DevSec Next AI: How Lumigo Built Their Production-Grade Co-Pilot

Hosted by: Ariel Beck (Jit)
Speaker: Omri Levy (Lumigo)

1. Robust Evaluation Pipeline: The pipeline reruns real-world use cases to ensure model consistency and performance, leveraging tools like Langfuse - this is critical to ensure the agentic flow works well and won't hallucinate
2. Dynamic Model Switching: The importance is to switch models easily, as their context window and speed improves super quickly - so they can adjust and have better results - for example, switching to gemini 2.0 flash for less expensive faster processing
3. Multi-Agent Lambda Architecture: Multiple agents operate on one lambda function that scales as a whole, with all tools integrated via API calls - this is simpler and easier to scale independently
4. User Feedback Integration: User feedback—such as thumbs up and thumbs down—is actively used to refine and improve the system and is taken seriously.