Senior AI Engineer
To apply, save or open the job page, sign in. Sign-up is by invitation only for now, and after signing in you come straight back to this job. No invite? Ask to join
Summary
Zafran is building the next generation of vulnerability and risk management. We bring together complex security data and turn it into clear investigation, prioritization, and action.
Requirements
- 5+ years of backend or infrastructure engineering, with strong system design skills.
- Proven experience building and operating production-grade AI / LLM infrastructure — real users, real traffic, real incidents. Not prototypes.
- Deep hands-on experience with agentic systems: tool use, structured outputs, prompt and context management, retrieval, and long-running or streaming flows.
- Experience designing and running LLM evaluations at scale.
- Strong Python skills.
- Production experience on AWS and Kubernetes, including observability (tracing, metrics, logs).
- Ownership mindset — you treat the platform as a product and other engineers as your customers.
- Experience with Amazon Bedrock, Strands Agents, LiteLLM, MCP, or OpenTelemetry (our current stack). (advantage)
- Experience building internal developer infrastructure used by multiple engineering teams. (advantage)
- Experience with model evaluation, safety controls, governance, or LLM security (guardrails, prompt injection). (advantage)