Team8- Fintech Stealth Startup- Senior AI Researcher, Evaluation & Agent Performance
כדי להגיש, לשמור או לפתוח את דף המשרה מתחברים עם Google. זה חינם, ואחרי ההתחברות חוזרים ישר למשרה הזו.
תקציר
We build the context layer for engineering organizations. We connect code, runtime telemetry, data lineage, and operational systems into one live model of how software runs, then give AI agents that model through chat and MCP.
דרישות
- 7+ years in ML/NLP research or applied AI, including evaluating LLMs or agents.
- A track record of designing benchmarks: task sampling, contamination control, scoring methods, and power analysis.
- Deep knowledge of agent architectures: tool use, retrieval, multi-step planning, MCP or similar protocols.
- Expert Python, and production-quality eval infrastructure you have shipped.
- Experience leading research projects end to end, from design to publication or product.
- Publications at NeurIPS, ICLR, ACL, ICSE or FSE on LLM evaluation, code intelligence or agents. (advantage)
- Experience with repo-level code benchmarks (SWE-bench-style). (advantage)
- Experience with LLM-as-judge methods and their known failure modes. (advantage)
- A background in distributed systems, observability data, or large codebases. (advantage)