AI Red Team – GenAI Adversarial Evaluation
כדי להגיש, לשמור או לפתוח את דף המשרה מתחברים עם Google. זה חינם, ואחרי ההתחברות חוזרים ישר למשרה הזו.
תקציר
As an Adversarial AI Evaluation Scientist, you will review and validate adversarial agent tasks: indirect prompt-injection (IPI), data-exfiltration, tool-misuse, and related attack scenarios to ensure each one is realistic, fair, deterministic, reproducible, and correctly graded.
דרישות
- 4+ years in an analytical, ML, security-research, or applied-research role, including hands-on work with adversarial ML, LLM security, red-teaming, or AI safety evaluation.
- Bachelor’s or Master’s in Computer Science, Machine Learning, Statistics, a related quantitative field, or equivalent practical experience.
- Working knowledge of prompt injection / indirect prompt injection, jailbreaks, data exfiltration, or tool-misuse attacks against LLM-based systems or agents.
- Strong Python and data-analysis skills.
- Solid grounding in statistics and experiment design: distributions, variance analysis, hypothesis testing, and anomaly detection: applied to evaluation and attack-success measurement.
- Experience building or auditing data-driven validation, evaluation, or quality frameworks.
- Experience using LLMs for analysis, evaluation, code generation, or automated remediation.
- Strong understanding of reproducibility, deterministic systems, and automated testing.
- Sharp adversarial thinking and the ability to spot subtle ways a test can be unfair, gameable, or mis-graded.
- Excellent analytical, problem-solving, and communication skills.
- Certifications in offensive cybersecurity (e.g., OSWA, OSWE, OSCE3, SEC542, SEC522) (advantage)
- Experience designing or evaluating AI agents, LLM-powered applications, or agentic workflows (e.g. email/doc assistants, tool-using agents). (advantage)