LLM Inference Engineer
כדי להגיש, לשמור או לפתוח את דף המשרה מתחברים עם Google. זה חינם, ואחרי ההתחברות חוזרים ישר למשרה הזו.
תקציר
We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training.
דרישות
- 5+ years building or operating production LLM inference and serving systems.
- Deep, hands-on work with a modern inference framework vLLM, SGLang, TensorRT-LLM, Fireworks, or similar including its scheduler, paged attention / KV cache, model executor, and backend integration points.
- Strong Python and C++, with the ability to move fluidly between the two.
- A real grasp of transformer inference the prefill/decode split, KV cache behavior, and how batching dynamics shape latency and throughput.
- Distributed inference experience tensor and pipeline parallelism across multiple devices.
- An instinct for performance you can profile an end-to-end stack and chase a regression from the serving API all the way down to the kernel.