Software Engineer, Lakehouse (Data Platform Group)
כדי להגיש, לשמור או לפתוח את דף המשרה מתחברים עם Google. זה חינם, ואחרי ההתחברות חוזרים ישר למשרה הזו.
תקציר
As AI reshapes cybersecurity, enterprises face a dual challenge: unlocking AI’s potential while defending against AI-driven attacks.
דרישות
- 5+ years of hands-on experience designing and developing large-scale distributed data systems in production, with a strong emphasis on performance.
- Deep, hands-on expertise in at least one of the following, at a significant scale:
- A columnar/analytical database — ClickHouse is a major advantage, including data modeling, query optimization, and operating it in production
- Apache Spark at an expert level, including tuning and optimizing large batch jobs.
- Experience with open table formats such as Iceberg, Delta Lake, or Hudi
- Experience with data lake technologies: Parquet, S3, and SQL query engines such as Athena, Trino, or Presto.
- Strong command of analytical data modeling and the design principles behind it: partitioning strategies, denormalization, batch vs. streaming trade-offs, and schema evolution.
- Strong Java and solid understanding of object-oriented design and software engineering principles.
- Experience building and running microservices on Kubernetes.
- Hands-on experience with the AWS platform, particularly EMR, S3, and Glue.
- Motivated, fast, independent learner and strong problem solver.
- A team player with excellent collaboration and communication skills.