Staff System Modeling Engineer - Warfighter Systems

Role Overview Anduril Industries is hiring a Staff System Modeling Engineer for Warfighter Systems in Mountain View, California. This role centers on applying advanced modeling methods to improve military systems and support mission success. Work here shapes the effectiveness of defense solutions and has a direct impact on operational outcomes.

Logos Space is at the forefront of revolutionizing satellite communications with our Low Earth Orbit (LEO) satellite system, designed to meet the connectivity demands of commercial enterprises and government entities. We aim to bridge a crucial gap in the market by delivering robust, high-performance satellite-based connectivity solutions for our clientele around the globe. Our business customers will benefit from contracts that specify performance standards for broadband, which we will integrate into our system from the outset. Speed and reliability are the cornerstones of our infrastructure, ensuring seamless cloud and data center connectivity to fixed, maritime, and aerial terminals worldwide.Led by a team of seasoned engineers with extensive experience in networking and satellite technology, Logos Space is committed to innovation and excellence.Position Overview & ResponsibilitiesAs a member of the Networking team at Logos Space, you will play a pivotal role in ensuring the success of our network through the development of software-defined networking, performance monitoring, and other vital components of the ground segment. Your collaboration with other spacecraft design aspects—such as RF, power management, and more—will be essential. This network will uniquely provide services at Layer 2, 2.5, and 3, necessitating the development of methodologies to manage flows with enterprise-level assurance. Your work will evolve from conceptual frameworks to discrete event simulations at the message level, ultimately culminating in a digital twin of the deployed system.As an Algorithm and Network Simulation Engineer, you will be instrumental in designing, optimizing, and validating our pioneering hybrid space and terrestrial network. Your responsibilities will include creating intricate simulation models and algorithms to analyze performance metrics, assess emerging technologies, and enhance network behaviors within this complex ecosystem. This is a remarkable opportunity to spearhead core innovations within our network architecture.We're seeking engineers who thrive in dynamic environments and relish the challenge of transforming abstract design concepts into tangible hardware ready for testing and deployment. If you have a passion for solving complex problems, we want to hear from you!

Reliable Robotics builds automated aviation systems aimed at making air transportation safer and more efficient. The team includes engineers from aerospace, robotics, and autonomous vehicle backgrounds, all working to advance aviation technology. Role overview The Senior Model-Based Systems Architect will design and develop the company’s internal digital engineering ecosystem. This role involves more than configuring existing tools: the architect will define the formal information schema that connects systems, software, and certification data throughout the organization. What you will do Design and implement a digital engineering framework to support automated aviation systems Create and maintain a unified information schema linking systems, software, and certification data Collaborate with engineering teams and internal tool developers to ensure integration and smooth data flow Establish a scalable, consistent single source of truth for engineering information Location This position is based in Mountain View, CA.

Who We AreGatik is at the forefront of transforming middle-mile logistics through our cutting-edge autonomous transportation-as-a-service (ATaaS) solution. Our focus is on delivering safe and consistent services while enhancing freight movement efficiency and alleviating congestion. In 2021, we made history by launching the world's first fully driverless commercial transportation service in partnership with Walmart, with our Class 3-7 autonomous trucks actively operating in key markets like Texas, Arkansas, and Ontario, Canada.Our proprietary Level 4 autonomous technology, Gatik Carrier™, is meticulously engineered to facilitate safe and efficient freight transportation between pick-up and drop-off points. With robust capabilities tailored for both highway and urban settings, Gatik Carrier™ represents a comprehensive solution that seamlessly integrates advanced software and hardware to optimize logistics operations for our clients.About the RoleWe are seeking a Senior/Staff Systems Engineer to lead the Verification and Validation processes for Gatik’s autonomous vehicle systems. This position is primarily located at our headquarters in Mountain View, CA, with additional opportunities available in Fort Worth, TX.What You Will DoEstablish and implement model-based system engineering (MBSE) practices and methodologies for effective requirements management, ensuring clear communication of functional and performance requirements across stakeholders and system levels.Provide advanced systems expertise in integrating architectural changes and component revisions, ensuring optimal performance and efficiency in autonomous vehicle operations.

About Contextual AIAt Contextual AI, we are at the forefront of transforming how AI agents operate by addressing one of the most significant challenges in the field: context. By providing the right context at the right moment, we enable enterprises to achieve the accuracy and scalability required for effective AI deployment. Our innovative enterprise AI development platform bridges cutting-edge AI research with the practical needs of developers, allowing them to seamlessly ingest, query, and integrate data from various enterprise sources into their workflows.Founded by the pioneers of Retrieval-Augmented Generation (RAG), our technology forms the backbone of the context layer that connects foundational AI models with relevant real-time information. Supported by visionary venture capital, we are not merely participating in the enterprise AI revolution; we are leading it. Join us as we create a future in which AI not only answers queries but also revolutionizes business operations.About the RoleAs a Member of Technical Staff focused on LLM Systems & Performance, you will join a dedicated and impactful team responsible for building and optimizing LLM systems from end-to-end. Your work will range from developing Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) pipelines to creating high-throughput inference clusters for production environments. You will collaborate with both researchers and engineers to design advanced models and the supporting infrastructure for our context layer.What You'll DoEnhance and optimize components of our SFT and RL training pipelines (e.g., Verl, SkyRL), focusing on areas such as data loading, training loops, logging, and evaluation.Contribute to the development of LLM inference infrastructure (e.g., vLLM, SGLang), including optimizations for batching, KV-cache management, scheduling, and serving.Utilize profiling tools like Nsight to analyze and improve end-to-end performance metrics (throughput, latency, compute/memory/bandwidth) by identifying and resolving bottlenecks.Engage with distributed training and inference systems using technologies such as NCCL, NVLink, and various parallelism strategies on multi-GPU clusters.Assist in experimenting with and implementing quantization techniques (e.g., INT8, FP8, FP4, mixed-precision) for both training and inference.Write and optimize GPU kernels utilizing CUDA or Triton, employing techniques such as FlashAttention and Tensor Cores as appropriate.Collaborate with researchers to advance ideas from concept to prototype, through scaled experiments, and into production.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the most trusted driver globally. Originating from the Google Self-Driving Car Project in 2009, Waymo is committed to developing the Waymo Driver—The World’s Most Experienced Driver™—which aims to enhance mobility access while significantly reducing traffic-related fatalities. With over ten million rider-only trips completed, the Waymo Driver has autonomously navigated over 100 million miles on public roads and undergone extensive simulation across more than 15 states in the U.S.Our Hardware Engineering team is a dynamic and collaborative group of electrical, mechanical, reliability, software, and vehicle engineers. We create and refine the essential products that act as the sensory systems for Waymo's autonomous technology, integrating these innovations into various vehicle platforms. We are looking for inquisitive and skilled individuals to join our team and drive our mission forward.This position follows a hybrid work schedule and reports directly to the Electrical (Systems Engineering) Manager. Your Responsibilities Include:Collaborating with the Waymo Product team and OEM partners to establish requirements for Low Voltage systems and interfaces across our vehicle platforms. You will work closely with Functional Systems Engineers (e.g., Networks, Infotainment, Thermal, Security, Motion Controls, Body Controls) to define Low Voltage systems, including communication networks and architecture design, along with functional safety requirements.Drafting detailed specifications for Waymo’s embedded software and hardware interactions necessary for Low Voltage systems and functions, ensuring seamless integration with the vehicle platform and Self-Driving System.Focusing on power electronics systems engineering for our vehicle platforms, which includes requirement setting with OEM partners and internal teams, developing power system architecture, and conducting verification and validation against program milestones.Producing safety-related work products such as safety concepts, Fault Tree Analysis (FTA), and Failure Modes Effects and Diagnostic Analysis (FMEDA).Assisting in the creation of Verification and Validation (V&V) plans, analyzing test results for Low Voltage systems and platform communications across various prototypes. Planning and executing tests, assessing test data, and addressing field issues will be integral to this role.

About Matic RoboticsAt Matic Robotics, we are redefining the landscape of home automation. Each year, approximately 2.5 trillion hours are consumed in domestic chores. Our mission is to reclaim that time by innovating cutting-edge home robotics.Our flagship product, Matic, is an advanced floor-cleaning robot reminiscent of Wall-E, featuring full self-driving capabilities within the home. It utilizes real-time 3D mapping, adaptive path-tracking, and a sophisticated semantic understanding of domestic environments. Through breakthroughs in spatial AI, Matic operates efficiently in real-world homes, leveraging only RGB cameras and integrated neural networks.Privacy FirstYour privacy is paramount. Our robots are designed to ensure that all data processing occurs on-device, safeguarding your personal information.Our VisionSimilar to the evolution of consumer devices before the iPhone, we believe in the progressive development of home robotics. We start with specialized robots and gradually enhance their capabilities.Our CultureMatic Robotics thrives on a collaborative culture where dedicated individuals work together to create products that our customers love. We are passionate problem solvers committed to improving lives by saving precious time and energy.About the RoleAs a Firmware Systems Engineer, you will play a pivotal role in bridging software and hardware. You will facilitate communication between our hardware and software teams, ensuring seamless integration and functionality. This position requires a systems-level mindset with a focus on product outcomes.Key ResponsibilitiesThe firmware scope at Matic encompasses a diverse range of projects, including:Implementing and supporting hardware modifications (both electrical and mechanical). For instance, enhancing a sensing mechanism to detect bag fullness during mopping, which involves updating device drivers, conducting assembly tests, and adjusting robot behaviors accordingly.Designing and refining control algorithms and behavioral logic for Matic’s physical systems.Analyzing robot logs and performance data to optimize system functionality.

Join our innovative team at ServiceNow as a Senior Staff Software Engineer specializing in Agentic AI Systems. In this critical role, you will lead the design, development, and implementation of cutting-edge AI solutions that enhance our customer experience and drive operational efficiency. You will work collaboratively with cross-functional teams to create scalable and robust systems that utilize advanced machine learning techniques.

At Reliable Robotics, we are pioneering cutting-edge technology that enhances safety in aviation, ultimately saving lives. Our vision is to transform air transportation into a safer, more efficient, and revolutionary means of moving goods and people globally. Our dedicated team comprises mission-driven engineers with expertise in aerospace, robotics, and autonomous vehicles, all working diligently to make this vision a reality.As a Senior System Integration Engineer, you will collaborate with a dynamic team of mechanical, electrical, and software engineers, reporting directly to the System Integration Engineering Manager. This role is integral to a small, highly motivated team focused on designing, testing, and flying advanced automated systems. You will find joy in integrating mechanical and electrical hardware safely and efficiently onto aircraft.ResponsibilitiesIn your capacity as a Senior System Integration Engineer, you will take ownership of vehicle-level projects throughout the planning, design, and testing phases. Your projects will encompass primary flight control hardware, data acquisition systems, hardware-in-the-loop testing, ground station development, and seamless integration with software and human-machine interface teams. You will guide the scheduling and prioritization of substantial integration projects, ensuring critical aircraft functions are integrated and tested effectively.

About UsAt Aurora, we are dedicated to advancing self-driving technology that enhances safety, efficiency, and accessibility across transportation and logistics.Discover The Aurora Driver and join us in shaping the future of mobility.Become part of a team that thrives on solving intricate challenges, collaborating with like-minded professionals, and growing your expertise. For the latest updates from Aurora, visit aurora.tech or follow us on LinkedIn.We are on the lookout for a talented Staff Hardware Systems Architect to join our Hardware Architecture team. In this pivotal role, you will be instrumental in shaping the future of self-driving vehicle architectures while supporting cutting-edge systems deployed in the field. This is a unique opportunity that offers complete ownership—from the architectural design phase through validation and deployment—allowing you to tackle highly complex integration challenges across multiple disciplines.

The RoleAre you a talented software engineer eager to leverage your extensive experience in developing and enhancing production systems at the forefront of AI technology? If so, we invite you to consider our Staff Software Engineer position on the Natural Language Understanding team within our 'agent lab'. In this pivotal role, you will contribute significantly to our mission of extending the capabilities of AI agents to execute tasks reliably on a large scale.As part of the Moveworks AI Assistant platform, you will lead the innovation in areas such as agent orchestration, sandboxed file systems, latency optimization, agent memory, and the advancement of LLMs (Large Language Models). Our team thrives on rapidly developing scalable infrastructure and tackling complex product and engineering challenges to maximize value for our customers. If you aspire to achieve the pinnacle of your career while working with a passionate and impactful team, we would love to connect with you.What You Will Do:Lead and tackle challenging engineering projects to create and enhance dependable AI agent systems.Define and implement cutting-edge distributed systems, ensuring their scalability and production readiness, while integrating the latest advancements in machine learning and AI.Set technical direction and influence the engineering roadmap to deliver enduring value to our clients.Establish high standards for code quality, including robustness, extensibility, and performance.Collaborate with senior experts across various domains, including machine learning, security, product development, and customer success, to build world-class enterprise AI solutions.Mentor and develop team engineers, focusing on technical design, execution, and excellence.Work closely with machine learning engineers to define and develop end-to-end architecture for outstanding AI systems.

Join our dynamic team at LinkedIn Corporation as a Senior Staff Software Engineer specializing in Systems Infrastructure. In this pivotal role, you will be responsible for designing, implementing, and maintaining robust infrastructure systems that support our growing platform. You will collaborate with cross-functional teams to drive innovation and optimize our systems for scalability and performance.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the most trusted driver in the world. Launched in 2009 as the Google Self-Driving Car Project, we have since developed the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility and prevent traffic-related fatalities. Our technology has facilitated over ten million rides while autonomously navigating more than 100 million miles on public roads across 15+ states in the USA.The Waymo Onboard Infrastructure team is pivotal in managing low-level software and infrastructure across various components of our self-driving system. Our expertise spans low-level system software, high-bandwidth data logging, inter-process communication (IPC), performance analysis, and comprehensive system debugging. We collaborate closely with teams specializing in Hardware, Compute, Sensor, Perception, Behavior, and Machine Learning to create the most efficient and responsive self-driving solutions in the industry.We are currently looking for a seasoned Android System Software Engineer to join our team, focusing on the development of our In-Vehicle Infotainment (IVI) platform for our next-generation, in-house System-on-Chip (SOC). This role demands a solid understanding of low-level operating system principles, embedded software, and a proactive attitude towards validating hardware against critical software performance metrics.In this role, you will:System Bring-up & Integration: Implement and integrate low-level software, including bootloader configurations, device trees, and kernel porting during the initial hardware bring-up phase.OS/Kernel Development & Optimization: Customize and optimize the Linux Kernel and relevant aspects of the Android Open Source Project (AOSP) for the partner SOC, ensuring robust and efficient operation.Hardware Abstraction Layer (HAL) Implementation: Develop and maintain reliable Vendor HALs to interface with unique in-house hardware IP (e.g., security modules, power management units, display controllers) within the Android framework.Performance Engineering: Lead system-level performance optimization initiatives, focusing on boot time reduction, scheduling adjustments, thermal management, and power efficiency tailored to the SOC's architecture.Ambiguity Resolution: Proactively clarify technical requirements for features still being defined, ensuring rapid documentation and stabilization of interfaces for the broader software team.

Reliable Robotics develops automated aviation systems aimed at making air transportation safer and more efficient. The team combines experience in aerospace, robotics, and autonomous vehicles to advance how people and goods travel. Role overview The Senior Production Systems Engineer joins the Production team in Mountain View, CA. This group delivers high-quality products and services, supporting the company’s mission to move automated aviation systems from concept to production. The position provides technical leadership and shapes strategy for production capabilities, business systems, and factory infrastructure. What you will do Design and manage production systems that support manufacturing processes, quality standards, and regulatory compliance. Plan, develop, and lead the rollout of new features and modules in partnership with SaaS vendors and internal teams. Conduct trade studies to inform decisions about business systems and infrastructure. Set up, automate, and monitor key performance indicators (KPIs) to drive improvements in design, product, and process. Key focus areas Oversee integration and performance of Manufacturing Execution Systems (MES), Enterprise Resource Planning (ERP), and Material Requirements Planning (MRP) tools. Lead enhancements using AI, develop and refine production processes, and install factory infrastructure such as printers and inspection equipment. Create real-time analytics tools to support operations in a safety-critical environment.

About UsGatik is at the forefront of transforming the B2B supply chain through our innovative autonomous middle-mile logistics. Our transportation-as-a-service (ATaaS) solution emphasizes safety, consistency in deliveries, and the efficient movement of freight, reducing congestion for our partners. In 2021, we proudly launched the world’s first fully driverless commercial transportation service in collaboration with Walmart, utilizing our Class 3-7 autonomous trucks that are actively deployed across major markets including Texas, Arkansas, and Ontario, Canada.Our proprietary Level 4 autonomous technology, Gatik Carrier™, is meticulously designed to facilitate safe and efficient freight transport between pick-up and drop-off points on the middle mile. With its advanced capabilities tailored for both highway and urban environments, Gatik Carrier™ seamlessly integrates advanced software and hardware to enhance our clients' logistics operations.Job OverviewWe are looking for a skilled Reliability and Risk Engineer to spearhead the analysis, prediction, and enhancement of the reliability and safety of our autonomous trucking systems. In this role, you will collaborate across hardware, software, and systems teams to uncover failure modes, assess associated risks, and inform design decisions through data-driven approaches employing advanced statistical techniques.This position requires your presence onsite at our Mountain View, CA or Fort Worth, TX office five days a week!

Who We AreNuro is pioneering self-driving technology with the goal of making autonomy available to everyone. Established in 2016, Nuro is developing the world's most scalable autonomous driver, integrating advanced AI with automotive-grade hardware. Our core technology, the Nuro Driver™, is licensed for a variety of uses, ranging from robotaxis and commercial fleets to personal vehicles. With years of successful self-driving operations behind us, Nuro is paving the way for automakers and mobility platforms to implement autonomous vehicles at commercial scale, fostering a safer, more connected future.About the RoleAs a Senior/Staff Systems Engineer focusing on Autonomy Verification, your key responsibility will be to ensure the Nuro Driver's safety for deployment within our defined Operational Design Domain (ODD) and adherence to traffic regulations. This role requires a background in autonomous systems development or validation and a collaborative spirit to work effectively with diverse teams including Autonomy Software, Simulation, Product, and Operations. You will hold comprehensive ownership from defining requirements to designing metrics and developing test strategies.About the WorkEstablish requirements for the autonomous system to guarantee safe operation within its ODD and compliance with traffic laws.Develop metrics and acceptance criteria to confirm that the autonomous system meets these requirements, leveraging established safety standards and methodologies.Utilize a variety of testing strategies - synthetic and log simulations, on-road logs, closed-course tests, and third-party accident reconstructions - to validate requirements.Work closely with teams in Behavior, Perception, Data Science, Product, Legal, and Public Trust to formulate acceptance criteria for metrics and tests.Collaborate with simulation infrastructure and test integration teams to establish automated verification workflows.Assess the coverage of tests for our ODD, ensuring realism and relevance in simulations for deployment. Connect test outcomes as evidence supporting the Autonomy Safety Case.

P-186 At Databricks, we are passionate about empowering data teams to tackle some of the world's most challenging problems, from detecting security threats to advancing cancer drug development. Our mission is to build and operate the premier data and AI infrastructure platform, allowing our customers to concentrate on the high-value challenges central to their missions. Since our inception in 2013 by the original creators of Apache Spark™, Databricks has transformed from a small office in Berkeley, California, into a global powerhouse with over 1,000 employees. Today, thousands of organizations—from startups to Fortune 100 companies—trust Databricks with their mission-critical workloads, solidifying our status as one of the fastest-growing SaaS companies worldwide. Our engineering teams are dedicated to developing highly technical products that address real-world needs. We continuously push the limits of data and AI technology while ensuring the resilience, security, and scale essential for our customers' success on our platform. We manage one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we routinely encounter cloud hardware, network, and operating system faults, and our software must adeptly shield our customers from these challenges. In modern data analysis, sophisticated techniques such as machine learning extend far beyond the traditional SQL query engine's roll-up and drill-down capabilities. As a software engineer on the Runtime team at Databricks, you will contribute to building next-generation distributed data storage and processing systems that not only surpass specialized SQL query engines in relational query performance but also offer the expressiveness and programming abstractions necessary to support varied workloads, ranging from ETL to data science. Here are some example projects you might work on: Apache Spark™: Develop the de facto open-source standard framework for big data. Data Plane Storage: Provide reliable and high-performance services and client libraries for storing and accessing massive amounts of data on cloud storage backends like AWS S3 and Azure Blob Store. Delta Lake: A storage management system that merges the scale and cost-efficiency of data lakes with the performance and reliability of data warehouses, along with the low latency of streaming. Its higher-level abstractions, including ACID transactions and time travel, significantly simplify real-world data engineering architecture. Delta Pipelines: Managing a single data engineering pipeline can be challenging. The objective of the Delta Pipelines project is to streamline this process.

Be a Pioneer in Home RoboticsAt Sunday, we are at the forefront of developing personal robots designed to liberate individuals from the burden of monotonous chores. Our ambitious mission is to make versatile robots widely available, empowering households to reclaim precious moments.After dedicating the last 18 months to assembling a skilled team, securing funding, and validating our technology, we are eager to welcome passionate individuals to join us on this exciting journey. If you are ready to contribute your expertise to the cutting-edge world of robotics, we want to hear from you!Your Role in Our VisionIn our quest to create home robots, we are addressing a significant challenge in robotics: achieving dexterous and safe mobile manipulation in unpredictable environments. To accomplish this, we are innovating across the entire robotics stack. We are training advanced AI models that utilize our extensive, high-quality, real-world data collection system. Simultaneously, we are developing a novel consumer hardware product that will be integrated into homes, delivering tangible value to our customers. As a foundational member of a compact, cross-disciplinary team, your contributions will be vital in advancing both our technology and product, pushing the boundaries of embodied AI and providing our customers with the freedom to enjoy more of what they love.As a Robotics Systems Integration Engineer, you will be instrumental in ensuring that our home robots are reliable, safe, and capable of being produced at scale. You will collaborate closely with mechanical, electrical, and software engineers to identify and resolve issues with our current robots. Your insights will help refine our manufacturing and quality assurance processes and inform the system architecture for future design iterations. This role offers substantial responsibility and the opportunity to mold cutting-edge technology into a cohesive and trustworthy product.Key ResponsibilitiesIntegrate and test robotic systems, encompassing both actuation and perception hardware.Diagnose and debug interdisciplinary challenges across mechanical, electrical, firmware, and software domains.Initiate, test, and assess essential components, such as sensors and actuators.Maintain motor and sensor drivers, as well as associated software tools, using Python and C++.Establish clear processes for robot assembly, bringing up systems, quality assurance testing, and troubleshooting.Assist in defining component and subsystem performance requirements and develop testing protocols to ensure dependable robot operation.

Waymo is at the forefront of autonomous driving technology, striving to become the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has been dedicated to developing the Waymo Driver—The World’s Most Experienced Driver™—with the goal of enhancing mobility access while aiming to reduce the tragic loss of lives due to traffic accidents. The Waymo Driver not only fuels our fully autonomous ride-hailing service but is also adaptable across various vehicle platforms and applications. With over ten million trips solely for riders and extensive experience from autonomously navigating over 100 million miles on public roads, alongside tens of billions of miles in simulation across more than 15 U.S. states, we are leading the charge in this transformative technology.The Large Model Evaluation team plays a pivotal role in advancing Waymo's AI vision. As we integrate cutting-edge Large Language Models (LLMs) and Vision-Language Models (VLMs), our aim is to construct sophisticated AI systems capable of addressing the multifaceted challenges of real-world driving. Central to our achievements is the ability to accurately measure our progress. In a landscape where robust evaluation serves as a critical barrier to deploying large models, the intricacies of this task at Waymo are particularly complex and safety-sensitive. We seek quantitatively driven engineers to innovate and propose novel methodologies for evaluating the ML models utilized in the Waymo Driver.

Waymo is a pioneering force in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo focuses on developing the Waymo Driver—The World's Most Experienced Driver™—to enhance mobility access and significantly reduce traffic-related fatalities. The Waymo Driver powers our fully autonomous ride-hailing service and is adaptable across various vehicle platforms and applications. With over ten million rider-only trips completed and extensive experience from driving more than 100 million miles on public roads, complemented by simulations totaling tens of billions of miles across over 15 U.S. states, we are at the forefront of our industry.The Large Model Evaluation team plays a crucial role in advancing Waymo's AI ambition. As we leverage advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs), our goal is to create cutting-edge AI systems that navigate the complexities of real-world driving scenarios. Our progress hinges on our ability to measure performance effectively. With robust evaluation being essential for deploying large models, the challenges we face are particularly intricate and safety-critical. We are seeking engineers with a quantitative mindset to explore and establish innovative methods for assessing the machine learning models utilized in the Waymo Driver.