Director, Perception

About the Internship Zoox is seeking a Software Engineering Intern focused on Perception Data at our Foster City, CA location. This role supports the development of software that improves how our autonomous vehicles understand and interpret their surroundings. What You'll Work On Collaborate with engineers to build and refine perception systems for autonomou…

Join Zoox as a Senior/Staff Software Engineer specializing in Perception & Sensing, where you'll work alongside a talented team of engineers from various domains including AI, robotics, and computer vision. This role offers the opportunity to innovate and implement cutting-edge technologies, contribute to research initiatives, and enhance key systems that drive our vision forward. Your expertise will play a pivotal role in the development of algorithms, software, and solutions that enhance our autonomous vehicle technology.

Join us in revolutionizing personal transportation at Zoox, where we're creating a safer, cleaner, and more enjoyable future. Our unique vehicle design is tailored for navigating dense urban environments with bidirectional driving capabilities and four-wheel steering, enabling seamless maneuverability in tight spaces without the need to reverse. We are seeking an experienced Engineering Manager to lead our Perception Occupancy and Rare Events team. In this role, you will oversee the development of Zoox’s cutting-edge 3D environment model utilizing multi-modal sensor data. Your expertise will guide the creation of innovative AI architectures that blend the latest academic advancements with our pioneering in-house innovations. Our algorithms are meticulously optimized to perform effectively on diverse real-world data and in simulations. As a leader, you will steer high-impact teams, charting technical roadmaps and achieving milestone goals. Collaboration with other AI domains—such as Simulation, Sensor and Hardware, and Systems Design and Mission Assurance—will be essential in delivering a top-tier object occupancy perception system that integrates modalities including vision, lidar, radar, and long-wave IR. You will mentor a diverse team, tackling some of the most intricate challenges in artificial intelligence, perception, and sensor fusion.

Join Zoox's innovative Perception Object Detection and Tracking team, where we focus on the sophisticated perception of dynamic objects and individuals. In this pivotal role, you will collaborate directly with machine learning model teams to integrate state-of-the-art models into our vehicle technology stack.You will have unparalleled access to premier sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. We are pioneering new algorithms for segmentation, tracking, classification, and high-level scene comprehension, and you will have the opportunity to contribute to any (or all!) of these critical components.

Join Zoox as a Machine Learning Engineer Intern in Perception and gain invaluable hands-on experience with cutting-edge technology while working alongside industry-leading experts. Our internship program is designed for outstanding students who exhibit exceptional academic performance, extracurricular involvement, and a genuine passion for our mission at Zoox. As part of the Perception team, you will contribute to the development of systems that empower our autonomous vehicles to understand their surroundings. You will have the opportunity to work in one of several dynamic teams, focusing on multimodal models, scene understanding, vehicle recognition, and hazard detection, all while utilizing state-of-the-art machine learning techniques and real-world data.

Zoox’s Perception and Mapping Data team develops the systems behind high-definition maps for autonomous vehicles. These maps are essential for safe operation and expansion into new cities, as well as for keeping current routes accurate and up to date. Role overview This Software Engineer position centers on building and improving mapping systems that support Zoox’s autonomous driving technology. The work involves both creating new maps for additional locations and maintaining the quality of existing ones. What you will do Design and implement large-scale algorithms and workflows for HD mapping Build and maintain data pipelines to process mapping data efficiently Collaborate with cross-functional teams to address real-world challenges in autonomous driving Improve the speed and efficiency of mapping new areas and updating current maps Requirements Interest in solving challenging technical problems related to autonomous vehicles Experience with mapping systems, large data pipelines, or similar technical domains is valuable Location This role is based in Foster City, CA.

Join Zoox as a Senior Machine Learning Engineer specializing in Perception, where you will play a pivotal role in crafting and deploying state-of-the-art detection models that leverage integrated sensor data. This position focuses on pioneering projects tailored for the next generation of driving software, which includes developing joint detection and tracking models and innovating methods to transmit enriched embeddings to downstream models to enhance semantic understanding and uncertainty management.This unique opportunity allows you to significantly contribute to Zoox's venture into new horizons. By engineering more robust and adaptable models, you will aid in navigating complex and diverse scenarios, propelling our mission to achieve safe and dependable autonomous mobility. We seek an enthusiastic and driven individual who is eager to push the limits of perception technology in autonomous vehicles.

The Perception team at Zoox plays a pivotal role in advancing our autonomous vehicle technology by creating a sophisticated understanding of the world for our self-driving robots. Our expertise enables safe and efficient navigation through complex environments by leveraging advanced detection, classification, and tracking systems.As a Senior Software Engineer within the perception mapping team, you will be an integral player in Zoox’s online mapping initiatives. Your responsibilities will encompass designing, training, validating, and integrating machine learning models that accurately detect semantic elements within our environment. This role will engage you in all phases of ML development, including data collection, labeling, training, validation, and onboard integration. Your contributions will be crucial in achieving significant milestones in scaling and enhancing our autonomy capabilities, ultimately driving the success of Zoox.

Join the visionary Perception team at Zoox, where we are revolutionizing autonomous vehicle technology by creating an intricate understanding of our surroundings for self-driving robots. Our mission is to facilitate safe and efficient navigation within complex environments through advanced detection, classification, and tracking systems.As a pivotal software engineer on the perception mapping team, you will drive the development of Zoox's online mapping initiative. Your responsibilities will include designing, training, validating, and seamlessly integrating machine learning models that identify semantic map elements in real-world settings. You will engage in all facets of machine learning development, from data collection and annotation to training, validation, and onboard integration. Your contributions will be instrumental in achieving key milestones that enhance our scaling and autonomy capabilities, playing a crucial role in Zoox's success.

Join the innovative Perception team at Zoox, where we harness the power of Generative AI to produce synthetic data that revolutionizes the training and evaluation of our autonomous systems. As a Machine Learning Engineer specializing in Generative AI, you will be at the cutting edge of developing and training advanced models for sensor-level scenario generation. By utilizing world models and radiance field techniques alongside our extensive proprietary datasets, your work will have a direct impact on enhancing the productivity, safety, and capabilities of Zoox's autonomous systems through real-world algorithm validation.

Join our innovative Attributes team within the Perception department as a Senior / Staff Machine Learning Engineer. In this pivotal role, you will spearhead the development and enhancement of advanced behavioral models for diverse road users, such as vehicles, pedestrians, and cyclists. Your focus will be on establishing and maintaining robust perception attribute models that deliver critical signals to our autonomous driving stack. These signals are vital for empowering our Prediction and Planning teams to make intelligent and safe driving decisions for our autonomous vehicles.The Attributes team plays an essential role in Zoox's autonomous driving capabilities. The models you create will form the cornerstone of how our vehicles interpret and engage with other road users, directly influencing the safety and efficiency of our autonomous driving system. By delivering reliable and precise behavioral models, you will enable Zoox's vehicles to make informed, secure decisions in complex urban settings, helping us realize our vision of transforming urban mobility.

Zoox seeks a PhD Research Intern to work on multi-modal foundation encoders for perception. The internship involves research that advances perception systems used in autonomous vehicles. Key responsibilities Contribute to research projects that use multi-modal data and foundation encoders Work closely with a team focused on perception technology for self-driving vehicles Location This position is located in Foster City, CA.

High-definition maps are essential for ensuring safe and scalable autonomous driving. We are on the lookout for driven engineers who are enthusiastic about tackling intricate, real-world challenges while developing cutting-edge mapping systems.This position involves collaborating with a diverse and cross-functional team to design and implement extensive HD mapping algorithms, workflows, and data pipelines. Your contributions will significantly enhance our capability to efficiently map new urban areas and continuously update existing maps on a large scale, playing a pivotal role in expediting our autonomous vehicle deployment.

Join our team as a Database Engineer at Vertex Sigma Software in Foster City, CA. This position requires you to work onsite five days a week, with a 40-hour work schedule and flexibility for hours outside of typical business times. In this role, you will be responsible for designing, building, and operating robust and scalable data storage solutions that drive our applications and analytics. You will collaborate closely with application and data teams to define schemas, enhance performance, and automate operations leveraging AWS and infrastructure-as-code methodologies. Your contributions will significantly enhance reliability, minimize costs, and expedite the transition from development to production. Key responsibilities include:Designing and developing efficient, scalable database solutions that meet business needs.Installing, configuring, and upgrading database software and related tools.Monitoring performance and optimizing queries, indexes, and schemas for enhanced reliability and speed.Implementing and maintaining database security measures to safeguard sensitive information.Collaborating with application developers to refine schema designs and SQL.Troubleshooting incidents and providing prompt solutions across various environments.Documenting architecture, configuration, and operational procedures.Conducting capacity planning and recommending infrastructure enhancements.Managing and supporting AWS database infrastructure (e.g., RDS/Aurora/Redshift).Staying updated with emerging database technologies, patterns, and best practices.

About Zoox Zoox designs and builds fully autonomous electric vehicles, aiming for a future where transportation is safer, more sustainable, and accessible. The team values innovation, collaboration, and a forward-thinking approach to mobility. Internship Program Overview Zoox’s internship program offers hands-on experience with advanced technology and mentorship from experienced professionals in the field. The program looks for PhD interns with strong academic records, curiosity, and a commitment to Zoox’s mission. Engagement in activities beyond coursework is also valued. About the Physical AI Perception Internship This research internship sits within the Perception Semantics team, which focuses on developing AI systems that help robots interpret and interact with the physical world. Interns will explore topics in vision-language-action (VLA) modeling, world modeling, spatial reasoning, and mapping. The work spans both theoretical research and practical implementation. Projects are exploratory and research-driven, encouraging interns to investigate new ideas, create solutions, and test them in real-world scenarios. This role suits PhD candidates interested in pushing the boundaries of computer vision and embodied AI, with the opportunity to see their research have real impact.

Join Zoox as a Technical Service Data Engineer, where you will play a crucial role in translating intricate engineering specifications and 3D CAD data into precise repair procedures within our ERP system. Your expertise will serve as the vital link between Design Engineering and the Shop Floor, ensuring that every detail—from bolts to torque values and Joint IDs—is meticulously documented throughout the engineering change lifecycle.Key Responsibilities:ERP Tasklist Authoring: Develop and maintain comprehensive repair 'Tasklists' in the ERP system, mapping specific Part Numbers, Joint IDs, and essential assembly values such as torque and sequence.CAD Data Extraction: Utilize CATIA to navigate complex assemblies, identify components, and verify spatial requirements for repairs, analyzing the 3D environment to determine necessary removals or replacements.Change Management (CM): Serve as the Data Agent for Engineering Change Orders (ECOs), assessing the impact of design shifts on existing repair procedures and manually updating the ERP to reflect the latest data.Technical Documentation: Convert engineering jargon into clear, logical repair steps, akin to a Technical Writer, but with a deep understanding of mechanical repair.

Join our team as an Autonomous Vehicle Safety Data Engineer on a contract basis, where you will play a vital role in ensuring the safety of Zoox's autonomous vehicles. The Safety Strategy & Operations team is dedicated to establishing and executing safety protocols, from thorough safety planning and risk management to operational safety, data analysis, and regulatory compliance. This position focuses on leveraging fleet and simulation data to assess and enhance behavioral safety and hardware performance of our autonomous vehicles.You will be instrumental in analyzing fleet data to pinpoint critical safety incidents, evaluate system behavior, and refine strategies that impact vehicle performance in complex environments. Your responsibilities will include developing and maintaining robust data infrastructure to highlight safety-related interactions, evaluate AV events, and provide data-driven insights to inform autonomy development. Additionally, you will build scalable data pipelines and metrics that ensure we receive reliable signals from the data, directly influencing our assessment of system readiness and accelerating safe deployment.Key Responsibilities:Develop and maintain data miners that identify significant events from fleet and simulation data.Enhance the accuracy and efficiency of existing miners using advanced statistical and machine learning techniques.Construct scalable data pipelines and dashboards to monitor miner performance and key safety metrics.Conduct exploratory data analyses to reveal trends and opportunities to improve vehicle behavior.Triage and evaluate AV events for potential safety, legal, or regulatory concerns.Establish clear triage guidelines for both onshore and offshore teams.Support regulatory reporting processes with relevant data and analyses.

Replit is an innovative software creation platform that empowers individuals to develop applications using natural language. With millions of users globally, including over 500,000 businesses, we are at the forefront of democratizing software development by dismantling traditional barriers to application creation.Job SummaryWe are seeking a skilled Growth Infrastructure Engineer to architect and sustain the robust technical framework that facilitates scalable growth experiments, high-performance data pipelines, and automated systems to enhance user acquisition, engagement, and product evolution. This pivotal role integrates growth, product, and infrastructure, merging advanced technical engineering with experimentation and data-informed optimization.You will collaborate with cross-functional teams encompassing product management, data science, and back-end engineering to ensure seamless execution and scalability of growth initiatives across our systems.

Replit is a groundbreaking platform that revolutionizes software creation, empowering individuals to build applications seamlessly using natural language. With a thriving community of millions and over 500,000 businesses utilizing our services, Replit is on a mission to democratize software development and eliminate the conventional barriers that hinder application creation.About the Opportunity:As a member of our innovative engineering team, you will embark on a 12-week, paid internship where you will collaborate with top-tier engineers, designers, and product managers to shape the future of software development. You will work on impactful features that serve millions, ranging from our AI-driven development environment to the infrastructure that supports dynamic collaboration.This internship goes beyond traditional learning; you will contribute meaningful code that furthers the democratization of software creation. Whether you're optimizing cloud infrastructure, crafting user-friendly developer tools, or enhancing our AI capabilities, your contributions will empower creators globally.Your Responsibilities:Deliver real features to our extensive developer community using Replit's platformEngage in cross-functional collaboration with engineers, designers, product managers, and AI researchersEnhance developer experiences that make coding accessible for everyoneDevelop and optimize cutting-edge AI tools and infrastructure that drive the next wave of software creationGain insights from industry leaders in a dynamic environment that values your ideas and contributionsQualifications:Currently enrolled in a Bachelor's, Master's, or PhD program in Computer Science, Computer Engineering, or a related technical disciplineMust have at least one semester of academic coursework remaining post-internshipProficient in at least one programming language with comfort in full-stack developmentDemonstrated passion for developer tools, AI, and making technology accessibleAbility to thrive in a fast-paced environment and adapt to shifting prioritiesOur Core Values:Innovative Problem Solving: Approach complex challenges with strategic thinking and create effective solutionsCollaboration: Foster a culture of teamwork and support to achieve shared goalsInclusivity: Embrace diversity and create an environment where everyone’s voice is heard