Machine Learning Engineer - 3D Vision Perception

Onsite in Foster City, CA | at least 3 days onsiteThe Perception team seeks a talented Machine Learning Engineer to innovate advanced Computer Vision modules, significantly enhancing the onboard perception capabilities of our robotic fleet. This position will directly influence safety and operational efficiency. The ideal candidate will engage in the complete design and development process, encompassing data collection, dataset creation, and the design and implementation of machine learning models. Key Responsibilities:Architect and develop in-cabin Computer Vision ML modules for critical safety and monitoring applications.Implement advanced Perception model architectures and sophisticated training methodologies.Create high-quality datasets utilizing inputs from our sensor stack and large-scale data.Validate and optimize solutions through real-world driving scenarios, directly enhancing the safety and reliability of our autonomous systems. Essential Qualifications:Bachelor's Degree in Computer Science or Computer Engineering with a minimum of 4 years of relevant experience.Proficient in modern Computer Vision and Machine Learning, especially in areas like 3D reconstruction, detection, classification, and semantic segmentation.Experience in training and deploying Deep Learning models.Strong programming skills in C++ and/or Python.Exceptional communication abilities. Preferred Qualifications:Familiarity with any of the following:Experience in the self-driving industry.Expertise in integrating ML models within latency-sensitive systems.Proficiency in CUDA programming. Employee Benefits:Comprehensive Health Care Plan (Medical, Dental, and Vision).Life Insurance (Basic and Voluntary, including AD&D).Generous Paid Time Off (Vacation, Sick Leave, and Public Holidays).Opportunities for Training and Development.Retirement Plan options (401k, IRA).

Join the innovative 3D Simulation team at Zoox, where we are at the forefront of merging cutting-edge machine learning with advanced 3D vision technology. We are seeking passionate machine learning engineers to help enhance the realism in simulations and promote diversity within virtual environments. You will leverage unparalleled access to world-class sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. Our ML team is dedicated to generating intricate and diverse 3D environments, including lifelike representations of humans and varying environmental conditions. Your contributions will be instrumental in shaping the future of automated driving technology.

Join the dynamic 3D Simulation team at Zoox as a Senior Machine Learning Engineer specializing in 3D sensor simulation. In this pivotal role, you will harness advanced machine learning and generative AI techniques alongside state-of-the-art 3D graphics to create realistic simulations of various sensors, including cameras, lidar, and radar. You will have unparalleled access to top-tier sensor data and a robust infrastructure designed for thorough testing and validation of your algorithms. Collaborate closely with teams across Sensor Simulation, Perception, and Verification & Validation to enhance the accuracy and realism of sensor simulations. Your contributions will be critical in generating high-fidelity synthetic data for autonomous vehicle training and testing, as well as supporting real-time sensor data for hardware-in-the-loop simulations.

Join Zoox as a Senior Machine Learning Engineer specializing in Perception, where you will play a pivotal role in crafting and deploying state-of-the-art detection models that leverage integrated sensor data. This position focuses on pioneering projects tailored for the next generation of driving software, which includes developing joint detection and tracking models and innovating methods to transmit enriched embeddings to downstream models to enhance semantic understanding and uncertainty management.This unique opportunity allows you to significantly contribute to Zoox's venture into new horizons. By engineering more robust and adaptable models, you will aid in navigating complex and diverse scenarios, propelling our mission to achieve safe and dependable autonomous mobility. We seek an enthusiastic and driven individual who is eager to push the limits of perception technology in autonomous vehicles.

Join Visa Inc. as a Staff Machine Learning Engineer and be at the forefront of innovation in the financial technology landscape. In this role, you will leverage advanced machine learning techniques to create cutting-edge solutions that enhance our services and customer experience. You will collaborate with cross-functional teams to drive impactful projects and contribute to the growth of our machine learning capabilities.

The Perception team at Zoox plays a pivotal role in advancing our autonomous vehicle technology by creating a sophisticated understanding of the world for our self-driving robots. Our expertise enables safe and efficient navigation through complex environments by leveraging advanced detection, classification, and tracking systems.As a Senior Software Engineer within the perception mapping team, you will be an integral player in Zoox’s online mapping initiatives. Your responsibilities will encompass designing, training, validating, and integrating machine learning models that accurately detect semantic elements within our environment. This role will engage you in all phases of ML development, including data collection, labeling, training, validation, and onboard integration. Your contributions will be crucial in achieving significant milestones in scaling and enhancing our autonomy capabilities, ultimately driving the success of Zoox.

Join our innovative Prediction & Behavior ML team at Zoox, where we are at the forefront of developing cutting-edge machine learning algorithms that analyze and predict driving behaviors from complex data sets. Our algorithms are pivotal in enhancing both on-vehicle driving decision-making and off-vehicle simulation and validation processes. By closely collaborating with the Planner team, we ensure a seamless integration of behavior forecasting and motion planning, driving the advancement of our autonomous vehicle technology. Furthermore, our partnerships with the Perception, Simulation, and Systems Engineering teams enable us to rigorously validate and refine our driving performance.As a Learned Trajectory Machine Learning Engineer, you will be instrumental in designing and implementing advanced deep learning models that generate accurate trajectories for our vehicles. Your work will directly impact the integration of behavior prediction with motion planning, and you will collaborate extensively with Planner and Perception teams to elevate our vehicle's overall functionality and performance.

Join Zoox as a Senior Engineering Manager for our Machine Learning Platform. In this pivotal role, you will lead a talented engineering team, driving innovation and excellence in our machine learning initiatives. You'll be responsible for overseeing the architecture and development of ML systems that enhance our autonomous vehicle technology. Your leadership will empower engineers to explore cutting-edge solutions and collaborate across disciplines.At Zoox, we are committed to redefining mobility through advanced robotics and AI, aiming to create a seamless transportation experience that is safe, efficient, and sustainable.

As a Staff Machine Learning Engineer at Zoox, you will play a crucial role in shaping the future of autonomous mobility. You will work with a talented team to design and implement cutting-edge algorithms that enable the mapping and understanding of the world around our vehicles. This position is ideal for innovative thinkers who thrive in a dynamic environment and are passionate about machine learning and artificial intelligence.

Join the dynamic 3D Simulation team at Zoox, where we blend advanced Machine Learning and cutting-edge 3D graphics to create realistic simulations of sensors such as cameras, lidar, and radar. In this pivotal role, you will utilize world-class sensor data and a robust testing infrastructure to develop and refine algorithms that enhance the accuracy of sensor simulations. Collaborate closely with teams across Sensor Simulation, Perception, and Verification & Validation to continuously elevate the fidelity of our synthetic data, which is crucial for training and testing autonomous vehicle AI, as well as for real-time simulations involving hardware-in-the-loop.

Join Zoox as a Senior Machine Learning Engineer specializing in Scene Understanding. In this role, you'll leverage your expertise to develop advanced algorithms and models that enhance the understanding of complex scenes for autonomous vehicles. You will be part of a dynamic team that is committed to innovation and excellence in the field of machine learning.

Join the visionary Perception team at Zoox, where we are revolutionizing autonomous vehicle technology by creating an intricate understanding of our surroundings for self-driving robots. Our mission is to facilitate safe and efficient navigation within complex environments through advanced detection, classification, and tracking systems.As a pivotal software engineer on the perception mapping team, you will drive the development of Zoox's online mapping initiative. Your responsibilities will include designing, training, validating, and seamlessly integrating machine learning models that identify semantic map elements in real-world settings. You will engage in all facets of machine learning development, from data collection and annotation to training, validation, and onboard integration. Your contributions will be instrumental in achieving key milestones that enhance our scaling and autonomy capabilities, playing a crucial role in Zoox's success.

Join the Offline Driving Intelligence team at Zoox, where we are pioneering the development of Foundation Models for ML Agents and strategic planning. Our mission is to leverage these models off-vehicle to enhance generalization capabilities for simulation and validation processes. In this role, you will collaborate closely with teams focused on Planning, Simulation, and Validation to craft and assess our driving performance. As a Senior Machine Learning Engineer specializing in ML Agents and Planning, you will operate at the forefront of the industry, innovating machine learning pipelines and models to accurately predict the behavior of surrounding agents and determine optimal pathways for the ego vehicle.

Join the pioneering 3D Simulation team at Zoox, where we are redefining the boundaries between simulation and reality through innovative machine learning solutions. We are seeking talented Machine Learning Engineers who are passionate about leveraging cutting-edge research in 3D vision. In this role, you will have unparalleled access to world-class sensor data and a robust infrastructure that empowers you to test and validate your algorithms effectively. Collaborate with our ML experts to create dynamic and diverse 3D environments, including realistic human interactions and varying environmental conditions, making a significant impact on the future of autonomous vehicles.

Join Zoox as a Machine Learning Engineer specializing in Simulation Scenario Generation. In this role, you will be at the forefront of developing advanced algorithms and machine learning models that drive our autonomous vehicle technology. Your expertise will help create realistic simulations for testing and refining our systems, ensuring safety and efficiency on the road.

Join Zoox on an innovative journey to revolutionize autonomous mobility solutions for urban environments, leading to the safe deployment of our robotaxi service. We are seeking a seasoned Senior Machine Learning Engineer to enhance our automated testing and validation processes. This pivotal role focuses on leveraging advanced machine learning techniques to refine our validation processes, significantly improving the efficiency and scalability of testing across extensive datasets where traditional methods fall short. By integrating real-world fleet logs and synthetic data, your contributions will directly influence the validation of software modifications, ensuring the safety and reliability of our robotaxi service. Your expertise will accelerate our validation process, empowering Zoox to innovate swiftly and effectively. As part of a forward-thinking organization with strong leadership and a culture of transparency and respect, you will have the opportunity to maximize your potential and advance your career through demonstrated performance.

Join the innovative Offline Driving Intelligence (ODIN) team at Zoox, where we harness the power of advanced AI to develop sophisticated algorithms that interpret the world around us. Our cutting-edge models are first tested offline, paving the way for impactful integration into our self-driving robots, which are designed for safe and efficient navigation through complex environments.As a Machine Learning Engineer on the ODIN team, you will be at the forefront of developing advanced multimodal large language models to enhance environmental cognition. Your expertise will focus on refining these models for off-vehicle analysis, collaborating closely with the onboard team to ensure our robotaxi platform can swiftly identify hazards and navigate driving constraints with remarkable precision. You will work alongside a team of world-class engineers and researchers, leveraging high-quality sensor data and state-of-the-art infrastructure to validate your algorithms in real-world scenarios, significantly influencing the productivity, safety, and overall capabilities of Zoox's autonomous systems.

Are you passionate about leveraging machine learning to solve intricate challenges in the realm of autonomous vehicle testing? Join our Simulation Scenario Generation team at Zoox, where we are seeking a skilled Machine Learning Engineer to drive the development of innovative, scalable workflows for creating autonomous vehicle scenarios. Your work will encompass the generation of extensive traffic simulations and the enhancement of our intelligent AI systems to facilitate the creation of synthetic scenarios derived from natural language test specifications. This role presents a unique opportunity to make a significant impact on user experience while playing a vital role in advancing AI-driven safety validation for autonomous vehicles.

Join Zoox as a Machine Learning Engineer Intern in Perception and gain invaluable hands-on experience with cutting-edge technology while working alongside industry-leading experts. Our internship program is designed for outstanding students who exhibit exceptional academic performance, extracurricular involvement, and a genuine passion for our mission at Zoox. As part of the Perception team, you will contribute to the development of systems that empower our autonomous vehicles to understand their surroundings. You will have the opportunity to work in one of several dynamic teams, focusing on multimodal models, scene understanding, vehicle recognition, and hazard detection, all while utilizing state-of-the-art machine learning techniques and real-world data.