PhD Research Intern - Multi-Modal Foundation Encoder for Perception

Zoox seeks a PhD Research Intern to work on multi-modal foundation encoders for perception. The internship involves research that advances perception systems used in autonomous vehicles. Key responsibilities Contribute to research projects that use multi-modal data and foundation encoders Work closely with a team focused on perception technology for self-dri…

At Zoox, we are on a mission to revolutionize urban mobility with our groundbreaking fully autonomous electric vehicle, meticulously designed for ride-hailing services. Our dynamic and collaborative team is dedicated to creating a transformative mobility experience that prioritizes safety and efficiency. This exciting opportunity allows you to play a pivotal role in the development of a trailblazing product.We are seeking a seasoned Manager of Multi-Modal LLM Applications to spearhead a talented team focused on harnessing advanced Large Multi-Modal Models (MLLMs) to tackle significant offline autonomy challenges. Your expertise will be essential in integrating cutting-edge AI technologies into our autonomous driving platform, making a direct impact on the safety and performance of our innovative solutions.

Join Zoox as a Senior Machine Learning Engineer specializing in Perception, where you will play a pivotal role in crafting and deploying state-of-the-art detection models that leverage integrated sensor data. This position focuses on pioneering projects tailored for the next generation of driving software, which includes developing joint detection and tracking models and innovating methods to transmit enriched embeddings to downstream models to enhance semantic understanding and uncertainty management.This unique opportunity allows you to significantly contribute to Zoox's venture into new horizons. By engineering more robust and adaptable models, you will aid in navigating complex and diverse scenarios, propelling our mission to achieve safe and dependable autonomous mobility. We seek an enthusiastic and driven individual who is eager to push the limits of perception technology in autonomous vehicles.

Join Visa Inc. as a Staff Machine Learning Engineer and be at the forefront of innovation in the financial technology landscape. In this role, you will leverage advanced machine learning techniques to create cutting-edge solutions that enhance our services and customer experience. You will collaborate with cross-functional teams to drive impactful projects and contribute to the growth of our machine learning capabilities.

Join Zoox as an AI Inference Engineer specializing in Model Optimization & Deployment, where you will play a vital role in advancing our cutting-edge autonomous vehicle technology. You will be responsible for optimizing AI models to ensure efficient deployment and high performance in real-world scenarios. Your expertise will help shape the future of mobility.

Join our dynamic Prediction & Behavior Machine Learning team at Zoox, where we are at the forefront of developing cutting-edge machine learning algorithms that analyze and predict driving behaviors. Our innovative solutions are applied both on-vehicle to enhance driving performance and off-vehicle to elevate simulation and validation processes. Our close collaboration with the Planner team ensures a seamless integration of behavior forecasting and motion planning, propelling advancements in vehicle behavior. We also engage with our Perception, Simulation, and Systems Engineering teams to enhance our validation capabilities, ensuring safety and efficiency.As a Learned Trajectory Machine Learning Engineer, you will play a pivotal role in creating advanced deep learning models that generate driving trajectories for our vehicles. Your work will involve close cooperation with the Planner and Perception teams, contributing to the evolution of our vehicle behavior in a collaborative, innovative environment.

The Perception team at Zoox plays a pivotal role in advancing our autonomous vehicle technology by creating a sophisticated understanding of the world for our self-driving robots. Our expertise enables safe and efficient navigation through complex environments by leveraging advanced detection, classification, and tracking systems.As a Senior Software Engineer within the perception mapping team, you will be an integral player in Zoox’s online mapping initiatives. Your responsibilities will encompass designing, training, validating, and integrating machine learning models that accurately detect semantic elements within our environment. This role will engage you in all phases of ML development, including data collection, labeling, training, validation, and onboard integration. Your contributions will be crucial in achieving significant milestones in scaling and enhancing our autonomy capabilities, ultimately driving the success of Zoox.

Join our innovative Prediction & Behavior ML team at Zoox, where we are at the forefront of developing cutting-edge machine learning algorithms that analyze and predict driving behaviors from complex data sets. Our algorithms are pivotal in enhancing both on-vehicle driving decision-making and off-vehicle simulation and validation processes. By closely collaborating with the Planner team, we ensure a seamless integration of behavior forecasting and motion planning, driving the advancement of our autonomous vehicle technology. Furthermore, our partnerships with the Perception, Simulation, and Systems Engineering teams enable us to rigorously validate and refine our driving performance.As a Learned Trajectory Machine Learning Engineer, you will be instrumental in designing and implementing advanced deep learning models that generate accurate trajectories for our vehicles. Your work will directly impact the integration of behavior prediction with motion planning, and you will collaborate extensively with Planner and Perception teams to elevate our vehicle's overall functionality and performance.

Join Zoox as a Senior Engineering Manager for our Machine Learning Platform. In this pivotal role, you will lead a talented engineering team, driving innovation and excellence in our machine learning initiatives. You'll be responsible for overseeing the architecture and development of ML systems that enhance our autonomous vehicle technology. Your leadership will empower engineers to explore cutting-edge solutions and collaborate across disciplines.At Zoox, we are committed to redefining mobility through advanced robotics and AI, aiming to create a seamless transportation experience that is safe, efficient, and sustainable.

As a Staff Machine Learning Engineer at Zoox, you will play a crucial role in shaping the future of autonomous mobility. You will work with a talented team to design and implement cutting-edge algorithms that enable the mapping and understanding of the world around our vehicles. This position is ideal for innovative thinkers who thrive in a dynamic environment and are passionate about machine learning and artificial intelligence.

Join the dynamic 3D Simulation team at Zoox, where we blend advanced Machine Learning and cutting-edge 3D graphics to create realistic simulations of sensors such as cameras, lidar, and radar. In this pivotal role, you will utilize world-class sensor data and a robust testing infrastructure to develop and refine algorithms that enhance the accuracy of sensor simulations. Collaborate closely with teams across Sensor Simulation, Perception, and Verification & Validation to continuously elevate the fidelity of our synthetic data, which is crucial for training and testing autonomous vehicle AI, as well as for real-time simulations involving hardware-in-the-loop.

Join Zoox as a Senior Machine Learning Engineer specializing in Scene Understanding. In this role, you'll leverage your expertise to develop advanced algorithms and models that enhance the understanding of complex scenes for autonomous vehicles. You will be part of a dynamic team that is committed to innovation and excellence in the field of machine learning.

Join the visionary Perception team at Zoox, where we are revolutionizing autonomous vehicle technology by creating an intricate understanding of our surroundings for self-driving robots. Our mission is to facilitate safe and efficient navigation within complex environments through advanced detection, classification, and tracking systems.As a pivotal software engineer on the perception mapping team, you will drive the development of Zoox's online mapping initiative. Your responsibilities will include designing, training, validating, and seamlessly integrating machine learning models that identify semantic map elements in real-world settings. You will engage in all facets of machine learning development, from data collection and annotation to training, validation, and onboard integration. Your contributions will be instrumental in achieving key milestones that enhance our scaling and autonomy capabilities, playing a crucial role in Zoox's success.

Join the innovative 3D Simulation team at Zoox, where we are at the forefront of merging cutting-edge machine learning with advanced 3D vision technology. We are seeking passionate machine learning engineers to help enhance the realism in simulations and promote diversity within virtual environments. You will leverage unparalleled access to world-class sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. Our ML team is dedicated to generating intricate and diverse 3D environments, including lifelike representations of humans and varying environmental conditions. Your contributions will be instrumental in shaping the future of automated driving technology.

Join the Offline Driving Intelligence team at Zoox, where we are pioneering the development of Foundation Models for ML Agents and strategic planning. Our mission is to leverage these models off-vehicle to enhance generalization capabilities for simulation and validation processes. In this role, you will collaborate closely with teams focused on Planning, Simulation, and Validation to craft and assess our driving performance. As a Senior Machine Learning Engineer specializing in ML Agents and Planning, you will operate at the forefront of the industry, innovating machine learning pipelines and models to accurately predict the behavior of surrounding agents and determine optimal pathways for the ego vehicle.

Join the pioneering 3D Simulation team at Zoox, where we are redefining the boundaries between simulation and reality through innovative machine learning solutions. We are seeking talented Machine Learning Engineers who are passionate about leveraging cutting-edge research in 3D vision. In this role, you will have unparalleled access to world-class sensor data and a robust infrastructure that empowers you to test and validate your algorithms effectively. Collaborate with our ML experts to create dynamic and diverse 3D environments, including realistic human interactions and varying environmental conditions, making a significant impact on the future of autonomous vehicles.

Join Zoox as a Machine Learning Engineer specializing in Simulation Scenario Generation. In this role, you will be at the forefront of developing advanced algorithms and machine learning models that drive our autonomous vehicle technology. Your expertise will help create realistic simulations for testing and refining our systems, ensuring safety and efficiency on the road.

Join Zoox on an innovative journey to revolutionize autonomous mobility solutions for urban environments, leading to the safe deployment of our robotaxi service. We are seeking a seasoned Senior Machine Learning Engineer to enhance our automated testing and validation processes. This pivotal role focuses on leveraging advanced machine learning techniques to refine our validation processes, significantly improving the efficiency and scalability of testing across extensive datasets where traditional methods fall short. By integrating real-world fleet logs and synthetic data, your contributions will directly influence the validation of software modifications, ensuring the safety and reliability of our robotaxi service. Your expertise will accelerate our validation process, empowering Zoox to innovate swiftly and effectively. As part of a forward-thinking organization with strong leadership and a culture of transparency and respect, you will have the opportunity to maximize your potential and advance your career through demonstrated performance.

Join Zoox as a Senior/Staff Machine Learning Engineer specializing in Perception and HD Mapping. In this pivotal role, you will leverage your expertise in machine learning and computer vision to develop cutting-edge solutions that enhance our autonomous driving technology. You will collaborate with a talented team to design, implement, and optimize algorithms that process and interpret complex data from various sensors, contributing to the creation of our next-generation mapping systems.

Join the innovative Offline Driving Intelligence (ODIN) team at Zoox, where we harness the power of advanced AI to develop sophisticated algorithms that interpret the world around us. Our cutting-edge models are first tested offline, paving the way for impactful integration into our self-driving robots, which are designed for safe and efficient navigation through complex environments.As a Machine Learning Engineer on the ODIN team, you will be at the forefront of developing advanced multimodal large language models to enhance environmental cognition. Your expertise will focus on refining these models for off-vehicle analysis, collaborating closely with the onboard team to ensure our robotaxi platform can swiftly identify hazards and navigate driving constraints with remarkable precision. You will work alongside a team of world-class engineers and researchers, leveraging high-quality sensor data and state-of-the-art infrastructure to validate your algorithms in real-world scenarios, significantly influencing the productivity, safety, and overall capabilities of Zoox's autonomous systems.