Research Scientist - Distributed Machine Learning

About the Institute of Foundation ModelsWe are a pioneering research lab focused on the development, understanding, application, and risk management of foundation models. Our mission is to propel research forward, cultivate the next generation of AI innovators, and make significant contributions to a knowledge-driven economy.Join our dynamic team and engage in the heart of innovative foundation model training, collaborating with top-tier researchers, data scientists, and engineers. Tackle groundbreaking challenges in AI development and contribute to transformative AI solutions that have the potential to revolutionize industries. Your strategic and innovative problem-solving skills will be vital in establishing MBZUAI as a global center for high-performance computing in deep learning, enabling impactful discoveries that inspire the future of AI innovation.Role OverviewDevelop and Enhance Distributed Pre-Training Frameworks· Implement DeepSpeed / FSDP / Megatron-LM on multi-node GPU clusters.· Design robust launch scripts, resilient checkpoints, and job monitoring systems (e.g., NCCL/GLOO/GPU).Transform Mathematical Concepts into High-Performance Production Code· Prototype novel optimizers or attention mechanisms using PyTorch/NumPy/JAX or similar frameworks.· Convert prototypes into efficient CUDA/Triton kernels with custom gradients and performance tests.Enhance Training Efficiency and Stability· Lead efforts in mixed-precision training, integrating bf16, fp8, etc., into regular workflows while assessing accuracy versus speed improvements and analyzing numerical stability.· Utilize kernel fusion, communication tuning, and memory optimization to achieve state-of-the-art throughput.Accelerate Research Progress· Develop logging and metrics systems, along with experiment-tracking tools, to facilitate rapid iteration.· Design ablation studies and statistical tests that validate or challenge new concepts.· Guide interns and junior engineers through clear asynchronous design documentation and code reviews.You will collaborate closely with researchers, deliver production code, and shape the landscape of large language models.

About the Institute of Foundation ModelsWe are an innovative research laboratory focused on the creation, comprehension, application, and risk management of foundation models. Our mission is to propel research forward, cultivate the next generation of AI innovators, and contribute significantly to a knowledge-driven economy.Joining our team presents a unique opportunity to engage in the core of advanced foundation model training, collaborating with leading researchers, data scientists, and engineers as we address the most pivotal and influential challenges in AI advancement. Your work will involve the creation of groundbreaking AI solutions with the potential to revolutionize entire industries. Employing strategic and innovative problem-solving skills will be crucial in establishing MBZUAI as a premier global center for high-performance computing in deep learning, fostering remarkable discoveries that inspire future AI trailblazers.

At Cerebras Systems, we are at the forefront of AI technology, developing the world's largest AI chip that is 56 times larger than conventional GPUs. Our innovative wafer-scale architecture enables the computational power of dozens of GPUs on a single chip, simplifying programming to the ease of handling one device. This unique design allows us to achieve unparalleled training and inference speeds, empowering machine learning practitioners to seamlessly deploy large-scale ML applications without the complexity of managing numerous GPUs or TPUs.Our clientele includes leading model labs, global enterprises, and pioneering AI-native startups. Recently, OpenAI announced a multi-year partnership with Cerebras aimed at leveraging 750 megawatts of scale to revolutionize critical workloads through ultra-high-speed inference.Thanks to our groundbreaking wafer-scale architecture, Cerebras Inference delivers the fastest Generative AI inference solution globally, exceeding GPU-based hyperscale cloud inference services by over tenfold. This significant boost in speed is transforming the user experience of AI applications, facilitating real-time iteration and enhancing intelligence through added agentic computation.About The RoleAs an Applied Machine Learning Research Scientist at Cerebras, you will be instrumental in converting modern machine learning methodologies into scalable, high-performance systems. This position focuses on the intersection of modeling and systems, emphasizing the efficient execution of existing algorithms rather than merely publishing new ones. Your efforts will significantly influence the training, optimization, and deployment of large language models (LLMs) on one of the most sophisticated AI platforms in existence.You will collaborate closely with fellow researchers and senior engineers to enhance workflows for LLM pretraining, fine-tuning, and reinforcement learning-based post-training. Your responsibilities will encompass building training pipelines, debugging complex system behaviors, improving model quality, and refining data and evaluation strategies. Your contributions will have a direct and meaningful impact on advancing our capabilities in AI.

About Applied IntuitionApplied Intuition, Inc. is at the forefront of advancing physical AI technologies. Established in 2017 and currently valued at $15 billion, this Silicon Valley powerhouse is dedicated to developing the essential digital infrastructure that will empower intelligent operations in every vehicle and machine worldwide. Our innovative solutions cater to the automotive, defense, trucking, construction, mining, and agriculture sectors, focusing on three pivotal areas: tools and infrastructure, operating systems, and autonomous capabilities. Our reputation is underscored by the trust placed in us by 18 of the top 20 global automakers and the United States military, among others. Our headquarters is in Sunnyvale, California, with additional offices in Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Discover more at applied.co.We promote a collaborative in-office culture and expect our team members to primarily work from their Applied Intuition office five days a week. However, we also value flexibility, allowing our employees to manage their schedules responsibly, which may include occasional remote work, starting the day with morning meetings from home, or leaving early to meet family obligations.About the Role and TeamWe are seeking enthusiastic Research Scientists to join our dynamic Research Group at Applied Intuition. Our mission is to develop pioneering technologies that drive the evolution of physical AI, particularly in two transformative applications: end-to-end autonomous driving and general-purpose robotics. Our team comprises distinguished experts from leading institutions and companies, celebrated for their remarkable contributions to both academia and industry, including eight Best Paper awards at prestigious conferences such as CVPR and ICRA. Learn more about our research initiatives at appliedintuition.com/research.With access to industry-leading tools and infrastructure, our researchers can leverage millions of miles of data from extensive fleets and implement their innovative methods across diverse autonomous and robotic systems, including self-driving vehicles and autonomous machinery.

About the Institute of Foundation ModelsAt the Institute of Foundation Models (IFM), we are committed to pioneering research related to building, comprehending, and managing foundation models effectively. Our goal is to push the boundaries of research, cultivate the next generation of AI innovators, and contribute significantly to a knowledge-driven economy.Joining our dynamic team means collaborating with top-tier researchers, data scientists, and engineers on the forefront of foundation model training. You will engage in developing innovative AI solutions that have the potential to transform entire industries. Your strategic problem-solving skills will play a crucial role in positioning MBZUAI as a global leader in high-performance computing for deep learning, facilitating groundbreaking discoveries that inspire future AI pioneers.The RoleWe are the AllWorld Team within the Institute of Foundation Models (IFM) at MBZUAI. Our team is at the cutting edge of developing PAN (Physical, Agentic, and Networked) world models—the next-generation foundation models that aim to expand machine intelligence beyond language.Our mission encompasses addressing the fundamental challenges associated with world modeling and establishing a new paradigm for next-generation machine reasoning. We invite passionate individuals who align with our vision and are eager to redefine the landscape of AI.

About the Institute of Foundation ModelsWe are a pioneering research laboratory focused on the construction, comprehension, utilization, and risk management of foundation models. Our mission is to propel research forward, cultivate the upcoming generation of AI innovators, and drive significant advancements in a knowledge-driven economy.Joining our team offers you the chance to engage with groundbreaking foundation model training at the forefront of technology. Collaborate with esteemed researchers, data scientists, and engineers to address key challenges in AI advancement. You will contribute to the development of innovative AI solutions with the potential to transform various industries. Your strategic and creative problem-solving skills will play a vital role in establishing MBZUAI as a premier global center for high-performance computing in deep learning, fostering discoveries that will inspire future AI leaders.The RoleAs a Research Scientist in the Data team, you will be responsible for curating high-quality web-scale data to drive the evolution of next-generation foundation models. Your work will involve investigating and consolidating diverse data sources and collaborating with cross-functional teams to perform comprehensive data research, contributing to MBZUAI's objective of catalyzing impactful AI breakthroughs and reinforcing our leadership in the global AI research landscape. Your expertise will be crucial in enhancing the efficacy of large-scale machine learning models while supporting the creation of transformative AI tools capable of influencing industries worldwide.

About Applied IntuitionApplied Intuition, Inc. is at the forefront of advancing the future of physical AI. Established in 2017 and currently valued at $15 billion, this Silicon Valley-based company is developing the digital infrastructure essential for instilling intelligence into every moving machine globally. Applied Intuition provides innovative solutions to a spectrum of industries, including automotive, defense, trucking, construction, mining, and agriculture, focusing on tools and infrastructure, operating systems, and autonomy. Renowned by eighteen of the top twenty global automakers, as well as the U.S. military and its allies, our solutions are trusted to deliver unparalleled physical intelligence. Our headquarters is located in Sunnyvale, California, with additional offices spread across Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Discover more at applied.co.We adopt an in-office culture, expecting our employees to primarily work from their Applied Intuition office five days a week. However, we value flexibility and trust our employees to manage their schedules responsibly, which may include occasional remote work, starting the day with morning meetings from home, or leaving early for family commitments.About the Role and TeamWe are seeking multiple enthusiastic Research Scientists to join our dynamic Research Group at Applied Intuition. Our mission is to innovate groundbreaking technologies that empower the next generation of physical AI, focusing on two pivotal applications that are transforming our daily lives: end-to-end autonomous driving and robotic general intelligence. Our team is composed of leading experts from prestigious institutions and companies, recognized for their outstanding contributions to academia and industry, including eight Best Paper awards from leading conferences and journals such as CVPR and ICRA. To learn more, visit appliedintuition.com/research.Backed by industry-leading tools and infrastructure, researchers have access to extensive datasets derived from large fleets and can deploy their developed methods across diverse autonomous and robotic systems, including self-driving cars and trucks.

About the Institute of Foundation ModelsWe are a pioneering research laboratory focused on the creation, comprehension, utilization, and risk management of foundation models. Our mission is to propel advancements in research, cultivate the next generation of AI innovators, and contribute significantly to a knowledge-driven economy.As a member of our esteemed team, you'll engage with leading researchers, data scientists, and engineers on the forefront of foundation model training, addressing some of the most crucial challenges in AI development. This role presents a unique opportunity to develop groundbreaking AI solutions with the potential to transform entire industries. Your strategic and innovative problem-solving capabilities will be vital in positioning MBZUAI as a global center for high-performance computing in deep learning, inspiring future AI trailblazers.Position SummaryAs a Research Scientist on our Reinforcement Learning team, you will be instrumental in shaping our scientific and technical strategies towards developing advanced capabilities in Foundation Models. This position requires innovating new methodologies in Reinforcement Learning to drive paradigm shifts in foundation modeling. Your responsibilities will include prototyping and refining novel learning approaches, enhancing large-scale RL training infrastructure, and producing reproducible code for public dissemination. Additionally, you will be expected to cultivate and maintain an impactful research portfolio through both internal and external collaborations.Key Responsibilities- Innovate research focused on large-scale self-play for foundation model training, agentic tasks, and equipping models with the ability to learn proactively from their environment.- Initiate and pursue cutting-edge algorithmic strategies within reinforcement learning to define and advance emergent capabilities in Foundation Models.- Engage in full-stack engineering, encompassing data curation, model architecture, algorithm design, and the final deployment of models for end-users with a commitment to high-quality, documented, and maintainable code.- Contribute to technical reports and research publications.- Represent MBZUAI at industry conferences and events.

About the Institute of Foundation ModelsWe are a pioneering research laboratory dedicated to the exploration, development, and responsible management of foundation models. Our mission is to propel research forward, cultivate the next wave of AI innovators, and foster transformative advancements in a knowledge-driven economy.Joining our team means engaging in groundbreaking foundation model training alongside leading researchers, data scientists, and engineers. You will confront significant challenges in AI development, working on innovative solutions that have the power to revolutionize entire industries. Your strategic and innovative problem-solving abilities will be vital in establishing MBZUAI as a premier global center for high-performance computing in deep learning, driving discoveries that inspire future AI trailblazers.The RoleAs a Research Scientist with a focus on Computer Vision, you will play a pivotal role in advancing state-of-the-art computer vision technologies and enhancing intelligent systems. Your responsibilities will include researching, developing, and implementing Computer Vision solutions, with particular emphasis on Python programming, machine learning techniques, and deep learning methodologies.

About the Institute of Foundation ModelsWe are a pioneering research laboratory committed to the creation, understanding, application, and risk management of foundation models. Our mission is to propel research, foster the next generation of AI innovators, and make transformative strides in a knowledge-driven economy.Joining our team offers you the chance to engage in forefront foundation model training, collaborating with esteemed researchers, data scientists, and engineers. Together, we will confront the most essential and impactful challenges in AI development. You will be instrumental in developing revolutionary AI solutions poised to transform industries. Your strategic and innovative problem-solving skills will help establish MBZUAI as a leading center for high-performance computing in deep learning, driving significant discoveries that motivate the next wave of AI pioneers.The RoleAs a Research Scientist focusing on data-centric large language model (LLM) advancement, you will work at the forefront of how LLMs reason, retrieve, and interact with external datasets. Your responsibilities will include identifying, collecting, and organizing datasets that empower LLMs to tackle complex reasoning tasks. You'll also develop scalable systems and tools that bridge cutting-edge research with robust engineering practices. Your contributions will have a direct influence on the performance and reliability of intelligent systems at MBZUAI IFM.

About the Institute of Foundation ModelsWe are a pioneering research laboratory focused on the development, understanding, application, and risk management of foundational models. Our mission is to propel research forward, cultivate the next generation of AI innovators, and make substantial contributions to a knowledge-driven economy.Join us and collaborate with top-tier researchers, data scientists, and engineers on the forefront of foundational model training. Engage in solving critical challenges that can redefine entire sectors through advanced AI solutions. Your strategic and innovative problem-solving skills will play a vital role in positioning MBZUAI as an international leader in high-performance computing for deep learning, facilitating discoveries that will inspire future AI trailblazers.The Role We are seeking a skilled distributed ML infrastructure engineer to enhance and expand our training systems. You will collaborate closely with distinguished researchers and engineers to:• Develop and scale distributed training frameworks (e.g., DeepSpeed, FSDP, FairScale, Horovod)• Implement distributed optimizers based on mathematical specifications• Create robust configuration and launching systems across multi-node, multi-GPU clusters• Manage experiment tracking, metrics logging, and job monitoring for enhanced external visibility• Enhance the reliability, maintainability, and performance of training systems• While much of your work will support large-scale pre-training, prior pre-training experience is not mandatory; strong infrastructure and systems expertise are our primary focus.Key Responsibilities • Distributed Framework Ownership – Extend or adapt training frameworks (e.g., DeepSpeed, FSDP) to accommodate new applications and architectures.• Optimizer Implementation – Convert mathematical optimizer specifications into distributed implementations.• Launch Config & Debugging – Develop and troubleshoot multi-node launch scripts with adaptable batch sizes and parallelism strategies.

Role overview Bosch Group is hiring a Research Scientist to work on comprehensive planning in autonomous systems. This role is based in Sunnyvale, CA and focuses on end-to-end planning for advanced autonomy projects. The work centers on research and development that shapes the future of autonomous technology. What you will do Advance research and development in planning for autonomous systems. Use technical expertise to improve how autonomous technologies perform and operate. Support projects that help define the capabilities and direction of upcoming autonomous systems. Location Sunnyvale, CA

About the Institute of Foundation ModelsAt the Institute of Foundation Models, we are committed to pioneering research that enhances the understanding, utilization, and risk management of foundation models. Our mission focuses on advancing research, cultivating future AI innovators, and making transformative contributions to a knowledge-driven economy.Join our dynamic team and engage in the forefront of groundbreaking foundation model training alongside leading researchers, data scientists, and engineers. You will address the most critical and impactful challenges in AI development, contributing to innovative AI solutions with the potential to revolutionize industries. Your strategic and creative problem-solving abilities will be key in positioning MBZUAI as a premier global center for high-performance computing in deep learning, fostering discoveries that will inspire the next generation of AI visionaries.Position SummaryAs a valued member of the Agents team, you will confront research and engineering obstacles related to training advanced agentic language models capable of employing reasoning and tool use to perform tasks on computers. The scope of challenges includes constructing high-quality training datasets, developing robust evaluation methods, and innovating reinforcement learning infrastructures, algorithms, and environments. We are seeking candidates with diverse expertise, ranging from algorithmic and empirical research to large-scale systems and optimization, reflecting the wide array of compelling problems we aim to address. Depth in any of these areas is highly regarded; there is no single “correct” background.Key Responsibilities· Propose, prototype, and scale systems and algorithms that support agentic learning.· Develop innovative paradigms for agentic behavior that extend beyond existing methodologies.· Contribute to technical reports, research publications, and open-source software initiatives.· Collaborate with interdisciplinary teams to create state-of-the-art foundation models.

Join Bosch Group as a Wireless Research Scientist, where you will contribute to cutting-edge research and development in wireless technology. You will work collaboratively with a talented team of experts, focusing on innovative solutions that drive the future of connectivity.

Role overview Bosch Group is looking for a Senior Research Scientist in Sunnyvale to focus on Vision, Language, and Action (VLA) Models. The position involves leading research efforts that advance artificial intelligence and machine learning, with a particular focus on integrating visual, language, and action-based data into unified models. What you will do Lead research initiatives in VLA models, helping to shape the next generation of AI applications. Collaborate with a team of experts to design and build models that connect vision, language, and action understanding. Contribute to Bosch Group’s technology strategy and support progress in AI research. Impact The research from this role will directly inform Bosch Group’s strategic choices and drive advancements in artificial intelligence technology.

About Applied IntuitionApplied Intuition, Inc. is at the forefront of advancing physical AI technologies. Established in 2017 and currently valued at $15 billion, this Silicon Valley powerhouse is building the essential digital infrastructure to infuse intelligence into every moving machine on Earth. Serving a diverse range of industries including automotive, defense, trucking, construction, mining, and agriculture, Applied Intuition excels in three key domains: tools and infrastructure, operating systems, and autonomy. Eighteen of the world's top 20 automakers, along with the United States military and its partners, rely on our solutions to deliver physical intelligence. Our headquarters is located in Sunnyvale, California, with additional offices in Washington, D.C.; San Diego; Ft. Walton Beach, FL; Ann Arbor, MI; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Discover more at applied.co.As an in-office company, we expect our employees to primarily work from their Applied Intuition office five days a week. However, we value flexibility and trust our employees to manage their schedules responsibly. This may include occasional remote work, starting the day with morning meetings from home, or leaving early for family commitments.Role and Team OverviewWe seek a dedicated Research Engineer (AI/RL Infrastructure) to join our Research Group at Applied Intuition. This position is perfect for engineers who design, build, and maintain large-scale machine learning systems and collaborate closely with researchers to innovate and enhance the foundational platform for next-generation physical AI systems.The Research Group's mission is to develop pioneering technologies that facilitate next-generation physical AI, focusing on two of the most challenging applications that are transforming our daily lives: end-to-end autonomous driving and robotic generalists. Our team comprises leading experts from prestigious institutions and organizations, recognized for their outstanding contributions in both academia and industry, including multiple Best Paper awards at top conferences and journals such as CVPR and ICRA. For further insights, visit appliedintuition.com/research.

About the Institute of Foundation ModelsAt the Institute of Foundation Models, we are committed to pioneering research in building, comprehending, and managing foundation models. Our mission is to push the boundaries of AI research, cultivate the next wave of AI innovators, and significantly contribute to a knowledge-driven economy.Join our dynamic team and engage in the forefront of foundation model training, collaborating with elite researchers, data scientists, and engineers. You will tackle some of the most pressing and transformative challenges in AI development, contributing to revolutionary AI solutions that can change entire industries. Your strategic and innovative problem-solving prowess will be key in positioning MBZUAI as a leading global hub for high-performance computing in deep learning, driving significant discoveries that will inspire future AI pioneers.The RoleAs a Research Scientist specializing in Natural Language Processing (NLP) with a focus on large language models and deep learning, you will play a pivotal role in the advancement of state-of-the-art language processing technologies and the development of intelligent systems. Your responsibilities will encompass a broad range of tasks, including the research, development, and implementation of NLP solutions, with emphasis on Python programming, machine learning techniques, and deep learning methodologies.

Join Cerebras Systems as an AI/ML Research Scientist and be part of a pioneering team at the forefront of advanced technology. In this role, you will leverage your expertise in artificial intelligence and machine learning to develop innovative solutions that will revolutionize the field. Collaborate with top-tier researchers and engineers to push the boundaries of what's possible.

Job Responsibilities:Lead and innovate in AI research projects focusing on the labeling, prediction, classification, clustering, description, and fusion of multi-sensor data, including acoustic, telemetry time series, vibration, radar, lidar, image, Wi-Fi, and ultrasound data. Enhance advanced driver assistance systems (ADAS) in vehicles and AI functionalities across various Bosch products.Design, architect, and validate multi-modal deep learning and Time Series Foundation Models (TSFM) tailored for multivariate time series signals.Integrate and expand time series models to utilize data from auxiliary modalities such as videos and images, improving contextual understanding.Provide expert insights to management within technological sectors, supporting strategic planning, research and development trajectories, and investment decisions.Stay updated on cutting-edge technological advancements, documenting and sharing research outcomes through high-quality publications and patent submissions.

About the Institute of Foundation ModelsWe are a pioneering research laboratory focused on developing, understanding, utilizing, and managing foundation models. Our mission is to propel research, cultivate the next generation of AI innovators, and create transformative impacts within a knowledge-driven economy.Join our dynamic team and seize the opportunity to engage in groundbreaking foundation model training, collaborating with elite researchers, data scientists, and engineers to address the most pressing challenges in AI development. You will contribute to the creation of innovative AI solutions with the potential to revolutionize industries. Your strategic and creative problem-solving abilities will play a crucial role in establishing MBZUAI as a global center for high-performance computing in deep learning, fostering discoveries that will motivate future AI trailblazers.The RoleAs a Machine Learning Engineer at the Institute of Foundation Models, your main duty will be to design and implement cutting-edge machine learning models that tackle real-world issues, pushing the limits of artificial intelligence research. You will work collaboratively with diverse teams to deploy scalable solutions, furthering MBZUAI’s goal of driving significant AI advancements and solidifying the institution’s status as a leader in the international AI research community. Your expertise will be vital in enhancing the performance of large-scale machine learning models and aiding in the development of transformative AI tools that can reshape industries globally.