Distinguished Software Engineer - Data Infrastructure

Databricks is seeking a skilled Senior Manager in Infrastructure Data Science to revolutionize our infrastructure through the power of data science. In this role, you will address intricate challenges associated with capacity planning, performance enhancement, reliability engineering, infrastructure optimization, and customer satisfaction. You will lead a talented team of data scientists and collaborate closely with engineering leaders to provide them with actionable, data-driven insights and solutions.At Databricks, our mission is to empower data teams to tackle the world's most pressing issues, from detecting security threats to advancing cancer treatments. We achieve this by creating and managing the leading data and AI infrastructure platform, allowing our clients to concentrate on the high-impact challenges that are vital to their missions.Founded in 2013 by the original creators of Apache Spark, Databricks has evolved from a small office in Berkeley, CA to a global powerhouse with over 7,000 employees. Numerous organizations, ranging from startups to Fortune 100 companies, depend on Databricks for their critical workloads, positioning us as one of the fastest-growing SaaS firms worldwide.Our engineering teams develop highly technical products that meet significant, real-world needs. We continuously push the limits of data and AI technology, all while maintaining the resilience, security, and scalability that are essential for ensuring our customers' success on our platform.

Join LinkedIn as a Senior Staff Applied Scientist specializing in Infrastructure Data Science. In this pivotal role, you will leverage your expertise to drive innovation and enhance the efficiency of our infrastructure systems. You will collaborate with cross-functional teams, developing cutting-edge data solutions that significantly impact our global user base.Your responsibilities will include conducting advanced data analyses, modeling complex systems, and implementing machine learning algorithms to optimize performance. You will also mentor junior scientists and contribute to a vibrant research culture, ensuring that LinkedIn remains at the forefront of technology and data science.

About Us Nuro is pioneering self-driving technology with a vision to make autonomy accessible to everyone. Established in 2016, we are developing the world’s most scalable autonomous driver, merging advanced AI with robust automotive hardware. Nuro's proprietary technology, the Nuro Driver™, is licensed for various applications, including robotaxis, commercial fleets, and personal vehicles. Our technology has been validated through years of successful self-driving implementations, offering automakers and mobility platforms a sustainable pathway to commercial-scale autonomous vehicles, fostering a safer, more interconnected future. Role OverviewWe are seeking a proactive and innovative Product Manager to lead the development of our data infrastructure and labeling systems essential for autonomous vehicle advancement. The quality of data is paramount for our Machine Learning and Behavior teams, and this role is crucial in establishing systems and workflows that instill confidence in the data utilized. You will be responsible for implementing dashboards to automate data reconciliation, setting labeling standards to mitigate costly revisions, and creating scalable infrastructure as our fleet expands. This is a high-responsibility role that involves collaboration across Engineering, Operations, ML, and external vendors to transform processes into dependable, quantifiable systems. Key Responsibilities Enhance Data Visibility: Develop dashboards that integrate mileage data from multiple sources, track collection coverage, and provide insights into existing and missing data for the ML and Behavior teams. Streamline Data Collection: Establish criteria for intelligent data collection strategies to maximize targeting efficiency, driving fewer miles while capturing higher-value data. Expand Infrastructure: Create tools to support operations for over 150 vehicles across diverse cities. Elevate Labeling Standards: Take ownership of labeling specifications, establish quality thresholds, and design a vendor audit system to ensure confidence in output quality. Manage Labeling Tool Roadmap: Prioritize engineering efforts for labeling infrastructure and identify opportunities for cost savings through pre-labeling, optimized task routing, and reduced QA redundancies. Your Profile Problem Ownership: You thrive amidst complexity and ambiguity, ready to tackle fragmented processes and incomplete systems by establishing order and structure. Proven Track Record: You have a strong history of delivering results and driving projects to completion. Technical Acumen: Experience in data infrastructure or product management within tech or automotive sectors is a plus.

Join Nuro as a Senior Software Engineer specializing in Perception Data Infrastructure. In this pivotal role, you will be responsible for developing and optimizing systems that process perception data, enabling our autonomous vehicles to navigate safely and efficiently. You will collaborate with cross-functional teams to enhance our data infrastructure, ensuring reliability and scalability.

Join Commure, Inc. as a Senior Operations Manager specializing in Infrastructure. In this pivotal role, you will oversee the development and execution of operational strategies that enhance our infrastructure capabilities. You will lead cross-functional teams to ensure operational excellence, drive efficiency, and foster a culture of continuous improvement.Your responsibilities will include managing infrastructure projects from conception to delivery, optimizing processes, and collaborating with various departments to align operations with business objectives.

At Intrinsic Robotics, a part of Alphabet, we are on a mission to revolutionize industrial robotics. We believe that advancements in artificial intelligence, perception, and simulation will redefine the capabilities of industrial robotics in the near future, with software and data at the heart of this transformation. Our vision is to make industrial robotics more intelligent, accessible, and user-friendly for countless businesses, entrepreneurs, and developers. We are a vibrant team of engineers, roboticists, designers, and technology enthusiasts dedicated to unlocking the creative and economic potential of industrial robotics.Role OverviewAs a Software Engineer on our Data Infrastructure team, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that drives our state-of-the-art robotics systems. Your contributions will facilitate the design, development, and operational workflows for robotics, integrating with Kubernetes-based cloud and on-device services. This includes the systems responsible for collecting and processing real-world data from our robots, feeding that information into our machine learning pipelines to train and assess the models that empower our robots with intelligence. You will collaborate closely with an enthusiastic Product and Engineering team to create software that enhances the capabilities of fleets of robots.Your Impact on Our MissionDesign, develop, and maintain scalable and reliable data pipelines for the collection, processing, and storage of vast amounts of robotics data (including sensor data, telemetry, and logs).Construct data pipelines to train the next generation of functional robot models.Develop and support tools and infrastructure for data exploration, analysis, and visualization.Implement and uphold best practices for data security and privacy.Collaborate with Customers, Product Managers, and Researchers to tailor data pipelines for analysis and research.

About Us Nuro is a pioneering self-driving technology company dedicated to making autonomous solutions accessible to everyone. Established in 2016, we are developing the most scalable autonomous driver by integrating advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to facilitate a variety of applications, including robotaxis, commercial fleets, and personal vehicles. With proven technology from years of self-driving deployments, Nuro provides automakers and mobility platforms with a clear pathway to achieving commercial-scale autonomous vehicles, promoting a safer, more connected future. Role Overview At Nuro, we adopt a machine-learning-first strategy in our approach to autonomous driving technology. The performance of our systems is significantly influenced by the quality and diversity of training and evaluation data. Your team will be pivotal in enhancing our autonomous driving systems by establishing a robust and scalable data infrastructure. This infrastructure will generate training and evaluation data from both real-world driving logs and simulated environments. Collaborating closely with system engineers, you will ensure thorough validation of the autonomous driving system prior to deployment. Key Responsibilities Design and implement cohesive, introspectable data pipelines capable of processing large-scale batch and streaming data across diverse evaluation use cases. Develop a storage solution that efficiently manages extensive volumes and a wide variety of performance metrics. Create user-friendly dashboards and reports to display evaluation results, enabling easy comparisons to highlight improvements and regressions in ML components and the overall system. Establish and maintain continuous testing and monitoring systems to ensure the integrity and robustness of our data and data pipelines. Build data mining tools utilizing applied ML techniques to meet data discovery requirements in areas such as Perception, Behavior, and Mapping. Develop data annotation tools to aid both first-party and third-party labeling efforts, ensuring high-fidelity perception, mapping, and trajectory labels. Scale data annotation labels with cutting-edge ML techniques. Qualifications A degree in Computer Science, Engineering, or a related field (BS, MS, or PhD) combined with at least 4 years of relevant professional experience. Strong programming skills in Python or similar languages. Experience in data engineering, machine learning, or related fields. Familiarity with data pipeline tools and frameworks. Ability to work collaboratively in a fast-paced, innovative environment.

About Moveworks At Moveworks, our mission is to transform language into the universal user interface. We empower enterprises with a conversational interface that seamlessly integrates with all systems—from Microsoft to Workday to Salesforce. Utilizing advanced GPT-class machine learning models, our platform adapts to the unique language of each organization, effectively addressing thousands of use cases. Esteemed brands such as Databricks, Broadcom, DocuSign, and Palo Alto Networks rely on Moveworks’ proprietary enterprise data, ready-to-use solutions, and user-friendly developer tools to implement conversational automation across their businesses. Founded in 2016 and backed by leading investors including Kleiner Perkins and Lightspeed, Moveworks has raised $315 million in funding and reached a valuation of $2.1 billion. We are proud to be recognized as a part of the Forbes AI 50 list for five consecutive years and to have received accolades such as the 2023 Edison Awards for AI Optimized Productivity and the Best Bot Solution at the 2022 AI Breakthrough Awards. With over 500 employees across six global offices, we invite you to be a part of one of the most innovative teams in the industry! Your Role As the Senior Engineering Manager for our core infrastructure team, you will spearhead the development of the Moveworks AI infrastructure. As our company grows rapidly, your leadership will be crucial in designing and operating highly reliable and resilient foundational services and frameworks that enable seamless scalability and swift feature development for our engineering teams. You will collaborate closely with teams in machine learning, search, product management, data, and full-stack engineering to identify, define, and implement elegant solutions to complex product and engineering challenges. This is an exceptional opportunity to play a pivotal role at the fastest-growing AI startup in its sector. Lead the evolution of Moveworks infrastructure architecture and foundational services with a focus on high reliability, scalability, performance, and security. Collaborate with machine learning, search, product, data, and frontend teams to understand their infrastructure needs, influence the infrastructure roadmap, and oversee the execution of various projects. Architect and enhance the core infrastructure and foundational services to support our rapid growth and customer needs.

Join our innovative team at neo-tax as a Front-end Data Science Engineer, where you will play a crucial role in developing cutting-edge web applications. Collaborate closely with UI/UX designers to create intuitive user interactions and ensure a seamless experience across various devices. Your responsibilities will include:Optimizing applications for mobile and tablet users, ensuring responsiveness across platforms.Collaborating with data scientists and engineers to design novel UI/UX methodologies that highlight the value of data science within web applications.Analyzing collected data to identify strengths and weaknesses, and implementing user interfaces to effectively communicate these insights.Creating custom UI/UX solutions tailored to unique data models and algorithms.Researching and implementing suitable data science algorithms and user interface tools.Staying updated on the latest research and selecting effective UI and data representation methods.This position allows for full-time telecommuting.

P-57 At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems. Our mission is to create and operate the premier data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their objectives. Founded in 2013 by the original creators of Apache Spark, Databricks has expanded from a small office in Berkeley, California, to a global powerhouse with over 1,000 dedicated employees. Thousands of organizations, from small startups to Fortune 100 companies, rely on Databricks for their critical workloads, establishing us as one of the fastest-growing SaaS companies globally. Our engineering teams are committed to developing highly technical products that meet significant needs in the industry. We continuously push the limits of data and AI technology while ensuring resilience, security, and scalability—key factors in ensuring our customers' success on our platform. We manage one of the largest software platforms in existence, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we frequently encounter cloud hardware, network, and operating system issues, necessitating that our software effectively shields our customers from such challenges. As a Data Scientist on the Data Team, you will play a crucial role in fostering a data-driven culture at Databricks by working on the company's top priorities. The Data Team also acts as an internal customer, utilizing Databricks to shape the future direction of our products. Your Impact: Analysis at the speed of thought: Enhance decision-making capabilities by developing robust data science tools for business leaders, analysts, and fellow data scientists. Extend capabilities of Databricks: Collaborate closely with the Data Platform and Product Engineering teams to integrate data science tools with existing offerings and the core product. Strategic business insights: Spearhead insight generation for key company priorities and essential engineering initiatives focusing on reliability and efficiency. Gather evolving requirements, define project OKRs and milestones, and communicate progress and results to both technical and non-technical stakeholders. Mentor and guide junior data scientists on the team regarding project planning, technical decisions, and reviews of code and documentation. Represent the data science discipline across the organization, advocating for a more data-driven approach. Act as a representative for Databricks at academic and industry events.

P-1124 Summary At Databricks, we are passionate about empowering data teams to tackle the world's most challenging issues, from detecting security threats to advancing cancer drug development. We achieve this by developing and maintaining the leading data and AI infrastructure platform, allowing our clients to concentrate on the critical challenges that define their missions. Our engineering teams are dedicated to creating highly sophisticated products that address genuine, vital needs in society. We continually explore the frontiers of data and AI technology while ensuring the resilience, security, and scalability essential for our customers' success on our platform. Clients trust Databricks with their most valuable data, and the Trust & Safety team is committed to establishing the most reliable data analytics and machine learning platform globally. Security Engineering plays a pivotal role within Trust & Safety, crucially safeguarding customer data from malicious threats. We seek senior leaders to craft the vision and define the strategy for this crucial domain. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical gaps in our infrastructure and services. Attract top-tier talent from across the industry. Serve as a key advocate for the security engineering discipline throughout the organization, promoting a data-driven approach. Represent Databricks at academic and industry conferences and events.

Join MatX in Shaping the Future of AI InfrastructureAt MatX, we are pioneering the development of vertically integrated full-stack solutions that span from silicon to sophisticated systems for artificial general intelligence compute platforms. Our unique blend of hardware and software is complemented by a robust infrastructure team that manages essential systems — including build systems, CI/CD pipelines, cloud environments, security measures, and developer tooling — enabling our nimble team to deliver results at the speed of a much larger organization.We are seeking a proactive and experienced Infrastructure and IT Manager who will take ownership of our infrastructure and lead our talented team. In this role, you will engage in writing infrastructure-as-code, debugging build systems, triaging CI failures, and pushing code, while also focusing on hiring, mentoring, and defining the technical direction for our expanding platform team.

Join Databricks as a Senior Manager in Engineering, where you will lead innovation in Cloud Intelligence and Infrastructure Economics. This pivotal role involves strategizing and executing engineering solutions that drive efficiency and enhance cloud performance.

Moveworks, a part of ServiceNow based in Mountain View, is looking for a Senior Data Scientist. This position focuses on using advanced analytics to guide decision-making and enhance product features. Collaboration is central, as the Senior Data Scientist works with multiple teams to identify opportunities and shape solutions that use AI to transform customer service. Key responsibilities Analyze complex datasets to inform business and product strategies Partner with engineering, product, and other groups to address challenges and drive improvements Create new methods to strengthen AI-powered support tools Support ongoing initiatives to advance customer service through artificial intelligence Role overview This role centers on both technical analysis and cross-functional teamwork. The Senior Data Scientist will play a part in shaping how AI is used to improve customer experiences at Moveworks and ServiceNow.

As a Senior Staff Software Engineer specializing in Compute Infrastructure, you'll play a pivotal role in designing, building, and optimizing our cloud infrastructure systems. Your expertise will help drive performance and scalability, ensuring our platforms support the ever-increasing demand for data processing and storage. You will work collaboratively with cross-functional teams to develop innovative solutions that enhance our technology stack.

Your Role As a key member of the Core Infrastructure team at Moveworks, you will play a pivotal role in designing and implementing the next evolution of our AI infrastructure. With Moveworks experiencing rapid growth, the infrastructure team is charged with creating and maintaining robust foundational services and frameworks that empower our products to scale effortlessly while enabling our engineering teams to rapidly develop customer-facing features. Collaborate closely with teams in machine learning, search, product development, data, and frontend engineering to assess infrastructure requirements, shape the infrastructure roadmap, and spearhead various projects. Design and develop core infrastructure and essential functionalities including distributed key-value stores, schema-less data storage, authentication and authorization mechanisms, event streaming, distributed configuration management, rate limiting, circuit breaking, feature flagging systems, A/B testing, and traffic capture and replay. Enhance the observability and reliability of Moveworks systems by improving distributed logging, tracing, monitoring, and alerting capabilities. Establish methodologies and metrics for assessing the performance of microservices and product functionalities, identify and resolve bottlenecks, and enhance the performance and scalability of Moveworks applications. Consistently deliver time-sensitive work that is interdependent with other engineering teams.

P-1107 At Databricks, we are dedicated to empowering data teams to tackle the world's most pressing challenges, from detecting security threats to advancing cancer drug development. Our mission is to create and maintain the leading data and AI infrastructure platform, enabling our customers to concentrate on the significant challenges central to their objectives. Our customers entrust their most critical data to Databricks, and the Trust & Safety team is committed to establishing the most reliable Data and AI platform globally. The Security Foundation Engineering team plays a pivotal role in safeguarding our platform and customers from emerging threats. We are seeking a Senior Engineering Manager to spearhead this initiative and define how security is integrated into every layer of our platform.

At Databricks, we are committed to empowering data teams to tackle some of the world's most significant challenges—ranging from revolutionizing transportation to accelerating medical breakthroughs. Our mission is realized through the development and management of the foremost data and AI infrastructure platform, enabling our clients to derive deep insights from their data to enhance business outcomes. Founded by engineers and driven by a passion for customer success, we eagerly embrace each opportunity to confront technical hurdles, from innovating next-generation UI/UX for data interaction to scaling our services across millions of virtual machines. Our journey has just begun.As a Senior Staff Software Engineer, you will be a pivotal member of the executive leadership team within the Data Platform organization. You will utilize cutting-edge AI developer tools and methodologies to construct the Data Intelligence Platform, which will facilitate automated decision-making across Databricks. This role involves collaboration with distinguished Tech Leads, product teams, data scientists, and others. You will shape the future of various tools, including logging, orchestration, data transformation, metric stores, governance platforms, and data consumption layers.

Waymo is a pioneering company in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has committed to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save countless lives lost in traffic accidents. Our technology powers a fully autonomous ride-hail service and can be adapted to various vehicle platforms and applications. With over ten million rider-only trips and extensive experience driving more than 100 million miles on public roads and tens of billions of simulation miles across 15+ U.S. states, we are at the forefront of this transformative journey.The Simulation ML Infrastructure team is focused on creating scalable AI/ML infrastructure that accelerates the Simulator team in developing state-of-the-art realistic simulations for testing and training the Waymo Driver. To enhance the realism and steerability of these simulations, we leverage large foundation models trained on vast datasets to accurately represent the real world, including realistic agents (vehicles, pedestrians, cyclists, motorcyclists), road systems, traffic control measures, and environmental conditions.We are looking for a seasoned senior individual contributor to spearhead the advancement of sophisticated AI/ML infrastructure for multi-billion parameter foundation models within ML accelerator-friendly simulations. Your expertise in massive model scaling, ML accelerators, and large-scale distributed systems will be essential in designing and scaling our systems.This position reports to an Engineering Manager.Your Responsibilities:Join a top-tier, high-performing research engineering team to push the boundaries of ultra-realistic multi-agent simulations using foundation models.Collaborate closely with the Waymo Realism Modeling team located in London and the Waymo Oxford team to utilize large foundation models for enhancing simulation realism.Operate at the intersection of data engineering, model development, and simulations, making architectural decisions. Take ownership of large, complex systems, and ensure that architectures and designs align with both technical and business objectives.Design and scale extensive distributed systems that encompass the entire ML lifecycle, facilitating planet-scale dataset generation, model training, and evaluation.Work cross-functionally to derive performance and system-level requirements for large ML systems. Convert product and business goals into measurable technical deliverables, ensuring alignment of system components.