Senior Staff Software Engineer - Data Infrastructure

Join Us in Transforming the Grocery IndustryAt Instacart, we are passionate about connecting the world through food. Our mission is to ensure that everyone has access to their favorite groceries while enjoying more quality time with loved ones. We view grocery delivery not just as a service, but as a complex and exciting challenge that allows us to cater to the diverse needs of our community. Through our platform, we provide an essential service that millions rely on for their grocery and household needs, while also creating flexible earning opportunities for our Personal Shoppers.Instacart has become a lifeline for countless individuals, and we are seeking talented professionals to help us advance our mission. If you are ready to make a significant impact in your career, we invite you to join our team.Embrace Flexibility with InstacartWe recognize that different people thrive in different environments. Our Flex First approach empowers employees to choose their ideal work setting, whether that's at home, in an office, or a cozy café, while fostering a sense of community through regular in-person events. Discover more about our flexible work philosophy.Role OverviewAs a Senior Staff Software Engineer on the Data Infrastructure team, you will lead the technical vision for our data platform, which is crucial to our company's data strategy. This role involves overseeing everything from storage and compute layers to streaming infrastructure, analytics tools, and governance systems.This position is ideal for a systems thinker who excels at bridging deep technical expertise with strategic company-level impact. You will create a multi-year architecture roadmap for our core data platform, guide significant platform investment decisions, and serve as a thought leader within both our engineering teams and the broader data infrastructure community. Your contributions will directly shape the decision-making processes at Instacart and influence the platform economics of one of the most data-centric technology companies in grocery commerce.

About Watney RoboticsAt Watney Robotics, we are pioneers in developing autonomous robotic solutions aimed at enhancing critical infrastructure. Recently securing $21 million in seed funding from leading investors such as Conviction, Abstract, and A*, we are collaborating with the world’s largest hyperscalers to propel the expansion of data centers and streamline maintenance processes.This is an extraordinary opportunity to join our team at a pivotal stage as we transition from prototype to large-scale production. Be part of a team that not only ships cutting-edge systems but also plays a crucial role in shaping the operational framework of an innovative robotics company.

At Docker, we are transforming the landscape of application development, empowering developers to focus on what truly matters. Our globally distributed, remote-first team is driven by a shared enthusiasm for innovation and exceptional developer experiences. With over 20 million active users and 20 billion image pulls each month, Docker stands as the leading tool for building, sharing, and running applications—trusted by both emerging startups and Fortune 100 companies. As we embark on an exciting growth journey, we invite you to join us for an incredible adventure!We are on the lookout for a Senior Software Engineer to become a vital member of our Data Infrastructure team, driving the technical advancement of our data systems that underpin analytics company-wide. As Docker scales to serve millions of developers and thousands of enterprise clients globally, we are in need of a senior technical leader who can design, cultivate, and deploy scalable data infrastructure that empowers data-driven decision-making across our Product, Engineering, Sales, Marketing, Finance, and Executive teams.In this hands-on leadership position, you will blend individual technical contributions with strategic thinking and mentorship. Your responsibilities will include architecting and implementing robust data systems and processes tailored to Docker's analytics requirements while setting technical standards and best practices for our data organization. Collaborating closely with cross-functional teams, you will gather requirements and deliver data solutions that drive key business outcomes.To succeed in this role, you must possess expert-level technical skills in modern data platforms, exceptional system design abilities, and the capacity to influence technical direction while mentoring and nurturing fellow engineers. You will play an essential part in scaling Docker's data capabilities as we continue to broaden our product offerings and serve enterprise customers around the globe.

At Sift, we are revolutionizing the way modern machines are constructed, tested, and operated. Our platform empowers engineers with real-time observability over high-frequency telemetry, eliminating bottlenecks and facilitating faster, more dependable development.Sift emerged from our collaborative efforts at SpaceX on projects such as Dragon, Falcon, Starlink, and Starship—where scaling telemetry, debugging flight systems, and ensuring mission reliability necessitated innovative infrastructure. Founded by a team with backgrounds at SpaceX, Google, and Palantir, Sift is engineered for mission-critical systems where precision and scalability are imperative.As an early engineer focused on our data infrastructure, you will play a pivotal role in defining core architecture while helping to scale a real-time telemetry platform from its inception. You will engage in developing complex backend systems aimed at ingesting, storing, and serving millions of high-frequency data points per second, thus enabling rapid iteration cycles for some of the world's leading engineering teams.

Join us in revolutionizing the grocery sector!At Instacart, we believe in the power of food to bring people together. Our mission is to ensure that everyone has access to the food they love, allowing them more time to enjoy it with family and friends. While others may see grocery delivery as a simple task, we recognize the intricate challenges and vast opportunities that come with meeting our community's diverse needs. We provide a vital service that customers trust to receive their groceries and household essentials, while also delivering flexible earning opportunities for Instacart Personal Shoppers.Instacart serves millions of individuals and families, and we are building a dedicated team to continue our growth. If you are eager to do your best work, we invite you to join our team.Embrace a Flex First Approach!At Instacart, we understand that there is no single way to achieve our best work. Our employees have the freedom to choose their work environment—be it from home, an office, or a favorite café—while still maintaining connections and community through regular in-person events. Discover more about our flexible work philosophy.Role OverviewOur Data Infrastructure team is responsible for developing and maintaining the systems that fuel Instacart's data ecosystem. This includes a cutting-edge open data lakehouse built on Apache Iceberg, a multi-engine computing platform tailored for both streaming and analytical workloads, along with self-service tools that empower teams in Product, Data Science, Machine Learning, Ads, Finance, and Engineering to effectively utilize data.We are on the lookout for a Staff Software Engineer specializing in Data Infrastructure to join our Data Governance and Foundations Team. In this pivotal role, you will take charge of the architecture and implementation of our open lakehouse foundation, governance, access patterns, and multi-engine compute strategies. You will be instrumental in balancing the immediate reliability needs with scalability, maturity, and cost-effectiveness for the next three to five years.Your responsibilities will involve close collaboration with engineering leadership and stakeholders across Data Science, ML Platform, Ads Infrastructure, Finance Engineering, Product Engineering, and Security. You will operate with significant ownership in a fast-paced environment where your architectural decisions carry substantial technical and financial implications. If you thrive in addressing complex, large-scale challenges and are ready to roll up your sleeves, this is your opportunity to make an impact.

About UsAt Temporal, we are pioneering an open-source programming model designed to simplify coding, enhance application reliability, and empower developers to focus on delivering features with speed. Our mission is to establish ourselves as the dependable backbone of every developer’s toolkit, and we are actively assembling a team to realize this vision. Our core values shape our actions, decisions, and teamwork, driving us to make a meaningful impact. We embody curiosity, determination, collaboration, authenticity, and humility. As we expand, we invite those who resonate with our values, challenge conventional thinking, and aspire to shape our future. If you are passionate about enhancing the developer experience, creating exceptional open-source software and communities, we would be thrilled to connect with you!SummaryWe are seeking a Senior Staff Software Engineer within our Infrastructure division, tasked with steering technical vision, establishing architectural standards, and executing intricate, high-impact projects spanning cloud computing, traffic management, security, and reliability. This pivotal role will take ownership of the technical design and implementation of systems that power Temporal Cloud. You should be adept at leading technical discussions with stakeholders, engaging with strategic customers, and collaborating effectively with executives, engineering leaders, and individual contributors across diverse teams. Your motivation to mentor and elevate engineering standards, along with a proven track record of significant technical contributions, will set you apart. Invent:Define and implement the long-term architectural strategy for our multi-cloud computing and traffic platforms.Lead hands-on execution of essential infrastructure projects, prioritizing reliability, system automation, and performance at scale.Develop multi-year technical roadmaps that outline the vision for infrastructure scalability, reliability, security, and engineering efficiency.Foster a culture of engineering excellence and operational integrity.Own:Provide technical leadership and mentorship to engineers through design reviews and code contributions, defining technical direction and removing architectural hurdles to execution.Ensure end-to-end technical governance for your systems, aligning execution with architectural vision and best practices.Act as a pivotal technical advisor to Engineering Leadership and Product Management.

At Databricks, we are committed to empowering data teams to tackle some of the world's most significant challenges—ranging from revolutionizing transportation to accelerating medical breakthroughs. Our mission is realized through the development and management of the foremost data and AI infrastructure platform, enabling our clients to derive deep insights from their data to enhance business outcomes. Founded by engineers and driven by a passion for customer success, we eagerly embrace each opportunity to confront technical hurdles, from innovating next-generation UI/UX for data interaction to scaling our services across millions of virtual machines. Our journey has just begun.As a Senior Staff Software Engineer, you will be a pivotal member of the executive leadership team within the Data Platform organization. You will utilize cutting-edge AI developer tools and methodologies to construct the Data Intelligence Platform, which will facilitate automated decision-making across Databricks. This role involves collaboration with distinguished Tech Leads, product teams, data scientists, and others. You will shape the future of various tools, including logging, orchestration, data transformation, metric stores, governance platforms, and data consumption layers.

At Genius Sports, we combine cutting-edge technology with premier live data to revolutionize the sports experience for fans around the globe. Our mission is to create more immersive, interactive, and personalized experiences than ever before. Discover more about us at geniussports.com.The Role - Staff Engineer - Infrastructure Platform We are on the lookout for an exceptional Staff Engineer to spearhead critical projects within our core infrastructure platform. Genius Sports is currently integrating its diverse tech teams and acquisitions under a cohesive technical strategy, and our infrastructure platform is the foundation of this transformation. Our primary objective is to empower engineering teams to efficiently build, deploy, and manage Genius Sports’ extensive product catalog in a consistent manner. In this role, you will collaborate with fellow InfraPlat leaders to define and execute the technical vision and implementation across an array of projects. These initiatives encompass multi-account and region Kubernetes clusters, MLOps, standardized deployment processes, and a centralized authentication platform. You will also engage with stakeholders from product engineering teams to assess requests, identify common challenges, and prioritize initiatives.

Verkada seeks a Senior Staff Software Engineer to join the Platform Infrastructure team in San Mateo, CA. This senior technical position focuses on shaping and improving the core infrastructure that underpins Verkada's products, with particular attention to performance and scalability. Key Responsibilities Lead the design, building, and ongoing support of platform infrastructure. Partner with engineering teams to deliver software solutions that enable the platform to grow and adapt. Spot opportunities to improve reliability and efficiency, and guide initiatives to address them. Collaboration Frequent collaboration with cross-functional teams is central to this role. The goal is to ensure that infrastructure evolves to meet the demands of both current and future products.

At Plaid, we believe in the power of data-driven decision-making. Our data culture demands robust and scalable data systems that ensure accuracy and completeness. As a Senior Software Engineer focusing on Data Infrastructure, you will play a pivotal role in empowering teams across engineering, product, and business sectors to swiftly and securely extract valuable data insights. Your work will directly enhance our ability to serve customers effectively. You will be responsible for building and optimizing our data and machine learning infrastructure, allowing Plaid engineers to innovate and iterate on products built on consumer-permissioned financial data. Our Data Infrastructure engineers are experts in Data Warehousing, Data Lakehouse architecture, Spark, Workflow Orchestration, and Streaming technologies. You will enhance our existing data pipelines for performance and cost efficiency while creating intuitive abstractions that simplify the development process for other engineers at Plaid.

About Applied IntuitionApplied Intuition, Inc. is at the forefront of advancing physical AI technologies. Established in 2017 and currently valued at $15 billion, this Silicon Valley powerhouse is dedicated to creating the essential digital infrastructure that empowers intelligence in every moving machine globally. Our solutions cater to key sectors including automotive, defense, trucking, construction, mining, and agriculture, with a focus on tools and infrastructure, operating systems, and autonomy. Trusted by 18 of the top 20 global automakers, along with the United States military and its allies, Applied Intuition is headquartered in Sunnyvale, California, with a global presence in cities including Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Discover more at applied.co.Our company thrives on in-office collaboration, and we expect our employees to primarily work from their respective Applied Intuition offices five days a week. We understand the need for flexibility, allowing for responsible management of schedules, including occasional remote work, starting the day with morning meetings from home, or leaving early to accommodate family commitments.About the RoleWe are seeking talented infrastructure engineers with a deep understanding of scaling open-source data infrastructure to join our Data & ML Infrastructure group. This dynamic role involves engaging with the entire data lifecycle — from collection, ingestion, and storage to querying and retrieval. You will collaborate closely with various business units to design and develop both internal and external products. Managing vast amounts of data to meet the demands of Applied Intuition's platform is critical, and we need a proactive individual who can actively support our data products and verticals across the organization. At Applied Intuition, we encourage our engineers to take ownership of technical and product decisions, actively engage with both internal and external users for feedback, and contribute to a vibrant, collaborative team culture.

Join the Suno TeamAt Suno, we are revolutionizing the music industry by harnessing the power of cutting-edge AI technology. Our platform empowers creators from all walks of life—whether you're a casual singer in the shower or a professional artist—to unleash their musical potential through innovative tools like Suno Studio, a game-changing generative audio workstation. We are on a mission to foster a vibrant community where music is created, shared, and discovered, making musical expression accessible and enjoyable for everyone.Your Role as a Senior Software EngineerWe are seeking passionate individuals to join our foundational software engineering infrastructure team. In this role, you will collaborate closely with our founding members, taking charge of a diverse range of technical and design decisions that shape the architecture and products at Suno.Key ResponsibilitiesDesign and implement robust services capable of managing high consumer traffic and data loads.Create systems that prioritize performance, security, scalability, and observability.Set a standard for operational and software engineering excellence by leading through example.Desired QualificationsA minimum of 5 years' experience in infrastructure-related roles.Proficiency with cloud platforms (AWS/GCP), container orchestration (Kubernetes), and tools for infrastructure as code (Pulumi/Terraform/CDK).Demonstrated experience in scaling infrastructure from conception to execution.Strong expertise in Postgres and distributed relational databases, with experience in large-scale database hosting considered a plus.Excellent backend development skills aimed at optimizing application performance; familiarity with websockets, CDNs, and streaming traffic patterns is advantageous.Thorough understanding of security best practices relevant to infrastructure design and scaling.Experience in MLOps, large-scale inference, and ML data pipelines is a plus.A commitment to engineering excellence, rapid iteration, and continuous learning.Prior experience in technical leadership or management is a bonus.A passion for music—whether listening, exploring, or creating—would greatly enhance your fit with our team.A Bachelor's degree or equivalent experience is required.Note: Candidates must be eligible to work in the United States.

Roblox Corporation seeks a Senior Software Engineer focused on Data Infrastructure and Safety in San Mateo, CA. This position plays a key part in maintaining the reliability and performance of the Roblox platform, with a strong focus on user protection and a secure environment. Role overview This engineer will design and build scalable data infrastructure to support Roblox’s continued growth. The work centers on improving data quality and reliability, ensuring the platform remains robust as user numbers increase. Collaboration with teams from various disciplines is essential to identify, investigate, and resolve safety-related issues. System architecture decisions made in this role will directly influence user safety and experience. Responsibilities Develop and implement scalable data infrastructure solutions for the Roblox platform Enhance data quality and reliability across systems Work with cross-functional teams to address and resolve safety issues Contribute to architectural decisions that impact user safety and overall experience Requirements Significant experience in software development, data management, and system architecture Proven ability to design solutions that scale with the platform’s growth Strong collaboration skills, especially for addressing safety concerns across teams This role directly influences the safety and experience of millions of Roblox users, supporting the company’s ongoing commitment to a secure and engaging platform.

Join the Revolution at CheckAt Check, we are transforming the payroll landscape. Our mission goes beyond just building a successful business; we collaborate with our partners to innovate payroll solutions. As pioneers of embedded payroll, we are reshaping the payment process, enabling payroll businesses to launch, expand, and succeed with ease. Discover our journey | Listen in.Check is more than an API; we are the catalyst for developing and scaling payroll operations.Our TeamThe payroll system is in dire need of innovation. We invite you to join a passionate team dedicated to making an impactful change! At Check, you will leverage creative problem-solving and critical thinking to influence every business we partner with. We view challenges as opportunities for improvement, valuing the unique contributions of each team member in our collective mission.If you're ready to dive in and transform payroll, let's collaborate to simplify complexity and enhance the future for businesses of all sizes.Your RoleAt Check, engineering is our foundation. We believe that payroll should resemble modern financial software; achieving this requires a comprehensive understanding of systems and reliable infrastructure that our partners can trust. Every product we deliver relies on scalable and secure systems that ensure timely payments and payroll processing.We are seeking a Staff Software Engineer who possesses strong software design capabilities coupled with hands-on infrastructure experience. In this position, you will focus on the essential systems that drive payroll operations, enhancing our service scalability, production operations, and empowering engineers with the tools to deliver software confidently and securely.You will collaborate across product and platform areas to enhance our cloud infrastructure, fortify our deployment and monitoring strategies, and streamline the architecture that supports embedded payroll services. The challenges you will address often intersect infrastructure, product, and operational domains.This opportunity is perfect for someone who has managed complex systems end-to-end in a dynamic environment and takes pride in developing resilient, comprehensible infrastructure that is vital to our operations.

P-1124 Summary At Databricks, we are driven by a passion for empowering data teams to tackle some of the most challenging problems in the world, spanning from security threat detection to advancements in cancer drug development. We achieve this by constructing and managing a top-tier data and AI infrastructure platform, enabling our customers to concentrate on their high-value missions. Our engineering teams are dedicated to creating highly technical products that address significant needs in the world. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers’ success on our platform. Customers place their trust in Databricks with their most sensitive data, and our Trust & Safety team is committed to establishing the world’s most reliable data analytics and machine learning platform. Security Engineering plays a pivotal role within Trust & Safety, working diligently to safeguard customer data from malicious threats. We are seeking seasoned leaders like you to craft the vision and define the strategy for this critical area. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical vulnerabilities in our infrastructure and services. Attract industry-leading talent to our team. Serve as a representative for the security engineering discipline throughout the organization, advocating for a data-driven approach. Represent Databricks at academic and industry conferences and events. What we look for: A minimum of 7 years of experience in Data Security or related fields, with expertise in at least two of the following areas: Cryptography, Kubernetes Security, Web Security, Governance, Privacy, Trust, Safety, Authentication, Identity Management, Access Control, Key Management, Inter-Service Authentication, Secure Application Frameworks, Detection & Response. Proven experience in building systems at large-scale internet companies is highly desirable. ...

Join Nuro as a Senior Software Engineer specializing in Perception Data Infrastructure. In this pivotal role, you will be responsible for developing and optimizing systems that process perception data, enabling our autonomous vehicles to navigate safely and efficiently. You will collaborate with cross-functional teams to enhance our data infrastructure, ensuring reliability and scalability.

Role overview FullStory is looking for a Senior Software Engineer to join the Data Infrastructure and AI team in Atlanta. This role centers on building and maintaining the systems that power AI-driven products. What you will do Design and implement data solutions that enable AI features Collaborate with teammates to strengthen and refine data architecture Focus on making data systems scalable, reliable, and high-performing Team and impact Work alongside engineers committed to creating solid foundations for AI capabilities. The team’s efforts directly influence how FullStory provides insights and value to its customers.

Founded in 2007, Airbnb has transformed the way people experience travel, connecting over 5 million hosts with more than 2 billion guests worldwide. Our platform enables unique stays and authentic experiences, fostering connections with local communities.The Team You Will Join:As a pivotal member of the Data Warehouse Infrastructure team, you will help shape the backbone of Airbnb's big data capabilities, enabling hundreds of engineers to efficiently collect, manage, and analyze vast amounts of data. We leverage cutting-edge open-source technologies such as Hadoop, Spark, Trino, Iceberg, and Airflow.Typical Responsibilities:Design and architect Airbnb's next-generation big data compute platform to enhance data ETL, analytics, and machine learning efforts.Oversee the platform's operations, focusing on improving reliability, performance, observability, and cost-effectiveness.Create high-quality, maintainable, and self-documenting code while engaging actively in code review processes.Contribute to open-source projects, making a significant impact on the industry.

About Us Nuro is a pioneering self-driving technology company dedicated to making autonomous solutions accessible to everyone. Established in 2016, we are developing the most scalable autonomous driver by integrating advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to facilitate a variety of applications, including robotaxis, commercial fleets, and personal vehicles. With proven technology from years of self-driving deployments, Nuro provides automakers and mobility platforms with a clear pathway to achieving commercial-scale autonomous vehicles, promoting a safer, more connected future. Role Overview At Nuro, we adopt a machine-learning-first strategy in our approach to autonomous driving technology. The performance of our systems is significantly influenced by the quality and diversity of training and evaluation data. Your team will be pivotal in enhancing our autonomous driving systems by establishing a robust and scalable data infrastructure. This infrastructure will generate training and evaluation data from both real-world driving logs and simulated environments. Collaborating closely with system engineers, you will ensure thorough validation of the autonomous driving system prior to deployment. Key Responsibilities Design and implement cohesive, introspectable data pipelines capable of processing large-scale batch and streaming data across diverse evaluation use cases. Develop a storage solution that efficiently manages extensive volumes and a wide variety of performance metrics. Create user-friendly dashboards and reports to display evaluation results, enabling easy comparisons to highlight improvements and regressions in ML components and the overall system. Establish and maintain continuous testing and monitoring systems to ensure the integrity and robustness of our data and data pipelines. Build data mining tools utilizing applied ML techniques to meet data discovery requirements in areas such as Perception, Behavior, and Mapping. Develop data annotation tools to aid both first-party and third-party labeling efforts, ensuring high-fidelity perception, mapping, and trajectory labels. Scale data annotation labels with cutting-edge ML techniques. Qualifications A degree in Computer Science, Engineering, or a related field (BS, MS, or PhD) combined with at least 4 years of relevant professional experience. Strong programming skills in Python or similar languages. Experience in data engineering, machine learning, or related fields. Familiarity with data pipeline tools and frameworks. Ability to work collaboratively in a fast-paced, innovative environment.

Gridmatic is a cutting-edge startup that is reshaping the energy sector by providing affordable, clean energy solutions through the optimization of renewable resources and grid-scale batteries. With a strong presence in both the Bay Area and Houston, we blend innovative thinking typical of Silicon Valley with robust, practical expertise in energy markets and retail.As solar and wind energy emerge as the fastest-growing electricity sources, the fluctuations caused by weather conditions and grid dynamics lead to greater volatility in energy prices. At Gridmatic, we confront this challenge head-on with advanced forecasting and optimization techniques, empowering our team to solve meaningful problems. Our core operations revolve around energy forecasting and trading, utilizing extensive datasets—weather patterns, pricing, load data, and grid conditions—to develop probabilistic machine learning forecasts that inform critical operational decisions. This work directly influences when energy is purchased, stored, or utilized, transforming uncertainty into tangible value for our customers and the grid.Our success is quantifiable. Gridmatic stands as the most profitable entity in ERCOT’s wholesale market and operates the leading battery asset in CAISO. Without relying on venture capital, we foster a collaborative, low-ego work culture, where rigorous analysis, autonomy, and ongoing learning are fundamental principles.About Us:Gridmatic is on a mission to decarbonize the grid utilizing deep learning to enhance energy price forecasting. We believe that improved forecasting can significantly impact energy consumption and climate change. As extreme weather events become more frequent, the volatility in energy prices escalates—an example being the Texas market where prices can surge up to 50 times higher during extreme conditions. In such instances, the necessity for accurate forecasting becomes paramount.We leverage our machine learning (ML) forecasting and optimization capabilities to participate in energy markets, enhance the efficiency of large-scale battery storage systems, and supply energy to businesses, shielding them from severe price fluctuations. Our deep learning models have achieved substantial success in energy trading, currently managing multiple significant battery systems (50MW+) and providing energy to hundreds of businesses.We boast a formidable team with extensive expertise in ML, energy, and optimization. If you are passionate about tackling intricate real-world challenges, working with large-scale data, and applying ML to climate and energy solutions, we would be thrilled to connect with you.The Opportunity:We seek a skilled engineer to spearhead the scaling and reliability of our data infrastructure, which is essential to the machine learning initiatives at Gridmatic.