Staff Software Engineer - Database Engine Internals

P-188 At Databricks, we are on a mission to revolutionize the data lifecycle—from ingestion and ETL to business intelligence and advanced machine learning. Our vision is centered around a unified platform that replaces the conventional data warehouse architecture with a cutting-edge Lakehouse model (CIDR 2021 paper). This innovative architecture aims to tackle significant challenges such as data staleness, reliability, total cost of ownership, data lock-in, and limited support for diverse use cases. A pivotal element of achieving this vision is the development of the next generation of decoupled query engines and structured storage systems that can surpass the performance of specialized data warehouses while retaining the versatility of general-purpose systems like Apache Spark™. This capability is essential for supporting a wide range of workloads, from ETL processes to complex data science applications. As a key member of this team, you will engage in one or more of the following areas to design and implement systems that set new standards in the industry: Query compilation and optimization Distributed query execution and scheduling Vectorized execution engine Data security Resource management Transaction coordination Efficient storage structures (encodings, indexes) Automatic physical data optimization

P-97 At Databricks, we are on a mission to fundamentally simplify the entire data lifecycle—from ingestion and ETL to BI and ultimately to ML/AI—through a unified platform. We envision a future where the traditional data warehouse architecture is transformed by an innovative architectural model known as the Lakehouse (CIDR 2021 paper). This open platform merges data warehousing with advanced analytics, effectively addressing critical challenges such as data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support. A key component in realizing this vision is the development of a next-generation decoupled query engine and structured storage system that surpasses the performance of specialized data warehouses while maintaining the flexibility of general-purpose systems like Spark™ to cater to a wide range of workloads, from ETL processes to data science applications. As a vital member of our team, you will engage in the design and implementation of these next-generation systems that aim to leapfrog the current state-of-the-art in the following areas: Query compilation and optimization Distributed query execution and scheduling Vectorized execution engine Data security Resource management Transaction coordination Efficient storage structures (encodings, indexes) Automatic physical data optimization

Join Anthropic as a Staff+ Software Engineer focusing on Databases, where you'll be at the forefront of our innovative technology solutions. You'll work closely with a collaborative team to design, implement, and maintain robust database systems that empower our AI models and enhance user experience. Your expertise will contribute significantly to our mission of advancing AI safety and usability.

About GustoAt Gusto, we are dedicated to empowering small businesses by managing essential services like payroll, health insurance, 401(k)s, and HR, allowing owners to focus on their passions and customers. With offices in Denver, San Francisco, and New York, we proudly support over 400,000 small businesses nationwide, fostering a workplace that reflects and celebrates the diverse customers we serve. Explore our Total Rewards philosophy. About the Role:We are seeking a seasoned engineer with extensive knowledge in distributed data systems to help shape the future of Gusto's storage architecture. In this impactful role, you will oversee intricate migrations, design high-scale systems, and establish benchmarks for automation, resilience, and security. Your work in implementing distributed database solutions will facilitate Gusto's ongoing growth and scalability.About the Team:The Datastores Infrastructure Engineering team is responsible for designing, building, and maintaining the data platforms that drive Gusto's products, including MySQL, Postgres, Redis, Kafka, and S3. We are committed to ensuring that our infrastructure is consistent, dependable, and equipped to support Gusto's expanding requirements. As we transition to self-hosted distributed databases, our focus lies in minimizing the blast radius, enhancing operational resilience, and enabling sustainable scalability.Here’s what you’ll do day-to-day:Architect, deploy, and manage the complete lifecycle of distributed database systems (TiDB) on Kubernetes at scale, ensuring high availability, data consistency, and operational excellence.Coordinate complex, zero-downtime migrations from monolithic to distributed architectures, including vertical sharding to isolate Product Services.Define and implement efficiency enhancements across the storage infrastructure through query optimization, caching strategies, and workload management.Establish standards and develop reliable automation to maintain data consistency, integrity, and security across distributed systems.Continuously enhance operational excellence by decreasing on-call burdens with sustainable, long-term solutions.Collaborate with product engineering teams and technical partners to enable rapid and reliable product development.

About Our Team:Join the innovative Database Systems team at OpenAI, where we specialize in high-performance distributed databases. We are the architects behind Rockset, a cutting-edge real-time search, analytics, and vector database that powers all vector search and retrieval augmented generation (RAG) at OpenAI. Rockset underpins core functionalities across all OpenAI product lines and supports various critical internal applications.About the Role:We are in search of engineers who are passionate about distributed systems, performance optimization at a low level (with our core engine developed in C++), and constructing scalable database infrastructures from scratch. As a member of the Database Systems team, you will play a key role in enhancing the core database engine, making significant contributions to ingestion, query execution, indexing, and storage improvements. You will collaborate with multiple teams across OpenAI to unlock new product capabilities and ensure the reliability and scalability of our online database as usage expands exponentially.Your Responsibilities Will Include:Design, develop, and maintain high-performance distributed systems.Identify and address performance bottlenecks to elevate infrastructure capabilities.Define and guide the long-term technical vision and evolution of the system.Collaborate with product, engineering, and research teams to deliver robust and scalable infrastructure.Investigate complex production issues across the entire technology stack.Contribute to incident response, retrospective analyses, and establishing best practices for system reliability.You Will Excel In This Role If You:Possess substantial experience in building, scaling, and optimizing distributed systems.Exhibit a keen interest in database internals, storage engines, or low-latency query systems.Enjoy tackling complex performance challenges in high-throughput systems.Have experience managing and operating production clusters at scale (e.g., Kubernetes or similar orchestration tools).Approach scalability, correctness, and reliability with a rigorous mindset.Thrive in a fast-paced environment where you can make a significant impact.Qualifications:4+ years of relevant industry experience with a focus on distributed systems.Proficiency in C++ or similar low-level programming languages.Strong problem-solving skills and attention to detail.Experience with performance monitoring and optimization tools.Excellent collaboration and communication skills.

About GridwareGridware is an innovative technology firm based in San Francisco, committed to safeguarding and optimizing the electrical grid. We have pioneered a revolutionary grid management approach known as Active Grid Response (AGR), which emphasizes the monitoring of electrical, physical, and environmental factors that influence grid reliability and safety. Our cutting-edge AGR platform leverages high-precision sensors to identify potential issues early, facilitating proactive maintenance and fault prevention. This holistic strategy aids in enhancing safety, minimizing outages, and ensuring the grid operates with maximum efficiency. Gridware is supported by prominent climate-tech and Silicon Valley investors. For further details, please visit www.Gridware.io.Role OverviewWe are looking for a talented Staff Software Engineer to act as a pivotal technical force within our team, enhancing the overall software engineering capabilities through architectural innovation, mentorship, and fostering a culture of excellence. In this role, you will design and develop the essential software systems that drive Gridware's platform. This encompasses everything from backend services that oversee our distributed network of devices to the front-end interfaces that visualize grid health, fleet diagnostics, and real-time field events.Your responsibilities will span the entire technology stack, building and scaling systems that integrate hardware, firmware, and cloud infrastructure to enable dependable communication, fleet visibility, and expedited decision-making. This position offers significant ownership and impact, allowing you to influence how our technology supports and protects critical infrastructure at scale.

About BroccoliBroccoli is revolutionizing the $500 billion home services industry by developing an AI operating system designed to empower trades businesses such as HVAC and roofing. Our intelligent AI agents handle customer interactions, manage job bookings, and ensure every lead is effectively captured.With the backing of prominent venture capital firms and a successful $27 million Series A funding round, we are on an aggressive growth trajectory. Collaborating with top private equity-backed home service platforms, we anticipate expanding our team fivefold by 2026, presenting a unique opportunity to join us early and make a significant impact.Why Join Broccoli?As a Staff Engineer, you will be instrumental in establishing the technical backbone of Broccoli AI. Your responsibilities will include ownership of critical systems, influencing architectural decisions, and shaping our development and deployment processes on a large scale.Immediate Impact: Your contributions will directly enhance production systems, benefiting hundreds of customers.Category Creation: Play a pivotal role in defining a new category of AI-powered workforce within an expansive market.Speed & Ownership: Enjoy the advantages of a small team with rapid feedback loops and substantial decision-making authority.Founder Collaboration: Partner closely with experienced founders to drive product and technical vision.What You’ll DoDesign, develop, and scale backend systems and internal tools for our AI agent platform.Take ownership of essential APIs and integrations, including systems like ServiceTitan.Lead complex features from initial design through to production deployment.Enhance real-time voice capabilities, reliability, and intelligence of AI agents.Mentor fellow engineers and help implement best practices across the team.Balance speed and quality while scaling systems to accommodate live customer traffic.What We’re Looking For7+ years of experience in backend or full-stack engineering.Strong system design and architectural skills.Proven experience in deploying and maintaining production systems at scale.Ability to thrive in high-growth, ambiguous startup environments.A proactive approach with a strong execution mindset.

Join Carta's engineering team as a Staff Software Engineer, where you will play a crucial role in developing innovative solutions that enhance our platform. You will collaborate with cross-functional teams to design, implement, and maintain scalable systems, ensuring high performance and responsiveness to requests from the front-end.We're looking for a passionate engineer who thrives in a fast-paced environment and is excited about tackling complex challenges. If you are eager to contribute to cutting-edge technology and drive impactful projects, we want to hear from you!

Role overview The Staff Software Engineer position at Amplitude, Inc. is based in San Francisco, CA. This role centers on developing and enhancing software to broaden the platform’s features. Day-to-day work includes direct software development and frequent collaboration with colleagues from various teams. What you will do Design, build, and maintain scalable software applications that support the platform’s growth. Collaborate with product managers and designers to deliver features that address user needs. Mentor junior engineers and contribute to their technical and professional development. Review code and help improve engineering practices throughout the team. Stay current with emerging technologies and industry trends to guide technical choices.

Join Discord, a platform embraced by over 200 million users monthly, where gaming is at the heart of our community. With more than 90% of our users engaging in gaming, they collectively spend 1.5 billion hours exploring thousands of unique titles each month. Our mission is to enhance the gaming experience by facilitating seamless communication and interaction among players.The Database Infrastructure team is responsible for the development and management of all database systems and data services at Discord. These systems are critical for supporting our vast user base, which includes trillions of messages exchanged each month. Our small yet impactful team works across various domains, including databases, disk storage, and Rust-based data access services, playing a pivotal role in the company's growth and success!Explore our team's insights through our blog posts:How Discord Indexes Trillions of MessagesHow Discord Stores Trillions of MessagesHow Discord Supercharges Network Disks for Extreme Low-Latency

Join our innovative team at Crusoe as a Staff Software Engineer. In this pivotal role, you will leverage your advanced software engineering skills to design, develop, and optimize cutting-edge solutions that enhance our technology stack. Collaborate with cross-functional teams to drive projects from concept to completion, ensuring high-quality deliverables that meet user needs and business objectives.

Airbnb, founded in 2007, has transformed the travel experience by connecting over 5 million hosts with more than 2 billion guests worldwide. Our platform enables unique stays and authentic community experiences for travelers around the globe.Join Our Community:At Airbnb, the Developer Infrastructure team is dedicated to empowering engineers and AI Coding Agents to produce high-quality software efficiently. We focus on infrastructure that enhances engineering productivity throughout the software development lifecycle, including build, test, and deployment.Your Impact:As a member of the CI+Build team, you will play a crucial role in optimizing our developer infrastructure, which encompasses remote build systems, CI clusters, flaky test management, and merge queues. Your contributions will help maintain a seamless mainline and accelerate pull request cycle times.In this role, you will define and implement cutting-edge build systems at Airbnb’s scale, guiding the technical direction for build infrastructure across diverse platform teams. You will collaborate with internal teams that deliver systems utilized by product engineers in backend, web, and mobile environments. Success in this position requires a deep understanding of the architecture of our largest internal backend services as we navigate an increasingly complex build graph.A Day in Your Role:Designing enhancements to our existing Bazel installation and remote build/cache infrastructure to boost correctness, reproducibility, and speed.Establishing the technical roadmap for the reliability and performance of our software build systems.Improving inner-loop development velocity and CI run-times through diagnostic efforts.

Why Join AngelListAt AngelList, we tackle some of the most challenging issues in venture capital and private markets. Our team is driven by precision, urgency, and a vision for the future. If you're passionate about transforming the startup funding landscape, this is your opportunity.About AngelListOur mission is to fuel innovation by enhancing the success rate of startups globally. We achieve this by creating the financial infrastructure that facilitates investment in transformative companies. AngelList stands at the intersection of venture capital and the startup ecosystem, supporting over $171 billion in assets and facilitating investments in more than 13,000 startups, including over 300 unicorns. With 57% of premier U.S. VC deals involving AngelList investors, we are ambitious in our goals.If you are excited about shaping the future of private markets, we invite you to join our journey.About the Role: As a Staff Software Engineer for our Nova platform, you will be pivotal in defining and designing our development processes. You will be responsible for establishing the domain model and architectural patterns that will guide our engineering team. If you are a catalyst who can empower a team of eight to perform like a team of twenty by establishing clear patterns, embedding engineering context into our codebase, and driving vital initiatives forward, we want to hear from you.

About UsAt Imprint, we are revolutionizing the landscape of co-branded credit cards and financial products, making them smarter, more rewarding, and fundamentally brand-centric. We collaborate with esteemed brands like Crate & Barrel, Rakuten, Booking.com, H-E-B, Fetch, and Brooks Brothers to create innovative credit programs that enhance customer loyalty, unlock savings, and stimulate growth. Our sophisticated platform integrates cutting-edge payments infrastructure, intelligent underwriting, and a seamless user experience, enabling brands to offer impactful financial products without the need to become a bank.With co-branded cards accounting for over $300 billion in annual spending in the U.S., the majority are still managed by traditional banks. Imprint stands as the modern solution: agile, technology-driven, and tailored for today’s consumers. Supported by industry leaders like Kleiner Perkins, Thrive Capital, and Khosla Ventures, we are assembling a top-tier team to redefine payment methods and empower brand growth. If you're eager to work at a fast pace, tackle complex challenges, and make a significant impact, we want to hear from you.Discover more about us on Imprint's Technology Blog.Your RoleDesign and spearhead the development of secure, reliable, and scalable backend systemsProvide technical leadership and mentorship across diverse teams and projectsSet and advocate for coding standards, architectural principles, and technical vision within the engineering organizationCollaborate closely with product, design, and engineering leadership to align technical strategy with business objectivesDrive the continuous enhancement of system performance, scalability, and reliability to accommodate rapid growth and evolving business needsLead complex, high-impact projects from inception through deployment and ongoing optimizationEnhance developer experience through advanced tooling, comprehensive observability frameworks, and improvements in platform reliabilityMentor and nurture engineers through code reviews, design discussions, and technical guidanceContribute to the technical roadmap and identify innovative opportunities

Supported by prominent Silicon Valley investors, Peregrine Technologies empowers public safety organizations, state and local governments, federal agencies, and private-sector institutions to address societal challenges with unparalleled speed and precision. Our AI-driven platform transforms fragmented and isolated data into actionable operational intelligence, quickly surfacing mission-critical information to facilitate informed and timely decisions that enhance outcomes across various contexts. Currently, Peregrine serves hundreds of customers across more than 30 states and two countries, impacting over 125 million individuals—and we are amplifying our influence as we expand into enterprise markets and internationally.Our TeamAs an engineering team, we place a strong emphasis on empathy, believing it enhances our solutions. Understanding how users interact with our product is essential, and engineers will collaborate closely onsite to grasp the diverse use cases that Peregrine addresses.We are seeking a Staff Software Engineer to join our core engineering teams. In this role, you will collaborate cross-functionally with design and product management to develop robust, scalable, and user-centric systems. Our teams confront a variety of challenges, from enabling real-time user collaboration on intricate maps to constructing high-scale backend architectures capable of processing billions of data points.We value ownership and teamwork; you will take complete responsibility for significant features and work closely with fellow engineers to ensure successful completion. We believe that humility and empathy are vital for crafting the right solutions—you will work directly with our deployment team and users as we refine our offerings to meet their needs. Creativity and perseverance will be key to executing our vision.RoleWe are looking for a Staff Software Engineer to join our expanding team, lead impactful projects, cultivate an inclusive team culture, and steer technical decision-making.This position is ideal for someone who excels in both people management and hands-on technical leadership. You will build a high-performing team, guide them through complex technical challenges, and ensure their work aligns with our business goals. The ideal candidate will effectively mentor while upholding high standards in technical execution.You will drive significant work that delivers value to our customers, from supporting emergency responders during hurricanes to de-escalating intricate organized crime situations. We are developing innovative capabilities that enable...

At Endeavor AI, we are redefining the landscape of enterprise AI solutions. Our innovative software serves as the distribution platform for cutting-edge AI models that will shape a more efficient world.We believe that artificial intelligence will revolutionize various sectors such as legal, healthcare, and finance. However, our primary mission is to create AI that can construct the very infrastructure that supports its own advancement. Our focus is on the building materials industry, which is currently hampered by outdated manual processes for quoting, order entry, and pricing. These inefficiencies not only result in lost revenue but also lead to unnecessary labor costs. Our AI-driven product addresses these challenges, and as we establish dominance in this sector, we plan to expand into other industries.While research labs develop the models of the future, our team is committed to delivering the last-mile solutions necessary for their implementation. We tackle the complexities of real-world environments, ensuring the reliability and effectiveness of our AI applications while integrating them into existing, traditional systems.Our Principles:We embrace boldness, especially when faced with skepticism about our goals.We prioritize truth and clarity over comfort.We are determined to succeed and are dedicated to hard work.The Role | Staff Software Engineer:In this role, you will optimize our applications to enhance the performance of critical business functions. You will independently identify bottlenecks in our codebase and implement improvements. This position offers a high degree of autonomy, allowing you to design database schemas, elevate code quality, and refine existing software architecture.

Join our innovative team at fal as a Staff Software Engineer specializing in large-scale computation platforms. We are seeking a seasoned software engineer with extensive experience in developing backend systems that efficiently orchestrate workloads and manage resource constraints. Your expertise in foundational cloud infrastructure and Linux provisioning will be crucial as you work towards achieving high reliability and scalability with minimal operational overhead.

Role overview MidiHealth is hiring a Staff Software Engineer - AI Engineer for a hybrid role in the San Francisco Bay Area. The position focuses on building and improving AI-powered solutions that contribute to better healthcare outcomes. What you will do Collaborate with cross-functional teams to design and implement AI-driven systems for healthcare. Develop scalable architectures and write efficient algorithms tailored to healthcare applications. Uphold strong software quality standards throughout the development lifecycle. Location This position is hybrid, with work based in the SF Bay Area.

Role overview MidiHealth seeks a Staff Software Engineer for its Platform Engineering team. This hybrid role is based in the San Francisco Bay Area and centers on building software that supports the platform’s growth, performance, and usability. What you will do Design and develop software solutions that address platform engineering challenges Collaborate with experienced engineers to improve reliability and expand platform features Contribute to efforts that boost performance and create a smooth user experience Location This position requires a hybrid schedule, including on-site work in the SF Bay Area.

With support from prominent Silicon Valley investors, Peregrine Technologies empowers public safety organizations, state and local governments, federal agencies, and private sector entities to tackle societal challenges with unparalleled speed and precision. Our AI-driven platform transforms isolated and disparate data into actionable intelligence, rapidly presenting critical information that enables improved decision-making and outcomes. Currently, Peregrine serves hundreds of clients across over 30 states and two countries, impacting more than 125 million individuals, as we broaden our reach into enterprise markets and international territories.TeamOur engineering team is deeply committed to the idea that empathy enhances our solutions. Understanding how users interact with our products is fundamental to our approach. Engineers have the unique opportunity to collaborate closely with our onsite team to grasp the diverse use cases that Peregrine addresses.We cherish both ownership and teamwork; you will be fully accountable for significant features while working hand-in-hand with fellow engineers to ensure successful delivery. We believe that humility and empathy are critical for crafting effective solutions, and you will engage directly with our deployment team and users as we refine our offerings to meet their needs. Ingenuity and perseverance are vital in realizing our vision.RoleAs part of our new AI team, you will play a key role in delivering unique value to our clients. This team is responsible for designing powerful and intuitive user experiences powered by generative AI. You will explore entirely new interaction methods for users—whether through natural language commands or by enabling AI agents to manage complex tasks on their behalf. Your contributions will shape impactful AI-driven features that assist customers in solving real-world challenges more efficiently.Your work will encompass a variety of intricate challenges, including scaling our platform to process terabytes of data from multiple sources, efficiently querying and alerting users about this data in real-time, and optimizing search algorithms for swift result delivery.While our technology stack is continuously evolving, it is built on a foundation that includes Python, Django, Celery, Airflow, and Kafka for the backend; React, Redux, and Mapbox for the frontend; PostgreSQL and Elasticsearch for data storage; machine learning models hosted in Bedrock and Sagemaker; and utilizing AWS, Pulumi, Terraform, and Kubernetes for our infrastructure.