Staff Software Engineer, Observability at Databricks | Mountain View, CA

Join Databricks as a Staff Software Engineer focused on Backend development, where you'll play a crucial role in enabling data teams to tackle some of the world's most challenging problems, ranging from security threat detection to cancer drug development. Our mission is to build and operate the world's leading data and AI infrastructure platform, allowing our customers to concentrate on the high-value challenges central to their missions.Founded in 2013 by the original creators of Apache Spark, Databricks has rapidly expanded from a small office in Berkeley, California, to a global powerhouse with over 1,000 employees. Our platform is trusted by thousands of organizations, from startups to Fortune 100 companies, making us one of the fastest-growing SaaS companies worldwide.As part of our engineering team, you'll develop and maintain highly technical products that address significant real-world needs. We constantly push the limits of data and AI technology while ensuring the resilience, security, and scalability essential for our customers' success.Our software operates at an impressive scale, managing millions of virtual machines and processing exabytes of data daily. We frequently encounter cloud hardware, network, and operating system faults, and it is vital that our software effectively shields customers from these issues.As a Backend Software Engineer, you'll collaborate closely with your team and product management to prioritize, design, implement, test, and operate micro-services for the Databricks platform. Your responsibilities will include writing software in Scala/Java, building data pipelines using Apache Spark and Apache Kafka, integrating third-party applications, and interacting with cloud APIs such as AWS and Azure.Possible teams you could join include:Data Science and Machine Learning Infrastructure: Develop services and infrastructure that blend machine learning and distributed systems, empowering collaborative workspaces, notebooks, IDE integrations, and project management tools.Compute Fabric: Create resource management infrastructure that supports big data and machine learning workloads in a robust, flexible, secure, and cloud-agnostic manner, managing millions of virtual machines.

P-97 At Databricks, we are dedicated to empowering data teams to tackle the most significant challenges facing the world today. We achieve this by creating and managing the premier data and AI infrastructure platform, enabling our clients to harness profound data insights to enhance their operations. Our commitment to innovation drives us to constantly explore the edges of data and AI technology while maintaining the resilience, security, and scalability essential for our customers to thrive on our platform. With one of the largest software platforms globally, our infrastructure comprises millions of virtual machines, producing terabytes of logs and processing exabytes of data daily. Given our scale, we routinely encounter faults in cloud hardware, networks, and operating systems, and our software must adeptly shield our clients from these issues. In the role of Performance Engineer, you will collaborate extensively with various teams across the organization to assess the performance of products and features. You will identify performance bottlenecks and partner with engineers to address performance and scalability challenges. This includes establishing performance targets for different software releases, guiding teams in developing performance benchmarks, conducting competitive benchmark analyses for various Databricks products, and performing in-depth analyses to diagnose and rectify performance issues.

Join Databricks as a Lead Security Architect and play a pivotal role in fortifying our IT infrastructure. In this fast-paced environment, you will design and implement a secure and scalable architecture to safeguard our corporate assets. Your focus will encompass crucial aspects of IT security, including Identity and Access Management (IAM), Zero Trust architecture, and endpoint security, all while ensuring the protection of critical business applications and sensitive data.Your deep expertise in security principles and comprehensive understanding of the entire infrastructure stack will be invaluable in crafting robust security solutions that are future-ready. You will help enhance the resilience and integrity of our systems against the ever-evolving cyber threat landscape.This position is critical for shaping our security strategy across various modern platforms including AWS, Azure, GCP, and SaaS solutions. You will establish a strong least privilege (PoLP) model, provide specialized IAM expertise, and securely support SaaS with sensitive information. Additionally, you will contribute to our internal strategy for secure AI development.Collaboration with cross-functional teams is essential to embed security throughout the technology stack, ensuring that our internal strategies align with enterprise security standards.

At Databricks, we are dedicated to empowering data teams to tackle the world's most challenging problems—from revolutionizing transportation to accelerating medical breakthroughs. Our mission is realized by providing the world’s premier data and AI infrastructure platform, enabling customers to harness deep data insights for business enhancement. Our Search technologies are integral to this mission, facilitating keyword retrieval, semantic similarity through vector embeddings, and hybrid solutions that blend both methods. These capabilities enable users to discover and comprehend information across vast, intricate datasets, powering applications such as Retrieval Augmented Generation (RAG), AI assistants, recommendation systems, enterprise knowledge management, in-product search, and data exploration. As a Senior Engineering Manager for Search, you will be pivotal in designing and scaling our next-gen Search product, which includes Vector Search, Keyword Search, and Search Quality. You will lead the development of a robust, high-performance, cost-effective, and developer-friendly Search stack, equipping customers to create AI applications with precision, speed, and scalability. In addition to hands-on contributions, you will help define the long-term vision, mentor senior engineers, collaborate across teams, and spearhead strategic initiatives that enhance the technical and business impact of Search at Databricks.

P-57 At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems. Our mission is to create and operate the premier data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their objectives. Founded in 2013 by the original creators of Apache Spark, Databricks has expanded from a small office in Berkeley, California, to a global powerhouse with over 1,000 dedicated employees. Thousands of organizations, from small startups to Fortune 100 companies, rely on Databricks for their critical workloads, establishing us as one of the fastest-growing SaaS companies globally. Our engineering teams are committed to developing highly technical products that meet significant needs in the industry. We continuously push the limits of data and AI technology while ensuring resilience, security, and scalability—key factors in ensuring our customers' success on our platform. We manage one of the largest software platforms in existence, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we frequently encounter cloud hardware, network, and operating system issues, necessitating that our software effectively shields our customers from such challenges. As a Data Scientist on the Data Team, you will play a crucial role in fostering a data-driven culture at Databricks by working on the company's top priorities. The Data Team also acts as an internal customer, utilizing Databricks to shape the future direction of our products. Your Impact: Analysis at the speed of thought: Enhance decision-making capabilities by developing robust data science tools for business leaders, analysts, and fellow data scientists. Extend capabilities of Databricks: Collaborate closely with the Data Platform and Product Engineering teams to integrate data science tools with existing offerings and the core product. Strategic business insights: Spearhead insight generation for key company priorities and essential engineering initiatives focusing on reliability and efficiency. Gather evolving requirements, define project OKRs and milestones, and communicate progress and results to both technical and non-technical stakeholders. Mentor and guide junior data scientists on the team regarding project planning, technical decisions, and reviews of code and documentation. Represent the data science discipline across the organization, advocating for a more data-driven approach. Act as a representative for Databricks at academic and industry events.

Job Title: Senior Staff Software Engineer - Enzyme Location: Mountain View, California At Databricks, we are driven by a passion for empowering data teams to tackle some of the world’s most intricate challenges—from revolutionizing transportation to accelerating medical advancements. We achieve this by developing and managing the leading data and AI infrastructure platform, enabling our customers to harness deep data insights to elevate their businesses. The Lakeflow Engineering team at Databricks oversees our comprehensive ETL product line, including innovative solutions like Materialized Views, Structured Streaming, and Delta Live Tables. We operate one of the largest data engineering platforms globally, processing exabytes of data daily for our extensive client base. We are in search of a committed technical leader to guide the Materialized Views engineering team. This team is tasked with creating next-generation Materialized View features that enhance both ETL workloads and query acceleration. In this role, you will engage in various areas to design and implement advanced systems that surpass current state-of-the-art: Incrementally maintaining materialized views Optimizing query performance Managing resources efficiently Developing effective storage structures Automating physical data optimization Your Impact: Address significant business needs at a large scale through your software engineering expertise. Deliver a robust, scalable, and fault-tolerant architecture for Materialized Views. Conduct low-level systems debugging, performance measurement, and optimization on large production clusters. Shape architecture design, influence product roadmaps, and assume ownership of new projects. Introduce tools that enhance automation and operational efficiency of services. Utilize your extensive experience to help preempt and resolve production issues. Plan and lead complex technical projects collaborating with multiple teams across the organization.

P-1126 Summary At Databricks, we are passionate about empowering data teams to tackle the world's most pressing challenges, ranging from security threat detection to groundbreaking cancer drug development. Our mission is to create and maintain the premier data and AI infrastructure platform that enables our customers to concentrate on high-value tasks central to their objectives. Our engineering teams are dedicated to developing innovative products that address significant real-world needs. We continually strive to advance the frontiers of data and AI technology while ensuring our operations are resilient, secure, and scalable to guarantee our customers' success on our platform. Customers place their trust in Databricks with their most critical data, and the Trust & Safety department's mission is to establish the most reliable data analytics and machine learning platform globally. Our Security Engineering team plays a pivotal role in safeguarding customer data from malicious threats. We seek seasoned leaders like you to craft the vision and strategy for this vital domain.

P-188 At Databricks, we are on a mission to fundamentally transform the data lifecycle, simplifying processes from data ingestion to ETL, Business Intelligence (BI), and extending to Machine Learning (ML) and Artificial Intelligence (AI) through a unified platform. We envision a future where traditional data warehouse architectures are replaced by innovative solutions like the Lakehouse architecture (CIDR 2021 paper), which integrate data warehousing and advanced analytics, effectively addressing critical challenges such as data staleness, reliability, cost of ownership, data lock-in, and limited use-case support. To turn this vision into reality, we are developing a next-generation decoupled query engine and structured storage system designed to surpass specialized data warehouses in relational query performance while maintaining the versatility of general-purpose systems like Apache Spark™. This system is intended to support a wide array of workloads, from ETL processes to data science applications. As a member of our team, you will engage in one or more of the following areas, contributing to the design and implementation of cutting-edge systems that redefine industry standards: Query compilation and optimization Distributed query execution and scheduling Vectorized execution engine Data security measures Resource management strategies Transaction coordination processes Efficient storage structures (encodings, indexes) Automatic physical data optimization techniques

Join Waymo as a Senior Staff Software Engineer specializing in TLM (Traffic Light Management). In this crucial role, you will lead the design and development of innovative software solutions that enhance our autonomous vehicle systems. Your expertise will contribute significantly to improving traffic management systems and ensuring seamless operations for our fleet.

P-1124 Summary At Databricks, we are driven by a passion for empowering data teams to tackle some of the most challenging problems in the world, spanning from security threat detection to advancements in cancer drug development. We achieve this by constructing and managing a top-tier data and AI infrastructure platform, enabling our customers to concentrate on their high-value missions. Our engineering teams are dedicated to creating highly technical products that address significant needs in the world. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers’ success on our platform. Customers place their trust in Databricks with their most sensitive data, and our Trust & Safety team is committed to establishing the world’s most reliable data analytics and machine learning platform. Security Engineering plays a pivotal role within Trust & Safety, working diligently to safeguard customer data from malicious threats. We are seeking seasoned leaders like you to craft the vision and define the strategy for this critical area. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical vulnerabilities in our infrastructure and services. Attract industry-leading talent to our team. Serve as a representative for the security engineering discipline throughout the organization, advocating for a data-driven approach. Represent Databricks at academic and industry conferences and events. What we look for: A minimum of 7 years of experience in Data Security or related fields, with expertise in at least two of the following areas: Cryptography, Kubernetes Security, Web Security, Governance, Privacy, Trust, Safety, Authentication, Identity Management, Access Control, Key Management, Inter-Service Authentication, Secure Application Frameworks, Detection & Response. Proven experience in building systems at large-scale internet companies is highly desirable. ...

At Databricks, we are dedicated to empowering data teams to tackle the world's most challenging problems—from transforming the future of transportation to expediting medical breakthroughs. We achieve this by creating and managing the most advanced data and AI infrastructure platform, enabling our customers to extract deep insights from data to drive business success. Founded by engineers with a strong customer focus, we eagerly embrace every opportunity to confront technical challenges, whether it’s designing next-generation UI/UX for data interfacing or scaling our services and infrastructure across millions of virtual machines. And we’re just getting started.The Logging Platform team is pivotal in developing scalable and efficient logging solutions that enhance observability across all Databricks services. As a Staff Software Engineer, you will spearhead the evolution of our logging infrastructure, empowering engineers throughout the company to gain profound insights into system behavior, troubleshoot issues efficiently, and optimize performance at scale.

Join Our Innovative Team and Help Shape the Future of Technology!Are you eager to tackle an exhilarating challenge in the development and maintenance of advanced infrastructure? At Kognitos, we're on the lookout for enthusiastic engineers like you to enhance our team and create a lasting impact.As a Staff Software Engineer, your key responsibilities will include:Building and sustaining our infrastructure leveraging Python and AWS Serverless technologies.Working collaboratively with cross-functional teams to design and deploy scalable, robust systems, including microservices and cloud-based architectures.Guaranteeing the reliability, scalability, and performance of our backend systems through proactive monitoring and optimization.Designing and managing database schemas and queries to support application features.Developing unit and integration tests to uphold code quality and reliability.Continuously refining our software development processes by integrating best practices and contemporary methodologies such as Agile, DevOps, and CI/CD.Diagnosing and resolving production issues to minimize downtime and ensure seamless operations.Engaging in architectural discussions and contributing to the formulation of technical solutions and best practices.Keeping abreast of the latest technologies and trends in software development to propose enhancements to our technology stack.

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world—whether it's realizing the next breakthrough in transportation or accelerating medical innovations. Our mission is to build and operate the leading data and AI infrastructure platform, allowing our clients to harness deep data insights for business enhancement.Our engineering teams create impactful technical products that address significant global needs. We consistently push the limits of data and AI technology while ensuring the security and scalability crucial for our customers' success on our platform.We manage one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, ensuring our software effectively shields our customers from these challenges.As a member of the Observability team, you will be at the forefront of developing solutions that deliver critical insights into the health and performance of our products and infrastructure.

Harness is at the forefront of revolutionizing software delivery with its cutting-edge AI Software Delivery Platform, founded by visionary technologist Jyoti Bansal, the mastermind behind AppDynamics, which was acquired by Cisco for a staggering $3.7 billion. With approximately $570 million in raised funding and a valuation of $5.5 billion, we are supported by premier investors such as Goldman Sachs, Menlo Ventures, IVP, and Citi Ventures. In an era where AI is expediting code development, the critical challenges now lie in phases post-coding, including testing, deployments, application security, reliability, compliance, and cost optimization. Harness is committed to addressing these challenges by integrating AI and automation into the software delivery lifecycle, empowering teams to deliver software more efficiently while upholding security and governance throughout.Our platform, driven by Harness AI and the Software Delivery Knowledge Graph, employs intelligent automation and deep context across the software delivery lifecycle, ensuring governance and policy-driven controls are seamlessly integrated.Over the past year, Harness has facilitated over 185 million deployments, 82 million builds, 18 trillion flag evaluations, 8 million security scans, 9.1 billion optimized tests, and 3 trillion protected API calls, managing an impressive $2.8 billion in cloud expenditure. Our clients, including renowned names like United Airlines, Morningstar, and Choice Hotels, have experienced accelerated release times by up to 75%, reduced cloud expenses by as much as 60%, and achieved a tenfold increase in DevOps efficiency.With a global workforce spanning 14 offices across 25 countries, Harness is shaping the future of AI-driven software delivery. Join us and contribute to our mission!Position SummaryThe Harness Supply Chain Security (SCS) module safeguards each phase of the software delivery lifecycle by securing builds, artifacts, and dependencies from inception to deployment. It offers comprehensive visibility, policy enforcement, and real-time risk detection, enabling engineering teams to ensure software integrity, prevent tampering, and comply with evolving supply chain security regulations. As part of this dynamic team, you will work on a rapidly growing product that integrates seamlessly with the broader Harness platform, unifying software delivery and developer tools into one cohesive experience. This is a high-impact role addressing pressing challenges faced by modern DevOps and platform engineering teams.

Join Moveworks as a Staff Software Engineer and play a pivotal role in enhancing our Core Platform. You will collaborate closely with cross-functional teams to design, develop, and implement innovative software solutions that drive efficiency and improve user experiences.

Moveworks seeks a Software Engineer to join its team in Mountain View, CA. The position focuses on improving user experiences and supporting day-to-day business operations. Role overview This engineer will collaborate with colleagues from various backgrounds to design and build new technical solutions. The work centers on creating tools and features that help streamline business processes. What you will do Work closely with other engineers and professionals to develop new products and features Contribute to projects that improve the efficiency and effectiveness of business operations Use modern technologies to address practical challenges Location This position is based in Mountain View, CA.

Who We Are At Otter, we are passionate about transforming the restaurant industry through innovative technology. As a leader in online food delivery solutions, we empower restaurateurs to thrive in a digital landscape. Our commitment to enhancing the dining experience has earned the trust of thousands of restaurants globally, including renowned brands like Chick-fil-A, Ben & Jerry’s, and Eataly. Join us in our mission to simplify and streamline delivery operations for restaurants, ensuring they can focus on what they do best—creating unforgettable dining experiences. What You’ll Do As a pivotal member of our team, you will work on our Menu Platform, which serves as the backbone of menu management across various delivery channels and point-of-sale systems. Your contributions will directly impact the efficiency and effectiveness of operations for over 150,000 restaurants worldwide. Develop data-driven features that enhance dynamic menu operations. Engage in planning and strategy for internal tools and platforms. Design, implement, and rigorously test backend services using agile methodologies. Collaborate closely with cross-functional teams including engineering, product management, and customer support. Ensure high-quality code through meticulous writing, debugging, and maintenance across multiple projects. Architect scalable systems capable of handling large, distributed workloads. Enhance platform reliability, performance, and overall developer experience. Drive innovation and continuously explore new technologies.

P-1126 Summary At Databricks, we are committed to empowering data teams to tackle some of the most complex challenges facing the world, from security threat detection to the development of innovative cancer treatments. We achieve this by developing and managing a state-of-the-art data and AI infrastructure platform, allowing our clients to concentrate on the high-impact issues that are critical to their goals. Our engineering teams craft advanced technical products that address significant and real-world needs. We consistently push the limits of data and AI technology while ensuring the resilience, security, and scalability that are essential for our customers' success on our platform. Clients entrust Databricks with their most sensitive data, and our Trust & Safety team is dedicated to creating the most secure data analytics and machine learning platform globally. The Security Engineering division plays a vital role in safeguarding customer data from malicious actors, and we are seeking visionary senior leaders to shape and define our strategy in this domain.

About UsAt Aurora Innovation, we are dedicated to revolutionizing the transportation industry by harnessing the power of self-driving technology. Our mission is to make this technology accessible, safe, and efficient for everyone.The Aurora Driver will usher in a new era of mobility and logistics, contributing to a safer and more efficient future.Joining Aurora means collaborating with a team of passionate and intelligent individuals to tackle complex challenges head-on while continuously honing your expertise. For the latest updates, visit aurora.tech or follow us on LinkedIn.We are on the lookout for a Staff Software Engineer to join our calibration team. This team is pivotal in ensuring that all vehicle sensors are correctly aligned to support advanced autonomy functions. Our software solutions span from low-level intrinsic models for our proprietary FMCW lidar to sophisticated continuous and online calibration methodologies.In this position, you will:Lead the technical direction for the development and management of online calibration and state estimation systems that guarantee high-level autonomy.Create and implement algorithms that efficiently process sensor data in real-time.Design high-performance software solutions to facilitate continuous, real-time calibration while trucks operate in the field.