Senior Software Engineer - Observability at Databricks | Bengaluru

At Databricks, we are dedicated to empowering data teams to tackle some of the most complex challenges globally — from revolutionizing transportation to accelerating groundbreaking medical advancements. Our mission is realized through the development and management of the premier data and AI infrastructure platform, enabling our customers to harness profound data insights for business enhancement. Founded by engineers with a relentless focus on customer satisfaction, we eagerly embrace every opportunity to address technical challenges, ranging from crafting next-generation UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. Our journey in Bengaluru, India is just beginning, as we are in the exciting phase of assembling 10 new teams from the ground up!Our engineering teams create technical products that meet real and significant needs in the world. We constantly push the limits of data and AI technology while maintaining the security and scalability essential for our customers' success on our platform.We operate one of the largest-scale software platforms, consisting of millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we encounter cloud hardware, network, and operating system faults, and our software must seamlessly shield our customers from these issues.As a software engineer in the Observability team, your role will be to develop observability solutions that deliver insights into the health and performance of our products and infrastructure.

P-1394 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most significant challenges—from revolutionizing transportation to accelerating medical advancements. Our mission is fulfilled by creating and managing the industry's leading data and AI infrastructure platform, enabling our customers to harness deep data insights to enhance their operations. Founded by engineers with a customer-centric mindset, we eagerly embrace every challenge, whether it's creating cutting-edge UI/UX for data interaction or scaling our infrastructure across millions of virtual machines. Our engineering teams design technical products that address real, critical needs in today's world. We continuously push the limits of data and AI technology while ensuring the security and scalability essential for our customers' success on our platform. We operate one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, and our software is designed to shield our customers from these issues seamlessly. As a Senior Software Engineer on the Observability team, you will develop observability solutions that provide critical insights into the health and performance of our products and infrastructure.

P-1385 In today's landscape, businesses are channeling substantial investments into the development and implementation of AI technologies and the data platforms that support them. However, do they truly understand the intricacies of their operations? At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging global issues, from revolutionizing transportation to expediting medical innovations. We achieve this by constructing and maintaining the world's premier data and AI infrastructure platform, enabling our clients to leverage deep data insights to enhance their operations. Founded by engineers who prioritize customer satisfaction, we eagerly embrace every opportunity to confront technical challenges, including designing next-generation UI/UX for data interaction and optimizing our services across millions of virtual machines. And this is just the beginning. As a Senior Software Engineer on the Customer Foresight Team, you will spearhead the development of tools that empower customers to gain insights into their AI and data workloads, optimize performance, and reduce costs. You will craft data infrastructure capable of processing billions of entries daily, deploy across over 65 cloud regions globally, and support some of the world's most prominent companies in executing their DevOps, FinOps, SecOps, and AIOps operations. This role involves directing technical development throughout product milestones, from requirement refinement to execution, operation, and collaboration with the broader product development and partner teams to guarantee product success.

Join our dynamic team at Databricks as a Senior Staff Software Engineer specializing in Networking. In this role, you will leverage your expertise to design and implement cutting-edge networking solutions that enhance our data platform's performance and reliability. You will collaborate with cross-functional teams to develop innovative features that drive value for our customers. Your experience will help shape our engineering practices and contribute to the development of scalable systems.

The Applied AI team at Databricks is at the cutting edge of AI and ML-driven products. Our customers constantly create a variety of assets (such as tables, notebooks, dashboards, and ML models) on our platform, making the search for these assets a vital aspect of their experience.As our Search product continues to grow, we are looking for multiple Machine Learning Engineers at various experience levels to enhance our Search Quality. In 2026, our primary focus will be on improving search ranking, query comprehension, developing robust evaluations, and expanding asset coverage to facilitate seamless searching at scale.

P-1348 At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging problems in the world, ranging from security threat detection to the development of cancer drugs. Our mission is to create and manage the leading data and AI infrastructure platform, allowing our customers to concentrate on the critical challenges central to their missions. Our engineering teams are committed to developing innovative technical products that meet real and significant needs globally. We continuously push the limits of data and AI technology while ensuring resilience, security, and scalability to enhance our customers' success on our platform. We are responsible for the operation of one of the largest scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data on a daily basis. At this scale, we encounter cloud hardware, network, and operating system issues, and our software must effectively shield our customers from these challenges. As a Senior Software Engineer on the Data Platform team, you will contribute to building the Data Intelligence Platform for Databricks, which aims to automate decision-making across the organization. You will collaborate closely with Databricks Product Teams, Data Science, Applied AI, and more. Your role will involve developing a range of tools for logging, orchestration, data transformation, metric storage, governance platforms, and data consumption layers. You will leverage the latest and most advanced Databricks products and other tools in the data ecosystem. Our team also serves as a substantial in-house customer, using Databricks to inform the future direction of our product. Your Impact: Design and manage the Databricks metrics store, enabling all business units and engineering teams to consolidate and share detailed metrics on a common platform with high quality, introspection capabilities, and query performance. Lead the development of the cross-company Data Intelligence Platform, which encapsulates all business and product metrics essential for running Databricks. You will play a pivotal role in balancing data protection with ease of shareability as we transition to a public company. Create tools and infrastructure to efficiently manage and operate Databricks on Databricks at scale across multiple clouds, geographies, and deployment types. This includes CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tooling. Establish the foundational ETL framework utilized by all pipelines developed within the company. Collaborate with our engineering teams to provide...

The Applied AI team at Databricks is at the leading edge of developing innovative AI and machine learning-powered products. Our customers continuously create vast numbers of assets—such as tables, notebooks, dashboards, data rooms, pipelines, SQL queries, and ML models—on our platform, some totaling hundreds of millions of assets. Navigating and locating these assets is vital for our users to efficiently complete their tasks.As our Search product continues to grow and advance, we are looking for multiple ML Engineers at various seniority levels to enhance our Search Quality. In 2026, our focus will be on improving search ranking, enhancing query understanding, building robust evaluations, and expanding asset coverage to facilitate seamless search capabilities at scale.

(P-1174)Join our innovative Engineering team as a Senior Staff Software Engineer at Databricks, where you will report directly to an Engineering Leader. You will play a pivotal role in our engineering organization, collaborating with teams to develop cutting-edge Databricks products and features that serve thousands of enterprises globally.Key ResponsibilitiesAs a key technical leader at Databricks, you will take full ownership of the product or infrastructure strategy in a major domain, guiding it from initial development to scalable solutions with tangible business impact. You will enhance our organizational processes and stability, leveraging your extensive expertise in large-scale distributed systems. Additionally, you will mentor senior engineers, assist in recruitment efforts, and lead high-stakes company projects, often addressing complex challenges beyond typical scopes.Your Impact:Address significant business needs at scale through your software engineering acumen.Deliver a robust, scalable, and fault-tolerant engine that processes hundreds of terabytes of data daily for a vast customer base.Engage in low-level systems debugging, performance evaluation, and optimization within extensive production clusters.Design architectural frameworks, influence product roadmaps, and assume responsibility for new initiatives.Utilize your deep knowledge to prevent and troubleshoot production issues.Lead complex technical projects in collaboration with various teams across the organization.Act as a significant influence in shaping the organization’s strategic direction.

P-1347 At Databricks, we are dedicated to empowering data teams to address the world's most challenging issues—from realizing the next mode of transportation to speeding up the discovery of medical innovations. Our mission is accomplished through the development and operation of the premier data and AI infrastructure platform, enabling our clients to harness profound data insights to enhance their operations. Networking Infrastructure is a fundamental component of our platform that fuels all our data and AI solutions. This platform also supports essential enterprise security functionalities that our customers leverage across all products to construct connectivity solutions to cloud resources, while mitigating the risk of data exfiltration. We are in the process of assembling our team from the ground up in Bengaluru, India. We are on the lookout for seasoned Senior Software Engineers with a strong networking background to join our Networking Infrastructure team. As an initial member of the Bangalore office, you will concentrate on creating new backend connectivity services that support millions of VMs operating on Databricks. You will take the lead in the design and development of new services that facilitate connectivity between our control and compute planes. This innovative platform empowers Databricks to enhance the scalability of our compute plane while optimizing cloud resource utilization. Collaborating closely with cross-functional teams—including product management, operations, and other engineering groups—you will ensure the delivery of robust, scalable, and efficient networking systems. This role is ideal for a hands-on leader who excels in a dynamic environment and is passionate about tackling complex multi-cloud and distributed systems challenges.

Join Databricks, where our mission is to empower data teams to tackle some of the most challenging problems in the world—from revolutionizing transportation to advancing medical innovations. We achieve this by developing and managing a top-tier data and AI infrastructure platform that allows our customers to harness deep data insights for better business outcomes. Founded by engineers and driven by our commitment to customer satisfaction, we embrace every challenge—whether it's creating next-generation UI/UX for data interfacing or scaling our infrastructure across millions of virtual machines. At Databricks Mosaic AI, we take a unique data-centric approach to crafting enterprise-quality Machine Learning and Generative AI solutions, enabling organizations to securely and cost-effectively manage and host their ML and AI models, enriched with their enterprise data. We're just getting started in Bengaluru, India, where we're launching 10 new teams from the ground up!As a Staff Software Engineer at Databricks India, you will have the opportunity to work across:Backend developmentDistributed Data Systems (DDS)Full Stack solutionsYour Impact:Backend: Engage with diverse domains within our essential service platforms, tackling challenges that span product and infrastructure, including distributed systems, service architecture, workflow orchestration, and enhancing developer experience. You'll be responsible for delivering high-performance services and client libraries for managing vast amounts of data on cloud storage backends such as AWS S3 and Azure Blob Store, as well as developing scalable services using technologies like Scala, Kubernetes, and Apache Spark™.Distributed Data Systems (DDS): Collaborate on projects involving Apache Spark™, Data Plane Storage, Delta Lake, Delta Pipelines, and Performance Engineering.Full Stack: Partner closely with product management to create exceptional user experiences.

(P-1174) Join the dynamic Engineering team at Databricks as a Senior Staff Software Engineer, reporting directly to an Engineering Leader. In this pivotal role, you will contribute to the development of innovative Databricks products and features that empower thousands of enterprises across the globe. Key Responsibilities As a highly skilled engineering contributor, you will have complete ownership of product and infrastructure direction in a key domain, guiding projects from their inception to scalable, impactful solutions. You will enhance the stability and reliability of our systems while fostering organizational processes, leveraging your expertise in large-scale distributed systems. Mentoring senior engineers, contributing to recruitment efforts, and spearheading high-stakes company projects will also be part of your role, often addressing challenging problems outside your comfort zone. Your Impact Address significant business needs at scale through your software engineering prowess. Deliver a robust, scalable, and fault-tolerant engine that processes hundreds of terabytes of data daily for numerous clients. Engage in low-level systems debugging, performance measurement, and optimization on extensive production clusters. Architect and design systems, influence product roadmaps, and take charge of new projects. Utilize your extensive experience to preempt and investigate production challenges. Plan and lead complex technical initiatives across multiple teams. Act as a strong influencer within the organization, shaping its roadmap and strategic direction.

(P-1174)Join our innovative team at Databricks as a Senior Staff Software Engineer within our Engineering division, reporting directly to an Engineering Leader. You will play a key role in our engineering organization, collaborating with teams dedicated to developing cutting-edge Databricks products and features that cater to thousands of enterprises globally.Key ResponsibilitiesAs a senior engineering individual contributor, you will take full ownership of product and infrastructure strategy in a significant area, driving initiatives from conception through to scalable solutions that deliver measurable business impact. You will enhance organizational stability and reliability while leveraging your deep expertise in large-scale distributed systems. Additionally, you will mentor senior engineers, assist in recruitment efforts, and lead high-impact projects that often involve complex challenges.Your Impact:Address real business challenges on a large scale with your software engineering expertise.Design and deliver a highly scalable, available, and fault-tolerant engine that processes hundreds of terabytes of data daily for thousands of customers.Conduct low-level systems debugging and performance optimization across extensive production clusters.Architect system designs, influence product roadmaps, and take ownership of new project initiatives.Utilize your extensive experience to help mitigate and resolve production issues.Lead intricate technical projects, collaborating across multiple teams within the organization.Act as a vital influencer in shaping the company's roadmap and strategic direction.

At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues—from transforming the future of transportation to accelerating medical innovations. Our commitment is to create and maintain the leading data and AI infrastructure platform, enabling our clients to harness deep data insights for business improvement. As a strategic focus, data ingestion into the Lakehouse is a vital area of investment at Databricks, crucial for enhancing Data and AI workflows. Our Lakeflow Connect initiative aims to address this need by offering user-friendly, point-and-click connectors to a diverse range of data sources, including enterprise applications such as Salesforce, Workday, ServiceNow, and SharePoint, as well as databases like SQL Server, cloud storage solutions, message queues, and local files. In this role, you will play an instrumental part in Lakeflow and Data Engineering. Connect serves as a pivotal platform capability, with ingestion functionalities required across all Databricks surfaces (Dashboards, Notebooks, SQL, AI). The successful candidate will collaborate closely with other products to integrate Connect seamlessly into these interfaces. We seek engineers with a robust background in core database internals to join our Lakeflow Connect team. A critical aspect of Connect involves extracting data from OLTP systems while minimizing the load on production environments. To achieve this, we are developing systems that utilize techniques such as incremental data capture and log parsing. We are searching for hands-on engineers eager to make a significant impact on a crucial challenge for the organization.

Join Databricks as a Staff Software Engineer and be part of our mission to empower data teams to tackle some of the world's most challenging problems. From revolutionizing transportation to speeding up medical innovations, we create and manage the leading data and AI infrastructure platform that allows our customers to harness deep data insights and enhance their businesses. Founded by engineers with a customer-first mindset, we eagerly tackle every technical challenge, whether it's designing next-gen UI/UX for data interaction or expanding our services and infrastructure to millions of virtual machines.Databricks Mosaic AI introduces a pioneering, data-centric methodology for developing enterprise-grade Machine Learning and Generative AI solutions. This approach enables organizations to securely and cost-effectively manage and deploy ML and AI models utilizing their proprietary data. We're excited to expand our presence in Bengaluru, India, as we establish 10 new teams from the ground up!As a Staff Software Engineer at Databricks, you will have the opportunity to work in the following areas:Backend DevelopmentDistributed Data Systems (DDS)Full Stack EngineeringYour Impact:1. Engage with our Backend teams across diverse domains, addressing challenges such as:Developing solutions that integrate product and infrastructure aspects, including distributed systems, scalable service architecture, monitoring, workflow orchestration, and enhancing developer experience.Delivering reliable, high-performance services and client libraries for managing vast amounts of data on cloud storage platforms like AWS S3 and Azure Blob Store.Creating robust, scalable services using technologies such as Scala and Kubernetes, as well as data pipelines with Apache Spark™, to support pricing infrastructure serving millions of cluster-hours daily, and developing features that enable customers to effortlessly monitor and control platform usage.2. Collaborate with our DDS team, which focuses on:Apache Spark™Data Plane StorageDelta LakeDelta PipelinesPerformance Engineering3. As a Full Stack Engineer, work alongside team members and product management to create delightful user experiences.

Join Databricks as a Staff Software Engineer and contribute to our innovative infrastructure that empowers data teams to excel with confidence and scalability. Our unified schema migration platform is the backbone of automated, observable, and developer-friendly workflows, ensuring that Databricks can swiftly evolve across thousands of databases and over 60 critical services.Key Responsibilities:Schema Migration Platform: Design and maintain an automated infrastructure for schema changes in MySQL and TiDB, focusing on versioning, rollback, validation, and auditing to ensure swift, safe migrations.Scale, Reliability & Test Harness: Guarantee the platform’s operation across a vast array of global databases without downtime, while enhancing resilience, observability, and recovery measures, along with developing a test harness for migration and deployment validation.Developer Experience & CI/CD Integration: Create user-friendly tools and APIs for efficient schema and data change management, integrating migration workflows into CI/CD pipelines to boost speed and reduce friction.Schema & Data Management: Construct infrastructure for secure, large-scale schema and data operations, ensuring that backfill processes are monitored, retryable, minimally disruptive, and automated to maintain data integrity in line with schema evolution.Your Impact:Enhance the scalability and reliability of schema and data operations across Databricks’ global presence.Facilitate predictable deployments by architecting robust test harnesses and automation tools.Improve the developer experience by delivering accessible and resilient tools that simplify complex migrations.Ensure the integrity of schema and data through safe and efficient backfill strategies.

Join our dynamic team at Databricks as a Staff Software Engineer, specializing in Search Quality. In this pivotal role, you'll contribute to enhancing our search functionalities, ensuring users have an exceptional experience when utilizing our platform. You will work closely with cross-functional teams to design, implement, and optimize algorithms that improve search accuracy and relevance.

P-1348 Join Databricks, where our mission is to empower data teams to tackle the world's most challenging problems, from detecting security threats to advancing cancer drug development. We build and maintain the premier data and AI infrastructure platform, enabling our customers to focus on their critical missions. Our engineering teams are dedicated to creating innovative technical products that address significant needs while pushing the limits of data and AI technology. We operate with the resilience, security, and scalability necessary to ensure our customers succeed on our platform. Our platform operates at an unparalleled scale, comprising millions of virtual machines and generating terabytes of logs, processing exabytes of data daily. We encounter various cloud hardware, network, and operating system faults, and our software must adeptly protect our customers from these challenges. As a Staff Software Engineer on the Data Platform team, you will contribute to the development of the Data Intelligence Platform at Databricks, automating decision-making processes across the organization. Collaborating with Product Teams, Data Science, Applied AI, and more, you will create tools for logging, orchestration, data transformation, metric storage, governance platforms, and data consumption layers. Leveraging cutting-edge Databricks products and tools within the data ecosystem, your team will serve as a significant in-house customer, providing insights that shape our product's future. Your Impact: Design and manage the Databricks metrics store, facilitating shared access to detailed metrics across business units and engineering teams with high quality and performance. Develop the cross-company Data Intelligence Platform, encompassing all business and product metrics necessary for running Databricks, balancing data protection with ease of sharing as we transition to a public entity. Create tools and infrastructure for efficiently managing Databricks operations at scale across multiple clouds and geographies, including CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tools. Establish the foundational ETL framework utilized by all company-developed pipelines. Collaborate with engineering teams to enhance...

P-995 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues — from bringing innovative transportation solutions to life to accelerating groundbreaking medical discoveries. We achieve this by developing and operating the leading data and AI infrastructure platform, enabling our clients to leverage deep data insights for enhanced business performance. Established by engineers with a customer-centric approach, we seize every chance to address technical challenges, from designing next-generation UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. Our journey has only just begun. As one of the initial Engineering Managers within the Software Engineering team at Databricks India, you will lead your team in creating infrastructure and products for the Databricks platform at scale. We have multiple teams focusing on various domains. Resource management infrastructure that supports big data and machine learning workloads on the Databricks platform in a secure, scalable, and cloud-agnostic manner. Development of reliable, scalable services and client libraries capable of handling vast amounts of data across multiple cloud providers and geographic regions. Creation of tools that enable Databricks engineers to manage their services across diverse clouds and environments. Development of services, products, and infrastructure at the nexus of machine learning and distributed systems. Your Impact: Recruit top-notch engineers to assemble an exceptional team. Establish high technical standards through the implementation of processes (architecture reviews, testing) and fostering a culture of engineering excellence. Collaborate with engineering and product leadership to craft a long-term roadmap. Facilitate execution and teamwork across various teams to overcome cross-functional project hurdles.

P-1386 At Databricks, we are dedicated to empowering data teams to address the most challenging problems globally — whether it's realizing the next mode of transportation or fast-tracking medical advancements. Our mission is fulfilled by constructing and managing the world's premier data and AI infrastructure platform, enabling our clients to leverage deep data insights for business enhancement. Established by engineers with a customer-centric philosophy, we eagerly embrace every opportunity to confront technical obstacles, from designing next-gen UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. And this is just the beginning. As a Senior Backline Technical Solutions Engineer, you will play a crucial role in ensuring customer success with the Databricks platform by addressing significant technical escalations and collaborating closely with the frontline support team. You will act as the technical liaison between support and engineering, serving as the first line of defense for engineering challenges. Your expertise will vet all issues before they escalate to the engineering team. You will report directly to the Manager of the Backline Engineering Team. Your Impact: Troubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core component metrics and logs. Provide best practice recommendations for performance enhancements in customer-specific environments and offer feedback for product improvements. Assist the support team with detailed troubleshooting guides and operational runbooks. Contribute to automation and tooling initiatives to streamline daily troubleshooting processes. Collaborate with engineering teams to disseminate knowledge about upcoming features and releases. Identify and contribute to supportability features that can be integrated back into the product. Exhibit ownership and coordinate with engineering and escalation teams to ensure resolution of customer issues and requests. Engage in weekend and weekday on-call rotation.

P-1405 At Databricks, our mission is to empower data teams to tackle some of the most challenging issues facing the world—whether it's revolutionizing transportation or accelerating medical advancements. We achieve this by developing and managing a cutting-edge data and AI infrastructure platform that enables our clients to harness deep data insights to enhance their businesses. Founded by engineers and driven by a customer-centric philosophy, we eagerly embrace technical challenges—from innovating next-gen UI/UX for data interaction to scaling our services across millions of virtual machines. Databricks Mosaic AI brings a unique, data-centric methodology to constructing enterprise-grade Machine Learning and Generative AI solutions, allowing organizations to securely and cost-effectively host and utilize ML and Generative AI models enriched with their enterprise data. We're excited to expand our operations in Bengaluru, India, by establishing 10 new teams from the ground up! The Partner Ecosystem team at Databricks is dedicated to enhancing customer workloads through seamless integrations with strategic partners, while also expanding our ecosystem to include new partners and data applications. This team is vital in enabling smooth connectivity between Databricks and an extensive range of partner applications via SQLDrivers. This crucial data integration work drives a significant portion of our Data Warehousing revenue by allowing clients to effortlessly connect their applications to Databricks SQL. Furthermore, with products like Databricks Partner Connect, we are simplifying the discovery and integration process, enabling you to incorporate your preferred tools directly within the Databricks platform. We are currently looking for a seasoned Senior Engineer to join our Partner Ecosystem team. In this pivotal role, you will be responsible for designing, developing, and maintaining SQL drivers that facilitate the majority of data warehousing traffic and essential infrastructure components that support our partner integrations. Your primary focus will be on optimizing SQLDrivers for enhanced performance, reliability, and telemetry to provide seamless connectivity to our partners and enterprise clients. Additionally, you will maintain open-source repositories and actively engage with the developer community. Collaboration with cross-functional teams will be key as you define technical requirements, architect solutions, and implement robust systems that enable our partners to connect seamlessly to the Databricks platform, ultimately driving Data Warehousing revenue and enhancing customer satisfaction.