About the job
P-1127
At Databricks, we are driven by a passion for empowering data teams to tackle some of the most challenging problems globally, ranging from security threat detection to cancer drug development. Our mission revolves around creating and managing the premier data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their missions.
Our engineering teams design and maintain highly sophisticated products that address significant global needs. We develop and operate one of the most extensive software platforms in existence, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we frequently encounter cloud hardware, network, and operating system faults, necessitating that our software effectively shields our customers from such issues.
The Delta DML team is responsible for the core write-path operations for Delta Lake, the open-source storage layer supporting the Databricks Lakehouse. Our goal is to provide industry-leading performance and a seamless user experience at an immense scale, with the majority of data written in Databricks traversing our platform. We spearhead performance innovations such as Low Shuffle Merge and Deletion Vectors and actively contribute to open-source efforts aimed at unifying Delta and Iceberg formats.
We are looking for an exceptionally talented and experienced Senior Staff Software Engineer to join our backend team. In this pivotal role, you will be key in designing, developing, and maintaining robust backend systems that power Databricks workspaces. You will architect the next-generation platform for serving workspace assets, ensuring high queries per second (QPS), low latency, reliability, and performance, while proactively addressing future growth challenges. Furthermore, as a senior member of the team, you will provide technical leadership, mentorship, and guidance to junior engineers, thereby enhancing overall team coding practices and system designs.
The Impact you will have:
- Address real business needs at scale through your software engineering expertise.
- Engage in low-level systems debugging, performance measurement, and optimization on large production clusters.
- Lead architectural design, influence the product roadmap, and take ownership of new projects.
- Introduce tools to enhance the automation and operability of services.
- Utilize your deep expertise to prevent and investigate production issues.
- Plan and lead complex technical projects involving multiple teams within the company.
- Contribute as a technical team lead by mentoring others, leading sprint planning, delegating tasks, and participating in project planning.
