About the job
At Databricks, we are dedicated to empowering data teams to address some of the most pressing challenges in the world, ranging from security threat detection to advancements in cancer drug development. We achieve this by creating and maintaining the world’s most sophisticated data and AI infrastructure platform, allowing our clients to concentrate on the critical challenges inherent to their missions.
Our engineering teams design and implement highly technical products that meet genuine, significant needs globally. We operate one of the largest software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we consistently encounter cloud hardware, network, and operating system faults, and our software must effectively shield our customers from these issues.
The Delta DML team is responsible for the core write-path operations of Delta Lake, the open-source storage layer that underpins the Databricks Lakehouse. Our goal is to provide unparalleled performance and a seamless user experience at an enormous scale, with the majority of data written in Databricks flowing through our platform. We spearhead performance innovations such as Low Shuffle Merge and Deletion Vectors, while actively contributing to open-source initiatives to unify Delta and Iceberg formats.
We are looking for an exceptionally skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will play a crucial part in designing, developing, and maintaining robust backend systems that support Databricks workspaces. You will be tasked with building the next-generation platform for serving workspace assets, ensuring high queries per second, low latency, and reliable, high-performance systems while proactively addressing future growth challenges. Additionally, as a senior member of the team, you will provide technical leadership, mentorship, and guidance to junior engineers, contributing to the overall enhancement of team coding practices and system designs.