companyDatabricks logo

Senior Staff Software Engineer - Delta

DatabricksBerlin, Germany
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Qualifications: Proven experience in backend software engineering, with a focus on high-performance systems. Strong understanding of database technologies and data structures. Expertise in programming languages such as Java, Scala, or Python. Experience with cloud platforms (e.g., AWS, Azure) and distributed systems. Excellent problem-solving skills and the ability to work collaboratively in a team environment. Previous experience in mentoring junior engineers is a plus.

About the job

Join Databricks as a Senior Staff Software Engineer!

At Databricks, we are passionate about empowering data teams to tackle some of the world's most challenging problems, ranging from security threat detection to groundbreaking cancer drug development. Our mission is to build and operate the finest data and AI infrastructure platform, allowing our customers to concentrate on the high-value challenges central to their missions.

Our engineering teams develop sophisticated products that address significant needs globally. We are responsible for one of the largest-scale software platforms, consisting of millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we frequently encounter cloud hardware, network, and operating system issues, and our software is designed to shield our customers from these challenges seamlessly.

The Delta DML team is responsible for the core write-path operations of Delta Lake, the open-source storage layer powering the Databricks Lakehouse. Our goal is to deliver top-tier performance and a smooth user experience at massive scales, with the majority of data processed in Databricks traversing our platform. We spearhead performance innovations such as Low Shuffle Merge and Deletion Vectors, and actively contribute to open-source initiatives to unify Delta and Iceberg formats.

We are looking for a highly capable and experienced Senior Staff Software Engineer to join our backend team. In this pivotal role, you will be key in designing, developing, and maintaining robust backend systems that power Databricks workspaces. You will create the next-generation platform for serving workspace assets, ensuring high queries per second (QPS), low latency, reliability, and performance, while proactively addressing future growth challenges. Additionally, as a senior team member, you will provide technical leadership, mentorship, and guidance to junior engineers, enhancing overall team coding practices and system designs.

Your Impact:

  • Address real business needs at scale through your software engineering expertise.
  • Conduct low-level systems debugging, performance measurement, and optimization on extensive production clusters.
  • Architect design solutions, influence product roadmaps, and take ownership of new projects.
  • Implement tools to enhance automation and operability of services.
  • Utilize your extensive experience to help prevent and investigate production issues.
  • Plan and lead complex technical projects that involve collaboration with multiple teams across the company.
  • Act as a technical team lead by mentoring others, leading sprint planning, delegating tasks, and participating in project planning.

About Databricks

Databricks is a leading cloud-based data platform founded to simplify and accelerate data and AI workflows. We empower data teams to innovate and drive impactful solutions to the world's most pressing challenges, enabling them to harness the full potential of data.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.