companyDatabricks logo

Engineering Manager - Streaming at Databricks | Bellevue, WA

DatabricksBellevue, Washington
On-site Full-time $181K/yr - $253.8K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Manager

Qualifications

Key responsibilities include:Leading a skilled engineering team in the Spark™ Structured Streaming division to develop and promote the engine in both OSS and the Databricks Data Intelligence Platform. Overseeing continuous recruitment of top-notch talent and enhancing the skills of existing team members. Establishing robust processes to effectively execute product vision, strategy, and roadmap, aligning with organizational objectives. Developing software that is not only high quality but also user-friendly. Driving company-wide impact by fostering Stream Processing adoption across the Databricks product suite. Managing technical debt, including making long-term architectural decisions and balancing the product roadmap.

About the job

At Databricks, we are committed to empowering data teams to tackle the world’s most challenging issues—from pioneering the next generation of transportation to fast-tracking medical innovations. We achieve this by developing and operating the premier data and AI infrastructure platform, enabling our clients to leverage deep data insights for enhanced business performance.

Join our Spark™ Structured Streaming team, where we are at the forefront of integrating Stream Processing capabilities into the Spark™ and Databricks Intelligence Platform. As the stream processing landscape evolves, we aim to not only create cutting-edge technology but also to deliver a leading managed service that empowers customers to efficiently handle their Stream Processing workloads.

We are looking for an experienced Engineering Leader to drive the development of Spark™ Structured Streaming initiatives, incorporating both open-source and Databricks-specific elements. Your primary goal will be to elevate Spark™ Structured Streaming into a premier Stream Processing engine by introducing advanced features such as enhanced state management and new operators, while also optimizing performance from both latency and throughput perspectives through innovative architectural designs.

About Databricks

Databricks is a leader in the data and AI infrastructure space, dedicated to solving complex challenges faced by data teams globally. With a focus on innovation and excellence, we provide the tools and platform necessary for organizations to unlock the full potential of their data.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.