Qualifications
Key ResponsibilitiesLead the development and deployment of machine learning-based search and discovery relevance models integrated with Databricks' products and services.Design and implement automated machine learning and natural language processing pipelines for data preprocessing, query understanding, ranking, retrieval, and model evaluation to enable rapid experimentation and iteration.Work collaboratively with product managers and cross-functional teams to spearhead technology-driven initiatives that foster innovative business strategies and product roadmaps for the search and discovery experience.Contribute to establishing a solid framework for evaluating search ranking improvements, both offline and online.What We’re Looking ForBachelor's degree (Master's or PhD preferred) in Computer Science or a related field.6+ years of experience developing search relevance systems at scale, whether in production or high-impact research settings.Proficient in applying large language models (LLMs) to search relevance.Experience in one or more of the following areas:Query understandingNLPText miningRecommendationsPersonalizationDiscoveryConversational AIStrong grasp of computer science fundamentals.Active contributions to widely-used open-source projects.
About the job
The Applied AI team at Databricks is at the leading edge of developing innovative AI and machine learning-powered products. Our customers continuously create vast numbers of assets—such as tables, notebooks, dashboards, data rooms, pipelines, SQL queries, and ML models—on our platform, some totaling hundreds of millions of assets. Navigating and locating these assets is vital for our users to efficiently complete their tasks.
As our Search product continues to grow and advance, we are looking for multiple ML Engineers at various seniority levels to enhance our Search Quality. In 2026, our focus will be on improving search ranking, enhancing query understanding, building robust evaluations, and expanding asset coverage to facilitate seamless search capabilities at scale.
About Databricks
At Databricks, we are pioneering state-of-the-art AI solutions that transform the way users engage with data and our products. Join us to be a part of a dynamic environment that fosters innovation and creativity.
