Qualifications
Key Responsibilities:
Guide the strategic direction of applied AI initiatives and intelligence features within our products. Lead the development and deployment of cutting-edge AI models and systems that significantly enhance the capabilities and performance of Databricks' offerings (e.g., Databricks Assistant and AI/BI Genie).
Innovate data collection, fine-tuning, and LLM technologies to achieve peak performance in specific tasks and domains.
Design and implement machine learning pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation to promote rapid experimentation and iteration.
Collaborate closely with cross-functional teams, including AI researchers, ML engineers, and product teams, to deliver impactful AI solutions that boost user productivity and satisfaction.
Construct scalable, reusable backend systems to support GenAI products company-wide. Develop robust logging, telemetry, and evaluation harnesses to ensure reliability and performance.
About the job
The Applied AI team at Databricks is dedicated to pioneering advancements in GenAI-driven products. In recent years, we have successfully launched notable innovations such as the Databricks Assistant, AI/BI Genie, and Agent Bricks. These products are utilized by hundreds of thousands of Databricks users daily. We are addressing complex challenges such as code suggestions, error detection and correction, text-to-SQL generation, automatic pipeline creation, and knowledge QA.
As our GenAI products continue to advance, we are on the lookout for multiple GenAI Engineers, ranging from junior to senior levels, to spearhead the next phase of development. In 2025, our focus will be on enhancing the quality of LLMs, broadening GenAI functionalities across Databricks products, and fortifying our platform architecture to facilitate seamless AI interactions at scale.
About Databricks
At Databricks, we are committed to transforming the way businesses harness data and AI. Our innovative platform empowers organizations with the tools needed to drive insights and enhance productivity through seamless data integration and advanced analytics.