companyJetBrains s.r.o. logo

Senior Machine Learning Engineer - IntelliJ AI

JetBrains s.r.o.Amsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; Limassol, Cyprus; London, United Kingdom; Munich, Germany; Paphos, Cyprus; Prague, Czech Republic
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Key Responsibilities: Develop and implement evaluation frameworks for AI features, including metrics, experiments, and trace analysis. Identify and resolve model performance challenges, such as prompt drift and latency/quality trade-offs, transforming insights into practical enhancements. Conduct experiments with contexts and lightweight models to continuously refine our machine learning system. Serve as the ML liaison for product teams, adapting and scaling AI functionalities within JetBrains IDEs. Create and sustain small supporting models (e.g., re-rankers, classifiers) tailored for specific tasks. Collaborate with colleagues across ML, product, engineering, and analytics teams to implement improvements and assess their production impact. Stay informed on the latest research in LLMs, agents, and evaluation methodologies, integrating best practices into our processes. Mentor junior engineers and contribute to the cultivation of a positive team culture, enhancing our experimentation and evaluation practices. Qualifications: Minimum of 5 years experience as a Machine Learning Engineer, with a robust background in production-grade ML systems, particularly LLMs and agent architectures. Familiarity with LLM evaluation methodologies and frameworks. Ability to design and execute comprehensive experiments, including hypothesis formulation, data collection, analysis, and decision-making. Proficient in context-aware pipelines or conversational/agent systems. Strong programming skills in Python.

About the job

At JetBrains, we are passionate about coding. Since our inception in 2000, our mission has been to develop the most powerful and efficient developer tools available. Our tools are designed to automate repetitive tasks, accelerating production and enabling developers to innovate and explore.

The AI features integrated into JetBrains IDEs, crafted by the IntelliJ AI team, have swiftly become essential to a developer's workflow. We collaborate with various product teams across JetBrains to infuse cutting-edge AI capabilities that enhance developer efficiency and provide significant value to software engineers.

We are excited to welcome a Senior Machine Learning Engineer to our team. In this pivotal role, you will play a key part in realizing our vision of AI assistance throughout the software development lifecycle within JetBrains IDEs. As a member of the ML subteam within IntelliJ AI, you will oversee the end-to-end development of our machine learning systems, defining evaluation metrics, orchestrating context, and customizing AI features to meet the unique needs of product teams.

About JetBrains s.r.o.

JetBrains is a leading software development company known for its innovative IDEs and tools that enhance developer productivity. With a strong focus on automation and efficiency, our products empower developers to achieve their full potential.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.