companyJetBrains s.r.o. logo

Research Engineer - Kotlin AI Value Stream

JetBrains s.r.o.Amsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; Limassol, Cyprus; Madrid, Spain; Munich, Germany; Prague, Czech Republic; Warsaw, Poland; Yerevan, Armenia
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Responsibilities include: Develop tools for error analysis: Create and implement systems to systematically capture, classify, and analyze errors made by AI coding agents when generating Kotlin code. Establish evaluation pipelines: Design, implement, and maintain evaluation pipelines that measure Kotlin code generation quality across various criteria, like correctness, idiomaticity, build success, framework usage, and test coverage. Research methods for enhancing agent behavior: Experiment with post-training techniques (SFT, DPO, GRPO) to improve model handling of Kotlin-specific patterns and frameworks. Collaborate with model providers such as Anthropic, OpenAI, and Google to translate findings into actionable improvements for agent behavior.

About the job

At JetBrains, we are driven by a passion for code. Since our inception in 2000, we've dedicated ourselves to crafting the most powerful and efficient developer tools available. As AI-driven coding agents become integral to Kotlin development, we are committed to ensuring these tools excel in their purpose.

The Kotlin AI Value Stream team plays a pivotal role in how AI agents comprehend, generate, and enhance Kotlin code across diverse platforms, including Android, Kotlin Multiplatform, server-side, web, and desktop applications. We develop evaluation infrastructures, error analysis tools, and post-training pipelines that assess and enhance agent performance on actual Kotlin developer tasks.

In your role as a Research Engineer with our team, you will take charge of the complete feedback loop: Analyze failures in Kotlin code generated by agents, devise evaluations to identify those failures, research and implement strategies for improvement, and measure the outcomes. Your contributions will significantly influence how millions of developers interact with Kotlin through AI coding agents.

About JetBrains s.r.o.

JetBrains is a renowned software development company passionate about creating the most effective developer tools. Our commitment to innovation has made us a leader in the industry, constantly pushing boundaries since 2000.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.