companyExa logo

Machine Learning Evaluations Engineer

ExaSan Francisco, California
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Required Qualifications:Proven experience in machine learning, including model training, fine-tuning, or evaluation—experience with embeddings or LLMs is a plus. Strong engineering background with the ability to construct reliable systems using Python, Rust, and distributed pipelines, including GPU and cluster work. A passion for data analytics, with experience in building evaluation sets, analyzing edge cases, and designing innovative measurement strategies.

About the job

At Exa, we are pioneering the next generation of search engines designed for the era of artificial intelligence, starting from the foundational Silicon architecture. Our ambitious indexing operation is unparalleled, allowing us to crawl the vast open web at an extraordinary scale. We harness cutting-edge embedding models to comprehend this data and utilize our high-performance Rust-based vector database alongside a $5M H200 GPU cluster, which powers tens of thousands of machines simultaneously.

The Machine Learning (ML) division is central to this mission, focusing on the training of foundational models that enhance search capabilities. Our vision is to create systems capable of swiftly filtering the world’s knowledge to deliver precisely what you need, regardless of the complexity of your inquiry—effectively transforming the web into a robust, searchable database.

To achieve this ambitious goal, we must define what constitutes “effective search”. This is where your expertise will play a crucial role.

We are seeking a talented Machine Learning Evaluations Engineer to develop and implement our evaluation framework at Exa. This position entails exploring methodologies to assess search engines in a world dominated by large language models (LLMs) and crafting the most thorough, innovative, and impactful evaluation suite. Your decisions will influence the future of search optimization and directly affect the research team’s focus, shaping the company’s strategic direction.

About Exa

Exa is at the forefront of developing revolutionary AI-driven search technology. Our commitment to excellence and innovation leads us to build powerful tools that elevate the search experience for users worldwide. Join us as we redefine how information is accessed and utilized across the digital landscape.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.