companyExa logo

Software Engineer - Web Crawling

ExaSan Francisco, California
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Key QualificationsProven experience in designing and scaling web crawlers, or a strong eagerness to learn quickly in this domain. Proficiency in high-performance programming languages such as C++ or Rust. Familiarity with TypeScript, Playwright, modern web design principles, and the Chrome DevTools Protocol (CDP). Adept at optimizing systems to achieve exceptional performance. A passion for tackling the challenges of acquiring high-quality knowledge and an understanding of its importance in today's world.

About the job

At Exa, we are on a mission to create a groundbreaking search engine from the ground up, designed to empower every AI application. Our team develops robust infrastructure to efficiently crawl the web, trains cutting-edge embedding models for indexing, and engineers high-performance vector databases in Rust for seamless searching. We also manage a state-of-the-art $5M H200 GPU cluster that powers tens of thousands of machines.

As a Software Engineer specializing in Web Crawling, you will take on the exciting challenge of building a web crawler that operates at a scale comparable to Google, revolutionizing the way we access and utilize information online.

About Exa

Exa is at the forefront of innovation, building a powerful search engine designed to support the next generation of AI applications. We leverage cutting-edge technology and a multi-million dollar GPU infrastructure to reshape how information is accessed and utilized globally.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.