Qualifications
Key QualificationsProven experience in designing and scaling web crawlers, or a strong eagerness to learn quickly in this domain. Proficiency in high-performance programming languages such as C++ or Rust. Familiarity with TypeScript, Playwright, modern web design principles, and the Chrome DevTools Protocol (CDP). Adept at optimizing systems to achieve exceptional performance. A passion for tackling the challenges of acquiring high-quality knowledge and an understanding of its importance in today's world.
About the job
At Exa, we are on a mission to create a groundbreaking search engine from the ground up, designed to empower every AI application. Our team develops robust infrastructure to efficiently crawl the web, trains cutting-edge embedding models for indexing, and engineers high-performance vector databases in Rust for seamless searching. We also manage a state-of-the-art $5M H200 GPU cluster that powers tens of thousands of machines.
As a Software Engineer specializing in Web Crawling, you will take on the exciting challenge of building a web crawler that operates at a scale comparable to Google, revolutionizing the way we access and utilize information online.
About Exa
Exa is at the forefront of innovation, building a powerful search engine designed to support the next generation of AI applications. We leverage cutting-edge technology and a multi-million dollar GPU infrastructure to reshape how information is accessed and utilized globally.