companyMistral AI logo

Web Crawling Engineer

On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Role OverviewWe are seeking a talented and driven Web Crawling Engineer to join our innovative engineering team. The ideal candidate will possess a strong foundation in distributed web crawling, data scraping, and large-scale data extraction, utilizing advanced tools and technologies. Key ResponsibilitiesAs a Web Crawling Engineer, your responsibilities will include:Developing and maintaining web crawlers using Go for data extraction from target websites. Implementing headless browsing strategies, including Chrome DevTools, to automate and optimize data collection. Collaborating with cross-functional teams to identify, scrape, and integrate data from APIs and web pages that align with business goals. Creating and implementing efficient parsing patterns using tokenizers, regular expressions, XPaths, and CSS selectors for precise data extraction. Designing and managing distributed job queues utilizing technologies such as Redis, Aerospike, and Kubernetes.

About the job

About Mistral AI

At Mistral AI, we harness the transformative potential of artificial intelligence to streamline tasks, conserve time, and foster creativity and learning. Our technology is engineered for seamless integration into everyday workflows.

Our mission is to democratize AI through high-performance, optimized, and open-source models and solutions tailored for enterprises, whether on-premises or in the cloud. Among our offerings is le Chat, an AI assistant designed to enhance both personal and professional life.

We pride ourselves on being a vibrant, collaborative team, united by our passion for AI and its capability to revolutionize society. Our diverse workforce excels in competitive environments and is dedicated to driving innovation. Our teams are spread across France, the USA, the UK, Germany, and Singapore, characterized by creativity, humility, and a strong team spirit.

Join us in shaping the future of AI at Mistral, where your contributions can lead to significant societal impact. Discover more about our culture at https://mistral.ai/careers.

About Mistral AI

Mistral AI is a pioneering technology company focused on democratizing artificial intelligence through innovative and open-source solutions. We are dedicated to enhancing productivity and creativity in both professional and personal spheres, with a commitment to fostering a collaborative and diverse workplace culture.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.