About the job
Join the Mindrift team as a Freelance Python Data Scraping Engineer for the Tendem project, where you'll play a pivotal role in enhancing our hybrid AI + human data workflows.
In this part-time remote position, referred to as an AI Pilot at Mindrift, you will collaborate with Tendem Agents who take care of repetitive tasks, while you apply your critical thinking and domain expertise to ensure the delivery of high-quality, actionable data.
About Mindrift
At Mindrift, we connect talented specialists with groundbreaking AI projects from leading technology organizations. Our mission is to harness the power of Generative AI by leveraging real-world expertise from around the globe.
Role Overview
This freelance opportunity involves managing data scraping tasks that require technical precision for web extraction and processing. You will utilize various tools including Apify and OpenRouter, along with your own innovative strategies.
Key Responsibilities
- Lead end-to-end data extraction workflows across diverse websites, ensuring thorough coverage, accuracy, and dependable delivery of structured datasets.
- Utilize internal tools (Apify, OpenRouter) and custom workflows to expedite data collection, validation, and task execution while adhering to project requirements.
- Ensure reliable extraction from dynamic web sources, adapting methods to handle JavaScript-rendered content and evolving site behavior.
- Uphold data quality standards through validation checks, consistency controls across different sources, and systematic verification before delivery.
- Scale scraping operations for extensive datasets using efficient batching or parallelization, monitor for failures, and maintain stability against minor site structural changes.
Compensation
Compensation for this project can reach up to $32 per hour, depending on your expertise and contribution pace.
How to Apply
To get started, simply submit your application and, upon qualification, you'll have the opportunity to work on projects that align with your technical skills, all on your own schedule. Your contributions will be vital in advancing AI capabilities and real-world applications.
