About the job
Mindrift connects professionals with AI projects for leading technology companies. The platform focuses on advancing Generative AI by involving specialists from around the world.
Role overview
This Freelance Python Data Scraping Engineer position supports the Tendem project. The role is remote and part-time, open to candidates based in Hyderabad, Telangana, India, or those working remotely from there. Work centers on improving hybrid AI and human-driven data scraping workflows. As an AI Pilot, collaboration with Tendem Agents is a key part of the job. The position blends hands-on technical work with critical thinking and quality control, aiming for precise and actionable web data extraction.
What you will do
- Manage end-to-end data extraction on complex websites to deliver accurate, structured datasets.
- Work with internal tools such as Apify and OpenRouter, plus custom methods, to collect, validate, and process data to meet project needs.
- Adjust scraping strategies for dynamic, interactive, and JavaScript-heavy web content, responding to changes in site behavior as they arise.
- Maintain high data quality through validation, consistency checks, compliance with formatting standards, and thorough verification before delivery.
- Optimize large-scale scraping by batching or parallel processing, monitoring for failures, and adapting to changes in site structure.
Requirements
- Minimum 3 years of experience in data engineering, web scraping, automation, or similar fields.
- Strong Python skills and experience with web scraping frameworks.
- Demonstrated ability to extract data from complex and dynamic web applications.
- Keen analytical skills and attention to detail for data quality.
- Clear written and verbal communication abilities.
Compensation
Contributors may earn up to $12 per hour, depending on experience and pace. Compensation varies by project scope, complexity, and expertise required.
How to get started
Apply to this posting and complete the qualification process to join. Projects are matched to technical strengths, and schedules are flexible. Tasks include coding, automation, and refining AI outputs, all aimed at improving AI capabilities and practical applications.

