About the job
Mindrift is hiring a Senior Python Data Scraping Engineer for a freelance, remote role based in Glasgow, Scotland, United Kingdom. This position focuses on the Tendem project and involves guiding data extraction workflows as an AI Pilot. The work is part-time and designed for professionals with strong experience in web scraping, data extraction, and data processing.
Role Overview
This role centers on overseeing the full data extraction process from complex websites. The Senior Python Data Scraping Engineer will collaborate with Tendem Agents, who manage repetitive tasks, while taking responsibility for the technical direction and quality of data workflows.
What You Will Do
- Manage end-to-end extraction of structured datasets from a range of complex web sources, ensuring accuracy and timely completion.
- Utilize internal tools such as Apify and OpenRouter, and apply custom strategies to improve efficiency in data collection and validation.
- Adjust scraping techniques for dynamic and JavaScript-heavy websites with varying structures.
- Conduct thorough validation to maintain high data quality, ensuring consistency and correct formatting across all sources.
- Scale data operations by batching or parallelizing tasks, monitor for failures, and respond to minor changes in website layouts.
Compensation
Freelance contributors on this project can earn up to $37 per hour, depending on experience and pace. Actual rates may vary based on project scope, complexity, and required expertise.

