Freelance Python Data Scraping Engineer

MindriftRemote — Queensland, AustraliaNew
Remote Part-time A$32/hr - A$32/hr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Experience

Qualifications

Minimum of 3 years of relevant experience in data engineering, web scraping, and automation. Proficient in Python and familiar with web scraping frameworks and libraries. Strong problem-solving skills and the ability to adapt to changing web environments. Experience with data quality assurance and validation techniques. Ability to work independently and manage multiple tasks effectively.

About the job

Join the Mindrift team as a Freelance Python Data Scraping Engineer for the Tendem project, where you'll play a pivotal role in enhancing our hybrid AI + human data workflows.

In this part-time remote position, referred to as an AI Pilot at Mindrift, you will collaborate with Tendem Agents who take care of repetitive tasks, while you apply your critical thinking and domain expertise to ensure the delivery of high-quality, actionable data.

About Mindrift

At Mindrift, we connect talented specialists with groundbreaking AI projects from leading technology organizations. Our mission is to harness the power of Generative AI by leveraging real-world expertise from around the globe.

Role Overview

This freelance opportunity involves managing data scraping tasks that require technical precision for web extraction and processing. You will utilize various tools including Apify and OpenRouter, along with your own innovative strategies.

Key Responsibilities

  • Lead end-to-end data extraction workflows across diverse websites, ensuring thorough coverage, accuracy, and dependable delivery of structured datasets.
  • Utilize internal tools (Apify, OpenRouter) and custom workflows to expedite data collection, validation, and task execution while adhering to project requirements.
  • Ensure reliable extraction from dynamic web sources, adapting methods to handle JavaScript-rendered content and evolving site behavior.
  • Uphold data quality standards through validation checks, consistency controls across different sources, and systematic verification before delivery.
  • Scale scraping operations for extensive datasets using efficient batching or parallelization, monitor for failures, and maintain stability against minor site structural changes.

Compensation

Compensation for this project can reach up to $32 per hour, depending on your expertise and contribution pace.

How to Apply

To get started, simply submit your application and, upon qualification, you'll have the opportunity to work on projects that align with your technical skills, all on your own schedule. Your contributions will be vital in advancing AI capabilities and real-world applications.

About Mindrift

Mindrift is at the forefront of integrating AI with human expertise to tackle complex data challenges. Our platform connects skilled professionals with innovative AI projects from major tech companies, aiming to unlock the potential of Generative AI through global collaboration.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.