Toloka AI logo

Senior Python Systems Developer for Functional Testing

Toloka AIRemote — Austria
Remote Contract $30/hr - $30/hr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Senior

Qualifications

Qualifications:5+ years as a Software Engineer, primarily using Python. Expertise in pytest and black-box functional testing. Proficient in Docker and Linux. Experience with multiple programming languages through LLMs. B2 level or higher in English.

About the job

We invite you to submit your CV in English and specify your level of English proficiency.

At Mindrift, we bridge skilled professionals with project-based opportunities in AI for top-tier tech companies, specializing in the testing, evaluation, and enhancement of AI systems. This position is project-based and does not offer permanent employment.

About the Role

We are looking for an accomplished Senior Python Developer with extensive expertise in functional testing. The ideal candidate should possess robust knowledge of Linux and Docker, as well as the ability to interpret code across various languages (such as C, Rust, Go) using large language models (LLMs). You will be responsible for translating requirements related to migration tasks and leveraging tools like Roo Code or Claude Code to streamline iterative development.

Key Responsibilities

  • Develop and execute functional black-box tests for extensive codebases written in multiple programming languages.
  • Set up and maintain Docker environments to ensure fully reproducible builds and test executions across diverse platforms.
  • Track code coverage and establish automated scoring metrics to achieve industry-standard benchmarks.
  • Utilize LLMs (Roo Code, Claude) to expedite development cycles, automate repetitive tasks, and enhance code quality.

Requirements

  • A minimum of 5 years of experience as a Software Engineer, with a focus on Python.
  • Extensive experience with pytest (including fixtures, session scopes, and timeouts) and the design of black-box functional tests for CLI tools.
  • Proficient in Docker, including creating reproducible Dockerfiles and managing user contexts and secure workspaces.
  • Strong skills in Linux and Bash scripting, with the ability to debug within containers.
  • Familiarity with modern Python tools (uv, pyproject.toml, packaging).
  • Capability to read and comprehend multiple programming languages (e.g., C, C++, Rust, Go) with the assistance of LLMs.
  • Experience with LLMs (Claude Code, Roo Code, Cursor) to facilitate iterative development and generate test cases.
  • English proficiency at a B2 level or higher.

Preferred Qualifications

  • Previous experience with agent evaluation platforms and MCP CLI.

Tools and Technologies: Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.

Benefits

What We Offer

  • Freelance project-based collaboration through the Mindrift platform powered by Toloka AI.
  • Fully remote and flexible participation, you can choose when and how much to contribute (20-30 hours per week).
  • Compensation varies by project scope and expertise. For this project, AI trainers can earn up to $30 per hour.

About Toloka AI

Mindrift is a leading platform connecting skilled professionals with project-based AI opportunities at top technology firms. We focus on enhancing AI systems through rigorous testing and evaluation.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.