About the job
We invite you to submit your CV in English, specifying your level of English proficiency.
Mindrift is your gateway to engaging project-based AI opportunities with top-tier technology companies, concentrating on the evaluation, testing, and enhancement of AI systems. Please note that participation is project-based and does not constitute permanent employment.
Opportunity Overview
In this role, you will be responsible for developing intricate coding test cases that challenge AI coding systems:
- Evaluate and enhance realistic coding tasks derived from provided production codebases, ensuring alignment with genuine scope and requirements.
- Design comprehensive functional tests that validate true end-to-end behavior and edge cases, moving beyond superficial checks.
- Create “fair but challenging” scenarios that provide AI with all necessary context, requiring significant effort to solve (information distributed across files and external sources, demanding complex reasoning).
- Examine AI failures to identify areas of difficulty for the model compared to its strengths.
- Refine your work based on feedback from expert QA reviewers who assess your contributions against seven quality criteria.
Desired Qualifications
This role is suitable for seasoned developers, software engineers, and test automation specialists seeking part-time, non-permanent engagements. Ideal candidates should possess:
- A degree in Computer Science, Software Engineering, or related fields.
- Over 5 years of experience in software development, primarily utilizing Python (pytest, async/await, subprocess, file operations).
- A background in Full-Stack development, with balanced expertise in both React-based front-end interfaces and robust back-end systems.
- Experience in writing tests (functional and integration—not just executing them).
- Familiarity with Docker containers (for local evaluations).
- An understanding of CI/CD processes (specifically GitHub Actions: triggers, labels, interpreting results).
- English proficiency at a B2 level or higher.
Application Process
Apply → Pass qualification(s) → Join a project → Complete tasks → Get compensated.
Estimated Effort
The tasks for this project are estimated to require approximately 20 hours for completion, depending on complexity. This is an estimate; you will have the flexibility to decide when and how to work. Tasks must be submitted by the deadline and adhere to the specified acceptance criteria to be accepted.
Compensation
- Compensated contributions, with rates up to $50/hour*.
- Fixed project rates or individual rates, contingent on the project.
- Some projects may include incentive payments.
*Note: Compensation rates vary based on expertise, skills assessment, location, project requirements, and other factors. Higher rates may be available for highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment specifics will be provided per project.

