About the job
We kindly request that you submit your CV in English, and specify your proficiency level in the English language.
Mindrift connects skilled professionals with project-based AI opportunities at leading technology companies, focusing on the testing, evaluation, and enhancement of AI systems. Engagement is project-based and does not constitute permanent employment.
Opportunity Overview
In this role, you will devise challenging coding test cases aimed at testing the limits of AI coding systems:
- Evaluate and enhance realistic coding tasks derived from actual production codebases, ensuring a practical scope, requirements, and information sources.
- Develop thorough functional tests that validate genuine end-to-end behavior and edge cases, moving beyond superficial checks.
- Create “fair yet challenging” tasks where the AI has all necessary context but must exert effort to find it (with information dispersed across various files and external sources, requiring complex reasoning).
- Investigate AI failures to discern the model's weaknesses versus its strengths.
- Iterate based on feedback from expert QA reviewers who assess your work against seven quality criteria.
Desired Qualifications
This role is ideal for experienced developers, software engineers, and/or test automation specialists looking for part-time, non-permanent projects. Preferred candidates will possess:
- A degree in Computer Science, Software Engineering, or a related field.
- 5+ years of experience in software development, primarily utilizing Python (pytest, async/await, subprocess, file operations).
- A background in full-stack development, with balanced expertise in developing React-based interfaces and robust back-end systems.
- Proven experience in writing tests (functional and integration—rather than merely executing them).
- Proficiency in Docker containers (for executing evaluations locally in containers).
- A solid understanding of CI/CD practices (e.g., using GitHub Actions: triggers, labels, analyzing results).
- English proficiency at a B2 level or higher.
How the Process Works
Apply → Successfully pass qualifications → Join a project → Complete assigned tasks → Receive payment.
Estimated Effort
Tasks for this project are estimated to require approximately 20 hours to complete, depending on their complexity. This is a guideline and not a scheduling requirement; you are free to decide when and how to work. Submitted tasks must adhere to the deadline and meet specified acceptance criteria to be approved.
Compensation
- Paid contributions at rates up to $50/hour*.
- Compensation may be based on fixed project rates or individual rates, depending on project specifics.
- Some projects may include additional incentive payments.
*Note: Compensation rates vary based on expertise, skills evaluation, location, project requirements, and other factors. Higher rates may be available for exceptionally specialized experts. Lower rates may be applicable during onboarding or non-core phases of projects. Payment details will be provided for each project.

