About the job
Please submit your CV in English and specify your English proficiency level.
Mindrift connects specialized professionals with project-based AI opportunities for leading technology companies, emphasizing the testing, evaluation, and enhancement of AI systems. This role is project-based rather than a permanent position.
Opportunity Overview
In this role, you will design intricate coding test cases that challenge AI coding systems:
- Review and enhance realistic coding tasks derived from actual production codebases with applicable scope, requirements, and information sources.
- Create thorough functional tests that verify genuine end-to-end behaviors and edge cases, avoiding mere superficial checks.
- Develop “fair yet tough” challenges where the AI has sufficient context but must engage in complex reasoning to succeed (information will be dispersed across files and external sources).
- Analyze AI shortcomings to identify areas of struggle versus mastery.
- Iterate based on feedback from expert QA reviewers who assess your work against seven quality criteria.
Ideal Candidate Profile
This position is suitable for seasoned developers, software engineers, and test automation experts interested in part-time, non-permanent projects. The ideal candidates will possess:
- A degree in Computer Science, Software Engineering, or related fields.
- Over 5 years of software development experience, primarily in Python (including pytest, async/await, subprocess, and file operations).
- A background in Full-Stack development, with balanced expertise in crafting React-based interfaces and robust back-end systems.
- Experience in writing tests (functional and integration, not just executing them).
- Familiarity with Docker containers (for local evaluations).
- Understanding of CI/CD processes (user-level experience with GitHub Actions: triggers, labels, result interpretation).
- Proficiency in English at a B2 level or higher.
Application Process
Apply → Pass qualifications → Join a project → Complete tasks → Get compensated.
Estimated Effort
Tasks for this project are estimated to require approximately 20 hours to complete, depending on complexity. This is a guideline, not a fixed schedule; you have the flexibility to determine when and how to work. Tasks must be submitted by the deadline and meet specified acceptance criteria to be accepted.
Compensation
- Paid contributions, with rates up to $45/hour*.
- Fixed project rates or individual rates may apply, depending on the project.
- Some projects may offer incentive payments.
*Note: Rates may vary based on expertise, skill assessments, location, project requirements, and other factors. Higher rates may be available for highly specialized experts, while lower rates may apply during onboarding or non-core project phases. Payment details are provided on a project basis.

