About the job
Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects talented specialists with project-based AI opportunities for leading technology firms, focusing on the assessment, testing, and enhancement of AI systems. Participation is project-based and does not constitute permanent employment.
What the opportunity entails:
As a Senior Software Engineer in Test, you will develop intricate coding test cases designed to challenge AI coding systems to their maximum potential:
- Analyze and enhance realistic coding tasks derived from existing production codebases, ensuring they have appropriate scope, requirements, and information sources.
- Design comprehensive functional tests that examine actual end-to-end behaviors and edge cases, going beyond simple checks.
- Create engaging challenges that provide the AI with necessary context while requiring it to navigate complex reasoning and dispersed information across files and external sources.
- Evaluate AI failures to discern what models struggle with versus what they excel at.
- Refine your work based on feedback from expert QA reviewers who evaluate your submissions against seven quality criteria.
What we seek:
This role is perfect for seasoned developers, software engineers, or test automation specialists open to part-time, non-permanent projects. Ideal candidates will possess:
- A degree in Computer Science, Software Engineering, or a related field.
- 5+ years of software development experience, with a primary focus on Python (including skills in pytest, async/await, subprocess, and file operations).
- A background in Full-Stack development, equally balancing the creation of React-based interfaces and robust backend systems.
- Experience in writing various tests (functional, integration) rather than merely executing them.
- Familiarity with Docker containers (running evaluations locally in containers).
- An understanding of CI/CD processes (specifically GitHub Actions as a user: triggers, labels, and result interpretation).
- English proficiency at a B2 level or higher.
How the process works:
1. Apply → 2. Pass qualifications → 3. Join a project → 4. Complete tasks → 5. Get paid.
Effort estimate:
Tasks for this project are projected to require around 20 hours to complete, contingent on complexity. This is an estimate; you have the flexibility to determine when and how you work. Tasks should be submitted by the deadline and must meet the specified acceptance criteria to be considered complete.
Compensation:
Contributors on this project can earn up to $12 per hour, dependent on their experience and contribution rate. Compensation varies across projects based on their scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their criteria.

