About the job
Kindly submit your CV in English and specify your English proficiency level.
Mindrift connects skilled professionals with project-based AI opportunities for top technology firms, emphasizing the evaluation, testing, and enhancement of AI systems. This role is project-based and does not constitute permanent employment.
What this role entails:
You will be tasked with developing challenging coding tests that evaluate AI coding systems to their fullest potential:
- Critically assess and enhance realistic coding tasks based on provided production codebases, ensuring they have appropriate scope and clear requirements.
- Develop thorough functional tests that validate the actual end-to-end functionality and address edge cases, rather than just superficial checks.
- Design “fair yet challenging” tasks where the AI has access to all necessary context but must engage in complex reasoning (information may be dispersed across various files and external resources).
- Examine AI failures to pinpoint areas where the model excels versus where it encounters difficulties.
- Refine your work in response to feedback from specialist QA reviewers who evaluate submissions against seven quality criteria.
Our Ideal Candidate:
This position is well-suited for seasoned developers, software engineers, or test automation specialists open to part-time, non-permanent engagements. Ideal candidates will possess:
- A degree in Computer Science, Software Engineering, or a closely related field.
- Over 5 years of software development experience, predominantly in Python (including pytest, async/await, subprocess, and file operations).
- A background in Full-Stack development, with balanced expertise in creating React-based user interfaces and robust back-end systems.
- Experience in writing tests (functional and integration) rather than merely executing them.
- Proficiency with Docker containers (to run evaluations locally in containers).
- An understanding of CI/CD processes (user experience with GitHub Actions: triggers, labels, and result analysis).
- English proficiency at a B2 level or higher.
Application Process:
Apply → Complete qualifications → Join a project → Execute tasks → Receive payment.
Time Commitment:
Tasks for this project are estimated to require around 20 hours to finish, depending on complexity. This is an estimate, not a deadline; you have the flexibility to choose your working hours. All tasks must be submitted by the specified deadline and must meet the acceptance criteria to be approved.
Compensation:
- Compensated contributions, with rates up to $50/hour*
- Fixed project rates or individual rates, subject to the specifics of each project.
- Some projects may offer additional incentive payments.
*Note: Rates may vary based on expertise, skills assessment, geographical location, project requirements, and other factors. Higher rates may be extended to highly specialized professionals. Lower rates may apply during onboarding or non-core project phases. Payment specifics will be provided per project.