About the job
Kindly submit your CV in English and specify your level of English proficiency.
Mindrift bridges the gap between skilled professionals and project-based AI opportunities for top tech companies, focusing on the testing, evaluation, and enhancement of AI systems. This is a project-based opportunity, not a permanent position.
Project Overview:
Your role will involve creating intricate coding test cases designed to challenge AI coding systems to their fullest potential:
- Evaluate and enhance realistic coding tasks derived from provided production codebases, ensuring they have a realistic scope and set of requirements.
- Develop thorough functional tests to validate the actual end-to-end behavior and edge cases, going beyond superficial checks.
- Design “fair yet challenging” tasks that provide the AI with necessary context while requiring it to work through information scattered across various files and external sources, demanding complex reasoning.
- Investigate AI failures to discern the model's strengths and weaknesses.
- Refine your approach based on feedback from expert QA reviewers who assess your work against seven quality criteria.
Qualifications:
This role is ideal for seasoned developers, software engineers, or test automation specialists looking for part-time, non-permanent projects. The ideal candidates will possess:
- A degree in Computer Science, Software Engineering, or a related field.
- 5+ years of experience in software development, predominantly in Python (including pytest, async/await, subprocess, file operations).
- A solid foundation in Full-Stack development, focusing equally on building React-based interfaces and robust back-end systems.
- Experience in writing tests (functional, integration) rather than merely executing them.
- Familiarity with Docker containers (for local evaluations in containers).
- An understanding of CI/CD processes (using GitHub Actions: triggers, labels, interpreting results).
- English proficiency at B2 level or higher.
How the Process Works:
Application → Qualification → Project Participation → Task Completion → Payment
Estimated Effort:
Tasks for this project are estimated to require approximately 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you have the flexibility to choose your working hours. Tasks must be submitted by the deadline and meet the acceptance criteria to be approved.
Compensation:
Contributors on this project can earn up to $50 per hour, contingent on their level of expertise and pace of work. Compensation varies by project based on scope, complexity, and required expertise. Please note that other projects available on the platform may offer varying pay levels depending on their specific requirements.