Freelance AI Agent Evaluation Engineer

Please submit your CV in English and include your English proficiency level. This contract role supports toloka-ai through Mindrift, focusing on building and evaluating datasets that measure how well AI coding agents perform real-world developer tasks. The position is project-based and not a permanent employment opportunity. Role overview The Freelance AI Agent Evaluation Engineer creates and refines simulated development environments to test advanced AI models. The work centers on designing authentic scenarios that mirror the challenges developers face, ensuring that AI agents are thoroughly evaluated in realistic contexts. What you will do Build virtual companies from scratch, including codebases, infrastructure, and supporting materials like documentation, conversations, and tickets to establish convincing development histories. Curate and refine tasks drawn from different stages of the virtual company, draft prompts, set evaluation criteria, and ensure tasks are solvable and assessed fairly. Design assignments within isolated environments that resemble a developer's workstation, using a Linux machine equipped with development tools, MCP servers (repository, task tracker, messenger, documentation), and a working web application codebase. Write tests that accept all correct solutions while rejecting incorrect ones, carefully balancing strictness to avoid excluding valid approaches or allowing flawed solutions. Collaborate with AI agents to ensure tests catch real issues, support valid solutions, and do not miss poor ones. Review code generated by AI agents, analyze factors behind success or failure, and design edge cases and adversarial scenarios to challenge the models. Iterate on your work based on feedback from expert QA reviewers who assess your output against quality standards. What this role does not involve Data labeling Prompt engineering Writing code from scratch (the AI agent handles most coding; the focus here is on guidance and evaluation) Collaboration with AI models is central to this work. Crafting tasks that truly test advanced models requires both technical expertise and creativity in using these systems as part of the process. Location Remote , Belo Horizonte, State of Minas Gerais, Brazil

Toloka AI seeks a Strategy Consultant with expertise in AI training and evaluation. This is a remote role based in Belo Horizonte, State of Minas Gerais, Brazil. The focus is on advising organizations as they refine their AI strategies and enhance training programs. Key responsibilities Guide companies in shaping and improving their AI training and evaluation processes Offer insights to support informed decisions for AI-related projects Assist clients in building stronger AI capabilities and refining their methodologies Location This position is remote, with a focus on candidates in Belo Horizonte, State of Minas Gerais, Brazil.

Please submit your CV in English and indicate your English proficiency level. Mindrift connects specialists with project-based assignments to help technology companies assess, test, and improve AI systems. All work is project-based and does not constitute permanent employment. Role overview This freelance role is designed for electrical engineers with Python expertise who want part-time, flexible projects. Contributors support AI training and evaluation by tackling engineering challenges that require both domain knowledge and programming skills. What you will do Design computational engineering problems that reflect real-world processes Create Python-based problems for engineering calculations and simulations Develop tasks that require significant computation, often using numerical methods or iterative techniques Focus on system design, optimization, and analytical problem-solving Base assignments on current research challenges or practical engineering scenarios Validate solutions in Python, using standard engineering libraries Write clear problem statements and provide verified answers Requirements Degree in Electrical Engineering or a related discipline Proficiency with Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is also valued At least two years of professional experience in applied work, research, or teaching Strong understanding of engineering constraints and practical approximations Excellent written English at C1 level or above Professional certifications (such as CMME, SAS Certifications, CAP) and international or applied project experience are considered a plus How projects work Apply Pass qualifications Join a project Complete assigned tasks Receive compensation Project commitment During active project phases, expect to contribute an estimated 10–20 hours per week, depending on project needs. Actual hours may vary. Compensation Contributors can earn up to $14 per hour, depending on the nature and complexity of the project. Pay rates may differ across assignments based on requirements and scope. This is a remote, project-based position open to candidates based in Belo Horizonte, State of Minas Gerais, Brazil.

Role overview Toloka AI seeks a freelance AI Trainer who combines civil engineering experience with strong Python programming skills. This contract position is fully remote, with work based in Belo Horizonte, State of Minas Gerais, Brazil. What you will do Guide and support others in civil engineering topics and Python programming as part of AI-focused projects. Help develop and refine methods for AI training. Apply your expertise to influence how new AI tools are built for the civil engineering field. Location This is a remote role tied to Belo Horizonte, State of Minas Gerais, Brazil.

Please submit your CV in English and indicate your English proficiency level. toloka-ai, through the Mindrift platform, offers project-based freelance work focused on evaluating, testing, and improving AI systems for leading technology companies. This is not a permanent position; assignments are tied to specific projects. Key responsibilities Create original optics challenges that reflect real research processes in physics. Design computationally intensive problems that require computer-based solutions. Develop tasks involving advanced reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics. Base problem sets on real-world research questions or practical scenarios in optics and physics. Document problem statements clearly and provide accurate, verified solutions. Requirements Degree in Physics (theoretical, experimental, or computational) or a closely related field. Minimum of 2 years in applied, research, or teaching roles. Experience with numerical simulation methods. Ability to construct problems that mirror authentic research approaches in physics. Creative mindset for developing problems across various physics domains. Knowledge of physics modeling and approximation techniques. Strong written English skills at C1 level or higher. Project workflow Apply Pass qualification steps Join a project Complete assigned tasks Receive compensation Time commitment During active projects, expect to dedicate approximately 10 to 20 hours per week. Actual hours may vary and are only required while a project is in progress. Compensation Rates are up to $14 per hour, depending on experience and the complexity of the tasks. Compensation may differ between projects based on their requirements. Location This freelance remote position is based in Belo Horizonte, State of Minas Gerais, Brazil.

Please submit your CV in English and indicate your English proficiency level. Mindrift, in partnership with toloka-ai, connects professionals to project-based AI assignments for major technology companies. Projects focus on testing, evaluating, and improving AI systems. All roles are project-specific and non-permanent. Role overview This freelance optical engineer position centers on supporting AI training projects by designing and validating computational physics problems. Assignments are project-based and may include tasks such as: Creating computational physics problems that reflect real research workflows Developing tasks requiring Python programming solutions, using libraries like Numpy, SciPy, or Sympy Ensuring problems are computation-intensive and cannot be solved manually within days or weeks Building multi-step reasoning challenges in areas such as mechanics, electromagnetism, thermodynamics, and quantum mechanics Basing problems on real research questions or practical physics scenarios Validating solutions with Python and established physics simulation libraries Documenting clear problem statements and providing verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a closely related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is a plus Minimum of 2 years of professional experience in applied, research, or teaching settings Background in numerical simulation methods Skill in designing problems that mirror authentic physics research Creative problem-solving across multiple physics domains Knowledge of physics modeling and approximation techniques Strong written English skills at C1 level or above Application process Apply Pass qualifications Join a project Complete tasks Receive payment Time commitment Estimated workload is 10 to 20 hours per week during active project periods. Actual hours may vary depending on project requirements. Compensation Contributors may earn up to $14 per hour, depending on expertise and pace. Compensation varies by project scope, complexity, and required skills. Other assignments on the platform may offer different pay rates based on their criteria. Location This is a remote position open to candidates based in Belo Horizonte, State of Minas Gerais, Brazil.

Toloka AI seeks a freelance Mechanical Engineer with advanced Python skills to contribute to AI training projects. This contract position is fully remote and open to professionals located in Belo Horizonte or anywhere in the State of Minas Gerais, Brazil. Key responsibilities Integrate mechanical engineering expertise into AI training workflows Utilize Python for data processing, automation tasks, or model-related development Work closely with Toloka AI teams to align on project objectives and deliverables Remote work details This role offers full remote flexibility. Candidates must reside in Belo Horizonte or within the broader Minas Gerais region.

To apply, submit your CV in English and indicate your English proficiency level. Mindrift connects subject matter experts with project-based AI work for leading technology companies. Work is organized by project and does not represent permanent employment. Role overview This freelance, remote position focuses on designing and documenting advanced physics problems to support AI training. Assignments vary and may include: Developing original optics problems that reflect real-world research processes in physics Ensuring problems are computationally intensive and not easily solved by hand Creating scenarios requiring complex reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics Basing challenges on actual research questions or practical applications in optics and physics Writing clear problem statements and supplying verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a closely related field At least 2 years of professional experience, which may include research, applied, or teaching roles Experience with numerical simulation techniques Ability to design problems that mirror physics research workflows Creative approach to developing problems across multiple physics domains Familiarity with modeling and approximation methods in physics Strong written English skills (C1 level or higher) Project commitment Typical workload ranges from 10 to 20 hours per week during active projects. Actual hours may vary based on project needs. Compensation Earnings can reach up to $14 per hour, depending on contribution level and project complexity. Rates may differ by project scope and required expertise. Application process Apply with a CV in English and specify your English proficiency Complete qualification(s) Join a project Finish assigned tasks Receive compensation Location: Remote , Belo Horizonte, State of Minas Gerais, Brazil

Become part of a global community that enhances and elevates the experiences of the world's most prestigious luxury brands! CXG, a leading customer experience agency serving premium and luxury brands, is seeking Customer Experience Evaluators who are existing customers of luxury brands.As a Freelance Evaluator for Luxury Brands, you will have the opportunity to conduct several evaluations each month and provide your valuable insights through a questionnaire. Your assignments will be as varied as our luxury clients and industries, encompassing high-quality fashion and jewelry, cosmetics, luxury watches, automobiles, and much more. Your evaluations may involve visiting a store, returning a purchase, buying a product online, or scheduling an appointment with a store.Important Note: Candidates must not have worked for luxury retail brands to ensure the integrity and objectivity of evaluations.Your feedback can influence brand strategies and help shape a brand's approach, making this an opportunity for you to have a significant impact in the luxury market.Responsibilities:Conduct discreet evaluations of your favorite luxury brands in-store, online, or both.Provide objective feedback on your experiences.Select assignments that align with your profile and interests.Complete questionnaires following each evaluation.Meet all project objectives and special requirements of the luxury brand we represent.How to Apply:To become an evaluator with us, follow these simple steps:Sign up at live.cxg.com and receive an email with your credentials.Log in to our platform and share more about yourself. Once completed, our team will verify your profile and reach out to you.Check the 'welcome package' and pass the General Certification.Now you're ready! You can search for and apply to missions that interest you.About CXG:CXG is a global customer experience agency serving premium and luxury brands. With 12 offices worldwide, we are capable of serving 70 countries. Our team consists of over 220 customer experience specialists and a network of more than 80,000 evaluators globally. Learn more about what we do at www.cxg.com.Enjoy the flexibility of working on our mobile app, where you can search and apply for missions, complete certifications, submit surveys, and more, all while on the go.Contact us for more information!

Toloka AI seeks a Freelance English Writer to contribute to ongoing AI development projects. This remote contract role is based in Belo Horizonte, State of Minas Gerais, Brazil. The main focus is supporting the improvement of machine learning models as an AI Trainer. Responsibilities Create and edit English-language content used for AI training Refine and update existing materials to enhance the quality and accuracy of machine learning outputs Location This position is remote, with a base in Belo Horizonte, State of Minas Gerais, Brazil.

toloka-ai is hiring a Freelance Junior Journalist - AI Trainer for remote work based in Belo Horizonte, State of Minas Gerais, Brazil. This role supports content creation and helps train AI systems. Responsibilities Provide accurate data and detailed feedback to help improve AI models Use AI tools and follow established workflows to complete content-related tasks Develop journalistic skills while working in a rapidly evolving field Requirements Interest in journalism and new AI technologies Willingness to learn and adapt as the field changes Strong ability to deliver clear, high-quality input and thoughtful insights

To apply, please submit your CV in English and indicate your English proficiency level. Mindrift connects experienced specialists with project-based AI work for leading technology companies. Assignments focus on testing, evaluating, and improving AI systems. These are freelance, project-specific roles rather than permanent employment. Role overview This freelance, remote position is available to candidates based in Belo Horizonte, State of Minas Gerais, Brazil. The work centers on designing and validating computational statistics problems that mirror real mathematical research and require Python programming to solve. What you will do Design original computational statistics problems inspired by real-world mathematical research workflows. Create challenges that require Python programming, using libraries such as Numpy, SciPy, and Sympy. Ensure problems are computationally intensive and not solvable by hand in a reasonable timeframe. Develop challenges involving complex reasoning in areas like number theory, combinatorics, graph theory, and numerical analysis. Base problem statements on authentic research questions or practical mathematical applications. Validate solutions in Python with standard mathematical libraries. Document problems clearly and provide verified, correct answers. Requirements Degree in Statistics or a related field. Proficiency in Python for numerical validation. Experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, other domain-specific libraries, Stata, or other programming languages is also acceptable. At least 2 years of relevant professional experience in applied, research, or teaching roles. Strong written English skills (C1 proficiency or above). Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are a plus. How projects work Apply Pass qualifications Join a project Complete assigned tasks Receive payment Time commitment During active project phases, tasks typically require 10–20 hours per week. Actual workload may vary and is not guaranteed. This estimate applies only when a project is active. Compensation Contributors can earn up to $16 per hour, depending on experience and the pace of contributions. Pay rates may vary between projects based on their scope, complexity, and required expertise.

Mindrift connects subject matter experts with AI projects for leading technology companies, focusing on testing, evaluation, and improvement of AI systems. This is a project-based freelance role, not a permanent position. Role overview As a Mathematics & Python Specialist, freelance AI trainers work on a range of challenging projects. Tasks may include: Creating original computational mathematics problems that mirror real mathematical research workflows Designing problems that require Python programming to solve, often using libraries such as Numpy, SciPy, or Sympy Ensuring problems are computationally intensive and cannot be solved manually in a reasonable timeframe Developing problems involving complex reasoning in areas like number theory, combinatorics, graph theory, and numerical analysis Basing problems on real-world research challenges or practical mathematical applications Validating solutions in Python with established mathematical libraries Clearly documenting problem statements and providing verified solutions Requirements Degree in Mathematics (Pure or Applied) or a related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is also accepted At least 2 years of professional experience, which may include applied, research, or teaching roles Experience with numerical methods and symbolic computation Ability to design problems reflecting authentic mathematical research workflows Understanding of computational complexity theory Strong written English skills (C1 level or higher) Process The process includes: Apply → Pass qualifications → Join a project → Complete tasks → Receive payment. Project commitment Tasks for this project are estimated at 10–20 hours per week during active phases. This is an estimate, not a guaranteed workload. Compensation Contributors may earn up to $14 per hour, depending on contribution level and pace. Actual rates may vary by project based on scope, complexity, and required expertise. Other projects on the platform may offer different earning opportunities. Please submit your CV in English and include your English proficiency level.

Please submit your CV in English and specify your English proficiency level. This freelance contract with Toloka AI (via Mindrift) is open to material scientists with strong Python skills. The focus is on supporting AI development for technology companies. The role is remote and based in Belo Horizonte, State of Minas Gerais, Brazil. This is not a permanent position, but a flexible, project-based opportunity. Key responsibilities Develop original material engineering problems that mirror real engineering workflows Design challenges involving Python programming for calculations and simulations Ensure problems require computational effort, using numerical methods or iterative techniques Create scenarios focused on system design, optimization, and analysis Draw from real-world research or practical engineering applications Validate solutions using Python and standard engineering libraries Write clear problem statements and provide accurate, verified solutions Requirements Degree in Material Science or a related discipline Proficiency in Python for numerical validation; familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is also acceptable At least 2 years of experience in applied work, research, or teaching Understanding of practical engineering constraints and approximations Excellent written English skills at C1 level or higher Project details Estimated workload is 10–20 hours per week during active project phases. Actual hours may change based on project needs and are not guaranteed. Compensation Earnings can reach up to $14 per hour. Pay depends on contribution, pace, and project requirements. Compensation may vary with project complexity and scope. Application process Apply in English, including your CV and English proficiency level Complete required qualifications Join a project when invited Finish assigned tasks Receive compensation for completed work This is a freelance, project-based position. Permanent employment is not available.

Toloka AI seeks a Freelance AI Trainer with expertise in both biology and Python. This remote role focuses on designing and delivering training sessions that help learners apply artificial intelligence to biological research and related applications. Role overview The Biology and Python Specialist will create educational content and lead sessions for a range of participants. The goal is to make complex AI concepts accessible and relevant within the context of biology. What you will do Develop and present training materials that connect AI techniques with real-world biological problems Engage learners through clear explanations and practical examples using Python Adapt content to suit different backgrounds and experience levels Requirements Strong background in biology Proficiency in Python programming Interest in education and technology This freelance position is open to candidates based in Belo Horizonte, State of Minas Gerais, Brazil, and offers full remote flexibility.

Role overview Toloka AI is hiring a Senior Consultant to work on freelance AI projects. This position is designed for someone with experience at MBB or other top-tier consulting firms. The focus is on developing strategies and solutions to enhance Toloka AI's services. The role operates fully remotely, with a base in Belo Horizonte, State of Minas Gerais, Brazil. Key responsibilities Use consulting expertise to guide the direction and execution of AI projects Work closely with an international group of specialists Support the growth and improvement of Toloka AI's service offerings Location This is a remote role based in Belo Horizonte, State of Minas Gerais, Brazil.

Join cxg as a Freelance Luxury Brand Evaluator based in Belo Horizonte or Rio de Janeiro. In this role, you will assess luxury brands and provide valuable insights to enhance their market presence.

Please submit your CV in English and specify your level of English proficiency. Mindrift connects professionals with project-based work in AI for leading technology companies. This contract focuses on assessing, testing, and improving AI systems. The position is project-based and not a permanent hire. Role overview The Freelance Quantum Research Scientist & AI Trainer (Python) role centers on developing and validating computational physics problems that reflect real research workflows. Contributors design challenges that require Python programming, especially using libraries such as Numpy, SciPy, and Sympy. Problems should be computationally intensive, not solvable by hand, and rooted in authentic scenarios from physics research or practical applications. Areas covered include mechanics, electromagnetism, thermodynamics, and quantum mechanics. Responsibilities also include validating solutions in Python, using established simulation libraries, and documenting both the problem statements and their verified solutions. Requirements Degree in Physics (theoretical, experimental, or computational) or a related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, or SciPy is also considered At least 2 years of professional experience in applied, research, or teaching settings Experience with numerical simulation methods Ability to design problems that mirror real research workflows in physics Creative problem-solving across multiple physics domains Knowledge of physics modeling and approximation techniques Strong written English skills at C1 level or above Application process Submit your application Complete qualifications Join a project Complete assigned tasks Receive payment Project commitment Project phases typically require about 10–20 hours per week, depending on current needs. This estimate applies only during active project periods and does not guarantee a fixed workload. Compensation Contributors may earn up to $14 per hour, depending on the complexity of the project and individual expertise. Actual rates may vary based on project requirements. Other projects on the Mindrift platform may offer different compensation levels. Location: Remote , Belo Horizonte, State of Minas Gerais, Brazil

Mindrift connects chemistry specialists with project-based freelance opportunities focused on AI system development for leading technology companies. These roles involve short-term projects and do not represent permanent employment. Role overview This freelance position centers on creating and validating computational chemistry challenges for AI training. Tasks vary by project and may include: Designing original computational chemistry problems that reflect real-world research workflows Developing challenges that require Python programming, using libraries such as numpy, scipy, or chemistry-specific tools Ensuring problems are computationally intensive and cannot be solved manually within a reasonable timeframe Incorporating advanced reasoning in areas like physical chemistry, quantum chemistry, and molecular modeling Basing problems on authentic research questions or practical chemistry applications Validating solutions in Python using established computational chemistry methods Clearly documenting problem statements and providing accurate, verified solutions Requirements Degree in Chemistry or a closely related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or domain-specific libraries is also valued At least 2 years of relevant professional experience (applied, research, or teaching) Expertise in numerical methods as applied to chemistry Strong understanding of computational chemistry concepts and techniques Excellent written English skills (C1 level or higher) Project structure The process includes submitting an application, passing qualification steps, participating in a project, completing assigned tasks, and receiving payment. Tasks typically require 10–20 hours per week during active phases, though actual workload may vary by project. Compensation Contributors can earn up to $14 per hour, depending on expertise and pace. Actual rates may vary based on project scope, complexity, and required skills. Other projects on the platform may offer different compensation levels. Please submit your CV in English and indicate your English proficiency level.

Please submit your CV in English and specify your English proficiency level. Mindrift connects subject-matter experts with project-based AI work for technology companies. This is a freelance, project-based position, not a permanent role. Role overview The Freelance AI Trainer - Physics and Python Specialist creates and tests computational physics problems for AI systems. This work involves designing problems that reflect real research workflows and require Python programming to solve, often using libraries such as Numpy, SciPy, or Sympy. Problems should be complex enough that they cannot be solved by hand in a reasonable timeframe, and should draw from advanced topics in mechanics, electromagnetism, thermodynamics, and quantum mechanics. Each problem must be clearly documented, based on genuine research challenges or practical applications, and include accurate, verified solutions implemented in Python. Requirements Degree in Physics (Theoretical, Experimental, or Computational) or a closely related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is a plus Minimum 2 years of professional experience in applied physics, research, or teaching Background in numerical simulation methods Ability to design problems reflecting real-world research in physics Creativity in developing problems across multiple physics domains Familiarity with modeling and approximation techniques in physics Strong written English skills at C1 level or higher How to apply Apply Pass qualification(s) Join a project Complete assigned tasks Receive compensation Time commitment Project tasks typically require 10–20 hours per week during active phases. Actual workload may vary depending on project needs. Compensation Earn up to $14 per hour, based on expertise and task completion rate. Compensation varies by project complexity, scope, and required skills. Other projects on the Mindrift platform may offer different earning potentials. Location This is a remote role for candidates based in Belo Horizonte, State of Minas Gerais, Brazil.