Freelance AI Agent Evaluation Engineer

Please submit your CV in English and include your English proficiency level. Mindrift offers project-based freelance roles for specialists interested in AI system evaluation. This contract position focuses on assessing and improving AI coding agents for technology clients. The role is remote, with a preference for candidates based in Hyderabad, Telangana, India. Please note: this is a freelance contract, not a permanent position. Role overview The Freelance AI Agent Evaluation Engineer works on building datasets to measure how well AI coding agents handle realistic developer tasks. The position centers on creating and refining simulated development environments and evaluating model performance in those settings. What you will do Set up virtual companies using detailed plans, including codebases, infrastructure, and supporting materials (documentation, tickets, conversations) to mirror real-world development environments. Design and adapt tasks as these virtual companies evolve: write prompts, define fair evaluation criteria, and ensure tasks are solvable and judged objectively. Create assignments within isolated environments that simulate a developer’s workstation, including a Linux machine with development tools, MCP servers (repository, task tracker, messenger, documentation), and a real web application codebase. Develop tests that accept all valid solutions and reject incorrect ones, ensuring the tests are neither too strict nor too lenient. Collaborate with an AI agent to check that tests catch real issues, avoid missing faulty solutions, and do not penalize correct ones. Review agent-generated code, analyze agent performance, and design edge cases and adversarial scenarios to further challenge the models. Incorporate feedback from expert QA reviewers to refine and improve your work to meet quality standards. What this role is not This is not a data labeling position. This is not prompt engineering. You will not write code from scratch; the AI agent produces most of the code. The main focus is on guidance and evaluation. Much of the work involves collaborating closely with AI systems. Creating tasks that challenge advanced models requires direct interaction with these agents.

Toloka AI seeks a Freelance AI Trainer who combines expertise in Mechanical Engineering with strong Python skills. This role is remote but based in Hyderabad, Telangana, India. Role overview This position centers on applying both mechanical engineering knowledge and Python programming to support the development and training of AI systems. The work involves collaborating with others to move technology forward. Key responsibilities Use technical skills in Mechanical Engineering and Python to contribute to AI training projects. Assist in designing and refining training programs for AI systems. Work closely with a team to develop and enhance technology-driven solutions. Location This is a remote position based in Hyderabad, Telangana, India.

CXG is a premier global agency dedicated to enhancing the customer experience for premium and luxury brands. Our mission is to assist brands in achieving profitable growth by transforming transactional interactions into meaningful relationships and emotional connections.With a vast network of over 170 customer experience specialists across 70 countries, we empower brands to assess the quality of the experiences they provide and collaborate with them to create programs that nurture a robust experience and a positive business culture.Job OverviewAre you a devoted shopper or enthusiast of premium or luxury brands? If so, we would love to hear from you!We are seeking passionate consumers to share their insights on their experiences within selected luxury stores. As a CXG Evaluator, you will conduct discreet evaluations at your preferred luxury retail locations, covering sectors such as cosmetics, fashion, jewelry, watches, or automobiles, and provide us with your valuable feedback.Join us in experiencing luxury retail and advocating for unparalleled service excellence!

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects skilled professionals with project-based AI work for leading technology companies. Assignments focus on testing, evaluating, and improving AI systems. This freelance position is project-based and not a permanent role. Role overview The Freelance Electrical Engineer & Python Specialist (AI Trainer) supports the development and validation of computational engineering challenges used in AI training. Projects are remote but focus on needs based in Hyderabad, Telangana, India. Main responsibilities Design computational engineering problems that mirror real-world engineering workflows. Create programming tasks in Python for calculations and simulations. Ensure tasks involve substantial computation, such as numerical methods or iterative solutions. Develop problems related to system design, optimization, and analysis. Base challenges on practical engineering or research scenarios. Validate solutions in Python, using standard engineering libraries. Document problems clearly and provide verified solutions. Who this suits This freelance role fits engineers with Python experience who want part-time, project-based work. Suitable candidates have: A degree in Electrical Engineering or a related discipline. Proficiency in Python for numerical validation. Familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar languages is also valued. At least 2 years of professional experience in applied, research, or educational settings. A strong understanding of practical engineering constraints and approximations. Excellent written English skills (C1 level or higher). Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are a plus. How projects work Apply Pass qualifications Join a project Complete assigned tasks Receive payment Time commitment During active project phases, expect to spend about 10-20 hours per week. Actual workload may vary with project needs and is not guaranteed. Compensation Contributors can earn up to $9 per hour, depending on expertise and pace. Compensation varies by project scope, complexity, and required skills. Some projects may offer different earning levels based on their specific requirements.

Toloka AI seeks a Civil Engineer with strong Python experience to join as a Freelance AI Trainer. This contract position centers on developing and delivering training modules for AI projects that combine civil engineering principles with Python programming. Role overview This role involves designing educational content that bridges civil engineering and Python. You will create and present training materials to support AI initiatives, ensuring technical concepts are clearly explained and relevant to project needs. Location This is a remote position based in Hyderabad, Telangana, India.

Join CXG, a leading global customer experience agency dedicated to enhancing the journey of premium and luxury brands. Our mission is to foster profitable growth by transforming transactional interactions into meaningful relationships and unforgettable experiences.With a vast network of over 170 customer experience experts across 70 countries, we specialize in evaluating the customer experiences that brands provide and collaborate closely with them to cultivate programs that reinforce both a strong customer experience and a thriving business culture.Your Role:Are you an enthusiast of luxury brands? If so, we want you!We are seeking expatriates who are passionate about sharing their insights from experiences within select luxury retail environments. As a CXG Evaluator, you will conduct discreet assessments of your favorite luxury brands across various sectors, including cosmetics, fashion, jewelry, watches, and automobiles, and provide valuable feedback based on your evaluations.Why Apply?Seize the opportunity to immerse yourself in the luxury retail sector and advocate for service excellence by joining our team!

Role overview This remote Strategy Consultant position at Toloka AI centers on AI training and evaluation. The role is based in Hyderabad, Telangana, India, but offers flexibility to work from any location. Toloka AI values candidates who bring experience from top-tier consulting firms, including those with MBB backgrounds. What you will do Use consulting experience to enhance AI training and evaluation methods Work closely with teams to improve AI solutions Support projects that advance artificial intelligence capabilities Requirements Background at a leading consulting firm (MBB or other top-tier) Strong experience in strategy, particularly in AI or technology fields Ability to work independently in a remote setting

Please submit your CV in English and specify your English proficiency level. Toloka AI, working with Mindrift, offers project-based freelance roles for skilled professionals supporting technology firms. This freelance optical engineer position centers on testing, evaluating, and improving AI systems. The work is not permanent employment but structured around specific projects. Role overview This role involves designing and validating computational physics problems that mirror real research workflows. Tasks require strong Python programming skills and a background in physics or a closely related field. What you will do Create original computational physics problems inspired by real-world research scenarios. Design problems that require Python programming to solve, using libraries such as NumPy, SciPy, or SymPy. Ensure problems are complex enough to require computational solutions, not manual calculation. Develop advanced reasoning tasks in mechanics, electromagnetism, thermodynamics, and quantum mechanics. Base problem statements on authentic research challenges from physics practice. Validate solutions in Python, using established simulation libraries. Clearly document each problem and provide verified solutions. Requirements Background as an optical engineer with strong Python skills and interest in part-time, project-based work. Degree in Physics (theoretical, experimental, or computational) or a related field. Proficiency in Python for numerical validation. Experience with tools like MATLAB, R, C, SQL, NumPy, Pandas, or SciPy is valued. Minimum 2 years of professional experience in applied research or teaching. Familiarity with numerical simulation methods. Ability to design problems that reflect authentic research workflows. Creative approach to developing problems across multiple physics domains. Understanding of modeling and approximation techniques in physics. Excellent written English at C1 level or higher. Application process Submit your application. Complete the qualification process. Join a project. Work on assigned tasks. Receive payment. Time commitment During active project periods, tasks typically require 10–20 hours per week. Workload may shift depending on project needs. Compensation Earn up to $10 per hour, depending on task complexity and pace. Compensation may vary for other projects on the platform based on their requirements.

Toloka AI seeks a Freelance English Writer and AI Trainer to contribute to the development of advanced AI models. This contract role is remote, with a focus on candidates based in Hyderabad, Telangana, India. Key responsibilities Produce clear and accurate written material that supports AI training efforts Capture the nuances, details, and subtleties of the English language in your work Collaborate with teams working on new AI technologies Ideal profile This position fits writers who are curious about technology and interested in influencing how AI systems interpret and use English.

Mindrift connects professionals with AI projects for leading technology companies. The platform focuses on advancing Generative AI by involving specialists from around the world. Role overview This Freelance Python Data Scraping Engineer position supports the Tendem project. The role is remote and part-time, open to candidates based in Hyderabad, Telangana, India, or those working remotely from there. Work centers on improving hybrid AI and human-driven data scraping workflows. As an AI Pilot, collaboration with Tendem Agents is a key part of the job. The position blends hands-on technical work with critical thinking and quality control, aiming for precise and actionable web data extraction. What you will do Manage end-to-end data extraction on complex websites to deliver accurate, structured datasets. Work with internal tools such as Apify and OpenRouter, plus custom methods, to collect, validate, and process data to meet project needs. Adjust scraping strategies for dynamic, interactive, and JavaScript-heavy web content, responding to changes in site behavior as they arise. Maintain high data quality through validation, consistency checks, compliance with formatting standards, and thorough verification before delivery. Optimize large-scale scraping by batching or parallel processing, monitoring for failures, and adapting to changes in site structure. Requirements Minimum 3 years of experience in data engineering, web scraping, automation, or similar fields. Strong Python skills and experience with web scraping frameworks. Demonstrated ability to extract data from complex and dynamic web applications. Keen analytical skills and attention to detail for data quality. Clear written and verbal communication abilities. Compensation Contributors may earn up to $12 per hour, depending on experience and pace. Compensation varies by project scope, complexity, and expertise required. How to get started Apply to this posting and complete the qualification process to join. Projects are matched to technical strengths, and schedules are flexible. Tasks include coding, automation, and refining AI outputs, all aimed at improving AI capabilities and practical applications.

Please submit your CV in English and specify your proficiency level. Toloka AI, in partnership with Mindrift, offers project-based contract work for specialists interested in advancing and evaluating AI systems for major technology companies. This freelance role is not a permanent staff position and is based remotely, with a focus on candidates in Hyderabad, Telangana, India. Role overview This position centers on developing challenging physics problems to support the training and evaluation of AI models. Tasks involve crafting original optics problems that reflect real research practices, as well as designing computationally demanding scenarios that require advanced reasoning in areas such as mechanics, electromagnetism, thermodynamics, and quantum mechanics. Problems should be grounded in authentic research challenges or practical applications within optics and physics. Clear documentation and verified solutions are essential for each problem set. Requirements Degree in Physics (theoretical, experimental, or computational) or a related field Minimum of 2 years’ experience in applied research, teaching, or a similar area Proficiency with numerical simulation techniques Ability to design problems that mirror real research workflows Creative approach to problem-solving across various physics domains Familiarity with modeling and approximation methods in physics Strong written English skills at C1 level or above How projects work Applicants complete qualification steps before joining a project. Once accepted, work is assigned on a task basis, and payment is provided for completed assignments. Time commitment Active project phases generally require between 10 and 20 hours per week. Actual hours may vary depending on project needs, and there is no guaranteed minimum. Compensation Earnings can reach up to $10 per hour, depending on skill, speed, and the complexity of assigned tasks. Actual rates may differ by project.

Toloka AI is hiring a Freelance Junior Journalist - AI Training Specialist for a remote contract role based in Hyderabad, Telangana, India. This position supports the development of AI models through writing and editorial work. Key Responsibilities Produce clear and accurate written content for machine learning and AI training projects Assist in refining and improving AI models by completing editorial assignments What We’re Looking For Interest in journalism and storytelling Curiosity about technology, with a focus on artificial intelligence

Role overview Toloka AI is looking for a Senior Consultant to join on a freelance basis, focusing on Artificial Intelligence projects. The position calls for strategic guidance on AI initiatives, with an emphasis on experience gained at top consulting firms such as MBB. What you will do Offer direction and recommendations for the design and rollout of AI solutions Work alongside specialists to influence and shape project results Use consulting knowledge to encourage new and effective approaches in AI work Location and collaboration This remote freelance role is based in Hyderabad, Telangana, India. The Senior Consultant will work closely with Toloka AI’s team of experts, collaborating from any location.

Please submit your CV in English and indicate your English proficiency level. Role overview toloka-ai, working with Mindrift, offers a freelance contract for professionals skilled in statistics and Python. This project-based position centers on developing and reviewing advanced computational statistics problems. The work supports AI system evaluation and improvement. This is not a permanent job but a freelance opportunity tied to specific projects. What you will do Create original computational statistics problems that reflect real-world mathematical research workflows Design problems that require Python programming for solutions, using libraries such as Numpy, SciPy, or Sympy Ensure problems are computationally intensive and not easily solved by hand Develop challenges involving advanced reasoning in areas like number theory, combinatorics, graph theory, or numerical analysis Base problems on genuine research questions or practical mathematical scenarios Validate solutions in Python with established mathematical libraries Document problem statements clearly and provide verified solutions Requirements Degree in Statistics or a closely related field Strong Python skills for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is welcome At least 2 years of professional experience in applied statistics, research, or teaching Excellent written English (C1 level or higher) Professional certifications (such as CMME, SAS Certifications, or CAP) and experience with international or applied projects are a plus How to apply Submit your application Complete qualification steps Join a project Finish assigned tasks Receive compensation Time commitment Project tasks usually require about 10–20 hours per week during active phases. Actual workload varies with project needs. Hours are available only when the project is running. Compensation Contributors may earn up to $11 per hour, depending on expertise and pace. Rates differ by project based on complexity, required skills, and scope. Other projects on the platform may offer different compensation levels. Location This is a remote contract role based in Hyderabad, Telangana, India.

Toloka AI is looking for a Freelance AI Training Consultant with a strong background in biology and solid Python skills. This remote role is based in Hyderabad, Telangana, India. Role overview This position focuses on developing and improving AI training modules that combine biological concepts with Python programming. The work supports projects that connect advances in technology with the field of biology. What you will do Apply knowledge of biology to inform AI training content Use Python to develop, test, or refine training modules Collaborate remotely with Toloka AI's team on projects at the intersection of biology and technology Requirements Proficiency in Python programming Strong understanding of biology Comfort working independently in a remote setting

Role overview Toloka AI is looking for a Freelance Legal Consultant with expertise in U.S. law to contribute to AI system training. This contract role is remote, with the primary location listed as Hyderabad, Telangana, India. What you will do Use your legal background to guide the development of AI tools centered on U.S. law. Provide in-depth feedback to help the AI better interpret legal concepts and terminology. Position details This contract offers legal professionals a chance to work where law meets technology. The position is fully remote and involves collaborating with an international team, offering flexibility in how and where the work is done.

This freelance, project-based role with toloka-ai focuses on improving AI systems for supply chain and procurement scenarios. The position is remote, with project work based in Hyderabad, Telangana, India. Participation is not considered permanent employment. Role overview Work with Mindrift and leading tech companies to test, evaluate, and refine AI recommendations in supply chain management. The role relies on practical experience in procurement and manufacturing to create realistic disruption scenarios, define expected outcomes, and assess the accuracy and relevance of AI-generated solutions. What you will do Develop supply chain disruption scenarios, such as supplier delays, quantity changes, logistics challenges, and quality concerns, based on real-world manufacturing and procurement processes. Outline expected results and possible mitigation strategies for each scenario. Assess AI-generated recommendations for alignment with practical business logic. Review outputs for accuracy, completeness, and business relevance, especially for ERP systems like Microsoft Dynamics 365, Coupa, Jaggaer, and Ariba (SAP). Support the creation and validation of structured data according to project standards. Requirements Minimum 4 years of hands-on experience in procurement, supply chain management, or purchasing, preferably within a manufacturing setting. Strong understanding of procurement processes, including purchase orders, vendor management, inventory control, and production planning. Direct experience with ERP platforms such as SAP, Oracle, or Microsoft Dynamics 365. Demonstrated ability to design and analyze supply chain disruption scenarios and mitigation plans. Knowledge of various disruption types: delays, shortages, quality issues, and logistics problems. Familiarity with Incoterms and logistics/transport management. Experience with Bill of Materials (BOM) and production planning. Understanding of supplier performance metrics, such as OTIF, lead times, and quality scores. Strong analytical skills for evaluating AI outputs against real business logic. Background in data validation, structured data entry, or annotation tasks. Excellent written English communication skills. How the process works Apply Pass qualifications Join a project Complete tasks Receive compensation Time commitment During active project phases, tasks typically require 10-20 hours per week. Actual workload may vary depending on project needs. Compensation Contributors may earn up to $50 per hour, depending on project requirements.

Mindrift, part of toloka-ai, connects skilled specialists with project-based AI work for leading tech companies. The focus here is on evaluating, testing, and improving AI systems. This Mathematics & Python Specialist role is freelance and project-based, not a permanent position. Role overview This position centers on designing and verifying advanced computational mathematics problems that mirror real research workflows. Tasks are remote and based out of Hyderabad, Telangana, India, but open to candidates working from anywhere. What you will do Create original computational mathematics problems based on actual research practices Formulate problems that require Python programming to solve, using libraries like Numpy, SciPy, and Sympy Design problems that are too complex for manual solution within reasonable timeframes Develop challenges involving advanced reasoning in areas such as number theory, combinatorics, graph theory, and numerical analysis Base problems on real research issues or practical mathematical applications Verify solutions using Python and standard mathematical libraries Document problem statements clearly and provide thoroughly checked answers Requirements Degree in Mathematics (Pure or Applied) or a related field Proficiency in Python for numerical validation; familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is also accepted At least 2 years of relevant experience in applied mathematics, research, or teaching Experience with numerical methods and symbolic computation Ability to design problems that reflect real mathematical research processes Understanding of computational complexity theory Strong written English skills at C1 level or above Project commitment Workload is estimated at 10–20 hours per week during active project phases, depending on demand. This is an approximate range and not a guaranteed number of hours. Compensation Contributors may earn up to $10 per hour, depending on the complexity of the project and individual contribution. Compensation can vary between projects based on their requirements. Application process Submit a CV in English along with your English proficiency level. The process includes qualification steps before joining a project. Tasks are assigned after successful qualification, and payment follows task completion.

We kindly request that you submit your CV in English along with your English proficiency level.At Mindrift, we bridge the gap between skilled professionals and project-based AI opportunities with top technology companies. Our focus is on the testing, evaluation, and enhancement of AI systems. Please note that this is a project-based opportunity rather than permanent employment.What You Will DoWhile each project presents distinct challenges, contributors may be tasked with:Crafting original computational physics problems that emulate authentic physics research workflows.Formulating problems necessitating Python programming for solutions, utilizing libraries such as Numpy, SciPy, and Sympy.Ensuring that problems require substantial computational effort, making manual solutions impractical within reasonable timeframes.Developing problems that involve complex reasoning chains across mechanics, electromagnetism, thermodynamics, and quantum mechanics.Grounding problems in real research challenges or practical applications from the field of physics.Validating solutions through Python using standard physics simulation libraries.Documenting problem statements with clarity and providing verified correct answers.Who We Are Looking ForThis role is ideal for physicists experienced in Python who are open to part-time, non-permanent projects. The ideal candidates will possess:A degree in Physics (Theoretical, Experimental, or Computational) or related disciplines.Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, domain-specific libraries, Stata, or any programming language will also be considered.At least 2 years of professional experience, including applicable applied, research, or teaching experience.Experience with numerical simulation techniques.The ability to design problems reflecting real physics research workflows.Creative problem design skills across various physics domains.Familiarity with physics modeling and approximation methods.Strong written English skills (C1+ level).How the Process WorksApply → Pass qualifications → Join a project → Complete tasks → Get compensated.Project Time ExpectationsTasks for this project are estimated to require approximately 10–20 hours per week during active phases, based on specific project requirements. This is an estimate and not a guaranteed workload, applicable only while the project is active.CompensationContributors can earn up to $10 per hour, depending on their level of expertise and contribution pace. Compensation varies across projects based on scope, complexity, and required expertise, and may differ from other projects on the platform.

This freelance, project-based role connects chemistry professionals with Python skills to artificial intelligence projects for leading technology firms. Assignments focus on creating, evaluating, and testing computational chemistry problems that help train and improve AI systems. The position is remote and open to candidates based in Hyderabad, Telangana, India, or working remotely from elsewhere. What you will do Design computational chemistry challenges that mirror real research tasks. Develop problems requiring Python programming solutions using libraries such as numpy, scipy, and chemistry-specific packages. Ensure problems are complex enough that manual solutions would be impractical. Create tasks involving advanced reasoning in physical chemistry, quantum chemistry, and molecular modeling. Base problems on real-world research or practical chemistry scenarios. Validate all solutions in Python, applying established computational chemistry methods. Document problem statements and provide clearly written, verified solutions. Requirements Degree in Chemistry or a closely related field. Strong Python skills for numerical validation (knowledge of MATLAB, R, C, SQL, Numpy, Pandas, or SciPy is also acceptable). At least 2 years of professional experience in applied, research, or teaching roles. Experience with numerical methods in chemistry. Solid grasp of computational chemistry concepts and methods. Excellent written English (C1 level or higher). Project details This is a part-time, non-permanent opportunity. During active project phases, expect to spend around 10–20 hours per week, though actual workload may vary and is not guaranteed. Compensation Earn up to $10 per hour, depending on project scope, complexity, and contribution. Pay rates may differ for other projects on the platform. How to apply To start, submit your CV in English. The application process includes qualification steps, joining a project, completing assigned tasks, and receiving payment upon completion.