Freelance AI Evaluation Engineer

Please submit your CV in English and include your English proficiency level. Project Overview Toloka AI, in partnership with Mindrift, offers project-based freelance roles focused on testing and evaluating AI systems. As a Freelance AI Evaluation Engineer, the main responsibility is to build and assess datasets that measure how well AI coding agents perform on tasks similar to those faced by real-world developers. This is a contract-based position and does not lead to permanent employment. Key Responsibilities Design virtual companies from broad outlines, creating codebases, infrastructure, and realistic supporting materials such as documentation, tickets, and internal communications to simulate development history. Develop and refine tasks that represent intermediate milestones within these virtual companies. Define prompts, set evaluation standards, and ensure tasks are both solvable and fairly judged. Create assignments in isolated environments that mirror a developer's workstation. This setup includes a Linux machine with development tools, MCP servers for repositories, task tracking, messaging, documentation, and a working web application codebase. Write tests that accept all valid solutions and reject incorrect ones, maintaining a fair but rigorous standard. Collaborate with AI agents to ensure tests surface real problems, filter out poor solutions, and confirm strong results. Review code generated by AI agents, analyze success or failure reasons, and design edge cases or adversarial scenarios to challenge model capabilities. Apply feedback from expert QA reviewers who check your work against established quality benchmarks. What This Role Does Not Include Data labeling Prompt engineering Writing code from scratch (the AI agent handles most coding; your focus is on guidance and evaluation) This work relies heavily on collaboration with AI systems. Building tasks that truly test advanced models requires direct interaction with these agents and thoughtful evaluation of their outputs.

Role overview Mindrift is hiring an AI Workflow Engineer (AI Pilot) to contribute to the Tendem project. This freelance, part-time position is open to candidates based in Sweden and is fully remote. The role centers on building automation systems that blend large language models (LLMs) with human expertise. For more information about the project, visit https://tendem.ai/. What you will do Work closely with Tendem Agents to design and refine automation workflows using advanced LLMs Use structured thinking to develop, test, and enhance AI-driven processes Create and optimize prompts for various automation needs Maintain quality control and ensure reliability in deployed AI workflows Requirements Experience integrating LLMs and working with AI automation systems Strong skills in prompt engineering and workflow design Attention to detail, especially in quality control and process improvement Ability to work effectively in environments where AI and human input intersect Location and commitment Remote role based in Sweden Part-time, freelance arrangement

toloka-ai is hiring a Strategic Consultant for AI Training & Evaluation. This remote role is available to candidates located in Sweden. The consultant will partner with prominent organizations to strengthen their AI training programs. Key Responsibilities Work with partner organizations to review and improve their AI training and evaluation methods Use knowledge of artificial intelligence to design and recommend effective training strategies Provide strategic guidance to increase the quality and effectiveness of AI training efforts Location This position is remote and open to applicants based in Sweden.

Please submit your CV in English and specify your English proficiency level. Toloka AI offers project-based freelance roles for specialists in artificial intelligence. The company focuses on testing, evaluating, and improving AI systems for major technology clients. This particular position is freelance and project-based, not a permanent employment offer. Role overview The Freelance Optical Engineer - AI Trainer works on projects that involve designing optical and physics problems for AI training. Assignments often include: Developing original optical problems that reflect real-world research workflows in physics Creating computationally intensive challenges unsuitable for manual solving Formulating problems requiring advanced reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics Referencing real research challenges or practical applications in optics and physics Writing clear problem statements and supplying accurate, validated solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a closely related field Minimum of 2 years of professional experience in applied, research, or teaching roles Strong background in numerical simulation methods Ability to design problems that mirror real research workflows in physics Creative approach to problem design across multiple physics domains Familiarity with physics modeling and approximation techniques Excellent written English skills (C1 level or above) Application process Apply Pass qualification(s) Join a project Complete assigned tasks Receive payment Project commitment During active project phases, contributors usually dedicate 10–20 hours per week. Actual workload depends on project needs and is not guaranteed outside of active periods. Compensation Contributors may earn up to $45 per hour, depending on experience and project pace. Rates vary by project scope, complexity, and required expertise. Other projects on the platform may offer different compensation based on their specific requirements.

Become a part of a global network dedicated to enhancing the experiences of the most prestigious luxury brands worldwide! CXG, a premier customer experience agency specializing in premium and luxury brands, is seeking passionate Customer Experience Evaluators who are current luxury brand consumers.As a Freelance Luxury Brand Evaluator, you have the opportunity to undertake multiple evaluations each month, providing invaluable insights through detailed questionnaires. Your tasks will be as varied as our luxury clientele, spanning industries from fashion and high-end jewelry to cosmetics, luxury watches, automotive, and beyond. Evaluations may include visiting retail locations, returning purchases, shopping online, or scheduling in-store appointments.Please note: Applicants must not have any contractual relationships with luxury retail brands to maintain the integrity and impartiality of the evaluations.Your contributions can significantly influence brand strategies, offering you a chance to make a meaningful impact in the luxury market.Key Responsibilities:Conduct confidential evaluations of your preferred luxury brands both in-store and online.Deliver unbiased feedback regarding your experiences.Select assignments that resonate with your personal interests and profile.Complete questionnaires following each evaluation.Adhere to all project objectives and specific requirements set by the luxury brands we represent.Application Process:To join our evaluator team, please follow these steps:Register at live.cxg.com to receive your login credentials via email.Log into our platform and share more about yourself. After submission, our team will verify your profile and reach out to you.Review the ‘welcome package’ and complete the general certification.Congratulations! You’re now eligible for assignments and can explore and apply for any opportunities that catch your interest.About CXG:CXG is a global leader in customer experience, dedicated to serving premium and luxury brands. With 12 offices worldwide, we provide services in over 70 countries. Our team consists of more than 220 customer experience specialists and a vast network of over 80,000 evaluators globally. Discover more about our mission at www.cxg.com.Enjoy the flexibility of working from our mobile app, where you can search and apply for missions, complete certifications, submit surveys, and more, all while on the move.For additional information, please feel free to reach out!

Please submit your CV in English and include your English proficiency level. Mindrift connects experienced professionals with project-based AI roles at top technology companies. Assignments focus on testing, evaluating, and improving AI systems. All work is freelance and project-based, not permanent employment. Role overview This freelance role is designed for optical engineers with strong Python skills who want to contribute to AI projects. Assignments vary, and each brings new technical challenges. Typical tasks include: Writing original computational physics problems based on real research workflows Developing programming challenges that require Python solutions, using libraries such as Numpy, SciPy, or Sympy Designing computationally intensive problems that cannot be solved manually in a reasonable timeframe Creating scenarios involving complex reasoning in areas like mechanics, electromagnetism, thermodynamics, and quantum mechanics Basing problems on real-world research or practical physics applications Using Python and standard physics simulation libraries to verify solutions Documenting problem statements clearly and providing accurate, verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a related discipline Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, or SciPy is a plus At least 2 years of professional experience in applied, research, or teaching roles Understanding of numerical simulation methods Ability to design problems that reflect real physics research workflows Creative approach to problem design across physics fields Familiarity with physics modeling and approximation techniques Strong written English skills at C1 level or above Project commitment Assignments usually require 10–20 hours per week during active project phases. Actual workload may vary depending on project needs and is not guaranteed. Compensation Contributors can earn up to $45 per hour, depending on project complexity, scope, and individual contribution. Compensation may vary by project. Application process Apply Complete the qualification process Join a project Finish assigned tasks Receive compensation Location: Remote, Sweden

Toloka AI seeks a freelance AI trainer who combines civil engineering experience with strong Python programming skills. This contract position is fully remote and open to candidates based in Sweden. Role overview This role centers on applying civil engineering knowledge and Python expertise to help train and refine artificial intelligence systems. The work supports the development of AI applications by contributing specialized insights from both fields. What you will do Apply civil engineering concepts and Python programming to improve AI models Offer subject matter expertise to shape and support AI application development Location This is a remote position for candidates located in Sweden.

Toloka AI seeks a Mechanical Engineer with advanced Python skills for a freelance AI Trainer role. This contract position is fully remote and open to candidates based in Sweden. Key responsibilities Create training materials that focus on AI technologies Lead workshops designed for engineers and technical teams Collaborate with fellow engineers to enhance AI products Team collaboration This role works closely with Toloka AI's engineering group. The environment emphasizes practical experience and clear, effective communication to support product development and knowledge sharing.

Become a vital part of a global community dedicated to enhancing the experiences of some of the world's most esteemed luxury brands! CXG, a premier agency specializing in customer experience for luxury and premium brands, is seeking enthusiastic Freelance Customer Experience Evaluators who are already patrons of luxury brands.As a Freelance Luxury Brand Evaluator, you'll have the flexibility to undertake multiple evaluations each month, providing your insights through detailed questionnaires. Your tasks will vary across a spectrum of luxury brands and sectors, including high fashion, exclusive jewelry, premium cosmetics, luxury watches, high-end automobiles, and much more. Evaluations could include visiting retail locations, returning products, making online purchases, or scheduling appointments with stores.Important Note: Applicants must not have been employed by luxury retail brands to maintain the integrity and impartiality of the evaluations.Your feedback plays a crucial role in influencing brand strategies and shaping the future of the luxury market, offering you a unique opportunity to make a significant impact.Key Responsibilities:Conduct confidential evaluations of your preferred luxury brands, whether in-store or online.Deliver objective feedback on your experiences.Select assignments that resonate with your interests and profile.Complete questionnaires following each evaluation.Adhere to all project goals and specific requirements of the luxury brands we represent.

Please submit your CV in English and include your English proficiency level. Mindrift connects specialized professionals with project-based AI assignments for leading technology companies. The focus is on testing, evaluating, and improving AI systems. All participation is project-based and does not imply permanent employment. Role overview This freelance position involves developing and validating computational engineering problems that help train AI systems. Projects vary, and contributors may work on tasks such as: Creating original computational engineering problems that mirror real-world workflows Designing problems that require Python programming for engineering calculations or simulations Ensuring problems are computationally intensive, using numerical methods or iterative solutions Developing scenarios related to system design, optimization, and analysis Basing problems on actual research challenges or practical engineering issues Validating solutions in Python, using standard engineering libraries Documenting problem statements clearly and providing verified, correct answers Requirements Degree in Electrical Engineering or a related field Proficiency in Python for numerical validation; familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is valued At least 2 years of professional experience in applied, research, or teaching roles Understanding of practical engineering constraints and approximations Ability to write clearly in English at C1 level or higher Professional certifications (such as CMME, SAS, CAP) and experience with international or applied projects are a plus Project workflow The process follows these steps: Application → Qualification Process → Project Engagement → Task Completion → Payment. Time commitment During active project phases, tasks typically require 10–20 hours per week. Actual workload may vary depending on project needs. Compensation Contributors may earn up to $50 per hour, depending on expertise and pace. Rates can vary by project based on complexity, scope, and required skills. Location This remote, project-based role is open to candidates based in Sweden.

Toloka AI is looking for a Freelance Machine Learning Engineer to join on a contract basis. This remote role is open to candidates based in Sweden and centers on contributing to projects in machine learning and data analytics. Key responsibilities Work closely with teams to advance machine learning initiatives Use data analytics to address practical problems Support the development and improvement of AI solutions Work arrangement This freelance position is fully remote, but applicants must reside in Sweden.

Mindrift is looking for a Freelance Low-Code Automation Engineer to support the Tendem project. This part-time contract is remote within Sweden. The main focus is building and refining automation workflows that connect AI tools with human input, using platforms such as Make.com and n8n. Key Responsibilities Design and optimize automation workflows that combine AI features with human collaboration. Partner with Tendem Agents to identify repetitive tasks and automate them efficiently. Apply analytical skills to ensure workflows operate smoothly across different systems. Test, refine, and scale automation solutions using quality assurance methods. Use JavaScript to customize workflows as project needs arise. Requirements Hands-on experience with low-code automation platforms, especially Make.com and n8n. Background in workflow design and process automation. Proficiency in JavaScript for customizing workflows. Strong analytical skills, attention to detail, and a commitment to quality. Ability to work remotely and collaborate with distributed teams. Role Details Part-time freelance contract Remote role based in Sweden For more details about the Tendem project, visit tendem.ai.

Toloka AI seeks a Freelance Mathematics Expert - AI Trainer to help advance AI systems. This is a remote contract position for candidates based in Sweden. Role overview This role centers on applying advanced mathematics to support AI model development. The work involves analyzing complex problems and bringing subject matter expertise to improve the accuracy and reliability of AI solutions. What you will do Use deep mathematical knowledge to train and refine AI models Contribute to projects that demand strong analytical and problem-solving skills Share expertise to help ensure AI systems deliver reliable results About Toloka AI Toloka AI creates data-driven tools for artificial intelligence. The company values input from experts who can strengthen the quality and dependability of AI technologies.

Toloka AI is looking for a freelance specialist with a strong background in both biology and Python programming. This remote role is based in Sweden and centers on developing and improving materials used to train artificial intelligence systems. Role overview This position focuses on creating and refining training content that combines biological science concepts with Python. The work supports AI development by ensuring materials are accurate and effective. What you will do Develop AI training materials that draw on biology and Python expertise Review and enhance existing content to improve clarity and accuracy Who this role suits This freelance opportunity is well suited to those interested in the overlap between biological sciences and artificial intelligence, and who enjoy working independently on specialized projects.

Toloka AI seeks a Freelance Junior Journalist - AI Trainer to support projects that connect journalism with artificial intelligence. This contract position is fully remote and open to candidates living in Sweden. Role overview This role centers on collaborating with professionals who are advancing AI-driven journalism. The work involves both content creation and the development of tools that assist in the evolution of news reporting through technology. What you will do Collaborate with experienced team members on journalism initiatives powered by AI Create and curate written content to help train and refine AI models Offer feedback and ideas to improve tools and workflows for the team Requirements Interest in journalism and new technology Ability to work independently and communicate effectively online Residence in Sweden

Please submit your CV in English and indicate your English proficiency level. Mindrift connects experienced professionals with project-based AI work for leading technology companies. Assignments focus on assessing, evaluating, and improving AI systems. This is a non-permanent, project-based role. Role overview The Freelance AI Trainer - Research Physicist contributes to diverse projects, each with its own objectives. Typical responsibilities include: Writing original optics problems that reflect real research processes in physics Designing computationally challenging problems that may require days or weeks to solve Developing complex scenarios involving detailed reasoning in areas such as mechanics, electromagnetism, thermodynamics, and quantum mechanics Creating problems based on real-world research challenges or relevant situations from optics and physics Clearly documenting problem statements and providing verified solutions Requirements Degree in Physics (Theoretical, Experimental, or Computational) or a closely related field Minimum of 2 years of professional experience (applied, research, or teaching) Background in numerical simulation methods Ability to design problems that mirror actual physics research workflows Creative approach to problem design across multiple physics disciplines Familiarity with physics modeling and approximation techniques Strong English writing skills at C1 level or higher Project commitment Assignments typically require 10–20 hours per week during active project periods. Actual workload depends on project needs and may vary outside active phases. Compensation Rates can reach up to $45 per hour, depending on experience and project pace. Compensation varies according to project complexity and required expertise. Other projects on the platform may offer different pay based on their specific requirements. Application process Apply Pass qualifications Join a project Complete tasks Receive payment

Join our global community dedicated to enhancing and elevating the experiences associated with the world's most prestigious luxury brands! CXG, a premier customer experience agency catering to premium and luxury brands, is seeking freelance Customer Experience Evaluators who are existing luxury brand customers.As a Freelance Evaluator for luxury goods, you'll have the opportunity to conduct multiple evaluations each month and provide valuable feedback through questionnaires. Your assignments will be as diverse as our luxury clients and their industries, ranging from fashion and exclusive jewelry to cosmetics, luxury watches, automobiles, and much more. Your evaluations may involve visiting a store, returning a purchase, purchasing a product online, or scheduling a meeting with a store.Your feedback can influence brand strategies and help shape the direction of luxury brands, making this a meaningful opportunity for you to impact the luxury market.Responsibilities:Conduct discreet evaluations of your favorite luxury brands in-store, online, or sometimes both.Provide objective feedback about your experiences.Select assignments that align with your profile and interests.Complete questionnaires after each evaluation.Follow all given project goals and specific requirements from the luxury brand we represent.How to Apply:Follow these simple steps to become an evaluator with us:Register at live.cxg.com and receive an email with your login credentials.Log in to our platform and share more about yourself. Once completed, our team will verify your profile and contact you.Check the 'welcome package' and pass the general certification.You're now ready! You can browse and apply for all opportunities that interest you.About CXG: CXG is a global customer experience agency working with premium and luxury brands. With 12 offices worldwide, we serve 70 countries. Our team consists of over 220 customer experience experts and a network of over 80,000 evaluators globally. Learn more about what we do at www.cxg.com.Enjoy the flexibility of working through our mobile application, where you can search and apply for assignments, complete certifications, submit surveys, and much more, all while on the go.Contact us for more information!

Toloka AI seeks a Freelance English Writer - AI Training Specialist to contribute to the development of advanced AI technologies. This contract position is fully remote and available to candidates located in Sweden. Responsibilities Produce clear and precise written materials for AI training projects Support the improvement of AI systems by shaping their comprehension and responses in English Requirements Excellent written English skills Strong attention to detail with a commitment to quality Genuine interest in language and technology

Please submit your CV in English and specify your English proficiency level. This freelance, project-based position at Mindrift connects material scientists with expertise in Python to AI-driven projects for leading technology companies. The work focuses on testing, evaluating, and improving AI systems. This is not a permanent role. Role overview Material scientists in this role design and validate advanced engineering problems for AI training. Typical tasks include: Creating materials engineering problems that mirror real-world workflows Developing challenges that use Python for engineering calculations and simulations Ensuring problems are computationally intensive, often using numerical methods or iterative solutions Designing problems related to system design, optimization, and analytical processes Grounding tasks in real research or practical engineering scenarios Validating solutions in Python, often with established engineering libraries Documenting problem statements and providing verified solutions Requirements Degree in Material Science or a related discipline Strong Python skills for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is also valued Minimum of 2 years of professional experience in applied work, research, or teaching Solid understanding of practical engineering constraints and approximations Excellent written English at C1 level or higher How to get started Apply Meet qualification criteria Join a project Complete assigned tasks Receive payment Time commitment During active project phases, work typically requires 10–20 hours per week. Workload may vary and is not guaranteed outside of active projects. Compensation Contributors can earn up to $45 per hour, depending on project scope, complexity, and expertise. Rates may differ across projects on the platform. Location: Remote , Sweden

Please submit your CV in English and indicate your English proficiency level. toloka-ai, through Mindrift, offers freelance, project-based work for specialists interested in evaluating and improving AI systems. This contract role is remote and based in Sweden. The position is not a permanent employment arrangement, and work is structured around specific projects for leading technology companies. Role overview This freelance AI Trainer position focuses on developing and validating advanced computational statistics problems. Work centers on creating original tasks inspired by real mathematical research, often requiring Python programming and the use of libraries such as Numpy, SciPy, or Sympy. Projects may involve computationally intensive problems that take significant time to solve, with an emphasis on areas like number theory, combinatorics, graph theory, and numerical analysis. What you will do Create original computational statistics problems modeled on authentic research workflows Develop problems that require Python-based solutions, using libraries such as Numpy, SciPy, or Sympy Design tasks that may take days or weeks to solve due to their complexity Write problem statements involving advanced reasoning in mathematics and numerical analysis Base tasks on real research challenges or practical mathematical applications Validate all solutions using Python and established mathematical libraries Document each problem clearly and provide verified, accurate answers Requirements Degree in Statistics or a related field Proficiency in Python for numerical validation (experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is also considered) Minimum of 2 years of professional experience, which can include applied research or teaching Strong written English skills at C1 level or higher Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are a plus How to join Application Qualification Assessment Project Participation Task Completion Compensation Project details During active project periods, tasks typically require 10-20 hours per week. Actual workload may vary and is not guaranteed outside of active project phases. Compensation Earnings can reach up to $50 per hour, depending on expertise and pace. Compensation rates may vary by project, based on complexity, scope, and required skills.