Freelance AI Evaluation Engineer

Please submit your CV in English and include your English proficiency level. This project-based contract with toloka-ai connects engineers to AI evaluation work for leading technology companies. The focus is on testing, assessment, and improvement of AI systems. This is not a permanent position. Role overview The Freelance AI Evaluation Engineer builds realistic virtual companies, complete with codebases, infrastructure, and supporting context such as documentation, conversations, and tickets. These environments simulate authentic development settings for AI systems to operate within. What you will do Design simulated companies based on strategic plans, including the creation of codebases and infrastructure. Develop and refine tasks within these environments, setting clear prompts and evaluation metrics to ensure tasks are solvable and fairly assessed. Set up isolated developer workstations, configuring Linux machines with development tools, repositories, task trackers, messaging platforms, and real web application codebases. Create tests that accurately accept all valid solutions and reject incorrect ones, maintaining a careful balance to avoid blocking correct approaches or allowing flawed ones. Iterate with AI agents during testing, ensuring they identify real issues, avoid missing mistakes, and do not incorrectly flag correct solutions. Review AI-generated code, analyze agent performance, and design edge cases and adversarial scenarios to strengthen evaluation processes. Incorporate feedback from expert QA reviewers, refining deliverables to meet quality standards. What this role does not include Data labeling Prompt engineering Writing code from scratch (the AI agent handles most code generation; your focus is on guidance and evaluation) This role centers on collaborating with advanced AI systems. Much of the work involves designing and refining tasks that challenge these models, requiring close interaction with AI agents throughout the process.

Please submit your CV in English and indicate your English proficiency level. toloka-ai, together with Mindrift, offers project-based contract work for optical engineers who want to support AI training projects. This remote role is open to candidates based in Queensland, Australia. Engagements are tied to specific projects and do not constitute permanent employment. Role overview This freelance position centers on designing and documenting advanced optics problems for AI training. The work draws on authentic research scenarios and practical applications in physics. Assignments are project-specific and require both subject expertise and strong written communication. What you will do Develop original optics problems that reflect real-world physics research workflows Create problems that require computational approaches and cannot be solved manually in a short period Design challenges involving complex reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics Base problems on genuine research situations or practical optics applications Document each problem thoroughly and provide accurate, verified solutions Requirements Degree in physics (theoretical, experimental, or computational) or a closely related field Minimum of 2 years of professional experience, including applied, research, or teaching roles Experience with numerical simulation techniques Ability to design realistic, complex problems that mirror actual research workflows Creative problem-solving skills across multiple physics domains Familiarity with physics modeling and approximation methods Strong written English skills at C1 level or higher How the process works Apply Pass qualifications Join a project Complete assigned tasks Receive compensation Time commitment During active project phases, expect to spend about 10–20 hours per week on assigned tasks. Workload may fluctuate depending on project needs and is not guaranteed outside of live project periods. Compensation Contributors may earn up to $35 per hour, depending on contribution level and pace. Actual rates will vary with project complexity, scope, and required expertise. Other projects on the platform may offer different compensation based on their specific needs.

Toloka-AI is seeking a Strategy Consultant to focus on AI training and evaluation. This remote role is available to candidates located in Queensland, Australia. Role overview This position centers on developing strategies that support AI training programs and enhance evaluation processes. The Strategy Consultant will work with teams across Toloka-AI to shape projects that impact the future of artificial intelligence. What you will do Create and refine strategies for AI training initiatives. Improve methods for evaluating AI systems and outcomes. Collaborate with experienced colleagues throughout the company. Contribute to projects that help guide the direction of AI development. Location This is a fully remote position for candidates based in Queensland, Australia.

Toloka AI seeks a Mechanical Engineer with strong Python programming skills for a freelance, remote role based in Queensland, Australia. This contract position focuses on training and content development at the intersection of mechanical engineering and artificial intelligence. Responsibilities Design and develop training modules that highlight AI applications in mechanical engineering Create educational materials tailored for engineers, ensuring clarity and engagement Lead training sessions for learners interested in combining AI with mechanical systems Collaborate with the engineering team to maintain the accuracy and relevance of all content Requirements Background in mechanical engineering Strong proficiency in Python Experience with teaching, mentoring, or creating technical educational content Interest in artificial intelligence and its applications within engineering Location This freelance position is remote and open to candidates based in Queensland, Australia.

Please submit your CV in English and highlight your English proficiency. Mindrift connects specialists with project-based AI work for leading technology companies. Most assignments involve testing, evaluating, and improving AI systems. This is a freelance, project-based position rather than a permanent role. Role overview As an Optical Engineer with Python expertise, work on designing and validating advanced computational physics problems. These problems are used to simulate research workflows and assess AI performance in physics-related areas. What you will do Design computational physics problems that reflect real research scenarios. Create Python-based problems using libraries such as Numpy, SciPy, or Sympy. Develop problems that are computationally intensive and not solvable manually within days or weeks. Build scenarios requiring complex reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics. Base scenarios on actual research challenges or practical applications from the field. Validate solutions using Python and standard physics simulation libraries. Document problem statements clearly and provide accurate, verified solutions. Requirements Degree in Physics (theoretical, experimental, or computational) or a related field. Proficiency in Python for numerical validation. Experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is beneficial. At least 2 years of professional experience in applied research or teaching. Background in numerical simulation methods. Ability to design problems that reflect real-world research processes in physics. Creative problem-solving skills across several physics domains. Familiarity with physics modeling and approximation techniques. Strong written English skills at C1 level or higher. Project process Application Qualification assessment Project participation Task completion Compensation Time commitment Tasks usually require about 10–20 hours per week during active project phases. Workload may vary depending on project needs and is not guaranteed. Compensation Earn up to $45 per hour, depending on expertise and contribution. Compensation may differ by project based on scope and complexity. Location This freelance role is remote and open to candidates based in Queensland, Australia.

Join our dynamic engineering team at Freelancer, where we are actively seeking skilled Senior Software Engineers to elevate our innovative environment.We offer an unparalleled opportunity for high achievers looking to break away from the mundane corporate grind. If you possess exceptional talent and seek to collaborate with some of the brightest minds in the industry, this position is tailored for you.At Freelancer, you won’t be just another number in a mega-cap technology firm; instead, you will face a diverse array of internet-scale challenges that will allow you to make a tangible impact. Our meritocratic culture ensures that hard work is recognized and rewarded, allowing you to rapidly advance your skills.Our mission is to create one billion job opportunities globally, making a real difference in the lives of people everywhere. You will have the chance to engage with a multitude of engineering challenges, utilizing a variety of cutting-edge technologies across our platform. Freelancer.com is among the top 1000 websites globally, featuring a state-of-the-art frontend stack with Angular, TypeScript, and RxJS, while our robust backend supports a modern global marketplace.As a Senior Software Engineer, you will take the lead in making architectural decisions and ensuring engineering excellence within your team, overseeing complex projects from inception to completion.

Please submit your CV in English and specify your proficiency level. Mindrift connects experienced professionals with project-based AI work for leading technology companies. Assignments focus on testing, evaluating, and improving AI systems. All work is freelance and project-based, not permanent employment. Role overview This freelance position is open to Electrical Engineers with strong Python skills, working remotely from Queensland, Australia. Contributors join AI projects, each with unique requirements and timelines. Work is flexible and organized by project phase. What you will do Design computational engineering problems that reflect real-world engineering workflows Create challenges that require Python programming for engineering calculations and simulations Develop problems involving computationally intensive tasks, including numerical methods or iterative solutions Build scenarios focused on system design, optimization, and analysis Base assignments on actual research challenges or practical engineering applications Validate solutions using Python and standard engineering libraries Write clear problem statements and provide verified solutions Requirements Degree in Electrical Engineering or a related field Strong Python skills for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is valued At least 2 years of experience in applied, research, or teaching roles Understanding of practical engineering constraints and approximations Advanced written English (C1+ level) Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are a plus Project commitment Active project phases usually require 10–20 hours per week. Actual workload depends on project needs and timelines. Compensation Contributors can earn up to $39 per hour, depending on contribution and speed. Rates vary by project based on complexity, scope, and expertise required. Other projects on the platform may offer different compensation depending on their requirements. How to apply Submit your application Pass the qualification process Join a project Complete assigned tasks Receive payment This is a freelance, project-based position. Permanent employment is not offered for this role.

We are expanding our engineering team and are seeking talented Full-Stack Software Engineers to elevate our company to new heights.This role is not your typical corporate position. If you're a high achiever with exceptional skills, looking for more than a mundane job, eager to collaborate with the brightest minds, and thrive without constant supervision, this is the opportunity for you.Joining a large tech company as the 10,000th employee may make it difficult to see your impact. Conversely, at a startup, you might work on temporary projects with limited mentorship and minimal chance to effect real change.At Freelancer, you will tackle a diverse array of global, internet-scale challenges that offer you real responsibility and the chance to make a substantial impact while rapidly enhancing your skills. We champion a meritocratic environment, actively promoting from within.Our mission is to create one billion jobs, and we genuinely make a difference in providing opportunities and income to individuals worldwide. Freelancer truly stands out in this regard.You will encounter a wide variety of engineering challenges. You’ll have the chance to work with an extensive range of technologies across our platforms. Freelancer.com is an Alexa top 1000 website, featuring a modern frontend stack that includes Angular, TypeScript, and RxJS. Our backend supports a robust suite of services that power a global marketplace including messaging, payments, translations, file services, and a notification system that sends millions of notifications every hour. We deploy code into production multiple times a day.

toloka-ai seeks a Senior Consultant for a freelance AI project. This remote position is open to candidates based in Queensland, Australia. The role centers on supporting strategic initiatives and contributing insights that help shape the company’s AI solutions. Role overview This position calls for a consultant with experience at MBB (McKinsey, BCG, Bain) or other leading consulting firms. The focus is on advising AI projects and influencing their direction through strategic guidance. Key responsibilities Advise on major strategic decisions for AI initiatives Apply consulting expertise to guide project direction Offer actionable insights to develop AI offerings Requirements Background at MBB or another top-tier consulting firm Strong experience in strategic consulting Comfort working independently as a freelancer

Role overview Toloka AI seeks a Freelance English Writer - AI Trainer to help shape and refine artificial intelligence systems. This contract role centers on producing clear, effective written content that supports the training and accuracy of AI models. What you will do Create and edit English-language materials used for AI training Work on projects that review, improve, and assess AI-generated text Collaborate remotely with a diverse team of professionals Location This remote position is open to candidates based in Queensland, Australia. Work can be performed from any location with reliable internet access.

Are you passionate about luxury automobiles and possess a keen eye for detail? If you thrive in the world of high-end vehicles, we want you to join our team as a Luxury Brand Evaluator!In this role, you will have the unique opportunity to evaluate customer experiences in luxury automotive settings. Your insights will be invaluable in helping prestigious brands enhance their services and elevate the luxury customer experience. Flexibility - Each in-store visit will take around 20 minutes, allowing you to manage multiple assignments with ease. Frequent Opportunities - Engage in several evaluations each month, collaborating with some of the most recognized brands globally. Your Responsibilities: Select assignments that resonate with your interests and expertise. Conduct evaluations either in-store or online, interacting with sales associates as needed. Meticulously observe the ambiance, experience luxury automotive showrooms, and assess after-sales services and overall customer satisfaction. Deliver honest feedback through our user-friendly platform, utilizing questionnaires to relay your observations. About CXG:At CXG, we unite premium brands with a network of over 80,000 evaluators across 70 countries. With nearly two decades of expertise in customer experience, we are committed to transforming the landscape of luxury retail. Join our team and leverage our mobile platform, CXG Live, to manage assignments, certifications, and feedback seamlessly.Locations: Gold Coast Cairns Brisbane North Lakes Southport Aspley

Toloka AI seeks a Freelance Junior Journalist - AI Trainer for a remote contract based in Queensland, Australia. This role blends journalism skills with AI model training tasks. What you will do Create original written content on a range of topics Contribute to the development and improvement of AI models by providing feedback and data Role focus This position centers on both content creation and practical work with AI systems. Assignments may cover various subjects, requiring adaptability and clear communication. Location This is a remote contract for candidates based in Queensland, Australia.

toloka-ai seeks a Freelance Machine Learning Engineer to join ongoing artificial intelligence and machine learning projects. This contract role is remote and open to candidates based in Queensland, Australia. Key responsibilities Contribute to machine learning and AI initiatives alongside a distributed team Use technical expertise to address practical challenges Work closely with colleagues to develop and deliver technology solutions Location details This freelance position is fully remote for those residing in Queensland, Australia.

Toloka AI is looking for a Freelance AI Trainer with a strong background in biology and Python. This remote position is based in Queensland, Australia and centers on advancing AI in the biological sciences. Role overview This role involves developing and refining AI models by applying expertise in both biology and programming. The work supports new advances in how AI is used within biological research and applications. What you will do Collaborate with a diverse team to design and improve training materials Participate in model training sessions, using knowledge of biology and Python to guide AI development Work environment This freelance position offers the flexibility of remote work and the chance to contribute meaningfully to the AI community, particularly at the intersection of technology and biological science.

Please submit your CV in English and indicate your level of English proficiency. Toloka AI, through Mindrift, is looking for freelance Research Physicists and AI Trainers for remote, project-based assignments in Queensland, Australia. Contributors support top technology companies by testing, evaluating, and improving AI systems. This arrangement is not permanent employment; participation is linked to specific projects as they arise. Role overview This contract role centers on developing original optics problems that reflect real-world physics research. Assignments often involve designing scenarios that require significant computational resources, making manual solutions impractical. Work spans advanced reasoning in mechanics, electromagnetism, thermodynamics, and quantum mechanics, with each challenge based on authentic research issues or practical applications. Clear documentation and accurate solutions are expected for every problem created. Responsibilities Create original optics problems modeled after actual research workflows Design challenges requiring extensive computation, beyond manual solving Develop scenarios in mechanics, electromagnetism, thermodynamics, and quantum mechanics Ground problems in real research or practical physics applications Document problems and provide thoroughly verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a related field At least 2 years of experience in applied physics, research, or teaching Familiarity with numerical simulation techniques Ability to design problems that reflect real research processes Creative problem-solving skills across various physics domains Experience with physics modeling and approximation Strong written English skills at C1 level or higher Project details During active project periods, tasks generally require 10–20 hours per week. Actual workload depends on project needs and is not guaranteed. Commitment is expected only while assigned to a current project. Compensation Contributors may earn up to $35 per hour, with rates varying by project based on scope, complexity, and required expertise. Other projects on the platform may offer different compensation depending on their requirements. Application process Apply Pass qualification(s) Join a project Complete assigned tasks Receive compensation

Please submit your CV in English and include your English proficiency level. Role overview toloka-ai, working with Mindrift, offers freelance project-based assignments for specialists in statistics and Python. This is not a permanent position. Projects connect contributors with AI initiatives for leading technology clients. What you will do Develop original computational statistics problems that mirror real research methods. Create challenges solvable with Python, using libraries such as Numpy, SciPy, and Sympy. Design problems that are computationally demanding, often requiring significant time to solve manually. Formulate tasks involving advanced reasoning in number theory, combinatorics, graph theory, and numerical analysis. Base assignments on authentic research questions or practical mathematical scenarios. Validate solutions in Python using standard mathematical libraries. Document each problem clearly and supply accurate, verified answers. Requirements Degree in Statistics or a closely related discipline. Proficiency in Python for numerical validation. Familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is valued. At least 2 years of relevant experience in applied, research, or teaching roles. Strong written English skills at C1 level or above. Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are considered an advantage. Project process The workflow includes: Application, Qualification Assessment, Project Participation, Task Completion, and Compensation. Time commitment During active project phases, expect to contribute roughly 10–20 hours per week. Actual hours depend on project needs and are not guaranteed outside of active assignments. Compensation Earn up to $38 per hour. Actual rates depend on project complexity, required expertise, and individual contributions. Pay may vary between assignments. Location This is a remote position based in Queensland, Australia.

Mindrift brings together skilled professionals and AI-focused projects from leading technology companies. The platform emphasizes collaboration between human expertise and AI, supporting the advancement of Generative AI through global talent. Role overview This part-time, freelance role focuses on data scraping for the Tendem project. The position is fully remote and based in Queensland, Australia. As an AI Pilot, collaboration with Tendem Agents will be central to delivering precise and dependable data extraction and processing. What you will do Manage the entire data extraction process from complex websites, producing structured datasets within deadlines. Work with internal tools such as Apify and OpenRouter, as well as custom workflows, to enhance data collection and validation. Adapt extraction methods to handle dynamic web content and respond to evolving site structures. Conduct validation checks and systematic reviews to ensure high data quality before delivery. Streamline scraping operations for large datasets by batching tasks and monitoring for consistent performance as websites change. Compensation Earnings may reach up to $32 per hour, depending on experience and the pace of contributions. Actual rates can vary with the scope and complexity of assigned projects.

Join our dynamic team as a Staff Software Engineer at Freelancer in beautiful Sydney. In this role, you will leverage your extensive experience to design, develop, and optimize scalable software solutions that drive our platform's success. You will collaborate with cross-functional teams to deliver high-quality products and enhance user experience.As a Staff Software Engineer, you will be responsible for leading technical initiatives, mentoring junior engineers, and ensuring best practices in software development are followed. You will play a crucial role in shaping the future of our technology stack and influence key architectural decisions.

Join our dynamic Systems Engineering team as a Senior DevOps Engineer / Site Reliability Engineer, where your expertise will play a vital role in designing and delivering mission-critical services and systems. Collaborate closely with software engineers to manage infrastructure and services at scale, utilizing an array of cutting-edge technologies to support the high-traffic Freelance.com marketplace and various other business products deployed on Amazon Web Services. Our tech stack includes Nginx, MySQL, Redis, ElasticSearch, RabbitMQ, Consul, Docker, and Kubernetes, all aimed at building highly resilient, dynamically scalable, self-healing systems through automation and monitoring using Terraform, Puppet, Prometheus, Grafana, Kibana, and Jenkins.

Transform the Future of WorkImagine spearheading engineering teams that drive platforms utilized by 80 million users worldwide. Visualize yourself designing systems that have revolutionized business operations, from the largest freelancing marketplace to a payment ecosystem that safeguards over US$7 billion in transactions.This is your opportunity to join Freelancer (ASX: FLN) and lead engineering efforts for industry-defining platforms:Freelancer: A thirteen-time Webby Award winner and the heart of online work.Escrow.com: The internet’s trust layer, protecting billions in transactions.LoadShift: Australia’s freight revolution, transporting more tonnage than the distance to the moon on weekdays.You will excel in this role if you: Dream in systems, think in architecture, and believe that excellent engineering addresses real-world problems at scale, not just merely writing code.Lead exceptional engineering talent across six continents, from Sydney to San Francisco. Our culture champions technical excellence, thrives on swift iterations, and measures success by the impact achieved.Are you ready to create products that make a difference for millions?As the Director of Engineering, you will:Build and scale high-performing engineering teams that deploy production code multiple times a day, fostering a culture of ownership, quality, and continuous improvement across globally distributed teams.Drive the technical vision and execution by collaborating with engineering teams to develop roadmaps, establish delivery goals, and meet them within ambitious timelines while upholding our reputation for reliability at internet scale.Architect for impact by engaging directly with senior architects to contribute to technical plans and designs that tackle complex distributed systems challenges across messaging, payments, translations, and notification systems processing millions of events every hour.Lead through influence by effectively communicating with stakeholders across the organization, from product managers to C-suite executives, translating technical complexities into business value and strategic decisions.Elevate engineering excellence by establishing and practicing world-class engineering habits, maintaining high standards of software quality through code reviews, testing disciplines, and a culture of continuous learning.Optimize across constraints by closely collaborating with product managers and cross-functional teams to achieve the best outcomes while balancing speed, quality, and technical debt management.Cultivate a championship culture centered on our company values, empowering engineers to take charge, improve continuously, leverage data, and perform like a world-class sports team.