Freelance AI Agent Evaluation Engineer

Please submit your CV in English and include your English proficiency level. Mindrift offers project-based freelance roles for specialists interested in AI system evaluation. This contract position focuses on assessing and improving AI coding agents for technology clients. The role is remote, with a preference for candidates based in Hyderabad, Telangana, India. Please note: this is a freelance contract, not a permanent position. Role overview The Freelance AI Agent Evaluation Engineer works on building datasets to measure how well AI coding agents handle realistic developer tasks. The position centers on creating and refining simulated development environments and evaluating model performance in those settings. What you will do Set up virtual companies using detailed plans, including codebases, infrastructure, and supporting materials (documentation, tickets, conversations) to mirror real-world development environments. Design and adapt tasks as these virtual companies evolve: write prompts, define fair evaluation criteria, and ensure tasks are solvable and judged objectively. Create assignments within isolated environments that simulate a developer’s workstation, including a Linux machine with development tools, MCP servers (repository, task tracker, messenger, documentation), and a real web application codebase. Develop tests that accept all valid solutions and reject incorrect ones, ensuring the tests are neither too strict nor too lenient. Collaborate with an AI agent to check that tests catch real issues, avoid missing faulty solutions, and do not penalize correct ones. Review agent-generated code, analyze agent performance, and design edge cases and adversarial scenarios to further challenge the models. Incorporate feedback from expert QA reviewers to refine and improve your work to meet quality standards. What this role is not This is not a data labeling position. This is not prompt engineering. You will not write code from scratch; the AI agent produces most of the code. The main focus is on guidance and evaluation. Much of the work involves collaborating closely with AI systems. Creating tasks that challenge advanced models requires direct interaction with these agents.

Frazier & Deeter (FD) is a distinguished accounting and advisory firm recognized for its excellence. Serving a diverse range of clients from Fortune Global 500 companies to burgeoning small businesses, FD fosters a growth-oriented culture that encourages adaptability and entrepreneurship. Our mission is to make a significant impact on our clients and within our teams through our brand promise of 'Investing in Relationships to Make a Difference.' With a comprehensive suite of services including tax, audit, accounting, and advisory, FD operates from multiple locations including Atlanta, Charlotte, Las Vegas, Nashville, Alpharetta, Tampa, London, and now India. Our firm has consistently been awarded accolades such as being a Top 50 firm, a Best of the Best Accounting firm, a Best Firm to Work For®, and a Best Firm for Women in Leadership. To support our growing international and cross-border client base, FD has launched its new entity in India. We pride ourselves on being unconventional in our approach to accounting, providing team members with the opportunity to engage in global consulting and advisory roles within a dynamic and expanding business environment that is part of our esteemed US and UK accountancy firms.

About the PositionAt Aisera, we are dedicated to revolutionizing the way AI agents tackle real-world challenges for our clients. Our focus is on harnessing cutting-edge technologies, including Large Language Models (LLMs) and advanced AI agent systems, to deliver innovative, secure, and cost-effective solutions. As a Forward Deployed Engineer, you will play a pivotal role in deploying AI agents that address practical issues faced by our customers. Collaborating closely with clients, software engineers, and machine learning experts, you will ensure impactful deployments while continuously enhancing our core AI platform. Your responsibilities will include developing intelligent AI agents, seamlessly integrating them with external systems, and providing hands-on technical support for successful implementations. This role calls for strong engineering acumen, adaptability, and a commitment to customer engagement. If you possess a self-driven mindset, analytical skills, and a passion for applying AI in practical contexts, we invite you to apply.

As a Principal Architect for the Agentic AI Platform & Systems at Experian, you will play a pivotal role in shaping the architecture and development of innovative AI solutions. Your expertise will drive the design and implementation of scalable architectures that empower our AI capabilities, ensuring high performance and reliability.Join our dynamic team and contribute to projects that are at the forefront of technology, transforming how data and AI intersect. This position offers an exciting opportunity to lead architectural strategies and collaborate with cross-functional teams to deliver cutting-edge solutions.

About Tide Tide helps small and medium enterprises (SMEs) simplify banking and administration, from invoicing to accounting. The company supports over 1.8 million members across the UK, India, Germany, and France, aiming to reshape how SMEs manage their finances and daily operations. Tide serves SMEs in the UK, India, Germany, and France. Membership exceeds 1.8 million, with 800,000 in the UK and 1,000,000 in India. More than $300 million raised in funding. Global team of over 2,500 employees. Offices in Central London, with technology hubs in Sofia and locations in Serbia, Romania, Lithuania, Hyderabad, Gurugram, New Delhi, Berlin, Paris, and Luxembourg. Role Overview: Staff Software Engineer, Agentic Platform This role is based in India (Bengaluru, Delhi NCR, or Hyderabad). The Staff Software Engineer will work on Tide’s agentic platform, focusing on backend systems that connect with Generative AI. The position centers on building frameworks, standards, and platforms that enable AI capabilities to scale securely and efficiently across the organization. The scope goes beyond feature delivery, influencing long-term technical direction for AI at Tide. What You Will Do Develop core backend services for the agentic platform, including APIs, workflow orchestration, and integration with tools. Integrate third-party components to speed up delivery, while ensuring control, trust, and reusability where needed. Work closely with product, data, platform, and security teams to implement shared AI capabilities. Design services that are reliable, secure, observable, and straightforward for other teams to use. Help define and develop reusable engineering patterns for AI-enabled workflows.

Role Overview Tide is looking for a Senior Staff Software Engineer to join the Agentic Platform team in Hyderabad, India. This role focuses on building new features and improving the platform to support better user experiences. The position involves close collaboration with colleagues across different teams to deliver software that meets customer needs.

Toloka AI seeks a Freelance AI Trainer who combines expertise in Mechanical Engineering with strong Python skills. This role is remote but based in Hyderabad, Telangana, India. Role overview This position centers on applying both mechanical engineering knowledge and Python programming to support the development and training of AI systems. The work involves collaborating with others to move technology forward. Key responsibilities Use technical skills in Mechanical Engineering and Python to contribute to AI training projects. Assist in designing and refining training programs for AI systems. Work closely with a team to develop and enhance technology-driven solutions. Location This is a remote position based in Hyderabad, Telangana, India.

Join our innovative team as a Generative AI (GenAI) Developer at Accellor, where your skills will be pivotal in crafting and deploying cutting-edge GenAI solutions. Your role will involve utilizing large language models (LLMs) to tackle real-world business challenges, collaborating with cross-functional teams, and employing advanced techniques such as prompt engineering and fine-tuning. This position requires a solid background in machine learning and NLP, coupled with a passion for the evolving field of GenAI technologies.Key Responsibilities: Design, develop, and implement GenAI solutions tailored to specific business requirements using Python and LLMs. Engage with stakeholders to discover opportunities for GenAI integration and convert these requirements into scalable solutions. Preprocess and analyze diverse unstructured data (text, documents, etc.) for model training, fine-tuning, and evaluation. Utilize prompt engineering, fine-tuning, and RAG (Retrieval-Augmented Generation) methodologies to enhance LLM outputs. Deploy GenAI models and APIs in production settings, ensuring optimal performance, scalability, and reliability. Continuously monitor and refine deployed solutions based on user feedback and real-world application. Stay informed about the latest developments in GenAI, LLMs, and orchestration tools such as LangChain and LlamaIndex. Write clean, maintainable, and well-documented code while contributing to team-wide code reviews and best practices. Qualifications: Minimum of 2 years of demonstrable experience as an AI Developer. Proficiency in Python programming. Strong understanding of various GenAI models including OpenAI, LLAMA2, and Mistral, along with experience setting up local GPTs using tools like Ollama and LM Studio. Hands-on experience with LLMs, RAG (Retrieval-Augmented Generation), and vector databases (e.g., FAISS, Pinecone). Experience with multi-agent frameworks to create efficient workflows. Familiarity with LangChain or similar tools like LlamaIndex and LangGraph. Sound knowledge of machine learning frameworks, libraries, and tools. Exceptional problem-solving skills and a solution-oriented mindset. Strong communication and collaboration skills. Ability to work autonomously and manage time effectively. Experience with cloud platforms such as AWS, GCP, or Azure. Benefits:Exciting Projects: We focus on diverse industries such as high-tech, communication, media, healthcare, retail, and telecom. Our clients include renowned global brands who appreciate our innovative solutions.Collaborative Environment: Enhance your skills while collaborating with a talented team in an open, relaxed atmosphere, with opportunities to work abroad in our global centers.Work-Life Balance: At Accellor, we prioritize a healthy work-life balance to foster productivity and well-being.

ProArch delivers IT services for clients worldwide, focusing on areas like cybersecurity, cloud computing, data management, artificial intelligence, and application development. With a team of over 400 professionals across three countries, the company aims to solve important business challenges while maintaining strong ethical standards. Team members at ProArch work alongside industry experts who share knowledge and encourage professional development. The company values contributions from every individual, offering a workplace where input matters and projects span multiple industries and communities. Flexibility is built into the remote work culture, supporting a healthy balance between work and life outside the office. Role overview The Senior AI Developer position is fully remote, with a primary focus on supporting clients in Hyderabad, Telangana, India, as well as international projects. This role involves designing and building technology solutions that address real-world client needs. Projects may include developing intelligent applications, strengthening system security, and supporting cloud migrations or infrastructure improvements. What you will do Develop and implement AI-driven applications and solutions Work closely with specialists in data, engineering, cloud, cybersecurity, and infrastructure Apply creative problem-solving and technical skills to tackle complex challenges Contribute to projects that shape outcomes for clients around the globe Our culture ProArch encourages curiosity and continuous learning. The team moves quickly, trusts individuals to make a difference, and supports ongoing professional growth. Innovation is welcomed, and every team member plays a part in creating meaningful change for clients and communities.

About InvoiceCloud:InvoiceCloud is a dynamic fintech leader that has garnered 20 prestigious awards in 2025, including accolades from USA TODAY and Boston Globe for Top Workplaces, as well as multiple SaaS Awards for Best Solution in Finance and FinTech. We have also received national customer service accolades from Stevie and the Business Intelligence Group. Our mission is to reduce digital exclusion and restore simplicity and dignity to payment processes for essential services while leading in AI maturity and responsible innovation. It’s an award-winning, purpose-driven environment where top talent thrives. To learn more, visit InvoiceCloud.com.Job DetailsThe SDET – AI Platform plays a crucial role in guaranteeing the quality, reliability, performance, and security of the generative AI capabilities that drive the InvoiceCloud platform. This position involves developing automated testing frameworks, semantic validation tools, and continuous monitoring to facilitate enterprise-grade AI delivery at scale.You will collaborate closely with Product, AI Engineering, Data Science, Platform, and Security teams to achieve measurable, observable, and responsible AI outcomes. Success in this role is measured by reduced release risk, enhanced AI accuracy, and increased developer productivity through automation and continuous validation.

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects skilled professionals with project-based AI work for leading technology companies. Assignments focus on testing, evaluating, and improving AI systems. This freelance position is project-based and not a permanent role. Role overview The Freelance Electrical Engineer & Python Specialist (AI Trainer) supports the development and validation of computational engineering challenges used in AI training. Projects are remote but focus on needs based in Hyderabad, Telangana, India. Main responsibilities Design computational engineering problems that mirror real-world engineering workflows. Create programming tasks in Python for calculations and simulations. Ensure tasks involve substantial computation, such as numerical methods or iterative solutions. Develop problems related to system design, optimization, and analysis. Base challenges on practical engineering or research scenarios. Validate solutions in Python, using standard engineering libraries. Document problems clearly and provide verified solutions. Who this suits This freelance role fits engineers with Python experience who want part-time, project-based work. Suitable candidates have: A degree in Electrical Engineering or a related discipline. Proficiency in Python for numerical validation. Familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar languages is also valued. At least 2 years of professional experience in applied, research, or educational settings. A strong understanding of practical engineering constraints and approximations. Excellent written English skills (C1 level or higher). Professional certifications (such as CMME, SAS Certifications, CAP) and experience with international or applied projects are a plus. How projects work Apply Pass qualifications Join a project Complete assigned tasks Receive payment Time commitment During active project phases, expect to spend about 10-20 hours per week. Actual workload may vary with project needs and is not guaranteed. Compensation Contributors can earn up to $9 per hour, depending on expertise and pace. Compensation varies by project scope, complexity, and required skills. Some projects may offer different earning levels based on their specific requirements.

Join our team at Weekday's client as a Lead AI Engineer!In this pivotal role, you will take charge of designing, developing, and implementing cutting-edge AI solutions. Your expertise will be applied to a variety of large language models (LLMs) — utilizing both open-source and proprietary technologies. You will optimize these models through advanced techniques such as fine-tuning, prompt engineering, agentic frameworks, and retrieval-augmented generation (RAG). As a leader, you'll oversee the AI engineering team, encouraging innovation and ensuring the successful delivery of AI-centric projects.

Role Overview weekday-1 is hiring an AI-Native Full-Stack Developer in Hyderabad, Telangana, India. This role focuses on building scalable web applications that use advanced AI technologies. The position involves working closely with teams from different disciplines to create solutions that improve both functionality and user experience.

Toloka AI seeks a Civil Engineer with strong Python experience to join as a Freelance AI Trainer. This contract position centers on developing and delivering training modules for AI projects that combine civil engineering principles with Python programming. Role overview This role involves designing educational content that bridges civil engineering and Python. You will create and present training materials to support AI initiatives, ensuring technical concepts are clearly explained and relevant to project needs. Location This is a remote position based in Hyderabad, Telangana, India.

Join our dynamic team at Accellor as a Senior AI Developer, where you will play a pivotal role in crafting and integrating cutting-edge artificial intelligence solutions into web applications. We are looking for a talented individual who possesses extensive hands-on experience in developing intelligent features that utilize machine learning models, natural language processing (NLP), computer vision, and other AI technologies to enhance user experiences, automate processes, and deliver substantial business value.Key Responsibilities:Design, develop, and deploy AI-driven features and functionalities within web applications.Create and implement AI models for various applications such as recommendation engines, chatbots, and predictive analytics.Preprocess and analyze large datasets for training and validating models.Optimize AI algorithms for improved performance, scalability, and accuracy.Collaborate with front-end and back-end developers to ensure seamless integration of AI components via APIs or microservices.Evaluate and experiment with suitable AI algorithms and tools based on project needs.Monitor and maintain deployed AI systems to ensure reliability and responsiveness.Stay abreast of the latest trends in AI and web development, applying best practices as necessary.Document processes, models, and code for maintainability and knowledge sharing.Work closely with cross-functional teams, including product managers, designers, and data engineers, to deliver impactful solutions.

Join roboyo as a Senior AI Engineer and be a pivotal part of our innovative team. In this role, you will leverage your expertise in artificial intelligence to design, develop, and implement cutting-edge AI solutions that drive impactful business outcomes. Your contributions will help shape the future of our technology and create value for our clients.

About Us:At Endpoint Clinical, we pride ourselves on being a leading provider of interactive response technology (IRT®) systems and solutions tailored for the life sciences industry. Since our inception in 2009, we've been dedicated to a singular vision: empowering sponsors and pharmaceutical companies to achieve unparalleled clinical trial success. Our innovative solutions, powered by the proprietary PULSE® platform, are designed to optimize supply chain management, reduce operational costs, and ensure precise and timely patient dosing. With our headquarters in Raleigh-Durham, North Carolina, and offices spanning the United States, Europe, and Asia, we're poised to make a significant impact globally.Position Overview:The Senior Software Developer – AI will play a crucial role in harnessing the power of AI technologies to optimize various business processes within our organization. This position requires a deep understanding of current business workflows, the ability to pinpoint opportunities for AI-driven automation, and the skill to advocate for the advantages of these solutions in terms of enhanced speed, quality, and cost-effectiveness. The ideal candidate will be responsible for developing proof of concepts (POCs), obtaining business approvals, and executing AI solutions on a global scale. Essential skills include expertise in neural networks, programming, natural language processing (NLP), prompt engineering, and practical experience with AI tools and frameworks. The role will also involve collaboration with cross-functional teams and necessitates a strong grasp of data ethics and AI bias considerations. You will work closely with fellow Software Developers and Design Managers to guide the development process for any client-specific customizations needed for unique deployments.This position is available at our offices in Hyderabad and Bangalore.

Toloka AI seeks a Computer Science Specialist with advanced Python skills to contribute to AI projects on the Mindrift platform. This role is remote, with a focus on candidates based in Hyderabad, Telangana, India. Key responsibilities Use Python to build and refine AI-driven solutions Tackle complex technical challenges as part of a collaborative team Support projects that explore new possibilities in AI technology Location This is a remote position for candidates located in Hyderabad, Telangana, India.

Join Shield AI as a Senior Staff Engineer in Supplier Development!Are you ready to make a significant impact in the field of aerospace engineering? At Shield AI, founded in 2015, we are dedicated to safeguarding service members and civilians with cutting-edge intelligent systems. Our innovative technology includes the V-BAT and X-BAT aircraft, Hivemind Enterprise, and Hivemind Vision product lines, which are actively utilized across the globe. We are looking for a passionate and experienced Supplier Development Engineer to enhance our mechanical components and engines supply chain. In this pivotal role, you will be instrumental in improving supplier performance by addressing challenges that affect quality, on-time delivery, and scalability. You will also support the onboarding of suppliers for new designs, contributing to our mission of delivering affordable and autonomous solutions at scale.

About Tide Tide supports small and medium-sized enterprises (SMEs) by helping them streamline operations and cut costs. The platform goes beyond business accounts and banking services, offering a full range of administrative tools for tasks like invoicing and accounting. With more than 1.8 million members in the UK, India, Germany, and France, Tide is reshaping how small businesses manage their finances. The company builds technology-driven solutions tailored for SMEs, focusing on fast onboarding, low fees, and features designed to save time and money. Data guides every decision at Tide, with the goal of letting SMEs concentrate on their core work while the platform handles the rest.