AI Agent Testing Specialist Jobs in United States· Page 2

35,642 jobs found

21 - 40 of 35,642 Jobs
Apply
Barnes & Thornburg LLP logo
Full-time|On-site|Minneapolis

Barnes & Thornburg LLP is seeking a dedicated and knowledgeable Patent Agent or Technical Specialist with a minimum of 3 years of experience in advanced AI technologies. This is an exciting opportunity to engage with cutting-edge projects in artificial intelligence while collaborating with a dynamic team focused on pioneering technology solutions. The role i…

Jan 5, 2026
Apply
Toloka AI logo
Contract|$80/hr - $80/hr|Remote|Remote — Virginia, United States

Please submit your CV in English and indicate your English proficiency level.Mindrift connects talented professionals with exciting project-based opportunities in AI for leading tech firms, emphasizing the testing, evaluation, and enhancement of AI systems. This is a project-based role, not a permanent position.About the RoleWe are seeking a highly skilled Senior Python Developer with extensive experience in functional testing. The ideal candidate will possess advanced skills in Linux and Docker, and will be adept at reading code across various programming languages (such as C, Rust, Go) with the assistance of LLMs. You will be responsible for translating requirements into actionable migration tasks and utilizing tools like Roo Code or Claude Code to streamline iterative development.Key ResponsibilitiesDevelop functional black box tests for substantial codebases in multiple source languages.Set up and manage Docker environments to ensure fully reproducible builds and test executions across diverse platforms.Track code coverage and configure automated scoring metrics to align with industry benchmarks.Utilize LLMs (Roo Code, Claude) to expedite development cycles, automate repetitive tasks, and enhance code quality.Requirements5+ years of experience in software engineering, primarily focused on Python.Deep expertise with pytest (fixtures, session-scoped, timeouts) and experience designing black-box functional tests for command-line tools.Advanced Docker proficiency (creating reproducible Dockerfiles, managing user contexts, ensuring secure work environments).Strong skills in Linux and Bash scripting, with a knack for debugging within containers.Familiarity with contemporary Python tools (uv, pyproject.toml, packaging).Ability to interpret and understand multiple programming languages through LLMs (e.g., C, C++, Rust, Go).Experience leveraging LLMs (Claude Code, Roo Code, Cursor) to enhance iterative development and generate test cases.Proficiency in English at a B2 level or higher.Preferred QualificationsPrevious experience with agent evaluation platforms and MCP CLI.Tools and Technologies: Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading skills), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.BenefitsWhat We Offer:Freelance project-based collaboration through the Mindrift platform (powered by Toloka AI).Fully remote and flexible participation — choose your working hours (20-30 hours per week).Each project offers competitive compensation based on its scope and required expertise. For this project, AI trainers can earn up to $80 per hour.

May 2, 2026
Apply
Sonsoft Inc. logo
Full-time|On-site|Plano

Join our dynamic team at Sonsoft Inc. as a Middleware Testing Specialist. In this pivotal role, you will be responsible for ensuring the seamless integration of middleware solutions. You will collaborate with cross-functional teams to identify and resolve integration issues, ensuring high quality and performance of our applications.Your expertise in middleware testing will help us deliver robust solutions that meet our clients' needs. If you are passionate about technology and testing, we want to hear from you!

Aug 8, 2016
Apply
Cresta logo
Full-time|Remote|San Francisco, Remote

Cresta is dedicated to transforming every customer interaction into a strategic advantage by harnessing the full capabilities of the contact center. Our innovative platform integrates AI and human intelligence to facilitate the discovery of customer insights, optimize behavioral best practices, automate conversations and streamline inefficient processes, empowering every team member to enhance their productivity and effectiveness. Founded by visionary leaders from Stanford's AI lab, including co-founder Sebastian Thrun, the brain behind Google X and Waymo, our leadership team also features CEO Ping Wu, co-founder of Google Contact Center AI, and Tim Shi, an early member of OpenAI.Our exceptional team consists of AI and ML experts, go-to-market leaders, and prominent investors such as Andreessen Horowitz, Greylock Partners, and Sequoia Capital, along with industry veterans like former AT&T CEO John Donovan. We proudly serve clients like Intuit, Cox Communications, Hilton, and Carmax and have been recognized by Forbes and Bain Consulting as one of the leading private AI companies worldwide.Embark on this exciting journey with us to redefine the workforce through AI. The future of work is now, and it’s happening at Cresta.

Feb 11, 2026
Apply
Zeta Global logo
Full-time|$220K/yr - $250K/yr|On-site|New York, New York, United States

About UsZeta Global (NYSE: ZETA) is at the forefront of innovation as an AI-Powered Marketing Cloud. Our platform harnesses cutting-edge artificial intelligence and an extensive array of consumer signals to streamline the process for marketers to acquire, nurture, and retain customers with unparalleled efficiency. The Zeta Marketing Platform (ZMP) embodies our mission to simplify sophisticated marketing by integrating identity, intelligence, and omnichannel activation into a cohesive platform, powered by one of the industry's largest proprietary databases and AI capabilities. We empower enterprise clients across diverse sectors to personalize consumer interactions on an individual basis across all channels, achieving superior marketing outcomes. Founded in 2007 by David A. Steinberg and John Sculley, our headquarters is located in New York City, with a presence in multiple global offices. Discover more about us at www.zetaglobal.com.Role OverviewWe are seeking a talented and hands-on Principal Agentic AI Engineer to develop innovative bidder-adjacent agents that enhance campaign performance through the utilization of RAG + tool-using workflows in a closed-loop ACE (Observe → Reason → Act → Evaluate) framework. This position goes beyond traditional model training and deployment; it focuses on agentic decision-making, evaluation, and safety within a fast-paced AdTech setting.

Mar 19, 2026
Apply
Zeta Global logo
Full-time|$220K/yr - $250K/yr|On-site|San Francisco, California, United States

About UsZeta Global (NYSE: ZETA) is an innovative AI-driven Marketing Cloud that harnesses cutting-edge artificial intelligence (AI) and an immense array of consumer signals to streamline the process for marketers in acquiring, nurturing, and retaining customers more effectively. Our Zeta Marketing Platform (ZMP) aims to simplify complex marketing strategies by integrating identity, intelligence, and omnichannel activation into a unified platform—powered by one of the industry's largest proprietary databases and AI. Our enterprise clientele, spanning various sectors, can tailor consumer interactions on an individual basis across all channels, resulting in superior marketing outcomes. Founded in 2007 by David A. Steinberg and John Sculley, Zeta is headquartered in New York City with global offices. Discover more at www.zetaglobal.com.Role OverviewWe are seeking a proactive and skilled Agentic AI Engineer to develop bidder-adjacent agents that enhance campaign performance through RAG and tool-using workflows within a closed-loop ACE (Observe → Reason → Act → Evaluate) framework. This role transcends traditional linear model training and deployment, focusing instead on agentic decision-making, evaluation, and safety in a fast-paced AdTech environment.

Mar 19, 2026
Apply
Truveta logo
Internship|$20/hr - $20/hr|Hybrid|Seattle, WA

Join Us as an Agentic AI Software Testing Intern – Intelligence Platform (IPA)At Truveta, we are pioneering the world's first health provider-led data platform with a vision to Save Lives with Data. Our mission is to empower researchers to accelerate the discovery of cures, enable clinicians to excel in their expertise, and assist families in making informed healthcare decisions. Achieving this ambitious vision requires a dynamic team of talented individuals who possess a unique blend of healthcare, software, and big data expertise, and who are aligned with our company values.This internship is located in the Greater Seattle area, and we expect interns to work from our office multiple days a week. #LI-hybridWho We Are Looking For:Truveta is rapidly assembling a talented and diverse team to address complex health and technical challenges. We are in search of problem solvers, passionate collaborators, and individuals ready to take initiative while making a meaningful impact. If you are eager to engage in purposeful work and grow your skills, we invite you to apply!

Mar 25, 2026
Apply
Shield AI logo
Full-time|On-site|Dallas, Texas

At Shield AI, our mission is to safeguard the lives of service members and civilians through cutting-edge intelligent systems. As part of this commitment, our Hardware Test Engineering team plays a vital role in developing and upholding test infrastructures that guarantee the reliability and performance of our hardware products, including the innovative X-BAT.As a Staff Engineering Specialist, you will be instrumental in designing, maintaining, and operating a sophisticated fleet of hardware test systems. This includes Hardware-in-the-Loop (HIL) environments and production test equipment, integrating electrical, mechanical, networking, and software components to validate the performance of avionics and vehicle subsystems, as well as production hardware.

Mar 23, 2026
Apply
Hatchit logo
Full-time|On-site|Reston, VA OR Somerville, MA

Hatchit seeks a Senior Director of Generative & Agentic AI to lead artificial intelligence projects from either Reston, VA or Somerville, MA. This position calls for a leader who can drive innovation and oversee a team dedicated to creating advanced AI technologies. Main focus The Senior Director will guide efforts to develop generative and agentic AI solutions. The work involves shaping projects that have practical impact across multiple industries. Leadership responsibilities This role includes managing a skilled team, setting strategic direction, and ensuring that AI initiatives align with broader organizational goals. Location This position is based in either Reston, VA or Somerville, MA, with a focus on collaboration and team leadership at one of these locations.

Apr 24, 2026
Apply
Barnes & Thornburg LLP logo
Full-time|On-site|Indianapolis

Barnes & Thornburg LLP is in search of a skilled Patent Agent or Technical Specialist with over 3 years of experience in advanced artificial intelligence concepts. This role is pivotal in addressing our expanding needs across diverse practices. Join us to engage in groundbreaking projects focused on artificial intelligence within a dynamic, collaborative team environment that champions next-generation technology. This position is available in our Chicago, Indianapolis, or Minneapolis offices.

Jan 5, 2026
Apply
NewsBreak logo
Full-time|$135K/yr - $225K/yr|On-site|Mountain View, California, United States

About NewsBreakEstablished in 2015, NewsBreak is a pioneering Content Intelligence platform that is redefining the content economy. With over 40 million monthly active users, our flagship platform provides highly personalized local news and information, driven by advanced AI technologies, recommendation systems, and advertising technology.As recognized by Fast Company as #32 on the Top Workplaces for Innovators, we take pride in being Great Place to Work® certified. Our dynamic team of technologists, product innovators, and business leaders is dedicated to addressing significant challenges at scale.Achieving unicorn status in 2021, we are committed to maintaining our high-growth trajectory and building the foundational infrastructure for content intelligence.If you’re driven to dream big, innovate quickly, and make a meaningful impact, we want to hear from you! For more details, visit www.newsbreak.com/aboutAbout the RoleWe are looking for an AI Development Engineer to join our AI and machine learning team. This role emphasizes multimodal machine learning modeling (audio, video, image, text) and the creation of AIGC systems and AI agents.Your responsibilities will involve translating cutting-edge research into scalable, real-world AI systems including virtual humans, text-to-image, and text-to-video generation. You will work closely with research, engineering, and product teams to propel next-generation multimodal and generative AI technologies forward.ResponsibilitiesDesign and develop multimodal ML models for understanding and generating audio, video, image, and text.Create AIGC systems, including virtual humans and text-to-image and text-to-video models.Develop AI agent systems encompassing reasoning, planning, tool usage, and multi-agent collaboration.Transform leading-edge research into scalable, production-ready AI systems.

Jan 16, 2026
Apply
Babel Street logo
Full-time|$140K/yr - $180K/yr|On-site|Reston, Virginia, United States; Somerville, Massachusetts, United States

Join Babel Street, the trusted technology partner for the world's leading identity intelligence and risk operations. Our advanced AI and data analytics solutions provide unparalleled, analysis-ready data in any language, enabling proactive risk identification and delivering comprehensive insights. With high-speed automation and seamless integration into existing systems, we empower government and commercial organizations to turn high-stakes identity and risk operations into a strategic advantage. Our actionable insights safeguard lives and protect critical assets globally.

Feb 5, 2026
Apply
OKX logo
Full-time|On-site|APAC

Join OKX as a Lead Principal AI Engineer specializing in AI Agent Development. In this pivotal role, you will spearhead innovative projects that leverage artificial intelligence to create next-generation AI agents. Your expertise will guide a talented team as they design, develop, and implement cutting-edge solutions that enhance user experiences and drive efficiencies.Key responsibilities include collaborating with cross-functional teams, conducting research on AI technologies, and mentoring junior engineers. Ideal candidates will possess a robust understanding of machine learning, natural language processing, and software engineering principles.

Mar 19, 2026
Apply
Sonsoft Inc. logo
Full-time|On-site|Plano

Join our dynamic team at Sonsoft Inc. as a Middleware Testing Specialist! In this role, you will play a crucial part in ensuring the reliability and performance of our middleware solutions. You will be responsible for designing and executing comprehensive test plans, identifying defects, and collaborating with cross-functional teams to enhance our middleware products.If you are passionate about quality assurance and seeking an opportunity to grow in a collaborative environment, we invite you to apply!

Aug 8, 2016
Apply
OKX logo
Full-time|On-site|San Jose, California, United States

Join OKX as a Principal AI Engineer specializing in AI Agent Development. In this pivotal role, you will spearhead the design and implementation of cutting-edge AI agents that drive automation and enhance user experience. Collaborating with cross-functional teams, you will leverage your expertise in artificial intelligence to innovate and propel our technology forward.

Mar 16, 2026
Apply
Robust AI logo
Full-time|On-site|San Carlos, CA

About the Role: Join Robust AI, a pioneering startup founded by industry veterans in robotics, AI, and Supply Chain, as we strive to bring the potential of Embodied AI to life. We are a dynamic team that values collaboration and diverse perspectives, and we are seeking passionate individuals eager to create robots that provide real value to customers while being enjoyable to use. Help us revolutionize the field of robotics by developing autonomous and truly collaborative robots that are smart, safe, and adaptable.We are in search of a hands-on Robotics Test Automation Engineer to drive the testing and validation of our mobile robotic systems. This role involves executing and automating tests in both simulation environments and on actual robotic platforms, ensuring system behavior is verified under real-world conditions. You will play a key role in assessing the performance of navigation, perception, and control systems across diverse scenarios, and your findings will inform future development efforts while maintaining high product quality.

Jan 6, 2026
Apply
simpleciti logo
Full-time|On-site|Garden City, New York, United States

simpleciti seeks an AI Agent Engineer based in Garden City, New York. This position centers on developing and launching AI-powered solutions for business needs. Role overview The AI Agent Engineer will design, build, and deploy systems that use artificial intelligence to enhance business technology. Projects focus on creating tools that streamline user interactions and support organizations in operating more efficiently. Key responsibilities Design AI-driven solutions tailored to business requirements Build and implement tools that improve user experience Deploy systems that help organizations optimize their operations Location This role is based in Garden City, New York.

Apr 24, 2026
Apply
Pure Storage, Inc. logo
Full-time|$149K/yr - $224K/yr|On-site|Santa Clara, California

Join Pure Storage, where we are at the forefront of an exhilarating technology revolution, fundamentally transforming the data storage landscape. Here, you will unleash your innovative potential, evolve with our team, and collaborate with some of the brightest minds in the industry.This is the kind of work that has historically driven the tech sector—a chance to create solutions that genuinely make a difference. If you are eager to embrace limitless possibilities and leave an impactful legacy, we invite you to be part of our journey.THE ROLEWe are looking for a skilled and innovative Agentic AI Software Engineer to enhance our vibrant team in Santa Clara, CA. You will be responsible for developing production-grade agentic AI solutions that facilitate enterprise automation and drive digital transformation initiatives. Your expertise will involve designing and deploying LLM-based services, employing advanced prompt engineering techniques, implementing guardrails, and establishing model evaluation frameworks, all while ensuring secure and scalable operations on AWS. This position emphasizes creating reliable, secure, and observable AI systems that seamlessly integrate with enterprise platforms.WHAT YOU'LL DODesign and develop production-grade Agentic AI solutions leveraging LLMs, multi-agent workflows, and RAG pipelines.Implement and enhance Prompt Engineering strategies, including structured prompts, tool-calling, and agent orchestration to ensure reliable and deterministic AI behavior.Build secure backend services and REST APIs in Python, integrating AI agents with enterprise systems through microservices architecture.Establish robust guardrails, including output validation, fallback strategies, rate limiting, safe tool invocation, and human-in-the-loop patterns as necessary.Develop and maintain model evaluation frameworks, encompassing automated prompt testing, retrieval validation, regression testing, and performance benchmarking.Deploy and manage AI services on AWS, utilizing services such as EC2, S3, Lambda, RDS, and containerization through Docker and Kubernetes.Adhere to security best practices, including access control, data protection, audit logging, and secure API design.Ensure strong observability, monitoring, and reliability of AI-driven services in production.Note: This role is primarily in-office, and you will be expected to work from the Santa Clara, CA office as per Everpure's policies, except during PTO, work travel, or other authorized leave.

Mar 12, 2026
Apply
Zeta Global logo
Full-time|$150K/yr - $180K/yr|On-site|San Francisco, California, United States

WHO WE ARE Zeta Global (NYSE: ZETA) is an innovative AI-Powered Marketing Cloud that integrates cutting-edge artificial intelligence (AI) with vast consumer insights to streamline the process for marketers to acquire, nurture, and retain customers more effectively. Our flagship Zeta Marketing Platform (ZMP) aims to simplify advanced marketing by merging identity, intelligence, and omnichannel activation into one cohesive platform, supported by one of the industry's most extensive proprietary databases and AI capabilities. Our enterprise clients, spanning various industries, are empowered to deliver tailored experiences to consumers on an individual basis across all channels, resulting in improved outcomes for their marketing initiatives. Founded in 2007 by David A. Steinberg and John Sculley, Zeta Global is headquartered in New York City, with offices worldwide. For more information, visit www.zetaglobal.com. ROLE SNAPSHOT We are seeking a proactive Agentic AI Engineer to develop innovative bidder-adjacent agents that enhance campaign performance through RAG and tool-using workflows within a closed-loop ACE (Observe → Reason → Act → Evaluate) framework. This position diverges from traditional roles focused solely on model training and deployment; instead, it emphasizes agentic decision-making, evaluation, and safety within a fast-paced AdTech environment.

Mar 19, 2026
Apply
airtable logo
Full-time|$177K/yr - $278.1K/yr|Remote|Remote - US

Airtable is a revolutionary no-code app platform that empowers individuals closest to the work to rapidly enhance their key business processes. With over 500,000 organizations relying on Airtable, including 80% of the Fortune 100, we are transforming the way work is accomplished.We are seeking an AI Agent Architect for Customer Experience to lead the technical framework that underpins our AI-driven customer support experience. In this role, you will design and refine the reasoning, retrieval, decision-making, and actions of our AI agents, establishing the knowledge systems, decision logic, and safety measures necessary for dependable, scalable AI solutions. This position demands a profound understanding of large language models and practical experience with AI agent architectures, alongside close collaboration with Engineering on production systems.

Feb 20, 2026

Sign in to browse more jobs

Create account — see all 35,642 results

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.