About the job
For over two decades, Smartsheet has been enabling individuals and teams to accomplish remarkable feats. From efficient work management to innovative, scalable solutions, our journey has always been about facilitating flow in work. We’re dedicated to creating tools that allow teams to automate manual tasks, reveal insights, and work more intelligently. More than just functionality, we’re fostering an environment that encourages expansive thinking, decisive action, and the realization of impactful work. When challenges align with purpose, and passion translates into progress, that’s where the real magic happens, and that’s our mission every day.
At Smartsheet, we are pioneering the next wave of AI-driven work management with SmartAssist, our intelligent agent platform. As we transition from initial demonstrations to robust, production-ready agents, maintaining quality is paramount, and we are seeking a dedicated Agent Quality Engineer to spearhead this initiative.
This role transcends traditional QA duties. It is a highly technical, autonomous position positioned at the crossroads of LLM evaluation, prompt and context engineering, and retrieval-augmented generation. You will analyze the reasons behind agent failures, design systems to detect regressions, and drive significant enhancements across our orchestrator and subagent network.
Collaboration will be key as you work alongside our Agent Engineering and AI Platform teams, embedded within a group that has successfully deployed evaluation infrastructure on Databricks/MLflow and is advancing towards a comprehensive Agent Development Lifecycle (ADLC).