Qualifications
Your Responsibilities:Lead initiatives to enhance Datadog’s public-facing MCP server, enabling intelligent agents to effectively discover and utilize our services.Design and develop agentic tool interfaces tailored for both evaluation and production across various AI agents.Create and maintain comprehensive evaluation pipelines for assessing agent performance on Datadog workflows, including investigations, incident triage, and metric queries.Analyze and resolve failure cases by scrutinizing tool outputs, refining query parsing, and enhancing feedback mechanisms for agents.Collaborate across Applied AI and internal teams to establish unified standards for tool integration and data access.Your Profile:Proven experience as a Staff-level engineer with a robust background in applied AI, agentic programming, and familiarity with LLM-powered automation pipelines, orchestration frameworks (e.g., LangChain, LangGraph, CrewAI), and agent orchestration systems.Able to thrive in ambiguous and rapidly changing environments; skilled at autonomously defining and prioritizing direction.Expertise in building evaluation frameworks for LLM agents or AI systems, including metrics design and data instrumentation.Bonus: Experience with the MCP standard or contributions to agent-compatible tooling surfaces, along with knowledge of building and evaluating ReAct agentic loops.Strong systems thinking capability, adept at reasoning across multiple agents, tools, and user scenarios.Driven by a passion for advancing agent-augmented software and eager to influence evolving interfaces.
About the job
Join the dynamic MCP team at Datadog, where we are enhancing our MCP Services platform. This innovative interface allows both external agents such as Claude and Cursor, alongside our internal Datadog AI Agents, to seamlessly interact with Datadog data. As a Staff Engineer, you will be instrumental in advancing this agent-friendly toolset, facilitating intelligent workflows across metrics, logs, incidents, and more. You will spearhead the development of sophisticated evaluation frameworks for agentic systems and contribute to pioneering models of agent-tool interaction in a rapidly evolving landscape filled with uncertainty and significant potential impact — a perfect opportunity for someone who is passionate about shaping the future of applied AI at Datadog.
At Datadog, we cherish our collaborative office culture, fostering relationships and creativity. As a hybrid workplace, we empower our Datadogs to cultivate a work-life balance that suits them best.
About Datadog
Datadog is a leading monitoring and analytics platform for developers, IT operations teams, and business users. Our mission is to provide a unified view of the applications and infrastructure that power your business, allowing teams to collaborate effectively and make data-driven decisions. Our vibrant office culture emphasizes collaboration, creativity, and a commitment to employee well-being.