About the job
Note: We are excited to facilitate this recruitment for our esteemed client. This position is directly with Arena Intelligence, not People Culture Talent. We look forward to connecting skilled professionals with this remarkable team!
The Role
Arena Intelligence is redefining the landscape for assessing AI model performance in practical applications. Originating from UC Berkeley’s SkyLab, our platform, Arena.ai, has established itself as the benchmark for AI model evaluation, gaining the trust of researchers, developers, and enterprises that are paving the future of artificial intelligence.
Our mission is to create API-driven services tailored for enterprise clients. We aim to deliver premier machine learning products (like Arena Max) that align with their specific business needs.
In this pivotal role, you will be responsible for the foundational infrastructure that transforms our research capabilities into enterprise-ready products. This is a unique opportunity to be part of the developer/enterprise team from the ground up. You will collaborate directly with founders and early customers to shape our offerings.
What You’ll Do
- Develop API-centric products from inception, focusing on creating low-latency, high-reliability APIs for leaderboards, models, and arenas.
- Tackle complex streaming challenges, including handling SSE/streaming responses from diverse providers, ensuring partial failure recovery, mid-stream fallbacks, and consistent response normalization.
- Deliver enterprise-grade infrastructure by implementing expected features such as rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC2 compliance.
- Enhance observability by integrating distributed tracing, latency analysis, token-level usage tracking, and real-time dashboards for comprehensive insights.
- Develop AI-focused products by integrating with our core evaluation platform, Arena data, and customer-specific benchmarks, while collaborating with the research team to evolve innovative concepts into robust products.
- Contribute across the tech stack, particularly in backend development for our Leaderboards and Evals platforms, ensuring a cohesive architecture for our public and private data systems.
What We’re Looking For
- A minimum of 4 years of backend engineering experience, with substantial experience in distributed systems, infrastructure, or developer-centric platforms.
- Proficiency in Go and familiarity with other programming languages.
