About the job
This role can be Office/Hybrid/Remote based within Ireland
HubSpot is leading the charge in empowering businesses through innovative AI technology, and our AI Infrastructure group is pivotal to this mission. We are on the lookout for a Staff Software Engineer who possesses a strong passion for infrastructure and enhancing developer experiences to become a vital member of our AI Serving team. This team is responsible for the end-to-end management of HubSpot’s model inference and serving infrastructure, ensuring that our AI models are deployed reliably, scaled efficiently, observed meticulously, and operated in a cost-effective manner across all hublets and environments. Moreover, this team is the home for modern Python practices at HubSpot.
Our team oversees the serving frameworks and libraries that facilitate synchronous, asynchronous, and offline inference, as well as model deployment pipelines, autoscaling, and resource management for both GPU and CPU. Our roadmap is focused on enhancing the reliability and efficiency of batch inference, improving model observability, and scaling our AI infrastructure in a cost-effective manner. Additionally, we are the custodians of core Python libraries and tools across HubSpot.
As a Staff Software Engineer on the AI Serving team, you will:
- Develop and deploy production code that directly powers AI functionalities across HubSpot, serving as a critical component for impactful user and business outcomes at scale.
- Lead the advancement of our model serving and inference infrastructure, enhancing reliability, scalability, and cost-efficiency.
- Establish the technical direction for deploying and operating ML models at scale, guiding architectural decisions, cost optimizations, and developer experience enhancements.
- Collaborate closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving processes.
- Gain extensive insight into various HubSpot infrastructure systems by building and maintaining core Python libraries, offering an exceptional opportunity to understand HubSpot's inner workings.
- Work alongside HubSpotters across different functions including engineering, product, design, research, marketing, and sales, while gaining a broader understanding of how HubSpot operates as a business.
- Be empowered to express your authentic self and choose a work style and location that allows you to perform at your best, whether from home, in an office, or a combination of both.
We are not solely seeking engineers with extensive experience; we value engineers who have demonstrated unique excellence, leadership, and the ability to elevate those around them.
Our primary programming languages include Python and Java, but a variety of experiences are welcomed.

