About the job
This position offers flexible work options: Office, Hybrid, or Remote within the UK
At HubSpot, we are dedicated to equipping businesses with state-of-the-art AI technologies, and our AI Infrastructure group plays a pivotal role in this mission. We are looking for a Staff Software Engineer who is passionate about infrastructure and improving the developer experience to join our dynamic AI Serving team. This team is responsible for managing HubSpot's end-to-end model inference and serving infrastructure, ensuring that AI models are deployed reliably, scaled appropriately, and remain cost-effective across various environments, while also serving as the cornerstone for modern Python development at HubSpot.
The AI Serving team is in charge of the frameworks and libraries that facilitate synchronous, asynchronous, and offline inference, including model deployment pipelines, autoscaling, and resource management for both GPU and CPU. Our roadmap is focused on enhancing batch inference reliability and efficiency, advancing model observability, and optimizing AI infrastructure costs. Additionally, we are the custodians of essential Python libraries and tools within HubSpot.
As a Staff Software Engineer on the AI Serving team, your responsibilities will include:
- Developing and deploying production-level code that directly enhances AI capabilities across HubSpot, serving as a crucial component for user and business impact at scale.
- Driving the advancement of our model serving and inference infrastructure, with an emphasis on reliability, scalability, and cost efficiency.
- Setting the technical direction for deploying and operating ML models at scale, influencing decisions on architecture, cost management, and developer experience.
- Collaborating closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving processes.
- Gaining in-depth exposure to a variety of HubSpot infrastructure systems by building and maintaining core Python libraries, providing an excellent opportunity to understand HubSpot's operations in detail.
- Engaging with HubSpotters across the organization, from engineering and product to design, research, marketing, and sales, to gain insights into how HubSpot functions as a business.
- Being encouraged to bring your authentic self to work and to choose a work style and location that enables you to perform at your best, whether that be from home, in an office, or a combination of both.
We are not solely seeking engineers with extensive experience; we are looking for individuals who have demonstrated unique excellence, leadership qualities, and the ability to uplift those around them.
