companyHubSpot logo

Staff Software Engineer, AI Serving (AI Infrastructure)

HubSpotFlex - Dublin, Ireland
Hybrid Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

To excel in this role, candidates should possess the following:Proven experience in software engineering, particularly within infrastructure or AI serving environments. Strong programming skills in Python and Java. Excellent problem-solving abilities and a passion for improving developer experiences. Experience with model serving frameworks and libraries. Ability to work collaboratively in cross-functional teams. Strong communication skills and a desire to contribute to a dynamic team.

About the job

POS-22139

This role can be Office/Hybrid/Remote based within Ireland

HubSpot is leading the charge in empowering businesses through innovative AI technology, and our AI Infrastructure group is pivotal to this mission. We are on the lookout for a Staff Software Engineer who possesses a strong passion for infrastructure and enhancing developer experiences to become a vital member of our AI Serving team. This team is responsible for the end-to-end management of HubSpot’s model inference and serving infrastructure, ensuring that our AI models are deployed reliably, scaled efficiently, observed meticulously, and operated in a cost-effective manner across all hublets and environments. Moreover, this team is the home for modern Python practices at HubSpot.

Our team oversees the serving frameworks and libraries that facilitate synchronous, asynchronous, and offline inference, as well as model deployment pipelines, autoscaling, and resource management for both GPU and CPU. Our roadmap is focused on enhancing the reliability and efficiency of batch inference, improving model observability, and scaling our AI infrastructure in a cost-effective manner. Additionally, we are the custodians of core Python libraries and tools across HubSpot.

As a Staff Software Engineer on the AI Serving team, you will:

  • Develop and deploy production code that directly powers AI functionalities across HubSpot, serving as a critical component for impactful user and business outcomes at scale.
  • Lead the advancement of our model serving and inference infrastructure, enhancing reliability, scalability, and cost-efficiency.
  • Establish the technical direction for deploying and operating ML models at scale, guiding architectural decisions, cost optimizations, and developer experience enhancements.
  • Collaborate closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving processes.
  • Gain extensive insight into various HubSpot infrastructure systems by building and maintaining core Python libraries, offering an exceptional opportunity to understand HubSpot's inner workings.
  • Work alongside HubSpotters across different functions including engineering, product, design, research, marketing, and sales, while gaining a broader understanding of how HubSpot operates as a business.
  • Be empowered to express your authentic self and choose a work style and location that allows you to perform at your best, whether from home, in an office, or a combination of both.

We are not solely seeking engineers with extensive experience; we value engineers who have demonstrated unique excellence, leadership, and the ability to elevate those around them.

Our primary programming languages include Python and Java, but a variety of experiences are welcomed.

About HubSpot

HubSpot is a cutting-edge technology company dedicated to empowering businesses with innovative AI solutions. Our AI Infrastructure group plays a crucial role in this mission, focusing on creating scalable, efficient, and reliable AI systems that drive significant business impact.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.