Senior Software Engineer – AI Infrastructure

Role overview As a Senior Software Engineer focused on AI Infrastructure at jobgether, the main responsibility is to shape and support the technical foundation for the company’s AI initiatives. The work involves both creating new systems and refining current technology to help meet evolving business objectives. What you will do Design and develop infrastructure that enables AI systems to operate efficiently and reliably Maintain and enhance existing AI technology stacks to ensure ongoing performance and scalability Apply technical expertise to solve complex engineering problems related to AI infrastructure Work environment This position is based in Canada and involves working closely with a collaborative team. The role provides opportunities to engage with advanced technologies in support of the company’s AI goals.

Join Thumbtack as a Software Engineer specializing in AI/ML Infrastructure. In this role, you will contribute to the development and enhancement of innovative AI and machine learning solutions that empower our platform. We are looking for a proactive and collaborative team member who is passionate about technology and eager to tackle complex challenges.

Role overview Veeva Systems is hiring a Senior Software Engineer focused on infrastructure in Toronto, Canada. This role centers on designing and building software that supports and improves our cloud-based platforms. The work directly impacts scalability and performance across our systems. What you will do Design and implement software solutions for infrastructure needs Work closely with teams from different disciplines to strengthen our cloud platforms Contribute to projects that improve system scalability and performance

As a Senior Infrastructure Software Engineer at Afresh Technologies, you will play a crucial role in enhancing our infrastructure to support cutting-edge software solutions. You will collaborate with cross-functional teams to design, implement, and maintain scalable systems that improve our operational efficiency and reliability.

Huawei Canada's Distributed Scheduling and Data Engine Lab in Markham has contributed to Huawei Cloud's technical growth since 2014. The team specializes in cloud-native databases, intelligent SQL engines, AI and agent infrastructure, and evaluating large language models. Close collaboration with industry experts shapes both new product development and the continuous improvement of cloud platforms. Role overview The Senior Engineer - Cloud AI Infrastructure role focuses on building and refining infrastructure to support AI and agentic workloads. This position blends research, systems engineering, and product delivery to advance cloud AI capabilities. What you will do Develop infrastructure for AI and agent workloads, combining technical research with hands-on engineering. Track trends in large language models, agentic AI, and multi-step agent workflows to inform infrastructure decisions. Identify and address performance bottlenecks related to GPU/NPU usage, data transfer, memory management, and distributed execution. Design and implement system-level architectures for agent execution, multi-model orchestration, and large-scale inference. Evaluate and optimize AI workload requirements on cloud and hybrid environments, balancing cost, performance, and scalability. Analyze the infrastructure stack, including distributed schedulers, inference pipelines, caching, and data access patterns. Work with engineering and product teams to prototype and deliver solutions based on research findings. Translate emerging AI trends and workload patterns into scalable infrastructure designs. Location Markham, Ontario, Canada

Role Overview Veeva Systems Inc. is looking for a Senior Software Engineer focused on Infrastructure in Toronto, Canada. This role centers on designing, building, and improving infrastructure that supports our software products. What You Will Do Create and refine infrastructure solutions to support application development and deployment Work with teams across engineering, operations, and product to strengthen system reliability and performance Address scalability and security needs as our technology evolves Impact Your work will help shape Veeva’s technology foundation and support the growth of our software applications.

Join Cohere as a Senior Software Engineer, specializing in Agent Infrastructure. In this role, you will lead the design and implementation of robust software solutions that enhance our agent infrastructure capabilities. Collaborate with cross-functional teams to drive innovation and optimize our systems for performance and scalability.

Join Huawei Canada as a Principal Software Engineer and be a part of our innovative team!About Us:Founded in 2014, the Distributed Scheduling and Data Engine Lab serves as Huawei Cloud’s technology innovation hub in Canada. This lab is dedicated to pioneering advanced cloud technologies, facilitating the productization and ongoing refinement of our technological breakthroughs. Our research spans various domains, including cloud-native databases, resource scheduling and prediction, middleware solutions, media engines, and user experience enhancements. We cultivate a dynamic technical environment that encourages collaboration with industry specialists to develop a competitive cloud platform. We are currently seeking a Principal Software Engineer to join our team.Job Responsibilities:Integrate AI frameworks with cloud infrastructure, optimizing the end-to-end architecture for AI inference and fine-tuning scenarios, with a focus on enhancing observability, reliability, and performance of AI services.Collaborate with team members to design and build concept prototypes, validating optimization strategies to ensure their effectiveness.Work closely with the product team to support prototype development, ensuring alignment with product constraints and requirements.

Role Overview Veeva Systems is looking for a Senior Software Engineer focused on Infrastructure in Ottawa, Canada. This role centers on designing and building infrastructure solutions that underpin Veeva’s software products. Collaboration with cross-functional teams is a key part of the job, with an emphasis on improving system performance and scalability.

Join Mechanical Orchard, a pioneering company dedicated to transforming the most essential and complex business applications—the backbone of today's digital world. We specialize in modernizing these applications, ensuring they can swiftly adapt to market challenges and opportunities.Our innovative approach is born from years of observing the common pitfalls in modernization projects. We aim to mitigate risks and disruptions through our Generative AI platform, Imogen, which leverages cutting-edge data engineering, compiler, and LLM-based techniques to deliver unparalleled solutions in the industry.With a strong foundation in software development and a reputation for influencing the industry, we've contributed significantly to the evolution of Agile practices, including XP. We apply the same level of thoughtfulness and rigor in integrating AI where it brings real value. Our core values focus on doing the right thing, achieving effective outcomes, and fostering kindness within our teams.Together, we are bringing relief to overwhelmed IT teams and witnessing how our expertise and innovative technologies can radically enhance the way organizations operate and innovate. If you share our passion for excellence and collaboration, we welcome your application!

Elevate Your Career with Loopio! At Loopio, we are searching for a visionary Senior Engineering Leader to spearhead our Site Reliability Engineering (SRE), Infrastructure, and MLOps teams. In this pivotal role, you will architect the foundation of reliability, scalability, and cost efficiency for our platform's systems.You will guide teams responsible for designing, building, and operating our production infrastructure, ensuring our services remain resilient, observable, and primed for expansion as we incorporate cutting-edge AI and automated workflows. Collaborating closely with Product Engineering, Security, and Data teams, you will facilitate rapid, secure delivery while upholding operational excellence.Note: This position is an existing vacancy within our team. Key ResponsibilitiesLeadership & Team DevelopmentLead and nurture multiple teams across SRE, Cloud Infrastructure, and MLOps.Mentor engineering managers and senior contributors, cultivating a culture of ownership and high standards.Foster a 'Platform-as-a-Product' mindset, ensuring infrastructure and ML tools empower the wider engineering organization.Collaborate with Recruiting to attract and retain top-tier talent in the areas of cloud, reliability, and machine learning infrastructure.Reliability & Operational ExcellenceOversee the operational health of production systems, focusing on availability, latency, and durability.Define and refine SLIs, SLOs, and error budgets to promote data-driven reliability decisions.Lead incident response efforts, championing blameless postmortems and systemic improvements to minimize

As the Manager of Data Infrastructure, you will report directly to the Director of Data Engineering and spearhead a team of 5-6 engineers responsible for operating essential data platforms that fuel our AI and analytics initiatives. This newly established, hands-on leadership position blends technical expertise with personnel management, requiring you to mentor your team, promote agile methodologies, and incorporate product-focused thinking into infrastructure management. You will implement our data strategy while ensuring operational excellence across platforms that handle billions of transactions monthly. We embrace a Flexible First work model, allowing this role to be performed remotely within the provinces of Ontario and British Columbia. Quarterly travel to the United States will be necessary. We are excited for you to potentially join our team!

Join Us in Revolutionizing the Grocery SectorAt Instacart, we believe that food brings people together. Our mission is to ensure everyone has access to the groceries they love while providing them with more time to savor those moments. What may seem like a simple grocery delivery service to some is, for us, an intricate web of opportunities to meet the diverse needs of our community. We are dedicated to delivering an essential service that our customers depend on for their groceries and household items while also creating safe and flexible earning opportunities for Instacart Personal Shoppers.Instacart has become a vital resource for millions, and we are expanding our team to drive our mission forward. If you're ready to contribute to something impactful and do your best work, we invite you to join our team.Flexibility at InstacartWe understand that there's no one-size-fits-all approach to productivity. Therefore, we provide our employees the freedom to choose their ideal work environment, whether it's from home, a local office, or a favorite café, while maintaining connectivity and community through regular in-person events. Discover more about our flexible work culture.Role OverviewAs a Senior Staff Software Engineer on the Data Infrastructure team at Instacart, you will play a pivotal role in shaping the technical landscape of our data platform, which is crucial for our company's data strategy. You'll be responsible for guiding the architecture roadmap that supports our storage and compute layers, streaming infrastructure, analytics tools, and governance systems. This position is ideal for a strategic thinker with deep technical expertise who can make a significant impact at a company-wide level.You will lead long-term architectural planning for our core data platform, influence major investment decisions, and serve as a thought leader within the engineering community and beyond. Your contributions will directly affect how Instacart scales its decision-making processes and will shape the economic framework of one of the most data-driven tech companies in the grocery sector.

About ClickHouseRanked among the top innovative cloud companies in the 2025 Forbes Cloud 100 list, ClickHouse is rapidly expanding its reach with over 3,000 clients and an annual recurring revenue (ARR) growth exceeding 250% year-over-year. Our expertise lies in real-time analytics, data warehousing, observability, and AI workloads.The company's remarkable progress was recently affirmed with a $400M Series D funding round. In just three months, we've welcomed prominent clients such as Capital One, Lovable, Decagon, Polymarket, and Airwallex, who are either adopting our platform or enhancing their existing implementations. These esteemed clients join a robust lineup of AI trailblazers and global brands like Meta, Cursor, Sony, and Tesla.We are dedicated to revolutionizing how organizations leverage data. Join us on this exciting journey!About the TeamThe Cloud Infrastructure Engineering team is responsible for creating and managing the essential components of the ClickHouse Cloud data plane from end to end. This encompasses compute, networking, security, and a multi-cloud, multi-region architecture to deliver a reliable and scalable managed ClickHouse experience for our customers. We are seeking highly skilled and experienced cloud infrastructure software engineers to design, deploy, and maintain our infrastructure.What will you do?Design and construct a resilient, scalable, and highly available distributed infrastructure.Develop an advanced cloud-native platform leveraging public cloud resources, along with automating our cloud resource management.Collaborate closely with our ClickHouse core database development and security teams to enhance our Software as a Service (SaaS) offerings.Enhance routing and traffic components to boost the reliability and scalability of our cloud services.Consistently improve system availability using industry best practices and distributed systems principles.Design and build security components to protect our infrastructure.

At Vanta, we are dedicated to helping businesses cultivate and demonstrate trust by prioritizing security that is continuously monitored and verified. Our mission empowers companies to enhance their security practices and showcase their commitment effortlessly. Join our supportive and skilled team, where individuals from diverse backgrounds thrive—many have succeeded at Vanta without prior security experience.About the Role:As a key member of Vanta’s Infrastructure & Security team, you will play a vital role in building a robust platform that ensures the scalability, performance, and reliability of our core systems. With our rapidly expanding customer base, we require infrastructure that evolves alongside us, without sacrificing speed or developer efficiency. You'll engage in projects involving distributed systems, infrastructure components, and security upgrades, enabling our engineers to deliver dependable software at scale.Your contributions will significantly impact product engineering across the board. Our initiatives simplify the process for engineers to identify bugs, develop features, and provide value to our clients swiftly and securely.At Vanta, we harness modern frameworks and tools such as TypeScript, React, Node.js, MongoDB, GitHub Actions, and a variety of AWS services like Fargate and ECS to design and develop new product functionalities and infrastructure.If you're excited about the intersection of infrastructure and security, we would love to connect with you.To learn more about our team's work, visit our Vanta Engineering Blog.Your Responsibilities Will Include:Designing and constructing scalable infrastructure to facilitate rapid increases in data volume, service utilization, and engineering productivity.Leading projects concerning our cloud infrastructure, encompassing container orchestration (e.g., AWS Fargate, ECS), monitoring and alerting systems, networking, and database upkeep.Implementing and maintaining essential security infrastructures and controls, including service-to-service authentication, secrets management, application security features (e.g., rate limiting, encryption libraries), and infrastructure hardening.Identifying and resolving intricate security challenges to bolster our systems.

Klue develops competitive intelligence solutions for businesses, with a growing engineering team in Toronto. The Senior Software Engineer, AI, will help shape the next generation of LLM-powered agents and advanced search systems. Role overview This position centers on designing and optimizing backend systems for agentic workflows. The work involves retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning. The goal is to deliver fast, accurate, and reliable search experiences for Klue's clients. What you will do Develop and deploy backend systems that support agentic workflows. Build retrieval pipelines, orchestration layers, and multi-step agent architectures to transform large volumes of competitive data, news, press releases, web updates, Slack, email, reviews, and CRM information, into actionable intelligence. Lead evaluation of agentic systems. Create and maintain automated, offline, and human-in-the-loop evaluation frameworks. Define success metrics and build infrastructure for continuous measurement of relevance, quality, latency, and task success. Design and refine retrieval and ranking systems. Work across hybrid retrieval, re-ranking, query rewriting, and post-retrieval synthesis. Balance trade-offs between BM25, dense retrieval, and hybrid methods to ensure agents provide timely and relevant information. Enhance LLM-powered workflows. Improve prompt design, retrieval strategies, caching, and latency to make agent responses faster, more accurate, and more reliable in production. Prioritize customer-centric development. Connect technical decisions to customer outcomes. Use insights from customer interactions to guide feature prioritization and improvements, adopting an iterative approach and measuring impact. Location This position is based in Toronto, Ontario. Learn more about Klue at klue.com.

We are seeking a highly skilled Senior Software Engineer specializing in Network Router Infrastructure. In this role, you will contribute to the design and development of robust networking solutions that enhance our clients' connectivity and performance. You will collaborate with cross-functional teams to deliver high-quality software that meets customer requirements and industry standards.

Bree serves Canadians who live paycheck to paycheck, focusing on those who need short-term credit solutions. With over 800,000 users, Bree has established a strong presence in the FinTech sector. The company maintains profitability, generates eight-figure annual revenue, and continues to see double-digit monthly growth. Bree has experienced zero voluntary employee turnover. After joining Y Combinator in 2021, Bree raised a $2 million seed round. Role overview The Software Engineer, Infrastructure will work to strengthen the reliability, scalability, and maintainability of Bree's data-driven systems. This position focuses on supporting a growing user base by improving system performance and stability. What you will do Design, build, and maintain infrastructure to support Bree's data systems. Refactor code and improve system architecture to reduce technical debt. Optimize PostgreSQL databases through query tuning, indexing, and capacity planning. Implement Infrastructure as Code using tools such as Pulumi, Terraform, or AWS CloudFormation. Set up monitoring and alerting with tools like Grafana or Datadog. Enhance system observability by improving metrics, logging, and tracing. Requirements Bachelor's degree in Computer Science or a related discipline. Experience building scalable, reliable, and maintainable infrastructure. Strong knowledge of PostgreSQL and hands-on database optimization skills. Familiarity with Infrastructure as Code concepts and tools. Experience with monitoring tools and practices. Location This position is based in Toronto.

Affirm seeks a Senior Staff Software Engineer to join the Consumer Engineering group, focusing on web infrastructure. This remote role is open to candidates based in Canada. What you will do Design, build, and maintain scalable web applications that shape the consumer experience at Affirm. Collaborate with cross-functional teams to enhance and support web infrastructure. Emphasize performance, security, and reliability throughout all projects. Location This position is remote within Canada.

About UsAt Quandri, our mission is to revolutionize the insurance industry, transforming it into a trusted and delightful experience through the power of AI. We provide an innovative AI operating system tailored for North America’s leading insurance agencies and brokerages.What We DoQuandri is reshaping the insurance landscape for policyholders across North America by equipping key industry stakeholders—insurance agencies and brokerages—with cutting-edge AI solutions. As the backbone of the insurance sector, insurance agents face numerous challenges, including consolidation, talent shortages, and increasing operational complexity. Our goal is to empower these agencies to navigate these challenges effectively and operate more efficiently.This transformative opportunity allows us to rethink traditional processes within insurance agencies. At Quandri, we leverage our deep understanding of insurance workflows, systems, and data alongside our advanced technical capabilities and proprietary models to drive real change in the insurance experience.We are dedicated to enhancing the insurance experience for policyholders while enabling brokerages to provide superior client service, accelerate growth, and harness AI to lead the future of insurance distribution.