Senior Engineer: Inference Data Plane at digitalocean98 | San Francisco

Redpanda Data is building the Agentic Data Plane (ADP), a platform that connects AI agents with enterprise data and systems. The ADP supports real-time, autonomous reasoning and action by agentic applications, powered by Redpanda's multi-modal data streaming engine. Major organizations across industries, including Activision Blizzard, Cisco, Moody's, Texas Instruments, Vodafone, and two of the top five U.S. banks, rely on Redpanda to process hundreds of terabytes of data every day. Backed by investors such as Lightspeed, GV, and Haystack VC, Redpanda operates as a globally distributed, people-first company. Role overview The Principal Software Engineer will architect and develop the Agentic Data Plane, which serves as the control and execution layer for AI agents interacting with enterprise data. This system enables agents to access, analyze, and act on data in real time, while providing human operators with oversight and control for secure operations. The ADP brings together Redpanda's low-latency streaming technology, a distributed query engine for real-time context, a library of over 300 data connectors, and a global policy and observability framework. This framework enforces access controls, records agent actions, and supports replayable audits. What you will do Design and build the core architecture of the Agentic Data Plane, focusing on secure and efficient data interaction for AI agents. Integrate streaming, query, and policy enforcement components to support real-time, autonomous agent operations. Monitor developments in the agentic AI field and translate research into engineering proposals and product strategies. Work closely with Engineering, Product, and Go-To-Market teams, as well as key customers, to shape the direction of the ADP.

Join DigitalOcean as a Senior Engineer 2 specializing in Inference Data Plane, where you'll play a pivotal role in enhancing our data processing capabilities. You will work alongside a talented team to design, implement, and optimize systems that facilitate efficient inference operations. Your expertise will contribute to building scalable solutions that empower developers and organizations to harness the cloud effectively.

About the Role Crusoe is seeking a Software Engineer focused on the Control Plane to help build and improve control systems. This position is based in San Francisco, CA. What You Will Do Develop and refine software that powers Crusoe's control systems Work closely with teammates to solve complex technical challenges Contribute ideas and code to projects that drive the platform forward Who We’re Looking For Experience building or maintaining control plane software Comfort working in a collaborative setting Interest in tackling sophisticated software engineering problems If you enjoy building systems and want to make an impact on Crusoe’s technology, this role offers the chance to work with a dedicated team on meaningful projects.

Join Sentry as a Senior Software Engineer specializing in the Control Plane, where you will play a pivotal role in enhancing our platform's capabilities. You'll collaborate with a talented team of engineers to design, develop, and maintain high-performance systems that empower developers to monitor and fix crashes seamlessly.

At Crusoe, our mission is to accelerate the proliferation of energy and intelligence. We're developing the technology that enables ambitious AI-driven creations without compromising on scale, speed, or sustainability.Join us at the forefront of the AI revolution with sustainable technology. Here, you will lead innovative initiatives, make a significant impact, and work with a team that is pioneering responsible and transformative cloud infrastructure.Role Overview:We are on the lookout for a Senior Engineering Manager for Data Plane Systems, who will spearhead the team accountable for high-performance Software Defined Networking (SDN) data planes across hosts and Data Processing Units (DPUs). In this hands-on senior leadership capacity, you will be responsible for the architecture, implementation, and operational management of a hardware-accelerated networking stack tailored for large-scale GPU workloads, with a focus on rapid feature deployment from commit to production.Key Responsibilities:Technical Leadership: Define the strategic roadmap for SDN data plane systems and guide the integration of DPUs (like NVIDIA BlueField) and hardware accelerators.Architecture & Optimization: Oversee the development of Linux kernel networking components, XDP/eBPF data paths, and DPDK-based fast paths while driving the transition of networking functions to hardware offload architectures.Operational Excellence: Lead performance benchmarking, regression prevention, and incident response, ensuring we meet our operational goals within 3-6 month cycles.Team Development: Mentor and cultivate a high-performing team of senior and staff-level systems engineers, setting technical standards and nurturing a culture of accountability.Collaboration: Work closely with control-plane teams (OVN/OVS) to enhance throughput and latency for multi-tenant GPU clusters.

At ZoomInfo, we are committed to accelerating careers. We foster a dynamic environment where innovation thrives, empowering you to produce your best work. Our team is dedicated, supportive, and celebrates victories together. With cutting-edge tools that amplify your contributions and a culture that nurtures your ambitions, you'll not only make an impact but also drive change swiftly.As a Principal Software Engineer on our Advertising, Company Intelligence, and Intent team, you will play a pivotal role in designing and implementing the foundational systems that drive our real-time marketing platform. You will work on high-throughput ad infrastructure, large-scale identity resolution, and intelligent systems enhanced by large language models (LLMs), pushing the boundaries of scalability, intelligence, and speed to achieve significant business outcomes.You will join a team engaged in a variety of ambitious and technically challenging projects—from APIs processing tens of billions of events daily to innovative buyer intent algorithms powered by LLMs and a unified B2B identity graph. Your strengths and interests will guide your assignment to initiatives where your impact can be maximized.This role is situated in a high-growth, high-ownership environment at the forefront of modern software engineering, data infrastructure, and applied AI.

Employee Applicant Privacy NoticeWho We Are:Join us in shaping a brighter financial future. At SoFi, we are revolutionizing the way individuals engage with personal finance, using innovative, mobile-first technology to empower millions of members to achieve their financial goals. As a next-generation financial services company and national bank, we are proud to be at the forefront of an industry undergoing unprecedented transformation, ensuring that our core values guide us in making a direct impact on people's lives. Invest in yourself, your career, and the financial world with us.The RoleWe are on the lookout for a seasoned engineering leader with a strong background in developing customer-facing AI agents to help us redefine the financial guidance experience for over 10 million SoFi members.This pivotal role is key to our mission of becoming the most trusted guide in helping our members Get Their Money Right. As a Principal Engineer, you will craft the architecture and technical strategy for our financial guidance agent, leading its implementation across diverse workstreams.You will collaborate across various teams, including engineering, product, data science, design, and business, to develop a scalable AI Agent that provides personalized, reliable, and actionable financial guidance at scale.What You’ll DoDefine and execute the technical strategy and architecture for the AI Agent for Members, leading cross-team system design.Establish evaluation strategies and implement systems to assess, monitor, and enhance AI agent quality and reliability.Ensure the quality, reliability, observability, safety, and compliance of the AI Agent within a regulated environment.Collaborate closely with product, data science, design, and business leaders to transform product visions into scalable systems.Mentor and guide senior engineers and technical leads, fostering engineering excellence throughout the organization.

Join Cloudflare as a Principal Systems Engineer, Data, where you will lead innovative projects that enhance our data processing capabilities. You will work collaboratively with cross-functional teams to design, implement, and optimize systems that efficiently handle large-scale data. This role requires a deep understanding of systems engineering principles, strong analytical skills, and a passion for leveraging data to drive decisions. Your contributions will be pivotal in shaping the future of our data infrastructure.

Join Cloudflare as a Principal Software Engineer specializing in Resiliency, where you will play a pivotal role in enhancing our systems' robustness and availability. Your expertise will contribute to building and maintaining resilient infrastructure that supports our global network, ensuring our customers receive uninterrupted service.In this role, you will work alongside a talented team of engineers to identify vulnerabilities, implement solutions, and innovate new strategies that enhance system performance and reliability. If you are passionate about software engineering and system resiliency, we invite you to apply!

Scale GP is at the forefront of enterprise Generative AI, offering cutting-edge APIs and infrastructure for knowledge retrieval, inference, evaluation, and intelligent automation. We empower critical workflows for leading enterprises, transforming intricate data and models into dependable, production-ready AI systems. Join our newly formed Agentic Data Products team, dedicated to creating the next generation of agent-powered tools that seamlessly integrate AI into real operational workflows. Our mission is to enable enterprises to unravel their data layers and deploy intelligent systems capable of reasoning, acting, and delivering measurable outcomes. This is a pioneering build team, and we are seeking a highly skilled, product-focused Senior Engineer who thrives in dynamic environments, acts swiftly, and relishes the challenge of constructing new systems from the ground up in collaboration with customers and cross-functional teams. You will partner closely with product managers, forward-deployed engineers, data scientists, and applied AI specialists to transform real-world challenges into scalable, production-ready solutions. If you have a passion for rapid delivery, accountability for outcomes, and enjoy working across the entire stack—from sleek front-end applications to robust distributed backends and LLM integrations—this role is perfect for you.

Join Cloudflare as a Principal Software Engineer specializing in billing systems, where you will play a pivotal role in shaping our payment and invoicing solutions. You will collaborate with cross-functional teams to implement innovative solutions that enhance user experiences and streamline processes. If you're passionate about building scalable software and want to contribute to a fast-paced, innovative environment, we want to hear from you!

ABOUT THE ROLE:As an AI Engineer at Varick, you will take charge of designing and optimizing the intelligence layer within our enterprise operations. This involves creating agent systems that efficiently handle thousands of transactions, make classification decisions, and learn from human interactions.This position is suited for engineers with extensive experience in LLMs, agent architectures, and evaluation systems. You have successfully developed agent workflows that operate in production, not merely in demo environments. Your expertise includes prompt engineering, retrieval, tool calling, multi-agent orchestration, and the evaluation frameworks necessary for deploying trustworthy AI systems in enterprise settings.WHAT YOU'LL DO:• Design and implement agent architectures that tackle complex enterprise workflows, focusing on multi-step reasoning, tool calling, and exception handling.• Develop and sustain evaluation systems that ensure agent quality, accuracy, safety, and groundedness.• Create robust prompt systems, retrieval pipelines, and context engineering strategies to ensure reliable agent performance.• Establish feedback loops that empower agents to learn from human corrections and enhance their functionality over time.• Optimize inference costs and latency for production workloads to ensure efficiency.• Define and uphold best practices for agent reliability, observability, and governance.• Stay updated with the latest models, frameworks, and research to ensure impactful deployments into production.WHAT WE'RE LOOKING FOR:• At least 3 years of software engineering experience, with a minimum of 1–2 years dedicated to LLM applications or AI systems in a production environment.• Practical experience in constructing agent workflows featuring tool calling, retrieval, and multi-step reasoning.• A profound understanding of prompt engineering, context engineering, and methods to elicit reliable behavior from LLMs.• Experience in developing evaluation systems to assess AI output quality.• Proficient in Python with a solid foundation in backend engineering principles.• You have delivered AI features to actual users and have navigated challenges such as hallucinations, edge cases, accuracy drops, and cost management.• Must be based in San Francisco.

Join Discord, a platform that connects over 200 million users every month primarily through gaming. With over 90% of our users engaged in gaming activities, we facilitate over 1.5 billion hours of gaming conversations, enhancing the experience before, during, and after gameplay.The Infrastructure organization at Discord is fundamental to our user experience. We handle the real-time delivery of over 40 million events per second and manage the storage of trillions of messages, ensuring robust connections among our vast user base. As a Principal Engineer, you will play a pivotal role in guiding our infrastructure teams, shaping our technical vision, and maintaining the reliability of Discord at a massive scale.This position is ideal for a professional who excels at the intersection of advanced technical skills and organizational leadership. You will contribute to our infrastructure roadmap, address our most challenging technical dilemmas, and ensure our systems can efficiently scale to accommodate the next wave of users.

Principal Software Engineer Saviynt offers an AI-driven identity platform that effectively manages and governs access permissions for both human and non-human entities across all organizational applications, data, and processes. Our clients rely on Saviynt to protect their digital assets, enhance operational efficiency, and lower compliance expenses. Designed for the age of AI, Saviynt is at the forefront of helping organizations safely advance their AI deployments and utilization. As a recognized leader in identity security, we provide solutions that empower and protect some of the world’s leading brands, Fortune 500 companies, and government institutions. For more details, please visit www.saviynt.com. Role Summary In this pivotal role, you will provide technical leadership and extensive knowledge in complex engineering domains, guiding architectural decisions while ensuring scalability, reliability, and quality across key platform components. As a Principal Engineer, you will act as a technical authority, mentor senior engineers, and tackle the most intricate technical challenges. The Connectors team plays a crucial role in facilitating seamless integrations between Saviynt's Identity Governance platform and a multitude of enterprise applications by developing and maintaining robust, scalable connector frameworks. We are committed to ensuring reliable data synchronization, provisioning, and lifecycle management across diverse external systems, forming a vital foundation for the entire platform. What You Will Be Doing ● Design and architect scalable, high-performance connector frameworks for enterprise application integrations.● Define technical standards, best practices, and design patterns for connector development.● Drive architectural decisions for complex integration scenarios involving over 200 enterprise applications.● Evaluate and recommend new technologies, tools, and frameworks to enhance connector reliability and performance.● Lead technical design reviews and provide guidance on system architecture and design trade-offs.

Join Cloudflare as a Principal Software Engineer, where you will play a pivotal role in designing and implementing innovative software solutions. You will collaborate with cross-functional teams to enhance our platform's scalability, security, and performance, making a significant impact on our global user base.

About the TeamOpenAI’s B2B Engineering team is committed to delivering our advanced technology to the world through our developer platform and enterprise products. We develop robust backend systems, APIs, and infrastructure that empower developers and organizations to leverage OpenAI's capabilities in production environments.Our expertise encompasses distributed systems, data infrastructure, platform services, and enterprise-grade features such as security, compliance, authentication, and reliability. We collaborate closely with product, research, design, infrastructure, and forward-deployed teams to transform pioneering AI functionalities into scalable and dependable products.About the RoleWe are seeking a Principal Software Engineer to architect and scale the systems that drive our developer and enterprise-facing products. You will take charge of the design for backend services and platform capabilities that safely and reliably integrate new AI functionalities into production at a global scale.This position covers a wide technical landscape, including distributed systems, APIs, databases, data pipelines, and secure enterprise infrastructure. You will play a pivotal role in shaping both the technical architecture and the product experience of our platform, maintaining high standards for performance, safety, reliability, and API design.ResponsibilitiesDesign, implement, and scale backend services, APIs, and infrastructure supporting OpenAI’s developer and enterprise products.Lead the architectural design of distributed systems, databases, and data pipelines that handle large-scale, high-reliability production workloads.Own key platform capabilities from initial technical strategy and design through implementation, launch, and ongoing operation.Carefully shape API design, treating interfaces as core product touchpoints while ensuring a top-notch developer experience.Create secure, reliable, and compliant systems that cater to both enterprise and developer needs.Work closely with product, research, design, infrastructure, and forward-deployed engineering teams to deploy new capabilities into production.Steer technical direction across complex challenges, making sound architectural trade-offs to balance speed, quality, and maintainability.Enhance engineering productivity by developing internal tools, platform abstractions, and systems that amplify efficiency across the organization.

About UsAt Sierra, we are pioneering a transformative platform designed to empower businesses to cultivate enhanced, more human-centric customer experiences through the power of AI. Headquartered in San Francisco, we proudly maintain a collaborative in-person culture, with expanding offices in Atlanta, New York, London, France, Singapore, and Japan.Our operations are rooted in a set of core values that shape our culture and guide our actions: Trust, Customer Obsession, Craftsmanship, Intensity, and Family. These principles form the bedrock of our endeavors, and we are unwavering in our commitment to embody them in every aspect of our work.Our co-founders, Bret Taylor and Clay Bavor, bring a wealth of experience to Sierra. Bret, who serves as Board Chair of OpenAI, has previously held leadership roles as co-CEO of Salesforce and CTO of Facebook, while Clay boasts an 18-year tenure at Google, where he led innovative projects including Google Lens and Project Starline.Your RoleAs a key member of our dynamic full-stack data team, you will play a pivotal role in enhancing the intelligence of our AI agents with each interaction. You will be instrumental in developing real-time data pipelines, analytics tools, and deep personalization frameworks that convert millions of conversations into actionable business insights. Your responsibilities will encompass:Data Foundations: Design and construct our foundational platform capable of efficiently managing data at scale with minimal latency. This includes developing our real-time eventing infrastructure, streaming and batch ETL pipelines, and an Iceberg-based data lakehouse. You will take ownership of interactive OLAP querying systems, orchestration processes, and experimentation frameworks, ensuring our data remains reliable, rapid, and user-friendly across the organization.Memory & Personalization: Drive the evolution of intelligent experiences by building systems for long-term agent memory, crafting reusable Customer Data Platform (CDP) components, and implementing optimization loops that enable our agents to tailor interactions, significantly enhancing business outcomes.What We’re Looking ForWe are eager to connect with candidates who possess substantial expertise in one or more of the following areas:Platform EngineeringDemonstrated experience in designing and developing scalable data architectures.

ABOUT THE ROLE:As a Full Stack Engineer at Varick Agents, you will play a pivotal role in developing the foundational infrastructure and product interfaces that drive our agent deployments. While this position is not client-facing, your contributions will ensure that each deployment is executed with enhanced speed, reliability, and consistency.This dynamic role requires you to engage with backend services, APIs, data pipelines, and user interfaces. Your responsibilities will include creating the orchestration layer for agent execution and developing the dashboards and controls utilized by clients, ensuring that every line of code you write supports real enterprise operations.WHAT YOU'LL DO:Develop and manage backend services for agent orchestration, tool activation, and workflow execution.Design and implement product interfaces for agent monitoring, human-in-the-loop controls, and client dashboards.Construct data pipelines that integrate with various enterprise systems such as ERPs, CRMs, and data warehouses.Create internal tools that expedite deployment processes and minimize engineering time for individual clients.Ensure the reliability, observability, and performance of production systems.Collaborate closely with Frontend Developers to transform client-specific solutions into reusable platform capabilities.WHAT WE'RE LOOKING FOR:At least 3 years of experience in software engineering, specifically in building production systems.Strong understanding of backend fundamentals including APIs, databases, cloud infrastructure, and distributed systems.Proficiency in full stack development, capable of creating both backend services and the UI that interfaces with them.Production experience with Python.Familiarity with cloud infrastructures such as AWS, GCP, or Azure, including containers, managed databases, and CI/CD practices.A commitment to code quality, testing, and the deployment of stable solutions.HELPFUL EXPERIENCE:Experience integrating with enterprise systems (REST/SOAP APIs, webhooks, ETL pipelines).Knowledge of large language model APIs and agent frameworks.Frontend development experience with technologies like React or Next.js.Experience with Infrastructure as Code tools like Terraform or Pulumi.Background in building multi-tenant SaaS or platform products.Experience in startup or early-stage environments.WHY VARICK:Join an innovative team at Varick Agents where you can make a significant impact through your engineering expertise.

About GustoAt Gusto, our mission is to empower the small business economy. We tackle essential services like payroll, health insurance, 401(k)s, and HR, allowing business owners to concentrate on their passion and their customers. With teams in Denver, San Francisco, and New York, we proudly support over 400,000 small businesses across the nation, while fostering a workplace that reflects and honors the diverse customers we serve. Discover more about our Total Rewards philosophy.About the Role:We are seeking experienced engineers to join our teams focused on enhancing core platform capabilities, optimizing existing systems for scalability, and shaping the future of Gusto's Payroll and Tax systems. As a Principal Software Engineer, you will lead projects from inception to completion, influencing initial feature specifications, optimizing systems towards desired outcomes, executing projects, and maintaining the code that underpins key user experiences. If you are passionate about developing sophisticated software that has a significant impact on the modern economy, we invite you to join us!About the Team:The Payroll team is the core of Gusto’s operations. The Pay Group teams (responsible for payroll and tax) oversee the product, operational, and service aspects that Gusto utilizes to onboard clients, process payroll, calculate taxes and deductions, pay and file with tax authorities, and ensure compliance on behalf of our clients. This domain is intricate and offers opportunities to engage in system design that simplifies processes for both internal and external customers.Sub-Teams:Tax Accuracy: This group is responsible for gathering and maintaining the essential information required to ensure timely and accurate tax payments and filings for our clients, consisting of multiple teams covering various aspects of the process.Ledger: This team is developing a payroll ledger to monitor accrual accounting for payroll-related monetary movements, beginning to support the payroll domain, risk management, payments, and accounting.Engine: This team collaborates closely with the payroll compliance team to facilitate compliant payroll processes, such as minimum wage adjustments and regular pay rates.