Software Engineer, AI Safety

About the TeamThe Safety Systems team at OpenAI is committed to fostering AI technologies that are not only advanced but also safe and reliable. Our mission revolves around addressing emerging safety challenges, leveraging years of alignment work and practical safety efforts to ensure the secure deployment of groundbreaking AI models and future AGI.Discover …

Join Our Team as a Software EngineerAt intrinsic-safety, we are at the forefront of developing AI agents that tackle complex decision-making in risk investigations, fraud detection, and identity verification. Our mission revolves around empowering machines to make the most challenging judgment calls efficiently and accurately.As a dynamic and compact team based in San Francisco, we are addressing challenges that impact billions of transactions and entities. Our clientele includes renowned Fortune 500 companies, global marketplaces, and regulated financial institutions. If you are driven by ownership, quick execution, and collaboration with founders, you will thrive here.

With support from prominent Silicon Valley investors, Peregrine Technologies empowers public safety organizations, state and local governments, federal agencies, and private sector entities to tackle societal challenges with unparalleled speed and precision. Our AI-driven platform transforms isolated and disparate data into actionable intelligence, rapidly presenting critical information that enables improved decision-making and outcomes. Currently, Peregrine serves hundreds of clients across over 30 states and two countries, impacting more than 125 million individuals, as we broaden our reach into enterprise markets and international territories.TeamOur engineering team is deeply committed to the idea that empathy enhances our solutions. Understanding how users interact with our products is fundamental to our approach. Engineers have the unique opportunity to collaborate closely with our onsite team to grasp the diverse use cases that Peregrine addresses.We cherish both ownership and teamwork; you will be fully accountable for significant features while working hand-in-hand with fellow engineers to ensure successful delivery. We believe that humility and empathy are critical for crafting effective solutions, and you will engage directly with our deployment team and users as we refine our offerings to meet their needs. Ingenuity and perseverance are vital in realizing our vision.RoleAs part of our new AI team, you will play a key role in delivering unique value to our clients. This team is responsible for designing powerful and intuitive user experiences powered by generative AI. You will explore entirely new interaction methods for users—whether through natural language commands or by enabling AI agents to manage complex tasks on their behalf. Your contributions will shape impactful AI-driven features that assist customers in solving real-world challenges more efficiently.Your work will encompass a variety of intricate challenges, including scaling our platform to process terabytes of data from multiple sources, efficiently querying and alerting users about this data in real-time, and optimizing search algorithms for swift result delivery.While our technology stack is continuously evolving, it is built on a foundation that includes Python, Django, Celery, Airflow, and Kafka for the backend; React, Redux, and Mapbox for the frontend; PostgreSQL and Elasticsearch for data storage; machine learning models hosted in Bedrock and Sagemaker; and utilizing AWS, Pulumi, Terraform, and Kubernetes for our infrastructure.

Join Lotus Health as an AI Quality & Safety Engineer, where you will play a pivotal role in ensuring the integrity and safety of our AI-driven health solutions. In this dynamic position, you will collaborate with cross-functional teams to develop, implement, and monitor quality assurance processes that uphold our commitment to delivering safe and effective healthcare technologies.

Join Us as a Product EngineerAt Variance, we are at the forefront of teaching machines to navigate complex decision-making processes at scale. Our mission involves developing AI agents designed to combat fraud, scams, and abuse with high precision.Based in San Francisco, our small but highly skilled team is dedicated to solving challenges that impact billions of events and entities. We proudly serve a diverse clientele, including Fortune 500 companies and global marketplaces, as we strive to save millions of hours of human labor. If you excel in environments that demand ownership, speed, and collaboration with founders, you'll thrive here.Who You Are:You possess a deep passion for craftsmanship and have clear opinions about your work.You are familiar with our technology stack: React/Next.js, TypeScript, MySQL, and ClickHouse. However, we prioritize foundational skills over specific technologies.You thrive on owning features from backend development to a polished user interface and deployment.You are excited by the opportunity to create AI interfaces that have the potential to save lives.Your Responsibilities:Deliver end-to-end features with iteration cycles that are measured in hours, rather than months.Expand our product into new sectors and workflows through swift pilots and live demonstrations.Collaborate directly with the founders on large-scale, pioneering challenges.Design systems where AI algorithms make real-time decisions, ensuring a balance between accuracy, speed, and user confidence.Our Culture:We foster a culture of ownership, urgency, and craftsmanship. We encourage spirited discussions, innovative ideas, and creating work we take pride in. Our team operates fully in-person in San Francisco.What We Offer:A competitive salary accompanied by meaningful equity.Comprehensive healthcare options, including platinum-level medical, dental, and vision coverage.Unlimited paid time off (PTO), sick leave, and parental leave.Monthly reimbursement of up to $100 for personal health and wellness expenses.401(k) retirement plan.

About Retell AIAt Retell AI, we are pioneering the future of call centers through innovative voice AI technology. Our cutting-edge solutions are transforming how companies engage with customers.In just 18 months since our inception, we've empowered thousands of businesses with our AI voice agents that efficiently manage sales, support, and logistics calls, significantly reducing the need for large teams of human agents. Supported by industry-leading investors including Y Combinator and Alt Capital, we've grown our annual recurring revenue from $5M to an impressive $36M while expanding our team from 5 to 20 talented individuals since 2025.Our ambitious vision for 2026 is to develop a state-of-the-art customer experience platform where entire contact centers are driven by AI. Unlike basic automation requiring constant human oversight, we’re engineering intelligent AI “workers” capable of serving as frontline agents, quality assurance analysts, and managerial roles, all while optimizing customer interactions continuously.We are rapidly expanding and seeking driven builders who thrive on solving complex technical challenges, act decisively, and wish to make a tangible impact in one of the fastest-growing voice AI startups.Join us in shaping the future!Recognized as a top 50 AI application in the a16z list: https://tinyurl.com/5853dt2xRanked #4 in Brex's Fast-Growing Software Vendors of 2025: https://www.brex.com/journal/brex-benchmark-december-2025Featured among the top startups on: https://leanaileaderboard.com/

Join Twitch as a Software Engineer II for our Safety Team, where you will play a pivotal role in enhancing our platform's security and user experience. In this position, you will collaborate with cross-functional teams to develop and implement innovative safety features that protect our community.

Join Quizlet as a Senior Software Engineer specializing in Trust & Safety, where you will play a crucial role in enhancing the security and integrity of our platform. You will collaborate with cross-functional teams to develop robust software solutions that protect our community and ensure a safe learning environment.

Responsibilities:Develop Our Product. Take ownership of software features that enhance our AI platform, empowering private market investors to analyze deals swiftly and accurately. This role requires you to actively engage in coding and delivering essential platform components from the ground up.Ensure Quality and Excellence. Establish and maintain coding standards, architectural guidelines, and review procedures; mentor fellow engineers. Co-cultivate a culture centered on practical, reliable, and test-driven development that swiftly meets business requirements.Scale for Growth. Assist in monitoring and scaling the architecture of our platform and its infrastructure.Collaborate Across Functions. Engage closely with product, security, and go-to-market teams to translate our strategic roadmap into actionable features and deliverables.

Discord is a vibrant platform with over 200 million monthly active users, primarily used for gaming. More than 90% of our community engages in gaming activities, contributing to an astounding 1.5 billion hours spent on thousands of games via Discord each month. As we look to the future of gaming, we are committed to enhancing the experience for users by facilitating better communication and social interaction before, during, and after gaming sessions.As a Staff Software Engineer on the Safety Experience team, you will take on a pivotal role as a technical leader, driving significant business impact through the autonomous delivery of large and complex projects. Your responsibilities will include designing and building features and systems that mitigate harmful activities while ensuring compliance with regulatory standards. This role demands not only deep technical acumen but also the ability to amplify your team's capabilities by fostering engineering excellence, making informed technical decisions, and contributing actively to code development. You will collaborate across various functions to establish the technical framework for safety initiatives that safeguard hundreds of millions of Discord users. This position reports directly to the Engineering Manager of Safety Experience.

fractional-ai is looking for a Senior or Staff Software Engineer to join the San Francisco office. This position centers on building advanced AI solutions with a team that values both technical depth and collaboration. Role overview This role focuses on designing and developing AI-driven systems. The work involves solving technical challenges and contributing to projects that push the boundaries of what AI can achieve. Collaboration with other engineers and stakeholders is a key part of daily responsibilities. Who will thrive Experienced engineers with a strong background in software development Those who enjoy working on complex technical problems Individuals who value teamwork and open communication Location This position is based in the San Francisco office.

About Simple AIAt Simple AI, we are pioneering cutting-edge voice AI solutions tailored for enterprises. Our lifelike voice agents empower renowned companies such as DoorDash, xAI, and Omaha Steaks in managing diverse phone operations ranging from customer support to order intake and lead qualification. As we experience rapid revenue growth, we seek a couple of founding software engineers to help us meet current customer demands while developing innovative systems for the future. Our team is passionate about harnessing AI to transform the world, and we operate from our San Francisco office five days a week.Simple AI is proudly supported by top-tier investors and industry leaders, including Y Combinator, Massive Tech Ventures, and prominent figures like Michael Seibel (co-founder of Twitch), Jared Friedman (Scribd), Alexandr Wang (Scale AI), Matt Van Horn (June Oven and Lyft), Suhail Doshi (Mixpanel), JJ Fliegelman (WayUp), and Scott Wu (Cognition).Meet the FoundersThe founders, Catheryn Li and Zach Kamran, previously led software teams at Y Combinator, where they launched numerous products for YC founders, including the co-founder matching site. Cat brings experience from Instagram and Facebook and holds degrees in mathematics and computer science from MIT. Zach studied computer science and statistics at the University of Chicago and led software initiatives at PEAK6.What We ProvideCompetitive salary with significant equity opportunitiesEmployee-friendly equity termsOffice located in San FranciscoComprehensive health, dental, and vision insuranceComplimentary lunch and dinner at the officeFree Uber rides home after 8:30 PMRegular team events and offsite activitiesYour Qualifications4+ years of relevant software engineering experience.Exceptional problem-solving skills and a passion for tackling technical challenges.A customer-centric mindset coupled with strong communication skills and a keen interest in product design and prioritization.Self-motivated with the ability to work independently.A genuine enthusiasm for continual learning and keeping abreast of the latest advancements in AI.

fractional-ai is hiring a Software Engineer to join the team onsite in San Francisco. This role centers on building and improving technology that advances artificial intelligence. Role overview As a Software Engineer, you will work closely with others to develop and support projects that drive the company’s AI initiatives forward. The work involves collaborating with colleagues and contributing technical solutions in a team setting. What you will do Develop software for AI-driven projects Collaborate with team members in the San Francisco office Contribute ideas and technical expertise to ongoing initiatives Requirements Interest in technology and artificial intelligence Ability to work onsite in San Francisco Strong motivation to learn and contribute to team projects

Discord is a vibrant platform that connects over 200 million users monthly for a variety of activities, with a significant focus on gaming. With over 90% of our users engaging in gaming, they spend a staggering 1.5 billion hours playing thousands of unique games on Discord each month. Our mission is to enhance the gaming experience by facilitating seamless communication and interaction among players before, during, and after their gaming sessions.We are seeking an experienced Staff Software Engineer to join our dedicated Safety Processing team. This pivotal team is responsible for maintaining trust and safety on Discord by processing signals from user reports and automated systems to identify and eliminate harmful or illegal content. In this role, you will spearhead backend projects, provide architectural insight, and develop scalable systems that effectively protect our users. Your contributions will directly influence the safety of our platform, ensuring that Discord remains a welcoming environment for all. To discover more about our engineering initiatives, visit our engineering blog.

About Our TeamThe Safety Systems Organization plays a crucial role in ensuring the safe deployment of our advanced models in real-world settings, contributing to OpenAI's mission of developing and implementing safe Artificial General Intelligence (AGI). We prioritize AI safety, trust, and transparency, and our work is vital in making a positive impact on society.Our Safety Engineering team is dedicated to creating the platforms and tools that ensure OpenAI’s models are safe for real-world usage. We collaborate closely with researchers, product teams, and policy experts to transform safety concepts into robust, scalable systems: assessing risks, implementing safeguards, and continuously enhancing model performance in live environments. Our efforts sit at the confluence of product engineering, data science, and AI, directly influencing how millions engage with OpenAI’s technologies.About the PositionWe are seeking a proactive Fullstack Engineer who thrives in a dynamic, iterative environment—especially when developing internal tools that drive tangible societal impact. In this role, you will design and implement full-stack solutions for our Safety Systems teams, ensuring the increased safety and reliability of OpenAI’s models, particularly in sensitive areas such as mental health and protections for vulnerable users. Your contributions will enhance our team's ability to quickly identify and resolve safety concerns while also strengthening the feedback loop among policy, data, and model training cycles.Key Responsibilities:Lead the complete development cycle of internal tools aimed at enhancing the safety of OpenAI’s models, with a focus on critical areas such as mental health and vulnerable-user protections.Collaborate closely with researchers, engineers, and model policy developers to identify workflows, challenges, and requirements, translating them into sustainable product solutions.Create full-stack applications that support essential model policy workflows, including data labeling, failure case analysis, and insight generation for iterative development.Enhance internal applications for usability, performance, and scalability, improving team efficiency and reducing resolution time for safety issues.Transform successful AI-assisted safety workflows into externally facing safety products that empower developers to create safer AI, elevate industry standards for AI safety, and prepare society for more advanced AGI.

Role OverviewAt Variance, we are at the forefront of teaching machines to execute high-stakes judgment calls on a large scale. This involves developing AI agents that navigate the complex domains of risk investigations, fraud detection, and identity verifications.Our San Francisco-based team is small yet exceptionally talented, comprising former founders and specialists from leading AI laboratories. We cater to an impressive clientele, including Fortune 500 companies, global marketplaces, and regulated financial institutions. If you are passionate about taking ownership, working swiftly, and collaborating closely with founders, you will thrive in our environment.We are seeking a Security Engineer to help establish a robust security foundation. You will collaborate across product, infrastructure, and internal systems to ensure that Variance is secure by design, enabling us to meet the rigorous standards needed to deploy AI in critical workflows for the world’s largest corporations.

Discord is a vibrant platform utilized by over 200 million users each month for a multitude of reasons, with a significant focus on gaming. A staggering 90% of our users engage in gaming activities, collectively spending 1.5 billion hours playing thousands of unique titles on Discord every month. As we look to the future, Discord is poised to play a pivotal role in enhancing the gaming experience by fostering communication and camaraderie among players before, during, and after their gaming sessions.The Safety Processing team is at the forefront of developing systems that empower Discord to effectively detect, review, and act upon harmful content at scale. Our mission is to build robust infrastructure and decision-making systems that facilitate accurate, efficient, and fair content moderation across the platform. We're on the lookout for a Senior Software Engineer capable of managing intricate, multi-phase projects and delivering high-quality systems that safeguard millions of users on a daily basis.As a Senior Engineer within the Safety Processing team, you will assume full ownership of projects from the initial design phase through to post-launch monitoring and iterative improvements. You will tackle challenging issues that lie at the intersection of automation, large-scale distributed systems, and content safety. Your contributions will include the development of automated decision systems that enhance our review capacity tenfold, the creation of enforcement infrastructure that manages millions of decisions each day, and the architecture of systems that centralize and streamline safety signal processing. Collaboration with Trust & Safety operations, machine learning teams, policy experts, and product partners will be key to delivering solutions that enhance Discord's safety while upholding our commitment to an exceptional user experience. You will create products that users love while maintaining Discord's high quality standards, utilizing an 80/20 mindset and a user-focused approach. We value a growth-oriented mindset and encourage diving into new code and technologies to implement safety solutions that protect our user community.This role presents the opportunity to work on systems that have a direct impact on user safety, address innovative technical challenges in content moderation at scale, and help shape the future of how Discord ensures community safety.

About UsXOXO is an innovative research lab dedicated to crafting intelligent interfaces that enhance everyday life. Our stealth team, composed of passionate engineers, designers, and researchers, is focused on solving unique challenges that go beyond the workplace.With recent advancements in infrastructure, architecture, and model layers, we are actively seeking skilled builders to create the application layer that will actualize our visionary concepts.About the RoleWe are on the lookout for a proficient iOS engineer to lead the development of XOXO’s consumer app, featuring a pioneering interface for intelligence. This position calls for a robust engineer capable of managing the entire mobile surface area, from architecture and performance to refining a visually appealing design system that ensures intentional user interactions.A specific background is not mandatory; what truly matters is your passion for ownership: you take charge, work swiftly without compromising quality, and aspire to create a mobile product that redefines craftsmanship and performance standards.What You’ll DoDesign and launch the initial versions of our React Native app, transitioning it from concept to production.Convert a visually rich design system into reusable components, motions, and interaction patterns with seamless performance.Develop new product interfaces that seamlessly integrate modern AI/ML capabilities in a mobile-friendly manner.Enhance app performance, focusing on rendering, startup, memory consumption, battery usage, and perceived speed.Establish high standards for mobile engineering quality (including testing, monitoring, and release management) while collaborating with various teams to ensure successful delivery.

Discord connects over 200 million users each month for various purposes, but a common theme is the love for video gaming. With over 90% of our users engaged in gaming, collectively spending 1.5 billion hours on our platform each month, Discord is key to shaping the future of gaming. Our mission is to enhance the experience of chatting and socializing before, during, and after gaming sessions.As a Senior Software Engineer on the Safety Experience team, you will play a pivotal role in creating a safer environment for our vast user base. You will spearhead the design, development, and maintenance of features that safeguard users from harmful activities while ensuring compliance with regulations. The work you do is vital for the growth and integrity of Discord, reporting directly to the Engineering Manager of Safety Experience.

About the Role Twitch Interactive, Inc. is looking for a Software Engineer to focus on safety features in our San Francisco office. This role centers on building and improving systems that help protect the Twitch community, while keeping the user experience smooth and reliable. What You Will Do Develop and enhance features that support user safety across the Twitch platform Work closely with teams from different disciplines to design scalable solutions Balance strong safety measures with a seamless experience for streamers and viewers Location This position is based in San Francisco, CA.