Software Engineer, AI Safety

Join Twitch as a Software Engineer II for our Safety Team, where you will play a pivotal role in enhancing our platform's security and user experience. In this position, you will collaborate with cross-functional teams to develop and implement innovative safety features that protect our community.

Join Our Team as a Software EngineerAt intrinsic-safety, we are at the forefront of developing AI agents that tackle complex decision-making in risk investigations, fraud detection, and identity verification. Our mission revolves around empowering machines to make the most challenging judgment calls efficiently and accurately.As a dynamic and compact team based in San Francisco, we are addressing challenges that impact billions of transactions and entities. Our clientele includes renowned Fortune 500 companies, global marketplaces, and regulated financial institutions. If you are driven by ownership, quick execution, and collaboration with founders, you will thrive here.

Join Quizlet as a Senior Software Engineer specializing in Trust & Safety, where you will play a crucial role in enhancing the security and integrity of our platform. You will collaborate with cross-functional teams to develop robust software solutions that protect our community and ensure a safe learning environment.

Discord is a vibrant platform with over 200 million monthly active users, primarily used for gaming. More than 90% of our community engages in gaming activities, contributing to an astounding 1.5 billion hours spent on thousands of games via Discord each month. As we look to the future of gaming, we are committed to enhancing the experience for users by facilitating better communication and social interaction before, during, and after gaming sessions.As a Staff Software Engineer on the Safety Experience team, you will take on a pivotal role as a technical leader, driving significant business impact through the autonomous delivery of large and complex projects. Your responsibilities will include designing and building features and systems that mitigate harmful activities while ensuring compliance with regulatory standards. This role demands not only deep technical acumen but also the ability to amplify your team's capabilities by fostering engineering excellence, making informed technical decisions, and contributing actively to code development. You will collaborate across various functions to establish the technical framework for safety initiatives that safeguard hundreds of millions of Discord users. This position reports directly to the Engineering Manager of Safety Experience.

Discord is a vibrant platform that connects over 200 million users monthly for a variety of activities, with a significant focus on gaming. With over 90% of our users engaging in gaming, they spend a staggering 1.5 billion hours playing thousands of unique games on Discord each month. Our mission is to enhance the gaming experience by facilitating seamless communication and interaction among players before, during, and after their gaming sessions.We are seeking an experienced Staff Software Engineer to join our dedicated Safety Processing team. This pivotal team is responsible for maintaining trust and safety on Discord by processing signals from user reports and automated systems to identify and eliminate harmful or illegal content. In this role, you will spearhead backend projects, provide architectural insight, and develop scalable systems that effectively protect our users. Your contributions will directly influence the safety of our platform, ensuring that Discord remains a welcoming environment for all. To discover more about our engineering initiatives, visit our engineering blog.

Discord is a vibrant platform utilized by over 200 million users each month for a multitude of reasons, with a significant focus on gaming. A staggering 90% of our users engage in gaming activities, collectively spending 1.5 billion hours playing thousands of unique titles on Discord every month. As we look to the future, Discord is poised to play a pivotal role in enhancing the gaming experience by fostering communication and camaraderie among players before, during, and after their gaming sessions.The Safety Processing team is at the forefront of developing systems that empower Discord to effectively detect, review, and act upon harmful content at scale. Our mission is to build robust infrastructure and decision-making systems that facilitate accurate, efficient, and fair content moderation across the platform. We're on the lookout for a Senior Software Engineer capable of managing intricate, multi-phase projects and delivering high-quality systems that safeguard millions of users on a daily basis.As a Senior Engineer within the Safety Processing team, you will assume full ownership of projects from the initial design phase through to post-launch monitoring and iterative improvements. You will tackle challenging issues that lie at the intersection of automation, large-scale distributed systems, and content safety. Your contributions will include the development of automated decision systems that enhance our review capacity tenfold, the creation of enforcement infrastructure that manages millions of decisions each day, and the architecture of systems that centralize and streamline safety signal processing. Collaboration with Trust & Safety operations, machine learning teams, policy experts, and product partners will be key to delivering solutions that enhance Discord's safety while upholding our commitment to an exceptional user experience. You will create products that users love while maintaining Discord's high quality standards, utilizing an 80/20 mindset and a user-focused approach. We value a growth-oriented mindset and encourage diving into new code and technologies to implement safety solutions that protect our user community.This role presents the opportunity to work on systems that have a direct impact on user safety, address innovative technical challenges in content moderation at scale, and help shape the future of how Discord ensures community safety.

Discord connects over 200 million users each month for various purposes, but a common theme is the love for video gaming. With over 90% of our users engaged in gaming, collectively spending 1.5 billion hours on our platform each month, Discord is key to shaping the future of gaming. Our mission is to enhance the experience of chatting and socializing before, during, and after gaming sessions.As a Senior Software Engineer on the Safety Experience team, you will play a pivotal role in creating a safer environment for our vast user base. You will spearhead the design, development, and maintenance of features that safeguard users from harmful activities while ensuring compliance with regulations. The work you do is vital for the growth and integrity of Discord, reporting directly to the Engineering Manager of Safety Experience.

About the Role Twitch Interactive, Inc. is looking for a Software Engineer to focus on safety features in our San Francisco office. This role centers on building and improving systems that help protect the Twitch community, while keeping the user experience smooth and reliable. What You Will Do Develop and enhance features that support user safety across the Twitch platform Work closely with teams from different disciplines to design scalable solutions Balance strong safety measures with a seamless experience for streamers and viewers Location This position is based in San Francisco, CA.

Join Us as a Product EngineerAt Variance, we are at the forefront of teaching machines to navigate complex decision-making processes at scale. Our mission involves developing AI agents designed to combat fraud, scams, and abuse with high precision.Based in San Francisco, our small but highly skilled team is dedicated to solving challenges that impact billions of events and entities. We proudly serve a diverse clientele, including Fortune 500 companies and global marketplaces, as we strive to save millions of hours of human labor. If you excel in environments that demand ownership, speed, and collaboration with founders, you'll thrive here.Who You Are:You possess a deep passion for craftsmanship and have clear opinions about your work.You are familiar with our technology stack: React/Next.js, TypeScript, MySQL, and ClickHouse. However, we prioritize foundational skills over specific technologies.You thrive on owning features from backend development to a polished user interface and deployment.You are excited by the opportunity to create AI interfaces that have the potential to save lives.Your Responsibilities:Deliver end-to-end features with iteration cycles that are measured in hours, rather than months.Expand our product into new sectors and workflows through swift pilots and live demonstrations.Collaborate directly with the founders on large-scale, pioneering challenges.Design systems where AI algorithms make real-time decisions, ensuring a balance between accuracy, speed, and user confidence.Our Culture:We foster a culture of ownership, urgency, and craftsmanship. We encourage spirited discussions, innovative ideas, and creating work we take pride in. Our team operates fully in-person in San Francisco.What We Offer:A competitive salary accompanied by meaningful equity.Comprehensive healthcare options, including platinum-level medical, dental, and vision coverage.Unlimited paid time off (PTO), sick leave, and parental leave.Monthly reimbursement of up to $100 for personal health and wellness expenses.401(k) retirement plan.

Join suno as an Engineering Manager in our Trust & Safety team, where you will lead the development and implementation of innovative solutions to enhance user safety and trust on our platform. You will work closely with cross-functional teams to ensure the integrity of our systems and the protection of our users. Your leadership will be vital in driving engineering excellence and fostering a culture of safety and accountability.

Join Discord as a Software Engineer specializing in Safety Experience! In this role, you will be at the forefront of creating a safe and engaging environment for our users. You'll collaborate with cross-functional teams to design, develop, and implement robust safety features that enhance community interactions. If you're passionate about building innovative solutions and making a difference in user safety, we want to hear from you!

Flexport seeks a Software Engineer II in San Francisco, California to help create technology for the logistics sector. This position centers on building software that supports business operations and drives improvements in efficiency. What you will do Design, develop, and maintain software applications that underpin daily business activities Test and troubleshoot code, focusing on reliability and performance Collaborate with team members to deliver solutions that help the company grow and operate more efficiently

About Our TeamThe Safety Systems Organization plays a crucial role in ensuring the safe deployment of our advanced models in real-world settings, contributing to OpenAI's mission of developing and implementing safe Artificial General Intelligence (AGI). We prioritize AI safety, trust, and transparency, and our work is vital in making a positive impact on society.Our Safety Engineering team is dedicated to creating the platforms and tools that ensure OpenAI’s models are safe for real-world usage. We collaborate closely with researchers, product teams, and policy experts to transform safety concepts into robust, scalable systems: assessing risks, implementing safeguards, and continuously enhancing model performance in live environments. Our efforts sit at the confluence of product engineering, data science, and AI, directly influencing how millions engage with OpenAI’s technologies.About the PositionWe are seeking a proactive Fullstack Engineer who thrives in a dynamic, iterative environment—especially when developing internal tools that drive tangible societal impact. In this role, you will design and implement full-stack solutions for our Safety Systems teams, ensuring the increased safety and reliability of OpenAI’s models, particularly in sensitive areas such as mental health and protections for vulnerable users. Your contributions will enhance our team's ability to quickly identify and resolve safety concerns while also strengthening the feedback loop among policy, data, and model training cycles.Key Responsibilities:Lead the complete development cycle of internal tools aimed at enhancing the safety of OpenAI’s models, with a focus on critical areas such as mental health and vulnerable-user protections.Collaborate closely with researchers, engineers, and model policy developers to identify workflows, challenges, and requirements, translating them into sustainable product solutions.Create full-stack applications that support essential model policy workflows, including data labeling, failure case analysis, and insight generation for iterative development.Enhance internal applications for usability, performance, and scalability, improving team efficiency and reducing resolution time for safety issues.Transform successful AI-assisted safety workflows into externally facing safety products that empower developers to create safer AI, elevate industry standards for AI safety, and prepare society for more advanced AGI.

Role OverviewAt Variance, we are at the forefront of teaching machines to execute high-stakes judgment calls on a large scale. This involves developing AI agents that navigate the complex domains of risk investigations, fraud detection, and identity verifications.Our San Francisco-based team is small yet exceptionally talented, comprising former founders and specialists from leading AI laboratories. We cater to an impressive clientele, including Fortune 500 companies, global marketplaces, and regulated financial institutions. If you are passionate about taking ownership, working swiftly, and collaborating closely with founders, you will thrive in our environment.We are seeking a Security Engineer to help establish a robust security foundation. You will collaborate across product, infrastructure, and internal systems to ensure that Variance is secure by design, enabling us to meet the rigorous standards needed to deploy AI in critical workflows for the world’s largest corporations.

At Forge, we recognize that our greatest asset is our team. As pioneers in the private market technology sector, our vision is to create a brighter future for everyone. We embody this vision through our core values of boldness, accountability, and humility. Every day, we witness the impact of our mission as we support the teams driving the most remarkable innovations of our time, from space exploration to advancements in artificial intelligence and beyond.With our robust liquidity solutions, exclusive data insights, custody offerings, and a dynamic marketplace, Forge aims to establish a top-tier technology infrastructure that enables a global private market that is transparent, accessible, and seamless for companies, their employees, and investors. Through Forge, employees can liquidate their private shares, employers can offer liquidity options to shareholders before IPOs, and individual and institutional investors can engage in the growth of private unicorns.Forge's unique global marketplace meets the growing demand from individual and institutional investors seeking exposure to private company stocks and is fostering a powerful network effect.Our capability to provide these impactful financial solutions has attracted significant attention from investors, created demand from customers, and necessitated the expansion of our team to better serve more companies, teams, and innovators.The Role:In the capacity of a Senior Software Engineer II with a focus on trading engineering, you will be instrumental in delivering a high-quality trading platform that powers the trading functionalities within the Forge Marketplace. Your role will involve identifying opportunities to enhance trading products, including the integration of cutting-edge low-latency technologies, while also helping to shape the direction and roadmap for trading engineering initiatives.You will collaborate closely with Product, Design, and Engineering teams to guarantee the seamless integration of trading technologies into products, thus enhancing both user experience and application performance.

With support from prominent Silicon Valley investors, Peregrine Technologies empowers public safety organizations, state and local governments, federal agencies, and private sector entities to tackle societal challenges with unparalleled speed and precision. Our AI-driven platform transforms isolated and disparate data into actionable intelligence, rapidly presenting critical information that enables improved decision-making and outcomes. Currently, Peregrine serves hundreds of clients across over 30 states and two countries, impacting more than 125 million individuals, as we broaden our reach into enterprise markets and international territories.TeamOur engineering team is deeply committed to the idea that empathy enhances our solutions. Understanding how users interact with our products is fundamental to our approach. Engineers have the unique opportunity to collaborate closely with our onsite team to grasp the diverse use cases that Peregrine addresses.We cherish both ownership and teamwork; you will be fully accountable for significant features while working hand-in-hand with fellow engineers to ensure successful delivery. We believe that humility and empathy are critical for crafting effective solutions, and you will engage directly with our deployment team and users as we refine our offerings to meet their needs. Ingenuity and perseverance are vital in realizing our vision.RoleAs part of our new AI team, you will play a key role in delivering unique value to our clients. This team is responsible for designing powerful and intuitive user experiences powered by generative AI. You will explore entirely new interaction methods for users—whether through natural language commands or by enabling AI agents to manage complex tasks on their behalf. Your contributions will shape impactful AI-driven features that assist customers in solving real-world challenges more efficiently.Your work will encompass a variety of intricate challenges, including scaling our platform to process terabytes of data from multiple sources, efficiently querying and alerting users about this data in real-time, and optimizing search algorithms for swift result delivery.While our technology stack is continuously evolving, it is built on a foundation that includes Python, Django, Celery, Airflow, and Kafka for the backend; React, Redux, and Mapbox for the frontend; PostgreSQL and Elasticsearch for data storage; machine learning models hosted in Bedrock and Sagemaker; and utilizing AWS, Pulumi, Terraform, and Kubernetes for our infrastructure.

At Intrinsic Safety, we're leveraging innovative technologies to tackle some of the most challenging issues of our digital era using safe and effective AI solutions. Your contributions will play a pivotal role in assisting fraud prevention and Trust & Safety teams, enabling them to concentrate on impactful tasks rather than repetitive manual reviews. We're experiencing rapid growth, partnering with some of the largest and most dynamic social media and online service platforms.We are on the lookout for an exceptional Technical Account Manager (TAM) to join our core Customer Success team. In this role, you will be crucial in ensuring our customers—particularly our enterprise clients—derive maximum value from Intrinsic Safety by providing expert technical support and guidance. You will act as the essential link between our advanced AI platform and our customers' technical teams, fostering deep platform adoption, troubleshooting complex issues, and facilitating their long-term success. This is a unique opportunity to contribute to our mission by transforming intricate technical challenges into practical solutions that effectively combat fraud and abuse.This role requires in-person attendance at our San Francisco office.Your ResponsibilitiesPost-Integration Technical Partnership: Serve as the main technical liaison for our enterprise customers post-deployment. Gain a thorough understanding of their unique technical environments and data flows as they interact with the Intrinsic Safety platform.Drive Ongoing Technical Adoption & Optimization: Assist customers in navigating advanced platform features and configurations to ensure they maximize the benefits of Intrinsic Safety’s offerings.Build Scalable Technical Resources: Develop and enhance our knowledge base, technical documentation, and best practice guides to empower both customers and the Customer Success team.Strategic Technical Troubleshooting & Resolution: Identify and resolve sophisticated technical challenges that arise after implementation, working closely with engineering and product teams to deliver scalable solutions.Product Evolution: Act as a key contributor to the continual improvement of our product offerings.

About UsBe Part of the Robotic Biomanufacturing Revolution!Multiply Labs is at the forefront of robotics innovation, dedicated to addressing a critical challenge in modern medicine: the automated production of life-saving advanced biologics, including gene therapies, cell therapies, antibodies, and more.Currently, these essential therapies are created using manual and labor-intensive methods, resulting in exorbitant costs—often between $500K and $2M per patient—restricting access for many who need them.As the complexity of products grows and the stakes of failure and scientific labor escalate, the industry is increasingly turning to automation. Robotics and AI are paving the way for a future where biologics manufacturing is feasible, dependable, and economically scalable.We envision a future where biomanufacturing is robotic, closed, automated, and scalable—guaranteeing that vital therapeutics are available to every patient in need.Why This MattersWe aren’t just manufacturing robots—we’re creating the essential infrastructure for the next generation of biologics. Our technology empowers biopharma companies to scale production seamlessly without altering their scientific foundations, minimizing regulatory obstacles and reducing costs, thereby expanding access to these treatments.The Stack & The ScaleThe Mission: Craft the world’s finest robots to ensure life-saving therapies are accessible to all.

Join our dynamic team as a Backend Software Engineer II at tvscientific powered by Pinterest. In this role, you will leverage your expertise in building scalable and efficient backend systems to support our innovative projects. Collaborate with cross-functional teams to design, implement, and optimize backend solutions that meet the company's objectives.