Implementation Engineer at Pylon Labs | San Francisco

At Judgment Labs, we are pioneering the way that Agent Behavior Monitoring (ABM) is approached. Unlike conventional observability methods that primarily focus on logging exceptions and latency, our innovative ABM technology identifies behavioral anomalies such as instruction drifts and context retrieval losses in large-scale production environments.Our platform is trusted by numerous teams developing autonomous agents, enabling them to gain insights into system behavior post-deployment. By moving beyond reactive incident management, our users can analyze patterns across conversations and workflows, correlate regressions to specific interaction types, and accurately identify where reliability issues arise within their operational context.Recent funding success: We have successfully raised over $30M across two funding rounds within the last five months, attracting notable investors such as Lightspeed, SV Angel, Valor Equity Partners, and more.

At Judgment Labs, we are at the forefront of developing Infrastructure for Agent Behavior Monitoring (ABM). Unlike traditional observability which primarily captures logging exceptions and latency, our innovative ABM technology identifies behavioral anomalies—such as instruction drifts and context retrieval loss—within scaled production environments.Numerous teams creating autonomous agents depend on Judgment to gain insights into their systems' post-deployment behaviors. Rather than responding reactively to incidents, our clients can analyze patterns across conversations and workflows, correlate regressions to specific interaction types, and accurately identify where reliability falters in their operational context.Recently, we successfully raised over $30M across two funding rounds in just five months. Our esteemed investors include top-tier firms and individuals such as Lightspeed, SV Angel, Valor Equity Partners, and many others.The Role:We are seeking a highly motivated Product Engineer with a minimum of 2 years of experience to join our dynamic team. This role is vital for expanding our product offerings to cater to growing customer demand while upholding our commitment to delivering an outstanding user experience in the fast-paced AI agent domain. We are looking for someone passionate about enhancing agent behavior and contributing to a product that is powerful yet enjoyable to use.What You’ll Do:Collaborate closely with our design team to develop new features and refine existing user flows based on user feedback.Engage with customers to capture their needs, gather insights, and propose new features.Develop core product features on both the front-end and back-end, including database interactions.Experiment with new features and technologies, delivering quick demonstrations for the team, and implementing promising solutions.Participate in product design reviews to ensure a high-quality and intuitive user experience.Why Judgment?Essential for Agents: Today's agents face challenges such as hallucination and drift in production. We are building the monitoring infrastructure that allows agents to improve autonomously.Driven to Succeed: Our small but mighty team of fewer than 20 operates with the efficiency of a larger team, delivering daily. You will collaborate with olympiad medalists, debate champions, and competitive athletes who all maintain the same intensity in building the company.

At Judgment Labs, we are revolutionizing the monitoring of agent behavior through our innovative infrastructure for Agent Behavior Monitoring (ABM). Unlike traditional observability metrics focused solely on logging exceptions and latency, our approach identifies behavioral anomalies including instruction drifts and context retrieval losses within scaled production environments.Numerous teams developing autonomous agents depend on Judgment Labs to gain insights into their systems' performance after deployment. Rather than merely reacting to incidents, they can cluster patterns across conversations and workflows, correlate regressions with specific interaction types, and accurately identify where reliability falters in their operational contexts.We are proud to announce that we have raised over $30 million in two funding rounds over the last five months. Our esteemed investors include Lightspeed, SV Angel, Valor Equity Partners, Nova Global, and notable individuals like Chris Manning and Michael Ovitz.The Role:We seek passionate Research Engineers to help us develop AI systems that utilize agent interaction data to enhance our understanding of agent behavior, facilitate large-scale evaluations, and drive improvements through iterative learning and feedback.Your research will have a tangible impact. You will engage directly with real-world agent data, implement cutting-edge methodologies in production, and witness your contributions being deployed in real-time. By enhancing the measurability and debuggability of agent behavior, your work will empower teams across finance, legal, operations, and other critical domains. You will lead projects from inception to completion, enjoying substantial autonomy while collaborating closely with our team to create self-improving agent systems.What You'll Do:Develop systems that aggregate, index, and analyze extensive agent interaction data to derive valuable evaluation metrics.Create agent-based systems for the analysis and evaluation of complex, long-term behaviors.Design and execute post-training and optimization workflows aimed at enhancing agent performance.Build internal tools and infrastructure that promote rapid experimentation, analysis, and training.What We're Looking For:You should resonate with at least one of the following:A strong focus on data quality, evaluation, and benchmarking, with a hands-on approach to working with complex datasets.Experience in developing agent systems and applying them in real-world or production environments.A robust background in machine learning or related fields, with an eagerness to advance agent technology.

At Judgment Labs, we're revolutionizing the landscape of Agent Behavior Monitoring (ABM). Unlike traditional observability that merely tracks exceptions and latency, our innovative ABM technology identifies behavioral anomalies such as instruction drifts and loss of context retrieval in large-scale production environments.Our platform is relied upon by countless teams developing autonomous agents who need insights into their systems' performance after deployment. Rather than just reacting to incidents, our users analyze patterns across conversations and workflows, link regressions to specific interaction types, and identify failure points in their operational context.We have successfully raised over $30 million in funding within the last five months, backed by renowned investors like Lightspeed, SV Angel, Valor Equity Partners, and several industry leaders.

Join Us at Pylon Labs: Shaping the Future of B2B Post SalesAt Pylon Labs, we are revolutionizing the B2B post-sales support landscape with our all-in-one platform that leverages conversational data and sophisticated intelligence. Our mission is to empower businesses to operate seamlessly and in real-time.We are proudly backed by top investors including a16z, BCV, General Catalyst, and Y Combinator, and currently support over 1000 companies, including Linear, Cognition (creators of Devin), Modal Labs, and Incident.io, in managing their support and customer success workflows.Recognized on the Enterprise Tech 30 List, our product covers a vast problem space, offering numerous opportunities for innovation and ownership. We are excited to welcome several talented software engineers to our dynamic team.Your Role: What You'll DoDevelop and enhance the infrastructure that drives Pylon's AI capabilities, including prompt execution and search infrastructure.Elevate the observability of LLMs through comprehensive AI evaluations, and prepare Pylon's AI for scalable growth.Enhance the quality and performance of our AI features.Are You the Right Fit?You prefer focusing on building and delivering code over excessive meetings.You possess solid engineering fundamentals, code efficiently, and are aware of your strengths and areas for growth.You excel in autonomous environments where you can manage your own projects and details.You are located in San Francisco or willing to relocate, enjoy in-person collaboration, and are committed to fostering a vibrant company culture.Familiarity with React, Golang, GraphQL, and AWS is a plus.Join a team of seasoned engineers from prestigious companies such as Samsara, Affinity, and Airbnb.Our Benefits Comprehensive medical, dental, and vision coverage for employees 401(k) retirement plan Commuter benefits Parental leave 14 company holidays plus unlimited PTO

About UsBraintrust is at the forefront of AI observability, seamlessly integrating evaluations and observability into a single workflow. Our platform empowers innovators by providing them with the critical insights needed to understand AI performance in production environments and the tools required to enhance it.Recognized by leading companies such as Notion, Stripe, Zapier, Vercel, and Ramp, Braintrust enables teams to compare AI models, test prompts, and detect regressions, transforming production data into superior AI with each iteration.Role OverviewWe are seeking a talented Cloud Infrastructure Engineer to join our team and contribute to the development of a robust and scalable infrastructure. You will provide developers with a premium platform to deploy code efficiently and confidently. Your role will involve leading initiatives across Terraform, Kubernetes, CI/CD, observability, and support, significantly impacting Braintrust's internal operations and the self-hosted experiences of our customers.This position is pivotal as you will manage our AWS environment while assisting customers in deploying our infrastructure on AWS, Azure, and GCP.Your ResponsibilitiesDevelop and maintain Terraform modules for both internal infrastructure and customer deployments.Engage directly with customers via Slack to assist with self-hosting and troubleshoot infrastructure challenges, creating tools to simplify their support process.Take ownership of our CI/CD pipeline, aiming to reduce build times, enhance failure visibility, and facilitate safer, quicker releases.Centralize and scale observability through logs, metrics, dashboards, and alerts.Collaborate with engineering teams to create and enhance a secure, developer-friendly infrastructure platform.Support multi-cloud deployment strategies, primarily in AWS, while also extending support for Azure and GCP for our enterprise clientele.Implement tools and automation to bolster deployment, rollback, and infrastructure reliability.Ideal Candidate ProfileA minimum of 5 years of experience in DevOps, SRE, or Infrastructure Engineering roles.In-depth knowledge of Terraform and experience with at least one major cloud provider, preferably AWS.Proficient in Kubernetes, with capabilities in deploying, debugging, and scaling real workloads.Strong programming skills in scripting languages like Python, Typescript, or Go.Experience in supporting production systems and managing incidents effectively.Comfortable working closely with customers in a support or deployment capacity.Bonus: Familiarity with monitoring and logging tools, as well as knowledge of security best practices.

Why Join AngelList At AngelList, we tackle some of the most challenging issues in venture capital and private markets. You will collaborate with a team that prioritizes precision, urgency, and forward-thinking. If you aspire to influence the way startups are financed and developed, this is your opportunity.About AngelListOur mission is to propel innovation by increasing the success rate of startups globally. We create the financial infrastructure that simplifies investing in transformative companies.As the heartbeat of the venture capital and startup ecosystem, AngelList supports over $171 billion in assets and has facilitated investments in more than 13,000 startups, including over 300 unicorns. Notably, 57% of elite U.S. VC deals involve AngelList investors. Our ambition is as vast as our scale.If you are passionate about shaping the future of private markets, we invite you to build with us.About the Role:As we develop the most efficient platform for fund operations and startup investments, our Infrastructure team plays a crucial role. As a Senior Infrastructure Engineer, you will have a significant impact on the platform infrastructure that supports billions in venture assets.This role transcends traditional operations. You will design and implement developer platforms, deployment pipelines, infrastructure automation, and essential systems that accelerate our engineering team's performance. Our technology stack includes Kubernetes and AWS, along with tools like Pulumi, cdk8s, and ArgoCD — your ability to innovate and adapt is what truly matters.

Who We AreAt Twelve Labs, we are at the forefront of creating innovative multimodal foundation models capable of understanding videos as humans do. Our groundbreaking models have set new benchmarks in video-language modeling, enhancing our capabilities and fundamentally changing how we engage with and interpret diverse media formats.Backed by an impressive $107 million in Seed and Series A funding, our organization enjoys support from prestigious venture capital firms including NVIDIA's NVentures, NEA, Radical Ventures, and Index Ventures, along with visionary leaders in AI such as Fei-Fei Li, Silvio Savarese, and Alexandr Wang. With our headquarters in San Francisco and a significant presence in Seoul, our global reach reflects our dedication to fostering innovation worldwide.We celebrate the individual journeys of our team members, recognizing that our diverse cultural, educational, and life experiences enable us to continuously challenge the status quo. We seek passionate individuals who resonate with our mission and are eager to create a meaningful impact as we expand the horizons of technology to reshape the world. Join us in our quest to revolutionize video comprehension and multimodal AI.About the RoleAs a Senior Backend Software Engineer at Twelve Labs, you will play a pivotal role in developing the server-side infrastructure that powers our new agentic application layer. You'll be an integral part of a small, high-impact team, taking ownership of the essential transition from prototype to a production-ready platform.Travel Requirements: Up to 25% travel to Los Angeles is expected.Candidates should be prepared to travel up to 10% annually for conferences, off-site meetings, and other business-related activities as required. This position may involve participating in on-site interviews and in-person onboarding processes.Your ResponsibilitiesBackend DevelopmentDesign and implement backend services for video processing workflows, including ingestion, transcoding, 4K export, metadata extraction, and timeline operations.Architect scalable and reliable systems to support enterprise-level video workloads using cloud-native infrastructure (AWS, GCP).Develop and optimize APIs that power real-time and asynchronous frontend workflows, focusing on streaming data delivery and long-running job orchestration.Ensure performance and reliability of distributed video processing pipelines, meeting low latency and high throughput requirements.

Join our dynamic team at unto-labs as a Product Engineer where you will be at the forefront of innovation. In this role, you will design, develop, and enhance our cutting-edge products while collaborating with cross-functional teams. Your contributions will directly impact the product lifecycle, from conceptualization to deployment.

About Absentia LabsAbsentia Labs is at the forefront of innovation, creating intelligent systems that integrate artificial intelligence, biology, chemistry, and large-scale engineering. Our mission is to convert intricate scientific data into machine intelligence that can reason, generalize, and foster discovery.We tackle the challenges of fragmented, noisy, and interconnected biomedical data, transforming it into a meaningful signal through robust data foundations and well-designed learning systems that are scalable across different modalities, tasks, and uncertainties. This position emphasizes the design and training of such systems.The RoleAs a Senior AI/ML Engineer, you will spearhead the architecture, training, and deployment of large-scale machine learning models that are central to Absentia Labs’ AI initiatives. Your role will bridge model architecture, training systems, and production infrastructure, granting you significant ownership of the technical direction.This position is tailored for engineers experienced in training large models in real-world production settings, who are adept at navigating scale and can analyze both learning dynamics and system constraints.What You’ll DoDesign, train, and evaluate large-scale models, including Large Language Models (LLMs), diffusion models, and Graph Neural Networks (GNNs).Own end-to-end training pipelines, from dataset interfaces and batching strategies to distributed training and checkpointing.Make informed decisions regarding model architecture, objective functions, optimization strategies, and scaling principles.Develop and enhance distributed training systems (data parallelism, model parallelism, sharding, mixed precision).Collaborate closely with data engineers to establish ML-ready datasets and streaming interfaces.Translate vague scientific or product requirements into solid ML solutions.Lead model assessment, ablation, and iteration with a focus on generalization, stability, and reproducibility.Contribute to architectural decisions concerning model serving, inference efficiency, and lifecycle management.Provide technical leadership through design reviews, mentorship, and cross-functional collaboration.Who You AreYou are a senior ML engineer with a holistic approach to models as systems. You comfortably navigate uncertainty, make informed trade-offs between compute, data, and performance, and take ownership of outcomes from research through to deployment.

The OpportunityJoin rowspace as an Infrastructure Engineer and play a pivotal role in constructing and safeguarding the core of our cutting-edge AI data platform. In this position, you'll engineer systems capable of managing extensive volumes of sensitive financial information while adhering to rigorous security and compliance standards. Your work will involve real-time integration of public data with private, tenant-isolated customer data at scale.Key ResponsibilitiesDesign and implement scalable infrastructure to support our AI-driven knowledge engine that processes both structured and unstructured financial data.Establish a security-first architecture for private cloud environments, ensuring data governance aligns with financial services regulations.Create resilient data ingestion pipelines that accommodate a variety of data sources, from CapIQ feeds (structured data) to internal SharePoint documents (unstructured data).Develop comprehensive monitoring and alerting systems for our BYOC platform.Enforce access controls and maintain audit trails to ensure that AI interactions can be traced back to primary sources.Collaborate with our AI Research and Product teams to enhance infrastructure for LLM inference and training workloads, as well as agent infrastructure development.Establish CI/CD practices and infrastructure-as-code for swift, reliable deployments across multiple cloud providers.

Join Pylon Labs and Shape the Future of B2B Post Sales!At Pylon, we are revolutionizing B2B post-sales support with an all-inclusive platform that leverages conversational data and advanced intelligence, empowering our clients to manage their operations seamlessly in real-time.Supported by leading investors including a16z, BCV, General Catalyst, and Y Combinator, we proudly serve over 1,000 companies such as Linear, Cognition (creators of Devin), and Modal Labs, who trust us to streamline their support and customer success workflows. We are also honored to be featured on the Enterprise Tech 30 List.This role is fully in-person; remote or hybrid options are not available. Your RoleEngage directly with customers while developing bespoke solutions.We seek a former Software Engineer who appreciates the power of automation—complete a task once and automate it, never to revisit it.Facilitate the migration of new customers from their legacy support systems to Pylon.Lead customer migration meetings within your first week.Serve as the primary 'problem-solver' for customers as they transition to Pylon, guiding them through the reconstruction of their processes and data.Become a product expert and assist customers in identifying the most suitable solutions, even when they may not initially understand their needs.Participate in pre-sales calls, showcasing your expertise in potential solutions.Develop proficiency not only in Pylon but also in the systems we are migrating from (e.g., Zendesk, Intercom).Manage multiple customer migrations simultaneously, ensuring timely completion.Continuously refine and enhance the migration process.RequirementsMust be located in or willing to relocate to San Francisco and eager to work on-site.Highly organized and quick to adapt; you’ll be managing multiple migrations concurrently.Detail-oriented with a strong capacity to learn rapidly; you will need to master various tools promptly.A passion for product innovation and the ability to suggest enhancements.Our BenefitsWe offer a vibrant work culture with numerous perks to enhance your experience.

Join Our Team at Pylon Labs!At Pylon, we are on a mission to redefine the B2B post-sales landscape. Our innovative all-in-one platform leverages conversational data and advanced intelligence to empower our clients to manage their operations seamlessly and in real-time.Pylon is proudly backed by top-tier investors including a16z, BCV, General Catalyst, and Y Combinator.Today, over 1000 companies, including notable names like Linear, Cognition (the team behind Devin), Modal Labs, and Incident.io, rely on Pylon for their support and customer success workflows. We are also honored to be featured on the Enterprise Tech 30 List.Our product encompasses a vast problem space, presenting numerous opportunities for impactful contributions. We are eager to bring on board several exceptionally skilled software engineers across various tech stacks.Are You the Right Fit?You prefer coding over meetings and are committed to delivering high-quality work.You possess strong engineering fundamentals, write efficient code, and understand your strengths and areas for growth.You thrive on autonomy and take ownership of your projects.You are located in San Francisco or are willing to relocate, and you value in-person collaboration to foster a vibrant company culture.Familiarity with React, Golang, GraphQL, and AWS is a plus.You will be joining a highly skilled technical team with senior engineers from respected organizations such as Samsara, Affinity, and Airbnb.Perks of Joining Pylon Comprehensive medical, dental, and vision coverage for employees. 401(k) retirement plan with company match. Commuter benefits to ease your travel. Generous parental leave. 14 company holidays and unlimited paid time off. Annual offsite retreats. Free lunch, dinner, and snacks at the office to fuel your day. Fitness stipend to support your well-being.About Pylon LabsFunding: Series B led by a16z and BCV, with a total of $51M raised.Founders: [Details about the founders].

Supported by prominent investors from Silicon Valley, Peregrine Technologies is dedicated to assisting public safety organizations, governmental entities at state and local levels, federal agencies, and private institutions tackle societal challenges with remarkable efficiency and precision. Our AI-driven platform converts fragmented and isolated data into actionable intelligence, providing instant access to crucial information that facilitates enhanced decision-making and improves outcomes across various touchpoints. Currently, Peregrine serves hundreds of clients across over 30 states and two countries, positively impacting more than 125 million lives, with plans to further amplify our influence as we expand into the enterprise sector and internationally.Role OverviewWe are seeking a Senior Infrastructure Engineer to become an integral part of our expanding team, where you will design and implement the infrastructure that underpins the Peregrine platform.Our engineering team believes that empathy fuels better solutions. Observing users interact with our product is essential to identifying the right solutions. Engineers will have the chance to collaborate closely with our team on-site to comprehend the diverse applications that Peregrine supports. We champion strong ownership while promoting collaboration and continuous feedback.In your role as Senior Infrastructure Engineer, you will utilize a broad array of technologies to scale our platform, ensuring secure connections to customer networks while managing vast amounts of data. You will confront a variety of intricate challenges, including:Building highly available and secure production systemsDesigning scalable and secure network architecturesEnhancing the ingest engine for substantial data processingSpeeding up the entire engineering lifecycleOur technology stack is continuously advancing, built on AWS GovCloud, Kubernetes, Docker, Terraform, Pulumi, PostgreSQL, Redshift, Elasticsearch, and more.

Join Us in Building a Safer Financial Future.At TRM Labs, we leverage blockchain analytics and AI technologies to empower law enforcement, national security agencies, financial institutions, and cryptocurrency enterprises in their battle against crypto-related fraud and financial crime. Our robust blockchain intelligence and AI solutions are designed to trace funds, identify illicit activities, construct cases, and provide comprehensive threat assessments. Trusted by leading global organizations, TRM Labs is dedicated to fostering a safer and more secure world.As part of our Data Platform team, you will work alongside a talented group of data scientists, engineers, and product managers to create highly available and scalable data infrastructure essential for TRM's products and services. In the role of Engineering Manager, you will spearhead the development of mission-critical systems and data services that analyze blockchain transaction activities at an unprecedented petabyte scale, contributing to a safer financial ecosystem for millions.Your Impact:Lead and mentor a dynamic team of skilled engineers, fostering a culture of technical excellence and collaboration.Provide ongoing coaching and technical guidance to your team and the broader engineering department.Assume responsibility for the quality and timely delivery of your team’s projects, ensuring optimal performance and reliability of critical services.Drive initiatives based on defined goals and measurable outcomes, aligning with key performance indicators (KPIs).Promote best practices in design and usability, developing scalable solutions accompanied by thorough documentation and knowledge sharing.Address escalations from operations and collaborate with various teams to resolve production incidents effectively.Work closely with management and product teams to strategize, estimate, and prioritize roadmap objectives, while identifying upcoming opportunities and risks.Develop highly reliable data services that integrate seamlessly with numerous blockchain protocols.Create and manage ETL pipelines that process and transform petabytes of structured and unstructured data in real time.Design efficient data models for optimal storage and retrieval, ensuring sub-second latency for querying blockchain data.Oversee the deployment and monitoring of large database clusters, ensuring high performance and availability.Collaborate cross-functionally with data scientists and backend engineers to deliver exceptional solutions.

We are seeking a highly skilled Senior Infrastructure Engineer to join our dynamic team at Bitgo. In this pivotal role, you will design, implement, and maintain our infrastructure systems, ensuring optimal performance and security. You will collaborate with cross-functional teams to develop innovative solutions and enhance our operational efficiency.Your expertise will be crucial in managing complex infrastructure environments and leveraging automation to streamline processes. If you are passionate about infrastructure engineering and are looking to make a significant impact in a fast-paced, cutting-edge environment, we want to hear from you!

Join Handshake as a Senior Cloud Engineer, where you'll play a pivotal role in designing and implementing scalable cloud solutions. Your expertise will help us enhance our cloud infrastructure while ensuring high availability and security.We are looking for a passionate and driven individual who thrives in a fast-paced environment, is eager to tackle complex challenges, and enjoys collaborating with cross-functional teams. If you have a deep understanding of cloud architectures and services, we want to hear from you!

Join Pylon Labs and Shape the Future of B2B Post-Sales!At Pylon Labs, we are pioneering an all-in-one B2B post-sales support platform that leverages conversational data and advanced intelligence to empower our clients to operate seamlessly in real-time.Backed by renowned investors like a16z, BCV, General Catalyst, and Y Combinator, we proudly serve over 1000 companies, including industry leaders such as Linear, Cognition (creators of Devin), Modal Labs, and Incident.io. We are also featured on the prestigious Enterprise Tech 30 List.This position requires full-time, in-person commitment; we do not offer remote or hybrid arrangements.

About Chalk Inc. Chalk Inc. is revolutionizing the data platform landscape to empower the next generation of machine learning applications. We are dismantling traditional barriers of complexity, latency, and scalability that have historically limited ML capabilities. Our platform delivers Rust-speed performance paired with developer-friendly tools, making it the preferred choice for leading companies tackling issues such as preventing fraudulent credit card transactions, identity verification, and optimizing clean energy generation. Recently, we secured a $50 million Series A funding round, led by Felicis. About the Role We are seeking exceptional engineers to join our Infrastructure team. This is a unique opportunity to become an early employee in a high-growth startup, where you can make a significant impact. In this role, you will address complex engineering challenges with a high level of autonomy and ownership. Note: Our team works in the office five days a week. While we are flexible during unavoidable conflicts, this position is not hybrid. We are looking for a platform engineer with a solid foundation in infrastructure engineering. At Chalk, we tackle challenges from database management systems (DBMS), query planning and optimization, compilers, and distributed analytical data processing systems. Our team utilizes both dynamic and static analysis of Python programs to optimize arbitrary user Python code, orchestrate infrastructure based on the code structure, and track metadata concerning data flow through these systems. What You Will Do Develop automation code for orchestrating and provisioning infrastructure to execute Chalk technology for our customers and prospects. Create a management platform for our hosted services and oversee the deployment of Chalk in customer-owned cloud environments across AWS and GCP. Collaborate closely with our Engineering and Sales teams. Assist in interviewing and expanding the Engineering team. What We Are Looking For At least 2 years of experience in writing software for automating infrastructure management. Proficient in Python, Go, and/or Terraform. Experience with AWS and/or GCP. Strong collaboration skills.