About the job
About Crunchyroll
Founded by passionate fans, Crunchyroll is dedicated to delivering the vibrant art and culture of anime to an enthusiastic community. Serving over 100 million anime and manga fans across more than 200 countries and territories, we connect them with the stories and characters they cherish. Our offerings include streaming services, theatrical experiences, games, merchandise, events, and more, all fueled by the anime content that we all adore.
Join us in shaping the future of anime!
About the Role
As Crunchyroll continues to expand and evolve, we face unique challenges and opportunities to support millions of anime fans globally. Our AI/ML team plays a crucial role in providing seamless assistance to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll enthusiasts.
- Design and implement comprehensive LLM-based applications such as chatbots, virtual assistants, search agents, and knowledge discovery tools.
- Create and deploy scalable RAG and GraphRAG pipelines utilizing vector databases (e.g., Opensearch, Pinecone, Mongo) along with document chunking strategies.
- Optimize and fine-tune foundation models (e.g., Bedrock, Claude, Nova) for specialized domain applications.
- Manage prompt design and evaluation, developing prompt libraries and frameworks to facilitate rapid experimentation and reuse.
- Develop APIs and microservices to support LLM-based applications with real-time performance and uptime assurances.
- Collaborate closely with data, platform, and backend teams to integrate LLM functionalities into broader Crunchyroll product experiences.
- Continuously monitor and assess LLM systems in production for issues related to hallucination, latency, cost, and feedback loops.
- Stay abreast of the latest advancements in LLM research, tooling (LangChain, LlamaIndex), and ecosystem developments.

