About the job
Join Us in Powering Global Connections!
At Kong, we believe that innovation knows no bounds. If you’re excited about the prospect of transforming how businesses interact with AI technologies, we invite you to apply. Don’t worry if you don't meet every single qualification; we value diverse experiences and are eager to find strong candidates who can grow with us.
Your Role:
As a Senior Software Engineer in our AI Gateway Team, you will play a pivotal role in developing the Kong AI gateway, which empowers organizations and developers worldwide to manage every aspect of their AI and LLM innovations. You will be responsible for key functionalities such as multi-LLM routing, semantic caching, and much more.
Your Responsibilities:
Design, develop, and maintain software for API management tailored for AI and LLMs.
Architect innovative features, including proxy capabilities and load balancing, to expand Kong AI Gateway’s offerings.
Troubleshoot bugs, optimize performance, and implement low-level enhancements.
Bridge the gap between Kong and third-party deployment tools.
Mentor junior team members, fostering their growth and development.
Execute additional tasks as assigned by management.
Your Qualifications:
A minimum of 5 years of experience in server-side application programming.
Proven experience in designing, prototyping, and building scalable applications.
Strong technical skills in Linux systems troubleshooting and profiling.
Expertise in distributed systems, Linux networking, and programming related to API transport protocols.
Ability to work seamlessly in a remote, distributed team environment.
Excellent communication skills, both verbal and written; documentation is a key aspect of the role.
Familiarity with AI and LLM concepts is a plus.

