Joblaze summary

In this role, the Senior Software Engineer for the AI Gateway at Kong focuses on designing and maintaining core components that ensure high performance and reliability for AI traffic. Proficiency in Golang and Python, along with a solid grasp of distributed systems and cloud-native environments, is essential for success. This position is ideal for experienced engineers who thrive in fast-paced settings and are eager to mentor junior team members. The team is dedicated to advancing API management for AI, making it a pivotal part of Kong's mission.

Joblaze insights

Listed 6 days ago — first seen on Joblaze October 27, 2026. Last confirmed on Kong's careers page November 2, 2026.
This exact title is also open at 1 other location at Kong: Milan, Italy.

Quick facts

What's the tech stack?: Joblaze extracted these technologies from the posting: AWS, Azure, Docker, GCP, Golang, Kubernetes.
What seniority level is this role?: Kong targets senior candidates for this position.
Is this full-time or contract?: Full-time for this Senior Software Engineer, AI Gateway role at Kong.

From the original posting

The Mission:

The AI Gateway team is at the forefront of Kong's evolution into the Agentic Era, building the critical infrastructure that connects enterprises to the world of generative AI. We are architecting a highly performant, secure, and observable gateway that provides developers with an unparalleled 'Developer Delight' experience for AI workloads. Your work will directly empower our customers to innovate faster by securely integrating LLMs and AI services into their applications at massive scale.

What You’ll Do:

Design and own core components of our AI Gateway, ensuring 99.99% uptime and low-latency performance for critical AI traffic.
Lead the implementation of features like prompt engineering, caching, and observability for AI services, writing clean, maintainable Golang and/or Python code.
Influence the technical roadmap and architecture, proactively identifying and mitigating technical debt to ensure long-term scalability.
Architect robust solutions for integrating with various Large Language Models (LLMs) and AI platforms, shaping the future of API management for AI.
Mentor junior engineers, fostering a culture of technical excellence, high-ownership, and rapid iteration through code reviews and design discussions.
Drive the full development lifecycle, from ideation and design to deployment and operation within a modern Kubernetes environment.
Collaborate with product managers and cross-functional teams to translate complex customer requirements into elegant and powerful technical solutions.

What You’ll Bring:

The Toolkit

5+ years of experience in backend development, preferably with Golang and/or Python.
Experience with AI/ML infrastructure, LLMs, or frameworks like LangChain or LlamaIndex.
Deep understanding of distributed systems, microservices architecture, and API design principles.
Proven experience designing and operating services in a cloud-native environment (Kubernetes, Docker, AWS/GCP/Azure).
Familiarity with API gateways, service mesh, or related infrastructure technologies.
Strong computer science fundamentals (data structures, algorithms, concurrency).

The Kong DNA

Ownership: You are a self-starter who takes initiative and sees features through from conception to production.
Urgency: You thrive in a fast-paced environment, balancing quality with the need to deliver value to customers quickly.
Collaboration: You excel at working with a globally distributed team, communicating clearly and effectively to achieve shared goals.

Bonus Points:

Contributions to open-source projects.
Experience with performance tuning and optimization of high-throughput systems.
Knowledge of Lua/OpenResty.

#LI-EA1

Standard company text repeated across Kong's postings is omitted here.

Senior Software Engineer, AI Gateway