Build and extend Kraken's AI Gateway, enabling teams to integrate and manage LLM workloads efficiently.
Posted by employer 4 days ago
First seen on Joblaze 3 days ago
Last verified on the company career page 7 hours ago
Skills & Technologies
What you'll build
- Build and extend the AI Gateway
- Design APIs, SDKs, and self-service tooling
- Help teams migrate LLM workloads
- Implement access control and audit logging
- Support internal users with documentation
Must have
- Solid experience as a backend or platform software engineer
- Strong skills in a backend language such as Rust, Python or TypeScript
- Working knowledge of LLM APIs
- Experience with observability, CI/CD and containers
Nice to have
- Experience with API gateways or traffic management
- Experience building LLM-powered systems
- Familiarity with authentication and authorization patterns
- Contributions to open-source infrastructure projects
AI in the day-to-day
AI Gateway provides self-service access to leading models from providers like Anthropic, OpenAI, and Google.
Not disclosed in this posting: compensation, years of experience, work arrangement, visa sponsorship.
Joblaze summary
In this role, the Senior Software Engineer will focus on enhancing Kraken's AI Gateway, which serves as a centralized access point for various LLM models. The position requires strong backend development skills, particularly in languages like Rust, Python, or TypeScript, along with experience in API design and distributed systems. This role is ideal for seasoned engineers who are comfortable managing complex integrations and have a solid understanding of LLM APIs and cloud infrastructure. The team emphasizes collaboration and feedback, ensuring that internal users have the tools and support they need.
Joblaze insights
- Listed 3 days ago — first seen on Joblaze October 30, 2026. Last confirmed on Kraken's careers page November 2, 2026.
Quick facts
- What's the tech stack?
- Joblaze extracted these technologies from the posting: Kubernetes, Python, Rust, TypeScript.
- What seniority level is this role?
- Kraken targets senior candidates for this position.
- Is this full-time or contract?
- Full-time for this Senior Software Engineer - Dev Platform role at Kraken.
From the original posting
The Dev Platform team builds the internal platform that Kraken's engineers use to build, ship and run software. Within Dev Platform, the AI Gateway is Kraken's company-wide LLM gateway: a single, governed entry point that gives teams self-service access to leading models from providers such as Anthropic, OpenAI and Google, with visibility into usage and cost, configurable budgets and rate limits, and routing across models and providers for efficiency and resilience.
The Opportunity
Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting
Design the APIs, SDKs and self-service tooling that let engineers across Kraken onboard to the gateway quickly and safely
Help teams migrate their LLM workloads onto the gateway with minimal disruption
Implement access control, key management and audit logging in partnership with Security
Instrument the gateway so teams can see latency, errors, token usage and cost for their own workloads
Own features end to end, from design through production, and keep the service reliable alongside SRE
Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap
Contribute to code review, design documents and engineering practices across Dev Platform
Skills You Should HODL
Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production
Strong skills in a backend language such as Rust, Python or TypeScript, with a habit of writing well-tested, maintainable code
Working knowledge of how LLM APIs behave: authentication, streaming responses, token accounting, rate limits and provider failure modes
Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider
Ability to design clean, well-documented APIs for internal customers and to weigh their feedback
Clear written and verbal communication, and the ownership to carry work from idea to production
Nice to Haves
Experience with API gateways, proxies or traffic management
Experience building LLM-powered systems, including routing, caching, evaluation or cost controls
Familiarity with authentication and authorization patterns (OAuth, OIDC, RBAC)
Contributions to open-source infrastructure or developer-platform projects
Stay connected
Standard company text repeated across Kraken's postings is omitted here.