Kong: Cloud-native API and LLM gateway
Lua-based reverse proxy with pluggable architecture.
Learn more about Kong
Kong is an open-source gateway written in Lua and C that sits between clients and backend services to handle traffic routing and policy enforcement. It operates as a reverse proxy with a pluggable architecture, allowing users to extend functionality through custom plugins while maintaining a RESTful admin API for configuration. The system supports multiple deployment models including database-backed, database-less (declarative), and hybrid control plane/data plane separation. Common deployments include Kubernetes ingress controller usage, microservice mesh integration, and API management for both traditional REST APIs and LLM traffic routing across multiple providers.
Plugin-based extensibility
Kong's architecture centers on a plugin system that allows custom logic to be injected at various request/response stages. Over 60 plugins are available for authentication, rate limiting, request transformation, logging, and observability, with a developer hub for creating additional plugins.
Multi-model LLM routing
Kong includes a unified API abstraction layer for routing requests across different LLM providers including OpenAI, Anthropic, AWS Bedrock, Azure AI, and others. This allows switching between providers or load balancing across multiple LLM backends without client-side changes.
Flexible deployment models
Kong supports database-backed deployments, database-less declarative configuration via decK, and hybrid architectures separating control planes from data planes. This flexibility allows deployment in various infrastructure contexts without vendor lock-in.
import requests
admin_api = "http://localhost:8001"
service = requests.post(f"{admin_api}/services", json={
"name": "user-service",
"url": "http://api.example.com/users"
})
route = requests.post(f"{admin_api}/services/user-service/routes", json={
"paths": ["/api/users"],
"methods": ["GET", "POST"]
})Top in Backend & APIs
Related Repositories
Discover similar tools and frameworks used by developers
Spring Framework
Comprehensive framework for building enterprise Java applications with infrastructure support.
Drizzle ORM
Lightweight type-safe SQL query builder for TypeScript.
Dragonfly
In-memory data store with Redis/Memcached API compatibility and multi-threaded C++.
Gin
Fast HTTP router with JSON binding and middleware support.
Node.js
JavaScript runtime built on V8 for server-side development.
Related Reading
Guides and comparisons from the Greptile content library
What is agentic coding? Benefits, risks, and best tools to consider
What engineering leaders need to know about agentic coding: how it differs from AI coding and vibe coding, how it works, the benefits and risks, and the tools worth evaluating.
Automated Code Review: How It Works & Best Tools [2026]
What automated code review is, how it differs from traditional and AI code review, the six types of code review automation tools, and why linters and SAST alone are no longer enough as agentic coding grows.
Guide to Self-Hosted AI Code Review for GitLab and GitHub Enterprise [2026]
How self-hosted AI code review works on GitLab Self-Managed and GitHub Enterprise Server, how it compares to SaaS review tools, what to look for in a self-hosted tool, and what a self-hosted rollout actually takes.
The 7 Best AI Coding Tools for Complex Codebases
The best AI coding tools for complex codebases, ranked on accuracy, suggestion quality, and full-codebase context. See which ones you can actually trust.