AI LLM as Judge

AI License Required
Related Documentation
Made by
Kong Inc.
Supported Gateway Topologies
hybrid db-less traditional
Supported Konnect Deployments
hybrid cloud-gateways serverless
Compatible Protocols
grpc grpcs http https
Minimum Version
Kong Gateway - 3.12
Tags
#ai

3.12.0.0

Release date 2025/10/01

Feature

  • Introduced the AI LLM as Judge plugin, enabling you to evaluate an LLM and use the score as a balancer.

Bugfix

  • Fix an issue where the ai-llm-as-judge plugin didn’t work with non-OpenAI provider configuration.

Something wrong?

Help us make these docs great!

Kong Developer docs are open source. If you find these useful and want to make them better, contribute today!