AI NVIDIA NeMo Guardrail Policy

Check requests with an inline guardrail configuration

Configure the AI NVIDIA NeMo Guardrail policy to send a complete guardrail configuration to NeMo with every check. AI Gateway forwards config.guardrails.config to NeMo as-is and doesn’t validate it, so configuration errors appear only when NeMo rejects the check. The model named in guardrails.config.models must be available to the NeMo microservice.

Prerequisites

Environment variables

  • OPENAI_API_KEY: The OpenAI API key that the NeMo Guardrails microservice uses to evaluate your rails.

Set up the policy

Attach the policy

Help us make these docs great!

Kong Developer docs are open source. If you find these useful and want to make them better, contribute today!