AI Models in Catalog

Uses: Catalog AI Gateway

Create an AI Model

In the Konnect sidebar, click Catalog.
From the New dropdown menu, select “AI model”.
Under Data source, do one of the following:
1. To manually define providers and models, select Add manually.
2. To import an existing gateway-defined model, select Import from AI gateway, then:
  1. From the AI gateway dropdown menu, select your AI Gateway 2.0 control plane.
  2. From the Model from AI gateway dropdown menu, select the model you want to import.
(Optional) Under Target models, add the providers and models this AI Model routes to:
1. From the Provider dropdown menu, select a provider, for example “OpenAI”.
2. From the Target model dropdown menu, select a model, for example “gpt-3.5-turbo”.
3. (Optional) Click Add target model to add another provider and target model pair.
In the Display name field, enter a name for your AI Model, for example My AI Model.
In the Name field, enter a unique identifier for the AI Model, for example my-ai-model. This must contain only lowercase letters, numbers, hyphens, and periods.
(Optional) In the Version field, enter a version for your AI Model.
(Optional) In the Description field, describe the purpose of your AI Model.
(Optional) Click Show labels, and do the following:
1. In the Key field, enter a label key.
2. In the Value field, enter a label value.
3. (Optional) Click Add another label to add more labels.
Click Create.

You can also link AI Models that you’ve manually created in Catalog to a model on AI Gateway 2.0 by clicking the Gateway tab on a Catalog AI Model’s details page and clicking Link AI gateway.

Send a POST request to the /ai-models endpoint to create an empty AI Model:

AI_MODEL_ID=$(curl -X POST "https://us.api.konghq.com/v1/ai-models" \
     --no-progress-meter --fail-with-body  \
     -H "Authorization: Bearer $KONNECT_TOKEN" \
     --json '{
       "name": "my-ai-model",
       "display_name": "My AI Model",
       "description": "Customer support triage model"
     }' | jq -r ".id"
)

Copied!

Add the providers and target models that this AI Model routes to by sending a POST request to the /ai-models/{aiModelId}/versions endpoint:

curl -X POST "https://us.api.konghq.com/v1/ai-models/$AI_MODEL_ID/versions" \
     --no-progress-meter --fail-with-body  \
     -H "Authorization: Bearer $KONNECT_TOKEN" \
     --json '{
       "version": "1.0.0",
       "target_models": [
         {
           "provider": "openai",
           "name": "gpt-4o"
         }
       ]
     }'

Copied!

Link the AI Model to a model on AI Gateway by sending a POST request to the /ai-models/{aiModelId}/implementations endpoint:

curl -X POST "https://us.api.konghq.com/v1/ai-models/$AI_MODEL_ID/implementations" \
     --no-progress-meter --fail-with-body  \
     -H "Authorization: Bearer $KONNECT_TOKEN" \
     --json '{
       "gateway_control_plane_id": "'$CONTROL_PLANE_ID'",
       "gateway_model_id": "'$GATEWAY_MODEL_ID'"
     }'

Copied!

AI Models in Catalog

Create an AI Model

Help us make these docs great!

Still need help?