Databricks provider

Uses: Kong Gateway AI Gateway Admin API deck KIC Konnect API Terraform

Upstream paths

AI Gateway automatically routes requests to the appropriate Databricks API endpoints. The following table shows the upstream paths used for each capability.

Capability	Upstream path or API
Chat completions	/serving-endpoints/v1/chat/completions

Supported capabilities

The following tables show the AI capabilities supported by Databricks provider when used with the AI Proxy or the AI Proxy Advanced plugin.

Set the plugin’s route_type based on the capability you want to use. See the tables below for supported route types.

Text generation

Support for Databricks basic text generation capabilities including chat, completions, and embeddings:

Capability	Route type	Streaming	Model example	Min version
Chat completions	`llm/v1/chat`	Supported	databricks-gpt-oss-20b	3.14

Databricks base URL

The base URL is https://{databricks_instance}.cloud.databricks.com:443, where {route_type_path} is determined by the capability.

AI Gateway uses this URL automatically. You only need to configure a URL if you’re using a self-hosted or Databricks-compatible endpoint, in which case set the upstream_url plugin option.

Configure Databricks with AI Proxy

To use Databricks with AI Gateway, configure the AI Proxy or AI Proxy Advanced plugin.

Here’s a minimal configuration for chat completions:

kong.yaml

Copied!

_format_version: "3.0"
plugins:
  - name: ai-proxy
    config:
      route_type: llm/v1/chat
      auth:
        header_name: Authorization
        header_value: Bearer ${{ env "DECK_DATABRICKS_TOKEN" }}
      model:
        provider: databricks
        name: databricks-gpt-oss-20b
        options:
          databricks:
            workspace_instance_id: ${{ env "DECK_DATABRICKS_WORKSPACE_INSTANCE_ID" }}

curl -i -X POST http://localhost:8001/plugins/ \
    --header "Accept: application/json" \
    --header "Content-Type: application/json" \
    --data '
    {
      "name": "ai-proxy",
      "config": {
        "route_type": "llm/v1/chat",
        "auth": {
          "header_name": "Authorization",
          "header_value": "Bearer '$DATABRICKS_TOKEN'"
        },
        "model": {
          "provider": "databricks",
          "name": "databricks-gpt-oss-20b",
          "options": {
            "databricks": {
              "workspace_instance_id": "'$DATABRICKS_WORKSPACE_INSTANCE_ID'"
            }
          }
        }
      }
    }
    '

Copied!

Make the following request:

curl -X POST https://{region}.api.konghq.com/v2/control-planes/{controlPlaneId}/core-entities/plugins/ \
    --header "accept: application/json" \
    --header "Content-Type: application/json" \
    --header "Authorization: Bearer $KONNECT_TOKEN" \
    --data '
    {
      "name": "ai-proxy",
      "config": {
        "route_type": "llm/v1/chat",
        "auth": {
          "header_name": "Authorization",
          "header_value": "Bearer '$DATABRICKS_TOKEN'"
        },
        "model": {
          "provider": "databricks",
          "name": "databricks-gpt-oss-20b",
          "options": {
            "databricks": {
              "workspace_instance_id": "'$DATABRICKS_WORKSPACE_INSTANCE_ID'"
            }
          }
        }
      }
    }
    '

Copied!

echo "
apiVersion: configuration.konghq.com/v1
kind: KongClusterPlugin
metadata:
  name:
  namespace: kong
  annotations:
    kubernetes.io/ingress.class: kong
  labels:
    global: 'true'
config:
  route_type: llm/v1/chat
  auth:
    header_name: Authorization
    header_value: Bearer $DATABRICKS_TOKEN
  model:
    provider: databricks
    name: databricks-gpt-oss-20b
    options:
      databricks:
        workspace_instance_id: '$DATABRICKS_WORKSPACE_INSTANCE_ID'
plugin: ai-proxy
" | kubectl apply -f -

Copied!

resource "konnect_gateway_plugin_ai_proxy" "my_ai_proxy" {
  enabled = true

  config = {
    route_type = "llm/v1/chat"

    auth = {
      header_name = "Authorization"
      header_value = "Bearer var.databricks_token"
    }

    model = {
      provider = "databricks"
      name = "databricks-gpt-oss-20b"

      options = {

        databricks = {
          workspace_instance_id = var.databricks_workspace_instance_id
        }
      }
    }
  }

  control_plane_id = konnect_gateway_control_plane.my_konnect_cp.id
}

Copied!

This example requires the following variables to be added to your manifest. You can specify values at runtime by setting TF_VAR_name=value.

variable "databricks_workspace_instance_id" {
  type = string
}

Copied!

For more configuration options and examples, see:

AI Proxy examples

AI Proxy Advanced examples

Databricks provider

Upstream paths

Supported capabilities

Text generation

Databricks base URL

Configure Databricks with AI Proxy

Tutorials

Help us make these docs great!

Still need help?