Ideavo
BYOK

Custom Provider

Connect local and self-hosted AI providers to Ideavo for flexible model routing beyond the built-in provider list.

Custom Providers

Ideavo allows you to connect model providers outside of its built-in provider list, including local models, self-hosted endpoints, and custom cloud providers, at no extra cost.

Using a Supported Provider?

Custom Providers are for local models, self-hosted endpoints, custom Base URLs, and provider configurations you control yourself. If you only want to connect a provider that Ideavo already supports with an API key or OAuth, use BYOK instead.

Add a Custom Provider

Click Add Provider to open the provider setup dialog. The dialog has two modes:

  • Form mode for the guided setup experience.
  • Raw mode for editing the provider configuration directly as JSON.
Custom provider form dialogCustom provider raw JSON dialog

Form Mode

Form mode is the recommended setup path for most users. It keeps the configuration structured and helps avoid JSON syntax mistakes.

FieldWhat to enter
Provider IDA unique ID for the provider. This is the technical identifier Ideavo uses internally. Use a stable, lowercase value such as local-ollama or my-openai-compatible.
NameA display name for the provider. This can be any name you want users to see in Ideavo, such as Local Ollama or My Provider.
PackageThe SDK package that matches the provider implementation. Choose one of the supported packages listed below.
API keyThe credential used to authenticate with the provider. Some custom providers may not require one, but hosted providers usually do.
Base URLThe exact API endpoint Ideavo should send model requests to.
Model IDThe exact model identifier expected by the provider API. This must match the provider's model ID.
Model nameA friendly display name for the model inside Ideavo. This can be any name you want to show in the model picker.
Context limitOptional. The model's total context window, in tokens.
Output limitOptional. The maximum output tokens the model can return.

Make sure the Base URL is exact, including the protocol, hostname, port, and API path when required. An incorrect Base URL is one of the most common reasons a custom provider fails to connect.

Supported Packages

Ideavo supports and tests these SDK packages by default:

PackageProvider type
@ai-sdk/openai-compatibleOpenAI-compatible APIs and many custom/self-hosted providers
@ai-sdk/openaiOpenAI
@ai-sdk/anthropicAnthropic
@ai-sdk/googleGoogle
ollama-ai-providerOllama

Choose the package that matches the API format exposed by your provider. For custom providers that expose an OpenAI-compatible API, @ai-sdk/openai-compatible is usually the right choice.

Models

Each custom provider needs at least one model. Click Add in the Models section to open the model details dialog.

  • Model ID is the provider-facing value used in API calls. It must be exact.
  • Model name is the readable label shown in Ideavo. You can name it whatever helps your team recognize the model.
  • Limits are optional context and output token values for the model.
  • Reasoning should only be enabled for models that truly support reasoning or effort controls.

For example, a local Ollama model ID might be llama3.2, while the display name could be Llama 3.2 Local.

Custom provider model details dialog

Model limits are optional, but they help Ideavo understand when a conversation is approaching the model's usable context window. If limits are not added, long conversations for that custom model may never compact automatically.

Enable Reasoning only if the model and provider API support it. If enabled incorrectly, requests may fail or produce unexpected responses. See Effort for how reasoning effort works.

Raw Mode

Raw mode is built for power users who want full control over the provider configuration. It lets you edit the same configuration directly in JSON, including provider options and model definitions.

Use raw mode when you need to customize advanced settings that are not exposed in the form, or when you already have a provider config you want to paste in directly.

To set model limits in raw mode, add limit.context and limit.output inside the model definition.

{
  "providerId": "local-ollama",
  "npm": "ollama-ai-provider",
  "name": "Local Ollama",
  "options": {
    "baseURL": "http://localhost:11434/api"
  },
  "models": {
    "llama3.2": {
      "name": "Llama 3.2 Local",
      "tools": "true",
      "limit": {
        "context": 128000,
        "output": 8192
      },
      "reasoning": false
    }
  }
}

Raw mode gives maximum flexibility, but Ideavo expects valid JSON and exact provider values. If you are unsure, start in form mode and switch to raw mode only after the basic provider details are filled in.

Manage Existing Providers

After you add a custom provider, it appears in the provider panel. From there, you can open the provider again, review its configuration, edit model details, or remove it completely.

View Your Providers

Your saved custom providers are listed in the provider panel. This is the main place to confirm which custom or self-hosted providers are currently available in your account.

Custom provider panel with added providers

Edit a Provider

Click an existing provider to open the edit dialog. You can update most of the configuration, including the provider name, package, API key, Base URL, model list, and model limits.

Edit custom provider dialog

This is useful when you rotate credentials, move a custom provider to a different port, rename a model, update context/output limits, or add another model exposed by the same provider.

The Provider ID cannot be changed after the provider is created. It stays disabled in form mode, and editing it in raw mode will not update the saved provider ID.

Delete a Provider

Use Delete when you no longer want Ideavo to use that provider. Deleting a provider removes it from your custom provider list and also removes its models from the model selector.

If you only need to change credentials, Base URL, package, or model names, edit the existing provider instead of deleting and recreating it.

Use a Local Model

Every custom provider needs at least one model before it can be used for building in Ideavo. Once a provider and model are saved, the model appears in the model selector under that provider's name.

Custom provider model shown in the model selector

Select the Model

Open the model selector, expand your custom provider, and choose the model you added. Ideavo will then route future model requests through your provider using the selected model ID.

The label shown in the selector comes from the Model name field, while the actual request uses the Model ID configured for that model.

If your model does not appear in the selector, confirm that the provider was saved successfully and that at least one model is configured for it.

FAQ

On this page