Skip to main content

Bring your own AI model

How to connect your own LLM via API key and use it inside Octonous.

Octonous runs on a default AI model. If you have a specific model you'd prefer (your own deployment of Claude or GPT-4, for example), you can connect it.

How to add a custom model:

  1. Go to Settings → Custom models

  2. Click Add model

  3. Enter the API endpoint and your API key

  4. Give it a name and save

Once added, select it when starting a conversation or building an automation.

Why this is useful:

  • Use a model you've already paid for to avoid double costs

  • Use a fine-tuned or internally hosted model

  • Test different models for specific tasks

Your API key is encrypted at rest using KMS envelope encryption.

Did this answer your question?