Custom LLM configuration

By default, AI Architect uses Bito's LLM, covered by your Bito API key. To bring your own key (BYOK), point AI Architect at a supported provider.

Configure a provider during installation, or at any time with:

bitoarch update-llm-config

Supported providers

Provider	Credentials required	Model
Anthropic	API key	Provider default
OpenAI	API key	Provider default
Google Gemini	API key	Optional (workspace default if omitted)
Azure AI	API key + endpoint URL	Deployment name
AWS Bedrock	Access key ID + secret + region	Provider default
Google Vertex AI	Service-account JSON + project ID + region	Optional (workspace default if omitted)
Portkey	API token (+ optional gateway URL)	Required, as @provider/model

• Portkey is an exclusive gateway. When configured, it routes all requests, and other providers are not used.

• Where the model is optional, leaving it blank uses the current workspace default managed by AI Architect.

• With an Anthropic key, indexing costs approximately $1 per MB of indexable code.

Model format notes. Portkey requires the @provider/model-name format (for example @openai/gpt-4o). Azure AI uses your deployment name rather than a base model name. Vertex AI and Gemini accept an optional model; leave it blank to use the workspace default.

Change the provider later

bitoarch update-llm-config   # reconfigure the provider or model
bitoarch show-config         # confirm the active configuration

Changing the provider or model does not re-index automatically. Run bitoarch index-repos if you want existing repositories re-indexed with the new model.