Skip to main content

Provider Configuration

Providers represent the external AI services and models that power your Javelin routes, including both open-source and closed-source Large Language Models (LLMs). This guide outlines how to configure provider objects, including endpoint details and API credentials.

Provider Configuration

Provider Object

provider:
name: "openai"
reserved_name: "openai"
config:
api_base: "https://api.openai.com"

Provider Fields

NameTypeRequiredDefaultDescription
namestringYesUnique identifier for the provider. Typically reflects the vendor or service (e.g., openai).
reserved_nameobjectYesIdentifies the provider vendor (e.g., openai, amazon, cohere) and is used internally by Javelin.
configobjectYesConnection settings used to interact with the provider. See config fields below.

Config Fields

NameTypeRequiredDefaultDescription
api_basestringYesBase URL for API requests (e.g., https://api.openai.com).
note

Each provider object is independently defined and referenced within each route's configuration. This allows full flexibility in supporting different providers across different routes.