Models API Documentation
Get Defaults
Authorizations
Response
openai, together, huggingface, groq, anyscale, azure, anthropic, cohere, amazon_bedrock, gemini, mistral, llama2, llama3 Base path of the endpoint
Host of the endpoint
Port of the endpoint
Scheme of the endpoint
The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot Base path of the endpoint
Host of the endpoint
Port of the endpoint
Scheme of the endpoint
The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot The request response format the model is compatible with
openai, azure, anthropic, cohere, mistral, llama2 Conversation template
Hosting type of the model
External, Internal If Anthropic, it's version
If Azure, it's API version
If Azure, it's deployment ID
If Azure, it's instance type
If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option
If running Gemini on Vertex, specify the regional API endpoint (hostname only)
If running Gemini on Vertex, specify the location ID
If running Gemini on Vertex, specify the project ID
If Llama2, it's format
raw, openai, ollama If Mistral, it's format
openai, ollama Provider of the model
Source of the model
Custom identifier for the model
System prompt
Name of the model
Name of the saved model
List of certifications
Type of the model
text_2_text Purpose of testing
Copilot, LLM, Chatbot