Create Model - Enkrypt AI

Authorizations

apikey

string

header

required

Body

application/json

model_config

Model Config · object

required

Show child attributes

model_config.model_provider

enum<string>

required

Provider of the model which determines the request response format

Available options:

openai,

together,

huggingface,

groq,

azure_openai,

anthropic,

cohere,

bedrock,

gemini,

ai21,

fireworks,

alibaba,

portkey,

deepseek,

mistral,

llama,

openai_compatible,

cohere_compatible,

anthropic_compatible,

custom,

url,

enkryptai,

sierra,

boxai,

nutanix,

xactly

Example:

"together"

model_config.hosting_type

enum<string>

Hosting type of the model

Available options:

External,

Internal

Example:

"External"

model_config.model_source

string

Source of the model

Example:

"https://together.ai"

model_config.tools

Tool · object[]

Array of tools available to the model

Show child attributes

model_config.tools.name

string

required

Name of the tool

Example:

"web_search"

model_config.tools.description

string

required

Description of what the tool does

Example:

"The tool web search is used to search the web for information related to finance."

Example:

[
  {
    "name": "web_search",
    "description": "The tool web search is used to search the web for information related to finance."
  }
]

model_config.input_modalities

enum<string>[]

Types of input that the model can process

Available options:

text,

image,

audio

Example:

["text"]

model_config.output_modalities

enum<string>[]

Types of output that the model can generate

Available options:

text

Example:

["text"]

model_config.rate_per_min

number

< 100 won't enable async. > 100 will enable async mode. > 200 we can run boosted async (all tests in parallel). Default 20.

Example:

20

model_config.system_prompt

string

System prompt

Example:

""

model_config.endpoint

Endpoint · object

Show child attributes

model_config.endpoint.scheme

string

required

Scheme of the endpoint

Example:

"https"

model_config.endpoint.host

string

required

Host of the endpoint

Example:

"api.together.xyz"

model_config.endpoint.port

integer

required

Port of the endpoint

Example:

443

model_config.endpoint.base_path

string

required

Base path of the endpoint

Example:

"/v1"

model_config.paths

Paths · object

Show child attributes

model_config.paths.completions

string

Example:

"/completions"

model_config.paths.chat

string

Example:

"/chat/completions"

model_config.auth_data

Auth Data · object

Show child attributes

model_config.auth_data.header_name

string

Example:

"Authorization"

model_config.auth_data.header_prefix

string

Example:

"Bearer"

model_config.auth_data.space_after_prefix

boolean

Example:

true

model_config.auth_data.param_name

string

Example:

"token"

model_config.auth_data.azure_client_id

string

Example:

"xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"

model_config.auth_data.azure_client_secret

string

Example:

"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

model_config.auth_data.azure_tenant_id

string

Example:

"xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"

model_config.auth_data.gcp_service_account_json

string

Example:

"{\"type\":\"service_account\",\"project_id\":\"xxxxxxxx\",\"private_key_id\":\"xxxxxxxx\",\"private_key\":\"xxxxxxxx\",\"client_email\":\"xxxxxxxx\",\"client_id\":\"xxxxxxxx\",\"auth_uri\":\"https://accounts.google.com/o/oauth2/auth\",\"token_uri\":\"https://oauth2.googleapis.com/token\",\"auth_provider_x509_cert_url\":\"https://www.googleapis.com/oauth2/v1/certs\",\"client_x509_cert_url\":\"https://www.googleapis.com/robot/v1/metadata/x509/[email protected]\"}"

model_config.auth_data.aws_access_key_id

string

Example:

"xxxxxxxx"

model_config.auth_data.aws_secret_access_key

string

Example:

"xxxxxxxx"

model_config.auth_data.allow_override

boolean

If enabled, the authorization header or parameter can be overridden in the request by the value configured here

Example:

false

model_config.auth_data.boxai_client_id

string

BoxAI client ID for authentication

Example:

"BOX_CLIENT_ID"

model_config.auth_data.boxai_client_secret

string

BoxAI client secret for authentication

Example:

"BOX_CLIENT_SECRET"

model_config.auth_data.boxai_user_id

string

BoxAI user ID for authentication

Example:

"BOX_USER_ID"

model_config.auth_data.boxai_default_file_id

string

BoxAI default file ID for operations

Example:

"BOX_FILE_ID"

model_config.auth_data.nutanix_user_session_id

string

Nutanix user session ID for authentication

Example:

"NUTANIX_USER_SESSION_ID"

model_config.auth_data.nutanix_email_id

string

Nutanix email ID for authentication

Example:

"NUTANIX_EMAIL_ID"

model_config.auth_data.xactly_username

string

Xactly username for authentication

Example:

"XACTLY_USERNAME"

model_config.auth_data.xactly_password

string

Xactly password for authentication

Example:

"XACTLY_PASSWORD"

model_config.apikeys

string[]

Example:

["TOGETHER_AI_API_KEY"]

model_config.model_auth_type

enum<string>

Available options:

apikey,

jwt

Example:

"apikey"

model_config.model_jwt_config

Model Custom Auth Token Config · object

Show child attributes

model_config.model_jwt_config.jwt_method

enum<string>

Available options:

POST,

GET

Example:

"POST"

model_config.model_jwt_config.jwt_url

string

Example:

"https://example.com/api/auth"

model_config.model_jwt_config.jwt_headers

Custom Token Headers · object[]

Array of custom headers to be sent with token requests

Show child attributes

model_config.model_jwt_config.jwt_headers.key

string

required

The name/key of the custom header

Example:

"x-custom-header"

model_config.model_jwt_config.jwt_headers.value

string

required

The value of the custom header

Example:

"custom-value"

Example:

[
  {
    "key": "content-type",
    "value": "application/x-www-form-urlencoded"
  },
  {
    "key": "x-custom-header",
    "value": "custom-value"
  }
]

model_config.model_jwt_config.jwt_body

string

The body of the token request

Example:

"grant_type=client_credentials&client_id=xxxxxxxxxx&client_secret=xxxxxxxxxx"

model_config.model_jwt_config.jwt_response_key

string

The key of the token in the response in jq format

Example:

".access_token"

model_config.custom_curl_command

string

Example:

"curl --location 'https://example.com/api/chat' \\\n--header 'Accept: application/json, text/plain, */*' \\\n--header 'Accept-Language: en-US,en;q=0.9' \\\n--header 'Authorization: {token}' \\\n--header 'Connection: keep-alive' \\\n--header 'Content-Type: application/json' \\\n--data '{\"prompt\":\"{prompt}\"}'"

model_config.custom_headers

Custom Headers · object[]

Array of custom headers to be sent with requests

Show child attributes

model_config.custom_headers.key

string

required

The name/key of the custom header

Example:

"X-Custom-Header"

model_config.custom_headers.value

string

required

The value of the custom header

Example:

"custom-value"

Example:

[
  {
    "key": "X-Custom-Header",
    "value": "custom-value"
  }
]

model_config.custom_payload

Custom Payload · object

A flexible object that can contain any custom key-value pairs for the request payload. Only condition is to include {prompt} in the payload.

Example:

{
  "messages": [
    {
      "role": "developer",
      "content": "You are a helpful assistant."
    },
    { "role": "user", "content": "{prompt}" }
  ]
}

model_config.custom_response_content_type

enum<string>

Content type of the custom response. Currently only supports JSON.

Available options:

json

Example:

"json"

model_config.custom_response_format

string

Optional response format path. Jq format for json type (e.g. '.choices[0].message.content')

Example:

".choices[0].message.content"

model_config.metadata

Metadata · object

Show child attributes

model_config.metadata.max_tokens

integer

Example:

2048

model_config.metadata.input_cost_1M_tokens

number

Example:

2.5

model_config.metadata.output_cost_1M_tokens

number

Example:

10

model_config.metadata.azure_instance

string

If Azure, it's instance type

Example:

"enkrypt2024"

model_config.metadata.azure_api_version

string

If Azure, it's API version

Example:

"2024-02-01"

model_config.metadata.azure_deployment_id

string

If Azure, it's deployment ID

Example:

"gpt3"

model_config.metadata.anthropic_version

string

If Anthropic, it's version

Example:

""

model_config.metadata.llama2_format

enum<string>

If Llama2, it's format

Available options:

openai

Example:

"openai"

model_config.metadata.mistral_format

enum<string>

If Mistral, it's format

Available options:

openai,

ollama

Example:

"openai"

model_config.metadata.gemini

Gemini · object

Show child attributes

model_config.metadata.gemini.api_endpoint

string

If running Gemini on Vertex, specify the regional API endpoint (hostname only)

Example:

""

model_config.metadata.gemini.project_id

string

If running Gemini on Vertex, specify the project ID

Example:

""

model_config.metadata.gemini.location_id

string

If running Gemini on Vertex, specify the location ID

Example:

""

model_config.metadata.bedrock

Bedrock · object

Show child attributes

model_config.metadata.bedrock.aws_region

string

If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option

Example:

""

model_config.metadata.enkryptai

EnkryptAI · object

Show child attributes

model_config.metadata.enkryptai.deployment_name

string

If using EnkryptAI, specify the deployment name

Example:

"test-deployment-1"

model_config.metadata.xactly

Xactly · object

Show child attributes

model_config.metadata.xactly.assistant_id

string

Xactly assistant ID for authentication

Example:

"XACTLY_ASSISTANT_ID"

model_config.default_request_options

Default Request Options · object

Show child attributes

model_config.default_request_options.temperature

number

Example:

1

model_config.default_request_options.top_p

number

Example:

1

model_config.default_request_options.top_k

integer

Example:

0

model_saved_name

string

required

Name of the saved model

Example:

"Test Model"

model_version

string

required

Custom identifier for the model

Example:

"v1"

testing_for

enum<string>

Purpose of testing

Available options:

foundationModels,

chatbotsAndCopilots,

agents,

URL

Example:

"foundationModels"

model_name

string

Name of the model. Required for foundationModels

Example:

"mistralai/Mixtral-8x7B-Instruct-v0.1"

certifications

string[]

List of certifications

Example:

[
  "GDPR",
  "CCPA",
  "HIPAA",
  "SOC 2 Type II",
  "SOC 3"
]

Response

200 - application/json

Successful Response

message

string

Example:

"Model details added successfully"

data

GetModelResponseObject · object

Show child attributes

data.model_config

Model Config · object

required

Show child attributes

data.model_config.model_provider

enum<string>

required

Provider of the model which determines the request response format

Available options:

openai,

together,

huggingface,

groq,

azure_openai,

anthropic,

cohere,

bedrock,

gemini,

ai21,

fireworks,

alibaba,

portkey,

deepseek,

mistral,

llama,

openai_compatible,

cohere_compatible,

anthropic_compatible,

custom,

url,

enkryptai,

sierra,

boxai,

nutanix,

xactly

Example:

"together"

data.model_config.hosting_type

enum<string>

Hosting type of the model

Available options:

External,

Internal

Example:

"External"

data.model_config.model_source

string

Source of the model

Example:

"https://together.ai"

data.model_config.tools

Tool · object[]

Array of tools available to the model

Show child attributes

data.model_config.tools.name

string

required

Name of the tool

Example:

"web_search"

data.model_config.tools.description

string

required

Description of what the tool does

Example:

"The tool web search is used to search the web for information related to finance."

Example:

[
  {
    "name": "web_search",
    "description": "The tool web search is used to search the web for information related to finance."
  }
]

data.model_config.input_modalities

enum<string>[]

Types of input that the model can process

Available options:

text,

image,

audio

Example:

["text"]

data.model_config.output_modalities

enum<string>[]

Types of output that the model can generate

Available options:

text

Example:

["text"]

data.model_config.rate_per_min

number

< 100 won't enable async. > 100 will enable async mode. > 200 we can run boosted async (all tests in parallel). Default 20.

Example:

20

data.model_config.system_prompt

string

System prompt

Example:

""

data.model_config.endpoint

Endpoint · object

Show child attributes

data.model_config.endpoint.scheme

string

required

Scheme of the endpoint

Example:

"https"

data.model_config.endpoint.host

string

required

Host of the endpoint

Example:

"api.together.xyz"

data.model_config.endpoint.port

integer

required

Port of the endpoint

Example:

443

data.model_config.endpoint.base_path

string

required

Base path of the endpoint

Example:

"/v1"

data.model_config.paths

Paths · object

Show child attributes

data.model_config.paths.completions

string

Example:

"/completions"

data.model_config.paths.chat

string

Example:

"/chat/completions"

data.model_config.auth_data

Auth Data · object

Show child attributes

data.model_config.auth_data.header_name

string

Example:

"Authorization"

data.model_config.auth_data.header_prefix

string

Example:

"Bearer"

data.model_config.auth_data.space_after_prefix

boolean

Example:

true

data.model_config.auth_data.param_name

string

Example:

"token"

data.model_config.auth_data.azure_client_id

string

Example:

"xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"

data.model_config.auth_data.azure_client_secret

string

Example:

"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

data.model_config.auth_data.azure_tenant_id

string

Example:

"xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"

data.model_config.auth_data.gcp_service_account_json

string

Example:

data.model_config.auth_data.aws_access_key_id

string

Example:

"xxxxxxxx"

data.model_config.auth_data.aws_secret_access_key

string

Example:

"xxxxxxxx"

data.model_config.auth_data.allow_override

boolean

If enabled, the authorization header or parameter can be overridden in the request by the value configured here

Example:

false

data.model_config.auth_data.boxai_client_id

string

BoxAI client ID for authentication

Example:

"BOX_CLIENT_ID"

data.model_config.auth_data.boxai_client_secret

string

BoxAI client secret for authentication

Example:

"BOX_CLIENT_SECRET"

data.model_config.auth_data.boxai_user_id

string

BoxAI user ID for authentication

Example:

"BOX_USER_ID"

data.model_config.auth_data.boxai_default_file_id

string

BoxAI default file ID for operations

Example:

"BOX_FILE_ID"

data.model_config.auth_data.nutanix_user_session_id

string

Nutanix user session ID for authentication

Example:

"NUTANIX_USER_SESSION_ID"

data.model_config.auth_data.nutanix_email_id

string

Nutanix email ID for authentication

Example:

"NUTANIX_EMAIL_ID"

data.model_config.auth_data.xactly_username

string

Xactly username for authentication

Example:

"XACTLY_USERNAME"

data.model_config.auth_data.xactly_password

string

Xactly password for authentication

Example:

"XACTLY_PASSWORD"

data.model_config.apikeys

string[]

Example:

["TOGETHER_AI_API_KEY"]

data.model_config.model_auth_type

enum<string>

Available options:

apikey,

jwt

Example:

"apikey"

data.model_config.model_jwt_config

Model Custom Auth Token Config · object

Show child attributes

data.model_config.model_jwt_config.jwt_method

enum<string>

Available options:

POST,

GET

Example:

"POST"

data.model_config.model_jwt_config.jwt_url

string

Example:

"https://example.com/api/auth"

data.model_config.model_jwt_config.jwt_headers

Custom Token Headers · object[]

Array of custom headers to be sent with token requests

Show child attributes

data.model_config.model_jwt_config.jwt_headers.key

string

required

The name/key of the custom header

Example:

"x-custom-header"

data.model_config.model_jwt_config.jwt_headers.value

string

required

The value of the custom header

Example:

"custom-value"

Example:

[
  {
    "key": "content-type",
    "value": "application/x-www-form-urlencoded"
  },
  {
    "key": "x-custom-header",
    "value": "custom-value"
  }
]

data.model_config.model_jwt_config.jwt_body

string

The body of the token request

Example:

"grant_type=client_credentials&client_id=xxxxxxxxxx&client_secret=xxxxxxxxxx"

data.model_config.model_jwt_config.jwt_response_key

string

The key of the token in the response in jq format

Example:

".access_token"

data.model_config.custom_curl_command

string

Example:

data.model_config.custom_headers

Custom Headers · object[]

Array of custom headers to be sent with requests

Show child attributes

data.model_config.custom_headers.key

string

required

The name/key of the custom header

Example:

"X-Custom-Header"

data.model_config.custom_headers.value

string

required

The value of the custom header

Example:

"custom-value"

Example:

[
  {
    "key": "X-Custom-Header",
    "value": "custom-value"
  }
]

data.model_config.custom_payload

Custom Payload · object

A flexible object that can contain any custom key-value pairs for the request payload. Only condition is to include {prompt} in the payload.

Example:

{
  "messages": [
    {
      "role": "developer",
      "content": "You are a helpful assistant."
    },
    { "role": "user", "content": "{prompt}" }
  ]
}

data.model_config.custom_response_content_type

enum<string>

Content type of the custom response. Currently only supports JSON.

Available options:

json

Example:

"json"

data.model_config.custom_response_format

string

Optional response format path. Jq format for json type (e.g. '.choices[0].message.content')

Example:

".choices[0].message.content"

data.model_config.metadata

Metadata · object

Show child attributes

data.model_config.metadata.max_tokens

integer

Example:

2048

data.model_config.metadata.input_cost_1M_tokens

number

Example:

2.5

data.model_config.metadata.output_cost_1M_tokens

number

Example:

10

data.model_config.metadata.azure_instance

string

If Azure, it's instance type

Example:

"enkrypt2024"

data.model_config.metadata.azure_api_version

string

If Azure, it's API version

Example:

"2024-02-01"

data.model_config.metadata.azure_deployment_id

string

If Azure, it's deployment ID

Example:

"gpt3"

data.model_config.metadata.anthropic_version

string

If Anthropic, it's version

Example:

""

data.model_config.metadata.llama2_format

enum<string>

If Llama2, it's format

Available options:

openai

Example:

"openai"

data.model_config.metadata.mistral_format

enum<string>

If Mistral, it's format

Available options:

openai,

ollama

Example:

"openai"

data.model_config.metadata.gemini

Gemini · object

Show child attributes

data.model_config.metadata.gemini.api_endpoint

string

If running Gemini on Vertex, specify the regional API endpoint (hostname only)

Example:

""

data.model_config.metadata.gemini.project_id

string

If running Gemini on Vertex, specify the project ID

Example:

""

data.model_config.metadata.gemini.location_id

string

If running Gemini on Vertex, specify the location ID

Example:

""

data.model_config.metadata.bedrock

Bedrock · object

Show child attributes

data.model_config.metadata.bedrock.aws_region

string

If using AWS providers (Bedrock) you can override the default AWS_REGION 'us-east-1' by setting this option

Example:

""

data.model_config.metadata.enkryptai

EnkryptAI · object

Show child attributes

data.model_config.metadata.enkryptai.deployment_name

string

If using EnkryptAI, specify the deployment name

Example:

"test-deployment-1"

data.model_config.metadata.xactly

Xactly · object

Show child attributes

data.model_config.metadata.xactly.assistant_id

string

Xactly assistant ID for authentication

Example:

"XACTLY_ASSISTANT_ID"

data.model_config.default_request_options

Default Request Options · object

Show child attributes

data.model_config.default_request_options.temperature

number

Example:

1

data.model_config.default_request_options.top_p

number

Example:

1

data.model_config.default_request_options.top_k

integer

Example:

0

data.model_saved_name

string

required

Name of the saved model

Example:

"Test Model"

data.model_version

string

required

Custom identifier for the model

Example:

"v1"

data.testing_for

enum<string>

Purpose of testing

Available options:

foundationModels,

chatbotsAndCopilots,

agents,

URL

Example:

"foundationModels"

data.model_name

string

Name of the model. Required for foundationModels

Example:

"mistralai/Mixtral-8x7B-Instruct-v0.1"

data.certifications

string[]

List of certifications

Example:

[
  "GDPR",
  "CCPA",
  "HIPAA",
  "SOC 2 Type II",
  "SOC 3"
]

data.model_id

integer

Example:

1234567890

data.created_at

string<date-time>

Example:

"2024-10-15T17:22:47.872389+00:00"

data.updated_at

string<date-time>

Example:

"2024-10-15T17:22:47.872389+00:00"

data.project_name

string

Example:

"default"

Example:

{
  "testing_for": "foundationModels",
  "model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
  "certifications": [],
  "model_config": {
    "paths": {
      "chat": "/chat/completions",
      "completions": "/completions"
    },
    "apikeys": ["xxxxx"],
    "endpoint": {
      "host": "api.together.xyz",
      "port": 443,
      "scheme": "https",
      "base_path": "/v1"
    },
    "auth_data": {
      "header_name": "Authorization",
      "header_prefix": "Bearer",
      "space_after_prefix": true
    },
    "input_modalities": ["text"],
    "output_modalities": ["text"],
    "model_source": "https://together.ai",
    "system_prompt": "",
    "tools": [
      {
        "name": "web_search",
        "description": "The tool web search is used to search the web for information related to finance."
      }
    ],
    "metadata": {},
    "default_request_options": {}
  },
  "model_saved_name": "Test Model",
  "model_version": "v1",
  "created_at": "2024-10-15T17:22:47.872389+00:00",
  "updated_at": "2024-10-15T17:22:47.872389+00:00",
  "model_id": 1234567890,
  "model_provider": "together",
  "project_name": "default",
  "hosting_type": "External"
}

API Reference

Authorizations

Body

Response