Skip to main content

AI Proxy Quickstart

We can use OpenAI SDK to use EnkryptAI deployment we created. It takes care of proxying correctly to the model saved in the deployment and applying the input, output guardrails set in the deployment.

Install required libraries

Shell

Setup your deployment

Please create a sample policy, sample model and then a sample deployment before proceeding with the below steps. See AI Proxy Quickstart

Example Usage