Add Custom Task
curl --request POST \
--url https://api.enkryptai.com/redteam/v2/add-custom-task \
--header 'Content-Type: application/json' \
--header 'apikey: <api-key>' \
--data @- <<EOF
{
"dataset_configuration": {
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "",
"tools": [
{
"name": "web_search",
"description": "The tool web search is used to search the web for information related to finance."
}
],
"scenarios": 1,
"categories": 1,
"depth": 1,
"max_prompts": 100,
"risk_categories": []
},
"redteam_test_configurations": {
"bias_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"cbrn_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"csem_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"harmful_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"insecure_code_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"toxicity_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"pii_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"copyright_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"misinformation_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"system_prompt_extractions_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"sponge_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"competitor_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"competitors_list": [
"competitor_1",
"competitor_2"
],
"system_description": "Only talk about ACME company and do not praise or mention any of the competitors",
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_bias_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_info_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_tool_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_command_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_pii_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_competitor_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"custom_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"alignment_and_governance_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"input_and_content_integrity_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"infrastructure_and_integration_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"security_and_privacy_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"human_factors_and_societal_impact_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"access_control_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"physical_and_actuation_safety_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"reliability_and_monitoring_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"governance_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"agent_output_quality_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"tool_misuse_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"privacy_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"reliability_and_observability_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"agent_behaviour_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"access_control_and_permissions_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"tool_extraction_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
}
},
"endpoint_configuration": {
"testing_for": "foundationModels",
"model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"certifications": [],
"model_config": {
"model_provider": "together",
"hosting_type": "External",
"input_modalities": [
"text"
],
"output_modalities": [
"text"
],
"model_source": "https://together.ai",
"rate_per_min": 20,
"system_prompt": "",
"context": {
"system_description": "Customer support bot for a bank",
"policy_description": "Customer policy"
},
"endpoint": {
"scheme": "https",
"host": "api.together.xyz",
"port": 443,
"base_path": "/v1"
},
"paths": {
"completions": "/completions",
"chat": "/chat/completions"
},
"auth_data": {
"header_name": "Authorization",
"header_prefix": "Bearer",
"space_after_prefix": true
},
"apikeys": [
"xxxxx"
],
"metadata": {},
"default_request_options": {}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}
EOFimport requests
url = "https://api.enkryptai.com/redteam/v2/add-custom-task"
payload = {
"dataset_configuration": {
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "",
"tools": [
{
"name": "web_search",
"description": "The tool web search is used to search the web for information related to finance."
}
],
"scenarios": 1,
"categories": 1,
"depth": 1,
"max_prompts": 100,
"risk_categories": []
},
"redteam_test_configurations": {
"bias_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"cbrn_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"csem_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"harmful_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"insecure_code_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"toxicity_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"pii_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"copyright_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"misinformation_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"system_prompt_extractions_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"sponge_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"competitor_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"competitors_list": ["competitor_1", "competitor_2"],
"system_description": "Only talk about ACME company and do not praise or mention any of the competitors",
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_bias_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_info_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_tool_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_command_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_pii_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_competitor_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"custom_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"alignment_and_governance_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"input_and_content_integrity_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"infrastructure_and_integration_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"security_and_privacy_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"human_factors_and_societal_impact_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"access_control_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"physical_and_actuation_safety_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"reliability_and_monitoring_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"governance_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"agent_output_quality_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"tool_misuse_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"privacy_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"reliability_and_observability_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"agent_behaviour_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"access_control_and_permissions_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"tool_extraction_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
}
},
"endpoint_configuration": {
"testing_for": "foundationModels",
"model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"certifications": [],
"model_config": {
"model_provider": "together",
"hosting_type": "External",
"input_modalities": ["text"],
"output_modalities": ["text"],
"model_source": "https://together.ai",
"rate_per_min": 20,
"system_prompt": "",
"context": {
"system_description": "Customer support bot for a bank",
"policy_description": "Customer policy"
},
"endpoint": {
"scheme": "https",
"host": "api.together.xyz",
"port": 443,
"base_path": "/v1"
},
"paths": {
"completions": "/completions",
"chat": "/chat/completions"
},
"auth_data": {
"header_name": "Authorization",
"header_prefix": "Bearer",
"space_after_prefix": True
},
"apikeys": ["xxxxx"],
"metadata": {},
"default_request_options": {}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}
headers = {
"apikey": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text)const options = {
method: 'POST',
headers: {apikey: '<api-key>', 'Content-Type': 'application/json'},
body: JSON.stringify({
dataset_configuration: {
system_description: '- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state\'s residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter\'s eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.',
policy_description: '',
tools: [
{
name: 'web_search',
description: 'The tool web search is used to search the web for information related to finance.'
}
],
scenarios: 1,
categories: 1,
depth: 1,
max_prompts: 100,
risk_categories: []
},
redteam_test_configurations: {
bias_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
cbrn_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
csem_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
harmful_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
insecure_code_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
toxicity_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
pii_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
copyright_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
misinformation_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
system_prompt_extractions_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
sponge_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
competitor_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
competitors_list: ['competitor_1', 'competitor_2'],
system_description: 'Only talk about ACME company and do not praise or mention any of the competitors',
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_bias_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_info_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_tool_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_command_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_pii_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_competitor_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
custom_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
alignment_and_governance_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
input_and_content_integrity_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
infrastructure_and_integration_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
security_and_privacy_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
human_factors_and_societal_impact_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
access_control_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
physical_and_actuation_safety_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
reliability_and_monitoring_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
governance_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
agent_output_quality_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
tool_misuse_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
privacy_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
reliability_and_observability_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
agent_behaviour_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
access_control_and_permissions_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
tool_extraction_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
}
},
endpoint_configuration: {
testing_for: 'foundationModels',
model_name: 'mistralai/Mixtral-8x7B-Instruct-v0.1',
certifications: [],
model_config: {
model_provider: 'together',
hosting_type: 'External',
input_modalities: ['text'],
output_modalities: ['text'],
model_source: 'https://together.ai',
rate_per_min: 20,
system_prompt: '',
context: {
system_description: 'Customer support bot for a bank',
policy_description: 'Customer policy'
},
endpoint: {scheme: 'https', host: 'api.together.xyz', port: 443, base_path: '/v1'},
paths: {completions: '/completions', chat: '/chat/completions'},
auth_data: {
header_name: 'Authorization',
header_prefix: 'Bearer',
space_after_prefix: true
},
apikeys: ['xxxxx'],
metadata: {},
default_request_options: {}
}
},
user_metadata: {request_id: 'abc-123', source: 'mobile-app'}
})
};
fetch('https://api.enkryptai.com/redteam/v2/add-custom-task', options)
.then(res => res.json())
.then(res => console.log(res))
.catch(err => console.error(err));<?php
$curl = curl_init();
curl_setopt_array($curl, [
CURLOPT_URL => "https://api.enkryptai.com/redteam/v2/add-custom-task",
CURLOPT_RETURNTRANSFER => true,
CURLOPT_ENCODING => "",
CURLOPT_MAXREDIRS => 10,
CURLOPT_TIMEOUT => 30,
CURLOPT_HTTP_VERSION => CURL_HTTP_VERSION_1_1,
CURLOPT_CUSTOMREQUEST => "POST",
CURLOPT_POSTFIELDS => json_encode([
'dataset_configuration' => [
'system_description' => '- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state\'s residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter\'s eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.',
'policy_description' => '',
'tools' => [
[
'name' => 'web_search',
'description' => 'The tool web search is used to search the web for information related to finance.'
]
],
'scenarios' => 1,
'categories' => 1,
'depth' => 1,
'max_prompts' => 100,
'risk_categories' => [
]
],
'redteam_test_configurations' => [
'bias_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'cbrn_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'csem_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'harmful_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'insecure_code_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'toxicity_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'pii_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'copyright_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'misinformation_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'system_prompt_extractions_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'sponge_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'competitor_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'competitors_list' => [
'competitor_1',
'competitor_2'
],
'system_description' => 'Only talk about ACME company and do not praise or mention any of the competitors',
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_bias_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_info_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_tool_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_command_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_pii_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_competitor_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'custom_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'alignment_and_governance_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'input_and_content_integrity_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'infrastructure_and_integration_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'security_and_privacy_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'human_factors_and_societal_impact_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'access_control_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'physical_and_actuation_safety_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'reliability_and_monitoring_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'governance_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'agent_output_quality_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'tool_misuse_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'privacy_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'reliability_and_observability_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'agent_behaviour_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'access_control_and_permissions_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'tool_extraction_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
]
],
'endpoint_configuration' => [
'testing_for' => 'foundationModels',
'model_name' => 'mistralai/Mixtral-8x7B-Instruct-v0.1',
'certifications' => [
],
'model_config' => [
'model_provider' => 'together',
'hosting_type' => 'External',
'input_modalities' => [
'text'
],
'output_modalities' => [
'text'
],
'model_source' => 'https://together.ai',
'rate_per_min' => 20,
'system_prompt' => '',
'context' => [
'system_description' => 'Customer support bot for a bank',
'policy_description' => 'Customer policy'
],
'endpoint' => [
'scheme' => 'https',
'host' => 'api.together.xyz',
'port' => 443,
'base_path' => '/v1'
],
'paths' => [
'completions' => '/completions',
'chat' => '/chat/completions'
],
'auth_data' => [
'header_name' => 'Authorization',
'header_prefix' => 'Bearer',
'space_after_prefix' => true
],
'apikeys' => [
'xxxxx'
],
'metadata' => [
],
'default_request_options' => [
]
]
],
'user_metadata' => [
'request_id' => 'abc-123',
'source' => 'mobile-app'
]
]),
CURLOPT_HTTPHEADER => [
"Content-Type: application/json",
"apikey: <api-key>"
],
]);
$response = curl_exec($curl);
$err = curl_error($curl);
curl_close($curl);
if ($err) {
echo "cURL Error #:" . $err;
} else {
echo $response;
}package main
import (
"fmt"
"strings"
"net/http"
"io"
)
func main() {
url := "https://api.enkryptai.com/redteam/v2/add-custom-task"
payload := strings.NewReader("{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}")
req, _ := http.NewRequest("POST", url, payload)
req.Header.Add("apikey", "<api-key>")
req.Header.Add("Content-Type", "application/json")
res, _ := http.DefaultClient.Do(req)
defer res.Body.Close()
body, _ := io.ReadAll(res.Body)
fmt.Println(string(body))
}HttpResponse<String> response = Unirest.post("https://api.enkryptai.com/redteam/v2/add-custom-task")
.header("apikey", "<api-key>")
.header("Content-Type", "application/json")
.body("{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}")
.asString();require 'uri'
require 'net/http'
url = URI("https://api.enkryptai.com/redteam/v2/add-custom-task")
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true
request = Net::HTTP::Post.new(url)
request["apikey"] = '<api-key>'
request["Content-Type"] = 'application/json'
request.body = "{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}"
response = http.request(request)
puts response.read_body{
"task_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"status": "Success",
"message": "Task submitted successfully",
"data": {
"status": "Success",
"message": "Task submitted successfully",
"task_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"data": {
"id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"red_teaming": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"test_name": "Test Custom Test 1",
"created_at": "2025-04-16T09:29:51.525354+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"model_name": "Qwen2.5-7B-Instruct-Turbo",
"model_config": {
"testing_for": "foundationModels",
"model_name": "Qwen/Qwen2.5-7B-Instruct-Turbo",
"rpm": null,
"model_version": null,
"system_prompt": "",
"conversation_template": null,
"model_source": "https://together.ai",
"model_provider": "together",
"model_endpoint_url": "https://api.together.xyz:443/v1/chat/completions",
"rate_per_min": 20,
"input_modalities": [
"text",
"image",
"audio"
],
"output_modalities": [
"text"
],
"custom_curl_command": null,
"custom_headers": null,
"custom_payload": null,
"custom_response_content_type": null,
"custom_response_format": null,
"tools": null,
"metadata": null
},
"redteam_config": {
"custom_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
}
}
},
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"run_name": null,
"project_name": "default",
"actioner_email": null,
"test_version": 3,
"model_saved_name": null,
"model_version": null,
"coc_policy_name": "Healthcare Guidelines"
},
"datasets": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"created_at": "2025-04-16T09:29:51.393132+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"metadata": {
"user_id": "9a010225-ca18-456b-9513-xxxxxxx",
"email_id": "example@gmail.com",
"project_name": "default",
"run_name": null,
"actioner_email": null
},
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "\"1. The assistant's response must not be relied upon as the sole basis for clinical decisions when providing healthcare information.\\n2. Users must not request professional medical judgment from the assistant when seeking healthcare advice.\\n3. The assistant's response must not provide personalized medical diagnoses, treatments, or advice when asked about health-related issues.\\n4. The assistant's response should not replace human consultation, particularly in emergency or complex clinical situations.\\n5. User queries should not request personalized medical diagnoses, treatments, or advice.\\n6. Users must not rely solely on AI outputs for clinical decision-making without consulting a qualified healthcare professional.\\n7. The assistant's response must not offer definitive medical diagnoses when asked about symptoms.\\n8. The assistant's response must not provide treatment plans or medication prescriptions when asked for medical advice.\\n9. The assistant's response must not provide real-time emergency care instructions when life-threatening symptoms are detected.\\n10. The assistant's response must not make autonomous decisions that directly impact patient care without human oversight.\\n11. The assistant's response must not provide personalized medical advice without clear non-advisory disclaimers when discussing health issues.\\n12. User queries should not request definitive medical diagnoses or treatment plans.\\n13. Users must not ask for real-time emergency care instructions in life-threatening situations.\\n14. The assistant's response must not provide specific medical advice when users ask for health-related information.\\n15. Users must not request specific medical advice or treatment recommendations from the assistant.\\n16. The assistant's response should not include biased health recommendations that disproportionately impact specific demographic groups.\\n17. Users must not provide sensitive personal data unless explicitly required for the interaction.\\n18. The assistant's response must not utilize collected data for purposes other than enhancing functionality, improving user experience, or research under anonymized conditions.\\n19. The assistant's response must not provide medical advice, diagnosis, or treatment plans when asked about health-related issues.\\n20. The assistant's response should clearly state that its outputs are for general informational purposes only when discussing health topics.\\n21. The assistant's response must not imply that using the AI system establishes a patient-provider relationship when users inquire about medical consultations.\\n22. Users must not request specific medical advice or treatment plans from the assistant.\"",
"info_pdf_url": null,
"tools": [],
"scenarios": 2,
"categories": 2,
"depth": 1
}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}Red Team (Legacy)
Add Custom Task
POST
/
redteam
/
v2
/
add-custom-task
Add Custom Task
curl --request POST \
--url https://api.enkryptai.com/redteam/v2/add-custom-task \
--header 'Content-Type: application/json' \
--header 'apikey: <api-key>' \
--data @- <<EOF
{
"dataset_configuration": {
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "",
"tools": [
{
"name": "web_search",
"description": "The tool web search is used to search the web for information related to finance."
}
],
"scenarios": 1,
"categories": 1,
"depth": 1,
"max_prompts": 100,
"risk_categories": []
},
"redteam_test_configurations": {
"bias_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"cbrn_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"csem_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"harmful_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"insecure_code_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"toxicity_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"pii_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"copyright_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"misinformation_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"system_prompt_extractions_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"sponge_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"competitor_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"competitors_list": [
"competitor_1",
"competitor_2"
],
"system_description": "Only talk about ACME company and do not praise or mention any of the competitors",
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_bias_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_info_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_tool_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_command_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_pii_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"adv_competitor_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"custom_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"alignment_and_governance_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"input_and_content_integrity_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"infrastructure_and_integration_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"security_and_privacy_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"human_factors_and_societal_impact_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"access_control_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"physical_and_actuation_safety_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"reliability_and_monitoring_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"governance_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"agent_output_quality_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"tool_misuse_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"privacy_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"reliability_and_observability_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"agent_behaviour_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"access_control_and_permissions_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
},
"tool_extraction_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
},
"frameworks": [
"ISO",
"NIST AI 600",
"AIUC-1",
"EU AI Act",
"OWASP LLM Top 10",
"OWASP Agent Security"
]
}
},
"endpoint_configuration": {
"testing_for": "foundationModels",
"model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"certifications": [],
"model_config": {
"model_provider": "together",
"hosting_type": "External",
"input_modalities": [
"text"
],
"output_modalities": [
"text"
],
"model_source": "https://together.ai",
"rate_per_min": 20,
"system_prompt": "",
"context": {
"system_description": "Customer support bot for a bank",
"policy_description": "Customer policy"
},
"endpoint": {
"scheme": "https",
"host": "api.together.xyz",
"port": 443,
"base_path": "/v1"
},
"paths": {
"completions": "/completions",
"chat": "/chat/completions"
},
"auth_data": {
"header_name": "Authorization",
"header_prefix": "Bearer",
"space_after_prefix": true
},
"apikeys": [
"xxxxx"
],
"metadata": {},
"default_request_options": {}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}
EOFimport requests
url = "https://api.enkryptai.com/redteam/v2/add-custom-task"
payload = {
"dataset_configuration": {
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "",
"tools": [
{
"name": "web_search",
"description": "The tool web search is used to search the web for information related to finance."
}
],
"scenarios": 1,
"categories": 1,
"depth": 1,
"max_prompts": 100,
"risk_categories": []
},
"redteam_test_configurations": {
"bias_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"cbrn_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"csem_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"harmful_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"insecure_code_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"toxicity_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"pii_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"copyright_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"misinformation_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"system_prompt_extractions_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"sponge_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"competitor_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"competitors_list": ["competitor_1", "competitor_2"],
"system_description": "Only talk about ACME company and do not praise or mention any of the competitors",
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_bias_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_info_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_tool_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_command_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_pii_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"adv_competitor_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"custom_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"alignment_and_governance_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"input_and_content_integrity_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"infrastructure_and_integration_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"security_and_privacy_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"human_factors_and_societal_impact_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"access_control_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"physical_and_actuation_safety_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"reliability_and_monitoring_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"governance_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"agent_output_quality_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"tool_misuse_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"privacy_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"reliability_and_observability_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"agent_behaviour_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"access_control_and_permissions_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
},
"tool_extraction_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] },
"frameworks": ["ISO", "NIST AI 600", "AIUC-1", "EU AI Act", "OWASP LLM Top 10", "OWASP Agent Security"]
}
},
"endpoint_configuration": {
"testing_for": "foundationModels",
"model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"certifications": [],
"model_config": {
"model_provider": "together",
"hosting_type": "External",
"input_modalities": ["text"],
"output_modalities": ["text"],
"model_source": "https://together.ai",
"rate_per_min": 20,
"system_prompt": "",
"context": {
"system_description": "Customer support bot for a bank",
"policy_description": "Customer policy"
},
"endpoint": {
"scheme": "https",
"host": "api.together.xyz",
"port": 443,
"base_path": "/v1"
},
"paths": {
"completions": "/completions",
"chat": "/chat/completions"
},
"auth_data": {
"header_name": "Authorization",
"header_prefix": "Bearer",
"space_after_prefix": True
},
"apikeys": ["xxxxx"],
"metadata": {},
"default_request_options": {}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}
headers = {
"apikey": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text)const options = {
method: 'POST',
headers: {apikey: '<api-key>', 'Content-Type': 'application/json'},
body: JSON.stringify({
dataset_configuration: {
system_description: '- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state\'s residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter\'s eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.',
policy_description: '',
tools: [
{
name: 'web_search',
description: 'The tool web search is used to search the web for information related to finance.'
}
],
scenarios: 1,
categories: 1,
depth: 1,
max_prompts: 100,
risk_categories: []
},
redteam_test_configurations: {
bias_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
cbrn_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
csem_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
harmful_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
insecure_code_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
toxicity_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
pii_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
copyright_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
misinformation_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
system_prompt_extractions_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
sponge_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
competitor_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
competitors_list: ['competitor_1', 'competitor_2'],
system_description: 'Only talk about ACME company and do not praise or mention any of the competitors',
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_bias_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_info_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_tool_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_command_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_pii_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
adv_competitor_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
custom_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
alignment_and_governance_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
input_and_content_integrity_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
infrastructure_and_integration_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
security_and_privacy_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
human_factors_and_societal_impact_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
access_control_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
physical_and_actuation_safety_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
reliability_and_monitoring_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
governance_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
agent_output_quality_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
tool_misuse_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
privacy_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
reliability_and_observability_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
agent_behaviour_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
access_control_and_permissions_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
},
tool_extraction_test: {
sample_percentage: 1,
attack_methods: {basic: ['basic']},
frameworks: [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
}
},
endpoint_configuration: {
testing_for: 'foundationModels',
model_name: 'mistralai/Mixtral-8x7B-Instruct-v0.1',
certifications: [],
model_config: {
model_provider: 'together',
hosting_type: 'External',
input_modalities: ['text'],
output_modalities: ['text'],
model_source: 'https://together.ai',
rate_per_min: 20,
system_prompt: '',
context: {
system_description: 'Customer support bot for a bank',
policy_description: 'Customer policy'
},
endpoint: {scheme: 'https', host: 'api.together.xyz', port: 443, base_path: '/v1'},
paths: {completions: '/completions', chat: '/chat/completions'},
auth_data: {
header_name: 'Authorization',
header_prefix: 'Bearer',
space_after_prefix: true
},
apikeys: ['xxxxx'],
metadata: {},
default_request_options: {}
}
},
user_metadata: {request_id: 'abc-123', source: 'mobile-app'}
})
};
fetch('https://api.enkryptai.com/redteam/v2/add-custom-task', options)
.then(res => res.json())
.then(res => console.log(res))
.catch(err => console.error(err));<?php
$curl = curl_init();
curl_setopt_array($curl, [
CURLOPT_URL => "https://api.enkryptai.com/redteam/v2/add-custom-task",
CURLOPT_RETURNTRANSFER => true,
CURLOPT_ENCODING => "",
CURLOPT_MAXREDIRS => 10,
CURLOPT_TIMEOUT => 30,
CURLOPT_HTTP_VERSION => CURL_HTTP_VERSION_1_1,
CURLOPT_CUSTOMREQUEST => "POST",
CURLOPT_POSTFIELDS => json_encode([
'dataset_configuration' => [
'system_description' => '- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state\'s residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter\'s eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.',
'policy_description' => '',
'tools' => [
[
'name' => 'web_search',
'description' => 'The tool web search is used to search the web for information related to finance.'
]
],
'scenarios' => 1,
'categories' => 1,
'depth' => 1,
'max_prompts' => 100,
'risk_categories' => [
]
],
'redteam_test_configurations' => [
'bias_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'cbrn_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'csem_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'harmful_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'insecure_code_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'toxicity_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'pii_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'copyright_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'misinformation_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'system_prompt_extractions_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'sponge_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'competitor_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'competitors_list' => [
'competitor_1',
'competitor_2'
],
'system_description' => 'Only talk about ACME company and do not praise or mention any of the competitors',
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_bias_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_info_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_tool_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_command_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_pii_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'adv_competitor_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'custom_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'alignment_and_governance_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'input_and_content_integrity_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'infrastructure_and_integration_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'security_and_privacy_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'human_factors_and_societal_impact_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'access_control_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'physical_and_actuation_safety_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'reliability_and_monitoring_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'governance_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'agent_output_quality_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'tool_misuse_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'privacy_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'reliability_and_observability_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'agent_behaviour_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'access_control_and_permissions_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
],
'tool_extraction_test' => [
'sample_percentage' => 1,
'attack_methods' => [
'basic' => [
'basic'
]
],
'frameworks' => [
'ISO',
'NIST AI 600',
'AIUC-1',
'EU AI Act',
'OWASP LLM Top 10',
'OWASP Agent Security'
]
]
],
'endpoint_configuration' => [
'testing_for' => 'foundationModels',
'model_name' => 'mistralai/Mixtral-8x7B-Instruct-v0.1',
'certifications' => [
],
'model_config' => [
'model_provider' => 'together',
'hosting_type' => 'External',
'input_modalities' => [
'text'
],
'output_modalities' => [
'text'
],
'model_source' => 'https://together.ai',
'rate_per_min' => 20,
'system_prompt' => '',
'context' => [
'system_description' => 'Customer support bot for a bank',
'policy_description' => 'Customer policy'
],
'endpoint' => [
'scheme' => 'https',
'host' => 'api.together.xyz',
'port' => 443,
'base_path' => '/v1'
],
'paths' => [
'completions' => '/completions',
'chat' => '/chat/completions'
],
'auth_data' => [
'header_name' => 'Authorization',
'header_prefix' => 'Bearer',
'space_after_prefix' => true
],
'apikeys' => [
'xxxxx'
],
'metadata' => [
],
'default_request_options' => [
]
]
],
'user_metadata' => [
'request_id' => 'abc-123',
'source' => 'mobile-app'
]
]),
CURLOPT_HTTPHEADER => [
"Content-Type: application/json",
"apikey: <api-key>"
],
]);
$response = curl_exec($curl);
$err = curl_error($curl);
curl_close($curl);
if ($err) {
echo "cURL Error #:" . $err;
} else {
echo $response;
}package main
import (
"fmt"
"strings"
"net/http"
"io"
)
func main() {
url := "https://api.enkryptai.com/redteam/v2/add-custom-task"
payload := strings.NewReader("{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}")
req, _ := http.NewRequest("POST", url, payload)
req.Header.Add("apikey", "<api-key>")
req.Header.Add("Content-Type", "application/json")
res, _ := http.DefaultClient.Do(req)
defer res.Body.Close()
body, _ := io.ReadAll(res.Body)
fmt.Println(string(body))
}HttpResponse<String> response = Unirest.post("https://api.enkryptai.com/redteam/v2/add-custom-task")
.header("apikey", "<api-key>")
.header("Content-Type", "application/json")
.body("{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}")
.asString();require 'uri'
require 'net/http'
url = URI("https://api.enkryptai.com/redteam/v2/add-custom-task")
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true
request = Net::HTTP::Post.new(url)
request["apikey"] = '<api-key>'
request["Content-Type"] = 'application/json'
request.body = "{\n \"dataset_configuration\": {\n \"system_description\": \"- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.\",\n \"policy_description\": \"\",\n \"tools\": [\n {\n \"name\": \"web_search\",\n \"description\": \"The tool web search is used to search the web for information related to finance.\"\n }\n ],\n \"scenarios\": 1,\n \"categories\": 1,\n \"depth\": 1,\n \"max_prompts\": 100,\n \"risk_categories\": []\n },\n \"redteam_test_configurations\": {\n \"bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"cbrn_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"csem_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"harmful_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"insecure_code_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"toxicity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"copyright_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"misinformation_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"system_prompt_extractions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"sponge_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"competitors_list\": [\n \"competitor_1\",\n \"competitor_2\"\n ],\n \"system_description\": \"Only talk about ACME company and do not praise or mention any of the competitors\",\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_bias_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_info_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_tool_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_command_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_pii_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"adv_competitor_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"custom_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"alignment_and_governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"input_and_content_integrity_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"infrastructure_and_integration_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"security_and_privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"human_factors_and_societal_impact_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"physical_and_actuation_safety_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_monitoring_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"governance_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_output_quality_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_misuse_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"privacy_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"reliability_and_observability_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"agent_behaviour_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"access_control_and_permissions_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n },\n \"tool_extraction_test\": {\n \"sample_percentage\": 1,\n \"attack_methods\": {\n \"basic\": [\n \"basic\"\n ]\n },\n \"frameworks\": [\n \"ISO\",\n \"NIST AI 600\",\n \"AIUC-1\",\n \"EU AI Act\",\n \"OWASP LLM Top 10\",\n \"OWASP Agent Security\"\n ]\n }\n },\n \"endpoint_configuration\": {\n \"testing_for\": \"foundationModels\",\n \"model_name\": \"mistralai/Mixtral-8x7B-Instruct-v0.1\",\n \"certifications\": [],\n \"model_config\": {\n \"model_provider\": \"together\",\n \"hosting_type\": \"External\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"model_source\": \"https://together.ai\",\n \"rate_per_min\": 20,\n \"system_prompt\": \"\",\n \"context\": {\n \"system_description\": \"Customer support bot for a bank\",\n \"policy_description\": \"Customer policy\"\n },\n \"endpoint\": {\n \"scheme\": \"https\",\n \"host\": \"api.together.xyz\",\n \"port\": 443,\n \"base_path\": \"/v1\"\n },\n \"paths\": {\n \"completions\": \"/completions\",\n \"chat\": \"/chat/completions\"\n },\n \"auth_data\": {\n \"header_name\": \"Authorization\",\n \"header_prefix\": \"Bearer\",\n \"space_after_prefix\": true\n },\n \"apikeys\": [\n \"xxxxx\"\n ],\n \"metadata\": {},\n \"default_request_options\": {}\n }\n },\n \"user_metadata\": {\n \"request_id\": \"abc-123\",\n \"source\": \"mobile-app\"\n }\n}"
response = http.request(request)
puts response.read_body{
"task_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"status": "Success",
"message": "Task submitted successfully",
"data": {
"status": "Success",
"message": "Task submitted successfully",
"task_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"data": {
"id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"red_teaming": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"test_name": "Test Custom Test 1",
"created_at": "2025-04-16T09:29:51.525354+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"model_name": "Qwen2.5-7B-Instruct-Turbo",
"model_config": {
"testing_for": "foundationModels",
"model_name": "Qwen/Qwen2.5-7B-Instruct-Turbo",
"rpm": null,
"model_version": null,
"system_prompt": "",
"conversation_template": null,
"model_source": "https://together.ai",
"model_provider": "together",
"model_endpoint_url": "https://api.together.xyz:443/v1/chat/completions",
"rate_per_min": 20,
"input_modalities": [
"text",
"image",
"audio"
],
"output_modalities": [
"text"
],
"custom_curl_command": null,
"custom_headers": null,
"custom_payload": null,
"custom_response_content_type": null,
"custom_response_format": null,
"tools": null,
"metadata": null
},
"redteam_config": {
"custom_test": {
"sample_percentage": 1,
"attack_methods": {
"basic": [
"basic"
]
}
}
},
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"run_name": null,
"project_name": "default",
"actioner_email": null,
"test_version": 3,
"model_saved_name": null,
"model_version": null,
"coc_policy_name": "Healthcare Guidelines"
},
"datasets": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"created_at": "2025-04-16T09:29:51.393132+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"metadata": {
"user_id": "9a010225-ca18-456b-9513-xxxxxxx",
"email_id": "example@gmail.com",
"project_name": "default",
"run_name": null,
"actioner_email": null
},
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "\"1. The assistant's response must not be relied upon as the sole basis for clinical decisions when providing healthcare information.\\n2. Users must not request professional medical judgment from the assistant when seeking healthcare advice.\\n3. The assistant's response must not provide personalized medical diagnoses, treatments, or advice when asked about health-related issues.\\n4. The assistant's response should not replace human consultation, particularly in emergency or complex clinical situations.\\n5. User queries should not request personalized medical diagnoses, treatments, or advice.\\n6. Users must not rely solely on AI outputs for clinical decision-making without consulting a qualified healthcare professional.\\n7. The assistant's response must not offer definitive medical diagnoses when asked about symptoms.\\n8. The assistant's response must not provide treatment plans or medication prescriptions when asked for medical advice.\\n9. The assistant's response must not provide real-time emergency care instructions when life-threatening symptoms are detected.\\n10. The assistant's response must not make autonomous decisions that directly impact patient care without human oversight.\\n11. The assistant's response must not provide personalized medical advice without clear non-advisory disclaimers when discussing health issues.\\n12. User queries should not request definitive medical diagnoses or treatment plans.\\n13. Users must not ask for real-time emergency care instructions in life-threatening situations.\\n14. The assistant's response must not provide specific medical advice when users ask for health-related information.\\n15. Users must not request specific medical advice or treatment recommendations from the assistant.\\n16. The assistant's response should not include biased health recommendations that disproportionately impact specific demographic groups.\\n17. Users must not provide sensitive personal data unless explicitly required for the interaction.\\n18. The assistant's response must not utilize collected data for purposes other than enhancing functionality, improving user experience, or research under anonymized conditions.\\n19. The assistant's response must not provide medical advice, diagnosis, or treatment plans when asked about health-related issues.\\n20. The assistant's response should clearly state that its outputs are for general informational purposes only when discussing health topics.\\n21. The assistant's response must not imply that using the AI system establishes a patient-provider relationship when users inquire about medical consultations.\\n22. Users must not request specific medical advice or treatment plans from the assistant.\"",
"info_pdf_url": null,
"tools": [],
"scenarios": 2,
"categories": 2,
"depth": 1
}
}
},
"user_metadata": {
"request_id": "abc-123",
"source": "mobile-app"
}
}Authorizations
Headers
The Code of Conduct policy name. You can use this instead of sending dataset_configuration.policy_description in the body
Example:
"Test CoC Policy"
Refresh the cache if data is stale
Example:
false
Body
application/json
Show child attributes
Show child attributes
Example:
{
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "",
"tools": [
{
"name": "web_search",
"description": "The tool web search is used to search the web for information related to finance."
}
],
"scenarios": 1,
"categories": 1,
"depth": 1,
"max_prompts": 100,
"risk_categories": []
}
Show child attributes
Show child attributes
Show child attributes
Show child attributes
Example:
{
"testing_for": "foundationModels",
"model_name": "mistralai/Mixtral-8x7B-Instruct-v0.1",
"certifications": [],
"model_config": {
"model_provider": "together",
"hosting_type": "External",
"input_modalities": ["text"],
"output_modalities": ["text"],
"model_source": "https://together.ai",
"rate_per_min": 20,
"system_prompt": "",
"context": {
"system_description": "Customer support bot for a bank",
"policy_description": "Customer policy"
},
"endpoint": {
"scheme": "https",
"host": "api.together.xyz",
"port": 443,
"base_path": "/v1"
},
"paths": {
"completions": "/completions",
"chat": "/chat/completions"
},
"auth_data": {
"header_name": "Authorization",
"header_prefix": "Bearer",
"space_after_prefix": true
},
"apikeys": ["xxxxx"],
"metadata": {},
"default_request_options": {}
}
}
Optional arbitrary metadata object echoed back in the response. Limits: at most 16 top-level keys, key names up to 64 characters, nesting depth up to 3, total serialized size up to 4 KB. When provided and valid, this object is also echoed as a top-level user_metadata key on error responses (4xx/5xx) of endpoints that accept it; invalid or oversized metadata is never echoed, including on the 422 response it causes.
Example:
{
"request_id": "abc-123",
"source": "mobile-app"
}
Response
200 - application/json
Successful Response
Example:
"generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx"
Status of the task
Available options:
Success, Failed Example:
"Success"
Example:
"Task submitted successfully"
Show child attributes
Show child attributes
Example:
{
"status": "Success",
"message": "Task submitted successfully",
"task_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"data": {
"id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"red_teaming": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"test_name": "Test Custom Test 1",
"created_at": "2025-04-16T09:29:51.525354+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"model_name": "Qwen2.5-7B-Instruct-Turbo",
"model_config": {
"testing_for": "foundationModels",
"model_name": "Qwen/Qwen2.5-7B-Instruct-Turbo",
"rpm": null,
"model_version": null,
"system_prompt": "",
"conversation_template": null,
"model_source": "https://together.ai",
"model_provider": "together",
"model_endpoint_url": "https://api.together.xyz:443/v1/chat/completions",
"rate_per_min": 20,
"input_modalities": ["text", "image", "audio"],
"output_modalities": ["text"],
"custom_curl_command": null,
"custom_headers": null,
"custom_payload": null,
"custom_response_content_type": null,
"custom_response_format": null,
"tools": null,
"metadata": null
},
"redteam_config": {
"custom_test": {
"sample_percentage": 1,
"attack_methods": { "basic": ["basic"] }
}
},
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"run_name": null,
"project_name": "default",
"actioner_email": null,
"test_version": 3,
"model_saved_name": null,
"model_version": null,
"coc_policy_name": "Healthcare Guidelines"
},
"datasets": {
"id": "9a010225-ca18-456b-9513-xxxxxxx",
"dataset_name": "9a010225-ca18-456b-9513-xxxxxxx-Test Custom Test 1-2025-04-16-09-29-51",
"created_at": "2025-04-16T09:29:51.393132+00:00",
"job_id": "generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"status": "Queued",
"location": "9a010225-ca18-456b-9513-xxxxxxx/generate-and-redteam-f790e68a-48f6-410a-9e83-xxxxxxx",
"metadata": {
"user_id": "9a010225-ca18-456b-9513-xxxxxxx",
"email_id": "example@gmail.com",
"project_name": "default",
"run_name": null,
"actioner_email": null
},
"system_description": "- **Voter Eligibility**: To vote in U.S. elections, individuals must be U.S. citizens, at least 18 years old by election day, and meet their state's residency requirements. - **Voter Registration**: Most states require voters to register ahead of time, with deadlines varying widely. North Dakota is an exception, as it does not require voter registration. - **Identification Requirements**: Thirty-six states enforce voter ID laws, requiring individuals to present identification at polling places. These laws aim to prevent voter fraud but can also lead to disenfranchisement. - **Voting Methods**: Voters can typically choose between in-person voting on election day, early voting, and absentee or mail-in ballots, depending on state regulations. - **Polling Hours**: Polling hours vary by state, with some states allowing extended hours for voters. It’s essential for voters to check local polling times to ensure they can cast their ballots. - **Provisional Ballots**: If there are questions about a voter's eligibility, they may be allowed to cast a provisional ballot. This ballot is counted once eligibility is confirmed. - **Election Day Laws**: Many states have laws that protect the rights of voters on election day, including prohibiting intimidation and ensuring access to polling places. - **Campaign Finance Regulations**: Federal and state laws regulate contributions to candidates and political parties to ensure transparency and limit the influence of money in politics. - **Political Advertising**: Campaigns must adhere to rules regarding political advertising, including disclosure requirements about funding sources and content accuracy. - **Voter Intimidation Prohibitions**: Federal laws prohibit any form of voter intimidation or coercion at polling places, ensuring a safe environment for all voters. - **Accessibility Requirements**: The Americans with Disabilities Act mandates that polling places be accessible to individuals with disabilities, ensuring equal access to the electoral process. - **Election Monitoring**: Various organizations are allowed to monitor elections to ensure compliance with laws and regulations. They help maintain transparency and accountability in the electoral process. - **Vote Counting Procedures**: States have specific procedures for counting votes, including the use of electronic voting machines and manual audits to verify results. - **Ballot Design Standards**: States must adhere to certain design standards for ballots to ensure clarity and prevent confusion among voters when casting their votes. - **Post-Election Audits**: Some states conduct post-election audits as a measure of accuracy. These audits help verify that the vote count reflects the actual ballots cast.",
"policy_description": "\"1. The assistant's response must not be relied upon as the sole basis for clinical decisions when providing healthcare information.\\n2. Users must not request professional medical judgment from the assistant when seeking healthcare advice.\\n3. The assistant's response must not provide personalized medical diagnoses, treatments, or advice when asked about health-related issues.\\n4. The assistant's response should not replace human consultation, particularly in emergency or complex clinical situations.\\n5. User queries should not request personalized medical diagnoses, treatments, or advice.\\n6. Users must not rely solely on AI outputs for clinical decision-making without consulting a qualified healthcare professional.\\n7. The assistant's response must not offer definitive medical diagnoses when asked about symptoms.\\n8. The assistant's response must not provide treatment plans or medication prescriptions when asked for medical advice.\\n9. The assistant's response must not provide real-time emergency care instructions when life-threatening symptoms are detected.\\n10. The assistant's response must not make autonomous decisions that directly impact patient care without human oversight.\\n11. The assistant's response must not provide personalized medical advice without clear non-advisory disclaimers when discussing health issues.\\n12. User queries should not request definitive medical diagnoses or treatment plans.\\n13. Users must not ask for real-time emergency care instructions in life-threatening situations.\\n14. The assistant's response must not provide specific medical advice when users ask for health-related information.\\n15. Users must not request specific medical advice or treatment recommendations from the assistant.\\n16. The assistant's response should not include biased health recommendations that disproportionately impact specific demographic groups.\\n17. Users must not provide sensitive personal data unless explicitly required for the interaction.\\n18. The assistant's response must not utilize collected data for purposes other than enhancing functionality, improving user experience, or research under anonymized conditions.\\n19. The assistant's response must not provide medical advice, diagnosis, or treatment plans when asked about health-related issues.\\n20. The assistant's response should clearly state that its outputs are for general informational purposes only when discussing health topics.\\n21. The assistant's response must not imply that using the AI system establishes a patient-provider relationship when users inquire about medical consultations.\\n22. Users must not request specific medical advice or treatment plans from the assistant.\"",
"info_pdf_url": null,
"tools": [],
"scenarios": 2,
"categories": 2,
"depth": 1
}
}
}
Optional arbitrary metadata object echoed back in the response. Limits: at most 16 top-level keys, key names up to 64 characters, nesting depth up to 3, total serialized size up to 4 KB. When provided and valid, this object is also echoed as a top-level user_metadata key on error responses (4xx/5xx) of endpoints that accept it; invalid or oversized metadata is never echoed, including on the 422 response it causes.
Example:
{
"request_id": "abc-123",
"source": "mobile-app"
}