Skip to main content
The payload for EnkryptAI’s Red Teaming API V3 is structured as a JSON object with four primary sections: test_name (required), dataset_configuration, redteam_test_configurations, and endpoint_configuration.
Required Field: test_name is required for all red team tests. It must be a unique identifier for your test run.

Test Catalogs

Foundation model and agent test catalogs

Attack Methods

Comprehensive guide to all attack methods

Configuration

Detailed configuration reference

Examples

Ready-to-use payload examples

What’s New in V3

V3 introduces significant enhancements to attack methods configuration:
  • Granular Parameter Control: Each attack method now supports specific parameters for fine-tuned testing
  • Structured Attack Hierarchy: Clear organization of basic, static, and dynamic attack methods
  • Enhanced Attack Methods: Expanded suite of encoding, obfuscation, and multi-modal attack techniques

V2 to V3 Migration

V2 Format (Legacy):
V3 Format (Current):
Key Changes:
  1. Attack methods are now objects with params instead of arrays
  2. Each attack method requires a params object (can be empty {})
  3. Use specific encoding keywords (e.g., base64_encoding instead of generic encoding)
  4. Configure parameters for iterative attacks: width, branching_factor, depth

Quick Reference: Attack Methods

Choose attack methods based on your model type and security testing needs. This table provides an enhanced overview of all available attack methods.

By Model Type

Quick Lookup: All Keywords

  • basic - LLM, VLM, ALM
  • obfuscation - LLM, VLM
  • eai_attack - LLM, VLM
  • ascii_encoding - LLM
  • base64_encoding - LLM
  • binary_encoding - LLM
  • hex_encoding - LLM
  • url_encoding - LLM
  • leet_encoding - LLM
  • morse_encoding - LLM
  • rot13_encoding - LLM
  • rot21_encoding - LLM
  • lang_fr - French (LLM)
  • lang_it - Italian (LLM)
  • lang_hi - Hindi (LLM)
  • lang_es - Spanish (LLM)
  • lang_ja - Japanese (LLM)
  • iterative - LLM
  • multi_turn - LLM
  • rt_agent - LLM
  • masking - VLM
  • figstep - VLM
  • camo - VLM
  • fc - VLM
  • hades 🔒 - VLM (Coming Soon)
  • jood 🔒 - VLM (Coming Soon)
  • waveform - ALM
  • echo - ALM
  • speed - ALM
  • pitch - ALM
  • reverb - ALM
  • noise - ALM
  • deep_inception - LLM

Payload Structure

High-Level Overview

For complete field descriptions, see Configuration Reference.

Quick Start Examples

Starter: Basic LLM Test

Standard: Multi-Test Assessment

For more examples including VLM, ALM, agents, and industry-specific use cases, see the Examples page.

Available Test Types

For comprehensive test catalogs with detailed descriptions, categories, sample prompts, and configuration examples:

Standard Tests (12 tests)

Tests available for all model types:

Custom & Agentic Tests

custom_test - Test with your own generated dataset
For AI agents with tool use and autonomous capabilities:
  • governance_test - Alignment, goal misalignment, and policy drift
  • agent_output_quality_test - Output quality, hallucinations, bias, and toxicity
  • tool_misuse_test - API integration, supply chain, and resource consumption
  • privacy_test - Sensitive data exposure and exfiltration channels
  • reliability_and_observability_test - Data poisoning, concept drift, and opaque reasoning
  • agent_behaviour_test - Human manipulation and unsafe actuation
  • access_control_and_permissions_test - Credential theft, privilege escalation, confused deputy
  • tool_extraction_test - Tool information extraction
For generated adversarial datasets:
  • adv_bias_test - Adversarial bias detection
  • adv_info_test - Sensitive information extraction
  • adv_persona_test - Persona manipulation
  • adv_command_test - Command injection
  • adv_pii_test - Advanced PII extraction
  • adv_competitor_test - Competitor information

Best Practices

Start Simple

Begin with basic attacks at low sample percentage (2-5%) to establish baseline.

Progressive Testing

Add static methods, then dynamic attacks as you identify vulnerabilities.

Match Your Model

Use appropriate modalities: ["text"] for LLM, ["text", "image"] for VLM, ["text", "audio"] for ALM.

Multiple Tests

Run multiple test types (harmful, bias, PII) for comprehensive coverage.

Sample Wisely

Dev: 2-5% | Staging: 10-20% | Production: 50-100%

Consider Cost

Dynamic attacks are thorough but resource-intensive. Start with static methods.

Configuration Guidelines

Sample Percentage by Stage

Attack Method Combinations

Time: 2-5 min | Coverage: Baseline

Common Parameters

iterative.width
integer
default:"5"
Number of parallel attack paths (1-10)
iterative.branching_factor
integer
default:"9"
Variations per iteration (1-15)
iterative.depth
integer
default:"3"
Maximum iteration depth (1-5)
base64_encoding.iterations
integer
default:"1"
Encoding iterations (1-3). Higher = more obfuscation but less comprehension

Security & Usage Notes

Security:
  • Never commit API keys to version control
  • Use environment variables for credentials
  • Rotate keys regularly
  • Separate test and production keys
Usage:
  • Verify endpoints and keys are correct
  • Adjust sample_percentage based on dataset size
  • Choose attack methods appropriate for your model type
  • Use in accordance with provider terms of service

Next Steps

Test Catalogs

Explore comprehensive test catalogs with detailed descriptions and examples

Attack Methods

Explore detailed attack method documentation with parameters and use cases

Configuration

Complete reference for all configuration fields and options

Examples

Browse ready-to-use examples for different scenarios and providers

API Reference

View the complete API specification and endpoints

Additional Resources


This payload structure facilitates in-depth testing across various model types, allowing for comprehensive assessments of behavior and security with fine-grained control over attack parameters.