PAGES
← all tools
◆ AI Red Teaming & Testing

CalypsoAI

1.0.0 commercial

CalypsoAI tests AI systems for security, safety, and compliance risks before deployment.

Summary

CalypsoAI is a commercial AI tool that runs as a backend service for probing AI systems against security, safety, and compliance risks before they go into production. Its API is organized around campaigns and scans run against configured providers and scanner packages, with projects used to scope access and roles, which suggests it is built for teams managing many models or deployments at once rather than testing a single chatbot by hand. Support for providers like OpenAI, Anthropic, and Google alongside its own scanner packages points to red teamers and AI security or compliance owners who need to run repeatable test campaigns across multiple model backends under one audit trail. It sits in the ai-security category, alongside tools built to stress-test models before release rather than monitor them in production, and its pace of 16 releases in the tracked window, the latest 23 days ago, indicates active, ongoing development.

CalypsoAI tests AI systems for security, safety, and compliance risks before deployment.

How CalypsoAI helps

Which of my AI projects are running scanners or providers nobody has reviewed lately?

lists scanners, scanner packages, and providers attached to each project so a security team can see what is active without asking each project owner

Who has access to a given campaign run, and did anyone change that access?

reports the current access list per campaign run and records each patch to it, so a change in who can see results is traceable to a person

Which chats or campaign runs match a person, model, or project I'm investigating?

supports searching chats and campaign runs and filtering campaign runs by model or project, narrowing a broad log into the sessions relevant to an incident

What happened around a specific security event, and who triggered it?

looks up individual audit events by identifier alongside the full audit feed, giving the detail behind a single flagged action rather than just its summary line

Can a failed campaign run be re-executed without rebuilding it from scratch?

retries a campaign run directly, reusing its existing configuration instead of requiring a new one to be defined

Who holds which roles and permissions across the users in this deployment?

exposes roles, their permissions, and per-user role assignments, and lets any of those be revoked, so entitlements can be audited and pruned from one place

all 17 features, with the evidence for each →

Languages

Not documented

Features

17 capabilities · 4 backed by code, an API document or a real run

Built from CalypsoAI's releases, docs, README and our own runs. “Seen” marks the month we first spotted a release the vendor didn't date. Group names and tags are our labels.

Compare with peers →

What CalypsoAI offers you

All capabilities 17 capabilities
Access management for campaign runs verified Allows checking and modifying access permissions for a specific campaign run. 3 releases · 2 other sources · first seen Aug 2026

Also counts toward: REST API

release

  • New endpoint PATCH /backend/v1/campaign-runs/{campaignRunId}/access 10.106.1 · Sep 2026 · source · release history
  • New endpoint GET /backend/v1/campaign-runs/{campaignRunId}/access 10.106.1 · Sep 2026 · source · release history
  • Auth (8 endpoints) — create, read, update, delete 10.62.4 · Aug 2026 · source · release history

api

Project dashboard and reporting shipped Provides project administrators with dashboards to view associated data, prompt history, and cost analysis via token usage metrics. 4 releases · first seen Sep 2026

release

  • GET /backend/v1/projects/{project}: param includeAdded (query) added 1.0.0 · Oct 2026 · source · release history
  • Adds new Scans, Prompts, Blocked Prompts, and Total Traffic metrics to the AI Security dashboard September 30, 2026 - SaaS - v10.122.0 · Sep 2026 · source · release history
  • Reports and Guardrails dashboard now display token usage data for cost analysis September 10, 2026 - SaaS - v10.110.0.2 · Sep 2026 · source · release history
  • Campaign reports now include run time metrics to track performance September 10, 2026 - SaaS - v10.110.0.2 · Sep 2026 · source · release history
Red Team attack composition and evaluation shipped Supports custom severity tagging for risks, refusal evaluation to detect model refusals, and multi-turn agentic resistance testing. 4 releases · first seen Apr 2026

release

  • Adds attack success rates for Prompt injection and Misinformation frameworks aligned with OWASP LLM Top 10 2026 to Red Team reports September 30, 2026 - SaaS - v10.122.0 · Sep 2026 · source · release history
  • Adds an attack vector and intent matrix showing success rates in Red Team reports September 30, 2026 - SaaS - v10.122.0 · Sep 2026 · source · release history
  • Red Team campaigns can now launch system prompt attacks to test if models reveal or follow system-level instructions September 10, 2026 - SaaS - v10.110.0.2 · Sep 2026 · source · release history
  • Red Team users can now use a refusal evaluator to check whether a model refuses to respond, detecting explicit refusals (e.g., I can't do that) and implicit ones (e.g., "I don't have access to that information") April 16, 2026 - SaaS - v10.10.4 · Apr 2026 · source · release history
Agent session inspection verified Provides endpoints to retrieve details about an agent session. 3 releases · 1 other source · first seen Jan 2026

Also counts toward: REST API

release

  • New endpoint GET /backend/v1/agent-sessions/{agentSessionId}⁠︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄⁠ 10.106.1 · Sep 2026 · source · release history
  • Adds session-based tracking and swimlane mapping to identify input messages, model responses and guardrail activity March 3, 2026 - SaaS - v9.164.4 · Mar 2026 · source · release history
  • Projects can now be filtered by type: agentic, app, bot, chat. Jan 29, 2026 - SaaS - v9.133.3.3 · Jan 2026 · source · release history

api

License information retrieval verified Allows checking the current license status or details. 3 releases · 1 other source · first seen Sep 2026

release

  • New endpoint GET /backend/v1/license 10.106.1 · Sep 2026 · source · release history
  • Adds self-service license key entry and expiry notifications in the Account Settings page September 8, 2026 - On-premises - v10.102.0.7 · Sep 2026 · source · release history
  • Adds GET /backend/v1/license unauthenticated endpoint to retrieve license status and expiration details September 8, 2026 - On-premises - v10.102.0.7 · Sep 2026 · source · release history

api

Guardrails configuration and management shipped Allows customization of guardrail behavior, including custom messages, refusal checks for attacks, and scope limitations. 3 releases · first seen Mar 2026

Also counts toward: REST API

release

  • Adds Arabic language PII support for Saudi Arabia and the United Arab Emirates to AI Guardrails PII packages September 30, 2026 - SaaS - v10.122.0 · Sep 2026 · source · release history
  • Adds the flagOnly parameter to the scans API (POST /backend/v1/scans) to return exact guardrail results (blocked when set to false). March 30, 2026 - SaaS - v9.189.0 · Mar 2026 · source · release history
  • Allows setting custom guardrails messages via the POST /backend/v1/scans and POST /backend/v1/prompts endpoints. March 30, 2026 - SaaS - v9.189.0 · Mar 2026 · source · release history
Campaign run retry verified Enables retrying a specific campaign run instance. 2 releases · 1 other source · first seen Jul 2026

release

  • New endpoint POST /backend/v1/campaign-runs/{campaignRunId}/retry 10.106.1 · Sep 2026 · source · release history
  • Adds morality dilemma attack vector in August 2026 attack pack for AI Red Team July 28, 2026 - SaaS - v10.81.3 · Jul 2026 · source · release history

api

Campaign search shipped Allows searching for campaigns via query parameters. 3 releases · first seen Jan 2026

release

  • GET /backend/v1/campaigns: param search (query) added 10.106.1 · Sep 2026 · source · release history
  • In-progress AI Red Team campaigns now link directly to their reports under Red Team > Reports May 21, 2026 - SaaS - v10.31.0 · May 2026 · source · release history
  • Playground shows aggregated F1 score for the whole scanner package when testing with a custom dataset. Jan 29, 2026 - SaaS - v9.133.3.3 · Jan 2026 · source · release history
Deployment and infrastructure configuration shipped Manages deployment specifics including OpenShift CDI workarounds, Security Context Constraints, and on-premises engine support. 2 releases · 1 other source · first seen Jun 2026

release

  • Inference guardrails, red team, and remediate model images now run under the built-in restricted-v2 Security Context Constraint (SCC) instead of a custom SCC. August 25, 2026 - Operator - Helm chart 1.8.0 / Red Hat Ecosystem Catalog 0.12.0 · Aug 2026 · source · release history
  • Adds Oracle Kubernetes Engine (OKE) support for on-premises deployments June 17, 2026 - SaaS - v10.42.6 · Jun 2026 · source · release history

example

  • Disable CDI support in the GPU ClusterPolicy as a workaround for older OpenShift nodes to allow inference pods to start. oc patch clusterpolicy gpu-cluster-policy --type=merge -p '{"spec":{"cdi":{"enabled":false}}}' August 25, 2026 - Operator - Helm chart 1.8.0 / Red Hat Ecosystem Catalog 0.12.0 · Aug 2026 · source
Agentic tracing and fingerprints shipped Allows tracking of agent actions, thoughts, and tool calls via fingerprints and multi-agent views to monitor complex workflows. 3 releases · first seen Jan 2026

release

  • Anthropic connections now support Fingerprints for Claude Code May 1, 2026 - On-premises - v10.13.2.1 · May 2026 · source · release history
  • Introduces agent fingerprints in AI Guardrails to track thoughts, actions and tool calls for security monitoring March 3, 2026 - SaaS - v9.164.4 · Mar 2026 · source · release history
  • Agentic fingerprints is no longer in beta and is ready for general use. Jan 29, 2026 - SaaS - v9.133.3.3 · Jan 2026 · source · release history
Token management shipped Allows management of tokens including bulk deletion, filtering, sorting, and association retrieval for projects and users. 2 releases · first seen Oct 2026

Also counts toward: REST API

release

  • New endpoint POST /backend/v1/tokens/bulk-delete 1.0.0 · Oct 2026 · source · release history
  • GET /backend/v1/tokens: param ascending (query) added; param includeProjects (query) added; param includeUsers (query) added; param scope (query) added; param sortBy (query) added; param status (query) added; param userId (query) added 1.0.0 · Oct 2026 · source · release history
Campaign run filtering shipped Allows filtering campaign runs by specific attributes like model or project. 2 releases · first seen Aug 2026

Also counts toward: REST API

release

  • GET /backend/v1/campaign-runs: param model (query) added; param projectId (query) added 10.106.1 · Sep 2026 · source · release history
  • Providers (9 endpoints) — create, read, update, delete 10.62.4 · Aug 2026 · source · release history
Chat message ordering and search shipped Allows retrieving chat messages with sorting and text search options. 2 releases · first seen Aug 2026

release

  • GET /backend/v1/chats: param ascending (query) added; param search (query) added 10.106.1 · Sep 2026 · source · release history
  • Chats (6 endpoints) — create, read, update, delete 10.62.4 · Aug 2026 · source · release history
Model connection and provider management shipped Supports connections to various AI providers with advanced authentication options like OAuth 2.0 and AWS. 2 releases · first seen May 2026

release

  • Providers (9 endpoints) — create, read, update, delete 10.62.4 · Aug 2026 · source · release history
  • Adds OAuth 2.0 and AWS authentication options for model connections via Configure > Connections > Other models > Authentication May 21, 2026 - SaaS - v10.31.0 · May 2026 · source · release history
Response scanning and security monitoring shipped Monitors high-volume AI usage, scans model responses for unauthorized content, and isolates concerning activity via advanced filtering. 2 releases · first seen Mar 2026

release

  • Adds connection support for Gemini to monitor high-volume generative AI use. March 30, 2026 - SaaS - v9.189.0 · Mar 2026 · source · release history
  • Enables advanced feed filtering to isolate concerning activity or unauthorized tool usage March 3, 2026 - SaaS - v9.164.4 · Mar 2026 · source · release history
Campaign run result retrieval shipped Allows retrieving the detailed results and output of a specific campaign run instance. 1 release · first seen Oct 2026

release

  • New endpoint GET /backend/v1/campaign-runs/{campaignRunId}/results⁠︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄⁠ 1.0.0 · Oct 2026 · source · release history
Deployment namespace and registry configuration shipped Allows customization of individual component namespaces and private registry settings within the SecurityOperator CR to streamline on-premises deployment. 1 release · first seen Sep 2026

release

  • Enables custom namespace derivation by adding moderator.namespace, postgresql.namespace, inference.namespace, and jobManager.namespace keys under spec.*.namespace in the SecurityOperator CR September 16, 2026 - Operator - Helm chart 1.8.1 / Red Hat Ecosystem Catalog 0.12.1 · Sep 2026 · source · release history

Lines in monospace are the tool's own words: help text parsed from its source, or an endpoint from its API document. Under release, a line is our summary of a dated release. Under docs, it is quoted from the tool's own documentation or website. Each links back to the source it came from.

Command line

1 command for CalypsoAI, each with where it came from. This tool has no source analysis yet, so there is no option reference and no captured run beside them.

Source

Score card

  1. Shipping velocity releases a month, last 12 months
  2. Documentation quality release-notes rubric, 0–100
  3. Breaking-change discipline how rarely a release breaks users, and notice given
  4. Maintenance risk quiet time against its own cadence, maintainers
  5. Innovation & surface new capabilities, API and MCP surface

Five scores for CalypsoAI, each built from the releases, notes and API history this site tracks — and, on Researcher and Business, where it stands among every measured tool in its category and how that has moved.

Score cards are part of every paid plan.

See plans →

Each score is 0–100 on a published rubric, derived from data this site already shows. A dimension we cannot measure says so — it is never scored 0 and never enters a rank.

How this is scored
  • Shipping velocity — releases a month over the last 12 months, on a log scale where 16 a month scores 100. Needs 3 releases in the window.
  • Documentation quality — the release-notes rubric published on the analytics page, unchanged.
  • Breaking-change discipline — the share of releases carrying a breaking change (none scores 100, half or more scores 0). Only projects that label breaking changes are measured: a clean record cannot be told from an unlabelled one.
  • Maintenance risk — quiet time measured against the tool's own release cadence (quiet longer than 90 days and three typical gaps scores 0), plus the number of active maintainers and whether contributors are growing, where known. Higher is lower risk.
  • Innovation & surface — new capabilities in the feature ledger this year, API and MCP operations added, and the share of commits that are features: the mean of whichever we hold.
  • Community health (open-source tools only) — each is a direction, not a size: contributors this year against last, the bus factor now against a year ago, and issues closed per issue opened, where steady scores 50, doubled 100 and halved 0; plus the median time to a maintainer's first reply (an hour scores about 100, a month or more 0). A commercial card has no repository and carries none of the four.
  • Documented delivery (commercial tools) — when a vendor's documented new capabilities have slowed against its own baseline, that counts against the overall standing as heavily as two low dimensions. Steady delivery, or too little history to judge, leaves the standing alone; it is never a sixth score.
  • Open-source tools are scored on repository signals; commercial tools on their published changelog. Ranks compare tools within one category and one profile and need at least five measured peers; the overall standing needs three ranked dimensions. Best-in-breed or consolidator is a shape, not a quality, and is never scored.

Release-note detail over time

See how much detail CalypsoAI puts in its release notes, quarter by quarter, and compare it with tracked tools in the same category. This history uses up to ten retained, reviewed notes per tool; sparse or blank older quarters may reflect that limit.

Checking release-note history…

Explore the full chart →

Website history

f5.com, every change

F5's home page and 40 more pages as they looked each month from August 2021 to October 2026: 50 renders, 8 changes of tagline or palette. Step through them, play them, or put any two months side by side.

Website history is included with Researcher and Business.

See plans →

Releases

Show

20 entries

  1. October 20261
  2. September 20266
  3. August 20263
  4. July 20262
  5. June 20261
  6. May 20262
  7. April 20261
  8. March 20262
  9. February 20261
  10. January 20261
    Show

    20 entries

    Add the badge to your README

    Maintain this project? The badge links readers straight to this page, so they can follow every release here.

    Tracked by Cyber Toolchain Choose a badge style and copy the code →
    browse all tools → score card for your toolchain →