Full cascade results
We report our screening results in two separate subsets, because they measure different things. Attack screening detects hostile prompts (prompt injection, jailbreak, agentic tool-call attacks). PII screening detects personal data leaving the network. Each row runs the full production cascade for that subset, exactly as it operates in the product. Held-out test sets, never seen during training.
Attack screening
PII screening
| Capability |
Dataset |
Recall |
False-positive |
| Sensitive PII + GDPR Art 9 |
ai4privacy/pii-masking-200k (sensitive subsetThe 488 rows of ai4privacy that contain sensitive personal data, emails, phone numbers, national IDs, SSNs, passports, API keys, credentials, and financial identifiers, plus GDPR Art 9 categories (health, biometrics, genetics, race, religion, politics, union, sexual orientation). We deliberately exclude "soft" entities (names, dates, places, job titles) that appear in ordinary prose.) |
92.2% (n=488) |
0.0% |
| All PII (combined) |
ai4privacy/pii-masking-200k (full set) |
96.1% (n=2000) |
1.5% |
Citations: The prompt-injection benchmark follows the independent evaluation protocol of N. Dzhaliuk et al., Comparative evaluation of machine learning methods for protecting LLMs from prompt injection attacks, Int. J. Inf. Secur. 25(4) (Springer, 2026), DOI 10.1007/s10207-026-01264-8, evaluated on the jayavibhav/prompt-injection test split. The jailbreak set is jackhhao/jailbreak-classification (Hugging Face), evaluated on its held-out test split. The agentic/tool-call set is cited in the dataset card: E. Deniz, Agentic Prompt-Injection 5K (Hugging Face, 2026), link. The PII set is ai4privacy/pii-masking-200k (Hugging Face, 2023), used under CC-BY-NC-4.0. The benign FP-control set combines leolee99/NotInject with other held-out benign text.
How the PII models work: SAGITTERA runs two PII specialists in parallel. The sensitive-PII model flags GDPR Art 9 special categories (health, biometrics, genetics, race, religion, politics, union, sexual orientation) plus sensitive identifiers (emails, phones, national IDs, SSNs, keys, financial), this is the "needs action" set. The non-sensitive (soft) model flags names, dates, places, and job titles. A query is flagged as containing PII if either model fires. The 0% FP on the sensitive model is on its clean set; the figures are not a universal guarantee of zero false-positives on all traffic.
Our model design
Rather than one general-purpose model trying to detect every threat, SAGITTERA runs a set of small expert models that are trained to work together in parallel and complement each other. All five are custom-trained int8 models (~106MB each) that run on a local CPU.
Attack analysis, one general attack model
The general attack model is a set of three expert specialists OR'd together: prompt-injection detection, jailbreak detection, and agentic / tool-call attack detection. There is no gating decision on top, any of the three flags the request. Each expert is trained to fire only on its own attack type, so together they cover the full attack surface, and because the experts are independent there is no single routing step that can misclassify an attack and let it through.
PII protection, one general PII model
The general PII model is a set of two expert specialists OR'd together that differentiate Art 9 from soft PII: a high-risk model flags GDPR Art 9 special categories (health, biometrics, genetics, race, religion, politics, union, sexual orientation) plus sensitive identifiers (emails, phones, national IDs, keys, financial) that need action, and a soft-PII model flags names, dates, places. Any of the two flags the request, with no gating decision on top.
The general attack model and the general PII model run in parallel on every AI-bound request and flag independently, with no gating decision on top. Because each specialist is trained for one narrow job and FP-penalized, the combined cascade keeps false-positives near zero while covering both the attack surface and data leakage. Because the specialists flag independently and identify which expert fired, the cascade can name the type of attack or breach (a prompt injection, a jailbreak, a tool-call attack, high-risk Art 9 data, or soft PII) and act appropriately, for example block the highest-risk cases and flag the rest for review.