Evidence

Evidence
before promises.

Two evaluations, each labelled for what it is. Neither is a customer site. Commissioning results are measured per site, on that site, against success criteria agreed before the appliance is connected.

1.0Results

Two evaluations, each labelled

Public testbed: SWaT 2015

Public academic water-treatment testbed (iTrust, SUTD). Labelled attacks against a live physical process.

labelled attacks detected
precision
holdout false-positive rate
point-adjusted recall
Run 2026-06-11, commit 97752838vardar-portal/src/data/gallery/swat-gallery.json

Two-channel synthetic evaluation

Repository-generated Modbus/TCP traffic with synchronised simulated separator values. No customer data.

classification accuracy
false-positive rate
precision
holdout gate, minimum
Commit b4eab079, CI run 35477541192vardar-sentinel/evaluation/two-channel-v2
2.0What was measured

What each evaluation is, and is not

SWaT 2015

The Secure Water Treatment testbed at iTrust, Singapore University of Technology and Design. A six-stage physical water-treatment process with labelled attacks injected over several days.

Why it is used

It is public, physical and labelled, so anyone can rerun the evaluation and compare.

Limits

An academic testbed, not an operating plant. Attack types and process scale are those of the testbed.

Two-channel synthetic evaluation, v2

Deterministic Modbus/TCP traffic generated from the repository, with synchronised simulated separator process values. Built to exercise the two evidence paths together.

Why it is used

It is reproducible byte for byte, carries category labels for every event, and contains no customer data.

Limits

Synthetic. It tests the mechanism, not a real process. Results are a technical reference, not a site claim.

3.0How to read the numbers

Metric definitions,
so a number can be checked.

Labelled attacks detected

The count of attack windows in the dataset for which at least one finding was raised inside the window. Shown as detected out of total.

Precision

Of all events flagged as attack, the share that were labelled attacks. High precision means few false alarms per true alarm.

Holdout false-positive rate

The share of non-attack events flagged as attack, measured on data the model did not see during fitting.

Point-adjusted recall

An attack window counts as detected if any point inside it is flagged. The standard metric for time-series anomaly detection, and the one recorded in the SWaT metrics file.

Classification accuracy

The share of events placed in the correct category across attack, operational and other classes. Used in the two-channel evaluation, where every event carries a category label.

Holdout gate

The minimum precision the evaluation must reach on holdout data for a release to be accepted. A gate, not a result.

4.0Provenance

Every figure has a commit.

The evaluation artefacts carry the source commit, the CI run and the checksums of the inputs. Rerun from a clean checkout of the named commit to reproduce.

SWaT 2015

Run 2026-06-11, commit 97752838, metrics file swat-gallery.json

Two-channel v2

Commit b4eab079, CI run 35477541192, evaluation report SHA-256 13da4918

Explore the attack gallery

Every detected SWaT attack, with the network and process evidence Vardar used, is published in the portal gallery.

5.0See it work

The demo and the walkthrough.

For the physical world

The four-minute product film: the decision, the two evidence paths, the appliance and the boundary.

Product walkthrough

A finding from first alert to governed next step, in the console.

The third evaluation is yours.

A technical evaluation on one critical process, with success criteria agreed in advance, produces the only number that matters for your site.

Evaluate one critical process