Skip to content

Reference

Tooling roster

Every tool the book actually runs, in one place. If a chapter puts a command in your hands, this is where you find it again - the real invocation, not a description of one. Where a tool has no meaningful CLI, the invocation column says so rather than dressing a product name up as a command.

Offense - attacking the model

ToolWhat it doesInvocationChapter
IBM ARTCraft adversarial-ML evasion (PGD / FGSM) against a model you ownfrom art.attacks.evasion import ProjectedGradientDescentI.4

Eval and red-team

ToolWhat it doesInvocationChapter
garakBroad LLM vulnerability scanner - sweep injection / jailbreak / leak probe familiespython -m garak --target_type openai --target_name <model> --probes promptinject,dan,encoding,latentinjection,leakreplayII.2
PyRITMicrosoft multi-turn adaptive red-team (Crescendo / TAP) for depthfrom pyrit.executor.attack import CrescendoAttackVI.4
promptfooRed-team config to a per-plugin attack-success-rate report you diff across model versionspromptfoo redteam run --target <endpoint>VI.3
Project MoonshotAI Verify run layer - connectors plus cookbooks / recipes and red-teamingmoonshot run cookbook "singapore-safety-cookbook" -e <target> -n 1 -r 5VI.5
InspectUK AISI eval harness - the standard runner for public capability benchmarksinspect eval inspect_evals/wmdp_bio --model <provider>/<model> --limit 100VI.6

Supply chain - proving the artifact

ToolWhat it doesInvocationChapter
modelscanFlags unsafe pickle / H5 / SavedModel deserialization before loadmodelscan -p ./<model-dir>I.5
ficklingTrail of Bits - decompile a pickle, inspect opcodes, detect code payloadsfickling --check-safety ./<model>.pklI.5
picklescanDenylist pickle scanner - a secondary gate only, it has known bypassespicklescan --path ./<model>.pklI.4
safetensorsCode-free tensor format - the safe alternative to pickle weightspython -c "from safetensors.torch import load_file; load_file('model.safetensors')"I.5
cosign / SigstoreSign, verify and attest the artifact; keyless, transparency-loggedcosign sign-blob --key <cosign.key> ./models/<model> > model.sigI.5
model_signing (OMS)OpenSSF Model Signing - verify weights against a signer identitymodel_signing verify sigstore --signature <model.sig> --identity <builder@org.example>I.5
slsa-verifierVerify tamper-resistant build provenance (in-toto / SLSA attestation)slsa-verifier verify-artifact <artifact> --provenance-path <att.jsonl> --source-uri github.com/<org>/<repo>I.5
DVCContent-addressed dataset versioning - hash-pin and diff each external setdvc add data/raw && dvc pushVII.1

Cloud and infrastructure

ToolWhat it doesInvocationChapter
ProwlerMulti-cloud CIS-aligned posture scanprowler aws --profile <assessment-profile> --output-formats html,json-ocsfV.1
CloudFoxEnumerate exploitable attack paths a compliance scanner will not surface (AWS / Azure / GCP)cloudfox aws --profile <assessment-profile> all-checksV.1
pmapperGraph IAM and compute privilege-escalation paths automaticallypmapper query 'preset privesc *'V.2
PacuAWS exploitation framework - enumerate permissions, test privescpacu then run iam__privesc_scanV.2
nucleiSweep the estate for exposed MLOps, vector and MCP servicesnuclei -tags mlflow,ray,kubeflow -u https://<target-host>I.5

Defense - build and run

ToolWhat it doesInvocationChapter
pytmThreat-model-as-code - regenerates the data-flow diagram and findings on every design changepython tm.py --dfd | dot -Tpng -o dfd.pngVI.3
PresidioMicrosoft PII detection and redaction, on ingest and on live responses and logsfrom presidio_analyzer import AnalyzerEngineVII.1
Amazon MacieManaged PII discovery across S3 before data reaches a training or RAG pipelineaws macie2 create-classification-job --job-type ONE_TIME --s3-job-definition <file://job.json>VII.1
EvidentlyData and prediction drift baselining (PSI / KL) with alert thresholdsfrom evidently.metric_preset import DataDriftPresetVII.1
NannyMLPost-deploy performance estimation without fresh labelsimport nannyml as nmlVII.1
Llama Guard / Prompt GuardMeta’s input / output safety and injection classifiers, run as an inline guardrail- (models, served behind your own inference endpoint)II.5
DefectDojoTrack AI vulnerabilities on the same board as application vulnerabilities (CVSS + EPSS)- (web application, deployed and driven through its UI / API)VII.1

Identity and policy

ToolWhat it doesInvocationChapter
OPAPolicy-as-code - enforce audience, scope and delegation at the resource, not in the promptopa eval -d policy.rego -i input.json 'data.authz.allow'IV.6
CedarAWS policy language for the same job, where the platform speaks Cedar- (policy language, evaluated by the host authorization engine)IV.6

This roster is the index, not the manual. Each command’s full context - the surrounding flags, the caveats, and the authorized-target discipline - lives in its owning chapter. Copy-paste-able engagement artifacts live in templates.