Skip to content

Taxonomy outputs and field guide

This page shows what a finished generation run leaves on disk, which file to build on, and how to open the browser field guide.

Every generation run produces a self-contained result directory. Keep the whole directory when reproducibility matters; taxonomy.json alone is enough for the judge. From Python, render_taxonomy_html(taxonomy_path) produces the same read-only field guide as adamast view.

๐Ÿ“ Output directory

taxonomy-run/
โ”œโ”€โ”€ taxonomy.json
โ”œโ”€โ”€ taxonomy.html
โ”œโ”€โ”€ taxonomy.draft.json
โ”œโ”€โ”€ manifest.json
โ””โ”€โ”€ artifacts/
    โ”œโ”€โ”€ inputs/
    โ”‚   โ”œโ”€โ”€ traces.normalized.jsonl
    โ”‚   โ””โ”€โ”€ trace_report.json
    โ”œโ”€โ”€ draft/
    โ””โ”€โ”€ agreement/

๐Ÿ‘€ Open the browser field guide

adamast view ./taxonomy-run/taxonomy.json

This creates or refreshes a self-contained taxonomy.html and opens it in the default browser. The view is read-only and scoped to that one taxonomy.

Make it yours

--manifest points at a manifest stored elsewhere; --output plus --no-open writes the HTML without opening a browser; --view on adamast generate opens the guide right after generation. Full commands below.

Supply a manifest explicitly

When the manifest is not next to the taxonomy:

adamast view ./taxonomy.json --manifest ./run-manifest.json

Write without opening

adamast view \
  ./taxonomy-run/taxonomy.json \
  --output ./exports/taxonomy-field-guide.html \
  --no-open

The resulting HTML is portable and can be archived with experiment artifacts.

Open directly after generation

adamast generate \
  --provider openai \
  --traces ./traces.jsonl \
  --output ./taxonomy-run \
  --view

Generation always writes taxonomy.html; --view controls whether the browser opens automatically.

๐Ÿ“„ taxonomy.json

This is the stable, integration-neutral taxonomy document. The important fields are the public status and the flat code catalog:

{
  "schema_version": 1,
  "status": "accepted",
  "display_name": "Task scheduling failure taxonomy",
  "codes": [
    {
      "id": "A.1",
      "name": "Tool response truncated",
      "description": "...",
      "category": "A",
      "when_to_use": "...",
      "when_not_to_use": "...",
      "severity": "major"
    }
  ]
}

Consumers should use codes[].id as the displayed code, validate the taxonomy status, and preserve unknown fields for forward compatibility.

๐Ÿงพ manifest.json

The manifest records how the result was produced:

  • input paths and normalized trace report;
  • provider, model, and output-token limit;
  • agreement thresholds and final metrics;
  • final status;
  • paths to the draft and intermediate artifacts.

Note

Credentials are never written to the manifest.

๐Ÿ—ƒ๏ธ Draft and agreement artifacts

taxonomy.draft.json is the pre-agreement layered A/B/C draft. The artifacts/draft/ directory contains generation-stage intermediates, while artifacts/agreement/ contains round-level annotations, reconciliations, assignments, metrics, and refinements.

Warning

These files are research and debugging artifacts. Downstream integrations should depend on taxonomy.json, not an internal round filename.

๐Ÿ”’ Preserve reproducibility

  • Archive the normalized inputs, manifest, and agreement artifacts together.
  • Record the exact model ID rather than relying only on a changing provider default.
  • Keep taxonomy status and thresholds with any reported evaluation result.
  • Do not edit taxonomy.json without recording that it is now a manually revised artifact.

โžก๏ธ Continue with