truf-server/docs/session-handoff/EVIDENCE_INDEX.md

# Evidence Index

Updated: 2026-09-26

This file maps facts to their existing source. Do not duplicate the underlying
evidence in handoff prose.

## STATUS: Authoritative Reports

- `docs/extended-live-validation-2026-09-26.md`
  - Final public-safe report for the two-slot extended live run, including
    settlement, keycheck, evidence integrity, deviation, restore, and open
    defects.
- `build/extended-live-validation/runs/e6ac8aec-ec20-4ba4-a924-abe5ee95d82c/verification-manifest.json`
  - Machine-readable derived aggregates, classifications, evidence hashes,
    terminal state, post-restore state, and test result.
- `docs/worker-operator-experience-live-trace-2026-09-25.md`
  - 295-assignment Windows/Linux cohort, aggregate outcomes, recovery, admin UI,
    pipeline state, tests, and evidence hashes.
- `docs/worker-operator-experience-validation-2026-09-24.md`
  - Earlier bounded production/package acceptance and operator validation.
- `docs/remote-worker-operations.md`
  - Canonical worker install, lifecycle, diagnostics, drain, update, and removal.
- `WORKER_OPERATOR_EXPERIENCE_HANDOFF.md`
  - Historical implementation and reproducible artifact detail. Its stop point
    predates the final live trace and defect-fix rollout.
- `openspec/changes/add-worker-operator-experience/tasks.md`
  - Current completion authority: all 27 tasks checked.

## RAW: Private Live Evidence

- `build/extended-live-validation/runs/e6ac8aec-ec20-4ba4-a924-abe5ee95d82c`
  - Local run root with compact server artifacts and complete worker evidence.
  - Server NDJSON SHA-256:
    `a6beb1864c540fc5f22b2b647730a39e45dfddb10cf5ceff5e0181eb1a8f0bd8`.
  - Worker NDJSON SHA-256:
    `03a04a0da5a2db6bd02f2aaed41c191554b135ec287fbc1e2d9998d77da59898`.
  - Server run SHA-256:
    `5ae58df5f67a8d2a8d4e84d73262a6e7009e03dcbcc9ea176537b384d4e693c3`.
- Private production server evidence root:
  `/var/lib/docker/volumes/truf-remote-server-data/_data/extended-live-validation/e6ac8aec-ec20-4ba4-a924-abe5ee95d82c`
  - Complete server evidence, approximately 1.2 GiB. Analyze in place and do not
    copy raw values into public documents.
- `build/live-trace-20260925/raw-evidence-final.json`
  - Complete server cohort evidence. Historical recorded SHA-256:
    `4071e38a1dec540663bc6febd9538ff54bedafa1627250933045beb8f7d09ec5`.
- `build/live-trace-20260925/raw-evidence-expanded.json`
  - Expanded unrestricted evidence used for defect diagnosis.
- `build/live-trace-20260925/monitor-final.ndjson`
  - Time-series server monitor. Historical SHA-256:
    `e07507b0b8f0f86d1a1c7aade7186297c372b1ff177067bea19dfd219f5027a9`.
- `build/live-trace-20260925/windows-localappdata/TRUF/RemoteWorker`
  - Final retained Windows worker state, events, history, logs, and inactive
    abandoned roots.
- `build/live-trace-20260925/linux-worker-state-final.tar.gz`
  - Final retained Linux worker state. Historical SHA-256:
    `b64e81c90b232f46b400a63ed08f5660f46e34fedb1f67b64afba079d8d36364`.
- `build/live-trace-20260925/dockerhub-discovery-db-raw.json`
- `build/live-trace-20260925/dockerhub-unmasked-cycle-failure.json`
- `build/live-trace-20260925/dockerhub-discovery.log`
  - Raw DockerHub retry defect evidence.

These files may contain sensitive raw values. Analyze them in place; do not copy
their contents into a public document.

## STATUS: Defects and Current Treatment

- Extended-run open items:
  - Windows GitLab filename-too-long checkout recovery is local and not
    deployed.
  - Invalid API-key classification is fixed locally and not deployed.
  - A roughly 20-second WSL clock-domain monotonic failure remains open.
  - Generic `WorkerContractError` diagnostics lose structured field detail.
  - Six monitor aggregate-query statement timeouts recovered during the run.
- `KEYCHECK-001` deviation:
  - An unintended authenticated broad recheck processed 35 provider checks
    instead of only the two pending candidates. All effects settled; do not
    repeat this probe.
- `docs/defect-windows-scan-timestamps-utc-2026-09-25.md`
  - Still open. Local `app/scanner.py` continues to create naive timestamps.
- `docs/defect-dockerhub-discovery-retry-null-type-2026-09-25.md`
  - Original report says local-only. Current source has the PostgreSQL
    `CAST(? AS TEXT)` correction and the defect-fix rollout included it. Reverify
    live retry coalescing during the extended run.
- `docs/defect-terminal-status-scan-deadline-readback-2026-09-25.md`
  - Original report says open. Current source preserves durable deadlines with
    `result.setdefault('deadlines', observability['deadlines'])`; included in the
    defect-fix rollout. Reverify terminal readback.
- `docs/defect-worker-network-oserror-mislabeled-local-io-2026-09-25.md`
  - Original report says open. Current source introduces `WorkerNetworkError`
    before broad `OSError` classification; included in the defect-fix worker
    artifacts. Reverify under a real transport failure.

## STATUS: Defect-Fix Rollout Artifacts

- `build/runtime-defect-fixes-v1/deploy-runtime.sh`
  - Atomic runtime/manifests cutover and rollback logic.
- `build/runtime-defect-fixes-v1/windows-b.zip`
- `build/runtime-defect-fixes-v1/windows-b.zip.json`
- `build/runtime-defect-fixes-v1/linux-worker-package.json`
- `build/runtime-defect-fixes-v1/verify-production-worker.py`
- `build/runtime-defect-fixes-v1/restore-production-worker.py`

Recorded identities:

- Deployed runtime image:
  `sha256:7d84fdf57a1cb9e6d38a571fbd3566b7549f1cda04ae02c4864cac70f74f2aaa`.
- Current WSL worker image:
  `sha256:491b3a2343571072209a7f92e83399fe206006dcccf247a0c551c50fc9f35e30`.
- Rollback tag: `truf-local:runtime-pre-defect-fixes-v1`.
- New registered manifest file hashes from the deploy script:
  - Linux: `b9d3594e4846a21ca12de5fc6973c04d9eea6f61fd0ecda83875426aa48c7b4b`.
  - Windows: `4cc97d17c34f7d89150927719f131f426f1068ab99af7f3f2f156d8642ae539e`.

## STATUS: Historical Accepted Artifacts

The pre-defect-fix live trace used:

- Windows package manifest:
  `78a962b2bd3fa411413c79e9a8ffb021608a08ff020b1ad851f4505ea634b2b6`.
- Linux package identity:
  `45588f2cf406b41b239cfa3b8a9dc83fe84b587229bc997b2729016e1f0dde42`.
- Linux image:
  `sha256:3a088f5743121d823aae132234a29730a84339cecbfda5fc601e8e942f9948c3`.

These remain valid historical evidence but are not the preferred artifacts for
the new defect-fix observation run.

## VERIFY: Fast Orientation Commands

Run from `D:\truf-workers`:

```powershell
openspec list --json
git status --short --branch
python -B -m pytest tests/test_worker_api.py tests/test_worker_api_runtime.py tests/test_worker_assignment.py tests/test_worker_assignment_runner.py tests/test_worker_cli.py tests/test_worker_contracts.py tests/test_worker_local_state.py tests/test_worker_observability_db.py tests/test_worker_package.py tests/test_worker_runner_handoff_linux.py tests/test_worker_supervisor.py tests/test_remote_worker_db.py tests/test_scan_execution.py tests/test_admin_api.py -q
```

Do not use an unrestricted repository-wide pytest run as the release gate. Do
not use Git clean/reset/checkout in this uncommitted snapshot.