|
|
|
@@ -0,0 +1,104 @@
|
|
|
|
|
# Production-Readiness Acceptance Matrix
|
|
|
|
|
|
|
|
|
|
**Matrix version:** 0.1
|
|
|
|
|
|
|
|
|
|
**Last audit:** 2026-07-12
|
|
|
|
|
|
|
|
|
|
**Release-candidate commit:** Not nominated
|
|
|
|
|
|
|
|
|
|
**Overall result:** **Not ready**
|
|
|
|
|
|
|
|
|
|
This is the current authority for Gitea
|
|
|
|
|
[`#50`](https://git.spacetrainclubhouse.com/Falling-Metal-Interactive/Blacksite/issues/50).
|
|
|
|
|
The older H1-H6 files are historical implementation snapshots and do not satisfy this gate.
|
|
|
|
|
|
|
|
|
|
## Evidence Rules
|
|
|
|
|
|
|
|
|
|
| State | Meaning |
|
|
|
|
|
|-------|---------|
|
|
|
|
|
| Pass | Candidate-specific evidence proves the full row. |
|
|
|
|
|
| Partial | Some implementation/evidence exists, but the full row is not proven. |
|
|
|
|
|
| Deferred | The project owner has explicitly postponed this check; it is not a pass. |
|
|
|
|
|
| Missing | Required implementation or candidate evidence does not exist. |
|
|
|
|
|
| Fail | Current authoritative evidence contradicts the gate. |
|
|
|
|
|
| External | Requires a person other than the implementer. |
|
|
|
|
|
|
|
|
|
|
Acceptance evidence must name the exact candidate commit and commands or protocol used. Results from
|
|
|
|
|
another commit, a dirty worktree, or an older package do not transfer to the candidate.
|
|
|
|
|
|
|
|
|
|
## Exit Gate
|
|
|
|
|
|
|
|
|
|
| ID | Requirement | State | Current evidence and gap |
|
|
|
|
|
|----|-------------|-------|--------------------------|
|
|
|
|
|
| G1 | Project create/open/resume, scene authoring, autosave/recovery, hierarchy, prefab, and asset integrity pass | Partial | Project/recovery/session/multi-scene/prefab implementations are documented in [project launcher](../../project-launcher.md), [session recovery](../../session-recovery.md), [multi-scene composition](../../multi-scene-composition.md), and [prefab authoring](../../prefab-authoring.md). Candidate-specific end-to-end reruns and the open asset-integrity work remain. |
|
|
|
|
|
| G2 | Brush, material, terrain, physics placement, animation, audio, navigation, PIE, and build/package samples pass | Fail | Animation, audio, navigation, and build foundations are implemented. Material/drag-drop tickets `#16`, `#18`, and `#51` remain open; terrain `#22`-`#24` and physics placement `#25` are not complete; brush acceptance `#37` remains open. Packaged testing is owner-deferred. |
|
|
|
|
|
| G3 | Undo/redo/cancel invariants and helper cleanup cover every production mutation path | Partial | The reusable harness and current tool coverage are documented in [operator regression testing](../../operator-regression-testing.md). Gitea `#33` remains open for terrain-stroke and physics-settle fixtures after those tools exist. |
|
|
|
|
|
| G4 | Representative project completes an eight-hour soak without unbounded memory/target growth or unrecoverable failure | Missing | No candidate soak log, resource timeline, failure ledger, or target-growth measurement exists. |
|
|
|
|
|
| G5 | Cold start, scene open/save, asset refresh, common manipulation, and package-build budgets are documented and measured | Missing | Gitea `#34` is open; no ratified budgets or candidate measurement record exists. |
|
|
|
|
|
| G6 | Headless content validation and CI are green from a clean checkout | Missing | [CI configuration](../../../../.github/workflows/ci.yml) exists and local source/headless checks have passed during feature work, but no clean-checkout candidate run is linked. The current Gitea server does not expose an Actions run endpoint for this repository. |
|
|
|
|
|
| G7 | First-hour UX and recovery QA are signed off by someone other than the implementer | External | No independent sign-off exists. Gitea `#36` remains open; historical H1-H6 implementation-pass notes do not count. |
|
|
|
|
|
| G8 | Known limitations have severity/workaround and no P0 blocker remains | Fail | Limitations are distributed across feature docs rather than one candidate ledger. Open P0 work includes `#16`, `#18`, `#32`, `#33`, `#35`, and `#51`; `#50` cannot close while a gate-relevant P0 remains. |
|
|
|
|
|
|
|
|
|
|
## Deliverables
|
|
|
|
|
|
|
|
|
|
| ID | Deliverable | State | Evidence or next action |
|
|
|
|
|
|----|-------------|-------|-------------------------|
|
|
|
|
|
| D1 | Versioned acceptance matrix under `docs/editor/evaluations/` | Pass | This file, version 0.1. |
|
|
|
|
|
| D2 | Release-candidate representative project and reproducible validation commands | Missing | Expand the committed project/regression pack through `#32`, including terrain and physics-placement samples, then nominate an exact commit. |
|
|
|
|
|
| D3 | Signed milestone comment linking evidence, limitations, and exact commit | Missing | Post only after G1-G8 pass; no candidate exists yet. |
|
|
|
|
|
|
|
|
|
|
## Workflow Coverage
|
|
|
|
|
|
|
|
|
|
| Workflow | Implementation status | Candidate acceptance |
|
|
|
|
|
|----------|-----------------------|----------------------|
|
|
|
|
|
| Project create/open/resume | Implemented | Not rerun |
|
|
|
|
|
| Scene save, autosave, recovery | Implemented | Not rerun |
|
|
|
|
|
| Hierarchy parenting and prefab structure | Implemented | Not rerun |
|
|
|
|
|
| Multi-scene composition | Implemented | Not rerun |
|
|
|
|
|
| Brush blockout/edit/CSG | Implemented foundation; `#37` open | Not signed off |
|
|
|
|
|
| Material catalog and assignment | Partial; `#16`, `#18`, `#51` open | Blocked |
|
|
|
|
|
| Terrain authoring | `#22`-`#24` open | Blocked |
|
|
|
|
|
| Physics placement | `#25` open | Blocked |
|
|
|
|
|
| Animation | Implemented | Not rerun |
|
|
|
|
|
| Audio | Implemented | Not rerun |
|
|
|
|
|
| Navigation | Implemented | Not rerun |
|
|
|
|
|
| PIE | Implemented | Not rerun |
|
|
|
|
|
| Build/package/runtime | Implemented foundation | Deferred by owner |
|
|
|
|
|
| Collaborative file safety | Local source/headless acceptance; `#49` open | Awaiting publication and live visual QA |
|
|
|
|
|
|
|
|
|
|
## Candidate Validation Commands
|
|
|
|
|
|
|
|
|
|
Run these from a fresh clone of the nominated commit with Git LFS content present. Record wall time,
|
|
|
|
|
machine profile, exit code, and artifact hashes. Packaged commands stay disabled until the project
|
|
|
|
|
owner re-enables them.
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
cargo fmt --all -- --check
|
|
|
|
|
cargo check --workspace --all-targets
|
|
|
|
|
cargo clippy --workspace --all-targets -- -D warnings
|
|
|
|
|
cargo clippy -p editor -p game --bins --features dev,hot-reload -- -D warnings
|
|
|
|
|
cargo test --workspace
|
|
|
|
|
cargo validate-levels --project .
|
|
|
|
|
cargo bake-navigation --project . --check
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
When packaged acceptance is re-enabled, append the exact `package-project` profile/target commands,
|
|
|
|
|
package hash verification, and packaged-runtime smoke protocol used for the candidate.
|
|
|
|
|
|
|
|
|
|
## Soak Protocol
|
|
|
|
|
|
|
|
|
|
The final candidate must run for eight continuous hours against the representative project. The
|
|
|
|
|
record must sample process RSS, GPU memory, target-directory size, recovery generations, background
|
|
|
|
|
job counts, and error/warning totals at least every five minutes. Exercise scene switching, save and
|
|
|
|
|
recovery, asset refresh, material editing, brush/terrain/physics tools, animation/audio/navigation,
|
|
|
|
|
PIE transitions, and build UI cancellation without replacing the candidate during the run.
|
|
|
|
|
|
|
|
|
|
A pass requires no unrecoverable editor failure, no lost authored work, no unbounded upward trend in
|
|
|
|
|
steady-state resource use, bounded recovery/cache behavior, and a triaged explanation for every
|
|
|
|
|
error. Numeric thresholds remain blocked on the performance-budget work in `#34`.
|
|
|
|
|
|
|
|
|
|
## Independent Sign-Off
|
|
|
|
|
|
|
|
|
|
The evaluator must not be the implementation agent. They record the candidate commit, machine,
|
|
|
|
|
elapsed first-hour workflow, recovery scenario, defects, severity, and go/no-go decision. Waivers
|
|
|
|
|
must include a workaround and owner ticket; an open P0 cannot be waived.
|