8.8 KiB
Production-Readiness Acceptance Matrix
Matrix version: 0.3
Last audit: 2026-07-13
Release-candidate commit: Not nominated
Overall result: Not ready
This is the current authority for Gitea
#50.
The older H1-H6 files are historical implementation snapshots and do not satisfy this gate.
Evidence Rules
| State | Meaning |
|---|---|
| Pass | Candidate-specific evidence proves the full row. |
| Partial | Some implementation/evidence exists, but the full row is not proven. |
| Deferred | The project owner has explicitly postponed this check; it is not a pass. |
| Missing | Required implementation or candidate evidence does not exist. |
| Fail | Current authoritative evidence contradicts the gate. |
| External | Requires a person other than the implementer. |
Acceptance evidence must name the exact candidate commit and commands or protocol used. Results from another commit, a dirty worktree, or an older package do not transfer to the candidate.
Exit Gate
| ID | Requirement | State | Current evidence and gap |
|---|---|---|---|
| G1 | Project create/open/resume, scene authoring, autosave/recovery, hierarchy, prefab, and asset integrity pass | Fail | Project/recovery/session/multi-scene/prefab implementations are documented in project launcher, session recovery, multi-scene composition, and prefab authoring. Collaborative file safety #49 and non-blocking native dialogs #52 passed live acceptance, but #55 records unguarded native dirty shutdown and a missing clean-history savepoint. Candidate-specific end-to-end reruns also remain. |
| G2 | Brush, material, terrain, physics placement, animation, audio, navigation, PIE, and build/package samples pass | Partial | The five-area sample pack now provides deterministic Brush, Material, Terrain, Physics Placement, and Rendering fixtures with source validation. Animation, audio, navigation, PIE, and build foundations also exist, but the exact-candidate pack rerun, brush acceptance #37, and combined workflow evidence remain incomplete. Packaged testing is owner-deferred. |
| G3 | Undo/redo/cancel invariants and helper cleanup cover every production mutation path | Partial | Source implementation and focused evidence are complete in operator regression testing and the operator-invariants evaluation; Gitea #33 closed at c55f347. A clean, exact-candidate rerun is still required for Pass. |
| G4 | Representative project completes an eight-hour soak without unbounded memory/target growth or unrecoverable failure | Missing | No candidate soak log, resource timeline, failure ledger, or target-growth measurement exists. |
| G5 | Cold start, scene open/save, asset refresh, common manipulation, and package-build budgets are documented and measured | Missing | Gitea #34 is open; no ratified budgets or candidate measurement record exists. |
| G6 | Headless content validation and CI are green from a clean checkout | Missing | CI configuration hydrates LFS and includes both project and sample content gates. Local implementation checks have passed, but no clean-checkout candidate run is linked. The current Gitea server does not expose an Actions run endpoint for this repository. |
| G7 | First-hour UX and recovery QA are signed off by someone other than the implementer | External | No independent sign-off exists. Gitea #36 remains open; historical H1-H6 implementation-pass notes do not count. |
| G8 | Known limitations have severity/workaround and no P0 blocker remains | Fail | The sample-pack implementation removes the previously identified #32 content gap, pending exact-commit native evidence and ticket closure, but guarded native shutdown and clean history savepoints remain the open P0 #55. A consolidated candidate limitations ledger is also missing. Deterministic imported-asset fingerprints #56 and property-block application #53 are P1; dynamic deformed Solari geometry #54 is a documented P2 limitation with Forward/raster fallback. |
Deliverables
| ID | Deliverable | State | Evidence or next action |
|---|---|---|---|
| D1 | Versioned acceptance matrix under docs/editor/evaluations/ |
Pass | This file, version 0.3. |
| D2 | Release-candidate representative project and reproducible validation commands | Partial | The committed sample regression pack and commands exist. Nominate an exact commit, rerun from a clean LFS-hydrated checkout, and attach native results. |
| D3 | Signed milestone comment linking evidence, limitations, and exact commit | Missing | Post only after G1-G8 pass; no candidate exists yet. |
Workflow Coverage
| Workflow | Implementation status | Candidate acceptance |
|---|---|---|
| Project create/open/resume | Implemented | Not rerun |
| Scene save, autosave, recovery | Implemented | Not rerun |
| Hierarchy parenting and prefab structure | Implemented | Not rerun |
| Multi-scene composition | Implemented | Not rerun |
| Five-area editor sample pack | Implemented with manifest, native menu, typed scene gate, and headless validation | Source evidence recorded; exact-candidate native run pending |
| Brush blockout/edit/CSG | Implemented foundation; #37 open |
Not signed off |
| Material catalog and assignment | Renderer/material foundation #51, Material Library, and exact targeted drops accepted; optional property-block promotion is #53 |
Not rerun as one candidate |
| Rendering volumes and look development | Deterministic visible rendering fixture is in the sample pack | Not rerun as one candidate |
| Terrain authoring | #22-#24 source/live acceptance complete; M3 closed |
Feature-level live acceptance exists; not rerun as one candidate. Packaged-runtime acceptance owner-deferred. |
| Physics placement | #25 source/live acceptance complete |
Feature-level live acceptance exists; not rerun as one candidate. Packaged-runtime acceptance owner-deferred. |
| Collider authoring and diagnostics | #26 source/live acceptance complete |
Feature-level live acceptance exists; not rerun as one candidate. Packaged-runtime acceptance owner-deferred. |
| Animation | Implemented | Not rerun |
| Audio | Implemented | Not rerun |
| Navigation | Implemented | Not rerun |
| PIE | Implemented | Not rerun |
| Build/package/runtime | Implemented foundation | Deferred by owner |
| Collaborative file safety | Implemented; #49 closed with live external-change acceptance |
Not rerun as one candidate |
| Native file/folder dialogs | Implemented; #52 closed with live 12-second compositor-responsiveness hold |
Not rerun as one candidate |
Candidate Validation Commands
Run these from a fresh clone of the nominated commit with Git LFS content present. Record wall time, machine profile, exit code, and artifact hashes. Packaged commands stay disabled until the project owner re-enables them.
cargo fmt --all -- --check
cargo check --workspace --all-targets
cargo clippy --workspace --all-targets -- -D warnings
cargo clippy -p editor -p game --bins --features dev,hot-reload -- -D warnings
cargo test --workspace
cargo validate-levels --project .
cargo validate-samples --project .
cargo bake-navigation --project . --check
When packaged acceptance is re-enabled, append the exact package-project profile/target commands,
package hash verification, and packaged-runtime smoke protocol used for the candidate.
Soak Protocol
The final candidate must run for eight continuous hours against the representative project. The record must sample process RSS, GPU memory, target-directory size, recovery generations, background job counts, and error/warning totals at least every five minutes. Exercise scene switching, save and recovery, asset refresh, all five sample-pack scenes, material editing, brush/terrain/physics tools, animation/audio/navigation, PIE transitions, and build UI cancellation without replacing the candidate during the run.
A pass requires no unrecoverable editor failure, no lost authored work, no unbounded upward trend in
steady-state resource use, bounded recovery/cache behavior, and a triaged explanation for every
error. Numeric thresholds remain blocked on the performance-budget work in #34.
Independent Sign-Off
The evaluator must not be the implementation agent. They record the candidate commit, machine, elapsed first-hour workflow, recovery scenario, defects, severity, and go/no-go decision. Waivers must include a workaround and owner ticket; an open P0 cannot be waived.