Blacksite/docs/editor/evaluations/sample-regression-pack
2026-07-13 01:52:58 -04:00
..
README.md Add editor sample regression pack 2026-07-13 01:52:58 -04:00

Sample Regression Pack Evaluation

Date: 2026-07-13

Issue: Gitea #32

Implementation commit: Pending commit

Release-candidate commit: Not nominated

Implementation validation: Pass

Native visual acceptance: Pending

This record separates source/fixture verification from release-candidate acceptance. The committed five-area catalog and scenes are ready for native QA, but results from the implementation worktree do not transfer to a later candidate commit.

Source Evidence

Check Result Evidence
Manifest contract Pass Schema v1 contains one ordered entry for Brush, Material, Terrain, Physics Placement, and Rendering, with stable IDs and nonempty checks.
Authored scene fixtures Pass All five scene paths exist; actors use stable IDs and each scene contains its required authored feature.
Project validation Pass cargo validate-levels --project . reported 78 dependencies, five known nonblocking import/platform findings, and zero blocking errors on 2026-07-13.
Typed no-GPU deserialization Pass cargo test -p editor every_manifest_sample_typed_deserializes_without_a_gpu --lib: one passed, zero failed, 256 filtered out.
Sample-pack validation Pass cargo validate-samples --project .: five ordered samples, 83 dependencies, five known nonblocking findings, zero blocking errors.
Clean-checkout CI Pending The exact candidate must hydrate LFS and pass both content gates. Current Gitea does not expose an Actions run endpoint for this repository.

Native Protocol

Open every row through File > Open Sample, not through a typed filesystem path. Capture native screenshots only after confirming the viewport is nonblank and correctly framed.

Sample Required native interaction and visual result Result
Brush Blockout Foundation, material-face tower, and red subtractive marker are distinct; enter brush edit and cancel one edit or clip preview without leaving helpers Pending
Material Lab Concrete cube, custom sphere, instance block, and emissive panel are visible; perform one exact primitive material drop and undo Pending
Terrain Authoring Hill chunks and two material layers render; perform and cancel one sculpt stroke and one paint stroke Pending
Physics Placement Cuboid, sphere, and capsule settle on the floor; cancel restores all three, then commit/undo behaves as one transaction Pending
Rendering Lab Red/cyan/amber anchors and emissive strip render; camera traversal visibly changes vignette, fog, and exposure ownership Pending

For each row, inspect the status strip, Diagnostics panel, and process log for missing references, hydration errors, render errors, helper leaks, or operator failures. Attach native images to the Gitea issue as ordinary uploaded attachments rather than embedding repository raw URLs. A committed original may remain beside this record through Git LFS under the shared evaluation policy.

Release Use

A future candidate may mark this evaluation fully passed only when the exact nominated commit has:

  1. Passed typed scene deserialization, validate-levels, and validate-samples from a clean, LFS-hydrated checkout.
  2. Opened all five entries through the native menu and completed the interactions above.
  3. Recorded the commit, machine profile, commands, exit codes, logs, and native attachments.