Rbanh/schemeta
1
0
Fork 0
Code Issues 2 Pull Requests Actions Packages Projects Releases Wiki Activity

P8-09: QA hardening - visual/readability gates + e2e matrix #45

New Issue
Closed
opened 2026-02-19 19:04:56 -05:00 by Rbanh · 6 comments
Rbanh commented 2026-02-19 19:04:56 -05:00
Owner
Copy Link

Goal:
Ship with measurable quality bars.

Scope:

  • Expand Playwright scenarios (drag stress, symbol edits, net edits, import variants).
  • Add readability metrics (label collisions, pin collisions, edge density hotspots).
  • CI matrix for viewport sizes and render modes.
  • Stabilize snapshots with deterministic state initialization.

Acceptance:

  • CI blocks on readability regressions.
  • Report artifact includes crossings/overlaps/detour + label collision counts.
  • Test flake rate reduced to near-zero.
Goal: Ship with measurable quality bars. Scope: - Expand Playwright scenarios (drag stress, symbol edits, net edits, import variants). - Add readability metrics (label collisions, pin collisions, edge density hotspots). - CI matrix for viewport sizes and render modes. - Stabilize snapshots with deterministic state initialization. Acceptance: - CI blocks on readability regressions. - Report artifact includes crossings/overlaps/detour + label collision counts. - Test flake rate reduced to near-zero.
Rbanh added this to the Phase 8 - React/ELK Core Refactor milestone 2026-02-19 19:05:18 -05:00
Rbanh commented 2026-02-19 22:57:32 -05:00
Author
Owner
Copy Link

QA run summary after Sprint 3 local integration (dc9c277, pending push):

Executed:

  • npm test -> pass
  • npm run test:ui -> pass

Artifacts updated in local workspace:

  • output/playwright/ui-metrics-report.json

Current report highlights:

  • Initial sample: 0 crossings, 0 overlaps, 2.09x detour
  • After drag: 0 crossings, 0 overlaps, 2.29x detour
  • After drag+tidy: 1 crossing, 0 overlaps, 2.67x detour
  • Dense fixture: 0 crossings, 0 overlaps, 2.91x detour (2 warnings expected)

Known environment gap:

  • React lint/build checks are currently skipped in this host due missing frontend-react/node_modules and blocked npm registry (EAI_AGAIN).
QA run summary after Sprint 3 local integration (`dc9c277`, pending push): Executed: - `npm test` -> pass - `npm run test:ui` -> pass Artifacts updated in local workspace: - `output/playwright/ui-metrics-report.json` Current report highlights: - Initial sample: `0 crossings`, `0 overlaps`, `2.09x detour` - After drag: `0 crossings`, `0 overlaps`, `2.29x detour` - After drag+tidy: `1 crossing`, `0 overlaps`, `2.67x detour` - Dense fixture: `0 crossings`, `0 overlaps`, `2.91x detour` (2 warnings expected) Known environment gap: - React lint/build checks are currently skipped in this host due missing `frontend-react/node_modules` and blocked npm registry (`EAI_AGAIN`).
Rbanh commented 2026-02-19 23:02:32 -05:00
Author
Owner
Copy Link

Additional QA pass after Sprint 4 (e69f2db, local):

Executed:

  • npm test -> pass (7/7)
  • npm run test:ui:update-baselines -> pass
  • npm run test:ui -> pass

Regression artifacts updated:

  • tests/baselines/ui/*.png refreshed for deterministic label-placement changes.
  • output/playwright/ui-metrics-report.json result: pass.

Latest metrics remain within thresholds:

  • Initial: 0 crossings / 0 overlaps / 2.09x detour
  • After drag: 0 / 0 / 2.29x
  • After drag+tidy: 1 / 0 / 2.67x
  • Dense: 0 / 0 / 2.91x (2 warnings expected)

Current external blocker remains unchanged:

  • Cannot push commits to remote from this environment (Could not resolve host: git.spacetrainclubhouse.com).
Additional QA pass after Sprint 4 (`e69f2db`, local): Executed: - `npm test` -> pass (7/7) - `npm run test:ui:update-baselines` -> pass - `npm run test:ui` -> pass Regression artifacts updated: - `tests/baselines/ui/*.png` refreshed for deterministic label-placement changes. - `output/playwright/ui-metrics-report.json` result: pass. Latest metrics remain within thresholds: - Initial: 0 crossings / 0 overlaps / 2.09x detour - After drag: 0 / 0 / 2.29x - After drag+tidy: 1 / 0 / 2.67x - Dense: 0 / 0 / 2.91x (2 warnings expected) Current external blocker remains unchanged: - Cannot push commits to remote from this environment (`Could not resolve host: git.spacetrainclubhouse.com`).
Rbanh commented 2026-02-19 23:10:15 -05:00
Author
Owner
Copy Link

Post-Sprint 5 QA confirmation (b8d894f pushed):

  • npm test pass (8/8)
  • npm run test:ui pass

I also caught and fixed an overreach regression during implementation:

  • Initial geometry normalization affected all symbols and broke snapshot baseline.
  • Adjusted scope to generic/template symbols only.
  • Re-ran full suites after fix; all green.
Post-Sprint 5 QA confirmation (`b8d894f` pushed): - `npm test` pass (8/8) - `npm run test:ui` pass I also caught and fixed an overreach regression during implementation: - Initial geometry normalization affected all symbols and broke snapshot baseline. - Adjusted scope to generic/template symbols only. - Re-ran full suites after fix; all green.
Rbanh commented 2026-02-19 23:52:50 -05:00
Author
Owner
Copy Link

QA update after cc20c0c and 5f31542:

  • Full test matrix green (npm test, npm run test:ui).
  • UI regression baselines refreshed to reflect improved stable behavior:
    • placement-preservation compile behavior
    • label/annotation compositor adjustments
  • Deterministic render hash updated in tests/render-regression.test.js.
QA update after `cc20c0c` and `5f31542`: - Full test matrix green (`npm test`, `npm run test:ui`). - UI regression baselines refreshed to reflect improved stable behavior: - placement-preservation compile behavior - label/annotation compositor adjustments - Deterministic render hash updated in `tests/render-regression.test.js`.
Rbanh commented 2026-02-20 00:11:29 -05:00
Author
Owner
Copy Link

QA status after fc5f2fe:

  • Full matrix green: npm test, npm run test:ui.
  • Updated deterministic SVG hash baseline in tests/render-regression.test.js.
  • Refreshed UI snapshots for changed placement/readability behavior.
  • Dense fixture gates pass again (crossings/overlaps/detour).
QA status after `fc5f2fe`: - Full matrix green: `npm test`, `npm run test:ui`. - Updated deterministic SVG hash baseline in `tests/render-regression.test.js`. - Refreshed UI snapshots for changed placement/readability behavior. - Dense fixture gates pass again (crossings/overlaps/detour).
Rbanh commented 2026-02-20 01:35:39 -05:00
Author
Owner
Copy Link

Closing as completed. QA hardening delivered with deterministic visual gates, fixture coverage, and report artifact (npm run test:ui, output/playwright/ui-metrics-report.json) across Phase 8/9.

Closing as completed. QA hardening delivered with deterministic visual gates, fixture coverage, and report artifact (`npm run test:ui`, `output/playwright/ui-metrics-report.json`) across Phase 8/9.
Rbanh closed this issue 2026-02-20 01:35:40 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Phase 8 - React/ELK Core Refactor
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Rbanh/schemeta#45
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?