Files
erofs-freebsd-out-tree/tests/EXECUTION-CHECKLIST.md
T
2026-08-18 09:20:44 +02:00

79 lines
3.4 KiB
Markdown

# Test Execution Checklist
## Acceptance Rules
- [x] Execute each TC from its Markdown procedure and record direct command
status, fixture/module hashes, kernel behavior, and cleanup state.
- [x] Treat fixture generation and static review as supporting evidence only.
- [x] Do not use retired wrappers, result collectors, or unconditional PASS
output as acceptance evidence.
- [x] Keep CI and automated kernel-test infrastructure outside this task.
## Specification Audit
- [x] TC000 is present as the non-executable template.
- [x] TC001-TC161 are present exactly once.
- [x] Bounded filename audit: 162 rows, 162 unique IDs, no duplicate or gap.
- [x] G1-G8 table audit: 156 rows, 156 unique IDs, no duplicate or omission.
- [x] TC157-TC161 add five unique final-review cases.
## Canonical Execution Groups
| Group | Scope | Final result | Evidence |
| --- | --- | --- | --- |
| G1 | TC001, TC007, TC009, TC011-TC014, TC019-TC040, TC147, TC150, TC151 | 32 PASS | `results/manual/2026-08-09T0710Z-g1/` |
| G2 | TC002, TC008, TC010, TC015-TC018, TC112-TC116, TC119 | 13 PASS | `results/manual/2026-08-09T0710Z-g2/` |
| G3 | TC041-TC066, TC141, TC148, TC149, TC152, TC153 | 31 PASS | `results/manual/2026-08-09T1059Z-g3/` plus TC060 fixed-source rerun |
| G4 | TC005, TC067-TC083, TC117, TC134-TC140, TC142 | 27 PASS | `results/manual/2026-08-09T0839Z-g4/` |
| G5 | TC003, TC004, TC084-TC092, TC102-TC110, TC143-TC146 | 23 PASS, 1 PARTIAL | `results/manual/2026-08-09T1236Z-g5/` |
| G6 | TC006, TC093-TC101, TC118 | 11 PASS | `results/manual/2026-08-09T1244Z-g6/` |
| G7 | TC120-TC130 | 11 PASS | `results/manual/2026-08-09T1359Z-g7/` |
| G8 | TC111, TC131-TC133, TC154-TC156 | 7 PASS | `results/manual/2026-08-09T1343Z-g8/` |
| Final | TC157-TC161 | 5 PASS | `results/manual/2026-08-09T1804Z-final-review-independent/` |
## Final Review Cases
- [x] TC157: global 16/32-byte explicit-extent order validation.
- [x] TC158: extended compressed inode 48-bit block-count accounting.
- [x] TC159: special-vnode combined setattr rejection.
- [x] TC160: dot-omitted `OFF_MAX` cookie rejection.
- [x] TC161: fatal `nm` failure and uncontaminated post-shim rebuild.
## Build and Runtime Sign-Off
- [x] Exact final source baseline:
`fcc85b93d5f8fd9671686bd68bf3b086c8bd25cf`.
- [x] `WITH_ZSTDIO=0` built with kernel `-Werror`; KLD SHA256
`15fda9d334132cd81769ce4dff4f8411a6e2b4cf7531c352530d0de85f42a2d2`.
- [x] `WITH_ZSTDIO=1` built with kernel `-Werror`; KLD SHA256
`23782dc0ce7da188807d35020bf2d8c6044b796c5c9a8746b398ba784cd6ad4e`.
- [x] Both final KLDs loaded and completed a read-only mount smoke.
- [x] Final guest EROFS mounts, md units, EROFS KLDs, and DTrace KLDs: zero.
- [x] repo22 generated build/object/image/bytecode artifacts removed.
## Final Statistics
```text
Executable test cases: 161
Executed: 161
PASS: 160
PARTIAL: 1 (TC146)
FAIL: 0
KERNEL-FAIL: 0
ENVIRONMENT-UNAVAILABLE: 0
SHELVED test case: 0
```
TC146 is PARTIAL because a positive explicit mapped-payload fixture is not
available. Its shelved subitem is not a separate TC. TC010, TC060, and TC153
are resolved historical issues.
## Residual Work
- [ ] Obtain an independently validated positive explicit mapped-payload
fixture and complete the remaining TC146 subfeature.
- [ ] Optionally extend TC157 with first-nonzero-`lstart` and extreme
extent-count performance coverage if the format contract and a qualified
fixture require it.
- [ ] CI remains intentionally unimplemented and outside this test effort.