forked from testing/wiki
add 9.0 QA:Testing Summary and Go/NoGo Status skeleton docs
This commit is contained in:
parent
ab736ee034
commit
f82431b09c
6
release_criteria/r9/.pages
Normal file
6
release_criteria/r9/.pages
Normal file
@ -0,0 +1,6 @@
|
|||||||
|
---
|
||||||
|
nav:
|
||||||
|
- ... | index.md
|
||||||
|
- Rocky Linux 9 Release Criteria: 9_release_criteria.md
|
||||||
|
- Rocky Linux 9.0 QA and Testing Summary: 9.0_qa_testing_summary.md
|
||||||
|
- Rocky Linux 9.0 GO / NO-GO Status: 9.0_qa_testing_go_no_go.md
|
||||||
89
release_criteria/r9/9.0_qa_testing_go_no_go.md
Normal file
89
release_criteria/r9/9.0_qa_testing_go_no_go.md
Normal file
@ -0,0 +1,89 @@
|
|||||||
|
---
|
||||||
|
title: Rocky Linux 9.0 QA and Testing GO / NO GO Status
|
||||||
|
author: Trevor Cooper
|
||||||
|
revision_date: 2022-05-18
|
||||||
|
rc:
|
||||||
|
prod: Rocky Linux
|
||||||
|
ver: 9
|
||||||
|
---
|
||||||
|
|
||||||
|
# {{ rc.prod }} {{ rc.ver }} QA and Testing : GO / NO GO Status
|
||||||
|
This document summarizes the GO / NO GO Status for Release of Rocky Linux 8.6 from perspective of the QA / Testing efforts. It is based largely on the Release Criteria (https://wiki.rockylinux.org/team/testing/release_criteria/) as was started as an import of that document. If there are differences between the official Release Critieria document and this document the official Release Criteria document will override and this document shall be updated.
|
||||||
|
|
||||||
|
As a reminder, the objective of a release (major or minor) is to provide a solid Enterprise Linux release that is suitable to:
|
||||||
|
- Meet the needs of end users
|
||||||
|
- Meet the needs of enterprises big or small
|
||||||
|
|
||||||
|
|
||||||
|
## SUMMARY
|
||||||
|
|
||||||
|
| Category | Proportion | Remaining Items |
|
||||||
|
| ----------------- | ----------------- | --------------- |
|
||||||
|
| TO_CONFIRM | 0 / 29 (0%) | |
|
||||||
|
| PASS | 0 / 29 (0%) | |
|
||||||
|
| FAIL_NON_BLOCKING | 0 / 29 (0%) | |
|
||||||
|
| FAIL_BLOCKING | 0 / 29 (0%) | |
|
||||||
|
|
||||||
|
|
||||||
|
## SOP
|
||||||
|
In this document each requirement is described and status is specified in the title.
|
||||||
|
|
||||||
|
Current choices are...
|
||||||
|
|
||||||
|
### TO_CONFIRM
|
||||||
|
- this means the item may be INCOMPLETE, PASS, FAIL_NON_BLOCKING or FAIL_BLOCKING and must be verified
|
||||||
|
|
||||||
|
### PASS
|
||||||
|
- this means that the release criteria has been met and is not a blocker
|
||||||
|
|
||||||
|
### FAIL_NON_BLOCKING
|
||||||
|
- this means the release criter has not been met but is non-blocking
|
||||||
|
|
||||||
|
### FAIL_BLOCKING
|
||||||
|
- this means the release criteria has not been met and is blocking
|
||||||
|
|
||||||
|
In this document criteria status should include who completed the item and generally how it was complete.
|
||||||
|
|
||||||
|
Examples...
|
||||||
|
|
||||||
|
- PASS - (@tcooper, virt only, manual)
|
||||||
|
- PASS - (@lumarel, @raktajino, @tcooper, semi-automatic , openQA)
|
||||||
|
|
||||||
|
|
||||||
|
## Initialization Requirements
|
||||||
|
|
||||||
|
- Release-blocking images must boot - PASS - (@neil, @atomicturtle)
|
||||||
|
- Optical Media Requirements - PASS - (@atomicturtle)
|
||||||
|
- Basic Graphics Mode behaviors - PASS - (@tcooper, virt only, manual)
|
||||||
|
- No Broken Packages - PASS - (@tcooper, scripted, manual)
|
||||||
|
- Repositories Must Match Upstream - TO_CONFIRM - (@tcooper, manual)
|
||||||
|
- Debranding - PASS - (@tcooper, scripted, manual)
|
||||||
|
- Media Consistency Verification - PASS - (@tcooper, scripted, manual)
|
||||||
|
- Packages and Installer Sources - PASS - (@lumarel, semi-automatic, openQA test)
|
||||||
|
- NAS (Network Attached Storage) - TO_CONFIRM - (@lumarel?, semi-automatic, openQA dual-host test)
|
||||||
|
- Installation Interfaces - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA, @atomicturtle, manual?, SCAP)
|
||||||
|
- Minimal Installation - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic , openQA)
|
||||||
|
- Kickstart Installation - PASS - (@label, @tcooper, manual, createhdds)
|
||||||
|
- Disk Layouts - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
|
||||||
|
- Firmware RAID - TO_CONFIRM - (@tbd, missing hardware support?)
|
||||||
|
- Bootloader Disk Selection - PASS - (@raktajino, manual)
|
||||||
|
- Storage Volume Resize - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
|
||||||
|
- Update Image - PASS - (@raktajino,@tcooper, semi-automatic, openQA)
|
||||||
|
- Installer Help - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
|
||||||
|
- Installer Translations - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
|
||||||
|
|
||||||
|
|
||||||
|
## Cloud Image Requirements
|
||||||
|
- Images Published to Cloud Providers - FAIL_NON_BLOCKING - (@neil)
|
||||||
|
|
||||||
|
|
||||||
|
## Post-Installation Requirements
|
||||||
|
- System Services - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Keyboard Layout - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- SELinux Errors (Server) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- SELinux and Crash Notifications (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Default Application Functionality (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Default Panel Functionality (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Dual Monitor Setup (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Artwork and Assets (Server and Desktop) - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
|
- Packages and Module Installation - PASS - (@lumarel, semi-automatic, openQA)
|
||||||
67
release_criteria/r9/9.0_qa_testing_summary.md
Normal file
67
release_criteria/r9/9.0_qa_testing_summary.md
Normal file
@ -0,0 +1,67 @@
|
|||||||
|
---
|
||||||
|
title: Rocky Linux 9.0 QA and Testing Summary
|
||||||
|
author: Trevor Cooper
|
||||||
|
revision_date: 2022-05-18
|
||||||
|
rc:
|
||||||
|
prod: Rocky Linux
|
||||||
|
ver: 9
|
||||||
|
level: Final
|
||||||
|
---
|
||||||
|
|
||||||
|
# {{ rc.prod }} {{ rc.ver }} QA and Testing Summary
|
||||||
|
Last updated: <to_fill_in_on_etherpad_when_saving_a_version>
|
||||||
|
|
||||||
|
## Scope
|
||||||
|
This document will record a summary of all QA and Testing results for {{ rc.prod }} {{ rc.9 }} release. It is only a record of success and/or failure. Solution discussion should take place elsewhere.
|
||||||
|
|
||||||
|
## Reference
|
||||||
|
- Please check RHEL 9 Release Notes **BEFORE** marking issue here as **FAIL**.
|
||||||
|
|
||||||
|
## SOP
|
||||||
|
- Please include **PASS**, **FAIL**, **NOTABUG**, **INVESTIGATE** or **UPSTREAM** as appropriate in all entries.
|
||||||
|
- Please only provide brief summary. Details should go to Rocky Pastebin, links here is OK.
|
||||||
|
- Please leave your MM @handle on all items you have done or are working on so we can talk to you to get resolution.
|
||||||
|
- If the item you have reported is related to a QA:Testcase please mention it.
|
||||||
|
- If you think the item you have reported should be a QA:Testcase, even if it's not a current requirement, suggest a title and create an issue in the wiki repository so we can add it.
|
||||||
|
|
||||||
|
## INVESTIGATE
|
||||||
|
This is a list of items that are being INVESTIGATEd further before being assigned a PASS, FAIL, NOTABUG or UPSTREAM status.
|
||||||
|
PLEASE add your MM handle if you are working on this item to minimize duplication of work. More than one handle is allowed but please communicate.
|
||||||
|
|
||||||
|
- QA:Testcase Basic Graphics Mode - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Boot Methods Boot Iso - [INVESTIGATE] - @neil
|
||||||
|
- QA:Testcase Boot Methods DVD - [INVESTIGATE] - @neil
|
||||||
|
- QA:Testcase Debranding - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media Consistency Verification - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Media Repoclosure - [INVESTIGATE] - @tcooper
|
||||||
|
- QA:Testcase Storage Volume Resize - [INVESTIGATE] - @raktajino
|
||||||
|
- QA:Testcase Update Image - [INVESTIGATE] - @raktajino
|
||||||
|
- QA:Testcase boot/install minimal x86_64 over DVD/Bluray - [INVESTIGATE] - @atomicturtle
|
||||||
|
- QA:Testcase_Mediacheck - [INVESTIGATE] - @tcooper
|
||||||
|
|
||||||
|
## UPSTREAM
|
||||||
|
This is a list of items that have been verified to be replicated UPSTREAM in RHEL {{ rc.9 }} and/or are described clearly in the RHEL 9 Release Notes.
|
||||||
|
|
||||||
|
- QA:Testcase_Some_Testcase - [UPSTREAM] - @your_mm_handle - <brief_description>
|
||||||
|
|
||||||
|
## FAIL
|
||||||
|
This is a list of items that have been verified to FAIL the QA:Testcase. In addition to recording who did the test please indicate if the item is BLOCKING release or not.
|
||||||
|
|
||||||
|
- QA:Testcase_Some_Testcase - [FAIL] - @your_mm_handle - <brief_description>
|
||||||
|
|
||||||
|
## NOTABUG
|
||||||
|
This is a list of items that have been verified as less than optimal but are expected and NOTABUG.
|
||||||
|
|
||||||
|
- QA:Testcase_Some_Testcase - [NOTABUG] - @your_mm_handle - <brief_description>
|
||||||
|
|
||||||
|
## PASS
|
||||||
|
This is a list of item that have been verified as PASSing the QA:Testcase named (or proposed).
|
||||||
|
|
||||||
|
- QA:Testcase_Some_Testcase - [PASS] - @your_mm_handle - <brief_description>
|
||||||
|
|
||||||
|
## OTHER NOTABLE ITEMS
|
||||||
|
|
||||||
Loading…
Reference in New Issue
Block a user