testing
/
wiki
generated from sig_core/wiki-template
10
0
Fork 3
Code Issues 1 Pull Requests Actions Packages Projects Releases Wiki Activity

add 9.0 QA:Testing Summary and Go/NoGo Status skeleton docs

This commit is contained in:
Trevor Cooper 2022-05-18 23:27:43 -07:00
parent ab736ee034
commit f82431b09c
3 changed files with 162 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
release_criteria/r9/.pages Normal file
View File

@ -0,0 +1,6 @@
---
nav:
- ... | index.md
- Rocky Linux 9 Release Criteria: 9_release_criteria.md
- Rocky Linux 9.0 QA and Testing Summary: 9.0_qa_testing_summary.md
- Rocky Linux 9.0 GO / NO-GO Status: 9.0_qa_testing_go_no_go.md

89
release_criteria/r9/9.0_qa_testing_go_no_go.md Normal file
View File

@ -0,0 +1,89 @@
---
title: Rocky Linux 9.0 QA and Testing GO / NO GO Status
author: Trevor Cooper
revision_date: 2022-05-18
rc:
prod: Rocky Linux
ver: 9
---
# {{ rc.prod }} {{ rc.ver }} QA and Testing : GO / NO GO Status
This document summarizes the GO / NO GO Status for Release of Rocky Linux 8.6 from perspective of the QA / Testing efforts. It is based largely on the Release Criteria (https://wiki.rockylinux.org/team/testing/release_criteria/) as was started as an import of that document. If there are differences between the official Release Critieria document and this document the official Release Criteria document will override and this document shall be updated.
As a reminder, the objective of a release (major or minor) is to provide a solid Enterprise Linux release that is suitable to:
- Meet the needs of end users
- Meet the needs of enterprises big or small
## SUMMARY
| Category | Proportion | Remaining Items |
| ----------------- | ----------------- | --------------- |
| TO_CONFIRM | 0 / 29 (0%) | |
| PASS | 0 / 29 (0%) | |
| FAIL_NON_BLOCKING | 0 / 29 (0%) | |
| FAIL_BLOCKING | 0 / 29 (0%) | |
## SOP
In this document each requirement is described and status is specified in the title.
Current choices are...
### TO_CONFIRM
- this means the item may be INCOMPLETE, PASS, FAIL_NON_BLOCKING or FAIL_BLOCKING and must be verified
### PASS
- this means that the release criteria has been met and is not a blocker
### FAIL_NON_BLOCKING
- this means the release criter has not been met but is non-blocking
### FAIL_BLOCKING
- this means the release criteria has not been met and is blocking
In this document criteria status should include who completed the item and generally how it was complete.
Examples...
- PASS - (@tcooper, virt only, manual)
- PASS - (@lumarel, @raktajino, @tcooper, semi-automatic , openQA)
## Initialization Requirements
- Release-blocking images must boot - PASS - (@neil, @atomicturtle)
- Optical Media Requirements - PASS - (@atomicturtle)
- Basic Graphics Mode behaviors - PASS - (@tcooper, virt only, manual)
- No Broken Packages - PASS - (@tcooper, scripted, manual)
- Repositories Must Match Upstream - TO_CONFIRM - (@tcooper, manual)
- Debranding - PASS - (@tcooper, scripted, manual)
- Media Consistency Verification - PASS - (@tcooper, scripted, manual)
- Packages and Installer Sources - PASS - (@lumarel, semi-automatic, openQA test)
- NAS (Network Attached Storage) - TO_CONFIRM - (@lumarel?, semi-automatic, openQA dual-host test)
- Installation Interfaces - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA, @atomicturtle, manual?, SCAP)
- Minimal Installation - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic , openQA)
- Kickstart Installation - PASS - (@label, @tcooper, manual, createhdds)
- Disk Layouts - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
- Firmware RAID - TO_CONFIRM - (@tbd, missing hardware support?)
- Bootloader Disk Selection - PASS - (@raktajino, manual)
- Storage Volume Resize - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
- Update Image - PASS - (@raktajino,@tcooper, semi-automatic, openQA)
- Installer Help - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
- Installer Translations - PASS - (@lumarel, @raktajino, @tcooper, semi-automatic, openQA)
## Cloud Image Requirements
- Images Published to Cloud Providers - FAIL_NON_BLOCKING - (@neil)
## Post-Installation Requirements
- System Services - PASS - (@lumarel, semi-automatic, openQA)
- Keyboard Layout - PASS - (@lumarel, semi-automatic, openQA)
- SELinux Errors (Server) - PASS - (@lumarel, semi-automatic, openQA)
- SELinux and Crash Notifications (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
- Default Application Functionality (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
- Default Panel Functionality (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
- Dual Monitor Setup (Desktop Only) - PASS - (@lumarel, semi-automatic, openQA)
- Artwork and Assets (Server and Desktop) - PASS - (@lumarel, semi-automatic, openQA)
- Packages and Module Installation - PASS - (@lumarel, semi-automatic, openQA)

67
release_criteria/r9/9.0_qa_testing_summary.md Normal file
View File

@ -0,0 +1,67 @@
---
title: Rocky Linux 9.0 QA and Testing Summary
author: Trevor Cooper
revision_date: 2022-05-18
rc:
prod: Rocky Linux
ver: 9
level: Final
---
# {{ rc.prod }} {{ rc.ver }} QA and Testing Summary
Last updated: <to_fill_in_on_etherpad_when_saving_a_version>
## Scope
This document will record a summary of all QA and Testing results for {{ rc.prod }} {{ rc.9 }} release. It is only a record of success and/or failure. Solution discussion should take place elsewhere.
## Reference
- Please check RHEL 9 Release Notes **BEFORE** marking issue here as **FAIL**.
## SOP
- Please include **PASS**, **FAIL**, **NOTABUG**, **INVESTIGATE** or **UPSTREAM** as appropriate in all entries.
- Please only provide brief summary. Details should go to Rocky Pastebin, links here is OK.
- Please leave your MM @handle on all items you have done or are working on so we can talk to you to get resolution.
- If the item you have reported is related to a QA:Testcase please mention it.
- If you think the item you have reported should be a QA:Testcase, even if it's not a current requirement, suggest a title and create an issue in the wiki repository so we can add it.
## INVESTIGATE
This is a list of items that are being INVESTIGATEd further before being assigned a PASS, FAIL, NOTABUG or UPSTREAM status.
PLEASE add your MM handle if you are working on this item to minimize duplication of work. More than one handle is allowed but please communicate.
- QA:Testcase Basic Graphics Mode - [INVESTIGATE] - @tcooper
- QA:Testcase Boot Methods Boot Iso - [INVESTIGATE] - @neil
- QA:Testcase Boot Methods DVD - [INVESTIGATE] - @neil
- QA:Testcase Debranding - [INVESTIGATE] - @tcooper
- QA:Testcase Media Consistency Verification - [INVESTIGATE] - @tcooper
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
- QA:Testcase Media File Conflicts - [INVESTIGATE] - @tcooper
- QA:Testcase Media Repoclosure - [INVESTIGATE] - @tcooper
- QA:Testcase Storage Volume Resize - [INVESTIGATE] - @raktajino
- QA:Testcase Update Image - [INVESTIGATE] - @raktajino
- QA:Testcase boot/install minimal x86_64 over DVD/Bluray - [INVESTIGATE] - @atomicturtle
- QA:Testcase_Mediacheck - [INVESTIGATE] - @tcooper
## UPSTREAM
This is a list of items that have been verified to be replicated UPSTREAM in RHEL {{ rc.9 }} and/or are described clearly in the RHEL 9 Release Notes.
- QA:Testcase_Some_Testcase - [UPSTREAM] - @your_mm_handle - <brief_description>
## FAIL
This is a list of items that have been verified to FAIL the QA:Testcase. In addition to recording who did the test please indicate if the item is BLOCKING release or not.
- QA:Testcase_Some_Testcase - [FAIL] - @your_mm_handle - <brief_description>
## NOTABUG
This is a list of items that have been verified as less than optimal but are expected and NOTABUG.
- QA:Testcase_Some_Testcase - [NOTABUG] - @your_mm_handle - <brief_description>
## PASS
This is a list of item that have been verified as PASSing the QA:Testcase named (or proposed).
- QA:Testcase_Some_Testcase - [PASS] - @your_mm_handle - <brief_description>
## OTHER NOTABLE ITEMS