Bump to autoqa-0.3-4
by James Laska
Greetings,
A good batch of changes since our last package (0.3-3). I'd like to bump the
release and deploy a new autoqa package so we can get Fedora 13 and Rawhide
tests flowing again.
Thanks,
James
14 years, 2 months
2010-02-26 - AutoQA resultdb design discussion (part#2)
by James Laska
# AutoQA ResultsDB Discussion
# Date: 2010-02-26
# Time: 15:00 UTC (10:00 EST, 16:00 CET)
# Participants - wwoods, jlaska, kparal, jskladan
= Review definition/goals =
https://fedorahosted.org/pipermail/autoqa-devel/2010-February/000201.html
Goals
* One central database to store test results (audience QA)
* Multiple front-ends to present stored results (audience QA/developers)
= Recap of research =
* Overview - https://fedoraproject.org/wiki/AutoQA_resultsdb_approaches
Spikesource schema -
http://dev.spikesource.com/wiki/index.php/Trpi-schema_view
* No concept of WAIVE results
RHTS/Beaker - http://beaker.fedorahosted.org/
* stores log files directly
* presents most important data on main results page (e.g. stdout)
* Hiearchy - Job contains RecipeSet(s), which contains Recipe(s), which
contains test(s), which contain phase(s)
Beakerlib
* Allows specification of test phases
* Provides common test writing format in bash
* beakerlib xml journal
http://jskladan.fedorapeople.org/beakerlib_format.xml
** test which produced the output:
http://git.fedorahosted.org/git/?p=autoqa.git;a=blob;f=tests/beakerlib_in...
RATS
* Test results linked by a unique key (timestamp of tree being tested)
* install.py test also uses concept of "phases" -
http://git.fedorahosted.org/git/?p=autoqa.git;a=blob;f=tests/rats_install...
* Multiple tests (2), each with multiple phases - Viewed from single
location - http://jlaska.fedorapeople.org/rats.png
= Ideate =
* Define an output standard for each test type for easier inspection of
results (similar to beakerlib)
* TCMS - something we're gonna forget about for now (db scheme review in
'open topics')
= Terminology =
* test case - one unit with a single result (but may contain several
phases)
* test phase - parts of a test case, their results are not stored
separately in the results db, but define pass/fail result of the test
case itself (internally for the test)
* test plan - contains several test cases, provides meta data around
test cases (responsibility, workflow, high-level criteria etc...)
* mapping to the beakerlib_format.xml - depends on particular test, for
initscripts checking: <log> ~ test case, <phase> ~ test phase
= Open topics =
* How to handle policy (waive) in tools?
** https://fedoraproject.org/wiki/AutoQA_resultsdb_approaches#DB_schema
- rpmdiff solution
* Is defining a common test writing and output format the same as
providing a results front-end/workflow?
* Examine nitrate/testopia resultsdb format?
* Test case results vs autotest job results (unhandled exception, etc)
= Tasks =
* [wwoods] - Examine beakerlib output format if it is sufficient for our
purposes
* [jlaska] - Examine nitrate/testopia DB schema
* [kparal + jskladan] - Define personas and write use cases
Example:
https://fedoraproject.org/wiki/No_frozen_rawhide_announce_plan#Use_Cases
Wiki page: https://fedoraproject.org/wiki/AutoQA_resultsdb_use_cases
* [kparal + jskladan] - Propose some initial DB schema
= Next Meeting =
* 2010-03-05 - mailing list checkin (conference call if needed)
14 years, 2 months
Increase the default guest RAM size and add command-line tunable
by James Laska
Greetings,
>From bug#559290, it's looking more like 512M for an x86_64 install is not sufficient. While that discovery process is underway, I'd like to increase the default guest RAM size from 512 to 768. Additionally, I found that being able to change this value from the command-line was very helpful. The following patch add a command-line argument to install.py to support changing the RAM size of the guest.
Comments/concerns appreciated.
Thanks,
James
14 years, 2 months
Re: [AutoQA] #97: rpmguard: Use yum/rpmUtils instead of rpmlib
by fedora-badges
#97: rpmguard: Use yum/rpmUtils instead of rpmlib
--------------------------+-------------------------------------------------
Reporter: kparal | Owner:
Type: enhancement | Status: new
Priority: major | Milestone:
Component: tests | Version: 1.0
Resolution: | Keywords: rpmguard
--------------------------+-------------------------------------------------
Comment (by kparal):
Just for the record, rpmUtils are now used for comparing PRCO versions
(cmpPRCOVer() method) instead of home-baked implementation.
But there are still many usages of rpm library to review.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/97#comment:1>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
14 years, 2 months
Re: [AutoQA] #87: new post-bodhi-update hook
by fedora-badges
#87: new post-bodhi-update hook
----------------------+-----------------------------------------------------
Reporter: wwoods | Owner: wwoods
Type: task | Status: assigned
Priority: major | Milestone: autoqa depcheck
Component: harness | Version: 1.0
Resolution: | Keywords:
----------------------+-----------------------------------------------------
Changes (by wwoods):
* owner: => wwoods
* status: new => assigned
Comment:
This is in-progress; some code has been added to bodhi to help make this
work (thanks lmacken)
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/87#comment:5>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
14 years, 2 months
