[AutoQA] #414: rats_install: run twice, once for updates, once for updates+updates-testing
#414: rats_install: run twice, once for updates, once for updates+updates-testing --------------------------+------------------------------- Reporter: kparal | Owner: Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Keywords: Blocked By: | Blocking: --------------------------+------------------------------- We decided it would be beneficial to run rats_install twice. Once for stable updates only, once for main+updates, once for main+updates+updates- testing. Currently we're running just the second option. The discussion is here:
https://fedoraproject.org/wiki/QA/Meetings/20120319#t15:55:42
Change rats_install to execute twice and report both variants. The easiest way is probably to modify 'control' file to execute the job twice and modify some input argument to distinguish the two cases. Also we need to change the summary accordingly so that we can easily distinguish that in our ResultsDB view.
Marking "Nice to have soon" if we can do it before F17 Final, otherwise it'll probably go into "Future tasks".
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by kparal):
Just a remark, currently rats_install fails due to https://bugzilla.redhat.com/show_bug.cgi?id=806931 , don't be surprised.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+-------------------------------- Changes (by hongqing):
* owner: => hongqing
Comment:
I would like to accept it. Not sure if it can be solved before Final, the manual test cost a lot of my time and I have to investigate in the control file. Anyway, I will give it high priority.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by hongqing):
Hi, All,
I have investigated in it, the updates-testing repo is enabled with rawhide by default. but I have not found how to enable the updates-testing repo during the installation with branched Fedora. Any suggestions?
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by kparal):
Hello, it can be controlled in the kickstart file. Currently we're using the default, which is main+updates+updates-testing (that might change after Beta, I'm not sure).
You can control which repositories are enabled by a snippet like this: {{{ # Use online Fedora repos repo --name=fedora repo --name=updates repo --name=updates-testing }}}
E.g. if you add this to the kickstart: {{{ # Use online Fedora repos repo --name=fedora repo --name=updates }}} then updates-testing should be disabled (verification needed).
That means we will need two different kickstart files or modify the current one on the fly before the second test execution.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by hongqing):
I have updated the script in git branch 'rats_install' with three different repo: fedora, fedora+updates, fedora+updates+updates- testing.[[BR]] A loop is used in control file to run different test. but all the tests can only be scheduled as one test, they cannot have different ids if we keep the same name 'rats_install', so the debug logs are store in the same file. But the raw logs of anaconda are stored in different results directories.[[BR]] Please review the codes to see if there is anything that need to be updated.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by kparal):
I have reviewed the code and fixed a lot of problems, but currently installation fails on:
{{{ == anaconda disk probe test == 60 seconds elapsed - giving up. TEST RESULT: diskprobe: FAIL }}}
That is caused by the fact that in resultsdir anaconda/anaconda.log is no longer created, everything goes to anaconda/syslog. Hongqing, can you have a look at that?
My changes are committed to rats_install branch.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by hongqing):
Replying to [comment:6 kparal]:
I have reviewed the code and fixed a lot of problems, but currently
installation fails on:
{{{ == anaconda disk probe test == 60 seconds elapsed - giving up. TEST RESULT: diskprobe: FAIL }}}
That is caused by the fact that in resultsdir anaconda/anaconda.log is
no longer created, everything goes to anaconda/syslog. Hongqing, can you have a look at that?
My changes are committed to rats_install branch.
It seems a F17 anaconda bug, it works well with F16. I will further investigate in it.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by hongqing):
It also does not work with manual installation, I have filed a bug at [[https://bugzilla.redhat.com/show_bug.cgi?id=820106]]
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: hongqing Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+--------------------------------
Comment (by kparal):
I have pushed the rats_install fixes to master in commit 3ec7707. I have also disabled rats_install execution in commit 15e3422 until we solve the problem mentioned in comment 8.
Hongqing, can you please work around that problem mentioned in comment 8? It doesn't seem that anaconda guys are likely to fix that soon. We don't need to have it solved *right now*, but once F18 composes start to come out, I'd like to have rats_install working again.
#414: rats_install: run twice, once for updates, once for updates+updates-testing -------------------------+-------------------------------- Reporter: kparal | Owner: kparal Type: enhancement | Status: new Priority: minor | Milestone: Nice to have soon Component: tests | Resolution: Keywords: | Blocked By: Blocking: | -------------------------+-------------------------------- Changes (by kparal):
* owner: hongqing => kparal
autoqa-devel@lists.fedorahosted.org
-
fedora-badges