autoqa-devel May 2010

autoqa-devel@lists.fedorahosted.org

8 participants
66 discussions

[PATCH] Autotest job-tag to AutoQA propagation
by Josef Skladanka 21 May '10

21 May '10

Hello, attached patches add the job-tag propagation functionality and change current tests and test templates so they take advantage of it. Joza

2 1

Auto install possible tests
by Li Ming 20 May '10

20 May '10

Hi, So far, we have almost solved all technical problems for auto install test. And a workable test driver has been put to git. What we are doing now is to list all possible tests which can meet each deliverable. As discussed with James, we should created these test drivers to map to test deliverables which we get from release engineering: * URL install source available *url_install.py * DVD image(s) available *iso_sanity.py *dvd_install.py * CD image(s) available *iso_sanity.py *cd_install.py For each test driver, we are trying to list all possible tests, I listed some in wiki, you can see at here: https://fedoraproject.org/wiki/Is_anaconda_broken_proposal#Roadmap On "step 3", I listed some possible tests,but I think I must have missed some, do you have some to supplement? For Possible dvd_install.py tests, I try to list all install tests, but for url_install.py and cd_install.py tests ,I only listed some default install,because cd_install.py tests are mainly test boot and swapping disc, url_install.py tests are mainly test remote boot and install. I am not sure whether list all possible tests for url_install.py and cd_install.py, what's your suggestion? Thanks Liam

3 13

[AutoQA] #106: create disk images for tests requiring pre-existing disk data
by fedora-badges 19 May '10

19 May '10

#106: create disk images for tests requiring pre-existing disk data --------------------+------------------------------------------------------- Reporter: wwoods | Owner: Type: task | Status: new Priority: major | Milestone: Automate installation test plan Component: tests | Version: 1.0 Keywords: | --------------------+------------------------------------------------------- Some installation tests require existing disks with some data - either an old version of Fedora to upgrade, or certain disk partitions to be reused/replaced. For example: * https://fedoraproject.org/wiki/QA:Testcase_Anaconda_Upgrade_New_Bootloader * https://fedoraproject.org/wiki/QA:Testcase_Preupgrade * https://fedoraproject.org/wiki/QA/TestCases/PartitioningPreExistingLvm2Lvm2 etc. We should either have a library of methods for creating these disks, or keep stock disk images for this purpose. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/106> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 3

[PATCH] initscripts: add support for emailing opted-in package maintainers
by Kamil Paral 19 May '10

19 May '10

--- tests/initscripts/initscripts.py | 9 ++++++++- 1 files changed, 8 insertions(+), 1 deletions(-) diff --git a/tests/initscripts/initscripts.py b/tests/initscripts/initscripts.py index 634a04d..630c944 100644 --- a/tests/initscripts/initscripts.py +++ b/tests/initscripts/initscripts.py @@ -27,6 +27,7 @@ import koji from autotest_lib.client.bin import test, utils from autotest_lib.client.bin.test_config import config_loader from autotest_lib.client.common_lib import error +from autoqa.repoinfo import repoinfo class initscripts(test.test): version = 1 # increment if setup() changes @@ -151,11 +152,17 @@ class initscripts(test.test): mail_from = self.config.get('test', 'mail_from') mail_server = self.config.get('test', 'smtpserver') if (mail_to and mail_from and mail_server): + mail_to = mail_to.split(',') + collection_name = repoinfo.getrepo_by_tag(kojitag)['collection_name'] + if collection_name and autoqa.util.check_opt_in(name, collection_name): + #FIXME - hardcoded partial email address here - obviously sub-par + mail_to.append('%s-owner(a)fedoraproject.org' % name) + msg = "Following tests returned zero exit code: %s\n" % repr(tests_exit_status_zero) msg += "Following tests returned NON-zero exit code: %s\n" % repr(tests_exit_status_nonzero) msg += "%s\n" % ("#" * 79,) - print "Sending email with results to '%s' ..." % mail_to + print 'Sending email with results to %s ...' % ', '.join(mail_to) utils.send_email(mail_to = mail_to, mail_from = mail_from, mail_server = mail_server, -- 1.6.6.1

2 4

2010-05-18 - Beakerlib and AutoQA meeting recap
by James Laska 18 May '10

18 May '10

============================== #fedora-qa: Beakerlib + AutoQA ============================== Meeting started by jlaska at 14:05:03 UTC. The full logs are available at http://meetbot.fedoraproject.org/fedora-qa/2010-05-18/beakerlib-and-autoqa.… . Meeting summary --------------- * Gathering (jlaska, 14:05:34) * HELP: (kparal, 14:08:12) * Check-in on package review status (jlaska, 14:09:01) * beakerlib was approved for fedora (afri, 14:09:59) * LINK: https://bugzilla.redhat.com/show_bug.cgi?id=561470 (jlaska, 14:10:28) * Initscript tests (jlaska, 14:16:43) * jskladan working several initscript issues with original maintainers (jlaska, 14:21:31) * expecting a new round of initscript tests landing in git soon (jlaska, 14:21:48) * probably add initscripts tickets to Package Update Tests milestone (kparal, 14:24:57) * ACTION: jlaska will add jskladan's initscript changes to Package Update Tests (https://fedorahosted.org/autoqa/milestone/Package%20update%20tests) (jlaska, 14:25:04) * Package Sanity Tests (jlaska, 14:26:40) * Next hurdles - #1 we must test packages on machine with correct Fedora release installed or use virt guests (jlaska, 14:34:20) * Next hurdles - #2 the famous updates-candidate testing problem (jlaska, 14:34:26) * open discussion - beakerlib EPEL? (jlaska, 14:37:37) * discussed how to update existing tests to use new paths (e.g. /usr/share/... instead of /usr/lib) (jlaska, 14:44:16) * discussed future maintenance of beakerlib (how best to manage maintaining custom plug-ins and Fedora package) (jlaska, 14:45:14) * open discussion - <your topic here> (jlaska, 14:48:18) * Next meeting (jlaska, 14:51:01) * 2010-05-25 - Check-in over email (perhaps autoqa-devel@ list) (jlaska, 14:54:12) * 2010-06-01 - Celebrate the first of June with another in-person meeting (jlaska, 14:54:39) Meeting ended at 14:54:51 UTC. Action Items ------------ * jlaska will add jskladan's initscript changes to Package Update Tests (https://fedorahosted.org/autoqa/milestone/Package%20update%20tests) Action Items, by person ----------------------- * jlaska * jlaska will add jskladan's initscript changes to Package Update Tests (https://fedorahosted.org/autoqa/milestone/Package%20update%20tests) * **UNASSIGNED** * (none) People Present (lines said) --------------------------- * jlaska (85) * kparal (56) * afri (16) * psss (6) * zodbot (3) * buggbot (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot

1 0

optin instructions
by Seth Vidal 17 May '10

17 May '10

I wrote up a brief text for opting in to the emails from autoqa. Here it is. you wanna get info on broken stuff (if anything) in your just-built-in-kojipackages? Info like: https://fedorahosted.org/pipermail/autoqa-results/2010-April/013903.html and https://fedorahosted.org/pipermail/autoqa-results/2010-April/013904.html Then all you have to do is: 1. ssh fedorapeople.org 2. cd /srv/people/site/packages/ 3. cd $first-letter-in-lower-case-of-the-name-of-your-package 4. mkdir $yourpackagename 5. cd $yourpackagename 6. mkdir $release (ex: F-13, devel, F-12, EL-5) 7. touch $release/autoqa-optin that's it! -sv

2 5

Another initscript test result -- initscripts: 1 PASSED, 0 FAILED for package samba-3.4.8-59.fc12]
by James Laska 17 May '10

17 May '10

Yay! It took more than a month, but we have another package update for which initscript tests are written. I thought I'd call this out on the list for a "ata-boy" and a chance to review the results. Results available below (or at https://fedorahosted.org/pipermail/autoqa-results/2010-May/020018.html) A few comments inline below. Thanks, James -------- Forwarded Message -------- From: autoqa(a)fedoraproject.org Reply-to: fedora-test-list(a)redhat.com To: autoqa-results(a)lists.fedorahosted.org Subject: initscripts: 1 PASSED, 0 FAILED for package samba-3.4.8-59.fc12 Date: Wed, 12 May 2010 19:59:05 -0400 Following tests returned zero exit code: [('samba', 0)] Following tests returned NON-zero exit code: [] ############################################################################### RUNNING: samba ============== posix on :: [20:05:54] :: [ WARNING ] :: POSIX mode detected and switched off :: [20:05:54] :: [ WARNING ] :: Please fix your test to have /bin/bash shebang ^^^ Is this the tests/initscript/tests/samba/runtest.sh that needs correction? ^^^ :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: samba-3.4.8-59.fc12.x86_64 :: [ PASS ] :: Checking for the presence of samba rpm smb 0:off 1:off 2:off 3:off 4:off 5:off 6:off :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: smbd is stopped :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-smb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: smb processes not running before startup Starting SMB services: [ OK ] :: [ PASS ] :: service smb start returns 0 5696 ? 00:00:00 smbd 5703 ? 00:00:00 smbd :: [ PASS ] :: smb processes running after start smbd (pid 5696) is running... :: [ PASS ] :: service smb status reported as running Starting SMB services: :: [ PASS ] :: service smb 2nd start returns 0 smbd (pid 5696) is running... :: [ PASS ] :: service smb status still reported as running Shutting down SMB services: [ OK ] :: [ PASS ] :: service smb stop returns 0 smbd is stopped :: [ PASS ] :: service smb status reported as stopped (ECODE 3) Shutting down SMB services: [FAILED] ^^^ Reported as FAILED, I gather this is the output for the next check -- "service smb 2nd stop returns 0"? ^^^ :: [ PASS ] :: service smb 2nd stop returns 0 smbd is stopped :: [ PASS ] :: service smb status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service smb Starting SMB services: [ OK ] :: [ PASS ] :: Running 'service smb start' :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-smb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [20:06:44] :: service smb PID: Shutting down SMB services: [ OK ] Starting SMB services: [ OK ] :: [ PASS ] :: service smb restart returns 0 :: [ PASS ] :: PID of service smb changed during restart smbd (pid 5910) is running... :: [ PASS ] :: service smb status reported as running Shutting down SMB services: [ OK ] Starting SMB services: [ OK ] :: [ PASS ] :: service smb condrestart returns 0 :: [ PASS ] :: PID of service smb changed during condrestart smbd (pid 5959) is running... :: [ PASS ] :: service smb status reported as running :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Shutting down SMB services: [ OK ] Starting SMB services: [ OK ] smbd (pid 6021) is running... Shutting down SMB services: [ OK ] nmb 0:off 1:off 2:off 3:off 4:off 5:off 6:off :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: nmbd is stopped :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-nmb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: nmb processes not running before startup Starting NMB services: [ OK ] :: [ PASS ] :: service nmb start returns 0 6107 ? 00:00:00 nmbd :: [ PASS ] :: nmb processes running after start nmbd (pid 6107) is running... :: [ PASS ] :: service nmb status reported as running Starting NMB services: :: [ PASS ] :: service nmb 2nd start returns 0 nmbd (pid 6107) is running... :: [ PASS ] :: service nmb status still reported as running Shutting down NMB services: [ OK ] :: [ PASS ] :: service nmb stop returns 0 nmbd is stopped :: [ PASS ] :: service nmb status reported as stopped (ECODE 3) Shutting down NMB services: [FAILED] :: [ PASS ] :: service nmb 2nd stop returns 0 nmbd is stopped :: [ PASS ] :: service nmb status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service nmb Starting NMB services: [ OK ] :: [ PASS ] :: Running 'service nmb start' :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-nmb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [20:07:43] :: service nmb PID: Shutting down NMB services: [ OK ] Starting NMB services: [ OK ] :: [ PASS ] :: service nmb restart returns 0 :: [ PASS ] :: PID of service nmb changed during restart nmbd (pid 6314) is running... :: [ PASS ] :: service nmb status reported as running Shutting down NMB services: [ OK ] Starting NMB services: [ OK ] :: [ PASS ] :: service nmb condrestart returns 0 :: [ PASS ] :: PID of service nmb changed during condrestart nmbd (pid 6360) is running... :: [ PASS ] :: service nmb status reported as running :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Shutting down NMB services: [ OK ] Starting NMB services: [ OK ] nmbd (pid 6419) is running... Shutting down NMB services: [ OK ] winbind 0:off 1:off 2:off 3:off 4:off 5:off 6:off :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-winbind :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: winbindd is stopped :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-winbind-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: winbind processes not running before startup Starting Winbind services: [ OK ] :: [ PASS ] :: service winbind start returns 0 6504 ? 00:00:00 winbindd 6507 ? 00:00:00 winbindd :: [ PASS ] :: winbind processes running after start winbindd (pid 6504) is running... :: [ PASS ] :: service winbind status reported as running Starting Winbind services: :: [ PASS ] :: service winbind 2nd start returns 0 winbindd (pid 6504) is running... :: [ PASS ] :: service winbind status still reported as running Shutting down Winbind services: [ OK ] :: [ PASS ] :: service winbind stop returns 0 winbindd is stopped :: [ PASS ] :: service winbind status reported as stopped (ECODE 3) Shutting down Winbind services: [FAILED] :: [ PASS ] :: service winbind 2nd stop returns 0 winbindd is stopped :: [ PASS ] :: service winbind status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service winbind Starting Winbind services: [ OK ] :: [ PASS ] :: Running 'service winbind start' :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-winbind-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [20:08:42] :: service winbind PID: Shutting down Winbind services: [ OK ] Starting Winbind services: [ OK ] :: [ PASS ] :: service winbind restart returns 0 :: [ PASS ] :: PID of service winbind changed during restart winbindd (pid 6714) is running... :: [ PASS ] :: service winbind status reported as running Shutting down Winbind services: [ OK ] Starting Winbind services: [ OK ] :: [ PASS ] :: service winbind condrestart returns 0 :: [ PASS ] :: PID of service winbind changed during condrestart winbindd (pid 6761) is running... :: [ PASS ] :: service winbind status reported as running :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-winbind :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Shutting down Winbind services: [ OK ] Starting Winbind services: [ OK ] winbindd (pid 6821) is running... Shutting down Winbind services: [ OK ] :: [20:08:56] :: JOURNAL XML: /tmp/beakerlib-TDf2wkY/journal.xml :: [20:08:56] :: JOURNAL TXT: /tmp/beakerlib-TDf2wkY/journal.txt :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: TEST PROTOCOL :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test run ID : TDf2wkY :: [ LOG ] :: Package : samba :: [ LOG ] :: Installed: : samba-3.4.8-59.fc12.x86_64 :: [ LOG ] :: Test started : 2010-05-12 20:05:54 :: [ LOG ] :: Test finished : 2010-05-12 20:08:56 :: [ LOG ] :: Test name : :: [ LOG ] :: Distro: : Fedora release 12 (Constantine) :: [ LOG ] :: Hostname : localhost.localdomain :: [ LOG ] :: Architecture : x86_64 :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test description :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: Cannot find the PURPOSE file of this test. Could be a missing, or rlInitializeJournal wasn't called from appropriate location :: [ WARNING ] :: POSIX mode detected and switched off :: [ WARNING ] :: Please fix your test to have /bin/bash shebang :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: Checking for the presence of samba rpm :: [ LOG ] :: Duration: 1s :: [ LOG ] :: Assertions: 1 good, 0 bad :: [ PASS ] :: RESULT: Setup :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 2s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: Setup-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-smb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: smb processes not running before startup :: [ PASS ] :: service smb start returns 0 :: [ PASS ] :: smb processes running after start :: [ PASS ] :: service smb status reported as running :: [ PASS ] :: service smb 2nd start returns 0 :: [ PASS ] :: service smb status still reported as running :: [ PASS ] :: service smb stop returns 0 :: [ PASS ] :: service smb status reported as stopped (ECODE 3) :: [ PASS ] :: service smb 2nd stop returns 0 :: [ PASS ] :: service smb status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service smb :: [ PASS ] :: Running 'service smb start' :: [ LOG ] :: Duration: 47s :: [ LOG ] :: Assertions: 12 good, 0 bad :: [ PASS ] :: RESULT: Test-smb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-smb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: service smb PID: :: [ PASS ] :: service smb restart returns 0 :: [ PASS ] :: PID of service smb changed during restart :: [ PASS ] :: service smb status reported as running :: [ PASS ] :: service smb condrestart returns 0 :: [ PASS ] :: PID of service smb changed during condrestart :: [ PASS ] :: service smb status reported as running :: [ LOG ] :: Duration: 14s :: [ LOG ] :: Assertions: 6 good, 0 bad :: [ PASS ] :: RESULT: Test-smb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 1s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: CleanUp-smb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 2s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: Setup-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-nmb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: nmb processes not running before startup :: [ PASS ] :: service nmb start returns 0 :: [ PASS ] :: nmb processes running after start :: [ PASS ] :: service nmb status reported as running :: [ PASS ] :: service nmb 2nd start returns 0 :: [ PASS ] :: service nmb status still reported as running :: [ PASS ] :: service nmb stop returns 0 :: [ PASS ] :: service nmb status reported as stopped (ECODE 3) :: [ PASS ] :: service nmb 2nd stop returns 0 :: [ PASS ] :: service nmb status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service nmb :: [ PASS ] :: Running 'service nmb start' :: [ LOG ] :: Duration: 42s :: [ LOG ] :: Assertions: 12 good, 0 bad :: [ PASS ] :: RESULT: Test-nmb-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-nmb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: service nmb PID: :: [ PASS ] :: service nmb restart returns 0 :: [ PASS ] :: PID of service nmb changed during restart :: [ PASS ] :: service nmb status reported as running :: [ PASS ] :: service nmb condrestart returns 0 :: [ PASS ] :: PID of service nmb changed during condrestart :: [ PASS ] :: service nmb status reported as running :: [ LOG ] :: Duration: 13s :: [ LOG ] :: Assertions: 6 good, 0 bad :: [ PASS ] :: RESULT: Test-nmb-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 0s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: CleanUp-nmb :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Setup-winbind :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 2s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: Setup-winbind :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-winbind-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ PASS ] :: winbind processes not running before startup :: [ PASS ] :: service winbind start returns 0 :: [ PASS ] :: winbind processes running after start :: [ PASS ] :: service winbind status reported as running :: [ PASS ] :: service winbind 2nd start returns 0 :: [ PASS ] :: service winbind status still reported as running :: [ PASS ] :: service winbind stop returns 0 :: [ PASS ] :: service winbind status reported as stopped (ECODE 3) :: [ PASS ] :: service winbind 2nd stop returns 0 :: [ PASS ] :: service winbind status still reported as stopped (ECODE 3) :: [ PASS ] :: no processes running for service winbind :: [ PASS ] :: Running 'service winbind start' :: [ LOG ] :: Duration: 43s :: [ LOG ] :: Assertions: 12 good, 0 bad :: [ PASS ] :: RESULT: Test-winbind-start-stop :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Test-winbind-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: service winbind PID: :: [ PASS ] :: service winbind restart returns 0 :: [ PASS ] :: PID of service winbind changed during restart :: [ PASS ] :: service winbind status reported as running :: [ PASS ] :: service winbind condrestart returns 0 :: [ PASS ] :: PID of service winbind changed during condrestart :: [ PASS ] :: service winbind status reported as running :: [ LOG ] :: Duration: 13s :: [ LOG ] :: Assertions: 6 good, 0 bad :: [ PASS ] :: RESULT: Test-winbind-restart-condrestart :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: CleanUp-winbind :::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: :: [ LOG ] :: Duration: 1s :: [ LOG ] :: Assertions: 0 good, 0 bad :: [ PASS ] :: RESULT: CleanUp-winbind :: [ LOG ] :: JOURNAL XML: /tmp/beakerlib-TDf2wkY/journal.xml :: [ LOG ] :: JOURNAL TXT: /tmp/beakerlib-TDf2wkY/journal.txt _______________________________________________ autoqa-results mailing list autoqa-results(a)lists.fedorahosted.org https://fedorahosted.org/mailman/listinfo/autoqa-results

2 2

[AutoQA] #156: pst: Test packages on a machine with the right Fedora release installed
by fedora-badges 17 May '10

17 May '10

#156: pst: Test packages on a machine with the right Fedora release installed --------------------+------------------------------------------------------- Reporter: kparal | Owner: Type: task | Status: new Priority: major | Milestone: Package Sanity Tests Component: tests | Version: 1.0 Keywords: | --------------------+------------------------------------------------------- Not only the architecture of the guest machine must comply to the architecture of the tested package (which is easily ensured by autotest), but also the Fedora release of the guest machine must match the release of the package (packages built for Fedora 12 must be tested on Fedora 12). This is currently AFAIK not ensured by autotest. We will need to find a way how to ensure the right packages are tested on guest with the right Fedora release. Probably we can either tweak autotest to select appropriate guest for us, or we can use some kind of virtual machines inside arbitrary host. This will be probably related also to the solution of ticket #128. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/156> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 2

[AutoQA] #155: pst: Allow testing of completely new packages
by fedora-badges 17 May '10

17 May '10

#155: pst: Allow testing of completely new packages -------------------------+-------------------------------------------------- Reporter: kparal | Owner: Type: enhancement | Status: new Priority: major | Milestone: Package Sanity Tests Component: tests | Version: 1.0 Keywords: | -------------------------+-------------------------------------------------- Currently both --old and --new must be specified. But when we need to test a completely new package, there is no previous build available. Still, we would like to have install/verify/remove phases tested. Please allow this behavior. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/155> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 1

[AutoQA] #127: pst: Create AutoQA wrapper for Package Sanity Testing script
by fedora-badges 17 May '10

17 May '10

#127: pst: Create AutoQA wrapper for Package Sanity Testing script --------------------+------------------------------------------------------- Reporter: kparal | Owner: kparal Type: task | Status: new Priority: major | Milestone: Package Sanity Tests Component: tests | Version: 1.0 Keywords: pst | --------------------+------------------------------------------------------- This wrapper should ensure that necessary information is provided to the sanity testing script (like package names, repo name, package files, etc). This test should be run probably every time a package is submitted into updates-testing or into updates (as part of the acceptance testing). This test will require post-bodhi-update hook, which is ticket #87. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/127> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

autoqa-devel May 2010