autoqa-devel January 2010

autoqa-devel@lists.fedorahosted.org

5 participants
50 discussions

Re: [AutoQA] #110: rpmlint, rpmguard: Send results to mailing list
by Kamil Paral 14 Jan '10

14 Jan '10

----- "James Laska" <jlaska(a)redhat.com> wrote: > On Wed, 2010-01-13 at 12:44 -0500, James Laska wrote: > > On Tue, 2010-01-12 at 08:48 -0500, James Laska wrote: > > > > James, will you install the updated code to our test server so > > > > we can see it in action, > > > > > > Certainly, I can build and install the autoqa package from git > head to > > > the autotest client systems. There are a few other patches out > for > > > review on the list ... do we want those included? > > > > autoqa-0.3-3 tagged [1] and been deployed. > > It doesn't appear that rpmguard tests are being scheduled alongside > rpmlint tests. I think one issue I saw was that the version of > autotest > we're using might not have the utf8 fix that you sent upstream. No, there was no utf-8 fix sent upstream, it was just an internal change (line #63 in autoqa file). I have sent another patch upstream, but it was not related to this. I will try to have a look what could be wrong. It's interesting that there is (only) one result in the list.

2 1

[AutoQA] #108: rpmguard test for unexpanded macros in srpms
by fedora-badges 14 Jan '10

14 Jan '10

#108: rpmguard test for unexpanded macros in srpms -------------------------+-------------------------------------------------- Reporter: ajax | Owner: Type: enhancement | Status: new Priority: major | Milestone: Component: tests | Version: 1.0 Keywords: | -------------------------+-------------------------------------------------- Koji builds the SRPM in a fairly empty environment. Not all rpm macro definitions may be available at that time. The built SRPM should not contain unexpanded macros in any text field like %description. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/108> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 4

Re: [AutoQA] #110: rpmlint, rpmguard: Send results to mailing list
by Kamil Paral 14 Jan '10

14 Jan '10

----- "James Laska" <jlaska(a)redhat.com> wrote: > 2) Now, this prepares the control file and calls 'atest' as noted > below ... > > # /usr/bin/atest job create -m *x86_64 > post-koji-build:rpmguard.x86_64 > -f /tmp/autoqa-control.sR24-A > > Error received from web server: > HTTP Error 500: Internal Server Error > > I've got some tips from the #autotest folks, will try to get more > information shortly. I don't understand what could be different in rpmguard control file from other tests' control files. Is it possible that it is really about the unicode characters (even when encoding is specified right)? It surely works when run locally, but maybe the server is not handling it so well. Could you please generate the autoqa-control.XXX file (by --dry-run for example) and modify my name not to contain non-ascii characters, and then submit it via atest command once again? Thanks.

1 0

[AutoQA] #110: rpmlint, rpmguard: Send results to mailing list
by fedora-badges 13 Jan '10

13 Jan '10

#110: rpmlint, rpmguard: Send results to mailing list ------------------------------+--------------------------------------------- Reporter: kparal | Owner: Type: task | Status: new Priority: major | Milestone: Package update tests Component: tests | Version: 1.0 Keywords: rpmguard,rpmlint | ------------------------------+--------------------------------------------- Rpmlint and rpmguard tests must be modified to send results to autoqa- results. A more detailed email soon to follow into the mailing list. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/110> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

3 6

[Fwd: rpmguard: 0 warnings for package xorg-x11-server-1.7.4-2.fc12]
by Will Woods 13 Jan '10

13 Jan '10

It would probably be better if it didn't send out email if there's nothing bad to report... -w -------- Forwarded Message -------- > From: autoqa(a)fedoraproject.org > Reply-to: fedora-test-list(a)redhat.com > To: autoqa-results(a)lists.fedorahosted.org > Subject: rpmguard: 0 warnings for package xorg-x11-server-1.7.4-2.fc12 > Date: Wed, 13 Jan 2010 14:00:06 -0500 > > N: Comparing xorg-x11-server-Xvfb-1.7.4-1.fc12 and xorg-x11-server-Xvfb-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-source-1.7.4-1.fc12 and xorg-x11-server-source-1.7.4-2.fc12 (archs: noarch) ... > N: ---- > N: Comparing xorg-x11-server-Xephyr-1.7.4-1.fc12 and xorg-x11-server-Xephyr-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-Xnest-1.7.4-1.fc12 and xorg-x11-server-Xnest-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-Xdmx-1.7.4-1.fc12 and xorg-x11-server-Xdmx-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-devel-1.7.4-1.fc12 and xorg-x11-server-devel-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-Xorg-1.7.4-1.fc12 and xorg-x11-server-Xorg-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > N: Comparing xorg-x11-server-common-1.7.4-1.fc12 and xorg-x11-server-common-1.7.4-2.fc12 (archs: ppc, x86_64, ppc64, i686) ... > N: ---- > _______________________________________________ > autoqa-results mailing list > autoqa-results(a)lists.fedorahosted.org > https://fedorahosted.org/mailman/listinfo/autoqa-results

1 0

[PATCH] Add support for passing boot arguments to install.py
by James Laska 13 Jan '10

13 Jan '10

--- lib/python/rats.py | 5 +++++ tests/rats_install/install.py | 6 +++--- 2 files changed, 8 insertions(+), 3 deletions(-) diff --git a/lib/python/rats.py b/lib/python/rats.py index b219b87..7cff743 100644 --- a/lib/python/rats.py +++ b/lib/python/rats.py @@ -76,6 +76,10 @@ def parse_args(): parser.add_option("-b", "--bindir", action="store", default=config.bindir, help="binary dir - contains minimon, ks.cfg, etc. (%default)") + parser.add_option("-x", "--extra-args", action="store", + default="", + help="Additional arguments to pass to the kernel booted from the specified TREEURL") + (opt, args) = parser.parse_args() if len(args) != 1: parser.error("incorrect number of arguments") @@ -86,4 +90,5 @@ def parse_args(): config.set_scratchdir(opt.scratchdir) config.logdir = opt.logdir config.bindir = opt.bindir + config.extra_args = opt.extra_args return (opt, uri) diff --git a/tests/rats_install/install.py b/tests/rats_install/install.py index 01eb572..72b7171 100755 --- a/tests/rats_install/install.py +++ b/tests/rats_install/install.py @@ -90,7 +90,7 @@ def get_initrd(treeinfo): initrd = c.get('images-%s' % arch,'initrd') return initrd -def create_guest(imgdir, name="RATS", kickstart=None, minimon=None, url=None): +def create_guest(imgdir, name="RATS", kickstart=None, minimon=None, url=None, extra_args=""): '''Attempt to create a new virt guest using the given data''' if kickstart is None: kickstart = os.path.join(config.bindir, "ks.cfg") @@ -149,7 +149,7 @@ def create_guest(imgdir, name="RATS", kickstart=None, minimon=None, url=None): guest = VirtGuest(name="%s_%u" % (name, counter)) print " new guest name: %s" % guest.name print "starting virt guest" - guest.create(location=imgdir) + guest.create(location=imgdir, extra_args=extra_args) guest.minimon = minimon_server # save MinimonServer object guest.steplist = [] # A place to save the list of anaconda steps return guest @@ -323,7 +323,7 @@ if __name__ == '__main__': util.write_keyval("tree_time", int(float(timestamp))) util.write_keyval("treeinfo_localtime", time.ctime(timestamp)) - guest = create_guest(config.scratchdir, url=baseuri) + guest = create_guest(config.scratchdir, url=baseuri, extra_args=opt.extra) try: print "\n== kernel boot test ==" -- 1.6.5.2

3 3

Re: [AutoQA] #110: rpmlint, rpmguard: Send results to mailing list
by Kamil Paral 12 Jan '10

12 Jan '10

----- "James Laska" <jlaska(a)redhat.com> wrote: There are a few other patches out for > review on the list ... do we want those included? > > * > https://fedorahosted.org/pipermail/autoqa-devel/2010-January/000073.html Liam's patch looks good for me. > * > https://fedorahosted.org/pipermail/autoqa-devel/2010-January/000079.html > That's completely out of my scope, I hope Will will have a look at that. Will?

1 0

Re: [AutoQA] #110: rpmlint, rpmguard: Send results to mailing list
by Kamil Paral 11 Jan '10

11 Jan '10

----- "AutoQA" <trac(a)fedorahosted.org> wrote: > #110: rpmlint, rpmguard: Send results to mailing list > ------------------------------+--------------------------------------------- > Rpmlint and rpmguard tests must be modified to send results to > autoqa- > results. > -- > Ticket URL: <https://fedorahosted.org/autoqa/ticket/110> There is a small nuisance when enabling this, it means several dozen emails a day. Do you think it's a problem? If not, it is easy to implement. If you do, we can for example try to just save the log somehow and send it concatenated once a day? There would have to be some modifications then. Anyway, we should probably think a little ahead. The test results should be stored somewhere, sending them to a mailing list is not good enough. From a short introspection I believe irb front-end does already have some database where it stores results received from autotest-server (do I say it correctly?). I think the results database should not be tied to a front-end. If we have it separated, we can instruct the tests to send all the results to that results server. Then we can collect those results (in any time interval we want) and send them to the mailing list. It also allows us to have several different front-ends (because some modifications will be needed to display results from rpmlint or rpmguard, it's not really pass or fail). Another thing, we can query the results server remotely. That means we can display the results even in external tools (koji can display rpmlint's results for a package when it is available). Ideas? Have I got something wrong?

2 1

Re: [AutoQA] #58: Write package sanity tests
by fedora-badges 11 Jan '10

11 Jan '10

#58: Write package sanity tests ----------------------+----------------------------------------------------- Reporter: kparal | Owner: Type: task | Status: closed Priority: major | Milestone: Package update tests Component: tests | Version: 1.0 Resolution: wontfix | Keywords: ----------------------+----------------------------------------------------- Changes (by kparal): * status: new => closed * resolution: => wontfix Comment: This will take a little more effort than a one ticket task. Beakerlib must be made standalone, integrated into autoqa. We will also need some further autoqa infrastructure changes, including modified presentation front-end. I will close this task for now and make appropriate sub-tickets as external tasks progress (beakerlib is ready to be used, sanity tests are completed, etc). -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/58#comment:1> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 0

Re: [AutoQA] #57: rpmguard: Integrate it into AutoQA
by fedora-badges 11 Jan '10

11 Jan '10

#57: rpmguard: Integrate it into AutoQA ---------------------+------------------------------------------------------ Reporter: kparal | Owner: kparal Type: task | Status: closed Priority: major | Milestone: Package update tests Component: tests | Version: 1.0 Resolution: fixed | Keywords: ---------------------+------------------------------------------------------ Changes (by kparal): * status: assigned => closed * resolution: => fixed Comment: Merged to master by commit [f48b8e2b2f47a81395b69da9ed767a2a141efa8b]. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/57#comment:3> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

autoqa-devel January 2010