#125: initscripts: Choosing the right repo for dependencies
-------------------------+--------------------------------------------------
Reporter: kparal | Owner: jskladan
Type: task | Status: new
Priority: major | Milestone:
Component: tests | Version: 1.0
Keywords: initscripts |
-------------------------+--------------------------------------------------
Currently after new Koji build the initscripts test downloads all relevant
binary packages (related to the particular source package) and installs
them. But the RPM dependencies are installed from stable/updates repos,
not from Koji. Also the dependencies parsed out of Makefile are installed
from stable/updates repos.
We have to inquire a little more into this situation. Is it
sufficient/desirable? Or is it desirable to download dependencies from
updates-testing or bleeding edge Koji? May the initscripts test sometimes
fail because of insufficient dependencies are in stable/updates repos?
This also depends on cases when we are going to use initscripts test. If
it will be used with Bodhi hook, it will be probably easier to solve it
than when used with Koji hook.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/125>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#224: initscripts: installing older package then current fails
--------------------+-------------------------------------------------------
Reporter: kparal | Owner: jskladan
Type: defect | Status: new
Priority: major | Milestone: Package Update Acceptance Test Plan
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
In initscripts test we install some packages. But if those packages are
older than currently installed, the test crashes. Usually we test only
very new package builds, but in same cases this can also happen and we
should have it handled.
{{{
[root@aqd autoqa]# autoqa post-koji-build --kojitag dist-f13
openssh-5.4p1-1.fc13 --local -t initscripts
14:28:27 INFO | Writing results to /usr/share/autotest/client/results
/post-koji-build:initscripts.noarch
14:28:27 INFO | Initializing the state engine
14:28:27 DEBUG| Persistent state variable __steps now set to []
14:28:27 INFO | Symlinking init scripts
14:28:27 DEBUG| Running 'grep :initdefault: /etc/inittab'
14:28:27 DEBUG| Running 'ln -sf /usr/share/autotest/client/tools/autotest
/etc/init.d/autotest'
14:28:27 DEBUG| Running 'ln -sf /usr/share/autotest/client/tools/autotest
/etc/rc3.d/S99autotest'
14:28:27 DEBUG| Dropping caches
14:28:27 DEBUG| Running 'sync'
14:28:27 DEBUG| Running 'echo 3 > /proc/sys/vm/drop_caches'
14:28:27 DEBUG| Running 'rpm -qa'
14:28:28 INFO | START ---- ---- timestamp=1284121708
localtime=Sep 10 14:28:28
14:28:28 DEBUG| Persistent state variable __group_level now set to 1
14:28:28 INFO | START initscripts initscripts
timestamp=1284121708 localtime=Sep 10 14:28:28
14:28:28 DEBUG| Persistent state variable __group_level now set to 2
14:28:28 DEBUG| Crash handling system enabled
14:28:28 DEBUG| Running 'rpm -qa'
14:28:29 INFO |
/etc/yum.repos.d/beakerlib.repo:baseurl=http://afri.fedorapeople.org/beakerlib/
14:28:29 DEBUG| Running 'yum -y install beakerlib'
14:28:29 DEBUG| [stdout] Setting up Install Process
14:28:30 DEBUG| [stdout] Package beakerlib-1.3-1.fc13.noarch already
installed and latest version
14:28:30 DEBUG| [stdout] Nothing to do
14:28:31 INFO | Test started. Number of iterations: 1
14:28:31 INFO | Executing iteration 1 of 1
14:28:31 INFO | Dropping caches between iterations
14:28:31 DEBUG| Running 'sync'
14:28:31 DEBUG| Running 'echo 3 > /proc/sys/vm/drop_caches'
14:28:31 INFO | ========================================
14:28:31 INFO | openssh-5.4p1-1.fc13
14:28:31 INFO | ========================================
14:28:32 INFO | Saving RPMs to
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms
14:28:32 INFO | Grabbing
http://koji.fedoraproject.org/packages/openssh/5.4p1/1.fc13/x86_64/pam_ssh_…
14:28:34 INFO | Grabbing
http://koji.fedoraproject.org/packages/openssh/5.4p1/1.fc13/x86_64
/openssh-askpass-5.4p1-1.fc13.x86_64.rpm
14:28:35 INFO | Grabbing
http://koji.fedoraproject.org/packages/openssh/5.4p1/1.fc13/x86_64
/openssh-server-5.4p1-1.fc13.x86_64.rpm
14:28:37 INFO | Grabbing
http://koji.fedoraproject.org/packages/openssh/5.4p1/1.fc13/x86_64
/openssh-clients-5.4p1-1.fc13.x86_64.rpm
14:28:39 INFO | Grabbing
http://koji.fedoraproject.org/packages/openssh/5.4p1/1.fc13/x86_64/openssh-…
14:28:41 DEBUG| Running 'yum -y --nogpgcheck localinstall
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
askpass-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
server-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
clients-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-5.4p1-1.fc13.x86_64.rpm'
14:28:47 ERROR| Exception escaping from test:
Traceback (most recent call last):
File "/usr/share/autotest/client/common_lib/test.py", line 384, in _exec
_call_test_function(self.execute, *p_args, **p_dargs)
File "/usr/share/autotest/client/common_lib/test.py", line 570, in
_call_test_function
return func(*args, **dargs)
File "/usr/share/autotest/client/common_lib/test.py", line 279, in
execute
postprocess_profiled_run, args, dargs)
File "/usr/share/autotest/client/common_lib/test.py", line 201, in
_call_run_once
self.run_once(*args, **dargs)
File "/usr/lib/python2.6/site-packages/autoqa/decorators.py", line 71,
in newf
f_result = f(*args, **kwargs) #call the decorated function
File "/usr/share/autotest/client/site_tests/initscripts/initscripts.py",
line 158, in run_once
utils.system_output(cmd)
File "/usr/share/autotest/client/common_lib/utils.py", line 689, in
system_output
args=args).stdout
File "/usr/share/autotest/client/common_lib/utils.py", line 425, in run
"Command returned non-zero exit status")
CmdError: Command <yum -y --nogpgcheck localinstall
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
askpass-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
server-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
clients-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-5.4p1-1.fc13.x86_64.rpm>
failed, rc=1, Command returned non-zero exit status
* Command:
yum -y --nogpgcheck localinstall
/usr/share/autotest/client/tmp/tmpS_K1om
_initscripts/rpms/pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
askpass-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
server-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
clients-5.4p1-1.fc13.x86_64.rpm
/usr/share/autotest/client/tmp/tmpS_K1om_i
nitscripts/rpms/openssh-5.4p1-1.fc13.x86_64.rpm
Exit status: 1
Duration: 0
stdout:
Setting up Local Package Process
Examining
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64.rpm:
pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64
Marking
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/pam_ssh_agent_auth-0.9.2-24.1.fc13.x86_64.rpm
to be installed
Examining /usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms
/openssh-askpass-5.4p1-1.fc13.x86_64.rpm: openssh-
askpass-5.4p1-1.fc13.x86_64
Marking /usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
askpass-5.4p1-1.fc13.x86_64.rpm to be installed
Examining /usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms
/openssh-server-5.4p1-1.fc13.x86_64.rpm: openssh-
server-5.4p1-1.fc13.x86_64
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
server-5.4p1-1.fc13.x86_64.rpm: does not update installed package.
Examining /usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms
/openssh-clients-5.4p1-1.fc13.x86_64.rpm: openssh-
clients-5.4p1-1.fc13.x86_64
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-
clients-5.4p1-1.fc13.x86_64.rpm: does not update installed package.
Examining
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-5.4p1-1.fc13.x86_64.rpm:
openssh-5.4p1-1.fc13.x86_64
/usr/share/autotest/client/tmp/tmpS_K1om_initscripts/rpms/openssh-5.4p1-1.fc13.x86_64.rpm:
does not update installed package.
Resolving Dependencies
--> Running transaction check
---> Package openssh-askpass.x86_64 0:5.4p1-1.fc13 set to be installed
--> Processing Dependency: openssh = 5.4p1-1.fc13 for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libX11.so.6()(64bit) for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libatk-1.0.so.0()(64bit) for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libcairo.so.2()(64bit) for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libfontconfig.so.1()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libgdk-x11-2.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libgdk_pixbuf-2.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libgtk-x11-2.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libpango-1.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libpangocairo-1.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
--> Processing Dependency: libpangoft2-1.0.so.0()(64bit) for package:
openssh-askpass-5.4p1-1.fc13.x86_64
---> Package pam_ssh_agent_auth.x86_64 0:0.9.2-24.1.fc13 set to be
installed
--> Running transaction check
---> Package atk.x86_64 0:1.30.0-1.fc13 set to be installed
---> Package cairo.x86_64 0:1.8.10-1.fc13 set to be installed
--> Processing Dependency: libpng12.so.0(PNG12_0)(64bit) for package:
cairo-1.8.10-1.fc13.x86_64
--> Processing Dependency: libpixman-1.so.0()(64bit) for package:
cairo-1.8.10-1.fc13.x86_64
--> Processing Dependency: libXrender.so.1()(64bit) for package:
cairo-1.8.10-1.fc13.x86_64
--> Processing Dependency: libpng12.so.0()(64bit) for package:
cairo-1.8.10-1.fc13.x86_64
---> Package fontconfig.x86_64 0:2.8.0-1.fc13 set to be installed
---> Package gtk2.x86_64 0:2.20.1-1.fc13 set to be installed
--> Processing Dependency: libXrandr >= 1.2.99.4-2 for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libtiff >= 3.6.1 for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: hicolor-icon-theme for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXrandr.so.2()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libtiff.so.3()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXdamage.so.1()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXcursor.so.1()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libcups.so.2()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXi.so.6()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libjasper.so.1()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXext.so.6()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXcomposite.so.1()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXinerama.so.1()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
--> Processing Dependency: libXfixes.so.3()(64bit) for package:
gtk2-2.20.1-1.fc13.x86_64
---> Package libX11.x86_64 0:1.3.1-3.fc13 set to be installed
--> Processing Dependency: libX11-common = 1.3.1-3.fc13 for package:
libX11-1.3.1-3.fc13.x86_64
--> Processing Dependency: libxcb.so.1()(64bit) for package:
libX11-1.3.1-3.fc13.x86_64
---> Package openssh-askpass.x86_64 0:5.4p1-1.fc13 set to be installed
--> Processing Dependency: openssh = 5.4p1-1.fc13 for package: openssh-
askpass-5.4p1-1.fc13.x86_64
---> Package pango.x86_64 0:1.28.0-1.fc13 set to be installed
--> Processing Dependency: libthai >= 0.1.9 for package:
pango-1.28.0-1.fc13.x86_64
--> Processing Dependency: libthai.so.0(LIBTHAI_0.1)(64bit) for package:
pango-1.28.0-1.fc13.x86_64
--> Processing Dependency: libthai.so.0()(64bit) for package:
pango-1.28.0-1.fc13.x86_64
--> Processing Dependency: libXft.so.2()(64bit) for package:
pango-1.28.0-1.fc13.x86_64
--> Running transaction check
---> Package cups-libs.x86_64 1:1.4.4-5.fc13 set to be installed
--> Processing Dependency: libgnutls.so.26(GNUTLS_1_4)(64bit) for package:
1:cups-libs-1.4.4-5.fc13.x86_64
--> Processing Dependency: libavahi-common.so.3()(64bit) for package: 1
:cups-libs-1.4.4-5.fc13.x86_64
--> Processing Dependency: libgnutls.so.26()(64bit) for package: 1:cups-
libs-1.4.4-5.fc13.x86_64
--> Processing Dependency: libavahi-client.so.3()(64bit) for package: 1
:cups-libs-1.4.4-5.fc13.x86_64
---> Package hicolor-icon-theme.noarch 0:0.12-1.fc13 set to be installed
---> Package jasper-libs.x86_64 0:1.900.1-15.fc13 set to be installed
---> Package libX11-common.noarch 0:1.3.1-3.fc13 set to be installed
---> Package libXcomposite.x86_64 0:0.4.1-2.fc13 set to be installed
---> Package libXcursor.x86_64 0:1.1.10-4.fc13 set to be installed
--> Processing Dependency: dmz-cursor-themes for package:
libXcursor-1.1.10-4.fc13.x86_64
---> Package libXdamage.x86_64 0:1.1.2-2.fc13 set to be installed
---> Package libXext.x86_64 0:1.1.2-2.fc13 set to be installed
---> Package libXfixes.x86_64 0:4.0.4-2.fc13 set to be installed
---> Package libXft.x86_64 0:2.1.14-1.fc13 set to be installed
---> Package libXi.x86_64 0:1.3.2-1.fc13 set to be installed
---> Package libXinerama.x86_64 0:1.1-2.fc13 set to be installed
---> Package libXrandr.x86_64 0:1.3.0-5.fc13 set to be installed
---> Package libXrender.x86_64 0:0.9.5-1.fc13 set to be installed
---> Package libpng.x86_64 2:1.2.44-1.fc13 set to be installed
---> Package libthai.x86_64 0:0.1.14-2.fc13 set to be installed
---> Package libtiff.x86_64 0:3.9.4-1.fc13 set to be installed
---> Package libxcb.x86_64 0:1.5-1.fc13 set to be installed
--> Processing Dependency: libXau.so.6()(64bit) for package:
libxcb-1.5-1.fc13.x86_64
---> Package openssh-askpass.x86_64 0:5.4p1-1.fc13 set to be installed
--> Processing Dependency: openssh = 5.4p1-1.fc13 for package: openssh-
askpass-5.4p1-1.fc13.x86_64
---> Package pixman.x86_64 0:0.18.0-1.fc13 set to be installed
--> Running transaction check
---> Package avahi.x86_64 0:0.6.25-7.fc13 set to be installed
--> Processing Dependency: libdaemon >= 0.11 for package:
avahi-0.6.25-7.fc13.x86_64
--> Processing Dependency: dbus for package: avahi-0.6.25-7.fc13.x86_64
--> Processing Dependency: libdaemon.so.0()(64bit) for package:
avahi-0.6.25-7.fc13.x86_64
---> Package dmz-cursor-themes.noarch 0:0.4-3.fc13 set to be installed
---> Package gnutls.x86_64 0:2.8.6-2.fc13 set to be installed
--> Processing Dependency: libtasn1.so.3(LIBTASN1_0_3)(64bit) for package:
gnutls-2.8.6-2.fc13.x86_64
--> Processing Dependency: libtasn1.so.3()(64bit) for package:
gnutls-2.8.6-2.fc13.x86_64
---> Package libXau.x86_64 0:1.0.5-1.fc12 set to be installed
---> Package openssh-askpass.x86_64 0:5.4p1-1.fc13 set to be installed
--> Processing Dependency: openssh = 5.4p1-1.fc13 for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Running transaction check
---> Package dbus.x86_64 1:1.2.24-1.fc13 set to be installed
---> Package libdaemon.x86_64 0:0.14-1.fc13 set to be installed
---> Package libtasn1.x86_64 0:2.4-2.fc13 set to be installed
---> Package openssh-askpass.x86_64 0:5.4p1-1.fc13 set to be installed
--> Processing Dependency: openssh = 5.4p1-1.fc13 for package: openssh-
askpass-5.4p1-1.fc13.x86_64
--> Finished Dependency Resolution
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
stderr:
Error: Package: openssh-askpass-5.4p1-1.fc13.x86_64 (/openssh-
askpass-5.4p1-1.fc13.x86_64)
Requires: openssh = 5.4p1-1.fc13
Installed: openssh-5.4p1-3.fc13.x86_64 (@updates)
openssh = 5.4p1-3.fc13
Available: openssh-5.4p1-1.fc13.x86_64 (fedora)
openssh = 5.4p1-1.fc13
}}}
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/224>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#353: Create Mockups for AutoQA External Dependencies
--------------------+-------------------------------------------------------
Reporter: tflink | Owner:
Type: task | Status: new
Priority: major | Milestone: Future tasks
Component: core | Keywords:
--------------------+-------------------------------------------------------
== Description ==
AutoQA is tightly coupled with Koji and Bobhi. This tight coupling makes
it difficult to test AutoQA in isolation.
Mocking up Koji and Bodhi would help to isolate AutoQA and provide a
controlled environment to run better tests. By mocking up Bodhi and Koji,
we can test without modifying more than the Bodhi and Koji URLs in config
files.
== Basic Design ==
Koji can be mocked up through its XML-RPC interface and Bodhi can be
mocked up through its RESTful interface.
Both interfaces can be mocked up using [http://flask.pocoo.org/ Flask] and
its [https://bitbucket.org/leafstorm/flask-xml-rpc/ XML-RPC extension].
Both pieces of software are in the Fedora repos.
The interfaces wouldn't be complete - just enough to get AutoQA to work.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/353>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#362: Add opt-in email support to anaconda tests
--------------------+-------------------------------------------------------
Reporter: jlaska | Owner:
Type: task | Status: new
Priority: major | Milestone: Finger Food
Component: tests | Keywords:
--------------------+-------------------------------------------------------
The anaconda crew has requested notification of installer automated
results. I'd like to enable opt-in email notification for compose_tree,
anaconda_storage and anaconda_checkbot. Once opt-in support in those
tests exists, we can recommend that the anaconda crew
[https://jlaska.wordpress.com/2010/06/01/fedora-package-maintainers-want-
test-results/ sign-up for result notification].
I'm not sure how to do it, but we have several other tests (rpmguard and
rpmlint) that offer this support now. Perhaps the test wrapper for each
test needs to somehow call the following ...
{{{
# submit results, including email opt-in
self.post_results(optin={'pkg': name, 'kojitag': kojitag})
}}}
Some things to consider ... when the compose_tree test fails, it's not
always the fault of anaconda. Many components are responsible for
composing trees (lorax, pungi, anaconda, createrepo, yum etc...). Maybe
we at least submit notification for the particular component whose build
triggered the test.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/362>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
Now that 0.6.0 has been released and we haven't seen any new issues,
it's time to start looking at 0.7.0. Since we're all working on getting
Fedora 16 Alpha out the door, I think that we're going to hold off on
some of the major work for the time being but that doesn't mean we
can't start planning.
I'd like to schedule a teleconference for Thursday but before I do,
let's get a list together of the proposed features. Once we have a
list, I'll schedule a meeting.
My proposals are holdovers from 0.6.0 that didn't get finished:
* #347 - Test results are sometimes linked incorrectly in bodhi
- https://fedorahosted.org/autoqa/ticket/347
* #355 - Determine Use Cases for Functional Self Tests
- https://fedorahosted.org/autoqa/ticket/355
* #353 - Create AutoQA Functional Self Test Cases
- https://fedorahosted.org/autoqa/ticket/353
Any other proposals?
Tim