copr-devel January 2017

copr-devel@lists.fedorahosted.org

6 participants
13 discussions

mockremote with RHEL??
by Martin Juhl 31 Jan '17

31 Jan '17

Hi guys I have standard mock building packages for RHEL with the following configuration: ------------------- config_opts['root'] = 'rhel-7-x86_64' config_opts['target_arch'] = 'x86_64' config_opts['legal_host_arches'] = ('x86_64',) config_opts['chroot_setup_cmd'] = 'install bash bzip2 cpio diffutils gzip perl sed tar unzip which @development' config_opts['dist'] = 'el7' config_opts['releasever'] = '7Server' config_opts['yum.conf'] = """ [main] cachedir=/var/cache/yum keepcache=1 debuglevel=1 reposdir=/dev/null logfile=/var/log/yum.log retries=20 obsoletes=1 gpgcheck=0 assumeyes=1 syslog_ident=mock syslog_device= # repos [rhel-7-server-rpms] metadata_expire = 86400 sslclientcert = /etc/pki/entitlement/9216879986979201201.pem baseurl = https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/os ui_repoid_vars = releasever basearch sslverify = 1 name = Red Hat Enterprise Linux 7 Server (RPMs) sslclientkey = /etc/pki/entitlement/9216879986979201201-key.pem gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release enabled = 1 sslcacert = /etc/rhsm/ca/redhat-uep.pem gpgcheck = 1 """ -------------------- Does anyone know howto use this with copr and mockremote??? Right now I have created a /etc/mock/rhel-7-x86_64.cfg, and added the profile with the manage.py script... But it doesn't really spawn the process: [2017-01-24 09:56:59,846][ DEBUG][vmm.event_handler][event_handle.py:on_health_check_result:106] recording check fail: {u'vm_ip': u'127.0.0.1', u'vm_name': u'Copr builder 596711858', u'topic': u'health_check', u'result': u'failed', u'msg': u'VM is not responding to the testing playbook.Runner options: {\'remote_user\': \'mockbuilder\', \'timeout\': 5, \'pattern\': \'127.0.0.1\', \'forks\': 1, \'host_list\': \'127.0.0.1,\', \'transport\': u\'paramiko\'}Ansible raw response:\n{\'dark\': {\'127.0.0.1\': {\'msg\': "Failed to open session: (1, \'Administratively prohibited\')", \'failed\': True}}, \'contacted\': {}}'} Any ideas?? Regards Martin

4 7

New COPR release
by Michal Novotny 31 Jan '17

31 Jan '17

Hey folks, it is our great pleasure to announce that newly released packages have just been deployed on COPR machines, that is: copr-frontend *1.105-1* copr-backend *1.96-1* copr-dist-git *0.24-1* These packages are f25 compatible (including copr-keygen) and offer some new features: copr-frontend: - always show "Regenerate" button for recreating backend repodata - display and improve info on modularity support in module details - handle GitHub tag event webhooks - option to login with krb5 now available copr-backend: - switched usage of deprecated ansible 1.x Runner for python-paramiko module to be compatible with ansible 2 - support for STOMP (Simple Text Oriented Message Protocol) for sending build info messages as an alternative to fedmsg copr-dist-git: - docker image upgraded to f25 You can find the complete list in the package changelogs, if required. To make a long story short, apart from upgrades to run on F25, there is also momentum to make COPR more general-purpose build system that can be installed and used on other distributions too. Modularity support is still a work in progress, although we are making some interesting progress. We are also continuously aiming to improve user experience. COPR team

2 1

New Release tomorrow
by Michal Novotny 30 Jan '17

30 Jan '17

Hello, new COPR version will be deployed tomorrow at 9am UTC. COPR team

1 0

fedmsg structure change?
by Pierre-Yves Chibon 25 Jan '17

25 Jan '17

Hi all, We have recently been receiving emails about wrongly formatted fedmsg message coming from copr in stg. Has there been any changes made to the structure of the messages sent in stg? To give you an idea, this is what we received: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/moksha/hub/api/consumer.py", line 191, in _work self.consume(message) File "/usr/lib/python2.7/site-packages/fmn/consumer/consumer.py", line 89, in consume self.work(session, raw_msg) File "/usr/lib/python2.7/site-packages/fmn/consumer/consumer.py", line 105, in work msg['msg']['owner'] in self.ignored_copr_owners: KeyError: 'owner' The message being: {'body': {u'username': u'copr', u'certificate': u'LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVUakNDQTdlZ0F3SUJBZ0lDQVBZd0RRWUpL\nb1pJaHZjTkFRRUZCUUF3Z2FBeEN6QUpCZ05WQkFZVEFsVlQKTVFzd0NRWURWUVFJRXdKT1F6RVFN\nQTRHQTFVRUJ4TUhVbUZzWldsbmFERVhNQlVHQTFVRUNoTU9SbVZrYjNKaApJRkJ5YjJwbFkzUXhE\nekFOQmdOVkJBc1RCbVpsWkcxelp6RVBNQTBHQTFVRUF4TUdabVZrYlhObk1ROHdEUVlEClZRUXBF\nd1ptWldSdGMyY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1UUdabFpHOXlZWEJ5YjJwbFkz\nUXUKYjNKbk1CNFhEVEUwTURReU16RTBNamsxTVZvWERUSTBNRFF5TURFME1qazFNVm93Z2R3eEN6\nQUpCZ05WQkFZVApBbFZUTVFzd0NRWURWUVFJRXdKT1F6RVFNQTRHQTFVRUJ4TUhVbUZzWldsbmFE\nRVhNQlVHQTFVRUNoTU9SbVZrCmIzSmhJRkJ5YjJwbFkzUXhEekFOQmdOVkJBc1RCbVpsWkcxelp6\nRXRNQ3NHQTFVRUF4TWtZMjl3Y2kxamIzQnkKTFdKbExtTnNiM1ZrTG1abFpHOXlZWEJ5YjJwbFkz\nUXViM0puTVMwd0t3WURWUVFwRXlSamIzQnlMV052Y0hJdApZbVV1WTJ4dmRXUXVabVZrYjNKaGNI\nSnZhbVZqZEM1dmNtY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1ClFHWmxaRzl5WVhCeWIy\ncGxZM1F1YjNKbk1JR2ZNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0R05BRENCaVFLQmdRQ2UKREs5VFQy\nM05BdTZPWTVGMnVVNHpMRW9Ld2k1RnRRTU5jVWV5eDdmOHJxMUZXaUxDWHBjWFhpU2tzUE1XV1NM\nWQo5SHNoa1pvM3ZjMHFSRXVBWDNweWRuM2VFRDA0UExrUmRlaWpvSXA5L0Y2YlZ3MmlLMDdXRmc5\nU2MwNlRsKzhSCld1RHNaeTQ1SVJKYXhCRTlJaHBYL0x2Y2JnQ1cvZmVHVGp5WG1iRHd0UUlEQVFB\nQm80SUJWekNDQVZNd0NRWUQKVlIwVEJBSXdBREF0QmdsZ2hrZ0JodmhDQVEwRUlCWWVSV0Z6ZVMx\nU1UwRWdSMlZ1WlhKaGRHVmtJRU5sY25ScApabWxqWVhSbE1CMEdBMVVkRGdRV0JCUm5lNTg0d3Bs\nWGYrZVE2K25zSTZCbm5BNENaRENCMVFZRFZSMGpCSUhOCk1JSEtnQlJyUUZyNUVnaUpXZWRaNVFY\nMUFoMEtUbjhVQUtHQnBxU0JvekNCb0RFTE1Ba0dBMVVFQmhNQ1ZWTXgKQ3pBSkJnTlZCQWdUQWs1\nRE1SQXdEZ1lEVlFRSEV3ZFNZV3hsYVdkb01SY3dGUVlEVlFRS0V3NUdaV1J2Y21FZwpVSEp2YW1W\namRERVBNQTBHQTFVRUN4TUdabVZrYlhObk1ROHdEUVlEVlFRREV3Wm1aV1J0YzJjeER6QU5CZ05W\nCkJDa1RCbVpsWkcxelp6RW1NQ1FHQ1NxR1NJYjNEUUVKQVJZWFlXUnRhVzVBWm1Wa2IzSmhjSEp2\nYW1WamRDNXYKY21lQ0NRRGpVQjVIVHhjZVJUQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFM\nQmdOVkhROEVCQU1DQjRBdwpEUVlKS29aSWh2Y05BUUVGQlFBRGdZRUFVazNlbjBYUXpDQm5IUlh4\nZDhyOHp2ZFAwVURvbEpiUysyTEl3Z3NDClJDMnNkZ1UwNGdFblYxdFpVTjNydEk1SzQ2MnpKT0JQ\nOFhQd3h4eUZMN1lOYmVtWTgyTG52Y1pHdzliMGdxTDMKdHNKbzllSFV5SXBZMG93TlVKdzgzU1Ax\neFJvb3NwVGJRK3BsNm9qdjVPNVpGZ1lBUG1yckRWZ0M4a2gzRlp4Rgp0SWc9Ci0tLS0tRU5EIENF\nUlRJRklDQVRFLS0tLS0K\n', u'i': 3, u'timestamp': 1485209011, u'msg_id':u'2017-dc6af56b-76c4-425d-8b66-f69295b38fe0', u'crypto': u'x509', u'topic': u'org.fedoraproject.prod.copr.build.end',u'signature':u'AJHlFzJnrrTF9XVs6b0KT4U0n3LCVtK/cWbt+hceOeWf/0bvYn6ZMx6dUTBasutGnA8TY998U6H6\nzgBXPM1fyV4WCO+ekuIV7O6dpNedlfpcrnnU1LRGCPWVPSgIw0gg5QDfZ06kQWuQvC17JxokG7Pi\n4vIiW64ifAddRZEILxc=\n', u'msg': {}}, 'topic':u'org.fedoraproject.prod.copr.build.end'} Does that ring a bell to anyone? Thanks, Pierre

2 10

fedmsg hotfix
by Michal Novotny 24 Jan '17

24 Jan '17

Hello, I will deploy fedmsg hotfix tomorrow at 7:30am UTC. I am very sorry for the inconvenience. clime

3 2

dist-git not pushing to lookaside cache?
by Martin Juhl 24 Jan '17

24 Jan '17

Hi Guys I'm trying to clean up my installation instructions for the RHEL/CentOS installation.. I have a COPR server running on RHEL7, which can build packages... BUT, in the process of documenting, I'm doing a new clean install, but I can't get dist-git to push to the lookaside cache?? The repository in git is getting the source, but the packages are not being published to /var/lib/dist-git/cache/lookaside/pkgs/ I think that I have checked all permissions, and I can't find any errors.. Anyone have any ideas??? Regards Martin

2 4

COPR maintenance next week Monday - 23/01/2017
by Michal Novotny 23 Jan '17

23 Jan '17

Hello, next week on Monday, all COPR machines will be upgraded to f25. System will be unavailable from 8am to 11am UTC. We will announce progress and possible shift in the finish time in the #fedora-buildsys IRC channel on Freenode. Thank you! clime

2 1

Registering copr deployments somewhere on wiki?
by Pavel Raiskup 17 Jan '17

17 Jan '17

Hi all, recently I've seen Koji wiki page [1], and I'm curious whether we shouldn't start something like this, somewhere. It would be nice from upstream development POV to see what is Copr used for, how users patch Copr to make it work and what we should make sure we keep stable as possible. [1] https://fedoraproject.org/wiki/Using_the_Koji_build_system Pavel

1 0

please delete folder that wasn't properly deleted
by Sérgio Basto 08 Jan '17

08 Jan '17

Hi, please delete all in https://copr-be.cloud.fedoraproject.org/results/sergiomb/kde4for23/fedora-2… and https://copr-be.cloud.fedoraproject.org/results/sergiomb/kde4for23/fedora-2… I deleted kactivities from my project some time ago and it is important delete it because package overwrite system packages Thanks in advance. -- Sérgio M. B.

1 0

Dist-git/lookaside missing hash
by Martin Juhl 05 Jan '17

05 Jan '17

Hi guys When trying to use fedpkg-copr I get: [copr-service@copr02 python-urllib3]$ fedpkg-copr -v --dist epel7 srpm Creating repo object from /tmp/3/python-urllib3 Could not determine the remote name: 'git config --get branch.epel7.remote' returned with exit code 1 Falling back to default remote name 'origin' Downloading urllib3-1.10.2.tar.gz Full url: http://localhost/repo/pkgs/mrmeee/Fisk/python-urllib3/urllib3-1.10.2.tar.gz… ######################################################################## 100.0% Could not execute srpm: Server returned status code 404 Traceback (most recent call last): File "/bin/fedpkg-copr", line 138, in <module> main() File "/bin/fedpkg-copr", line 128, in main sys.exit(client.args.command()) File "/usr/lib/python2.7/site-packages/pyrpkg/cli.py", line 1246, in srpm self.cmd.sources() File "/usr/lib/python2.7/site-packages/pyrpkg/__init__.py", line 1783, in sources hashtype=entry.hashtype, branch=self.branch_merge) File "/usr/lib/python2.7/site-packages/pyrpkg/lookaside.py", line 179, in download raise DownloadError('Server returned status code %d' % status) pyrpkg.errors.DownloadError: Server returned status code 404 This is because the url generated is wrong... in my working url the "md5" is not there... Generated url from fedpkg-copr: http://localhost/repo/pkgs/mrmeee/Fisk/python-urllib3/urllib3-1.10.2.tar.gz… working url: http://localhost/repo/pkgs/mrmeee/Fisk/python-urllib3/urllib3-1.10.2.tar.gz… Does anyone know howto either change the generated url or the url generated by dist-git??? Regards Martin

3 2

Re: dist-git is failing to import
by Martin Juhl 04 Jan '17

04 Jan '17

Hi Happy new year.. Still stuck here... Any new ideas??? Regards Martin ----- Original meddelelse ----- Fra: "mj" <mj(a)casalogic.dk> Til: "Michal Novotny" <clime(a)redhat.com> Sendt: mandag, 5. december 2016 19:14:25 Emne: Re: dist-git is failing to import Have traced it a little further... in /usr/lib/python2.7/site-packages/pyrpkg/__init__.py: line 2386 (or close by): file_hash = self.lookasidecache.hash_file(f) Still no real error though... ----- Original meddelelse ----- Fra: "Michal Novotny" <clime(a)redhat.com> Til: "mj" <mj(a)casalogic.dk> Sendt: mandag, 5. december 2016 17:36:31 Emne: Re: dist-git is failing to import On Mon, Dec 5, 2016 at 5:30 PM, Martin Juhl < mj(a)casalogic.dk > wrote: I'm not really any good with writing Python.. I can usually read it... Something like this (just gives the same error message)??? try: commands.upload(upload_files, replace=True) except Exception: log.exception("Failed!!!!") try: commands.upload(upload_files, replace=True) except Exception as e: log.exception("traceback: {0}".format(traceback.format_exc)) log.exception(str(e)) /Martin ----- Original meddelelse ----- Fra: "Michal Novotny" < clime(a)redhat.com > Til: "mj" < mj(a)casalogic.dk > Sendt: mandag, 5. december 2016 17:25:19 Emne: Re: dist-git is failing to import On Mon, Dec 5, 2016 at 5:16 PM, Martin Juhl < mj(a)casalogic.dk > wrote: Hi [root@copr02 new]# rpm -aq |grep pyrpkg pyrpkg-1.46-5.el7.noarch - It's from EPEL... What's your version... Seems to be here it fails: log.info ("save the source files into lookaside cache") commands.upload(upload_files, replace=True) <------ FAILS log.debug("git push") So is probably the pyrpkg library... what version do you use?? The same version and release (packaged for fc23) is on production. Try to wrap that code into try-except and print traceback an exception message. That might show us something. BQ_BEGIN /Martin ----- Original meddelelse ----- Fra: "Michal Novotny" < clime(a)redhat.com > Til: "copr-devel" < copr-devel(a)lists.fedorahosted.org > Sendt: mandag, 5. december 2016 17:05:12 Emne: Re: dist-git is failing to import On Mon, Dec 5, 2016 at 4:46 PM, Martin Juhl < mj(a)casalogic.dk > wrote: When trying to import, dist-git is failing: [15:12:20][DEBUG][dist_git.dist_git_importer][dist_git_importer:392] 1. Try to get task data [15:12:20][INFO][dist_git.dist_git_importer][dist_git_importer:484] 2. Task: 9-epel7, importing the package: http://copr02.casalogic.lan/tmp/tmpuxT8L3/copr-mocks-1.5-1.el7.src.rpm [15:12:20][DEBUG][dist_git.dist_git_importer][dist_git_importer:361] downloading package http://copr02.casalogic.lan/tmp/tmpuxT8L3/copr-mocks-1.5-1.el7.src.rpm [15:12:20][DEBUG][dist_git.dist_git_importer][dist_git_importer:428] Verifying packagage, getting name and version. [15:12:20][DEBUG][dist_git.dist_git_importer][dist_git_importer:457] make sure repos exist: mrmeee/Fisk/copr-mocks [15:12:20][DEBUG][dist_git.dist_git_importer][dist_git_importer:415] importing srpm into the dist-git [15:12:20][DEBUG][dist_git.srpm_import][srpm_import:57] repo_dir: /tmp/tmpFpUmZy/copr-mocks [15:12:20][DEBUG][dist_git.srpm_import][srpm_import:77] clone the pkg repository into tmp directory [15:12:20][DEBUG][pyrpkg][__init__:1279] Checking out a specific branch ssh://copr-dist-git@localhost/mrmeee/Fisk/copr-mocks [15:12:20][DEBUG][pyrpkg][__init__:952] Running git clone -b epel7 ssh://copr-dist-git@localhost/mrmeee/Fisk/copr-mocks --origin origin and logging output [15:12:20][INFO][pyrpkg][__init__:973] Cloning into 'copr-mocks'... [15:12:20][DEBUG][dist_git.srpm_import][srpm_import:79] import the source rpm into git and save filenames of sources [15:12:20][DEBUG][pyrpkg][__init__:680] Creating repo object from /tmp/tmpFpUmZy/copr-mocks [15:12:21][DEBUG][pyrpkg][__init__:1105] Running: rpm -qp --nosignature --qf %{NAME} /tmp/tmphDba9m/package.src.rpm [15:12:21][DEBUG][pyrpkg][__init__:1120] Running: rpm -qpl /tmp/tmphDba9m/package.src.rpm [15:12:21][INFO][dist_git.srpm_import][srpm_import:86] save the source files into lookaside cache [15:12:21][ERROR][dist_git.dist_git_importer][dist_git_importer:500] Exception raised during srpm import: Traceback (most recent call last): File "/usr/share/copr/dist_git/dist_git_importer.py", line 493, in do_import task.git_hash = self.git_import_srpm(task, fetched_srpm_path) File "/usr/share/copr/dist_git/dist_git_importer.py", line 419, in git_import_srpm return do_git_srpm_import(self.opts, filepath, task, tmp) File "/usr/share/copr/dist_git/srpm_import.py", line 112, in do_git_srpm_import raise PackageImportException("Failed to import the source rpm: {}".format(src_filepath)) PackageImportException: Failed to import the source rpm: /tmp/tmphDba9m/package.src.rpm [15:12:21][DEBUG][dist_git.dist_git_importer][dist_git_importer:465] Sending back: {"task_id": "9-epel7", "error": "srpm_import_failed"} [15:12:21][DEBUG][dist_git.dist_git_importer][dist_git_importer:392] 1. Try to get task data [15:12:21][DEBUG][dist_git.dist_git_importer][dist_git_importer:399] No new tasks to process Any way to get the importer to throw some more info???? Or anyone who recognize this error... What is the version of pyrpkg package on your machine? This is also one of the trickier errors. To debug that, you need to look into actual_do_git_srpm_import in dist-git/srpm_import.py. BQ_BEGIN When running the script defined in the installation ( https://pagure.io/fork/mrmeee/copr/copr/blob/master/f/dist-git ). .. I get: [root@copr02 new]# /usr/share/copr/dist_git/dist_git_importer.py Traceback (most recent call last): File "/usr/share/copr/dist_git/dist_git_importer.py", line 13, in <module> from .exceptions import CoprDistGitException, PackageImportException, PackageDownloadException, SrpmBuilderException, \ ValueError: Attempted relative import in non-package _______________________________________________ copr-devel mailing list -- copr-devel(a)lists.fedorahosted.org To unsubscribe send an email to copr-devel-leave(a)lists.fedorahosted.org _______________________________________________ copr-devel mailing list -- copr-devel(a)lists.fedorahosted.org To unsubscribe send an email to copr-devel-leave(a)lists.fedorahosted.org BQ_END BQ_END

2 3

Copr post-mortem
by Miroslav Suchý 02 Jan '17

02 Jan '17

Hi, today we experienced Copr failure and outage. First we got reports that builds are failing due failure to sign resulting packages. We had similar problem before Christmas, but investigation of logs shown that this was different issue. It took us a moment to find that we run out of inodes on storage where GPG keys are stored. The storage is only 1GB big, and default size of inodes was just 65k. Although we use only 40% of storage, we used all inodes. So we moved the data, formatted the partition with high -N option and moved data back. Right now the Copr and package signing is operational again. Thank to Clime, who helped me to restore the service. -- Miroslav Suchy, RHCA Red Hat, Senior Software Engineer, #brno, #devexp, #fedora-buildsys

1 0

COPR chroots additions/deletions
by Michal Novotny 02 Jan '17

02 Jan '17

Hello, I have added the following chroots custom-1-i386 custom-1-ppc64le custom-1-x86_64 epel-7-i386 and removed fedora-rawhide-i386 fedora-rawhide-x86_64 . Custom chroots were a long expected feature that enable you to configure your build environment almost at free will (by additional repos per chroot and additional buildroot packages). epel-7-i386 chroot was requested in *Bug 1271977* <https://bugzilla.redhat.com/show_bug.cgi?id=1271977> - RFE - asking for el7 i386 build option. It was somehow missed when epel-7 chroots were added so finally we have it. fedora-rawhide chroots were some residue of the yesterday's release. They should have been already disabled as fedora-26 chroots replaced them. clime

4 12

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

copr-devel January 2017