August 2016 - infrastructure - Fedora mailing-lists

About JS framework
by Pierre-Yves Chibon 17 Oct '22

17 Oct '22

Good Morning Everyone, Our infrastructure is mostly a python store, meaning almost all our apps are written in python and most using wsgi. However in python we are using a number of framework: * flask for most * pyramid for some of the biggest (bodhi, FAS3) * Django (askbot, Hyperkitty) * TurboGears2 (fedora-packages) * aiohttp (python3, async app: mdapi) While this makes sometime things difficult, these are fairly standard framework and most of our developers are able to help on all. However, as I see us starting to look at JS for some of our apps (fedora-hubs, wartaa...), I wonder if we could start the discussion early about the different framework and eventually see if we can unify around one. This would also allow those of us not familiar with any JS framework to look at the recommended one instead of picking one up semi-randomly. So has anyone experience with one or more JS framework? Do you have one that would you recommend? Why? Thanks for your inputs, Pierre

10 12

Proposal to mirror Docker images
by Randy Barlow 27 Oct '16

27 Oct '16

During Flock 2016, I had the opportunity to talk with Adam Miller, Dennis Gilmore, and Pierre-Yves Chibon about the technical challenges with distributing Docker images with Fedora's extensive mirror network. These conversations helped me to solidify a proposal for how Fedora could solve this problem, outlined below. High level view =============== In summary, the proposal is to write a patch for the docker client that will give it the capability to accept metalink responses upon docker pull operations. We would also need to add support for Docker images to mirror list and mirror manager. Additionally, we will need a small tool to pull the content to be mirrored out of a docker registry and write them to disk in a format that can be mirrored, as well as some Ansible code to run the tool when there is new content to be mirrored. Background ========== The Fedora project wishes to begin distributing new types of content than it has in the past. One of the types that has been identified as a goal is the Docker image. Adam Miller has already done the work that will allow packagers to build Docker images, but we still need a way to distribute those builds to Fedora's users. Adam Miller's implementation helpfully drops the builds we want into a Docker registry. Proposed Changes ================ Mirror List ----------- Users will be pointing their docker clients at Mirror List when they docker pull Fedora's Docker images. In order for this to work, we will need to make two changes to Mirror List so that it can respond to the docker client properly. The first change is that Mirror List will need to respond with a special header and a body of "{}" when the docker client sends a GET request for /v2/. The second change is that it will need to return a metalink document when the client makes additional requests so that the clients can be redirected to a list of mirrors near their locations, just as it does with the dnf client today. The docker client typically connects to port 5000. We could run a second instance of Mirror List on port 5000 if we wanted to isolate it from the current instance. We can also have the docker client pull from 443 as dnf does if we want to keep the deployment simpler. Mirror Manager -------------- We will need to make a few changes to Mirror Manager as well. We will need to provide an interface to allow mirror admins to opt in/out of mirroring Docker content. We will also need to modify the curler to detect whether a given mirror is up to date or not. We will need to make sure that UMDL is updated when content changes. docker ------ The most significant work required will likely be modifying the docker client to enable it to properly handle the metalink responses it will be receiving from Mirror List. When requesting the manifest, it will receive a metalink document that will give it a priority ordered list of mirrors. It will need to work through the list in order until it reaches a mirror that has the correct checksum for the requested manifest. It will then use that same mirror for the subsequent blob requests. There is some concern that such a feature would not be accepted by the upstream docker project. If we were to proceed with this proposal, we would propose this patch to the upstream Docker project. If upstream were not willing to accept the feature, we would need to have the Fedora docker packager carry this patch as a downstream add on. New Tool -------- The last piece that is needed is a tool that can create the filesystem tree that we want to synchronize out to the mirrors. The mirrors only need to carry manifests and blobs, so the tool needs only to pull these documents out of the registry that Adam Miller has set up and write them to disk in a particular structure. For optimization, we could use hardlinks for blobs that are common across the various images (for example, the Fedora base blob will be the same in all images) to save rsync time and mirror disk space. Additionally, we will need a playbook to run this new tool in response to fedmsgs. We may be able to use Adam Miller's loopabull project to run such a playbook at the right times. Conclusion ========== Thanks for reading, and please respond with any comments or questions you have about this proposal. I'm happy to clarify any points further, and if you have any alternative proposals I'd love to hear those as well.

12 26

[release] pagure: 2.4
by Pierre-Yves Chibon 05 Sep '16

05 Sep '16

Good Morning Everyone, This morning I cut a new release of pagure: 2.4 It had been a while since the last one and I felt we were at a right time for this. There are more changes coming, some of which will be disruptive so I wanted to cut a release before them. Here is the corresponding changelog: * Wed Aug 31 2016 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 2.4-1 - Update to 2.4 - - [Security] Avoid all html related mimetypes and force the download if any (CVE-2016-1000037) -- Fixed in 2.3.4 as well - Redirect the URL to projects <foo>.git to <foo> (Abhishek Goswami) - Allow creating projects with 40 chars length name on newer pagure instances - Fix @<user> and #<id> when editing a comment (Eric Barbour) - Display properly and nicely the ACLs of the API tokens (Lubomír Sedlář) - Removing html5lib so bleach installation finds what version is best (Tiago M. Vieira) - Remove the branchchooser from the repoheader (again) (Ryan Lerch) - Fix hard-coded urls in the master template - Made the interaction with the watch button clearer (Ryan Lerch) - Introduce pagure-ci, a service allowing to integrate pagure with a jenkins instance (Farhaan Bukhsh and I) - Accept Close{,s,d} in the same way as Merges and Fixes (Patrick Uiterwijk) - Avoid showing the 'New PR' button on the overview page is a PR already exists for this branch, in the main project or a fork (Vivek Anand) - Fix presenting the readme file and display the readme in the tree page if there is one in the folder displayed (Ryan Lerch) - Move the new issue button to be available on every page (AnjaliPardeshi) - Fix pagure for when an user enters a comment containing #<id> where the id isn't found in the db - Make the bootstrap URLs configurable (so that they don't necessarily point to the Fedora infra) (Farhaan Bukhsh) - Fix how the web-hook server determine the project and its username - Replace the login icon with plain text (Ryan Lerch) - Fix layout in the doc (Farhaan Bukhsh) - Improve the load_from_disk utility script - Fix our mardown processor to avoid crashing on #<text> (where we expect #<id>) - Fix the search for projects with a / in their names - Fix adding a file to a ticket when running pagure with `local` auth - Improve the grammar around the allowed prefix in our fake-namespaces (Jason Tibbitts) - Implement scanning of attached files for viruses (Patrick Uiterwijk) - Document how to set-up multiple ssh keys per user (William Moreno Reyes) - Add display_name and description to groups, and allow editing them - Add the ability to run the post-receive hook after merging a PR in the UI - Fix showing the group page even when user management is turned off (Vivek Anand) - Make explicit what the separators for tags is (Farhaan Bukhsh) - Include the word setting with icon (tenstormavi) - Fix the requirements.txt file (Vivek Anand) - Cleaned up the topbar a bit (Ryan Lerch) - Fix location of bottom pagination links on user page (Ryan Lerch) - Add user's project watch list in index page of the user (Vivek Anand) - Fix showing the reporter when listing the closed issues (Vivek Anand) - Fix accessing forks once the main repo has been deleted (Farhaan Bukhsh) As you can see many changes from many people, thanks to everyone who helped and worked hard to make this release. This release has been pushed to staging and will not be pushed to prod before next week. Happy hacking, Pierre

1 1

Fedora RelEng Automation
by Adam Miller 01 Sep '16

01 Sep '16

Hello all, I've been doing some work on the Fedora RelEng Automation[0][1] lately and I've gotten to a point that I have some Ansible playbooks that I'd like to test but I need to be able to run them somewhere in the Fedora Infrastructure as they will need to be able to touch various Release Engineering related systems (at least compose machines to begin with). I'd like advisement from the Infrastructure Team on how best to move forward with this. I'm happy to do the leg work, I just need some guidance to make sure I'm complying with Infra standards. Thank you, -AdamM [0] - https://pagure.io/releng-automation [1] - https://fedoraproject.org/wiki/Changes/ReleaseEngineeringAutomationWorkflow…

2 2

Mirrormanager doesn't provide F25 x86_64 debuginfo mirror for updates repository
by Christian Stadelmann 01 Sep '16

01 Sep '16

I'm trying to report a bug in a package (gnome-settings-daemon) and it would be useful to have debuginfo for this package. When running `dnf debuginfo-install gnome-settings-daemon`, I'm getting an error that the repomd.xml was not found in metalink. Therefore I manually downloaded the metalink file from https://mirrors.fedoraproject.org/metalink?repo=updates-released-debug-f25&… (URL from /etc/yum.repos.d/fedora-updates.repo file) and had a look at the file. The file itself just contains this content: <metalink version="3.0" xmlns="http://www.metalinker.org/" type="dynamic" pubdate="Wed, 31 Aug 2016 21:05:11 GMT" generator="mirrormanager" xmlns:mm0="http://fedorahosted.org/mirrormanager">  </metalink> but the file does not contain a line like # repo=updates-released-debug-f25&arch=x86_64 but it contains everything else: different architectures: # repo=updates-released-debug-f25&arch=aarch64 # repo=updates-released-debug-f25&arch=ppc64 # repo=updates-released-debug-f25&arch=ppc64le # repo=updates-released-debug-f25&arch=s390x different repos: … # repo=fedora-debug-25&arch=x86_64 … # repo=updates-released-f25&arch=x86_64 … # repo=updates-released-source-f25&arch=source … # repo=updates-testing-debug-f25&arch=x86_64 … the repo I'd need is just missing. I know of https://apps.fedoraproject.org/packages/mirrormanager/ and bugzilla and http://fedorahosted.org/mirrormanager, but those are for the package respectively its distribution through fedora, not for the infrastructure on mirrors.fedoraproject.org. I hope I'm right here.

2 2

Plan for tomorrow's Fedora Infrastructure meeting - 2016-09-01
by Kevin Fenzi 01 Sep '16

01 Sep '16

The infrastructure team will be having it's weekly meeting tomorrow, 2016-09-01 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-09-01) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info Fedora 25 alpha is out the door! - everyone #info We are now out of freeze until Beta - everyone #info new koschei in production on Fedora 24 - mizdebsk #info openvpn links moved to higher/better encryption - kevin #info ssl config consolidated, everything using high grade - patrick #info various small changes made post freeze - kevin #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic fedorahosted retirement - kevin * what to do about lists.fedorahosted.org * what to do about freemedia * Other "special" projects? * When to send announcements #topic = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

Fedora 25 Alpha Freeze now in effect
by Kevin Fenzi 31 Aug '16

31 Aug '16

Greetings. we are now in the infrastructure freeze leading up to the Fedora 25 Alpha release. This is a pre-release freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 25 Alpha when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://infrastructure.fedoraproject.org/infra/ansible.git scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2016-08-23 (or later if Alpha slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list. Thanks, kevin

1 1

[release] fedimg: 0.7
by Sayan Chowdhury 29 Aug '16

29 Aug '16

0.7 --- Pull Requests - (@ralphbean) #41, Setup logging for cronjob https://github.com/fedora-infra/fedimg/pull/41 - (@coolsvap) #44, Update typos https://github.com/fedora-infra/fedimg/pull/44 - (@nishant-mor) #46, Dropped 'os' and 'ver' from the AWS_AMIS config https://github.com/fedora-infra/fedimg/pull/46 - (@ralphbean) #47, Pungi4 fixes. https://github.com/fedora-infra/fedimg/pull/47 - (@ralphbean) #49, Add a nice log statement at the beginning stating what we're going to upload. https://github.com/fedora-infra/fedimg/pull/49 - (@sayanchowdhury) #50, Fix to include nightly atomic uploads https://github.com/fedora-infra/fedimg/pull/50 - (@sayanchowdhury) #51, Migrate fedimg to compose based https://github.com/fedora-infra/fedimg/pull/51 - (@sayanchowdhury) #52, Send image raw_url to fedmsg instead of the build_name https://github.com/fedora-infra/fedimg/pull/52 Commits - 60aa36b2a Setup logging for cronjob https://github.com/fedora-infra/fedimg/commit/60aa36b2a - 511497384 Update typo in GCE service https://github.com/fedora-infra/fedimg/commit/511497384 - 6b9c3210d Update typo in rackspace service https://github.com/fedora-infra/fedimg/commit/6b9c3210d - f470cebef Update typo in hp service https://github.com/fedora-infra/fedimg/commit/f470cebef - 5a1c7ab51 Dropped 'os' and 'ver' from the AWS_AMIS config https://github.com/fedora-infra/fedimg/commit/5a1c7ab51 - 05452ed71 ex2.py : Added new format of AWS_AMIS config https://github.com/fedora-infra/fedimg/commit/05452ed71 - 20805fdd9 s/yum/dnf/ https://github.com/fedora-infra/fedimg/commit/20805fdd9 - aec998075 Pungi4 fixes. https://github.com/fedora-infra/fedimg/commit/aec998075 - 9d4873858 Add a nice log statement at the beginning stating what we're going to upload. https://github.com/fedora-infra/fedimg/commit/9d4873858 - 156190880 Fix to include F24 nightly atomic uploads https://github.com/fedora-infra/fedimg/commit/156190880 - 335d2236a Migrate fedimg from koji-based to compose-based https://github.com/fedora-infra/fedimg/commit/335d2236a - 7ae44d715 Minor fixes in the fedmsg consumer https://github.com/fedora-infra/fedimg/commit/7ae44d715 - a3a2300ab Change KojiConsumer to FedimgConsumer https://github.com/fedora-infra/fedimg/commit/a3a2300ab - 1d0af12c1 Update the documenation to install fedfind while setting up https://github.com/fedora-infra/fedimg/commit/1d0af12c1 - 0e199c95d An small indentation typo resulting into major issue https://github.com/fedora-infra/fedimg/commit/0e199c95d - 4f9e932f3 Send image raw_url to fedimg instead of the build_name https://github.com/fedora-infra/fedimg/commit/4f9e932f3 -- Sayan Chowdhury <https://sayanchowdhury.dgplug.org/> Senior Software Engineer, Fedora Engineering - Emerging Platform GPG Fingerprint : 0F16 E841 E517 225C 7D13 AB3C B023 9931 9CD0 5C8B Proud to work at The Open Organization!

1 0

Freeze break request: Update Autocloud tests
by Kushal Das 25 Aug '16

25 Aug '16

Hi, We want to introduce new Autocloud test cases. This will not require change in any configure or package version. But it will create a new tarball of testcases for Autocloud which is accessible at [1]. I would also request to decide if we can keep the tests outside of the release freeze so that we can add/update the tests as required. [1] http://infrastructure.fedoraproject.org/infra/autocloud/tunirtests.tar.gz Kushal -- Fedora Cloud Engineer CPython Core Developer https://kushaldas.in https://dgplug.org

4 7

Plan for tomorrow's Fedora Infrastructure meeting - 2016-08-25
by Kevin Fenzi 25 Aug '16

25 Aug '16

The infrastructure team will be having it's weekly meeting tomorrow, 2016-08-25 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-08-25) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info commops cloud instance fixed up for ssh port changes - kevin #info copr backend volume fscked, hopefully stable now - kevin #info Bunch of alpha issues found and sorted, hopefully go this week - kevin #info freemedia updated for f24 - kevin #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic flock workshop followup - kevin #topic "official" announcement on Trac sunsetting to Pagure - jflory7 #idea To help encourage migration discussion in teams, a post on Community Blog about plans to sunset Trac in favor of Pagure to raise awareness? = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. #info jflory7 would like to pursue becoming a member of sysadmin-badges - interested to know more! = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

Freeze break request: update freemedia form
by Kevin Fenzi 24 Aug '16

24 Aug '16

From cf4e98451a80bea8616694fdc53042794c85d7b7 Mon Sep 17 00:00:00 2001 From: Kevin Fenzi <kevin(a)scrye.com> Date: Tue, 23 Aug 2016 20:17:51 +0000 Subject: [PATCH] update freemedia form for fedora 24 --- roles/freemedia/files/FreeMedia-form.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/roles/freemedia/files/FreeMedia-form.html b/roles/freemedia/files/FreeMedia-form.html index a9d2c48..78dad4f 100644 --- a/roles/freemedia/files/FreeMedia-form.html +++ b/roles/freemedia/files/FreeMedia-form.html @@ -47,7 +47,7 @@ To request <b>ONE</b> copy of Fedora DVD or Live Media by mail, please fill out <tr><td><b><small>Email</small></b></td><td><input type="text" size="20" name="email"></td></tr> <tr><td><b><small>Release</small></b></td> <td> -<input type="radio" name="release" value="Fedora 23" checked>Fedora 23</> +<input type="radio" name="release" value="Fedora 24" checked>Fedora 24</> </td> </tr> <tr><td><b><small>Media</small></b></td> -- 1.8.3.1 And also a run of the sundries playbook. +1s? kevin

3 2

Freeze break koji update
by Dennis Gilmore 23 Aug '16

23 Aug '16

Hi all, I want to update koji on the builders, the new build has a patch that stops it bind mounting /dev/ and /selinux into the chroot. It should fix the random livemedia builds failing bug Dennis

4 6

Post-freeze code update
by Aurelien Bompard 23 Aug '16

23 Aug '16

Hey people! As you all know, Mozilla Persona is going down in the next few months. I've spent the last weeks since Flock updating the Mailman UI code to use a library that will allow us to support local accounts properly, on top of external services accounts. I'm currently testing it in staging, and I'd like to update to code in production after the alpha freeze. It's a pretty decent amount of code change so I'm being careful here, and the DB schema migration may take a couple minutes. There was also a big branch merged in Mailman (unrelated, but a pretty large code change). I'm thinking a day or two after alpha is released, in my morning (UTC+2) so the US folks will be asleep and I can still get help from Patrick if necessary (Patrick doesn't seem to have a timezone anyway). Does this seem OK to you? Aurélien

2 2

Re: Freeze break request: dhcp changes on noc01
by itamar 23 Aug '16

23 Aug '16

. On Aug 12, 2016 4:00 PM, Kevin Fenzi <kevin(a)scrye.com> wrote: > > Greetings. > > tflink pushed this change right around freeze, but it's not yet active > on noc01 (needs a playbook run). > > +1s to just push it out? It shouldn't affect anything else. > looks good +1

1 0

Quick note regarding https in doc
by Michael Scherer 20 Aug '16

20 Aug '16

Hi, while searching for doc in the infra repo, I stumbled on a few occurence of us using rpm -ivh on http, and this kind of stuff. I fixed the docs to use https, but would like to remind people about making sure they do not forget MitM risks, and also ask to verify that I didn't commit something wrong to the repo (as I also fixed a few urls while on it) See https://infrastructure.fedoraproject.org/cgit/infra-docs.git/commit/?id=60e… Patrick and I also disagree on using DNS name in some part of the kickstart doc, so if there is anything not working, please feel free to fix :) -- Michael Scherer

3 2

track show svg for fedora design with this track plugin
by Catalin 19 Aug '16

19 Aug '16

Can we have this plugin https://trac-hacks.org/wiki/GraphvizPlugin ? for fedora design goal: will view the .svg file into track

2 1

Plan for tomorrow's Fedora Infrastructure meeting - 2016-08-18
by Kevin Fenzi 18 Aug '16

18 Aug '16

The infrastructure team will be having it's weekly meeting tomorrow, 2016-08-18 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-08-18) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info wikiedit fas group created for people who need to edit, but don't fit in other groups - kevin #info inactive apprentices dropped monday - kevin #info created bodhi-backend03 fedora 24 instance, mostly works - kevin #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic flock workshop followup - kevin #topic = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

Provenpackager for pagure on pkgs.fp.org
by Vivek Anand 17 Aug '16

17 Aug '16

Hi, I am one of GSoC students of this year and my project is to bring pkgs.fp.org <http://pkgs.fedoraproject.org/> on a pagure instance. The script is almost ready but there is one issue which needs some advice. The group *provenpackagers* currently has commit rights over all the repositories. As you might know, in pagure if some group has commit rights on a repository, all the members of that group also has rights on the project and it's listed as their own project. This would mean that all the members of provenpackagers would have >18k projects of their own. Example: 1. https://admin.fedoraproject.org/pkgdb/packager/pingou/ 2. https://pkgs.stg.fedoraproject.org/pagure/user/pingou (it says 1119 projects, it's under investigation at the moment.) pingou came out with two ideas: *1. Drop provenpackagers from pagure: *This would mean the proven packagers won't get any particular advantage of shifting to pagure as they won't be listed as admins of all the projects in the pagure db. They won't be able to merge/close pull requests, edit a file directly via the web-interface or execute any other admin rights on any of the repository they wish. They would, however, have access to all the git repositories as they would be present in gitolite conf file. They would be able to push to any of the repositories as it is the case at present. *2. Create exception for provenpackagers:* This is hackish. We can give them admin rights on all the repositories but won't show them in their profile. (only for provenpackager group). Proven packagers will get all the fun on moving to pagure. pingou is inclined to go with the first option and so am i. What do you think? Does anyone have a strong preference for one or the other? Thanks, Vivek

5 4

Freeze break request: create production docker iptables file
by Patrick Uiterwijk 17 Aug '16

17 Aug '16

Hi, So, this seems to have never been picked up, and I'm guessing the blocking didn't work before or it wasn't tested before (Either way, it's my fault, for which I'm sorry). Can I get +1s to add the production version of the osbs-master iptables rules? The actual changes are just a duplicate of the file to prod and updating the ip addresses in there. commit bb4b4696f99da9b202e454874ee492ceed54a3d9 Author: Patrick Uiterwijk <puiterwijk(a)redhat.com> Date: Wed Aug 17 17:43:54 2016 +0000 Create production docker iptables script Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com> diff --git a/roles/osbs-master/files/fix-docker-iptables b/roles/osbs-master/files/fix-docker-iptables deleted file mode 100644 index c204f74..0000000 --- a/roles/osbs-master/files/fix-docker-iptables +++ /dev/null @@ -1,54 +0,0 @@ -#!/bin/bash -xe -# Note: this is done as a script because it needs to be run after -# every docker service restart. -# And just doing an iptables-restore is going to mess up kubernetes' -# NAT table. - -# Delete all old rules -iptables --flush FORWARD - -# Re-insert some basic rules -iptables -A FORWARD -o docker0 -j DOCKER -iptables -A FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT -iptables -A FORWARD -i docker0 -o docker0 -j ACCEPT - -# Now insert access to allowed boxes -# docker-registry -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.217 --dport 443 -j ACCEPT - -#koji.fp.o -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.87 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.87 --dport 443 -j ACCEPT - -# pkgs.stg -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 9418 -j ACCEPT - -# DNS -iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.21 --dport 53 -j ACCEPT -iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.22 --dport 53 -j ACCEPT - -# mirrors.fp.o -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.51 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.52 --dport 443 -j ACCEPT - -# dl.phx2 -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 443 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 80 -j ACCEPT -iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 443 -j ACCEPT - - -# Docker is CRAZY and forces Google DNS upon us..... -iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.8.8 --dport 53 -j ACCEPT -iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.4.4 --dport 53 -j ACCEPT - -iptables -A FORWARD -j REJECT --reject-with icmp-host-prohibited - diff --git a/roles/osbs-master/files/fix-docker-iptables.production b/roles/osbs-master/files/fix-docker-iptables.production new file mode 100644 index 0000000..fc84186 --- /dev/null +++ b/roles/osbs-master/files/fix-docker-iptables.production @@ -0,0 +1,54 @@ +#!/bin/bash -xe +# Note: this is done as a script because it needs to be run after +# every docker service restart. +# And just doing an iptables-restore is going to mess up kubernetes' +# NAT table. + +# Delete all old rules +iptables --flush FORWARD + +# Re-insert some basic rules +iptables -A FORWARD -o docker0 -j DOCKER +iptables -A FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT +iptables -A FORWARD -i docker0 -o docker0 -j ACCEPT + +# Now insert access to allowed boxes +# docker-registry +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.56 --dport 443 -j ACCEPT + +#koji.fp.o +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.61 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.61 --dport 443 -j ACCEPT + +# pkgs +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.44 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.44 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.125.44 --dport 9418 -j ACCEPT + +# DNS +iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.21 --dport 53 -j ACCEPT +iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.22 --dport 53 -j ACCEPT + +# mirrors.fp.o +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.51 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.52 --dport 443 -j ACCEPT + +# dl.phx2 +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 443 -j ACCEPT + + +# Docker is CRAZY and forces Google DNS upon us..... +iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.8.8 --dport 53 -j ACCEPT +iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.4.4 --dport 53 -j ACCEPT + +iptables -A FORWARD -j REJECT --reject-with icmp-host-prohibited + diff --git a/roles/osbs-master/files/fix-docker-iptables.staging b/roles/osbs-master/files/fix-docker-iptables.staging new file mode 100644 index 0000000..c204f74 --- /dev/null +++ b/roles/osbs-master/files/fix-docker-iptables.staging @@ -0,0 +1,54 @@ +#!/bin/bash -xe +# Note: this is done as a script because it needs to be run after +# every docker service restart. +# And just doing an iptables-restore is going to mess up kubernetes' +# NAT table. + +# Delete all old rules +iptables --flush FORWARD + +# Re-insert some basic rules +iptables -A FORWARD -o docker0 -j DOCKER +iptables -A FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT +iptables -A FORWARD -i docker0 -o docker0 -j ACCEPT + +# Now insert access to allowed boxes +# docker-registry +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.217 --dport 443 -j ACCEPT + +#koji.fp.o +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.87 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.87 --dport 443 -j ACCEPT + +# pkgs.stg +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.83 --dport 9418 -j ACCEPT + +# DNS +iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.21 --dport 53 -j ACCEPT +iptables -A FORWARD -i docker0 -p udp -m udp -d 10.5.126.22 --dport 53 -j ACCEPT + +# mirrors.fp.o +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.51 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.52 --dport 443 -j ACCEPT + +# dl.phx2 +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.93 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.94 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.95 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.96 --dport 443 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 80 -j ACCEPT +iptables -A FORWARD -i docker0 -p tcp -m tcp -d 10.5.126.97 --dport 443 -j ACCEPT + + +# Docker is CRAZY and forces Google DNS upon us..... +iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.8.8 --dport 53 -j ACCEPT +iptables -A FORWARD -i docker0 -p udp -m udp -d 8.8.4.4 --dport 53 -j ACCEPT + +iptables -A FORWARD -j REJECT --reject-with icmp-host-prohibited + diff --git a/roles/osbs-master/tasks/main.yml b/roles/osbs-master/tasks/main.yml index bb622d9..d0b0c25 100644 --- a/roles/osbs-master/tasks/main.yml +++ b/roles/osbs-master/tasks/main.yml @@ -126,7 +126,7 @@ when: osbs_export_dir is defined - name: copy docker iptables script - copy: src=fix-docker-iptables dest=/usr/local/bin/fix-docker-iptables mode=0755 + copy: src="fix-docker-iptables.{{ env }}" dest=/usr/local/bin/fix-docker-iptables mode=0755 - name: copy docker service config copy: src=docker.service dest=/etc/systemd/system/docker.service

3 2

Fwd: Can't login to fedora project wiki page
by Nuwan Indika 17 Aug '16

17 Aug '16

---------- Forwarded message ---------- From: Nuwan Indika <nuwan600(a)gmail.com> Date: Tue, Aug 16, 2016 at 8:38 AM Subject: Re: Can't login to fedora project wiki page To: Kevin Fenzi <kevin(a)scrye.com>, Truong Tuan <tuanta(a)iwayvietnam.com> Hi Kevin, I like to join to wikiedit group because have trouble to sing-in to non cla groups and i have apply following group but still they are not sing-in to those groups.I think i need to sing-in to wikiedit group.hope you talk to me soon. - Click-through CLA Group <https://admin.fedoraproject.org/accounts/group/view/cla_click?_csrf_token=7…> (user) Status: Unapproved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/cla_click?_csrf_token=7…> - Signed CLA Group <https://admin.fedoraproject.org/accounts/group/view/cla_done?_csrf_token=71…> (user) Status: Approved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/cla_done?_csrf_token=71…> - Invite a New Member... <https://admin.fedoraproject.org/accounts/group/invite/cla_done/en/?_csrf_to…> - Signers of the Fedora Project Contributor Agreement <https://admin.fedoraproject.org/accounts/group/view/cla_fpca?_csrf_token=71…> (user) Status: Approved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/cla_fpca?_csrf_token=71…> - Invite a New Member... <https://admin.fedoraproject.org/accounts/group/invite/cla_fpca/en/?_csrf_to…> - IBM CLA Group <https://admin.fedoraproject.org/accounts/group/view/cla_ibm?_csrf_token=713…> (user) Status: Unapproved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/cla_ibm?_csrf_token=713…> - Fedora Install Guide <https://admin.fedoraproject.org/accounts/group/view/gitinstall-guide?_csrf_…> (user) Status: Unapproved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/gitinstall-guide?_csrf_…> - gitkernel <https://admin.fedoraproject.org/accounts/group/view/gitkernel?_csrf_token=7…> (user) Status: Unapproved Tools: - View Group <https://admin.fedoraproject.org/accounts/group/view/gitkernel?_csrf_token=7…> Thank you, Nuwan On Mon, Aug 15, 2016 at 9:56 PM, Kevin Fenzi <kevin(a)scrye.com> wrote: > On Sat, 30 Jul 2016 14:52:52 -0600 > Kevin Fenzi <kevin(a)scrye.com> wrote: > > > On Sat, 30 Jul 2016 16:33:13 -0400 > > "Justin W. Flory" <jflory7(a)gmail.com> wrote: > > > > > Just throwing out an idea, perhaps we could use the Fedora Join SIG > > > (fedora-join) FAS group to help bring new contributors into the > > > project, and then they could be removed once they are sponsored into > > > another group, if they are verified to be a human. > > > > > > CCing the Join list on this one too. > > > > If it's active enough we could sure... > > > > There was thought of making a new wikieditors group as well and just > > having a large pool of existing contributors be sponsors and sponsor > > people in as needed. > > To reply to myself here I have made a 'wikiedit' group. > > If there's people who need/want to edit the wiki but are not yet in a > non cla group, we can add them to this group. Folks that talk to new > contributors often that might be in this case let me know and I will > add you as sponsors to the group. > > kevin > > _______________________________________________ > infrastructure mailing list > infrastructure(a)lists.fedoraproject.org > https://lists.fedoraproject.org/admin/lists/infrastructure@ > lists.fedoraproject.org > > -- *H.G Nuwan Indika* http://nuwan600.wordpress.com | Skype: nuwan600 <https://mail.google.com/mail/u/0/#> <http://www.facebook.com/nuwan600> <http://lk.linkedin.com/in/h-g-nuwan-indika-a683ab43> <http://twitter.com/nuwan600> <http://www.instagram.com/nuwan600/> -- *H.G Nuwan Indika* http://nuwan600.wordpress.com | Skype: nuwan600 <https://mail.google.com/mail/u/0/#> <http://www.facebook.com/nuwan600> <http://lk.linkedin.com/in/h-g-nuwan-indika-a683ab43> <http://twitter.com/nuwan600> <http://www.instagram.com/nuwan600/>

2 2

Freeze break request: add fwupdate to secure-boot channel in koji
by Kevin Fenzi 17 Aug '16

17 Aug '16

Greetings. Per request from pjones, he would like us to add fwupdate to the secure-boot channel in koji. The following patch does this. Would require restart of the hub, but shouldn't be any downtime. +1s? diff --git a/roles/koji_hub/templates/hub.conf.j2 b/roles/koji_hub/templates/hub.conf.j2 index abe650c..6758196 100644 --- a/roles/koji_hub/templates/hub.conf.j2 +++ b/roles/koji_hub/templates/hub.conf.j2 @@ -116,6 +116,7 @@ channel = source */fedora-release* && has_perm secure-boot :: use secure-boot source */fedora-repos* && has_perm secure-boot :: use secure-boot source */pesign* && has_perm secure-boot :: use secure-boot + source */fwupdate* && has_perm secure-boot :: use secure-boot # we have some arm builders that have ssd's in them, eclipse is 7 hours faster building on them so lets # make sure that we always build eclipse on them.

3 2

Aug status update for Fedora Infrastructure Apprentices
by Kevin Fenzi 16 Aug '16

16 Aug '16

You are getting this email because you are in the 'fi-apprentice' group in the fedora account system (or are reading this on the infrastructure list). Feel free to reply just directly to me, or cc the infrastructure list for everyone to see and comment on. https://fedoraproject.org/wiki/Infrastructure_Apprentice At the first of every month(or so), I am going to be sending out an email like this one. I would like feedback on how things are going for you. I'd like to ask for everyone to send me a quick reply with the following data or anything related you can think of that might help us make the apprentice program more useful. 0. Whats your fedora account system login? 1. Have you logged in and used your fi-apprentice membership to look at our machines/setup in the last month? Do you plan to? 2. Has it helped you decide any area you wish to focus on or contribute to more? 3. Have you looked at or been able to work on any of the fi-apprentice 'easyfix' tickets? https://fedorahosted.org/fedora-infrastructure/report/14 4. Do you still wish to be a member of the group? If not (for whatever reason) could you provide any hints to help others down the road? 5. Is there any help or communication or ideas you have that would help you do any of the above? 6. What do you find to be the hardest part of getting involved? Finding things to work on? Getting attention from others to help you? Finding tickets in your interest area? 7. Have you been able to make any weekly irc meetings? Do you find them helpful or interesting? 8. Have you logged into our Gobby instance and read/seen/added to our meeting agenda? https://fedoraproject.org/wiki/Gobby 9. when was the last plane trip you took? Any other general feedback is also quite welcome, including improvements to this email, the wiki page, etc. Any folks I do not hear from in the next week will be removed from the group. (Note that it's easy to be readded when you have time or whatever and it's nothing at all personal, we just want to keep the group up to date with active folks). Thanks, and looking forward to your feedback! kevin

15 15

Meeting Agenda Item: Introduction Tiago M. Vieira
by Tiago M. Vieira 16 Aug '16

16 Aug '16

Hi all I'm Tiago (FAS: tiagovieira, IRC: tmoreira). I've been around Fedora for few years - I'm a Fedora advocate in the UK (UK ambassador) and I am a QE engineer at Red Hat. I have great interest in systems engineering - I've been developing tools to assist automations, configuration management and troubleshooting. In the last few years I've been developing my skills in the security area - I've got a PG diploma in systems and software security at Univ. of Oxford (UK). Fedora has always been my favourite dist, and I want contribute back. As I've been working with troubleshooting, tools development and configuration management, this is the things I can learn and do within my comfort zone. I am willing to learn more about the infrastructure security and, and hopefully focus in this area as I learn more about how this is done in this group. I would be grateful if I can get an sponsor. The languages I've worked in the past are C and Java, and I've been working with Python in the past 4 years. Apart from the academic diplomas, I've got RHCSA and RHCE certification (and I'm currently working on the expertise certifications for a Datacenter RHCA certification). You can also check my about page at: http://tvieira.com/about/ with few more details. I'm looking forward to working with you. Tiago

1 0

Can't login to fedora project wiki page
by Nuwan Indika 16 Aug '16

16 Aug '16

Hello Guys, I'm H.G Nuwan Indika. I did apply for the fedora ambassadors and i have done my first fedora event for the Fedora 24 release. I'm trying to access my fedoraproject wiki but i can't login and it show this error. *Login error You have entered an invalid username and password. If you are certain that your username and password are correct, confirm that you can log in to the Fedora Account System (https://admin.fedoraproject.org/accounts/ <https://admin.fedoraproject.org/accounts/>) and that you have signed the CLA. * I can login to my FAS account both the account has same user-name : nuwan600 I hope you can help me with this problem Best Regards *H.G Nuwan Indika* http://nuwan600.wordpress.com | Skype: nuwan600 <https://mail.google.com/mail/u/0/#> <http://www.facebook.com/nuwan600> <http://lk.linkedin.com/in/h-g-nuwan-indika-a683ab43> <http://twitter.com/nuwan600> <http://www.instagram.com/nuwan600/>

6 13

mirrormanager in the qa network
by Dennis Gilmore 15 Aug '16

15 Aug '16

Hi All, We have a chicken and egg problem, the tests require mirrormanager to point at the right content, and we do not want to sync the content unless we are sure it is okay for users and will work as expected. So the thought I was was to setup in the qa network a mirrormanager instance that will be able to point the tests at the just built composes and content. it would like need its own dns view so that the expected urls work in the expected ways, but point the the QA test specific instances. I wanted to get a conversation started on what it would take to implement Dennis

3 4

Freeze break request: bodhi-backend03 changes
by Kevin Fenzi 12 Aug '16

12 Aug '16

Greetings. Fedora 24 alpha is running into some bugs because the updates-testing repo does not have any weak deps in it's repodata. This is because bodhi-backend01 is a rhel7 instance and it's rpm is too old to have them. So, I have created a bodhi-backend03 instance thats Fedora 24 and would like to try pushing the fedora-24-updates-testing updates (to start with) from there to see if it fixes the issue. The attached patch should fix the bodhi roles to call 'package' instead of yum module (so they work on either rhel7 or fedora24) and add in a bodhi2 f24 repo to install from. +1s? kevin

3 6

Freeze break request: dhcp changes on noc01
by Kevin Fenzi 12 Aug '16

12 Aug '16

Greetings. tflink pushed this change right around freeze, but it's not yet active on noc01 (needs a playbook run). +1s to just push it out? It shouldn't affect anything else. kevin -- TASK [dhcp_server : setup dhcpd.conf dest=/etc/dhcp/dhcpd.conf, src=dhcpd.conf.{{ inventory_hostname }}, mode= 644] *** Friday 12 August 2016 18:54:31 +0000 (0:00:00.432) 0:04:28.954 ********* skipping: [noc02.fedoraproject.org] changed: [noc01.phx2.fedoraproject.org] --- before: /etc/dhcp/dhcpd.conf +++ after: /srv/web/infra/ansible/roles/dhcp_server/files/dhcpd.conf.noc01.phx2.fedoraproject.org @@ -1928,6 +1928,15 @@ fixed-address 10.5.131.22; } + host beaker-client01 { + hardware ethernet 44:A8:42:03:49:CB; + fixed-address 10.5.131.31; + option host-name "beaker-client01"; + option ntp-servers 66.187.233.4, 192.43.244.18, 128.118.25.5, 204.152.184.72; + next-server 10.5.124.228; + filename "pxelinux.0"; + } + host beaker-client02 { hardware ethernet 44:A8:42:03:49:CB; fixed-address 10.5.131.32;

3 2

Freeze break request: re-add ambassadors wiki updater script
by Kevin Fenzi 12 Aug '16

12 Aug '16

Greetings. Somehow we lost the script that was updating https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification in the move from puppet to ansible. The following commit re-adds it. This would also need an ansible run on sundries playbook. Impact should be low, just another cron and script on sundries01 and one new package added (python-mwclient). +1s? kevin -- From 07580e4585e9a36642b97b0fb849e16efeee3054 Mon Sep 17 00:00:00 2001 From: Kevin Fenzi <kevin(a)scrye.com> Date: Thu, 11 Aug 2016 19:58:45 +0000 Subject: [PATCH] Add back the script that updates the ambassadors membership wiki page. Was lost in the puppet->ansible move. --- .../build/files/membership-mwclient-build | 1 + roles/membership-map/build/tasks/main.yml | 28 ++ .../build/templates/membership-mwclient.py | 307 +++++++++++++++++++++ 3 files changed, 336 insertions(+) create mode 100644 roles/membership-map/build/files/membership-mwclient-build create mode 100644 roles/membership-map/build/templates/membership-mwclient.py diff --git a/roles/membership-map/build/files/membership-mwclient-build b/roles/membership-map/build/files/membership-mwclient-build new file mode 100644 index 0000000..6295923 --- /dev/null +++ b/roles/membership-map/build/files/membership-mwclient-build @@ -0,0 +1 @@ +55 5 * * * root /usr/local/bin/membership-mwclient.py > /dev/null diff --git a/roles/membership-map/build/tasks/main.yml b/roles/membership-map/build/tasks/main.yml index f9bffcf..cfdb2c3 100644 --- a/roles/membership-map/build/tasks/main.yml +++ b/roles/membership-map/build/tasks/main.yml @@ -1,3 +1,7 @@ +# +# This first part is building the maps for: +# http://fedoraproject.org/membership-map/ambassadors.html +# - file: dest=/srv/web/membership-map state=directory - template: > @@ -16,3 +20,27 @@ - synchronize: > src=www/ dest=/srv/web/membership-map/ + +# +# This part updates the wiki page at: +# https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification +# + +- yum: state=present name=python-mwclient + tags: + - membership-map + - membership-map/build + +- template: > + src=membership-mwclient.py dest=/usr/local/bin/membership-mwclient.py + owner=root group=root mode=0755 + tags: + - membership-map + - membership-map/build + +- copy: > + src=membership-mwclient-build dest=/etc/cron.d/membership-mwclient-build + owner=root group=root mode=0644 + tags: + - membership-map + - membership-map/build diff --git a/roles/membership-map/build/templates/membership-mwclient.py b/roles/membership-map/build/templates/membership-mwclient.py new file mode 100644 index 0000000..ff74498 --- /dev/null +++ b/roles/membership-map/build/templates/membership-mwclient.py @@ -0,0 +1,307 @@ +#!/usr/bin/python +''' This script is for generating output for +https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification.''' +# +# Copyright (C) 2010, Susmit Shannigrahi, Susmit AT fedoraproject DOT org +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +import getpass +from fedora.client.fas2 import AccountSystem +import datetime +import GeoIP +from kitchen.text.converters import to_bytes +import mwclient + +#from maxmind array +#changes are: 'RS': 'EU', 'ME': 'EU', 'AU': 'AS', 'NZ': 'AS' +#https://fedorahosted.org/fedora-infrastructure/ticket/2921 +#changes are: 'IL': 'EU', 'KG': 'EU', 'LB': 'EU', 'SA': 'EU', 'AE': 'EU' + + +CONTINENT_MAP = {'AP': 'AS', 'EU': 'EU', 'AD': 'EU', 'AE': 'EU', 'AF': 'AS', \ + 'AG': 'SA', 'AI': 'SA', 'AL': 'EU', 'AM': 'AS', 'AN': 'SA', 'AO': 'AF', \ +'AQ': 'AN', 'AR': 'SA', 'AS': 'OC', 'AT': 'EU', 'AU': 'OC', 'AW': 'SA', \ +'AX': 'EU', 'AZ': 'AS', 'BA': 'EU', 'BB': 'SA', 'BD': 'AS', 'BE': 'EU', \ +'BF': 'AF', 'BG': 'EU', 'BH': 'AS', 'BI': 'AF', 'BJ': 'AF', 'BM': 'SA', \ +'BN': 'AS', 'BO': 'SA', 'BR': 'SA', 'BS': 'SA', 'BT': 'AS', 'BV': 'AF', \ +'BW': 'AF', 'BY': 'EU', 'BZ': 'SA', 'CA': 'NA', 'CC': 'AS', 'CD': 'AF', \ +'CF': 'AF', 'CG': 'AF', 'CH': 'EU', 'CI': 'AF', 'CK': 'OC', 'CL': 'SA', \ +'CM': 'AF', 'CN': 'AS', 'CO': 'SA', 'CR': 'SA', 'CU': 'SA', 'CV': 'AF', \ +'CX': 'AS', 'CY': 'AS', 'CZ': 'EU', 'DE': 'EU', 'DJ': 'AF', 'DK': 'EU', \ +'DM': 'SA', 'DO': 'SA', 'DZ': 'AF', 'EC': 'SA', 'EE': 'EU', 'EG': 'AF', \ +'EH': 'AF', 'ER': 'AF', 'ES': 'EU', 'ET': 'AF', 'FI': 'EU', 'FJ': 'OC', \ +'FK': 'SA', 'FM': 'OC', 'FO': 'EU', 'FR': 'EU', 'FX': 'EU', 'GA': 'AF', \ +'GB': 'EU', 'GD': 'SA', 'GE': 'AS', 'GF': 'SA', 'GG': 'EU', 'GH': 'AF', \ +'GI': 'EU', 'GL': 'SA', 'GM': 'AF', 'GN': 'AF', 'GP': 'SA', 'GQ': 'AF', \ +'GR': 'EU', 'GS': 'SA', 'GT': 'SA', 'GU': 'OC', 'GW': 'AF', 'GY': 'SA', \ +'HK': 'AS', 'HM': 'AF', 'HN': 'SA', 'HR': 'EU', 'HT': 'SA', 'HU': 'EU', \ +'ID': 'AS', 'IE': 'EU', 'IL': 'EU', 'IM': 'EU', 'IN': 'AS', 'IO': 'AS', \ +'IQ': 'AS', 'IR': 'AS', 'IS': 'EU', 'IT': 'EU', 'JE': 'EU', 'JM': 'SA', \ +'JO': 'AS', 'JP': 'AS', 'KE': 'AF', 'KG': 'EU', 'KH': 'AS', 'KI': 'OC', \ +'KM': 'AF', 'KN': 'SA', 'KP': 'AS', 'KR': 'AS', 'KW': 'AS', 'KY': 'SA', \ +'KZ': 'AS', 'LA': 'AS', 'LB': 'EU', 'LC': 'SA', 'LI': 'EU', 'LK': 'AS', \ +'LR': 'AF', 'LS': 'AF', 'LT': 'EU', 'LU': 'EU', 'LV': 'EU', 'LY': 'AF', \ +'MA': 'AF', 'MC': 'EU', 'MD': 'EU', 'MG': 'AF', 'MH': 'OC', 'MK': 'EU', \ +'ML': 'AF', 'MM': 'AS', 'MN': 'AS', 'MO': 'AS', 'MP': 'OC', 'MQ': 'SA', \ +'MR': 'AF', 'MS': 'SA', 'MT': 'EU', 'MU': 'AF', 'MV': 'AS', 'MW': 'AF', \ +'MX': 'NA', 'MY': 'AS', 'MZ': 'AF', 'NA': 'AF', 'NC': 'OC', 'NE': 'AF', \ +'NF': 'OC', 'NG': 'AF', 'NI': 'SA', 'NL': 'EU', 'NO': 'EU', 'NP': 'AS', \ +'NR': 'OC', 'NU': 'OC', 'NZ': 'AS', 'OM': 'AS', 'PA': 'SA', 'PE': 'SA', \ +'PF': 'OC', 'PG': 'OC', 'PH': 'AS', 'PK': 'AS', 'PL': 'EU', 'PM': 'SA', \ +'PN': 'OC', 'PR': 'SA', 'PS': 'AS', 'PT': 'EU', 'PW': 'OC', 'PY': 'SA', \ +'QA': 'AS', 'RE': 'AF', 'RO': 'EU', 'RU': 'EU', 'RW': 'AF', 'SA': 'AS', \ +'SB': 'OC', 'SC': 'AF', 'SD': 'AF', 'SE': 'EU', 'SG': 'AS', 'SH': 'AF', \ +'SI': 'EU', 'SJ': 'EU', 'SK': 'EU', 'SL': 'AF', 'SM': 'EU', 'SN': 'AF', \ +'SO': 'AF', 'SR': 'SA', 'ST': 'AF', 'SV': 'SA', 'SY': 'AS', 'SZ': 'AF', \ +'TC': 'SA', 'TD': 'AF', 'TF': 'AF', 'TG': 'AF', 'TH': 'AS', 'TJ': 'AS', \ +'TK': 'OC', 'TM': 'AS', 'TN': 'AF', 'TO': 'OC', 'TP': 'AS', 'TR': 'EU', \ +'TT': 'SA', 'TV': 'OC', 'TW': 'AS', 'TZ': 'AF', 'UA': 'EU', 'UG': 'AF', \ +'UM': 'OC', 'US': 'NA', 'UY': 'SA', 'UZ': 'AS', 'VA': 'EU', 'VC': 'SA', \ +'VE': 'SA', 'VG': 'SA', 'VI': 'SA', 'VN': 'AS', 'VU': 'OC', 'WF': 'OC', \ +'WS': 'OC', 'YE': 'AS', 'YT': 'AF', 'YU': 'EU', 'ZA': 'AF', 'ZM': 'AF', \ +'ZR': 'AF', 'ZW': 'AF', 'RS': 'EU', 'ME': 'EU', 'AU': 'AS'} + + +def calc_list(): + '''Calculate the contributors list categorised by country''' + output = [] + people_list = [] + country_list = [] + inactive_list = [] + flag = 0 + final_output_list_as = [] + final_output_list_eu = [] + final_output_list_na = [] + final_output_list_latam = [] + final_output_list_africa = [] + final_output_list_unknown = [] + full_name = {'AS' : 'APAC', 'NA' : 'North America', \ +'SA' : 'LATAM', 'AF' : 'Africa', 'EU' : 'EMEA', 'Unknown' : 'Unknown'} + + + group_name = 'ambassadors' + username = 'fedoradummy' + password = '{{ fedoraDummyUserPassword }}' +# username = raw_input('Username: ').strip() +# password = getpass.getpass('Password: ') +{% if env == "staging" %} + base_url = 'https://admin.stg.fedoraproject.org/accounts/' +{% else %} + base_url = 'https://admin.fedoraproject.org/accounts/' +{% endif %} + + fas = AccountSystem(base_url=base_url, username=username, password=password) + + # Call fedoraproject API with mwclient +{% if env == "staging" %} + site = mwclient.Site(('https', 'stg.fedoraproject.org'), path='/w/') +{% else %} + site = mwclient.Site(('https', 'fedoraproject.org'), path='/w/') +{% endif %} + + site.login(username, password) # Optional + # Specify which page to edit + page = site.Pages['Ambassadors/MembershipService/Verification2'] + + #delete all the erswhile contents. + page.text() + blank_page = "updating..." + page.save(blank_page) + + print 'This takes loooooong time to execute...' + + #get all data from a group + group_people = fas.group_members(group_name) + #make a list of usernames of a group + for item in group_people: + people_list.append(item['username']) + + # get the country list from GeoIP + countries = dict(GeoIP.country_names.items()) + + # Get a dictinary of all people in FAS + data = fas.people_by_key(key='id', search=u'*', \ +fields=['human_name', 'username', 'email', 'status', 'country_code']) + + for person in people_list: +# break + for item in data.values(): + user_name = item['username'] + human_name = item['human_name'] + country_code = item['country_code'] + status = item['status'] + email = item['username'] + '@fedoraproject.org' + + + + if person == user_name: + if status == 'inactive': + inactive_list.append(user_name) + #print 'match' + elif status == 'active': #filter out all inactive accounts + if country_code is None or country_code == 'O1' \ +or country_code == ' ': + continent_code = 'Unknown' + else: + continent_code = CONTINENT_MAP[country_code] + + #different values for blank or non-blank fields are + #_____________________________________________________# + # Country Code || Human Name || Number of tickets|| # + #_____________________________________________________# + # None || None/Name || 0/n # + # ' ' || None/Name || # + # 'IN','FR' etc.|| None/Name || # + #_____________________________________________________# + + if country_code is None: + if human_name is None: + flag = 1 + else: + flag = 2 + elif country_code == ' ': + if human_name is None: + flag = 1 + else: + flag = 2 + + else: #if there is a country code available + country = countries[country_code] + if human_name is None: + flag = 3 + else: + flag = 4 + #check flag to decide o/p + if flag == 1: + entry = [user_name, user_name, 'Unknown', email, \ +'Unknown'] + output.append(entry) + elif flag == 2: + entry = [user_name, human_name, 'Unknown', email, \ +'Unknown'] + output.append(entry) + elif flag == 3: + entry = [user_name, user_name, country, email, \ +continent_code] + output.append(entry) + else: + entry = [user_name, human_name, country, email, \ +continent_code] + output.append(entry) + +# Now we have a output list like +#[['rdsharma4u', 'Ravi Datta Sharma','India','rdsharma4u(a)gmail.com','1','AS'], +#['red', 'Sandro Mathys', 'Switzerland', 'sm(a)sandro-mathys.ch', '10', 'EU']] + + + + for item in output: + #break + continent_code = item[4] + if continent_code == 'AS' or continent_code == 'AU': + final_output_list_as.append(item) + elif continent_code == 'NA': + final_output_list_na.append(item) + elif continent_code == 'SA': + final_output_list_latam.append(item) + elif continent_code == 'EU': + final_output_list_eu.append(item) + elif continent_code == 'AF': + final_output_list_africa.append(item) + elif continent_code == 'Unknown': + final_output_list_unknown.append(item) + # sort the list according to countries + + final_string = '' + for final_output_list in [final_output_list_as, final_output_list_africa, \ +final_output_list_na, final_output_list_latam, final_output_list_eu, \ +final_output_list_unknown]: + country_list = [] + #print final_output_list + + # print the full continent name from entry zero of list + try: + continent_code = final_output_list[0][4] + full_cont_name = full_name[continent_code] + full_cont_name = "<h3> %s (%s) </h3>" \ +% (full_cont_name, len(final_output_list)) + + final_string = final_string + full_cont_name + #print final_string + for item in final_output_list: + country = item[2] + if country_list.count(country) == 0: + country_list.append(country) + country_list.sort() + + except IndexError: + pass + + + #print country_list + final_output_country_list = \ +[[]*len(country_list) for i in range(len(country_list))] + for item in final_output_list: + # find the index of this entry (country) from county_list + index = country_list.index(item[2]) + final_output_country_list[index].append(item) + #print final_output_country_list + + + + + #final_string = '' + + for item in final_output_country_list: + #reverse mapping to print the country + pos = final_output_country_list.index(item) + num = len(item) #number of ambassador in a country. + + cnt_lst = "<h4> %s (%s) </h4>" % (country_list[pos], num) + # add country and table formatting to string. + final_string = final_string + cnt_lst + '<table><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Index</th><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Name</th><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Email</th>' + + index = 0 + for entries in item: + #print entries + #break + index = index + 1 + user_name = entries[0] + human_name = entries[1] + email = user_name + ' AT fedoraproject DOT org' + + #add detals. + final = "<tr><td>%s</td><td> [[User:%s| %s]]</td><td>%s</td></tr>" % (to_bytes(index), to_bytes(user_name), to_bytes(human_name), to_bytes(email)) + + final_string = final_string + final + final_string = final_string + '</table>' + + time = datetime.datetime.utcnow() + page.text() + page.save(final_string, summary = time) + + + note = "{{admon/note | Last Updated : %s UTC. %s active contributors \ +listed here against %s total.}}" % (time, len(output), len(people_list)) + page = site.Pages['Ambassadors/MembershipService/VerificationStats'] + page.text() + page.save(note, summary = time) + + page = site.Pages['Ambassadors/MembershipService/Inactives'] + page.text() + page.save(inactive_list, summary = time) + +if __name__ == "__main__": + calc_list() -- 1.8.3.1

3 2

Plan for tomorrow's Fedora Infrastructure meeting - 2016-08-11
by Kevin Fenzi 11 Aug '16

11 Aug '16

The infrastructure team will be having it's weekly meeting tomorrow, 2016-08-11 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-08-11) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info flock 2016 is over. Lots of blogs and soon videos to recap - everyone #info Fedora 25 Alpha Freeze has started - kevin #info nagios is all green for freeze - kevin/smooge/patrick #info Aug apprentice email went out (a bit late), reply by friday - kevin #info virthost-comm02 has been reinstalled with rhel7 - kevin #info rawhide/branched composers are now Fedora 24 - kevin #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic flock workshop followup - kevin = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

freeze break compose boxes
by Dennis Gilmore 10 Aug '16

10 Aug '16

We need to get a new pungi and python-productmd to fix some bugs in the compose process. can I get some +1's please Dennis

3 4

Flock discussions recap/request for input
by Kevin Fenzi 10 Aug '16

10 Aug '16

Greetings. At the recent flock conference Infrastructure workshop, we had a nice lively discussion on a number of items. However, as is normal, we don't want to make decisions about things without being open and allowing input from everyone, including those that couldn't be at flock. So, I thought I would write up what we talked about and the consensus we came up with and ask for any more input from this list before we start implementing things. It's possible there's something we didn't think about or that needs more discussion, so do feel free to reply to this email with any parts you want to comment on. * Containers in Fedora Infrastructure: * We want to look at moving things that make sense to containers. * A good initial candidate is the mirrorlist servers. * Would use the existing OSBS build system to build them. * Would run on proxies. * Would have haproxy list their socket as primary and old mirrorlists as secondary. * The container would have mirrorlist-server wsgi in it along with the pkl updated hourly. * Could allow us to spin up more as needed, but also should allow faster answers from proxies as they don't have to depend on or query over the vpn. * Contributor resources in the fedorainfracloud * Once our cloud is upgraded, we can use ipsilon to let users login to the cloud and spin up instances for Fedora related needs. * Outgoing restrictions would be added on port 25 and the like * To start with users would only get 1 external floating ip. * Initial rollout would enable qa and packager groups, need to see if docs and i18n or other groups would have a use for it. * would note that we can terminate any instance for any reason. * Patrick would write some scripting to notify users after some time and terminate if we didn't get an answer back. * Long term instances should be moved to persistent infra playbooks. * Build setup and requirements for infrastructure applications. * Will get releng to set us up some side tags that we can build from src.rpm in. * all prod builds to be done in koji. * Up to maintainers what priority they place on getting into EPEL/Fedora. Encouraged for many reasons. * FAS3 status * Was running in staging, but we disabled for now until we can finish a security audit. * Need to get python-fedora changes lined up and ready/pushed out. * Need to get fas3 fas_client packaged and ready to go. * Need more testing in staging. * Hopefully move production over after f25 is out. * Fedora Infrastructure support setup * Talked about on the list a fair bit. * Support can be determined by looking at the domain: fedoraproject.org - full 24x7 support, monitoring, uses RFR stg.fedoraproject.org - 8x5 support, monitoring fedoracommunity.org - some support, monitoring, uses simple RFR fedorainfracloud.org - unsupported, apps run by contributors * Fedora CA and cert infrastructure. * Current CA expires in 2018. * Plans being worked on now to back fas3 with freeipa so we could move to kerberos tickets for koji then * Need to figure out what would need to happen to sigul for that. * Wait and see pending freeipa/fas3 integration. * koji alternative arch proposals (on devel list, fesco ticket) * Not too much infrastructure work here. * will need to increase storage for primary koji, but can regain from secondaries once their last releases go end of life. Thats all I had notes on from the workshop, but there may well have been other items, please do chime in with them if you think of anything, or have any thoughts on the above. kevin

3 3

Freeze Break Request (Retroactive): Adding new staging database host for testing in qa
by Tim Flink 10 Aug '16

10 Aug '16

I completely forgot that we were in Alpha freeze earlier today and made some changes without requesting a freeze break. The changes shouldn't impact production in any meaningful way but I can back all the changes out if need be. In summary, I did the following: - created new dns entries for db-qa-stg01.qa - added a new db-qa-stg01.qa host to inventory - changed the postgres_server role to support dnf for f22+ - added the new db-qa-stg01.qa host to the postgres-server playbook I've attached a diff to this email for review. Tim

2 3

Re: 'Meeting Agenda Item: Introduction Marc'
by Marc Bagatela 09 Aug '16

09 Aug '16

employment in the furture On Tue, Aug 9, 2016 at 2:34 PM, Marc Bagatela <mbphilly84(a)gmail.com> wrote: > Hi everyone My name is Marc > IRC: marc84 > I can write Basic bash script but I willing to learn other programming > language like python and also want to learn about web application. I have > LPIC-1 certification and I want to improve my current linux administrator > skills. I also have Linux User groups(Linux, Linux(tech support) & gentoo > linux) on facebook and I also attend fosscon. > > What i want to learn? > I want to know everything what infrastructure team and system > administrator what they do. I like to learn new application and programming > skills that will help me become a linux administrator and also help me get >

1 0

'Meeting Agenda Item: Introduction Marc'
by Marc Bagatela 09 Aug '16

09 Aug '16

Hi everyone My name is Marc IRC: marc84 I can write Basic bash script but I willing to learn other programming language like python and also want to learn about web application. I have LPIC-1 certification and I want to improve my current linux administrator skills. I also have Linux User groups(Linux, Linux(tech support) & gentoo linux) on facebook and I also attend fosscon. What i want to learn? I want to know everything what infrastructure team and system administrator what they do. I like to learn new application and programming skills that will help me become a linux administrator and also help me get --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Builds from git repo with unpacked sources
by Michal Sekletar 09 Aug '16

09 Aug '16

Hello everyone, this is my first post to Fedora Infrastructure list, allow me to quickly introduce myself. My name is Michal Sekletar and I work for Red Hat. I co-maintain systemd in both Fedora and RHEL. Also I am Fedora user and contributor for more than 5 years now. Some of you probably know that Red Hat's internal infrastructure (dist-git and build system) has a lot in common with what is available to Fedora packagers. Recently, internally they introduced very nice feature that might be also useful to Fedora packagers. It is the ability to build packages from exploded sources. Packager no longer uploads tarball to lookaside cache and maintains patches in dist-git, but points rhpkg (internal equivalent of fedpkg) to git repo that contains exploded sources with downstream patches applied on top. This allows for easy cherry-picking of patches between branches and a ton of other nice features that make maintainer's life easier. I briefly talked about this with Ralph at Flock. He suggested that I send an email to this list where we can start the discussion if this is something we want in Fedora, and in case yes, how to get there. Cheers, Michal

4 5

unable to login to ask.fedoraproject.org
by Morgan Read 08 Aug '16

08 Aug '16

Hello folk I'm trying to post to: https://ask.fedoraproject.org/en/question/90082/fedora-24-doesnt-do-anythin… I write my post and click the login/signup button I'm referred to: https://ask.fedoraproject.org/en/account/signin/ Where I click on the 'fedora' button I'm referred to: https://id.fedoraproject.org/login/fas?ipsilon_transaction_id=bc5d2be8-f337… Where I enter my credentials and click the login button I'm referred to: https://ask.fedoraproject.org/en/account/signin/complete/?next=%2F&janrain_… entity%2Clp.is_member%2Cmode%2Cns%2Cns.cla%2Cns.lp%2Cns.sreg%2Cop_endpoint%2Cresponse_nonce%2Creturn_to%2Csigned%2Csreg.email%2Csreg.nickname&openid.sreg.email=mstuff%40read.org.nz&openid.sreg.nickname=mread Where my 'Screen Name' is prepopulated with 'mread' (my FAS username), and; My 'Email Address' is prepopulated with 'mstuff(a)read.org.nz' And, I click the 'signup' button (Why do I have to 'signup' and not 'signin' when the top of the page says 'please sign in'?) And, I'm referred back to the same page with the announcement in RED: 'this email is already used by someone else, please choose another' Please can someone direct me out of this mindless loop so that I can post to the ask forum please

2 1

[PATCH 1/4] Move mod_wsgi to a role rather than a included tasks
by Michael Scherer 08 Aug '16

08 Aug '16

--- files/mod_wsgi/wsgi.conf | 14 -------------- playbooks/groups/ask.yml | 2 +- playbooks/groups/autocloud-web.yml | 2 +- playbooks/groups/badges-web.yml | 2 +- playbooks/groups/basset.yml | 2 +- playbooks/groups/blockerbugs.yml | 2 +- playbooks/groups/bodhi2.yml | 2 +- playbooks/groups/datagrepper.yml | 2 +- playbooks/groups/elections.yml | 2 +- playbooks/groups/fas.yml | 2 +- playbooks/groups/fas3.yml | 2 +- playbooks/groups/fedocal.yml | 2 +- playbooks/groups/github2fedmsg.yml | 2 +- playbooks/groups/ipa.yml | 2 +- playbooks/groups/ipsilon.yml | 2 +- playbooks/groups/kerneltest.yml | 2 +- playbooks/groups/koschei-web.yml | 2 +- playbooks/groups/mailman.yml | 2 +- playbooks/groups/mdapi.yml | 2 +- playbooks/groups/mirrorlist2.yml | 2 +- playbooks/groups/noc.yml | 2 +- playbooks/groups/notifs-web.yml | 2 +- playbooks/groups/nuancier.yml | 2 +- playbooks/groups/packages.yml | 2 +- playbooks/groups/pdc.yml | 4 +--- playbooks/groups/pkgdb.yml | 2 +- playbooks/groups/statscache.yml | 4 +--- playbooks/groups/sundries.yml | 2 +- playbooks/groups/tagger.yml | 2 +- playbooks/groups/zanata2fedmsg.yml | 2 +- .../hosts/grafana.cloud.fedoraproject.org.yml | 2 +- playbooks/hosts/graphite.fedorainfracloud.org.yml | 2 +- playbooks/hosts/iddev.fedorainfracloud.org.yml | 2 +- playbooks/hosts/lists-dev.fedorainfracloud.org.yml | 2 +- .../hosts/modernpaste.fedorainfracloud.org.yml | 2 +- roles/mod_wsgi/files/wsgi.conf | 14 ++++++++++++++ roles/mod_wsgi/handlers/main.yml | 2 ++ roles/mod_wsgi/tasks/mod_wsgi.yml | 22 ++++++++++++++++++++++ tasks/mod_wsgi.yml | 22 ---------------------- 39 files changed, 72 insertions(+), 74 deletions(-) delete mode 100644 files/mod_wsgi/wsgi.conf create mode 100644 roles/mod_wsgi/files/wsgi.conf create mode 100644 roles/mod_wsgi/handlers/main.yml create mode 100644 roles/mod_wsgi/tasks/mod_wsgi.yml delete mode 100644 tasks/mod_wsgi.yml diff --git a/files/mod_wsgi/wsgi.conf b/files/mod_wsgi/wsgi.conf deleted file mode 100644 index 6c32a15..0000000 --- a/files/mod_wsgi/wsgi.conf +++ /dev/null @@ -1,14 +0,0 @@ -LoadModule wsgi_module modules/mod_wsgi.so - -# Some apps, notably anything that uses hg, need these off -WSGIRestrictStdin Off -WSGIRestrictStdout Off - -# Put the socket somewhere writable -WSGISocketPrefix run/wsgi - -# Do not Optimize without stripping docstrings -WSGIPythonOptimize 0 - -# Set WSGIApplicationGroup to global -WSGIApplicationGroup %{GLOBAL} diff --git a/playbooks/groups/ask.yml b/playbooks/groups/ask.yml index e52b1fb..574e309 100644 --- a/playbooks/groups/ask.yml +++ b/playbooks/groups/ask.yml @@ -18,6 +18,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - ask - fedmsg/base - rsyncd @@ -29,7 +30,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/autocloud-web.yml b/playbooks/groups/autocloud-web.yml index 52c5ac4..47ec534 100644 --- a/playbooks/groups/autocloud-web.yml +++ b/playbooks/groups/autocloud-web.yml @@ -21,6 +21,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - fedmsg/base - sudo - role: openvpn/client @@ -29,7 +30,6 @@ tasks: - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/badges-web.yml b/playbooks/groups/badges-web.yml index cff2680..3f53cd9 100644 --- a/playbooks/groups/badges-web.yml +++ b/playbooks/groups/badges-web.yml @@ -29,6 +29,7 @@ - sudo - { role: openvpn/client, when: env != "staging" } + - mod_wsgi - role: collectd/web-service site: frontpage url: "http://localhost/" @@ -42,7 +43,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/basset.yml b/playbooks/groups/basset.yml index 1af41a4..3ee7b82 100644 --- a/playbooks/groups/basset.yml +++ b/playbooks/groups/basset.yml @@ -26,6 +26,7 @@ - mongodb - rabbitmq - apache + - mod_wsgi - basset/frontend - basset/worker @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/blockerbugs.yml b/playbooks/groups/blockerbugs.yml index 27d4b16..113eda6 100644 --- a/playbooks/groups/blockerbugs.yml +++ b/playbooks/groups/blockerbugs.yml @@ -23,13 +23,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - blockerbugs tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/bodhi2.yml b/playbooks/groups/bodhi2.yml index 0a12c32..df9fac2 100644 --- a/playbooks/groups/bodhi2.yml +++ b/playbooks/groups/bodhi2.yml @@ -22,6 +22,7 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - { role: bodhi2/base, when: "inventory_hostname.startswith('bodhi0')" } - { role: fedmsg/base, when: "inventory_hostname.startswith('bodhi0')" } @@ -29,7 +30,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/datagrepper.yml b/playbooks/groups/datagrepper.yml index 9e343c0..c6eeaa1 100644 --- a/playbooks/groups/datagrepper.yml +++ b/playbooks/groups/datagrepper.yml @@ -25,12 +25,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/elections.yml b/playbooks/groups/elections.yml index 756fc37..afdc6a2 100644 --- a/playbooks/groups/elections.yml +++ b/playbooks/groups/elections.yml @@ -21,13 +21,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - collectd/base tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fas.yml b/playbooks/groups/fas.yml index bff9deb..3243a22 100644 --- a/playbooks/groups/fas.yml +++ b/playbooks/groups/fas.yml @@ -22,6 +22,7 @@ - rsyncd - memcached - apache + - mod_wsgi - fas_server - fedmsg/base - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fas3.yml b/playbooks/groups/fas3.yml index 3c93166..021b492 100644 --- a/playbooks/groups/fas3.yml +++ b/playbooks/groups/fas3.yml @@ -22,6 +22,7 @@ - rsyncd - memcached - apache + - mod_wsgi - fas3_server - fedmsg/base - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fedocal.yml b/playbooks/groups/fedocal.yml index 3bee8ea..ec2989b 100644 --- a/playbooks/groups/fedocal.yml +++ b/playbooks/groups/fedocal.yml @@ -21,13 +21,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - collectd/base tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/github2fedmsg.yml b/playbooks/groups/github2fedmsg.yml index ac8264a..99fe0eb 100644 --- a/playbooks/groups/github2fedmsg.yml +++ b/playbooks/groups/github2fedmsg.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/ipa.yml b/playbooks/groups/ipa.yml index 609fb46..8ebfcf0 100644 --- a/playbooks/groups/ipa.yml +++ b/playbooks/groups/ipa.yml @@ -20,12 +20,12 @@ - sudo - { role: openvpn/client, when: env != "staging" } + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/ipsilon.yml b/playbooks/groups/ipsilon.yml index 5706119..9bbccdf 100644 --- a/playbooks/groups/ipsilon.yml +++ b/playbooks/groups/ipsilon.yml @@ -26,12 +26,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/kerneltest.yml b/playbooks/groups/kerneltest.yml index 46ec3b8..221b1d3 100644 --- a/playbooks/groups/kerneltest.yml +++ b/playbooks/groups/kerneltest.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/koschei-web.yml b/playbooks/groups/koschei-web.yml index a21edf1..9314f57 100644 --- a/playbooks/groups/koschei-web.yml +++ b/playbooks/groups/koschei-web.yml @@ -20,13 +20,13 @@ - collectd/base - { role: sudo, sudoers: "{{ private }}/files/sudo/koschei01-sudoers" } - { role: openvpn/client, when: env != "staging" } + - mod_wsgi - koschei/frontend tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mailman.yml b/playbooks/groups/mailman.yml index c4f837d..b3d0da0 100644 --- a/playbooks/groups/mailman.yml +++ b/playbooks/groups/mailman.yml @@ -26,13 +26,13 @@ when: env != "staging" } - apache - spamassassin + - mod_wsgi tasks: # this is how you include other task lists - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mdapi.yml b/playbooks/groups/mdapi.yml index f07ee88..656c139 100644 --- a/playbooks/groups/mdapi.yml +++ b/playbooks/groups/mdapi.yml @@ -21,12 +21,12 @@ - { role: openvpn/client, when: env != "staging" } - collectd/base + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mirrorlist2.yml b/playbooks/groups/mirrorlist2.yml index bbc8468..aea46eb 100644 --- a/playbooks/groups/mirrorlist2.yml +++ b/playbooks/groups/mirrorlist2.yml @@ -56,6 +56,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - httpd/mod_ssl - role: httpd/certificate @@ -95,7 +96,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: diff --git a/playbooks/groups/noc.yml b/playbooks/groups/noc.yml index 1d426ad..34d4bd3 100644 --- a/playbooks/groups/noc.yml +++ b/playbooks/groups/noc.yml @@ -22,12 +22,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/notifs-web.yml b/playbooks/groups/notifs-web.yml index afb8c7f..3c49b35 100644 --- a/playbooks/groups/notifs-web.yml +++ b/playbooks/groups/notifs-web.yml @@ -23,6 +23,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - fedmsg/base - notifs/frontend - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/nuancier.yml b/playbooks/groups/nuancier.yml index 1d48752..5237609 100644 --- a/playbooks/groups/nuancier.yml +++ b/playbooks/groups/nuancier.yml @@ -26,12 +26,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/packages.yml b/playbooks/groups/packages.yml index 81e8997..a7f8505 100644 --- a/playbooks/groups/packages.yml +++ b/playbooks/groups/packages.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/pdc.yml b/playbooks/groups/pdc.yml index 49e0fe1..f57bed8 100644 --- a/playbooks/groups/pdc.yml +++ b/playbooks/groups/pdc.yml @@ -42,12 +42,10 @@ - role: openvpn/client when: env != "staging" - apache + - mod_wsgi - fedmsg/base - pdc/frontend - tasks: - - include: "{{ tasks }}/mod_wsgi.yml" - - name: stuff just for the backend nodes hosts: pdc-backend:pdc-backend-stg user: root diff --git a/playbooks/groups/pkgdb.yml b/playbooks/groups/pkgdb.yml index 95b70ff..9c3cc4d 100644 --- a/playbooks/groups/pkgdb.yml +++ b/playbooks/groups/pkgdb.yml @@ -25,12 +25,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/statscache.yml b/playbooks/groups/statscache.yml index 3d1cd1e..a0a61ad 100644 --- a/playbooks/groups/statscache.yml +++ b/playbooks/groups/statscache.yml @@ -44,13 +44,11 @@ roles: - apache + - mod_wsgi - role: openvpn/client when: env != "staging" - statscache/frontend - tasks: - - include: "{{ tasks }}/mod_wsgi.yml" - - name: Stuff just for the fedmsg backend hosts: statscache-backend:statscache-backend-stg user: root diff --git a/playbooks/groups/sundries.yml b/playbooks/groups/sundries.yml index c7e66c2..537694f 100644 --- a/playbooks/groups/sundries.yml +++ b/playbooks/groups/sundries.yml @@ -23,6 +23,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - geoip - geoip-city-wsgi/app - role: koji_reminder @@ -56,7 +57,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/tagger.yml b/playbooks/groups/tagger.yml index ab32b1c..f781868 100644 --- a/playbooks/groups/tagger.yml +++ b/playbooks/groups/tagger.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/zanata2fedmsg.yml b/playbooks/groups/zanata2fedmsg.yml index c23a9a2..0628d17 100644 --- a/playbooks/groups/zanata2fedmsg.yml +++ b/playbooks/groups/zanata2fedmsg.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/grafana.cloud.fedoraproject.org.yml b/playbooks/hosts/grafana.cloud.fedoraproject.org.yml index 799d110..1933031 100644 --- a/playbooks/hosts/grafana.cloud.fedoraproject.org.yml +++ b/playbooks/hosts/grafana.cloud.fedoraproject.org.yml @@ -24,6 +24,7 @@ - base - rkhunter - apache + - mod_wsgi #- graphite/graphite #- graphite/statsd #- graphite/fedmsg2statsd @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/graphite.fedorainfracloud.org.yml b/playbooks/hosts/graphite.fedorainfracloud.org.yml index c120980..d04bc38 100644 --- a/playbooks/hosts/graphite.fedorainfracloud.org.yml +++ b/playbooks/hosts/graphite.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - base - rkhunter - apache + - mod_wsgi - certbot - graphite/graphite - graphite/statsd @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/iddev.fedorainfracloud.org.yml b/playbooks/hosts/iddev.fedorainfracloud.org.yml index 54784d8..848a8c1 100644 --- a/playbooks/hosts/iddev.fedorainfracloud.org.yml +++ b/playbooks/hosts/iddev.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - sudo - hosts - apache + - mod_wsgi - base pre_tasks: @@ -33,7 +34,6 @@ - include: "{{ tasks }}/cloud_setup_basic.yml" - name: set hostname (required by some services, at least postfix need it) hostname: name="{{inventory_hostname}}" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/lists-dev.fedorainfracloud.org.yml b/playbooks/hosts/lists-dev.fedorainfracloud.org.yml index aa7d3c7..31185e2 100644 --- a/playbooks/hosts/lists-dev.fedorainfracloud.org.yml +++ b/playbooks/hosts/lists-dev.fedorainfracloud.org.yml @@ -33,13 +33,13 @@ - sudo - hosts - apache + - mod_wsgi - base tasks: - include: "{{ tasks }}/postfix_basic.yml" - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" # Basic Apache config - name: install mod_ssl diff --git a/playbooks/hosts/modernpaste.fedorainfracloud.org.yml b/playbooks/hosts/modernpaste.fedorainfracloud.org.yml index 996d764..7d07691 100644 --- a/playbooks/hosts/modernpaste.fedorainfracloud.org.yml +++ b/playbooks/hosts/modernpaste.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - sudo - hosts - apache + - mod_wsgi - base pre_tasks: @@ -33,4 +34,3 @@ - include: "{{ tasks }}/cloud_setup_basic.yml" - name: set hostname (required by some services, at least postfix need it) hostname: name="{{inventory_hostname}}" - - include: "{{ tasks }}/mod_wsgi.yml" diff --git a/roles/mod_wsgi/files/wsgi.conf b/roles/mod_wsgi/files/wsgi.conf new file mode 100644 index 0000000..6c32a15 --- /dev/null +++ b/roles/mod_wsgi/files/wsgi.conf @@ -0,0 +1,14 @@ +LoadModule wsgi_module modules/mod_wsgi.so + +# Some apps, notably anything that uses hg, need these off +WSGIRestrictStdin Off +WSGIRestrictStdout Off + +# Put the socket somewhere writable +WSGISocketPrefix run/wsgi + +# Do not Optimize without stripping docstrings +WSGIPythonOptimize 0 + +# Set WSGIApplicationGroup to global +WSGIApplicationGroup %{GLOBAL} diff --git a/roles/mod_wsgi/handlers/main.yml b/roles/mod_wsgi/handlers/main.yml new file mode 100644 index 0000000..f599732 --- /dev/null +++ b/roles/mod_wsgi/handlers/main.yml @@ -0,0 +1,2 @@ +- name: restart apache + command: /usr/local/bin/conditional-restart.sh httpd httpd diff --git a/roles/mod_wsgi/tasks/mod_wsgi.yml b/roles/mod_wsgi/tasks/mod_wsgi.yml new file mode 100644 index 0000000..06c8aa5 --- /dev/null +++ b/roles/mod_wsgi/tasks/mod_wsgi.yml @@ -0,0 +1,22 @@ +--- +# install mod_wsgi +- name: install mod_wsgi + yum: name=mod_wsgi state=present + tags: + - packages + when: ansible_distribution_major_version|int < 22 + +- name: install mod_wsgi + dnf: name=mod_wsgi state=present + tags: + - packages + when: ansible_distribution_major_version|int > 21 + +- name: wsgi.conf + copy: src="wsgi.conf" dest=/etc/httpd/conf.d/wsgi.conf + notify: + - restart apache + tags: + - config + + diff --git a/tasks/mod_wsgi.yml b/tasks/mod_wsgi.yml deleted file mode 100644 index c4d9deb..0000000 --- a/tasks/mod_wsgi.yml +++ /dev/null @@ -1,22 +0,0 @@ ---- -# install mod_wsgi -- name: install mod_wsgi - yum: name=mod_wsgi state=present - tags: - - packages - when: ansible_distribution_major_version|int < 22 - -- name: install mod_wsgi - dnf: name=mod_wsgi state=present - tags: - - packages - when: ansible_distribution_major_version|int > 21 - -- name: wsgi.conf - copy: src="{{ files }}/mod_wsgi/wsgi.conf" dest=/etc/httpd/conf.d/wsgi.conf - notify: - - restart apache - tags: - - config - - -- 1.8.3.1

2 4

[PATCH 1/3] Whitespace cleanup, make ansible-lint happy
by Michael Scherer 08 Aug '16

08 Aug '16

--- roles/dnf-automatic/tasks/main.yml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/roles/dnf-automatic/tasks/main.yml b/roles/dnf-automatic/tasks/main.yml index 80b8046..2a41f19 100644 --- a/roles/dnf-automatic/tasks/main.yml +++ b/roles/dnf-automatic/tasks/main.yml @@ -1,9 +1,9 @@ --- # -# This role adds dnf automatic package and configuration. -# We want this on any public facing Fedora installs so we -# can pick up security updates. +# This role adds dnf automatic package and configuration. +# We want this on any public facing Fedora installs so we +# can pick up security updates. # - name: install dnf-automatic -- 1.8.3.1

2 3

[PATCH] Simplify the task to install cronjob
by Michael Scherer 08 Aug '16

08 Aug '16

Giving directly the file to deploy and doing magic with the variable permit to have a clearer idea of what is deployed when reading the task for the first time --- roles/mdapi/tasks/main.yml | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/roles/mdapi/tasks/main.yml b/roles/mdapi/tasks/main.yml index d884654..ac4dacd 100644 --- a/roles/mdapi/tasks/main.yml +++ b/roles/mdapi/tasks/main.yml @@ -19,11 +19,12 @@ - name: Install the meta-data fetch cron job when: inventory_hostname.startswith(('mdapi01')) - template: src={{ item.file }} - dest={{ item.location }}/{{ item.file }} + template: + src: "{{ item | basename }}" + dest: "{{ item }}" with_items: - - { file: 'mdapi.cron', location: /etc/cron.d } - - { file: 'mdapi.cfg', location: /etc/mdapi } + - /etc/cron.d/mdapi.cron + - /etc/mdapi/mdapi.cfg tags: - mdapi - config -- 1.8.3.1

1 0

[PATCH 1/3] Whitespace cleanup, make ansible-lint happy
by Michael Scherer 08 Aug '16

08 Aug '16

--- roles/dnf-automatic/tasks/main.yml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/roles/dnf-automatic/tasks/main.yml b/roles/dnf-automatic/tasks/main.yml index 80b8046..2a41f19 100644 --- a/roles/dnf-automatic/tasks/main.yml +++ b/roles/dnf-automatic/tasks/main.yml @@ -1,9 +1,9 @@ --- # -# This role adds dnf automatic package and configuration. -# We want this on any public facing Fedora installs so we -# can pick up security updates. +# This role adds dnf automatic package and configuration. +# We want this on any public facing Fedora installs so we +# can pick up security updates. # - name: install dnf-automatic -- 1.8.3.1

1 2

[PATCH 1/2] Use the new pkg module, to avoid having 2 tasks
by Michael Scherer 06 Aug '16

06 Aug '16

--- roles/nfs/client/tasks/main.yml | 14 +++----------- 1 file changed, 3 insertions(+), 11 deletions(-) diff --git a/roles/nfs/client/tasks/main.yml b/roles/nfs/client/tasks/main.yml index 627fab2..58ee460 100644 --- a/roles/nfs/client/tasks/main.yml +++ b/roles/nfs/client/tasks/main.yml @@ -34,22 +34,14 @@ # Install needed packages # - name: Install needed nfs packages - yum: pkg={{ item }} state=present + pkg: + name: "{{ item }}" + state: present with_items: - nfs-utils - rpcbind tags: - nfs/client - when: ansible_distribution_major_version|int < 22 -# -- name: Install needed nfs packages - dnf: pkg={{ item }} state=present - with_items: - - nfs-utils - - rpcbind - tags: - - nfs/client - when: ansible_distribution_major_version|int > 21 - name: enable nfs-related services and run them (fedora20 only) service: name={{ item }} enabled=true state=started -- 1.8.3.1

1 1

[PATCH] Use a more concise form for include of playbook
by Michael Scherer 06 Aug '16

06 Aug '16

--- roles/osbs-atomic-reactor/tasks/main.yml | 9 +-------- 1 file changed, 1 insertion(+), 8 deletions(-) diff --git a/roles/osbs-atomic-reactor/tasks/main.yml b/roles/osbs-atomic-reactor/tasks/main.yml index fc28ff9..3b5cd32 100644 --- a/roles/osbs-atomic-reactor/tasks/main.yml +++ b/roles/osbs-atomic-reactor/tasks/main.yml @@ -1,9 +1,2 @@ --- -- include: source_pull.yml - when: atomic_reactor_source == 'pull' - -- include: source_git.yml - when: atomic_reactor_source == 'git' - -- include: source_rpm.yml - when: atomic_reactor_source == 'rpm' +- include: source_{{ atomic_reactor_source }}.yml -- 1.8.3.1

1 0

[PATCH 1/2] Use a more modern style for gluster/client yaml
by Michael Scherer 05 Aug '16

05 Aug '16

Use pkg rather than yum, for future proofing with dnf --- roles/gluster/client/tasks/main.yml | 25 +++++++++++++++++-------- 1 file changed, 17 insertions(+), 8 deletions(-) diff --git a/roles/gluster/client/tasks/main.yml b/roles/gluster/client/tasks/main.yml index 2ecc5cf..8db6025 100644 --- a/roles/gluster/client/tasks/main.yml +++ b/roles/gluster/client/tasks/main.yml @@ -1,24 +1,33 @@ --- - name: install needed packages - yum: pkg={{ item }} state=present + pkg: + name: "{{ item }}" + state: present with_items: - glusterfs-fuse tags: - packages - name: make the mountdir - file: state=directory path={{ mountdir }} owner={{ owner }} group={{ group }} + file: + state: directory + path: "{{ mountdir }}" + owner: "{{ owner }}" + group: "{{ group }}" - name: copy over the client config - template: src=client.config dest=/etc/glusterfs/glusterfs.{{name}}.vol mode=0640 + template: + src: client.config + dest: /etc/glusterfs/glusterfs.{{name}}.vol + mode: 0640 #notify: #- remount? no idea... - name: mount it up - mount: > - src=/etc/glusterfs/glusterfs.{{name}}.vol - state=mounted - fstype=glusterfs - name={{mountdir}} + mount: + src: /etc/glusterfs/glusterfs.{{name}}.vol + state: mounted + fstype: glusterfs + name: "{{mountdir}}" ignore_errors: True -- 1.8.3.1

1 1

[Flock16] [Transcription] Pagure: Past, Present and Future
by Justin W. Flory 04 Aug '16

04 Aug '16

https://flock2016.sched.org/event/6yp8/pagure-past-present-and-future Meeting ended Wed Aug 3 14:24:12 2016 UTC. Minutes: https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… Minutes (text): https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… Log: https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… * * * * * =============================================================================================== #fedora-flock-picasso: Pagure: Past, Present, and Future - Speaker: Pierre-Yves Chibon (pingou) =============================================================================================== Meeting started by jflory7 at 13:33:36 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… . Meeting summary --------------- * Introduction (jflory7, 13:33:43) * Talking about Pagure, open source git forge (jflory7, 13:33:54) * Background (jflory7, 13:34:00) * Fork, pull request, three repositories per project (sources, pull requests, tickets) (jflory7, 13:34:21) * New UI, new architecture, and lots of new features with recent growths (jflory7, 13:35:06) * Architecture (jflory7, 13:36:21) * Diagram on-screen of how all of Pagure architecture fits together (see slides / video feed later) (jflory7, 13:36:53) * EventSource server: If two people working on ticket / PR, one is making comment, new comment magically appears on other user's page (jflory7, 13:38:20) * Gitolite has always been a part of the project for managing user git repos and projects (jflory7, 13:39:56) * Features (jflory7, 13:39:59) * Doc hosting / repos (jflory7, 13:40:03) * To generate docs, you push source to the docs repo, view page, and updates quickly and instantly (jflory7, 13:41:59) * LINK: https://docs.pagure.org/pagure/ (jflory7, 13:42:16) * === Watch project (Gaurav Kumar) === (jflory7, 13:42:55) * Watch a project, get notifications as if you had commit rights (except on priv. tickets) (jflory7, 13:43:22) * === Roadmap === (jflory7, 13:43:55) * Migrating Trac features to Pagure was a major focus, like roadmaps (jflory7, 13:44:31) * === Customized PR page === (jflory7, 13:45:57) * You can customize the information displayed in pull requests (jflory7, 13:46:49) * Includes what branch and repo pull requests go into, add a note about contributing (e.g. "how to test your changes before submitting") (jflory7, 13:47:22) * === Issue templates === (jflory7, 13:48:10) * Different issue templates for different ticket types (jflory7, 13:49:24) * === Diff between x commits (Oliver Guitierrez) === (jflory7, 13:49:39) * LINK: https://pagure.io/pagure/c/5803a79..3c85bbc (jflory7, 13:50:08) * Q: "Can we compare against dates? e.g. Jan 1 and Mar 30?" (jflory7, 13:50:36) * A: Currently not, only two commits. Technically possible, no reason why not. Merge commits could affect whether this is accurate or not as well, e.g. if changes were made before date, but were merged in during that timeframe (jflory7, 13:52:07) * === Take issue (Ryan Lerch) === (jflory7, 13:52:43) * Before, if you wanted to take an issue, you needed to edit metadata, find your username, save metadata (jflory7, 13:53:11) * Now, you click the button in the issue and you will auto-assign it to yourself. No refresh necessary (jflory7, 13:53:28) * Q: "Right now, if you have page open for a long time, will it work?" (jflory7, 13:53:47) * A: Will work because connection never closes. Problem is that some endpoints is over cross-site scripting, other concerns as well were considered too. (jflory7, 13:54:50) * === Live completion (Eric Barbour) === (jflory7, 13:55:01) * Auto-completion for tagging username or IDs for tickets / PRs, e.g. @jflory7 or #17 (jflory7, 13:55:27) * === README file at creation (Ryan Lerch) === (jflory7, 13:56:08) * Most people used to git, not a problem, but more in mind for new users (jflory7, 13:56:18) * === Fake namespace === (jflory7, 13:57:00) * Want to have Pagure as front-end for dist-git (jflory7, 13:57:19) * Run x instances of Pagure for x instances of pkgdb, not effective solution when you can just run one. Won't be able to search between Pagures. (jflory7, 13:58:16) * Adding namespacing would break all previous projects and change all URLs for all projects (jflory7, 13:58:43) * Solution? Adding one slash to the end of a project configuration (jflory7, 13:59:48) * === New hooks === (jflory7, 14:02:54) * ReadTheDoc hook: Push to PAgure, update ReadTheDocs (jflory7, 14:03:14) * Block un-signed commits: Blocks PRs from being merged if they are unsigned with GPG (jflory7, 14:03:37) * Block non-fastforward commits: If you want to keep the log clean, keeps merge commits out and only relevant commits (can also specify which branch to have this apply to, e.g. `master`) (jflory7, 14:04:26) * === Better Pagure hook === (jflory7, 14:04:32) * Close ticket / PR via commit message (e.g. `git commit -s "close issue #10 close pull request #6"`) (jflory7, 14:05:11) * Future (jflory7, 14:05:42) * === Private repository (Farhaan) === (jflory7, 14:05:55) * === CI integration (Farhaan) === (jflory7, 14:07:11) * Pull requests can have flags to automatically build projects on other services, e.g. Jenkins (jflory7, 14:07:28) * Aimed for next release (jflory7, 14:07:32) * === Front-end for pkgs.fp.o (Vivek Anand) === (jflory7, 14:08:04) * LINK: http://pkgs.stg.fedoraproject.org/pagure/ (jflory7, 14:10:19) * Work in progress, but implementation is public, in staging (jflory7, 14:10:22) * Q: "Can I do stuff with this or will it break things?" (jflory7, 14:10:24) * A: Shouldn't break anything, but if it does, we need to look into it! (jflory7, 14:10:26) * === Mirror sources === (jflory7, 14:11:41) * Designed to be made so you can move things from Pagure instance to Pagure instance (jflory7, 14:11:52) * Maybe you have a private Pagure instance and want everyone to be on there, should be able to port all packages over to the other instance (jflory7, 14:12:26) * When you push to Pagure, it will do a git push to another git server (jflory7, 14:12:43) * Community (jflory7, 14:13:09) * 56 contributors, 33 contributors at 1.0, 2 GSoC students this year (Vivek Anand & Farhaan Bukhsh), 2 Red Hat interns (Eric Barbour and Simon) (jflory7, 14:13:51) * Top 10 contributors: pingou, ryanlerch, farhaanbukhsh, Johan, Clement, Vivek, Farhaan, Sayan, Lubomír, puiterwijk (jflory7, 14:14:50) * Being packaged in Debian (jflory7, 14:16:34) * Used outside our community (jflory7, 14:16:37) * LINK: https://git.48.io (jflory7, 14:16:41) * LINK: https://git.pignus.computer (jflory7, 14:16:44) * Evaluated by two start-ups (and a team at RackSpace!) (jflory7, 14:16:53) * Questions (jflory7, 14:17:36) * Q: "When is dist-git for Fedora going to be in prod?" - mattdm (jflory7, 14:17:57) * A: As soon as we support it! It just reached staging, not entirely deployed (jflory7, 14:19:23) * Q: "Is it designed in a way to work around problem by packaging dist-git into pagure.io?" - mhroncok (jflory7, 14:21:58) * A: Leverage pagure.io for pkg apps and relationship between fork and where it's coming from (jflory7, 14:22:09) Meeting ended at 14:24:12 UTC. Action Items ------------ Action Items, by person ----------------------- * **UNASSIGNED** * (none) People Present (lines said) --------------------------- * jflory7 (181) * zodbot (19) * jibecfed (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot -- Cheers, Justin W. Flory jflory7(a)gmail.com

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure August 2016