infrastructure August 2016

infrastructure@lists.fedoraproject.org

44 participants
44 discussions

Freeze break request: bodhi-backend03 changes
by Kevin Fenzi 12 Aug '16

12 Aug '16

Greetings. Fedora 24 alpha is running into some bugs because the updates-testing repo does not have any weak deps in it's repodata. This is because bodhi-backend01 is a rhel7 instance and it's rpm is too old to have them. So, I have created a bodhi-backend03 instance thats Fedora 24 and would like to try pushing the fedora-24-updates-testing updates (to start with) from there to see if it fixes the issue. The attached patch should fix the bodhi roles to call 'package' instead of yum module (so they work on either rhel7 or fedora24) and add in a bodhi2 f24 repo to install from. +1s? kevin

3 6

Freeze break request: dhcp changes on noc01
by Kevin Fenzi 12 Aug '16

12 Aug '16

Greetings. tflink pushed this change right around freeze, but it's not yet active on noc01 (needs a playbook run). +1s to just push it out? It shouldn't affect anything else. kevin -- TASK [dhcp_server : setup dhcpd.conf dest=/etc/dhcp/dhcpd.conf, src=dhcpd.conf.{{ inventory_hostname }}, mode= 644] *** Friday 12 August 2016 18:54:31 +0000 (0:00:00.432) 0:04:28.954 ********* skipping: [noc02.fedoraproject.org] changed: [noc01.phx2.fedoraproject.org] --- before: /etc/dhcp/dhcpd.conf +++ after: /srv/web/infra/ansible/roles/dhcp_server/files/dhcpd.conf.noc01.phx2.fedoraproject.org @@ -1928,6 +1928,15 @@ fixed-address 10.5.131.22; } + host beaker-client01 { + hardware ethernet 44:A8:42:03:49:CB; + fixed-address 10.5.131.31; + option host-name "beaker-client01"; + option ntp-servers 66.187.233.4, 192.43.244.18, 128.118.25.5, 204.152.184.72; + next-server 10.5.124.228; + filename "pxelinux.0"; + } + host beaker-client02 { hardware ethernet 44:A8:42:03:49:CB; fixed-address 10.5.131.32;

3 2

Freeze break request: re-add ambassadors wiki updater script
by Kevin Fenzi 11 Aug '16

11 Aug '16

Greetings. Somehow we lost the script that was updating https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification in the move from puppet to ansible. The following commit re-adds it. This would also need an ansible run on sundries playbook. Impact should be low, just another cron and script on sundries01 and one new package added (python-mwclient). +1s? kevin -- From 07580e4585e9a36642b97b0fb849e16efeee3054 Mon Sep 17 00:00:00 2001 From: Kevin Fenzi <kevin(a)scrye.com> Date: Thu, 11 Aug 2016 19:58:45 +0000 Subject: [PATCH] Add back the script that updates the ambassadors membership wiki page. Was lost in the puppet->ansible move. --- .../build/files/membership-mwclient-build | 1 + roles/membership-map/build/tasks/main.yml | 28 ++ .../build/templates/membership-mwclient.py | 307 +++++++++++++++++++++ 3 files changed, 336 insertions(+) create mode 100644 roles/membership-map/build/files/membership-mwclient-build create mode 100644 roles/membership-map/build/templates/membership-mwclient.py diff --git a/roles/membership-map/build/files/membership-mwclient-build b/roles/membership-map/build/files/membership-mwclient-build new file mode 100644 index 0000000..6295923 --- /dev/null +++ b/roles/membership-map/build/files/membership-mwclient-build @@ -0,0 +1 @@ +55 5 * * * root /usr/local/bin/membership-mwclient.py > /dev/null diff --git a/roles/membership-map/build/tasks/main.yml b/roles/membership-map/build/tasks/main.yml index f9bffcf..cfdb2c3 100644 --- a/roles/membership-map/build/tasks/main.yml +++ b/roles/membership-map/build/tasks/main.yml @@ -1,3 +1,7 @@ +# +# This first part is building the maps for: +# http://fedoraproject.org/membership-map/ambassadors.html +# - file: dest=/srv/web/membership-map state=directory - template: > @@ -16,3 +20,27 @@ - synchronize: > src=www/ dest=/srv/web/membership-map/ + +# +# This part updates the wiki page at: +# https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification +# + +- yum: state=present name=python-mwclient + tags: + - membership-map + - membership-map/build + +- template: > + src=membership-mwclient.py dest=/usr/local/bin/membership-mwclient.py + owner=root group=root mode=0755 + tags: + - membership-map + - membership-map/build + +- copy: > + src=membership-mwclient-build dest=/etc/cron.d/membership-mwclient-build + owner=root group=root mode=0644 + tags: + - membership-map + - membership-map/build diff --git a/roles/membership-map/build/templates/membership-mwclient.py b/roles/membership-map/build/templates/membership-mwclient.py new file mode 100644 index 0000000..ff74498 --- /dev/null +++ b/roles/membership-map/build/templates/membership-mwclient.py @@ -0,0 +1,307 @@ +#!/usr/bin/python +''' This script is for generating output for +https://fedoraproject.org/wiki/Ambassadors/MembershipService/Verification.''' +# +# Copyright (C) 2010, Susmit Shannigrahi, Susmit AT fedoraproject DOT org +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +import getpass +from fedora.client.fas2 import AccountSystem +import datetime +import GeoIP +from kitchen.text.converters import to_bytes +import mwclient + +#from maxmind array +#changes are: 'RS': 'EU', 'ME': 'EU', 'AU': 'AS', 'NZ': 'AS' +#https://fedorahosted.org/fedora-infrastructure/ticket/2921 +#changes are: 'IL': 'EU', 'KG': 'EU', 'LB': 'EU', 'SA': 'EU', 'AE': 'EU' + + +CONTINENT_MAP = {'AP': 'AS', 'EU': 'EU', 'AD': 'EU', 'AE': 'EU', 'AF': 'AS', \ + 'AG': 'SA', 'AI': 'SA', 'AL': 'EU', 'AM': 'AS', 'AN': 'SA', 'AO': 'AF', \ +'AQ': 'AN', 'AR': 'SA', 'AS': 'OC', 'AT': 'EU', 'AU': 'OC', 'AW': 'SA', \ +'AX': 'EU', 'AZ': 'AS', 'BA': 'EU', 'BB': 'SA', 'BD': 'AS', 'BE': 'EU', \ +'BF': 'AF', 'BG': 'EU', 'BH': 'AS', 'BI': 'AF', 'BJ': 'AF', 'BM': 'SA', \ +'BN': 'AS', 'BO': 'SA', 'BR': 'SA', 'BS': 'SA', 'BT': 'AS', 'BV': 'AF', \ +'BW': 'AF', 'BY': 'EU', 'BZ': 'SA', 'CA': 'NA', 'CC': 'AS', 'CD': 'AF', \ +'CF': 'AF', 'CG': 'AF', 'CH': 'EU', 'CI': 'AF', 'CK': 'OC', 'CL': 'SA', \ +'CM': 'AF', 'CN': 'AS', 'CO': 'SA', 'CR': 'SA', 'CU': 'SA', 'CV': 'AF', \ +'CX': 'AS', 'CY': 'AS', 'CZ': 'EU', 'DE': 'EU', 'DJ': 'AF', 'DK': 'EU', \ +'DM': 'SA', 'DO': 'SA', 'DZ': 'AF', 'EC': 'SA', 'EE': 'EU', 'EG': 'AF', \ +'EH': 'AF', 'ER': 'AF', 'ES': 'EU', 'ET': 'AF', 'FI': 'EU', 'FJ': 'OC', \ +'FK': 'SA', 'FM': 'OC', 'FO': 'EU', 'FR': 'EU', 'FX': 'EU', 'GA': 'AF', \ +'GB': 'EU', 'GD': 'SA', 'GE': 'AS', 'GF': 'SA', 'GG': 'EU', 'GH': 'AF', \ +'GI': 'EU', 'GL': 'SA', 'GM': 'AF', 'GN': 'AF', 'GP': 'SA', 'GQ': 'AF', \ +'GR': 'EU', 'GS': 'SA', 'GT': 'SA', 'GU': 'OC', 'GW': 'AF', 'GY': 'SA', \ +'HK': 'AS', 'HM': 'AF', 'HN': 'SA', 'HR': 'EU', 'HT': 'SA', 'HU': 'EU', \ +'ID': 'AS', 'IE': 'EU', 'IL': 'EU', 'IM': 'EU', 'IN': 'AS', 'IO': 'AS', \ +'IQ': 'AS', 'IR': 'AS', 'IS': 'EU', 'IT': 'EU', 'JE': 'EU', 'JM': 'SA', \ +'JO': 'AS', 'JP': 'AS', 'KE': 'AF', 'KG': 'EU', 'KH': 'AS', 'KI': 'OC', \ +'KM': 'AF', 'KN': 'SA', 'KP': 'AS', 'KR': 'AS', 'KW': 'AS', 'KY': 'SA', \ +'KZ': 'AS', 'LA': 'AS', 'LB': 'EU', 'LC': 'SA', 'LI': 'EU', 'LK': 'AS', \ +'LR': 'AF', 'LS': 'AF', 'LT': 'EU', 'LU': 'EU', 'LV': 'EU', 'LY': 'AF', \ +'MA': 'AF', 'MC': 'EU', 'MD': 'EU', 'MG': 'AF', 'MH': 'OC', 'MK': 'EU', \ +'ML': 'AF', 'MM': 'AS', 'MN': 'AS', 'MO': 'AS', 'MP': 'OC', 'MQ': 'SA', \ +'MR': 'AF', 'MS': 'SA', 'MT': 'EU', 'MU': 'AF', 'MV': 'AS', 'MW': 'AF', \ +'MX': 'NA', 'MY': 'AS', 'MZ': 'AF', 'NA': 'AF', 'NC': 'OC', 'NE': 'AF', \ +'NF': 'OC', 'NG': 'AF', 'NI': 'SA', 'NL': 'EU', 'NO': 'EU', 'NP': 'AS', \ +'NR': 'OC', 'NU': 'OC', 'NZ': 'AS', 'OM': 'AS', 'PA': 'SA', 'PE': 'SA', \ +'PF': 'OC', 'PG': 'OC', 'PH': 'AS', 'PK': 'AS', 'PL': 'EU', 'PM': 'SA', \ +'PN': 'OC', 'PR': 'SA', 'PS': 'AS', 'PT': 'EU', 'PW': 'OC', 'PY': 'SA', \ +'QA': 'AS', 'RE': 'AF', 'RO': 'EU', 'RU': 'EU', 'RW': 'AF', 'SA': 'AS', \ +'SB': 'OC', 'SC': 'AF', 'SD': 'AF', 'SE': 'EU', 'SG': 'AS', 'SH': 'AF', \ +'SI': 'EU', 'SJ': 'EU', 'SK': 'EU', 'SL': 'AF', 'SM': 'EU', 'SN': 'AF', \ +'SO': 'AF', 'SR': 'SA', 'ST': 'AF', 'SV': 'SA', 'SY': 'AS', 'SZ': 'AF', \ +'TC': 'SA', 'TD': 'AF', 'TF': 'AF', 'TG': 'AF', 'TH': 'AS', 'TJ': 'AS', \ +'TK': 'OC', 'TM': 'AS', 'TN': 'AF', 'TO': 'OC', 'TP': 'AS', 'TR': 'EU', \ +'TT': 'SA', 'TV': 'OC', 'TW': 'AS', 'TZ': 'AF', 'UA': 'EU', 'UG': 'AF', \ +'UM': 'OC', 'US': 'NA', 'UY': 'SA', 'UZ': 'AS', 'VA': 'EU', 'VC': 'SA', \ +'VE': 'SA', 'VG': 'SA', 'VI': 'SA', 'VN': 'AS', 'VU': 'OC', 'WF': 'OC', \ +'WS': 'OC', 'YE': 'AS', 'YT': 'AF', 'YU': 'EU', 'ZA': 'AF', 'ZM': 'AF', \ +'ZR': 'AF', 'ZW': 'AF', 'RS': 'EU', 'ME': 'EU', 'AU': 'AS'} + + +def calc_list(): + '''Calculate the contributors list categorised by country''' + output = [] + people_list = [] + country_list = [] + inactive_list = [] + flag = 0 + final_output_list_as = [] + final_output_list_eu = [] + final_output_list_na = [] + final_output_list_latam = [] + final_output_list_africa = [] + final_output_list_unknown = [] + full_name = {'AS' : 'APAC', 'NA' : 'North America', \ +'SA' : 'LATAM', 'AF' : 'Africa', 'EU' : 'EMEA', 'Unknown' : 'Unknown'} + + + group_name = 'ambassadors' + username = 'fedoradummy' + password = '{{ fedoraDummyUserPassword }}' +# username = raw_input('Username: ').strip() +# password = getpass.getpass('Password: ') +{% if env == "staging" %} + base_url = 'https://admin.stg.fedoraproject.org/accounts/' +{% else %} + base_url = 'https://admin.fedoraproject.org/accounts/' +{% endif %} + + fas = AccountSystem(base_url=base_url, username=username, password=password) + + # Call fedoraproject API with mwclient +{% if env == "staging" %} + site = mwclient.Site(('https', 'stg.fedoraproject.org'), path='/w/') +{% else %} + site = mwclient.Site(('https', 'fedoraproject.org'), path='/w/') +{% endif %} + + site.login(username, password) # Optional + # Specify which page to edit + page = site.Pages['Ambassadors/MembershipService/Verification2'] + + #delete all the erswhile contents. + page.text() + blank_page = "updating..." + page.save(blank_page) + + print 'This takes loooooong time to execute...' + + #get all data from a group + group_people = fas.group_members(group_name) + #make a list of usernames of a group + for item in group_people: + people_list.append(item['username']) + + # get the country list from GeoIP + countries = dict(GeoIP.country_names.items()) + + # Get a dictinary of all people in FAS + data = fas.people_by_key(key='id', search=u'*', \ +fields=['human_name', 'username', 'email', 'status', 'country_code']) + + for person in people_list: +# break + for item in data.values(): + user_name = item['username'] + human_name = item['human_name'] + country_code = item['country_code'] + status = item['status'] + email = item['username'] + '@fedoraproject.org' + + + + if person == user_name: + if status == 'inactive': + inactive_list.append(user_name) + #print 'match' + elif status == 'active': #filter out all inactive accounts + if country_code is None or country_code == 'O1' \ +or country_code == ' ': + continent_code = 'Unknown' + else: + continent_code = CONTINENT_MAP[country_code] + + #different values for blank or non-blank fields are + #_____________________________________________________# + # Country Code || Human Name || Number of tickets|| # + #_____________________________________________________# + # None || None/Name || 0/n # + # ' ' || None/Name || # + # 'IN','FR' etc.|| None/Name || # + #_____________________________________________________# + + if country_code is None: + if human_name is None: + flag = 1 + else: + flag = 2 + elif country_code == ' ': + if human_name is None: + flag = 1 + else: + flag = 2 + + else: #if there is a country code available + country = countries[country_code] + if human_name is None: + flag = 3 + else: + flag = 4 + #check flag to decide o/p + if flag == 1: + entry = [user_name, user_name, 'Unknown', email, \ +'Unknown'] + output.append(entry) + elif flag == 2: + entry = [user_name, human_name, 'Unknown', email, \ +'Unknown'] + output.append(entry) + elif flag == 3: + entry = [user_name, user_name, country, email, \ +continent_code] + output.append(entry) + else: + entry = [user_name, human_name, country, email, \ +continent_code] + output.append(entry) + +# Now we have a output list like +#[['rdsharma4u', 'Ravi Datta Sharma','India','rdsharma4u(a)gmail.com','1','AS'], +#['red', 'Sandro Mathys', 'Switzerland', 'sm(a)sandro-mathys.ch', '10', 'EU']] + + + + for item in output: + #break + continent_code = item[4] + if continent_code == 'AS' or continent_code == 'AU': + final_output_list_as.append(item) + elif continent_code == 'NA': + final_output_list_na.append(item) + elif continent_code == 'SA': + final_output_list_latam.append(item) + elif continent_code == 'EU': + final_output_list_eu.append(item) + elif continent_code == 'AF': + final_output_list_africa.append(item) + elif continent_code == 'Unknown': + final_output_list_unknown.append(item) + # sort the list according to countries + + final_string = '' + for final_output_list in [final_output_list_as, final_output_list_africa, \ +final_output_list_na, final_output_list_latam, final_output_list_eu, \ +final_output_list_unknown]: + country_list = [] + #print final_output_list + + # print the full continent name from entry zero of list + try: + continent_code = final_output_list[0][4] + full_cont_name = full_name[continent_code] + full_cont_name = "<h3> %s (%s) </h3>" \ +% (full_cont_name, len(final_output_list)) + + final_string = final_string + full_cont_name + #print final_string + for item in final_output_list: + country = item[2] + if country_list.count(country) == 0: + country_list.append(country) + country_list.sort() + + except IndexError: + pass + + + #print country_list + final_output_country_list = \ +[[]*len(country_list) for i in range(len(country_list))] + for item in final_output_list: + # find the index of this entry (country) from county_list + index = country_list.index(item[2]) + final_output_country_list[index].append(item) + #print final_output_country_list + + + + + #final_string = '' + + for item in final_output_country_list: + #reverse mapping to print the country + pos = final_output_country_list.index(item) + num = len(item) #number of ambassador in a country. + + cnt_lst = "<h4> %s (%s) </h4>" % (country_list[pos], num) + # add country and table formatting to string. + final_string = final_string + cnt_lst + '<table><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Index</th><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Name</th><th style="color: white; background-color: #3074c2; font-weight: bold" align="justified">Email</th>' + + index = 0 + for entries in item: + #print entries + #break + index = index + 1 + user_name = entries[0] + human_name = entries[1] + email = user_name + ' AT fedoraproject DOT org' + + #add detals. + final = "<tr><td>%s</td><td> [[User:%s| %s]]</td><td>%s</td></tr>" % (to_bytes(index), to_bytes(user_name), to_bytes(human_name), to_bytes(email)) + + final_string = final_string + final + final_string = final_string + '</table>' + + time = datetime.datetime.utcnow() + page.text() + page.save(final_string, summary = time) + + + note = "{{admon/note | Last Updated : %s UTC. %s active contributors \ +listed here against %s total.}}" % (time, len(output), len(people_list)) + page = site.Pages['Ambassadors/MembershipService/VerificationStats'] + page.text() + page.save(note, summary = time) + + page = site.Pages['Ambassadors/MembershipService/Inactives'] + page.text() + page.save(inactive_list, summary = time) + +if __name__ == "__main__": + calc_list() -- 1.8.3.1

3 2

Plan for tomorrow's Fedora Infrastructure meeting - 2016-08-11
by Kevin Fenzi 11 Aug '16

11 Aug '16

The infrastructure team will be having it's weekly meeting tomorrow, 2016-08-11 at 18:00 UTC in #fedora-meeting on the freenode network. We have a gobby document (see: https://fedoraproject.org/wiki/Gobby ) fedora-infrastructure-meeting-next is the document. Please try and review and edit that document before the meeting and we will use it to have our agenda of things to discuss. A copy as of today is included in this email. If you have something to discuss, add the topic to the discussion area with your name. If you would like to teach other folks about some application or setup in our infrastructure, please add that topic and your name to the learn about section. kevin -- = Introduction = This shared document is for the next fedora infrastructure meeting. We will use it over the week before the meeting to gather status and info and discussion items and so forth, then use it in the irc meeting to transfer information to the meetbot logs. = Meeting start stuff = #startmeeting Infrastructure (2016-08-11) #meetingname infrastructure #topic aloha #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson #topic New folks introductions = Status / information / Trivia / Announcements = (We put things here we want others on the team to know, but don't need to discuss) (Please use #info <the thing> - your name) #topic announcements and information #info flock 2016 is over. Lots of blogs and soon videos to recap - everyone #info Fedora 25 Alpha Freeze has started - kevin #info nagios is all green for freeze - kevin/smooge/patrick #info Aug apprentice email went out (a bit late), reply by friday - kevin #info virthost-comm02 has been reinstalled with rhel7 - kevin #info rawhide/branched composers are now Fedora 24 - kevin #info = Things we should discuss = We use this section to bring up discussion topics. Things we want to talk about as a group and come up with some consensus or decision or just brainstorm a problem or issue. If there are none of these we skip this section. (Use #topic your discussion topic - your username) #topic flock workshop followup - kevin = Apprentice office hours = #topic Apprentice Open office hours Here we will discuss any apprentice questions, try and match up people looking for things to do with things to do, progress, testing anything like that. = Learn about some application or setup in infrastructure = (This section, each week we get 1 person to talk about an application or setup that we have. Just going over what it is, how to contribute, ideas for improvement, etc. Whoever would like to do this, just add the info in this section. In the event we don't find someone to teach about something, we skip this section and just move on to open floor.) #topic Learn about: = Meeting end stuff = #topic Open Floor #endmeeting

1 0

freeze break compose boxes
by Dennis Gilmore 10 Aug '16

10 Aug '16

We need to get a new pungi and python-productmd to fix some bugs in the compose process. can I get some +1's please Dennis

3 4

Flock discussions recap/request for input
by Kevin Fenzi 10 Aug '16

10 Aug '16

Greetings. At the recent flock conference Infrastructure workshop, we had a nice lively discussion on a number of items. However, as is normal, we don't want to make decisions about things without being open and allowing input from everyone, including those that couldn't be at flock. So, I thought I would write up what we talked about and the consensus we came up with and ask for any more input from this list before we start implementing things. It's possible there's something we didn't think about or that needs more discussion, so do feel free to reply to this email with any parts you want to comment on. * Containers in Fedora Infrastructure: * We want to look at moving things that make sense to containers. * A good initial candidate is the mirrorlist servers. * Would use the existing OSBS build system to build them. * Would run on proxies. * Would have haproxy list their socket as primary and old mirrorlists as secondary. * The container would have mirrorlist-server wsgi in it along with the pkl updated hourly. * Could allow us to spin up more as needed, but also should allow faster answers from proxies as they don't have to depend on or query over the vpn. * Contributor resources in the fedorainfracloud * Once our cloud is upgraded, we can use ipsilon to let users login to the cloud and spin up instances for Fedora related needs. * Outgoing restrictions would be added on port 25 and the like * To start with users would only get 1 external floating ip. * Initial rollout would enable qa and packager groups, need to see if docs and i18n or other groups would have a use for it. * would note that we can terminate any instance for any reason. * Patrick would write some scripting to notify users after some time and terminate if we didn't get an answer back. * Long term instances should be moved to persistent infra playbooks. * Build setup and requirements for infrastructure applications. * Will get releng to set us up some side tags that we can build from src.rpm in. * all prod builds to be done in koji. * Up to maintainers what priority they place on getting into EPEL/Fedora. Encouraged for many reasons. * FAS3 status * Was running in staging, but we disabled for now until we can finish a security audit. * Need to get python-fedora changes lined up and ready/pushed out. * Need to get fas3 fas_client packaged and ready to go. * Need more testing in staging. * Hopefully move production over after f25 is out. * Fedora Infrastructure support setup * Talked about on the list a fair bit. * Support can be determined by looking at the domain: fedoraproject.org - full 24x7 support, monitoring, uses RFR stg.fedoraproject.org - 8x5 support, monitoring fedoracommunity.org - some support, monitoring, uses simple RFR fedorainfracloud.org - unsupported, apps run by contributors * Fedora CA and cert infrastructure. * Current CA expires in 2018. * Plans being worked on now to back fas3 with freeipa so we could move to kerberos tickets for koji then * Need to figure out what would need to happen to sigul for that. * Wait and see pending freeipa/fas3 integration. * koji alternative arch proposals (on devel list, fesco ticket) * Not too much infrastructure work here. * will need to increase storage for primary koji, but can regain from secondaries once their last releases go end of life. Thats all I had notes on from the workshop, but there may well have been other items, please do chime in with them if you think of anything, or have any thoughts on the above. kevin

3 3

Freeze Break Request (Retroactive): Adding new staging database host for testing in qa
by Tim Flink 10 Aug '16

10 Aug '16

I completely forgot that we were in Alpha freeze earlier today and made some changes without requesting a freeze break. The changes shouldn't impact production in any meaningful way but I can back all the changes out if need be. In summary, I did the following: - created new dns entries for db-qa-stg01.qa - added a new db-qa-stg01.qa host to inventory - changed the postgres_server role to support dnf for f22+ - added the new db-qa-stg01.qa host to the postgres-server playbook I've attached a diff to this email for review. Tim

2 3

Re: 'Meeting Agenda Item: Introduction Marc'
by Marc Bagatela 09 Aug '16

09 Aug '16

employment in the furture On Tue, Aug 9, 2016 at 2:34 PM, Marc Bagatela <mbphilly84(a)gmail.com> wrote: > Hi everyone My name is Marc > IRC: marc84 > I can write Basic bash script but I willing to learn other programming > language like python and also want to learn about web application. I have > LPIC-1 certification and I want to improve my current linux administrator > skills. I also have Linux User groups(Linux, Linux(tech support) & gentoo > linux) on facebook and I also attend fosscon. > > What i want to learn? > I want to know everything what infrastructure team and system > administrator what they do. I like to learn new application and programming > skills that will help me become a linux administrator and also help me get >

1 0

'Meeting Agenda Item: Introduction Marc'
by Marc Bagatela 09 Aug '16

09 Aug '16

Hi everyone My name is Marc IRC: marc84 I can write Basic bash script but I willing to learn other programming language like python and also want to learn about web application. I have LPIC-1 certification and I want to improve my current linux administrator skills. I also have Linux User groups(Linux, Linux(tech support) & gentoo linux) on facebook and I also attend fosscon. What i want to learn? I want to know everything what infrastructure team and system administrator what they do. I like to learn new application and programming skills that will help me become a linux administrator and also help me get --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Builds from git repo with unpacked sources
by Michal Sekletar 09 Aug '16

09 Aug '16

Hello everyone, this is my first post to Fedora Infrastructure list, allow me to quickly introduce myself. My name is Michal Sekletar and I work for Red Hat. I co-maintain systemd in both Fedora and RHEL. Also I am Fedora user and contributor for more than 5 years now. Some of you probably know that Red Hat's internal infrastructure (dist-git and build system) has a lot in common with what is available to Fedora packagers. Recently, internally they introduced very nice feature that might be also useful to Fedora packagers. It is the ability to build packages from exploded sources. Packager no longer uploads tarball to lookaside cache and maintains patches in dist-git, but points rhpkg (internal equivalent of fedpkg) to git repo that contains exploded sources with downstream patches applied on top. This allows for easy cherry-picking of patches between branches and a ton of other nice features that make maintainer's life easier. I briefly talked about this with Ralph at Flock. He suggested that I send an email to this list where we can start the discussion if this is something we want in Fedora, and in case yes, how to get there. Cheers, Michal

4 5

unable to login to ask.fedoraproject.org
by Morgan Read 08 Aug '16

08 Aug '16

Hello folk I'm trying to post to: https://ask.fedoraproject.org/en/question/90082/fedora-24-doesnt-do-anythin… I write my post and click the login/signup button I'm referred to: https://ask.fedoraproject.org/en/account/signin/ Where I click on the 'fedora' button I'm referred to: https://id.fedoraproject.org/login/fas?ipsilon_transaction_id=bc5d2be8-f337… Where I enter my credentials and click the login button I'm referred to: https://ask.fedoraproject.org/en/account/signin/complete/?next=%2F&janrain_… entity%2Clp.is_member%2Cmode%2Cns%2Cns.cla%2Cns.lp%2Cns.sreg%2Cop_endpoint%2Cresponse_nonce%2Creturn_to%2Csigned%2Csreg.email%2Csreg.nickname&openid.sreg.email=mstuff%40read.org.nz&openid.sreg.nickname=mread Where my 'Screen Name' is prepopulated with 'mread' (my FAS username), and; My 'Email Address' is prepopulated with 'mstuff(a)read.org.nz' And, I click the 'signup' button (Why do I have to 'signup' and not 'signin' when the top of the page says 'please sign in'?) And, I'm referred back to the same page with the announcement in RED: 'this email is already used by someone else, please choose another' Please can someone direct me out of this mindless loop so that I can post to the ask forum please

2 1

[PATCH 1/4] Move mod_wsgi to a role rather than a included tasks
by Michael Scherer 08 Aug '16

08 Aug '16

--- files/mod_wsgi/wsgi.conf | 14 -------------- playbooks/groups/ask.yml | 2 +- playbooks/groups/autocloud-web.yml | 2 +- playbooks/groups/badges-web.yml | 2 +- playbooks/groups/basset.yml | 2 +- playbooks/groups/blockerbugs.yml | 2 +- playbooks/groups/bodhi2.yml | 2 +- playbooks/groups/datagrepper.yml | 2 +- playbooks/groups/elections.yml | 2 +- playbooks/groups/fas.yml | 2 +- playbooks/groups/fas3.yml | 2 +- playbooks/groups/fedocal.yml | 2 +- playbooks/groups/github2fedmsg.yml | 2 +- playbooks/groups/ipa.yml | 2 +- playbooks/groups/ipsilon.yml | 2 +- playbooks/groups/kerneltest.yml | 2 +- playbooks/groups/koschei-web.yml | 2 +- playbooks/groups/mailman.yml | 2 +- playbooks/groups/mdapi.yml | 2 +- playbooks/groups/mirrorlist2.yml | 2 +- playbooks/groups/noc.yml | 2 +- playbooks/groups/notifs-web.yml | 2 +- playbooks/groups/nuancier.yml | 2 +- playbooks/groups/packages.yml | 2 +- playbooks/groups/pdc.yml | 4 +--- playbooks/groups/pkgdb.yml | 2 +- playbooks/groups/statscache.yml | 4 +--- playbooks/groups/sundries.yml | 2 +- playbooks/groups/tagger.yml | 2 +- playbooks/groups/zanata2fedmsg.yml | 2 +- .../hosts/grafana.cloud.fedoraproject.org.yml | 2 +- playbooks/hosts/graphite.fedorainfracloud.org.yml | 2 +- playbooks/hosts/iddev.fedorainfracloud.org.yml | 2 +- playbooks/hosts/lists-dev.fedorainfracloud.org.yml | 2 +- .../hosts/modernpaste.fedorainfracloud.org.yml | 2 +- roles/mod_wsgi/files/wsgi.conf | 14 ++++++++++++++ roles/mod_wsgi/handlers/main.yml | 2 ++ roles/mod_wsgi/tasks/mod_wsgi.yml | 22 ++++++++++++++++++++++ tasks/mod_wsgi.yml | 22 ---------------------- 39 files changed, 72 insertions(+), 74 deletions(-) delete mode 100644 files/mod_wsgi/wsgi.conf create mode 100644 roles/mod_wsgi/files/wsgi.conf create mode 100644 roles/mod_wsgi/handlers/main.yml create mode 100644 roles/mod_wsgi/tasks/mod_wsgi.yml delete mode 100644 tasks/mod_wsgi.yml diff --git a/files/mod_wsgi/wsgi.conf b/files/mod_wsgi/wsgi.conf deleted file mode 100644 index 6c32a15..0000000 --- a/files/mod_wsgi/wsgi.conf +++ /dev/null @@ -1,14 +0,0 @@ -LoadModule wsgi_module modules/mod_wsgi.so - -# Some apps, notably anything that uses hg, need these off -WSGIRestrictStdin Off -WSGIRestrictStdout Off - -# Put the socket somewhere writable -WSGISocketPrefix run/wsgi - -# Do not Optimize without stripping docstrings -WSGIPythonOptimize 0 - -# Set WSGIApplicationGroup to global -WSGIApplicationGroup %{GLOBAL} diff --git a/playbooks/groups/ask.yml b/playbooks/groups/ask.yml index e52b1fb..574e309 100644 --- a/playbooks/groups/ask.yml +++ b/playbooks/groups/ask.yml @@ -18,6 +18,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - ask - fedmsg/base - rsyncd @@ -29,7 +30,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/autocloud-web.yml b/playbooks/groups/autocloud-web.yml index 52c5ac4..47ec534 100644 --- a/playbooks/groups/autocloud-web.yml +++ b/playbooks/groups/autocloud-web.yml @@ -21,6 +21,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - fedmsg/base - sudo - role: openvpn/client @@ -29,7 +30,6 @@ tasks: - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/badges-web.yml b/playbooks/groups/badges-web.yml index cff2680..3f53cd9 100644 --- a/playbooks/groups/badges-web.yml +++ b/playbooks/groups/badges-web.yml @@ -29,6 +29,7 @@ - sudo - { role: openvpn/client, when: env != "staging" } + - mod_wsgi - role: collectd/web-service site: frontpage url: "http://localhost/" @@ -42,7 +43,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/basset.yml b/playbooks/groups/basset.yml index 1af41a4..3ee7b82 100644 --- a/playbooks/groups/basset.yml +++ b/playbooks/groups/basset.yml @@ -26,6 +26,7 @@ - mongodb - rabbitmq - apache + - mod_wsgi - basset/frontend - basset/worker @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/blockerbugs.yml b/playbooks/groups/blockerbugs.yml index 27d4b16..113eda6 100644 --- a/playbooks/groups/blockerbugs.yml +++ b/playbooks/groups/blockerbugs.yml @@ -23,13 +23,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - blockerbugs tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/bodhi2.yml b/playbooks/groups/bodhi2.yml index 0a12c32..df9fac2 100644 --- a/playbooks/groups/bodhi2.yml +++ b/playbooks/groups/bodhi2.yml @@ -22,6 +22,7 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - { role: bodhi2/base, when: "inventory_hostname.startswith('bodhi0')" } - { role: fedmsg/base, when: "inventory_hostname.startswith('bodhi0')" } @@ -29,7 +30,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/datagrepper.yml b/playbooks/groups/datagrepper.yml index 9e343c0..c6eeaa1 100644 --- a/playbooks/groups/datagrepper.yml +++ b/playbooks/groups/datagrepper.yml @@ -25,12 +25,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/elections.yml b/playbooks/groups/elections.yml index 756fc37..afdc6a2 100644 --- a/playbooks/groups/elections.yml +++ b/playbooks/groups/elections.yml @@ -21,13 +21,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - collectd/base tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fas.yml b/playbooks/groups/fas.yml index bff9deb..3243a22 100644 --- a/playbooks/groups/fas.yml +++ b/playbooks/groups/fas.yml @@ -22,6 +22,7 @@ - rsyncd - memcached - apache + - mod_wsgi - fas_server - fedmsg/base - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fas3.yml b/playbooks/groups/fas3.yml index 3c93166..021b492 100644 --- a/playbooks/groups/fas3.yml +++ b/playbooks/groups/fas3.yml @@ -22,6 +22,7 @@ - rsyncd - memcached - apache + - mod_wsgi - fas3_server - fedmsg/base - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/fedocal.yml b/playbooks/groups/fedocal.yml index 3bee8ea..ec2989b 100644 --- a/playbooks/groups/fedocal.yml +++ b/playbooks/groups/fedocal.yml @@ -21,13 +21,13 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi - collectd/base tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/github2fedmsg.yml b/playbooks/groups/github2fedmsg.yml index ac8264a..99fe0eb 100644 --- a/playbooks/groups/github2fedmsg.yml +++ b/playbooks/groups/github2fedmsg.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/ipa.yml b/playbooks/groups/ipa.yml index 609fb46..8ebfcf0 100644 --- a/playbooks/groups/ipa.yml +++ b/playbooks/groups/ipa.yml @@ -20,12 +20,12 @@ - sudo - { role: openvpn/client, when: env != "staging" } + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/ipsilon.yml b/playbooks/groups/ipsilon.yml index 5706119..9bbccdf 100644 --- a/playbooks/groups/ipsilon.yml +++ b/playbooks/groups/ipsilon.yml @@ -26,12 +26,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/kerneltest.yml b/playbooks/groups/kerneltest.yml index 46ec3b8..221b1d3 100644 --- a/playbooks/groups/kerneltest.yml +++ b/playbooks/groups/kerneltest.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/koschei-web.yml b/playbooks/groups/koschei-web.yml index a21edf1..9314f57 100644 --- a/playbooks/groups/koschei-web.yml +++ b/playbooks/groups/koschei-web.yml @@ -20,13 +20,13 @@ - collectd/base - { role: sudo, sudoers: "{{ private }}/files/sudo/koschei01-sudoers" } - { role: openvpn/client, when: env != "staging" } + - mod_wsgi - koschei/frontend tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mailman.yml b/playbooks/groups/mailman.yml index c4f837d..b3d0da0 100644 --- a/playbooks/groups/mailman.yml +++ b/playbooks/groups/mailman.yml @@ -26,13 +26,13 @@ when: env != "staging" } - apache - spamassassin + - mod_wsgi tasks: # this is how you include other task lists - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mdapi.yml b/playbooks/groups/mdapi.yml index f07ee88..656c139 100644 --- a/playbooks/groups/mdapi.yml +++ b/playbooks/groups/mdapi.yml @@ -21,12 +21,12 @@ - { role: openvpn/client, when: env != "staging" } - collectd/base + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/mirrorlist2.yml b/playbooks/groups/mirrorlist2.yml index bbc8468..aea46eb 100644 --- a/playbooks/groups/mirrorlist2.yml +++ b/playbooks/groups/mirrorlist2.yml @@ -56,6 +56,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - httpd/mod_ssl - role: httpd/certificate @@ -95,7 +96,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: diff --git a/playbooks/groups/noc.yml b/playbooks/groups/noc.yml index 1d426ad..34d4bd3 100644 --- a/playbooks/groups/noc.yml +++ b/playbooks/groups/noc.yml @@ -22,12 +22,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/notifs-web.yml b/playbooks/groups/notifs-web.yml index afb8c7f..3c49b35 100644 --- a/playbooks/groups/notifs-web.yml +++ b/playbooks/groups/notifs-web.yml @@ -23,6 +23,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - fedmsg/base - notifs/frontend - sudo @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/nuancier.yml b/playbooks/groups/nuancier.yml index 1d48752..5237609 100644 --- a/playbooks/groups/nuancier.yml +++ b/playbooks/groups/nuancier.yml @@ -26,12 +26,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/packages.yml b/playbooks/groups/packages.yml index 81e8997..a7f8505 100644 --- a/playbooks/groups/packages.yml +++ b/playbooks/groups/packages.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/pdc.yml b/playbooks/groups/pdc.yml index 49e0fe1..f57bed8 100644 --- a/playbooks/groups/pdc.yml +++ b/playbooks/groups/pdc.yml @@ -42,12 +42,10 @@ - role: openvpn/client when: env != "staging" - apache + - mod_wsgi - fedmsg/base - pdc/frontend - tasks: - - include: "{{ tasks }}/mod_wsgi.yml" - - name: stuff just for the backend nodes hosts: pdc-backend:pdc-backend-stg user: root diff --git a/playbooks/groups/pkgdb.yml b/playbooks/groups/pkgdb.yml index 95b70ff..9c3cc4d 100644 --- a/playbooks/groups/pkgdb.yml +++ b/playbooks/groups/pkgdb.yml @@ -25,12 +25,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/statscache.yml b/playbooks/groups/statscache.yml index 3d1cd1e..a0a61ad 100644 --- a/playbooks/groups/statscache.yml +++ b/playbooks/groups/statscache.yml @@ -44,13 +44,11 @@ roles: - apache + - mod_wsgi - role: openvpn/client when: env != "staging" - statscache/frontend - tasks: - - include: "{{ tasks }}/mod_wsgi.yml" - - name: Stuff just for the fedmsg backend hosts: statscache-backend:statscache-backend-stg user: root diff --git a/playbooks/groups/sundries.yml b/playbooks/groups/sundries.yml index c7e66c2..537694f 100644 --- a/playbooks/groups/sundries.yml +++ b/playbooks/groups/sundries.yml @@ -23,6 +23,7 @@ - fas_client - collectd/base - apache + - mod_wsgi - geoip - geoip-city-wsgi/app - role: koji_reminder @@ -56,7 +57,6 @@ - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/tagger.yml b/playbooks/groups/tagger.yml index ab32b1c..f781868 100644 --- a/playbooks/groups/tagger.yml +++ b/playbooks/groups/tagger.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/groups/zanata2fedmsg.yml b/playbooks/groups/zanata2fedmsg.yml index c23a9a2..0628d17 100644 --- a/playbooks/groups/zanata2fedmsg.yml +++ b/playbooks/groups/zanata2fedmsg.yml @@ -27,12 +27,12 @@ - { role: openvpn/client, when: env != "staging" } - apache + - mod_wsgi tasks: - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/grafana.cloud.fedoraproject.org.yml b/playbooks/hosts/grafana.cloud.fedoraproject.org.yml index 799d110..1933031 100644 --- a/playbooks/hosts/grafana.cloud.fedoraproject.org.yml +++ b/playbooks/hosts/grafana.cloud.fedoraproject.org.yml @@ -24,6 +24,7 @@ - base - rkhunter - apache + - mod_wsgi #- graphite/graphite #- graphite/statsd #- graphite/fedmsg2statsd @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/graphite.fedorainfracloud.org.yml b/playbooks/hosts/graphite.fedorainfracloud.org.yml index c120980..d04bc38 100644 --- a/playbooks/hosts/graphite.fedorainfracloud.org.yml +++ b/playbooks/hosts/graphite.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - base - rkhunter - apache + - mod_wsgi - certbot - graphite/graphite - graphite/statsd @@ -33,7 +34,6 @@ - include: "{{ tasks }}/yumrepos.yml" #- include: "{{ tasks }}/2fa_client.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/iddev.fedorainfracloud.org.yml b/playbooks/hosts/iddev.fedorainfracloud.org.yml index 54784d8..848a8c1 100644 --- a/playbooks/hosts/iddev.fedorainfracloud.org.yml +++ b/playbooks/hosts/iddev.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - sudo - hosts - apache + - mod_wsgi - base pre_tasks: @@ -33,7 +34,6 @@ - include: "{{ tasks }}/cloud_setup_basic.yml" - name: set hostname (required by some services, at least postfix need it) hostname: name="{{inventory_hostname}}" - - include: "{{ tasks }}/mod_wsgi.yml" handlers: - include: "{{ handlers }}/restart_services.yml" diff --git a/playbooks/hosts/lists-dev.fedorainfracloud.org.yml b/playbooks/hosts/lists-dev.fedorainfracloud.org.yml index aa7d3c7..31185e2 100644 --- a/playbooks/hosts/lists-dev.fedorainfracloud.org.yml +++ b/playbooks/hosts/lists-dev.fedorainfracloud.org.yml @@ -33,13 +33,13 @@ - sudo - hosts - apache + - mod_wsgi - base tasks: - include: "{{ tasks }}/postfix_basic.yml" - include: "{{ tasks }}/yumrepos.yml" - include: "{{ tasks }}/motd.yml" - - include: "{{ tasks }}/mod_wsgi.yml" # Basic Apache config - name: install mod_ssl diff --git a/playbooks/hosts/modernpaste.fedorainfracloud.org.yml b/playbooks/hosts/modernpaste.fedorainfracloud.org.yml index 996d764..7d07691 100644 --- a/playbooks/hosts/modernpaste.fedorainfracloud.org.yml +++ b/playbooks/hosts/modernpaste.fedorainfracloud.org.yml @@ -24,6 +24,7 @@ - sudo - hosts - apache + - mod_wsgi - base pre_tasks: @@ -33,4 +34,3 @@ - include: "{{ tasks }}/cloud_setup_basic.yml" - name: set hostname (required by some services, at least postfix need it) hostname: name="{{inventory_hostname}}" - - include: "{{ tasks }}/mod_wsgi.yml" diff --git a/roles/mod_wsgi/files/wsgi.conf b/roles/mod_wsgi/files/wsgi.conf new file mode 100644 index 0000000..6c32a15 --- /dev/null +++ b/roles/mod_wsgi/files/wsgi.conf @@ -0,0 +1,14 @@ +LoadModule wsgi_module modules/mod_wsgi.so + +# Some apps, notably anything that uses hg, need these off +WSGIRestrictStdin Off +WSGIRestrictStdout Off + +# Put the socket somewhere writable +WSGISocketPrefix run/wsgi + +# Do not Optimize without stripping docstrings +WSGIPythonOptimize 0 + +# Set WSGIApplicationGroup to global +WSGIApplicationGroup %{GLOBAL} diff --git a/roles/mod_wsgi/handlers/main.yml b/roles/mod_wsgi/handlers/main.yml new file mode 100644 index 0000000..f599732 --- /dev/null +++ b/roles/mod_wsgi/handlers/main.yml @@ -0,0 +1,2 @@ +- name: restart apache + command: /usr/local/bin/conditional-restart.sh httpd httpd diff --git a/roles/mod_wsgi/tasks/mod_wsgi.yml b/roles/mod_wsgi/tasks/mod_wsgi.yml new file mode 100644 index 0000000..06c8aa5 --- /dev/null +++ b/roles/mod_wsgi/tasks/mod_wsgi.yml @@ -0,0 +1,22 @@ +--- +# install mod_wsgi +- name: install mod_wsgi + yum: name=mod_wsgi state=present + tags: + - packages + when: ansible_distribution_major_version|int < 22 + +- name: install mod_wsgi + dnf: name=mod_wsgi state=present + tags: + - packages + when: ansible_distribution_major_version|int > 21 + +- name: wsgi.conf + copy: src="wsgi.conf" dest=/etc/httpd/conf.d/wsgi.conf + notify: + - restart apache + tags: + - config + + diff --git a/tasks/mod_wsgi.yml b/tasks/mod_wsgi.yml deleted file mode 100644 index c4d9deb..0000000 --- a/tasks/mod_wsgi.yml +++ /dev/null @@ -1,22 +0,0 @@ ---- -# install mod_wsgi -- name: install mod_wsgi - yum: name=mod_wsgi state=present - tags: - - packages - when: ansible_distribution_major_version|int < 22 - -- name: install mod_wsgi - dnf: name=mod_wsgi state=present - tags: - - packages - when: ansible_distribution_major_version|int > 21 - -- name: wsgi.conf - copy: src="{{ files }}/mod_wsgi/wsgi.conf" dest=/etc/httpd/conf.d/wsgi.conf - notify: - - restart apache - tags: - - config - - -- 1.8.3.1

2 4

[PATCH 1/3] Whitespace cleanup, make ansible-lint happy
by Michael Scherer 08 Aug '16

08 Aug '16

--- roles/dnf-automatic/tasks/main.yml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/roles/dnf-automatic/tasks/main.yml b/roles/dnf-automatic/tasks/main.yml index 80b8046..2a41f19 100644 --- a/roles/dnf-automatic/tasks/main.yml +++ b/roles/dnf-automatic/tasks/main.yml @@ -1,9 +1,9 @@ --- # -# This role adds dnf automatic package and configuration. -# We want this on any public facing Fedora installs so we -# can pick up security updates. +# This role adds dnf automatic package and configuration. +# We want this on any public facing Fedora installs so we +# can pick up security updates. # - name: install dnf-automatic -- 1.8.3.1

2 3

[PATCH] Simplify the task to install cronjob
by Michael Scherer 08 Aug '16

08 Aug '16

Giving directly the file to deploy and doing magic with the variable permit to have a clearer idea of what is deployed when reading the task for the first time --- roles/mdapi/tasks/main.yml | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/roles/mdapi/tasks/main.yml b/roles/mdapi/tasks/main.yml index d884654..ac4dacd 100644 --- a/roles/mdapi/tasks/main.yml +++ b/roles/mdapi/tasks/main.yml @@ -19,11 +19,12 @@ - name: Install the meta-data fetch cron job when: inventory_hostname.startswith(('mdapi01')) - template: src={{ item.file }} - dest={{ item.location }}/{{ item.file }} + template: + src: "{{ item | basename }}" + dest: "{{ item }}" with_items: - - { file: 'mdapi.cron', location: /etc/cron.d } - - { file: 'mdapi.cfg', location: /etc/mdapi } + - /etc/cron.d/mdapi.cron + - /etc/mdapi/mdapi.cfg tags: - mdapi - config -- 1.8.3.1

1 0

[PATCH 1/3] Whitespace cleanup, make ansible-lint happy
by Michael Scherer 08 Aug '16

08 Aug '16

1 2

[PATCH 1/2] Use the new pkg module, to avoid having 2 tasks
by Michael Scherer 06 Aug '16

06 Aug '16

--- roles/nfs/client/tasks/main.yml | 14 +++----------- 1 file changed, 3 insertions(+), 11 deletions(-) diff --git a/roles/nfs/client/tasks/main.yml b/roles/nfs/client/tasks/main.yml index 627fab2..58ee460 100644 --- a/roles/nfs/client/tasks/main.yml +++ b/roles/nfs/client/tasks/main.yml @@ -34,22 +34,14 @@ # Install needed packages # - name: Install needed nfs packages - yum: pkg={{ item }} state=present + pkg: + name: "{{ item }}" + state: present with_items: - nfs-utils - rpcbind tags: - nfs/client - when: ansible_distribution_major_version|int < 22 -# -- name: Install needed nfs packages - dnf: pkg={{ item }} state=present - with_items: - - nfs-utils - - rpcbind - tags: - - nfs/client - when: ansible_distribution_major_version|int > 21 - name: enable nfs-related services and run them (fedora20 only) service: name={{ item }} enabled=true state=started -- 1.8.3.1

1 1

[PATCH] Use a more concise form for include of playbook
by Michael Scherer 06 Aug '16

06 Aug '16

--- roles/osbs-atomic-reactor/tasks/main.yml | 9 +-------- 1 file changed, 1 insertion(+), 8 deletions(-) diff --git a/roles/osbs-atomic-reactor/tasks/main.yml b/roles/osbs-atomic-reactor/tasks/main.yml index fc28ff9..3b5cd32 100644 --- a/roles/osbs-atomic-reactor/tasks/main.yml +++ b/roles/osbs-atomic-reactor/tasks/main.yml @@ -1,9 +1,2 @@ --- -- include: source_pull.yml - when: atomic_reactor_source == 'pull' - -- include: source_git.yml - when: atomic_reactor_source == 'git' - -- include: source_rpm.yml - when: atomic_reactor_source == 'rpm' +- include: source_{{ atomic_reactor_source }}.yml -- 1.8.3.1

1 0

[PATCH 1/2] Use a more modern style for gluster/client yaml
by Michael Scherer 05 Aug '16

05 Aug '16

Use pkg rather than yum, for future proofing with dnf --- roles/gluster/client/tasks/main.yml | 25 +++++++++++++++++-------- 1 file changed, 17 insertions(+), 8 deletions(-) diff --git a/roles/gluster/client/tasks/main.yml b/roles/gluster/client/tasks/main.yml index 2ecc5cf..8db6025 100644 --- a/roles/gluster/client/tasks/main.yml +++ b/roles/gluster/client/tasks/main.yml @@ -1,24 +1,33 @@ --- - name: install needed packages - yum: pkg={{ item }} state=present + pkg: + name: "{{ item }}" + state: present with_items: - glusterfs-fuse tags: - packages - name: make the mountdir - file: state=directory path={{ mountdir }} owner={{ owner }} group={{ group }} + file: + state: directory + path: "{{ mountdir }}" + owner: "{{ owner }}" + group: "{{ group }}" - name: copy over the client config - template: src=client.config dest=/etc/glusterfs/glusterfs.{{name}}.vol mode=0640 + template: + src: client.config + dest: /etc/glusterfs/glusterfs.{{name}}.vol + mode: 0640 #notify: #- remount? no idea... - name: mount it up - mount: > - src=/etc/glusterfs/glusterfs.{{name}}.vol - state=mounted - fstype=glusterfs - name={{mountdir}} + mount: + src: /etc/glusterfs/glusterfs.{{name}}.vol + state: mounted + fstype: glusterfs + name: "{{mountdir}}" ignore_errors: True -- 1.8.3.1

1 1

[Flock16] [Transcription] Pagure: Past, Present and Future
by Justin W. Flory 04 Aug '16

04 Aug '16

https://flock2016.sched.org/event/6yp8/pagure-past-present-and-future Meeting ended Wed Aug 3 14:24:12 2016 UTC. Minutes: https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… Minutes (text): https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… Log: https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… * * * * * =============================================================================================== #fedora-flock-picasso: Pagure: Past, Present, and Future - Speaker: Pierre-Yves Chibon (pingou) =============================================================================================== Meeting started by jflory7 at 13:33:36 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-flock-picasso/2016-08-03/flock2016… . Meeting summary --------------- * Introduction (jflory7, 13:33:43) * Talking about Pagure, open source git forge (jflory7, 13:33:54) * Background (jflory7, 13:34:00) * Fork, pull request, three repositories per project (sources, pull requests, tickets) (jflory7, 13:34:21) * New UI, new architecture, and lots of new features with recent growths (jflory7, 13:35:06) * Architecture (jflory7, 13:36:21) * Diagram on-screen of how all of Pagure architecture fits together (see slides / video feed later) (jflory7, 13:36:53) * EventSource server: If two people working on ticket / PR, one is making comment, new comment magically appears on other user's page (jflory7, 13:38:20) * Gitolite has always been a part of the project for managing user git repos and projects (jflory7, 13:39:56) * Features (jflory7, 13:39:59) * Doc hosting / repos (jflory7, 13:40:03) * To generate docs, you push source to the docs repo, view page, and updates quickly and instantly (jflory7, 13:41:59) * LINK: https://docs.pagure.org/pagure/ (jflory7, 13:42:16) * === Watch project (Gaurav Kumar) === (jflory7, 13:42:55) * Watch a project, get notifications as if you had commit rights (except on priv. tickets) (jflory7, 13:43:22) * === Roadmap === (jflory7, 13:43:55) * Migrating Trac features to Pagure was a major focus, like roadmaps (jflory7, 13:44:31) * === Customized PR page === (jflory7, 13:45:57) * You can customize the information displayed in pull requests (jflory7, 13:46:49) * Includes what branch and repo pull requests go into, add a note about contributing (e.g. "how to test your changes before submitting") (jflory7, 13:47:22) * === Issue templates === (jflory7, 13:48:10) * Different issue templates for different ticket types (jflory7, 13:49:24) * === Diff between x commits (Oliver Guitierrez) === (jflory7, 13:49:39) * LINK: https://pagure.io/pagure/c/5803a79..3c85bbc (jflory7, 13:50:08) * Q: "Can we compare against dates? e.g. Jan 1 and Mar 30?" (jflory7, 13:50:36) * A: Currently not, only two commits. Technically possible, no reason why not. Merge commits could affect whether this is accurate or not as well, e.g. if changes were made before date, but were merged in during that timeframe (jflory7, 13:52:07) * === Take issue (Ryan Lerch) === (jflory7, 13:52:43) * Before, if you wanted to take an issue, you needed to edit metadata, find your username, save metadata (jflory7, 13:53:11) * Now, you click the button in the issue and you will auto-assign it to yourself. No refresh necessary (jflory7, 13:53:28) * Q: "Right now, if you have page open for a long time, will it work?" (jflory7, 13:53:47) * A: Will work because connection never closes. Problem is that some endpoints is over cross-site scripting, other concerns as well were considered too. (jflory7, 13:54:50) * === Live completion (Eric Barbour) === (jflory7, 13:55:01) * Auto-completion for tagging username or IDs for tickets / PRs, e.g. @jflory7 or #17 (jflory7, 13:55:27) * === README file at creation (Ryan Lerch) === (jflory7, 13:56:08) * Most people used to git, not a problem, but more in mind for new users (jflory7, 13:56:18) * === Fake namespace === (jflory7, 13:57:00) * Want to have Pagure as front-end for dist-git (jflory7, 13:57:19) * Run x instances of Pagure for x instances of pkgdb, not effective solution when you can just run one. Won't be able to search between Pagures. (jflory7, 13:58:16) * Adding namespacing would break all previous projects and change all URLs for all projects (jflory7, 13:58:43) * Solution? Adding one slash to the end of a project configuration (jflory7, 13:59:48) * === New hooks === (jflory7, 14:02:54) * ReadTheDoc hook: Push to PAgure, update ReadTheDocs (jflory7, 14:03:14) * Block un-signed commits: Blocks PRs from being merged if they are unsigned with GPG (jflory7, 14:03:37) * Block non-fastforward commits: If you want to keep the log clean, keeps merge commits out and only relevant commits (can also specify which branch to have this apply to, e.g. `master`) (jflory7, 14:04:26) * === Better Pagure hook === (jflory7, 14:04:32) * Close ticket / PR via commit message (e.g. `git commit -s "close issue #10 close pull request #6"`) (jflory7, 14:05:11) * Future (jflory7, 14:05:42) * === Private repository (Farhaan) === (jflory7, 14:05:55) * === CI integration (Farhaan) === (jflory7, 14:07:11) * Pull requests can have flags to automatically build projects on other services, e.g. Jenkins (jflory7, 14:07:28) * Aimed for next release (jflory7, 14:07:32) * === Front-end for pkgs.fp.o (Vivek Anand) === (jflory7, 14:08:04) * LINK: http://pkgs.stg.fedoraproject.org/pagure/ (jflory7, 14:10:19) * Work in progress, but implementation is public, in staging (jflory7, 14:10:22) * Q: "Can I do stuff with this or will it break things?" (jflory7, 14:10:24) * A: Shouldn't break anything, but if it does, we need to look into it! (jflory7, 14:10:26) * === Mirror sources === (jflory7, 14:11:41) * Designed to be made so you can move things from Pagure instance to Pagure instance (jflory7, 14:11:52) * Maybe you have a private Pagure instance and want everyone to be on there, should be able to port all packages over to the other instance (jflory7, 14:12:26) * When you push to Pagure, it will do a git push to another git server (jflory7, 14:12:43) * Community (jflory7, 14:13:09) * 56 contributors, 33 contributors at 1.0, 2 GSoC students this year (Vivek Anand & Farhaan Bukhsh), 2 Red Hat interns (Eric Barbour and Simon) (jflory7, 14:13:51) * Top 10 contributors: pingou, ryanlerch, farhaanbukhsh, Johan, Clement, Vivek, Farhaan, Sayan, Lubomír, puiterwijk (jflory7, 14:14:50) * Being packaged in Debian (jflory7, 14:16:34) * Used outside our community (jflory7, 14:16:37) * LINK: https://git.48.io (jflory7, 14:16:41) * LINK: https://git.pignus.computer (jflory7, 14:16:44) * Evaluated by two start-ups (and a team at RackSpace!) (jflory7, 14:16:53) * Questions (jflory7, 14:17:36) * Q: "When is dist-git for Fedora going to be in prod?" - mattdm (jflory7, 14:17:57) * A: As soon as we support it! It just reached staging, not entirely deployed (jflory7, 14:19:23) * Q: "Is it designed in a way to work around problem by packaging dist-git into pagure.io?" - mhroncok (jflory7, 14:21:58) * A: Leverage pagure.io for pkg apps and relationship between fork and where it's coming from (jflory7, 14:22:09) Meeting ended at 14:24:12 UTC. Action Items ------------ Action Items, by person ----------------------- * **UNASSIGNED** * (none) People Present (lines said) --------------------------- * jflory7 (181) * zodbot (19) * jibecfed (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot -- Cheers, Justin W. Flory jflory7(a)gmail.com

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure August 2016