infrastructure September 2022

infrastructure@lists.fedoraproject.org

17 participants
21 discussions

Fedora 37 Beta Freeze now in effect
by Kevin Fenzi 14 Sep '22

14 Sep '22

Greetings. We are now in the infrastructure freeze leading up to the Fedora 37 Beta release. This is a pre release freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 37 Beta when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://infrastructure.fedoraproject.org/infra/ansible.git ansible/scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2022-09-13 (or later if release slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list or a pull request for review. Thanks, Kevin

1 1

I made a new Fedora Apps page, do you want it?
by Jakub Kadlcik 12 Sep '22

12 Sep '22

Hello, I am reimplementing the current https://apps.fedoraproject.org page. It is not finished yet, but I wanted to share a demo with you: https://fedora-apps.netlify.app The upstream is here: https://github.com/frostyx/fedora-apps/ Do you have any interest to eventually switch to this implementation and sunset the original one? PS: Please don't judge me too harshly for the code quality, I am learning the language. I will refactor once the basic features are done (I know everybody is saying that :D) Jakub

3 4

[Fedocal] Reminder meeting : Websites & Apps Team Meeting
by t0xic0der＠fedoraproject.org 12 Sep '22

12 Sep '22

Dear all, You are kindly invited to the meeting: Websites & Apps Team Meeting on 2022-09-13 from 15:00:00 to 16:00:00 UTC At https://meet.jit.si/fedora-websites-apps-meeting The meeting will be about: Weekly team meeting for the Websites & Apps Team. This is part of the [Websites & Apps Community Revamp Objective](https://fedoraproject.org/wiki/Objectives/Websites_%26_Apps_Comm…. See [past discussion]( https://discussion.fedoraproject.org/t/planning-meeting-for-websites-apps-t…) to learn more about the Websites & Apps Team and how it came together. More information available at: [hackmd.io/Mxm2We3yTqKybLsdohadOA](https://hackmd.io/Mxm2We3yTqKybLsdohadOA?view) Source: https://calendar.fedoraproject.org//meeting/9990/

1 0

FBR: DNS update
by Stephen Smoogen 12 Sep '22

12 Sep '22

Currently the ipv6for osuosl.org is not functioning and I would like to take them out of DNS. When looking at it, I found that the getfedora.org was in this state: ``` disable proxy09.fedoraproject.org disable proxy11.fedoraproject.org enable proxy11.fedoraproject.org disable proxy02.fedoraproject.org enable proxy02.fedoraproject.org disable proxy04.fedoraproject.org disable proxy06.fedoraproject.org enable proxy06.fedoraproject.org disable proxy13.fedoraproject.org enable proxy13.fedoraproject.org disable proxy03.fedoraproject.org enable proxy03.fedoraproject.org disable proxy12.fedoraproject.org enable proxy12.fedoraproject.org disable proxy01.iad2.fedoraproject.org disable proxy101.iad2.fedoraproject.org disable proxy101.iad2.fedoraproject.org ``` My change to the cmds files is to add proxy06.fedoraproject.org and proxy09 to the disable list and remove all others from getfedora.org. Then execute a change and cleanup. -- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren

3 2

CPE Weekly Update - Week 36 2022
by Michal Konecny 09 Sep '22

09 Sep '22

Hi everyone, This is a weekly report from the CPE (Community Platform Engineering) Team. The report could be found at https://communityblog.fedoraproject.org/ cpe-weekly-update---week-36-2022/. If you want to receive weekly reports by emails in the future, please subscribe to either https://communityblog.fedoraproject.org/ or https://discussion.fedoraproject.org/c/news/commblog/61. We will stop sending them in the future. Regards, CPE Team

1 0

The state of mailing lists/mailman (not great)
by Stephen Smoogen 07 Sep '22

07 Sep '22

This is a general 'what I am seeing in the infrastructure' email taking various comments I made in irc into a more formal email I started looking at some email failures last week and realized that many of the mailing lists have vast amounts of 'held' email and 'held' subscriptions. In most cases these are SPAM messages and from many of the email addresses probably also spam accounts. In viewing this, I "felt" that lists with large numbers of these seemed slower to bring up various web pages so I started to clean up the loads. My rough estimate is that there are several hundred thousand outstanding subscriptions on many lists going back to 2015 and there are approximately million held messages in the database. Due to the age of our mailman3 implementation, I could not easily do this with any command line tool and found that the direct action given in various forums were not working either due to the schema we have in our DB not matching what is now the current version. I instead went through cleaning up various lists of old spam by hand. This takes a long time and led me to see that the general load average of the mailman was running around 10 to 12 over long periods of time. With only 4 CPU's, I thought this might be cause of my original issues so I increased the CPU count to 8. This lowered the long term load average but now led to reports where the mailman REST daemon does not respond in time due to timeouts. Looking at what is going on in the logs, and reading through the forums, my guess was these are issues due to the old django and early mailman we are using. At this point I started to look at what would be needed to update mailman to a newer version which could be supported on Fedora or RHEL9. The main issues are setting up the django "project" and then making sure that the needed packages are available. The upstream 'recommended' ways are to use either venv or containers but I found that the solutions are for a) docker, b) have a lot of security vulnerabilities in the quay listing and c) using it looks like Debian/Ubuntu packages. There is also a lot of customization needed to the point it might be best to start from scratch on that. I am thinking it might make better sense to work out a project and layout in staging, get a copy of the database from db01 and try experiments to make it work until we either burn it all down or not. -- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren

4 7

Freeze break request - eln signing
by Kevin Fenzi 06 Sep '22

06 Sep '22

I messed up and didn't update eln signing at branching. ;( This PR: https://pagure.io/fedora-infra/ansible/pull-request/1185 should enable that and also allow me to re-sign existing builds. +1s? kevin

1 0

[Fedocal] Reminder meeting : Websites & Apps Team Meeting
by t0xic0der＠fedoraproject.org 05 Sep '22

05 Sep '22

Dear all, You are kindly invited to the meeting: Websites & Apps Team Meeting on 2022-09-06 from 15:00:00 to 16:00:00 UTC At https://meet.jit.si/fedora-websites-apps-meeting The meeting will be about: Weekly team meeting for the Websites & Apps Team. This is part of the [Websites & Apps Community Revamp Objective](https://fedoraproject.org/wiki/Objectives/Websites_%26_Apps_Comm…. See [past discussion]( https://discussion.fedoraproject.org/t/planning-meeting-for-websites-apps-t…) to learn more about the Websites & Apps Team and how it came together. More information available at: [hackmd.io/Mxm2We3yTqKybLsdohadOA](https://hackmd.io/Mxm2We3yTqKybLsdohadOA?view) Source: https://calendar.fedoraproject.org//meeting/9990/

1 0

Freeze Break Request: Increase mailman to 8 CPU
by Stephen Smoogen 02 Sep '22

02 Sep '22

I am trying to deal with some crashing issues with the mailman. It is currently at 100% CPU usage with 4 cpus and about 12-16 waiting services at all times. I would like to increase the number of CPUs to 8. There does not look to be memory problems at this time so no increase is needed there. Actions: update ansible update vm system via virsh reboot vm -- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren

4 4

CPE Weekly Update - Week 35 2022
by Lenka Segura 02 Sep '22

02 Sep '22

Hi everyone, This is a weekly report from the CPE (Community Platform Engineering) Team. The report could be found at https://communityblog.fedoraproject.org/cpe-weekly-update---week-35-2022/cp…. If you want to receive weekly reports by emails in the future, please subscribe to either https://communityblog.fedoraproject.org/ or https://discussion.fedoraproject.org/c/news/commblog/61. We will stop sending them in the future. Regards, CPE Team

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure September 2022