Fedora 38 beta freeze now in effect
by Kevin Fenzi
Greetings.
We are now in the infrastructure freeze leading up to the Fedora 38
Beta release. This is a pre release freeze.
We do this to ensure that our infrastructure is stable and ready to
release the Fedora 38 Beta when it's available.
You can see a list of hosts that do not freeze by checking out the
ansible repo and running the freezelist script:
git clone
https://infrastructure.fedoraproject.org/infra/ansible.git
ansible/scripts/freezelist -i inventory
Any hosts listed as freezes is frozen until 2023-03-14 (or later if
release slips). Frozen hosts should have no changes made to them without
a sign-off on the change from at least 2 sysadmin-main or rel-eng
members, along with (in most cases) a patch of the exact change to be
made to this list or a pull request for review.
Thanks,
Kevin
1 week
MDAPI logs a lot
by Aurelien Bompard
Hey folks!
To help me search through the FMN logs during development I've written
a small script that parses and stores the logs in a SQLite database on
log01 (that I remove afterwards :-).
While doing that I noticed that MDAPI produces quite a bit of logs.
Here is the number of log lines produced per app since yesterday:
mdapi | 39173286
oraculum | 1524762
zezere | 1394854
fmn | 1085206
As you can see MDAPI produces an order of magnitude more logs than the
second on that list: 40 million lines, while oraculum is only at 1.5
million.
I don't know whether it's justified or not, Akashdeep would know
better, but since a new version has been recently deployed I thought
there may be some debug setting still on.
Cheers!
Aurélien
1 week, 2 days
Freeze Break request: 3 new machines
by Kevin Fenzi
Hey everyone.
I have a pr that adds info for 3 of the 4 new machines we had racked
today:
https://pagure.io/fedora-infra/ansible/pull-request/1340
We also got a replacement server for backup01, but since we needed it
back to run it's backups, I treated that as an outage and already pushed
it.
These 3 are less important, but I'd like to get them in so nagios looks
cleaner to see problems and just to get them in service.
+1's from sysadmin-mainers welcome or comments from anyone. ;)
kevin
2 weeks, 2 days
Take 1 minute to help with Infra & Releng Team with a decision
by Michal Konecny
Hi everyone,
it came to Infra & Releng Team (sub-team in CPE that is taking care of
Fedora Infra, Fedora Release Engineering and CentOS Infra) attention
that there is a confusion about the labels we are using for issues in
our trackers. Namely fedora-infrastructure, releng and centos-infra.
There was even a request to change them to something less confusing.
So we want to decide if this is really need to change, so we ask you to
take this quick survey [0] (this is an anonymous survey, nothing is
collected by us) to see if the change is really needed or people are
happy with current labels.
The survey will be closed on 7th March 2023.
On behalf of I&R Team,
Michal
[0] - https://forms.gle/J2HWDkw1UNuj8HYD8
2 weeks, 2 days
new machines
by Kevin Fenzi
Hey everyone. Just a heads up that 4 new machines we got a bit ago are
hopefully going to be racked up tomorrow (monday) morning. (Likely
before I am in).
1 is replacing 2 staging bvmhosts (already powered off)
1 is replacing 3 staging vmhosts (already powered off)
1 is replacing backup01 (which I am going to power off right after it
finishes backups tonight and will reinstall it/bring it back tomorrow on
the new hardware).
1 is replacing autosign01 (and the old autosign01 is staying around for
now until we can get the new one all up and working). Probibly will move
that after freeze.
Just a heads up. ;)
kevin
2 weeks, 3 days
Freeze break request: forward openshift logs to log01
by Kevin Fenzi
I'm not really sure this needs a freeze break (we haven't really
established a formal policy about if our openshift cluster is frozen or
just some applications on it, or none of it) but I thought I would run
it by everyone just in case.
I'd like to setup log forwarding on our production cluster to log all
application level logs to log01. I've already done this for staging to
test everything out and it seems to be working fine.
Now of course this means a bunch more logs on log01, but on the other
hand, it means we can actually look back and see what happened when say
a update didn't process as we expected, but the bodhi web pod has been
restarted. ;)
Thoughts?
kevin
3 weeks
