infrastructure September 2023

infrastructure@lists.fedoraproject.org

18 participants
11 discussions

Start a nNew thread

hyperkitty/mailman3 now updated to the latest
by Reon Beon 13 Nov '23

13 Nov '23

Nice.

5 7

Resource usage in AWS per group
by Miroslav Suchý 25 Sep '23

25 Sep '23

Now when we have all instances and volumes tagged. I can say who is using what resources. Below you will find the aggregated overview of resources we are using in AWS. If you will not mind, I plan to send this overview every month. My intention is to be able to see the overview of long-term provisioned resources across regions. This is just snapshot of one moment. This report does not catch how long the resource has been provisioned. This report does not include: * snapshots - this is something I want to focus in next step in near future * CloudFront - this is actualy biggest item on our invoice. But there is nothing we can do about it. There is no cheaper option and no way to optimize it further. I have no intention to report our usage of CloudFront. * price of instances - this report does not differ if the instance is spot, reserved one, or on demand. I am not sure if I want to report it as my main goal is to catch forgotten resources rather than aiming for lowering the total cost. If you have ideas how to improve this report, let me know. Here is the report. = Volumes FedoraGroup: centos Region: ap-south-1 Volume Type: gp3 - Total Size: 4570 GiB Region: eu-central-1 Volume Type: gp3 - Total Size: 13200 GiB Region: us-west-2 Volume Type: gp3 - Total Size: 13145 GiB Region: af-south-1 Volume Type: gp3 - Total Size: 4050 GiB Region: eu-west-3 Volume Type: gp3 - Total Size: 2917 GiB Region: eu-west-2 Volume Type: gp3 - Total Size: 21420 GiB Region: eu-west-1 Volume Type: gp3 - Total Size: 584 GiB Region: ap-northeast-1 Volume Type: gp3 - Total Size: 8070 GiB Region: sa-east-1 Volume Type: gp3 - Total Size: 4250 GiB Region: ap-southeast-1 Volume Type: gp3 - Total Size: 4050 GiB Region: ap-southeast-2 Volume Type: gp3 - Total Size: 8100 GiB Region: us-east-1 Volume Type: gp3 - Total Size: 24350 GiB Region: us-east-2 Volume Type: gp3 - Total Size: 44890 GiB Volume Type: io1 - Total Size: 200 GiB FedoraGroup: infra Region: ap-south-1 Volume Type: gp3 - Total Size: 8 GiB Region: eu-central-1 Volume Type: gp3 - Total Size: 16223 GiB Region: us-west-1 Volume Type: gp3 - Total Size: 40 GiB Region: us-west-2 Volume Type: standard - Total Size: 100 GiB Volume Type: gp3 - Total Size: 900 GiB Region: af-south-1 Volume Type: gp3 - Total Size: 25 GiB Region: eu-west-2 Volume Type: gp3 - Total Size: 20 GiB Region: ap-northeast-2 Volume Type: gp3 - Total Size: 196 GiB Region: sa-east-1 Volume Type: gp3 - Total Size: 200 GiB Region: ap-southeast-1 Volume Type: gp3 - Total Size: 108 GiB Region: us-east-1 Volume Type: gp3 - Total Size: 330 GiB Region: us-east-2 Volume Type: gp3 - Total Size: 113 GiB FedoraGroup: min Region: eu-central-1 Volume Type: gp3 - Total Size: 1000 GiB FedoraGroup: garbage-collector Region: ap-southeast-1 Volume Type: standard - Total Size: 6 GiB FedoraGroup: copr Region: us-east-1 Volume Type: st1 - Total Size: 5500 GiB Volume Type: gp3 - Total Size: 3468 GiB Volume Type: standard - Total Size: 500 GiB Volume Type: io2 - Total Size: 20 GiB Volume Type: sc1 - Total Size: 49652 GiB FedoraGroup: ci Region: us-east-1 Volume Type: gp3 - Total Size: 3056 GiB Region: us-east-2 Volume Type: gp3 - Total Size: 12488 GiB Volume Type: gp2 - Total Size: 516 GiB FedoraGroup: respins Region: us-east-1 Volume Type: gp3 - Total Size: 500 GiB FedoraGroup: abrt Region: us-east-1 Volume Type: gp3 - Total Size: 10 GiB = Instances FedoraGroup: centos Region: ap-south-1 Instance Type: t3.2xlarge - Count: 3 Instance Type: t3.large - Count: 1 Instance Type: m6i.2xlarge - Count: 1 Region: eu-central-1 Instance Type: t2.small - Count: 1 Instance Type: t2.large - Count: 2 Instance Type: r5b.8xlarge - Count: 1 Instance Type: m6i.2xlarge - Count: 1 Instance Type: t3.xlarge - Count: 1 Region: us-west-2 Instance Type: m6i.2xlarge - Count: 2 Instance Type: t3.small - Count: 1 Instance Type: t3.xlarge - Count: 1 Region: af-south-1 Instance Type: m6i.2xlarge - Count: 1 Region: eu-west-3 Instance Type: t2.large - Count: 2 Instance Type: t2.2xlarge - Count: 1 Instance Type: t3a.xlarge - Count: 1 Instance Type: t2.small - Count: 2 Instance Type: t3.xlarge - Count: 1 Instance Type: t3.large - Count: 1 Region: eu-west-2 Instance Type: t2.small - Count: 1 Instance Type: t2.large - Count: 1 Instance Type: t3a.large - Count: 2 Instance Type: r5a.8xlarge - Count: 1 Instance Type: t3.large - Count: 2 Instance Type: t3.xlarge - Count: 1 Instance Type: t2.medium - Count: 1 Instance Type: m6i.2xlarge - Count: 1 Region: eu-west-1 Instance Type: t2.medium - Count: 4 Instance Type: t2.xlarge - Count: 3 Instance Type: t2.large - Count: 1 Instance Type: t2.small - Count: 2 Instance Type: t3.large - Count: 1 Instance Type: t3.medium - Count: 2 Region: ap-northeast-1 Instance Type: c6g.2xlarge - Count: 1 Instance Type: m6i.2xlarge - Count: 1 Region: sa-east-1 Instance Type: c6g.4xlarge - Count: 1 Instance Type: m6i.2xlarge - Count: 1 Region: ap-southeast-1 Instance Type: m6i.2xlarge - Count: 1 Region: ap-southeast-2 Instance Type: m6i.2xlarge - Count: 2 Region: us-east-1 Instance Type: t3.xlarge - Count: 2 Region: us-east-2 Instance Type: t2.2xlarge - Count: 1 Instance Type: m5a.2xlarge - Count: 1 Instance Type: t3.xlarge - Count: 4 Instance Type: t3a.large - Count: 1 Instance Type: m6i.2xlarge - Count: 2 Instance Type: t2.large - Count: 2 Instance Type: t3.large - Count: 1 Instance Type: m4.2xlarge - Count: 1 Instance Type: t3.small - Count: 1 Instance Type: t3.medium - Count: 1 FedoraGroup: infra Region: ap-south-1 Instance Type: c5d.xlarge - Count: 1 Region: eu-central-1 Instance Type: c5d.xlarge - Count: 1 Instance Type: c5n.2xlarge - Count: 1 Instance Type: m5.xlarge - Count: 1 Instance Type: m6gd.4xlarge - Count: 1 Region: us-west-1 Instance Type: t3.medium - Count: 1 Region: us-west-2 Instance Type: m5.large - Count: 4 Instance Type: m6g.large - Count: 1 Instance Type: t3.large - Count: 1 Instance Type: c5n.2xlarge - Count: 1 Instance Type: c6gd.xlarge - Count: 1 Region: af-south-1 Instance Type: c5d.xlarge - Count: 2 Region: eu-west-2 Instance Type: c5d.xlarge - Count: 1 Region: ap-northeast-2 Instance Type: c5n.2xlarge - Count: 1 Region: sa-east-1 Instance Type: c5.2xlarge - Count: 1 Instance Type: c5n.2xlarge - Count: 1 Region: ap-southeast-1 Instance Type: c5d.xlarge - Count: 1 Instance Type: c5n.2xlarge - Count: 1 Region: us-east-1 Instance Type: t3.medium - Count: 1 Instance Type: t3.small - Count: 1 Instance Type: c5.xlarge - Count: 2 Instance Type: t2.medium - Count: 2 Instance Type: c5.2xlarge - Count: 1 Region: us-east-2 Instance Type: c5d.large - Count: 2 Instance Type: t2.micro - Count: 1 Instance Type: t3.medium - Count: 1 FedoraGroup: centos-stream-osci Region: ca-central-1 Instance Type: m5d.large - Count: 5 Instance Type: t2.micro - Count: 1 FedoraGroup: min Region: eu-central-1 Instance Type: t3.2xlarge - Count: 1 FedoraGroup: abrt Region: us-east-1 Instance Type: t3a.2xlarge - Count: 1 FedoraGroup: ci Region: us-east-1 Instance Type: c5.2xlarge - Count: 6 Region: us-east-2 Instance Type: m5a.4xlarge - Count: 1 Instance Type: r5.large - Count: 4 Instance Type: i3.2xlarge - Count: 6 Instance Type: c5.2xlarge - Count: 3 Instance Type: r5.xlarge - Count: 2 Instance Type: c6a.large - Count: 19 Instance Type: c6g.large - Count: 15 Instance Type: c6g.xlarge - Count: 1 FedoraGroup: copr Region: us-east-1 Instance Type: t3a.small - Count: 1 Instance Type: t3a.medium - Count: 5 Instance Type: t3a.xlarge - Count: 3 Instance Type: m5a.4xlarge - Count: 1 Instance Type: i4i.large - Count: 23 Instance Type: c7g.xlarge - Count: 64 Instance Type: t2.medium - Count: 1 FedoraGroup: centos-stream-build Region: us-east-2 Instance Type: t2.micro - Count: 1 -- Miroslav Suchy, RHCA Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys

2 1

AWS Instances without tag FedoraGroup=*
by Miroslav Suchý 22 Sep '23

22 Sep '23

According our SOP https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/aws-access/#_role… Users MUST tag resources with their FedoraGroup tag within one day, or the resource may be removed. I created a small script and queried all resources in all regions for resources without this tag. I am NOT going to delete resources without this tag as that would destroy half of the infrastructure. Please check if one of these resources is yours and properly tag them. (BTW when you will work on that, please add tag Owner=* too): Region: ap-south-2 Region: ap-south-1 Instances: * mref1.aps1.stream.centos.org (i-0f566f5a8d0544a9d) Volumes - [id (attached to instance)]: * vol-04ba60d39cfda0873 (mref1.aps1.stream.centos.org) * vol-0624a43d78bbcf1e3 (mref1.aps1.stream.centos.org) * vol-0dbcb65fadcadfd56 (N/A) Region: eu-south-1 Region: eu-south-2 Region: me-central-1 Region: il-central-1 Region: ca-central-1 Instances: Volumes - [id (attached to instance)]: * vol-067b5f163d2320171 (cloud-fedora-34-aws-ssd) * vol-07a41964b391cbe75 (cloud-fedora-34-aws-ssd) * vol-05fa6f0557ab1e44b (cloud-fedora-34-aws-ssd) * vol-00d79ef4b4e1f92e8 (cloud-fedora-34-aws-ssd) * vol-0712085157d0bade9 (cloud-fedora-34-aws-ssd) * vol-037fb93e199476ee1 (cloud-fedora-34-aws) Region: eu-central-1 Instances: * risc-v koji hub (i-096911a251a31b09f) * mref1.euc1.stream.centos.org (i-0db35e5f70750e87f) * vault.euc1.centos.org (i-0bc52b0cc68e4499d) Volumes - [id (attached to instance)]: * vol-0ce62ad946d5356e9 (id.dev.centos.org) * vol-0e630691e76128447 (proxy36.fedoraproject.org) * vol-0bd681a8a7537d2e7 (minetest) * vol-05b6b70293a262e2b (risc-v koji hub) * vol-0a6a0692e6db3a4cd (risc-v koji hub) * vol-06e0ad3a62ff40ee4 (mref1.euc1.stream.centos.org) * vol-0fd3b08bd32b095b7 (mref1.euc1.stream.centos.org) * vol-0fccc73d1328ff978 (vault.euc1.centos.org) Region: eu-central-2 Region: us-west-1 Instances: Volumes - [id (attached to instance)]: * vol-b07165de (N/A) * vol-b82037d6 (N/A) * vol-54657c3a (N/A) * vol-8349ade2 (N/A) * vol-3ffc2b1f (N/A) Region: us-west-2 Instances: * mref1.uw2.stream.centos.org (i-0cc5dceddb5b661af) * proxy09.fedoraproject.org (i-07a30fbb93ec0030d) * aarch64-test02.fedorainfracloud.org (i-09d5619b3782ff940) * pdns3.uw2.centos.org (i-0d448e1f3f6552ce1) * vault.uw2.centos.org (i-08f1d848cc1da073a) Volumes - [id (attached to instance)]: * vol-0a3391b6d83a69e3e (mref1.uw2.stream.centos.org) * vol-0df5eb0cf0d4e8855 (mref1.uw2.stream.centos.org) * vol-070ba525db8d62425 (proxy09.fedoraproject.org) * vol-0ad5c4cde450a9bdd (aarch64-test02.fedorainfracloud.org) * vol-0c728f179988d4f1c (pdns3.uw2.centos.org) * vol-48b8ec21 (N/A) * vol-a998df91 (N/A) * vol-06173c2bf59801079 (N/A) * vol-03f61f31b964390b4 (N/A) * vol-0acf2f1309656dbf0 (f37-test.fedorainfracloud.org) * vol-09b92bac86df1d577 (vault.uw2.centos.org) * vol-074066a4fb17c2ccd (f38-test.fedorainfracloud.org) * vol-05c43dd45de9ec8dc (f39-test.fedorainfracloud.org) * vol-60cc8458 (N/A) Region: af-south-1 Instances: * proxy33.fedoraproject.org (i-091c3a0a9b51b746c) * mref1.afs1.stream.centos.org (i-05e8706b4d1c1dbe3) Volumes - [id (attached to instance)]: * vol-0474b44ac60470546 (proxy33.fedoraproject.org) * vol-00ffe8821d7313bbf (mref1.afs1.stream.centos.org) * vol-02b6f520ece872075 (mref1.afs1.stream.centos.org) Region: eu-north-1 Region: eu-west-3 Instances: * pdns1.euw3.centos.org (i-07724f80561513ae4) * people.euw3.centos.org (i-0629a7c9146e04290) Volumes - [id (attached to instance)]: * vol-01517db42903637d9 (mirrorlist.euw3.aws.centos.org) * vol-00c760fbdd555a77d (pdns1.euw3.centos.org) * vol-033eed789811e4d73 (people.euw3.centos.org) * vol-0879d3b255788e2b9 (people.euw3.centos.org) * vol-0940073018c7c7424 (wiki.stg.centos.org) Region: eu-west-2 Instances: * mon2.stg.centos.org (i-0e2dfdfd40502033d) * buildlogs.euw2.centos.org (i-0d3da2203fcde2803) * blog.stg.centos.org (i-0ff49a8f0cb580006) * mref1.euw2.stream.centos.org (i-01e8f6a3aaf0fbc7c) * www-node3.centos.org (i-0b7fd297c9c3e3070) Volumes - [id (attached to instance)]: * vol-0fdf7047099b942c3 (forums.centos.org) * vol-0a031eb0b5d5b43ab (mref1.euw2.stream.centos.org) * vol-0c63ea2af7fae21be (mref1.euw2.stream.centos.org) * vol-04698aafb278a461b (www-node3.centos.org) * vol-02657e34fb9b4c830 (lists.stg.centos.org) * vol-0d0b02d00c539e44e (buildlogs.euw2.centos.org) * vol-0354f50fe045ed5cf (mon2.stg.centos.org) * vol-0b558b597fd70b8a7 (buildlogs.euw2.centos.org) * vol-09f323dea12ca8189 (blog.stg.centos.org) Region: eu-west-1 Instances: * kojid1.stg.centos.org (i-00028f1043d123ea2) * cbs.stg.centos.org (i-0e093bb7fbd190252) * proxy1.stg.euw1.centos.org (i-03f1be4e6338a4173) * nfs01.stg.aws.centos.org (i-093e80bf9aa8a732f) * mref1.stg.euw1.centos.org (i-09c2cdce2dada8fa8) * stylo.stg.euw1.centos.org (i-08da0a182d470d9f6) * kojid2.stg.euw1.centos.org (i-0ffcc59f1d286b026) * connect.aws.centos.org (i-0d07a512a8d8abe86) * blog.euw1.centos.org (i-0dc40921da17bb9e1) * stylo2.stg.euw1.centos.org (i-02219605591a69bee) * paste.aws.centos.org (i-0b6601e487d027f71) Volumes - [id (attached to instance)]: * vol-0358b68ad2cb85949 (cbs.stg.centos.org) * vol-069e3c20829a3587d (kojid1.stg.centos.org) * vol-091e43582ed27eabd (nfs01.stg.aws.centos.org) * vol-049ee971c07e235bc (nfs01.stg.aws.centos.org) * vol-078a5b5c05d572ee7 (proxy1.stg.euw1.centos.org) * vol-0f2e7769aad780b2b (mref1.stg.euw1.centos.org) * vol-05f9df99cba974c4a (stylo.stg.euw1.centos.org) * vol-03bbbcf777c8c1dcb (kojid2.stg.euw1.centos.org) * vol-01dfe65607647f01f (connect.aws.centos.org) * vol-04190ea81df793721 (blog.euw1.centos.org) * vol-0cc57dd55cb4967c9 (stylo2.stg.euw1.centos.org) * vol-03b554d3065a9d9a1 (paste.aws.centos.org) * vol-ef097386 (N/A) * vol-78589510 (N/A) * vol-c9a0ce9c (N/A) * vol-07a0b32a (N/A) * vol-a5425088 (N/A) * vol-4109086c (N/A) * vol-7ae00456 (N/A) Region: ap-northeast-3 Region: ap-northeast-2 Region: me-south-1 Region: ap-northeast-1 Instances: * m1.apnh1.aws.centos.org (i-0e9a17d45bafaffee) * N/A (i-0399e6de6e283c229) * mref1.apn1.stream.centos.org (i-01258e58ba0c82c32) Volumes - [id (attached to instance)]: * vol-de3704b1 (N/A) * vol-bda64eeb (N/A) * vol-4e0b016c (N/A) * vol-bc010b9e (N/A) * vol-5ca7ff56 (N/A) * vol-5005ba46 (N/A) * vol-5105ba47 (N/A) * vol-96921780 (N/A) * vol-97921781 (N/A) * vol-c2c8472b (N/A) * vol-c5c8472c (N/A) * vol-acc84745 (N/A) * vol-9dc84774 (N/A) * vol-b7c14e5e (N/A) * vol-9bc14e72 (N/A) * vol-4ec14ea7 (N/A) * vol-41c14ea8 (N/A) * vol-5328b5ba (N/A) * vol-2328b5ca (N/A) * vol-2228b5cb (N/A) * vol-1028b5f9 (N/A) * vol-922ab77b (N/A) * vol-402ab7a9 (N/A) * vol-7e57dd82 (N/A) * vol-6757dd9b (N/A) * vol-5057ddac (N/A) * vol-3157ddcd (N/A) * vol-6e55df92 (N/A) * vol-6855df94 (N/A) * vol-2a34a1d6 (N/A) * vol-2b34a1d7 (N/A) * vol-0d34a1f1 (N/A) * vol-0834a1f4 (N/A) * vol-1836a3e4 (N/A) * vol-0436a3f8 (N/A) * vol-bae07746 (N/A) * vol-bbe07747 (N/A) * vol-83e0777f (N/A) * vol-7de07781 (N/A) * vol-adef7851 (N/A) * vol-afef7853 (N/A) * vol-64bb2a98 (N/A) * vol-40bb2abc (N/A) * vol-2bbb2ad7 (N/A) * vol-fbba2b07 (N/A) * vol-b2bd2c4e (N/A) * vol-b3bd2c4f (N/A) * vol-8d019271 (N/A) * vol-8e019272 (N/A) * vol-530192af (N/A) * vol-180192e4 (N/A) * vol-fd079401 (N/A) * vol-e8079414 (N/A) * vol-6ca03990 (N/A) * vol-1aa039e6 (N/A) * vol-05a039f9 (N/A) * vol-07a039fb (N/A) * vol-4da23bb1 (N/A) * vol-15a23be9 (N/A) * vol-19d0b3e5 (N/A) * vol-f0d7b40c (N/A) * vol-dfd7b423 (N/A) * vol-cbd7b437 (N/A) * vol-223e51de (N/A) * vol-ec3d5210 (N/A) * vol-ed3d5211 (N/A) * vol-783d5284 (N/A) * vol-513b54ad (N/A) * vol-533b54af (N/A) * vol-d19feb2d (N/A) * vol-c39feb3f (N/A) * vol-b7d0a44b (N/A) * vol-7dd0a481 (N/A) * vol-59d0a4a5 (N/A) * vol-5ad0a4a6 (N/A) * vol-223342de (N/A) * vol-153342e9 (N/A) * vol-e332431f (N/A) * vol-cd324331 (N/A) * vol-4c3544b0 (N/A) * vol-3d3544c1 (N/A) * vol-de235d22 (N/A) * vol-d2235d2e (N/A) * vol-d3235d2f (N/A) * vol-aa235d56 (N/A) * vol-be215f42 (N/A) * vol-8f215f73 (N/A) * vol-3c89c5c0 (N/A) * vol-e58ac619 (N/A) * vol-e68ac61a (N/A) * vol-ad8ac651 (N/A) * vol-d685c92a (N/A) * vol-c585c939 (N/A) * vol-7a3e7486 (N/A) * vol-7b3e7487 (N/A) * vol-5c3e74a0 (N/A) * vol-3d3e74c1 (N/A) * vol-ec3c7610 (N/A) * vol-c13c763d (N/A) * vol-430f5abf (N/A) * vol-0f0f5af3 (N/A) * vol-f80e5b04 (N/A) * vol-ed0e5b11 (N/A) * vol-59df8aa5 (N/A) * vol-12df8aee (N/A) * vol-3797c3cb (N/A) * vol-0d97c3f1 (N/A) * vol-0f97c3f3 (N/A) * vol-ff90c403 (N/A) * vol-0691c5fa (N/A) * vol-e392c61f (N/A) * vol-872a7d7b (N/A) * vol-802a7d7c (N/A) * vol-41580fbd (N/A) * vol-27580fdb (N/A) * vol-ed471011 (N/A) * vol-ee471012 (N/A) * vol-e644131a (N/A) * vol-c4441338 (N/A) * vol-57d38fab (N/A) * vol-9c6b3560 (N/A) * vol-4b6b35b7 (N/A) * vol-7168368d (N/A) * vol-556836a9 (N/A) * vol-d0f7ae2c (N/A) * vol-a7f7ae5b (N/A) * vol-c3154d3f (N/A) * vol-f7164e0b (N/A) * vol-c4164e38 (N/A) * vol-c7164e3b (N/A) * vol-c0164e3c (N/A) * vol-76243d80 (N/A) * vol-4b243dbd (N/A) * vol-36243dc0 (N/A) * vol-3b243dcd (N/A) * vol-7a263f8c (N/A) * vol-02263ff4 (N/A) * vol-76c8d180 (N/A) * vol-74c8d182 (N/A) * vol-75c8d183 (N/A) * vol-5bc8d1ad (N/A) * vol-accad35a (N/A) * vol-9ecad368 (N/A) * vol-274a51d1 (N/A) * vol-86a8b370 (N/A) * vol-42a8b3b4 (N/A) * vol-34a8b3c2 (N/A) * vol-2aa8b3dc (N/A) * vol-e211f42b (N/A) * vol-981afe51 (N/A) * vol-9b1afe52 (N/A) * vol-0f37d1c6 (N/A) * vol-2d37d1e4 (N/A) * vol-2c37d1e5 (N/A) * vol-8034d249 (N/A) * vol-4f35d386 (N/A) * vol-4e35d387 (N/A) * vol-cc3ed805 (N/A) * vol-a03ed869 (N/A) * vol-6c3ed8a5 (N/A) * vol-3b3ed8f2 (N/A) * vol-c93cda00 (N/A) * vol-f63cda3f (N/A) * vol-7cc72db5 (N/A) * vol-85c42e4c (N/A) * vol-05ef4fc9e5307a04f (m1.apnh1.aws.centos.org) * vol-0b704a7411c1c060f (m1.apnh1.aws.centos.org) * vol-0beeea6a3411304ab () * vol-07d097f2636d16259 (mref1.apn1.stream.centos.org) * vol-0d9732224afb08d10 (mref1.apn1.stream.centos.org) Region: sa-east-1 Instances: * mref1.sae1.stream.centos.org (i-0979edb5dd7428743) Volumes - [id (attached to instance)]: * vol-0ca01d67 (N/A) * vol-8fbcbddd (N/A) * vol-20ad501e (N/A) * vol-0d4358f8079033969 (mref1.sae1.stream.centos.org) * vol-01752d104a5b74e34 (mref1.sae1.stream.centos.org) * vol-b06520e2 (N/A) Region: ap-east-1 Region: ap-southeast-1 Instances: * mref1.apse1.stream.centos.org (i-04c65901c10aa0deb) Volumes - [id (attached to instance)]: * vol-33767b3a (N/A) * vol-21392b28 (N/A) * vol-0af88717d62f3f877 (N/A) * vol-07ff0b59dd9aaeece (mref1.apse1.stream.centos.org) * vol-070a536ac8d11a141 (mref1.apse1.stream.centos.org) * vol-0877f064 (N/A) * vol-2ba14e4b (N/A) * vol-70797b24 (N/A) * vol-495d4a40 (N/A) * vol-455d4a4c (N/A) * vol-6b425562 (N/A) Region: ap-southeast-2 Instances: * mref1.aps2.stream.centos.org (i-024b1404ea5660938) * mref2.apse2.stream.centos.org (i-083f09ef938afbe7e) Volumes - [id (attached to instance)]: * vol-08966b3a (N/A) * vol-011f429ea680a4fcc (N/A) * vol-014918822b1c2f691 (mref1.aps2.stream.centos.org) * vol-01601aada2f60c6cd (mref1.aps2.stream.centos.org) * vol-05e52eb95234f5465 (mref2.apse2.stream.centos.org) * vol-0e9848df3d7aa61b3 (mref2.apse2.stream.centos.org) * vol-010ad056 (N/A) * vol-6a894e59 (N/A) * vol-136f9b21 (N/A) * vol-2a53a718 (N/A) Region: ap-southeast-3 Region: ap-southeast-4 Region: us-east-1 Instances: * N/A (i-0b369063062ca52c9) * fedora-packages-ng (test) (i-0f15e4c4b9a49be4a) * N/A (i-0931da1d5eda4eb93) * Discourse-test (i-0eca039ae29709710) * mobrien-test (i-0b96a11ec696351a5) * N/A (i-0fc9ee46b558d8b43) * N/A (i-08c3bdc2cf1ad6c3a) * N/A (i-0b08fcde88335d021) * N/A (i-0854b37f391d8c53a) * buildlogs.ue1.centos.org (i-083312fa648640a21) * N/A (i-03a7d143db378408c) * copr-pulp-dev-old (i-083cc92eb3f9df0fa) * copr-pulp-dev (i-0dc6604b4d517bdcd) * N/A (i-088625e35e83fd5e2) Volumes - [id (attached to instance)]: * vol-00a1134d012b8618c (N/A) * vol-0f054fc977e292d7a (N/A) * vol-0e1f27f56d5e70685 (N/A) * vol-0a2e0c3a3825552e0 (N/A) * vol-0b485e1085984051e () * vol-0dc4d4d90f320ec5c () * vol-05180f7bf9fcac534 (copr-keygen-dev) * vol-0749c34ff6655165b (copr-distgit-dev) * vol-00d69ba2bd22822a9 (copr-frontend-dev) * vol-05d6160567d56ab37 (copr-distgit-prod) * vol-0b414449faa733f4e (copr-keygen-prod) * vol-0c6b76d3da6468410 (copr-frontend-prod) * vol-02a202ca9fbdceae1 () * vol-00840bfe9333eee83 () * vol-00715de8a3da2780a (N/A) * vol-0953f947daf155706 (N/A) * vol-0be047389daecc795 (N/A) * vol-06c2c4d56f8ebdbdc (N/A) * vol-0c9fdaa83aeba5689 (N/A) * vol-048a9767b99ba2db9 (N/A) * vol-048570eb7999fa696 (N/A) * vol-02a3433b411a3ab13 (N/A) * vol-0a7c2c7b82f4af72e (N/A) * vol-0f2a55e1d17f70576 (N/A) * vol-0c6c793c15a5f90ac (N/A) * vol-04784852659e63194 (N/A) * vol-08af7fdaa1ffed4aa () * vol-0573cd537ac825417 () * vol-0eefed9c134e2df15 (N/A) * vol-0abac03535e56228b (N/A) * vol-043364d9d0312a44c (N/A) * vol-00c7b006f042a8f2b (N/A) * vol-0ce671635b0c3c985 (N/A) * vol-0969062e005f599c6 (N/A) * vol-003384a4dc131084f (N/A) * vol-0a38fb3de4a46f50e () * vol-09c1e943aee32a917 () * vol-010276659ec19e5f8 (N/A) * vol-0b028e56f6db411ba (N/A) * vol-0d59358ba36893604 (N/A) * vol-03e37474f7f1755e5 (N/A) * vol-0ccc3ee06ea02a456 (N/A) * vol-03ec0c816b2dcc0e3 (N/A) * vol-025c47d62fb63418d (N/A) * vol-0012f6d8dab508b57 (N/A) * vol-0105464e6dbbdf0f5 (N/A) * vol-099605bff0998f1ef (N/A) * vol-079e9580aa3afebe0 (N/A) * vol-0de4d1696654116cb (N/A) * vol-086a905075e73656b (N/A) * vol-0bd5fc1143fe99fc2 (N/A) * vol-04d297c12e490a8bc (N/A) * vol-033111874a2f6db38 (N/A) * vol-091d177859babf3d5 (N/A) * vol-048599f9b0cb1b03c (N/A) * vol-0315fd5e1381ea6a9 (N/A) * vol-0d512fed86ddaccee (N/A) * vol-08228fc3fa8421858 (N/A) * vol-06045d63f0b9b308c (N/A) * vol-047a0d29b34fa4049 (N/A) * vol-00091c41e655ed4f7 (N/A) * vol-0ec92f0ec8b8e86e0 (N/A) * vol-094ff3bcc5acca40b (N/A) * vol-0a2c7dd4a3f56a738 () * vol-0e56add6a6999d4a3 (fedora-packages-ng (test)) * vol-078902c5902a0920d () * vol-0fecc0fda9d8fb632 (Discourse-test) * vol-0b59716906163e08d (mobrien-test) * vol-02e6c2ea6fb761882 (N/A) * vol-0f28fc9d82f07a6aa (buildlogs.ue1.centos.org) * vol-0f36e2735ccfaf8d1 (buildlogs.ue1.centos.org) * vol-09bda4cc18f9d62bc () * vol-022ae8f97e526d05b () * vol-05fc9ecf502e50756 (copr-pulp-dev-old) * vol-0c9159a0102e9d2b6 (N/A) * vol-08d532623137bf26c (mock-release-work) * vol-065881d7a890e2432 (copr-pulp-dev) * vol-0bb5ac500de6714ed (N/A) * vol-00c37c132fabd6c8f (N/A) * vol-04c263a57bd468d52 (N/A) * vol-08c82653f916a1f4f (N/A) * vol-0797f85279b683f8b (N/A) * vol-030c8492b14ff3553 (N/A) * vol-059b3abc628b450c7 () * vol-08e9b1b975a989431 () * vol-0b3da28b8a14a361b () * vol-021e1718cc43240f5 (N/A) * vol-0bd75fe8ebc9ee7bd (N/A) * vol-03098d29a32b04d9c (N/A) * vol-0c0eb19ec06006ff0 (N/A) * vol-0e1af24a2882b498f (N/A) * vol-0a9c0155e3bb157b7 (N/A) * vol-029e60bf3439c26e4 (N/A) * vol-0f34d70aebc723dcf (N/A) * vol-0a335a25b57a48baa (N/A) * vol-02cef29268d1a1cd7 (N/A) * vol-019b2be03a1cfbbfd (N/A) * vol-0a7d9774865f6d201 (N/A) * vol-0d4d29ae7de1a781c (N/A) * vol-0ecf8c2fab47e8bd8 (N/A) * vol-0fa60b6e3d82779c2 (N/A) * vol-0e30698181c5bf967 (N/A) * vol-087e75a123835762e (N/A) * vol-0e438216534ee7eeb (N/A) * vol-04467b93f7b7e12cd (N/A) * vol-07a88cd2080caecf9 (N/A) * vol-0120468a9a60ca6de (N/A) * vol-0c7fb67f9c7b8ba24 (N/A) * vol-0bfdd6e147725feb3 (N/A) * vol-0c37736d18eaa1768 (N/A) * vol-0d2bdedabb2941fab (N/A) * vol-092561392da691594 (N/A) * vol-0063fbee54fc03318 (N/A) * vol-0af301d88f8ffa119 (N/A) * vol-018480981007ef1c0 (N/A) * vol-078a8acaabcb5f44b (N/A) Region: us-east-2 Instances: * ms1.ue2.centos.org (i-0eae90c3ead2c197f) * git.dev.centos.org (i-07529514b33f47084) * attic1.infra.centos.org (i-09cd9e1078f297773) * git1.stg.aws.centos.org (i-00bd1fa0d29aba8fc) * git2.stg.aws.centos.org (i-088fbd0a4a03dc6f1) * mref1.ue2.stream.centos.org (i-0569d074d621d9c39) * pdns2.ue2.centos.org (i-033fb02cf6c10e2fe) * N/A (i-0278bbf7d7b9801b2) * N/A (i-07678cd3d615ca52a) * N/A (i-030bd89ccd0a66013) * N/A (i-01350e4dc91dd5f31) * N/A (i-01e07e6e302d60a4d) * N/A (i-07759ac45a275da45) * docs.aws.centos.org (i-006cf243e7f5acd04) Volumes - [id (attached to instance)]: * vol-0e951c8c9ce872fe6 (ms1.ue2.centos.org) * vol-015398ffddfcfe53e (ms1.ue2.centos.org) * vol-0e69449e0f02977f0 (attic1.infra.centos.org) * vol-07745919f4e5379b4 (attic1.infra.centos.org) * vol-0f6b9aaae6c1fd611 (git2.stg.aws.centos.org) * vol-04e1180a487d012af (git1.stg.aws.centos.org) * vol-079d65c005c149417 (pdns2.ue2.centos.org) * vol-0bd20acb90dcaa116 () * vol-07fa6789322a53ee1 () * vol-069b1284dd7f84d6d (stream-test-202307291912) * vol-0691bd932b8c4c700 (mirrorlist.ue2.aws.centos.org) * vol-0c2703c099eae864f () * vol-0b01e0523201f239b () * vol-0f72df80ec98fd257 (git.dev.centos.org) * vol-07689d14c28aa2e3a (N/A) * vol-0bfd16d9a47989ca4 (N/A) * vol-002caa3fe664365ae (N/A) * vol-08239d54bb2632920 (N/A) * vol-090889e15d882246b (N/A) * vol-0d07333d5b3a8a560 (N/A) * vol-06855c950909e8cee (N/A) * vol-02abc70fbf63fa425 (N/A) * vol-0cb6146ada48e7ba7 (N/A) * vol-07bb5acc2d1687549 (N/A) * vol-0560cdb93b8c98684 (N/A) * vol-06ed64db5a41adeb9 (N/A) * vol-00e75aa1f310224c0 (N/A) * vol-01fb2cfe12eaf3f1c (N/A) * vol-06a5b0cafc0acd8ae (N/A) * vol-018e164088fd3a3f5 (N/A) * vol-0e4f83deade7334d8 (mref1.ue2.stream.centos.org) * vol-0adb72af3aaa6daab (mref1.ue2.stream.centos.org) * vol-0e98a7ee0567f6099 (N/A) * vol-0fb6df38d7e61e46d (N/A) * vol-03d31c270a4ba2536 (N/A) * vol-0b1149f7862989fd4 (N/A) * vol-0bd34e2a1b50cd880 (N/A) * vol-0ee2584ca5df32a52 (N/A) * vol-00edbbd68e1d2bca7 (N/A) * vol-01b694b7462293229 (N/A) * vol-0dadd82b1ca73b922 (N/A) * vol-0eb790387e33ac1a1 (N/A) * vol-04844fad16c6bf9c3 (N/A) * vol-0a8a5f5cc6df386d7 (N/A) * vol-081553e7cc7a118df (N/A) * vol-02b1b5679444c5f36 (N/A) * vol-0513aee8673333d31 (N/A) * vol-002ebfe4728090857 (N/A) * vol-0dfef3beafa833980 (N/A) * vol-0d7ddfb8933f189ec (N/A) * vol-046864dcbed037300 (N/A) * vol-0e87fbb94aa689355 (N/A) * vol-096d2d42335caa33e (N/A) * vol-073481eb97f57c56c (N/A) * vol-0cf27387ff14dfbd2 (N/A) * vol-01cc3b65be613a83f (N/A) * vol-060414cb2f7d37586 (N/A) * vol-0525f57bac403c119 (N/A) * vol-00af4765bd9b6c4a4 (N/A) * vol-0abc1d334cde46263 (N/A) * vol-0c53c1d8ad4fede81 (N/A) * vol-0aed8a13febe1a51e (N/A) * vol-036ac11242c0f1b80 (N/A) * vol-00387eadbbe442036 (N/A) * vol-0eeb10a290b3f3cbf (N/A) * vol-0b272016177181cfd (N/A) * vol-00ff3291b13eed9ad (N/A) * vol-0b9f71875a961e586 (N/A) * vol-05085022158f7e7bd (N/A) * vol-0fb649ce819300757 (N/A) * vol-07734677f247dfd66 (N/A) * vol-01ac25fb07a0c5a15 (N/A) * vol-0d9e787f60dab0df3 (N/A) * vol-0455b9f039d48e855 (N/A) * vol-0b2aa83f8ec584580 (N/A) * vol-01a01efa620996021 (N/A) * vol-0d5bd88f2601a0f97 (N/A) * vol-0f7f97faf21e995c2 (N/A) * vol-0cba932b39c636b9c (N/A) * vol-00929bb4a11e8c415 (N/A) * vol-02d6689a8ff38b579 (N/A) * vol-08b26c60a5baa8865 (N/A) * vol-0e2b292e5aa3165d0 (N/A) * vol-0561068ff6b85a871 (N/A) * vol-0b4037f0cc6d37930 (N/A) * vol-0c865b9b89357b0bf (N/A) * vol-06f1f1adddfe9ce50 (N/A) * vol-06fc3608f5c5d9380 (N/A) * vol-0eef57596232592ee (N/A) * vol-00519e2179ce57fa7 (N/A) * vol-0dfeb7d2894f3bd5c (N/A) * vol-0079a2565cebd5e2a (N/A) * vol-09c87dda422f07194 (N/A) * vol-04916a2a22adf0990 (N/A) * vol-0f38640615b12dba0 (N/A) * vol-025cccce466678815 (N/A) * vol-0c0c67e1e08d5fb60 (N/A) * vol-0f45ad0b9a2061b31 (N/A) * vol-052282a9e9297a14c (N/A) * vol-011c7bfde090fee06 (N/A) * vol-0fa97737707089547 (N/A) * vol-0bd9c88ef6effdbe6 (N/A) * vol-09a08b4430de09033 (N/A) * vol-05aeb212b75f5d128 (N/A) * vol-0e9060ca9292c23f1 (N/A) * vol-0fdfad3ef2b26cd73 (N/A) * vol-03617eee5c7f49389 (N/A) * vol-022721fcd27da20ab (N/A) * vol-0362a49b3a741e83f (N/A) * vol-0273453f4f3fef36d (N/A) * vol-0594c400dc531465c (N/A) * vol-0223c52ca9ead68e5 (N/A) * vol-0504f42906ee00da5 (N/A) * vol-0d0b71159461837d7 (N/A) * vol-021c68e1d16fd4032 (N/A) * vol-027f1968fd6e660a6 (N/A) * vol-0bbb83acef6e47489 (N/A) * vol-0fe71642aa678eb61 (N/A) * vol-0b16b0a5a7dae92ca (N/A) * vol-043fb81ffe3ad1231 (N/A) * vol-0713570ef85094a20 (N/A) * vol-000adbf9b7e28878f (N/A) * vol-0e9ef28d7e8940355 (N/A) * vol-0f804970d3b227c8f (N/A) * vol-0633a41378aaee546 (N/A) * vol-0f776abf94ccf25c7 (N/A) * vol-06a859ec3d676409b (N/A) * vol-0c24253ed420eba37 (N/A) * vol-03d91b78d7d82ab38 (N/A) * vol-08789adf5dce9a9c8 (N/A) * vol-05c11584dfab014c9 (N/A) * vol-0df44c480e44ff62c (N/A) * vol-0bf9f1f3245f6be12 (N/A) * vol-000dd0186e508ffaa (N/A) * vol-06869e453564b66ef (N/A) * vol-03f1b35fa457efcd5 (N/A) * vol-0bba76294e709c7c6 (N/A) * vol-0e0d64454625c25bf (N/A) * vol-0cf1c9dc23bd7900a (N/A) * vol-06dadb4cd7832ec16 (N/A) * vol-06db05d36f6821256 (N/A) * vol-062a34b84c4456986 (N/A) * vol-0cbbb393d34115bde (N/A) * vol-01c78d175247aa5ea (N/A) * vol-067995dc7a4a6cdcc (N/A) * vol-0d6aaa6003e5f4fa4 (N/A) * vol-0d9ef6a35e23c1c9f (N/A) * vol-01bf79ecba1aaf1fa (N/A) * vol-0d6a4a3ebd504a6ba (N/A) * vol-0782b59886c5a6cfc (N/A) * vol-0cdc33706a6a08518 (N/A) * vol-0c30473bae6c70950 (N/A) * vol-06267234dd2de1c1f (N/A) * vol-0fbcc77ef24ddb50b (N/A) * vol-04ec3a87ba6994569 (N/A) * vol-0fce9f41d82ae7107 (N/A) * vol-022538344eef1cd1b (N/A) * vol-0b8500280b6bc244d (N/A) * vol-022d68c33aed04092 (N/A) * vol-07c07ab3713f3adb0 (N/A) * vol-051270e7c9ecb1f67 (N/A) * vol-0b979b6fe65b2bdb9 (N/A) * vol-0119701b2a7f4609d (N/A) * vol-0cd9f88ffe9924710 (N/A) * vol-0aae3667794191c57 (N/A) * vol-0182435613ce2bf92 (N/A) * vol-0776e7beb92d104b4 (N/A) * vol-08652118ddf73542a (N/A) * vol-0ab680a64632db104 (N/A) * vol-0f39f45b9554b765c (N/A) * vol-0e1600a9e66d11e67 (N/A) * vol-040aa323f11f047d7 (N/A) * vol-0edd838c4f8a1b7a0 (N/A) * vol-0768d5ef0298191bd (N/A) * vol-0c23214159f858e85 (N/A) * vol-025077d9a5f2253dd (N/A) * vol-0cf183eb3a964c1b0 (N/A) * vol-016b2b3f18911877b (N/A) * vol-04e6831ee3d9dd582 (N/A) * vol-0ae136f4f5c43820c (N/A) * vol-04df782e18f21b4c6 (N/A) * vol-0ee80ff511e24daff (N/A) * vol-0056c4e25f3618f94 (N/A) * vol-0a4a4e22af888027a (N/A) * vol-056597febc5713ccd (N/A) * vol-01e594e1484aca117 (N/A) * vol-064de669984247caa (N/A) * vol-0ce58ce5a6c358659 (N/A) * vol-0ac92374674c3b7c5 (N/A) * vol-0ca456968aad0e7e2 (N/A) * vol-0edcbf43502e4585c (N/A) * vol-0c40249839be6b9c4 (N/A) * vol-0203966a60b8f4264 (N/A) * vol-0736a57d7b376d938 (N/A) * vol-0dae9616418c07ac5 (N/A) * vol-0dfb3133ace190782 (N/A) * vol-07a547c31b821d8be (N/A) * vol-0bce6785c8ada185f (N/A) * vol-0cf852dc1c934d154 (N/A) * vol-00a46366c4ce56ef5 (N/A) * vol-049b59043377aefef (N/A) * vol-066d11aa729f1db1e (N/A) * vol-061c7801b4223c10f (N/A) * vol-02cdc82a5a3248ce2 (N/A) * vol-0924bab9cf1be2082 (N/A) * vol-03c4c700dffa12d4e (N/A) * vol-043c05c9b090cc6aa (N/A) * vol-0e00d3c948f151357 (N/A) * vol-0052056e47c44d5ad (N/A) * vol-0f6f73d386d3e122c (N/A) * vol-0025efc6123b99854 (N/A) * vol-0072a409a21df972d (N/A) * vol-0d66b05c45cef6ede (N/A) * vol-088fba2b569e5b970 (N/A) * vol-0359d26e76915a5a3 (N/A) * vol-06d473f18f838a8e0 (N/A) * vol-0c0d94e7afa53be72 (N/A) * vol-0b5de8bc7747ab508 (N/A) * vol-0303239170605bc5e (N/A) * vol-033ec35f93bd64659 (N/A) * vol-09e0a2f1d3ba348d2 (N/A) * vol-05318e5d36f11def9 (N/A) * vol-08d061d6dd5871930 (N/A) * vol-0f813507ea57bc5f9 (N/A) * vol-02b8ede1512122ef2 (N/A) * vol-0608b134765667d0e (N/A) * vol-07d8b84b7beb58366 (N/A) * vol-0f20f13190dd4f5d1 (N/A) * vol-0d28f2cae1df746ab (N/A) * vol-0bbf57b943d34bfbc (N/A) * vol-0d15448e4406c7fa4 (N/A) * vol-0e2ee1a1c2f92436a (N/A) * vol-0ba6ef19c80a5dffa (N/A) * vol-02b4b83802353701a (N/A) * vol-0592521288eb17700 (N/A) * vol-00eb6321368fe8d46 (N/A) * vol-0da175ee068453d4f (N/A) * vol-081d30f6fab35008d (N/A) * vol-022ffab2b7e1df966 (N/A) * vol-0ab4c729de4913935 (N/A) * vol-0f50430322782ed43 (N/A) * vol-07b9b49a06c91b575 (N/A) * vol-0098cce65c340319e (N/A) * vol-0475da58763cf15ba (N/A) * vol-00f671524c634711e (N/A) * vol-0564f5731bef688bd (N/A) * vol-05c55dd9b89790b84 (N/A) * vol-0ea1309c141d51dfb (N/A) * vol-0936f73732a33584f (N/A) * vol-0a49a049130a8e2a4 (N/A) * vol-01ec0a0f051ca23ea (N/A) * vol-02cbb69eed01716f3 (N/A) * vol-01e99262d8e94d72d (N/A) * vol-039da51a323341de6 (N/A) * vol-06821e059a77e08dd (N/A) * vol-0236742dcfac8b6fc (N/A) * vol-017707a36a8a4fd0c (N/A) * vol-066ddf60ece0bfdbb (N/A) * vol-098331014a6512909 (N/A) * vol-09e8db89ff088f0c6 (N/A) * vol-0bb49e592e4e62bbe (N/A) * vol-002ea42d41cf30870 (N/A) * vol-0a0266ce0a899347f (N/A) * vol-0a604ad5cec3fba00 (N/A) * vol-0d7fb252a165ebec2 (N/A) * vol-081ab8114d6cb7694 (N/A) * vol-0fac363bdf3f57430 (N/A) * vol-069c2a609f9bbcb04 (N/A) * vol-04a9afcdc457e26c2 (N/A) * vol-0786c5dbfc7582650 (N/A) * vol-0597971b191ef2d5f (N/A) * vol-0549bfcd27e1f68e7 (N/A) * vol-044607807167cbd40 (N/A) * vol-04017004ab04e01e2 (N/A) * vol-0127312d7109f6798 (N/A) * vol-0120f68cfe482b119 (N/A) * vol-004468e40682430a8 (N/A) * vol-0560c91acb8a41906 (N/A) * vol-0f148853b03190756 (N/A) * vol-058edb27a194ea3bc (N/A) * vol-0d4ac143469e75a29 (N/A) * vol-0999ed1eb359dc765 (N/A) * vol-0c3dafbff18c5b4d6 (N/A) * vol-00660e647f4fb4d1f (N/A) * vol-042de25bfed1185bb (N/A) * vol-0d13cf4be4c0793d1 (N/A) * vol-05124459edaa2be23 (N/A) * vol-0cd2914b21ea33113 (N/A) * vol-057a86d547d7eb286 (N/A) * vol-01abf1a0fbdda09dd (N/A) * vol-0318060e4137fa48c (N/A) * vol-0015237d831240d09 (N/A) * vol-08f033ec92625a492 (N/A) * vol-002eb8c57e571c238 (N/A) * vol-01f4dbaafc8691901 (N/A) * vol-0f4ae3588dcb62678 (N/A) * vol-05ab8a89117d5da6b (N/A) * vol-025e3ca246d0b7917 (N/A) * vol-0f94198034b58e3d8 (N/A) * vol-0bf92ce72dde35b36 (N/A) * vol-0ae710175859de429 (N/A) * vol-07da56772588b9bec (N/A) * vol-0c49b638ab70bac0c (N/A) * vol-0a56bc7bde2af5bef (N/A) * vol-003060371f88afc63 (N/A) * vol-0040f07dd9a75ae74 (N/A) * vol-08f02e2aff1e5a993 (N/A) * vol-05eac36e5bcd1e2d6 (N/A) * vol-07917742372f07f8e (N/A) * vol-07252ae5b0846adf2 (N/A) * vol-096ddd268ac45c76f (N/A) * vol-0daece89fc48a7333 (N/A) * vol-0a53d9c2a955d37c9 (N/A) * vol-017d93982bc7b5b86 (N/A) * vol-0747e81a98ebe5a25 (N/A) * vol-00dbcf8165f1a3a4f (N/A) * vol-0354547b729c40449 (N/A) * vol-0810a8f6d7bf6a1d5 (N/A) * vol-09cefa72f6a0eb97b (N/A) * vol-0926c068e86d5f234 (N/A) * vol-0c2c11c4b12bd1d87 (N/A) * vol-0b05143092906bdb4 (N/A) * vol-0b28c933b9000eb97 (N/A) * vol-00ee41eae33f967e9 (N/A) * vol-0ff2d95be07baba23 (N/A) * vol-0d9ec9684a5b29f06 (N/A) * vol-03494b54440fb9246 (N/A) * vol-05cac710054af5cdd (N/A) * vol-0add9412102ce0e64 (N/A) * vol-08b80cd97ced70f41 (N/A) * vol-0ed69695f3a7f3bed (N/A) * vol-0874a4cb18cf313d6 (N/A) * vol-07452588d00f5e39f (N/A) * vol-0c06f29a6b52966ac (N/A) * vol-09a006d9dca593f77 (N/A) * vol-0b2e2af30e9a190f9 () * vol-06a266ddeeacd4c31 (N/A) * vol-0d7123b036e42ddda (N/A) * vol-0fdc8d1c1d99caf9a (N/A) * vol-066791c61ba4a9829 (N/A) * vol-00dcc0fc28341dd79 (N/A) * vol-088d99f8630c6de67 (N/A) * vol-03d2c62b975296b0b (N/A) * vol-0551b44293f17b907 (N/A) * vol-0041d5308d66090a7 (N/A) * vol-080969c773bdef101 (N/A) * vol-044147f85a28a1b13 (N/A) * vol-0bb0a669d90394363 (N/A) * vol-032c78091002e0328 (N/A) * vol-03f83de03cf6c4421 (N/A) * vol-0aaf528e9c68006bc (N/A) * vol-049a86d7c9de84916 (N/A) * vol-0ca85be8386463d08 (N/A) * vol-0cfe2b1475443494a (N/A) * vol-0b7b29566e77bfcef (N/A) * vol-04a96992977257826 (N/A) * vol-012e5820d46ef5f1c (N/A) * vol-09b242f2d3947a12a (N/A) * vol-0567739cfa810948c (N/A) * vol-0e808ab0e425e7aee (N/A) * vol-07f870f26e511b6d5 (N/A) * vol-03238ab9579eca946 (N/A) * vol-0d5ed0f61b57ab126 (N/A) * vol-03bcfe34101ff703d (N/A) * vol-0109808d4ec4694ce (N/A) * vol-052ade626337fb920 (N/A) * vol-03e1eee5597815473 (N/A) * vol-0c2e23a673a452b0f (N/A) * vol-0b945e8a7d5cafc18 (N/A) * vol-05f0554add0529ba7 (N/A) * vol-076a7ce3afc2bd97a (N/A) * vol-01f9647e90e3abc47 (N/A) * vol-0589eb69845cada22 (N/A) * vol-0d393c9f0cbadd0a0 (N/A) * vol-0aca39918894fddfb (N/A) * vol-047859d98ab8f0c4f (N/A) * vol-0c8049be0f1e2909d (N/A) * vol-083bb11819b5dded8 (N/A) * vol-0e6ba19254eb34960 (N/A) * vol-09073f4ee79b0277b (N/A) * vol-0f78340c22910d744 (N/A) * vol-0215b14a6d272ecea (N/A) * vol-050a9ab7d6b2b9982 (N/A) * vol-0581d3d0642b6823e (N/A) * vol-088568406311f1b8c (N/A) * vol-08128eaa9173f3f3c (N/A) * vol-055be505424a8fbd9 (N/A) * vol-0e356a92135300e35 (N/A) * vol-03255a8bf70de64f7 (N/A) * vol-005792fe711482084 (N/A) * vol-07fe59ac6e7786952 (N/A) * vol-0f6ff15cad81ce0eb (N/A) * vol-08cfdf128eeb9fa63 (N/A) * vol-0a2b57c5f09a2e0db (N/A) * vol-0fc4d89811d4dda0a (N/A) * vol-047b9e0cec55aef6b (N/A) * vol-0f9952d7765ccdc36 (N/A) * vol-079382306326c597b (N/A) * vol-07c2ea3eda655f86b (N/A) * vol-09008e6cae8bb657c (N/A) * vol-0193ce71d5ac64232 (N/A) * vol-0062810e2f3601f85 (N/A) * vol-0bf77c69b6b37964b (N/A) * vol-0b7c3c33ed026fe8b (N/A) * vol-067ebfbd45cb58236 (N/A) * vol-0a35d1fe076ac5c38 (N/A) * vol-00edbcba5c0b2425d (N/A) * vol-0ff862cfa22ee991c (N/A) * vol-074824bb5e8fb9521 (N/A) * vol-08f023e80e48b7090 (N/A) * vol-01d8c81b78f236214 (N/A) * vol-03eeee2cd852cd915 (N/A) * vol-019d305852ef8332f (N/A) * vol-0724a6586834a23e5 (N/A) * vol-09a204b772e717ffc (N/A) * vol-0f8622abafb8f8749 (N/A) * vol-0ae0c3c774353591c (N/A) * vol-04f5b9a75f8159a7a (N/A) * vol-04df0ec4bab620cf2 (N/A) * vol-06481633c023999ad (N/A) * vol-07750f3e383203d21 (N/A) * vol-08ff5550205e99185 (N/A) * vol-045d2fbcce26e1a20 (N/A) * vol-061d5606e34ecfe5f (N/A) * vol-072b4fa2bdec5cda3 (N/A) * vol-0f9e0c4f64fd89655 (N/A) * vol-0d0283d8c04476a92 (N/A) * vol-0739ccb1a2ad9716d (N/A) * vol-00fa87a8d55d5f9be (N/A) * vol-0768b4dbe737c22fc (N/A) * vol-03b3bf6ed5997ca61 (N/A) * vol-0a98db0aace3014ab (N/A) * vol-0fb0b932020721a4f (N/A) * vol-064a0b0075c9cc1a6 (N/A) * vol-005ac4acf3b513dad (N/A) * vol-0242dd4c4d15bb92c (N/A) * vol-0d7cb34384ec96297 (N/A) * vol-00eb0bed65065b08b (N/A) * vol-050860d0518084a18 (N/A) * vol-0e4659b2b3f84b0b4 (N/A) * vol-078a58237eead52d8 (N/A) * vol-091fe2cd425e2b6ec (N/A) * vol-0f49caa76ded78f24 (N/A) * vol-01c1329d77b53e7a8 (N/A) * vol-08b37be0c85df43e6 (N/A) * vol-03a7b5b8bd7e20747 (N/A) * vol-0648f1373c5b83333 (N/A) * vol-0b7e6deabd2c80cb2 (N/A) * vol-02e07db8216e83f03 (N/A) * vol-0cac6618e823c03ff (N/A) * vol-08d1c340529b1ba60 (N/A) * vol-0a7d8969d8614a4ab (N/A) * vol-0eb9d5decfc60326c (N/A) * vol-0d15dc7f3ff1f6996 (N/A) * vol-0485109622ce294cf (N/A) * vol-0f0ef70cae8bd5491 (N/A) * vol-0e9bc2d817ecdf64b (N/A) * vol-0685ac60f87696fd0 (N/A) * vol-09a2e4a4a511a7357 (N/A) * vol-0c4e3be8d90fdb39b (N/A) * vol-0a8cefc9f03bd8e54 (N/A) * vol-05ea7347a10e2154b (N/A) * vol-08aa745c2b58c718f (N/A) * vol-0a7d69b738d014675 (N/A) * vol-0d8d301a1352102ac (N/A) * vol-068aa1eb96b12025c (N/A) * vol-01de0c111c3e581ff (N/A) * vol-0d7fd1d3ee9ede82e (N/A) * vol-0a2c25f9db10ec7c8 (N/A) * vol-0563bde423446d001 (N/A) * vol-049b9c0da27ce9db9 (N/A) * vol-0cb27acfe4c040ed6 (N/A) * vol-0dd4142610e08d9a2 (N/A) * vol-052951e9362a3ed7e (N/A) * vol-02179af804cee3228 (N/A) * vol-0c459a12c84227272 (N/A) * vol-03c28589c86a23c40 (N/A) * vol-09651bfaa14227190 (N/A) * vol-0a58bee51a6875187 (N/A) * vol-0b29fbdf4e8b28676 (N/A) * vol-0ecca29b2e3f02edf (N/A) * vol-0ba37d6b63dd92466 (N/A) * vol-09ad2584619766469 (N/A) * vol-017d3fc3b2bb96b7b (N/A) * vol-01bcd08f53d78f62c (N/A) * vol-0253927d1d98cf943 (N/A) * vol-0b70f431bd296de68 (N/A) * vol-033dd5ddf080fbea9 (N/A) * vol-0260e8ae395fe7798 (N/A) * vol-0797712a93577a846 (N/A) * vol-0fbb2de982341264d (N/A) * vol-0df5bcead12b0c91a (N/A) * vol-0eca0540e76d1028e (N/A) * vol-09a0b559a75dfc989 (N/A) * vol-05fcf1d7f9768ed6e (N/A) * vol-0dbbd344de39efa8f (N/A) * vol-0fb82d5e23fe622e8 (N/A) * vol-0cb852739252e0734 (N/A) * vol-0367ef06886486c8d (N/A) * vol-04780fa68fc8b1ba6 (N/A) * vol-0dcee1c3e70896c1f (N/A) * vol-069309e96d28c4226 (N/A) * vol-009bd9830aa8927e8 (N/A) * vol-06adc5de77ca3e557 (N/A) * vol-09cc80d18850c2151 (N/A) * vol-0910a174b1f7d16f0 (N/A) * vol-0b009b4d3399195d3 (N/A) * vol-0d5d79ce4d5119846 (N/A) * vol-0b00d50221e7d10ce (N/A) * vol-0019abec407f17c2d (N/A) * vol-0fbe49be41de7a540 (N/A) * vol-0bc5f7ca46c554ae4 (N/A) * vol-05607bad6996dc677 (N/A) * vol-02d32247406e13725 (N/A) * vol-0df42f97c532dd269 (N/A) * vol-0c7bdb89846f54d46 (N/A) * vol-05e52d6e72d22e023 (N/A) * vol-093a9e5aed52a5073 (N/A) * vol-08060e8d076e7a435 (N/A) * vol-0d5c46315a57a2d48 (N/A) * vol-04b4faeaef6b64574 (N/A) * vol-01025ac8e7cc6818d (N/A) * vol-0f7371083b9530212 (N/A) * vol-032d078b443ee03d0 (N/A) * vol-01a5fb63c1c504469 (N/A) * vol-03e4a47dd5bb991a3 (N/A) * vol-0d8d23d71eb07d3f1 (N/A) * vol-02c3e4af47910bce6 (N/A) * vol-0411f72b48c564742 (N/A) * vol-09c71e32eb4790ad8 (N/A) * vol-00900a08dd8ae741a (N/A) * vol-01dc692b6c406a56f (N/A) * vol-02e7ba30e3e79aef2 (N/A) * vol-037466906cba45b3d (N/A) * vol-088759ff74f552331 (N/A) * vol-0f6f36d49dac698e8 (N/A) * vol-0a633c3443032a4db (N/A) * vol-090d3167ebade79a0 (N/A) * vol-0cfae1d781122f9dd (docs.aws.centos.org) * vol-0304008769cd5736a (N/A) * vol-004f73e80b07b5b23 (N/A) * vol-0edc7bf6ad60c93db (N/A) * vol-0335f8370575aa065 () * vol-05801a05ce41bd236 (N/A) * vol-0e2d53cfa7931bc03 (N/A) * vol-0c619180097eb7675 (N/A) * vol-0b5d5b59ee09e49cf (N/A) * vol-0e790240df7aa967e (N/A) * vol-0307b4cd8a4365c0c (N/A) * vol-0918b2d9e042eaa7c (N/A) * vol-0b8d903ae288ae9e5 (N/A) * vol-05fa50c7954813aaa (N/A) * vol-056a9b17e65cb7300 (N/A) * vol-065210ec1f4323b82 (N/A) * vol-07105ef3ff5c14e69 (N/A) * vol-0adfe5fea60d11675 (N/A) * vol-00dfcfe1a0abcbf66 (N/A) * vol-094fe449cf5775f7f (N/A) * vol-0ec1179ddd2112e3b (N/A) * vol-06ea9054b76af90d5 (N/A) * vol-0f078fc7f49521d95 (N/A) * vol-06f78ec93e5f53bd5 (N/A) * vol-0d11ded24dbd37613 (N/A) * vol-000d6d1185e2ee0bb (N/A) * vol-09604b8bd34ad6989 (N/A) * vol-086a8651bc52adf5a (N/A) * vol-0fb6ac4278f60c60b (N/A) * vol-0e3cb6733f8553daf (N/A) * vol-0a907ac1305c2697a (N/A) * vol-076222aaf4df2c699 (N/A) * vol-0327f7cf388226e26 (N/A) * vol-0a7c3a74dc3767c23 (N/A) * vol-041155ce772461787 (N/A) * vol-0a4300068be1bb276 (N/A) * vol-054140e724f58c044 (N/A) * vol-0d29eb1d2bc975b54 (N/A) * vol-0d6dc6637a82d128b (N/A) * vol-045c6fe74a66d2521 (N/A) * vol-0600eadfd3a3d6473 (N/A) * vol-0e8a0c348192ebff7 (N/A) * vol-0f00079b1941ee764 (N/A) * vol-0ed67b69bee3dec37 (N/A) * vol-0198f821be51952a6 (N/A) * vol-0cf6db8556611f37d (N/A) * vol-06e7e4b301b1a5d32 (N/A) * vol-0767f8b74865a86da (N/A) * vol-0b82a6eec49c964db (N/A) * vol-0c2800c821cf95b21 (N/A) * vol-0551ff55b4cad8e31 (N/A) * vol-0c7e780dca6764cc6 (N/A) * vol-036bf562e81ec32b6 (N/A) * vol-0e509550ec18259f5 (N/A) * vol-0b988b7fbd79019ce (N/A) * vol-04b8ff3622afabdbb (N/A) * vol-0845b8c1074a25915 (N/A) * vol-0a9b0c88228462a16 (N/A) * vol-0f0ee511c24a08f7d (N/A) * vol-0a93ea5ac1587c736 (N/A) * vol-067fa7854801f334a (N/A) * vol-004784fedb4577715 (N/A) * vol-0849965b14f7381ee (N/A) * vol-0d41d8d51ceca841b (N/A) * vol-09e601ab571ce6852 (N/A) * vol-0813f237b40e8f2a4 (N/A) * vol-06142b4625c66690d (N/A) * vol-08fb92d1146d6b871 (N/A) * vol-03ae4fdb8261e2bab (N/A) * vol-065c8fb184725eefe (N/A) * vol-0622ffef82962096c (N/A) * vol-0586561f870c5f5e6 (N/A) * vol-08df6c99caf40b108 (N/A) * vol-0e1786b0efda960fa (N/A) * vol-0e89937750d2fbbeb (N/A) * vol-0b75639bf14faa2c6 (N/A) * vol-0d94b051c1044efb9 (N/A) * vol-023abbc9b17275c98 (N/A) * vol-030f74286bbc33ee7 (N/A) * vol-0d53adbef8e6864ba (N/A) * vol-05bf50ac8863c5f95 (N/A) * vol-0a5a2a75ac87cf861 (N/A) * vol-004a8776d70440932 (N/A) * vol-02c97aab3ab9f1f5b (N/A) * vol-0824d9924cd02a9de (N/A) * vol-089a8e997ccc89f2f (N/A) * vol-03e6b396ee2d4e89f (N/A) * vol-015f21b5e091f5bc6 (N/A) * vol-03aa95bc691cf4bb0 (N/A) * vol-03d79fb7d195dc187 (N/A) * vol-0efafc1a59d22e0ff (N/A) * vol-089890e5023bdc8a3 (N/A) * vol-035085a1ec38e87da (N/A) * vol-097b7cd94015552d5 (N/A) * vol-0d5d75a3c82fa6f6a (N/A) * vol-08f18c4223b5ca032 (N/A) * vol-06e3132ba305e71c7 (N/A) * vol-05e520d10672c51e3 (N/A) * vol-08477242c58a6f360 (N/A) * vol-0d4d30a0acc8f1fda (N/A) * vol-0ed6691ac972c5ea4 (N/A) * vol-03d228815b8556c71 (N/A) * vol-078739f292b801bb8 (N/A) * vol-0489fc298ed07323a (N/A) * vol-04d6e0ba07d63f9b9 (N/A) * vol-063954e053e3624dc (N/A) * vol-01446f0baddcdfa33 (N/A) * vol-0a76534bd99b8dcc7 (N/A) * vol-02427a757a2ff09c5 (N/A) * vol-07e5ef161e5606878 (N/A) * vol-0b9dc7a9d2f62e0bc (N/A) * vol-09a61b4bf2b684e15 (N/A) * vol-0427118a224a6f508 (N/A) * vol-00ee21eef82a65ca1 (N/A) * vol-097b63d4ed33579c5 (N/A) * vol-03818f480cac2086b (N/A) * vol-04cb3858c343f7c2b (N/A) * vol-0e036c5d5dfade73d (N/A) * vol-057b0458608fe3e2b (N/A) * vol-0e8a774af59c2ee55 (N/A) * vol-0c8178534ba1d7d5d (N/A) * vol-05b1e2dab19521f1c (N/A) * vol-09eff8f6fa24756d8 (N/A) * vol-0432b9bc64d03d9bf (N/A) * vol-02286e4bb09be4f52 (N/A) * vol-0bf65dcb35e9a9b74 (N/A) * vol-0530b1121ba6c748c (N/A) * vol-01fa68be37a350064 (N/A) * vol-04aa2a8d834837bf1 (N/A) * vol-015d32e057e2f120d (N/A) * vol-04fd435cfbf54b5e4 (N/A) * vol-06bcc3829b8022619 (N/A) * vol-0f3608b6c40fd9175 (N/A) * vol-0f4b3843d71df8d72 (N/A) * vol-07a331f5bc1513bc2 (N/A) * vol-090687ef7587bfbc3 (N/A) * vol-0606c8631a95c909c (N/A) * vol-0b9b3f357867aa8da (N/A) * vol-061f0e067df513cb3 (N/A) * vol-03e92032a5d9021dd (N/A) * vol-08f959d028b9b8b54 (N/A) * vol-0980f57f9c63a9b6e (N/A) * vol-0a2c37bc7b56e7db3 (N/A) * vol-07703f787e8189ec3 (N/A) * vol-0ed2abe6a8eaa4da9 (N/A) * vol-0ec7fefc37d13f39d (N/A) * vol-0c79790d29d52b3af (N/A) * vol-0bdc3326030b030e1 (N/A) * vol-0ee5282d592db9627 (N/A) * vol-01923e42eaf83abc0 (N/A) * vol-0be722ddab43142b2 (N/A) * vol-0a6768d83398f5dfd (N/A) * vol-015fc12c68b3257e8 (N/A) * vol-05e98e822d49c7394 (N/A) * vol-0a684a39f442c18e1 (N/A) * vol-0d86041103272dfc7 (N/A) * vol-03a0522f2dbe7e0bf (N/A) * vol-0993e41da6bccc779 (N/A) * vol-00ebce262f3569b75 (N/A) * vol-0550350ef5b4e317d (N/A) * vol-02f4a28dcb79c3d0a (N/A) * vol-0f16300c50ebc8f5a (N/A) * vol-0dbf4a9cef52dfacc (N/A) * vol-024d96f5babe340e6 (N/A) * vol-08a488de4910ea9cb (N/A) * vol-0765d3ef4fde5bd02 (N/A) * vol-0c6426310326ff422 (N/A) * vol-06529456293c393fc (N/A) * vol-008a8c88d3a979387 (N/A) * vol-05c46abc66cc71a9e (N/A) * vol-037f1795cf898c248 (N/A) * vol-0d0410d3a71af7505 (N/A) * vol-041adae94fe58dac4 (N/A) * vol-0e8eda7fb1c51c754 (N/A) * vol-099b43486526a45b4 (N/A) * vol-073526beb9a1c1f36 (N/A) * vol-04d4ab2d9e5a8b1aa (N/A) * vol-0455f80f084d53623 (N/A) * vol-0ad5c60675084bf9f (N/A) * vol-0aa6b673c0944d3c2 (N/A) * vol-0c2844d5f38f916b2 (N/A) * vol-0dd9527340262b8ab (N/A) * vol-092e4b9ed714c5f26 (N/A) * vol-0ab08e5e12a925d25 (N/A) * vol-0566872bfa6caa877 (N/A) * vol-0e432af1214295737 (N/A) * vol-0947f3d950fdb4b35 (N/A) * vol-0ebf8827eeb22b64a (N/A) * vol-0e5bf61a9ea4433e5 (N/A) * vol-0371a21a3b09bd66c (N/A) * vol-0a99b1402fcfd7d95 (N/A) * vol-0768b4770af5a0e44 (N/A) * vol-0dcc588cd6ba686b6 (N/A) * vol-0cd5216ca2a1bede3 (N/A) * vol-06d8c1e5cfccec7d3 (N/A) * vol-0a369b1639e8f1451 (N/A) * vol-0c2ee70086295c88a (N/A) * vol-0b4bd0b7a3b04cb2b (N/A) * vol-059235e4c4add5e80 (N/A) * vol-0e3bac2fc3326e328 (N/A) * vol-06b4eb85494967c49 (N/A) * vol-02475228dc925d317 (N/A) * vol-06472da16eaf51969 (N/A) * vol-038960dd93b512239 (N/A) * vol-0701a00cbfb2119fb (N/A) * vol-0aa279cd5c9b7c1d0 (N/A) * vol-07e281bae516b5450 (N/A) * vol-03dec34866efa9b01 (N/A) * vol-0a90c289eda48f0cd (N/A) * vol-001a9e10764fd9c42 (N/A) * vol-05d5418662868fc12 (N/A) * vol-02e3c196bb59db0ad (N/A) * vol-0b53e98895b1c7b18 (N/A) * vol-0d59ed04c91969751 (N/A) * vol-0eed99fa06a0d7d5e (N/A) * vol-09e1899e1eeb92ff5 (N/A) * vol-037e47d69a532ea9d (N/A) * vol-0bd7d0d3cbe19cead (N/A) * vol-08bd27009ce4c4cf8 (N/A) * vol-0642cc4fdaf5149a3 (N/A) * vol-0f2a2c4473a5cb53a (N/A) * vol-09e120d455f869e1f (N/A) * vol-039fcf2893ff83ce5 (N/A) * vol-065e01ac39f209909 (N/A) * vol-0485e7cab4303e392 (N/A) * vol-00c61d3660faabc6e (N/A) * vol-09051d6e858d66c4d (N/A) * vol-05d936fb4a55c47e2 (N/A) * vol-0e71af65cf81d90cf (N/A) * vol-01ac6dbecce3281cb (N/A) * vol-03eb1b9a1189698d8 (N/A) * vol-098c895be425e69c8 (N/A) * vol-0dd987cb37d6ca5bb (N/A) * vol-00d18a9fb715d4670 (N/A) * vol-06742ced9552bbd9a (N/A) * vol-08a94e6662a58cb18 (N/A) * vol-093b52d11f4237b57 (N/A) * vol-028392f38a3c0ea2c (N/A) * vol-0fea146394eab7a03 (N/A) * vol-05979dea35deaafc5 (N/A) * vol-024bd2d5c3e34fe9b (N/A) * vol-063f20263a7883921 (N/A) * vol-0dbb963c26d1fbab7 (N/A) * vol-0dbeaff46301e8049 (N/A) * vol-09591d1b0aab65699 (N/A) * vol-07f8d5a8d6ca80761 (N/A) * vol-0ed31493a57069c70 (N/A) * vol-0d9025128ab14717b (N/A) * vol-03234ac315c51182f (N/A) * vol-04f3c0aee10ebb5dc (N/A) * vol-0f60c6a6319894508 (N/A) * vol-070b1046610c8a889 (N/A) * vol-072420b69c4c5280b (N/A) * vol-097640c2449289751 (N/A) * vol-0c6e6eed8cc303124 (N/A) * vol-0eacd876ec8f524b0 (N/A) * vol-0bd67fc8ecce66e5c (N/A) * vol-0bbc8045c7788e09b (N/A) * vol-0298c4c7fe4e5fbde (N/A) * vol-0f2976619ddb4d3cf (N/A) * vol-0263dee87b0f01d6b (N/A) * vol-0dd7de8e7f11e7b03 (N/A) * vol-0ba9b89af1ab018da (N/A) * vol-0525594cfb26405bf (N/A) * vol-09786e2d529be7e7c (N/A) * vol-0fff5731e37900874 (N/A) * vol-0f9b9998d2e2c3ef5 (N/A) * vol-0ed12015dde8daf00 (N/A) * vol-02634620c2c6dbf4f (N/A) * vol-096d3988265046ae5 (N/A) * vol-0ee450750d710fe0b (N/A) * vol-06a34c9cec783126e (N/A) * vol-0d04f88b2f7a295b5 (N/A) * vol-0affc3e87d01fba17 (N/A) * vol-07ef45427173adcf7 (N/A) * vol-0731ebf8585c31684 (N/A) * vol-07f3dee7e61c6a022 (N/A) * vol-069f14790e345422e (N/A) * vol-0ff23d95d8706bd76 (N/A) * vol-0f37a81a037665cff (N/A) * vol-0eba232dc6d657af6 (N/A) * vol-05c47f418a83305e0 (N/A) * vol-029088626be1c8e34 (N/A) * vol-0004a6deb86fb5d1f (N/A) * vol-0278cfba83f8e71df (N/A) * vol-0c9c969bd4bfcb98a (N/A) * vol-065ec69c8dadd5ae6 (N/A) * vol-0f9521b72bd19199d (N/A) * vol-0f7dc412e6cf8d99e (N/A) * vol-0c3e14125860f8b21 (N/A) * vol-0dffc62abafe90daa (N/A) * vol-0bf8f058fd8e46391 (N/A) * vol-049971b7689445af0 (N/A) * vol-0b2cd598d6609401d (N/A) * vol-040f19759adf2b8cb (N/A) * vol-026256333e1dae5f7 (N/A) * vol-01f36055620443b3d (N/A) * vol-0e4a95fa2f93bec28 (N/A) * vol-023d40ad862f63439 (N/A) * vol-02ff4e1ce7e647720 (N/A) * vol-08ca346fbad39b271 (N/A) * vol-09f2cbb83ef4e29df (N/A) * vol-0201a4836d3f2f5c8 (N/A) * vol-03fc8ac463a6db1b5 (N/A) * vol-0333a1e6df8c2e1cb (N/A) * vol-01d3e528c3b58be49 (N/A) * vol-06f654d16fcad3548 (N/A) * vol-018d9649207af3081 (N/A) * vol-0c596f3176ae3ca15 (N/A) * vol-0da4f499691b01193 (N/A) * vol-0912113a51a338f1e (N/A) * vol-0ddc416ff0edf7099 (N/A) * vol-0c2bec7dc3233cead (N/A) * vol-00b3865d24dd9212d (N/A) * vol-0065b84d88e0a13cf (N/A) * vol-06ac01b3cfaed98c5 (N/A) * vol-0d834497111dbb04f (N/A) * vol-03e2d6324c32241c1 (N/A) * vol-053777321edafadcd (N/A) * vol-013a0575eeaf7d386 (N/A) * vol-0933c3b02426fe66f (N/A) * vol-0b2a48558dca8a4b7 (N/A) * vol-05e7d2d20efbbffeb (N/A) * vol-0c88a5f9a98ad1d3f (N/A) * vol-05fd5706bc100064e (N/A) * vol-0b20b050aa1c7b67c (N/A) * vol-05fa4f4ab588f6343 (N/A) * vol-0d7144046066ccaf5 (N/A) * vol-0826b2fbfbfd282e3 (N/A) * vol-04e08c39937225f6f (N/A) * vol-012a4f2b1a8d71201 (N/A) * vol-0c95ba3e5441d7f8f (N/A) * vol-061a19248027fe955 (N/A) * vol-089592585cbb7f9d8 (N/A) * vol-0adbd297d0416ca6f (N/A) * vol-090271db9bf9f9b46 (N/A) * vol-065138395a9a6f429 (N/A) * vol-0c8e379cd5c4b6fe5 (N/A) * vol-078049aca5fe98e88 (N/A) * vol-0ee84937c9890fb68 (N/A) * vol-02bfa34c231a312b8 (N/A) * vol-0da0337b768d5d4bf (N/A) * vol-05f4029b20fdb0019 (N/A) * vol-0dfbe4c63e154e40e (N/A) * vol-07a79ca3de13687b9 (N/A) * vol-0750fe8b796d51439 (N/A) * vol-0dcfb7f0dd53720f9 () * vol-038243e5c74d0e2b6 (N/A) * vol-029d9c80d22db510b (N/A) * vol-067f0cd84c80521c0 (N/A) * vol-0aa430b0edd2e431a (N/A) * vol-0be5378e6b639fe2f (N/A) * vol-0fec7ebc9be5edc87 (N/A) * vol-0c706e24ed0d9f8b7 (N/A) * vol-0a934cca6593c25df (N/A) * vol-06cb6c35828b02ae1 (N/A) * vol-0a982947ccf5baf97 (N/A) * vol-05f509cafd6b539c2 (N/A) * vol-01ea147a8e6272b0c (N/A) * vol-0fd77c8af591d3766 (N/A) * vol-0871d2846649d3c99 (N/A) * vol-0745cd5e7779cfdc3 (N/A) * vol-086a4c88c46246dee (N/A) * vol-039ed85f760625821 (N/A) * vol-08011f35ac062fd28 (N/A) * vol-06074898959f99ba2 (N/A) * vol-02a80907c357d5365 (N/A) * vol-0dea73e168a2950fb (N/A) * vol-0b843b802bfef4fc9 (N/A) * vol-05e6a1b09cf2af4fc (N/A) * vol-080295d913104c110 (N/A) * vol-0b915f63f330bbde6 (N/A) * vol-02a1819cf74ed2b16 (N/A) * vol-02197d659de4c27e0 (N/A) * vol-03e4bc7740cbc4d31 (N/A) * vol-0095142340b71f2ec (N/A) * vol-0d6f58899a9fba6f7 (N/A) * vol-098caddacb7e4dce2 (N/A) * vol-0f46013577185af47 (N/A) * vol-0b019dbe8cc4b942a (N/A) * vol-096c0f6e44ea2de1e (N/A) * vol-029030809ae9cbf70 (N/A) * vol-017348934f0a0936a (N/A) * vol-001463329f7423013 (N/A) * vol-01d1675bd3285be6b (N/A) * vol-09d9eb20be1379482 (N/A) * vol-0b7339b515e60c7b7 (N/A) * vol-0c508032280bdaee1 (N/A) * vol-0a1964e3c0f9b9b76 (N/A) * vol-03af637f3dcf0222e (N/A) * vol-00b8e045c2e1f8c3e (N/A) * vol-0e3bedb9df4c446f5 (N/A) * vol-06b558b4d90ab29a7 (N/A) * vol-0d1bd7342e37275d6 (N/A) * vol-018a9702ae568c317 (N/A) * vol-0ef52dfc277e3f603 (N/A) * vol-046bad45f0b3cca44 (N/A) * vol-0d54963091ce18550 () * vol-010f6eb0a740b4597 () * vol-06c804a6dd421895f () * vol-03a7136f554a45eae (N/A) * vol-0b55bb4d19d815841 (N/A) * vol-08810ec455a7fd532 (N/A) * vol-090a9010ef849a701 (N/A) * vol-01ee0f6e7ebb6aa6f (N/A) * vol-03bf15bc47d03c021 (N/A) * vol-03d7d4284c54f9b78 (N/A) * vol-007aef4c18d75e169 (N/A) * vol-096d6c1e603ae8296 (N/A) * vol-04bae7b7624274433 (N/A) * vol-00a570622aa417e90 (N/A) * vol-0e1df101791c89825 (N/A) * vol-068c8bcddfca932a8 (N/A) * vol-0f339035b44ec3ffc (N/A) * vol-022cfac186daf9168 (N/A) * vol-0e28736ddc1cdb994 (N/A) * vol-0ef59e939075306e3 (N/A) * vol-0571c7426d597957e (N/A) * vol-0721e809cfd258a3c (N/A) * vol-0c0be5eb2dbf7059c (N/A) * vol-07a0b66d702dc5f59 (N/A) * vol-0e52bb06c04b8b511 (N/A) * vol-00afee002006915d4 (N/A) * vol-06f7c757e251b0506 (N/A) * vol-0c20b93991aa5b354 (N/A) * vol-03174b07f5e2b30f1 (N/A) * vol-03e662aca0f4357a1 (N/A) * vol-05c0322fe6360eab2 (N/A) * vol-08a59b3871cbed7f7 (N/A) * vol-009c56e7fd0c427a9 (N/A) * vol-03643946f3ddc3cbc (N/A) * vol-04daa63c72962a03b (N/A) * vol-079fb3327e888814a (N/A) * vol-07ff1268e40e589da (N/A) * vol-05a8f8c0094b1fed0 (N/A) * vol-01471cb97ddb60f39 (N/A) * vol-032c94f86cd709398 (N/A) * vol-0c1cbdf5e99b4e2a8 (N/A) * vol-05dbf6c543ebf2b31 (N/A) * vol-04083c86b656b64d9 (N/A) * vol-0a9e4acccf90373c4 (N/A) * vol-0c5a339c5a7f829db (N/A) * vol-0cade6f72e8032f7a (N/A) * vol-093358144881b0c49 (N/A) * vol-059570b7bd3f4e5dd (N/A) * vol-0750f68a0bb3041c3 (N/A) * vol-0e893574385cfe1b9 (N/A) * vol-0908f19491602e321 (N/A) * vol-0630e964128559f98 (N/A) * vol-0b2ad5274ccc94b15 (N/A) * vol-0268b3e2114d57594 (N/A) * vol-00d6f69694521be81 (N/A) * vol-0b1f3495748567465 (N/A) * vol-0529949dbec9a15c0 (N/A) * vol-0ed0de7740eb2e0fa (N/A) * vol-0edfb6ea701d7b93b (N/A) * vol-0495fadab893653a7 (N/A) * vol-002042015728fe3a3 (N/A) * vol-05d268725898fe2bb (N/A) * vol-0db5b9736053498a0 (N/A) * vol-0084d2fd8e6c21594 (N/A) * vol-0d356708358b9cc5e (N/A) * vol-04dcb95a7816e8ad0 (N/A) * vol-049d81c9401c3c4ff (N/A) * vol-0ce8dc9b30fc7c36e (N/A) * vol-07bd23ec5aefea298 (N/A) * vol-0180725ea9511fb14 (N/A) * vol-0097d6446c5c35a15 (N/A) * vol-07702b50eb87382a6 (N/A) * vol-088f48af3292f115b (N/A) * vol-01b2f7f5f713e7fc9 (N/A) * vol-0f5628c16c40e2157 (N/A) * vol-0f2af2031746cf37b (N/A) * vol-04abb001007ded25c (N/A) * vol-01fde99bc18ac26ba (N/A) * vol-0f75d3fc7d675e1eb (N/A) * vol-079b6fa36e47b11e2 (N/A) * vol-0baec4a24f1318a3b (N/A) * vol-09daa0f32678bbdda (N/A) * vol-089f8ae90baf24ac3 (N/A) * vol-00820b7afaa048e3e (N/A) * vol-0d2f1d8ba6f4eb440 (N/A) * vol-0ec625a4e43bd69fb (N/A) * vol-090ee90eb4451e01c (N/A) * vol-0c83e7e5491294d0c (N/A) * vol-0fbcf480e53a9cc76 (N/A) * vol-09db7e67e64052320 (N/A) * vol-08c0cdadf51e435f4 (N/A) * vol-01c7e8f716161ee2c (N/A) * vol-08abf4632f6d687f8 (N/A) * vol-056907e7a7ecff9cf (N/A) * vol-06bc9cc59d270d25b (N/A) * vol-0e9ee2bffc854f573 (N/A) * vol-03aa8cc7681b94374 (N/A) * vol-0f00a5bec00ae3abf (N/A) * vol-0955aada175b407e0 (N/A) * vol-05d481e3a7163a72f (N/A) * vol-073c3641afa8d3c06 (N/A) * vol-0740eb92a12a578c8 (N/A) * vol-0179f731fd27b9f2b (N/A) * vol-01cf7161c3db401fb (N/A) * vol-0e70aea9a0fb4393e (N/A) * vol-0c2a99c756bc01881 (N/A) * vol-07f7900eb25fdd85a (N/A) * vol-0e7746fbcc224f361 (N/A) * vol-06965c109f149ad32 (N/A) * vol-00ecbaf6ef04fd9f4 (N/A) * vol-08f2086d4d5a74d8c (N/A) * vol-0fd3403b90fc831e8 (N/A) * vol-02807967b41537efc (N/A) * vol-0694250170a44c134 (N/A) * vol-0c4e3d51f495ab18b (N/A) * vol-079cd003028f59a83 (N/A) * vol-0383192a9c761f698 (N/A) * vol-03a909a569cf301a2 (N/A) * vol-08af2539eec78baab (N/A) * vol-07d9df54fd70dfba1 (N/A) * vol-00209f9b828833f71 (N/A) * vol-098051646a7cd2a1b () * vol-0fef65117690d2afb () * vol-06013084e9ff26c56 () The volumes from the last list mostly belongs to CentOS Stream builders. That is all Miroslav -- Miroslav Suchy, RHCA Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys

5 23

Fedora 39 beta freeze now in effect
by Kevin Fenzi 20 Sep '23

20 Sep '23

Greetings. We are now in the infrastructure freeze leading up to the Fedora 39 Beta release. This is a pre release freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 39 Beta when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://pagure.io/fedora-infra/ansible.git ansible/scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2023-09-12 (or later if release slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list or a pull request for review. Thanks, Kevin

2 5

AWS - strange error: volume in use, but is not attached
by Miroslav Suchý 15 Sep '23

15 Sep '23

When cleaning the old volumes I find strange error This volume: https://ap-southeast-1.console.aws.amazon.com/ec2/home?region=ap-southeast-… i.e. vol-495d4a40 in ap-southeast-1 cannot be deleted, because is "in-use". And I can only "detach" or "force detach", but there is no attached instances listed. In this region are 3 instances: proxy38.fedoraproject.org, proxy30.fedoraproject.org and mref1.apse1.stream.centos.org but none of them list this volume as attached. BTW, this volume is already snapshoted as snap-017a9145cd8099a06 so it can be safely deleted. Does somebody ever experienced this kind of error? Any ideas? If I get no suggestions by end of the week, I will try to detach it (not sure from where), and if it fails (I kind of expect it) I will raise a support ticket. -- Miroslav Suchy, RHCA Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys

2 2

PDC replacement proposal
by Tomas Hrcka 14 Sep '23

14 Sep '23

Hello all, it took us a few years but we are finally getting rid of the PDC project. Thanks to the ARC research we identified use cases in our tooling and proposed solution. The essential functionalities currently provided by PDC will be re-implemented in other applications within our release infrastructure, as there are no immediate plans for their replacement and are currently maintained This work is anticipated to span several months for completion. However, before we embark on this endeavor, we would like to proactively share our proposed solution with all of you and gather your valuable feedback. Below, we outline our strategy to preserve the core functionality of PDC by leveraging existing applications within our ecosystem. Current uses of PDC: Currently, we rely on the Package Database (PDC) for various data management tasks, including: 1. Critical Path Package Tracking: Bodhi leverages PDC to track packages on the critical path. 2. Retirement of Packages and Service Level Agreements (SLAs): PDC assists in managing the retirement of packages and their associated SLAs. 3. Metadata for Nightly Composes: Our Release Engineering and Fedora Quality Assurance teams rely on PDC for metadata related to nightly composes. More info on the usage can be found here: https://fedora-arc.readthedocs.io/en/latest/pdc/users.html Specific Endpoints in Use: We interact with the following endpoints in PDC to access and manage our data: /rest_api/v1/global-components: This endpoint stores package names. /rest_api/v1/component-branches: Here, we store SLAs, track active/retired status, and manage the critical-path flag. /rest_api/v1/component-branch-slas: An auxiliary endpoint dedicated to SLAs. /rest_api/v1/compose-images: This endpoint stores essential files, such as composeinfo.json and image-manifest.json. /rest_api/v1/releases: It houses metadata on various release types (e.g., GA, updates, EUS, AUS, ELS, fast, updates-testing) for product versions, indicating their active status. /rest_api/v1/rpms: This endpoint establishes links between RPM packages and composes. /rest_api/v1/product-versions: Here, we store major versions of Fedora. More info on the endpoints: https://fedora-arc.readthedocs.io/en/latest/pdc/endpoints.html Upcoming Changes Bodhi: Bodhi will assume responsibility for the following tasks, reducing our reliance on PDC: /rest_api/v1/releases/: Bodhi will now manage release-related data. /rest_api/v1/component-branches/: Specifically, Bodhi will handle the critical-path flag. Bodhi's existing framework aligns well with releases and components. To enhance this, we will create an auxiliary table that pairs this data with additional metadata, predominantly focusing on the critical-path flag. Previously, we had to query this information from PDC. It's essential to note that PDC is not the definitive source of truth for critical-path packages. The Fedora Project Critical Path Package Wiki indicates that the source of truth lies within the Fedora Comps repository. You can find specific information by searching for groups with the "critical-path-*" prefix, as demonstrated here. While the data is accessible through DNF, generating it can be time-consuming. PDC serves as a pre-computed cache. Previously, we followed this process to update it, but now we have transitioned to using this method. The primary application of this information during the Fedora release cycle is in Bodhi, where it is used to enforce stricter requirements on critical-path package updates. For further details, please refer to this link. Pagure-dist-git: Pagure-dist-git will take over several responsibilities from PDC, including: /rest_api/v1/product-versions /rest_api/v1/global-components /rest_api/v1/component-branches/ /rest_api/v1/component-branch-slas/ Pagure already has a robust database of global components (repositories) and product versions (repository branches). It utilizes the PDC API to query component branches when a package is retired, and an auxiliary table in Pagure-dist-git will store the reasons for orphaning these components. A list of all identified uses of PDC API can be found in the original ARC investigation: https://fedora-arc.readthedocs.io/en/latest/pdc/users.html Projects not considered in the original arc investigation: MDapi Toddlers Toddlers took over the functionality of the fedscm-admin tool and it's more or less a 1:1 rewrite of the tool, use cases should be the same as fedscm-admin. Remaining Endpoints: A few endpoints will remain unchanged: /rest_api/v1/compose-images/: Given that we primarily store JSON blobs here, we have decided, based on discussions, to store the JSON data on a network-accessible file server. /rest_api/v1/rpms/: This endpoint does not currently have a dedicated application, but our Quality Assurance team uses it to query packages in specific composes. CPE is scheduled to commence work on this project in approximately two weeks. If you have any feedback regarding the proposed solution to facilitate the decommissioning of PDC or if you have any questions or require additional information, please don't hesitate to get in touch with us. Your input and inquiries are greatly appreciated. -- Tomas Hrcka fas: humaton libera.CHAT: jednorozec

5 11

AWS gp2 -> gp3
by Miroslav Suchý 13 Sep '23

13 Sep '23

tl;dr I want to change **all** storage types in AWS from gp2 to gp3 next week. The recent Change proposal https://fedoraproject.org/wiki/Changes/CloudEC2gp3 brought to my attention that gp3 is actually faster and cheaper than gp2. The comparision is as follows: gp2: * $0.10 per GB-month * IOPS: 100 IOPB, burstable to 3000 IOPS * Throughput: Throughput limit is between 128 MiB/s and 250 MiB/s, depending on the volume size. gp3: * IOPS: 3000 for free, addional IOPS can be bought * Throughput 125 MiB/s for free, addional throughput can be bought For more information see https://aws.amazon.com/blogs/storage/migrate-your-amazon-ebs-volumes-from-g… We have about 150 volumes of gp2 type in AWS. Copr is the most prominent user, but there are other: libravatar, taiga, TF, and other... The type of the storage can be changed on the fly - even for attached and volumes in-use. I already tried that with my private server. Unless somebody will have objections I plan to change volume types to gp3 for Copr next week and for all other services in week following Easter. I also modified fedimg template to allow gp3 https://pagure.io/fedora-infra/ansible/c/034cf953db5d0519eb327136abd72a2ee6… If you have scripts outside of fedora-infra/ansible to provision instances that uses gp2 for volumes, it will be great if you can move it to gp3. Miroslav

4 18

Freeze Break Request: update fedora-repos-zchunk on composers
by Kevin Fenzi 08 Sep '23

08 Sep '23

The new fedora-repo-zdicts-2309.1-1.fc38 update has f39 zchunk dictionaries, which should make the zchunk deltas better for f39. I'd like to update compose-branched01/compose-rawhide01/compose-x86_01 so we can get this advantage. I think this is a pretty low impact change and we can always just back out to the older version if something happens. +1s? kevin

3 2

Migration from registry.fp.o to quay.io
by Michal Konecny 07 Sep '23

07 Sep '23

Hi everyone, I finished investigation for migration from registry.fp.o to quay.io. It is available in ARC investigation document [0]. The investigation ticket [1] is on fedora-infra tracker. Looking forward for any feedback. Michal [0] - https://fedora-arc.readthedocs.io/en/latest/registry_to_quay/index.html [1] - https://pagure.io/fedora-infrastructure/issue/10386

8 13

Freeze Break request: update *.apps.ocp.fedoraproject.org cert
by Kevin Fenzi 06 Sep '23

06 Sep '23

Greetings. Our *.apps.ocp.fedoraproject.org cert expires in 21 days. I could just wait for freeze to be over, but if we slip that could make it really close, so instead I would just like to update it now. I already have the cert ready to push into ansible-private, just need +1's to run the proxies playbook and update the cert there. kevin

5 5

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure September 2023