Re: About MirrorManager2

----- Original Message -----

From: "Pierre-Yves Chibon" pingou@pingoured.fr To: "Fedora Infrastructure" infrastructure@lists.fedoraproject.org Sent: Wednesday, February 11, 2015 5:10:01 AM Subject: About MirrorManager2

[snip]

Before we move MirrorManager2 to prod, here is what I think would be nice to do/have:

• Pickle validation
  • Figure a way to validate a pickle after its creation and before moving it
  to the mirrorlist boxes
• Find out if we can improve our tests some more (to improve our confidence that we're ready)
• Engage the mirror mailing list and try to get them to react on the coming changes

The pickle validation might also be an interesting idea to check if there is a difference between the pickle generated by prod and the one generated in stg.

Finally, at DevConf we have been speaking quite a bit with Dennis around updates and MirrorManager and here is some of the ideas we spoke about:

• Be able to run the UMDL script on only a part of the tree (ie: be able to say, we updated f21-updates and we only update this part)
• Crawl the mirrors for only a part of the tree (This goes together with updating only part of the tree via UMDL)
• Consider if we should/could drop the content of the host_category_dir table before running the crawler
• Mirror versioning:
  • run UMDL, detect changes, increase master mirror's version by 1
  • run the crawler, check for the changes, align that mirror's version with
  the master mirror one
  • be able to see the difference between two versions
  • be able to crawl a mirror only for the difference between the version it
  is at and the version the master mirror is at note: we might still want to run a full crawl once in a while (daily? bi-daily?)

This list of ideas is more a long term todo list, not something we would want to have working for pushing MirrorManager2 to prod.

Thoughts? Agreements? Disagreements?

Hi!

I'd like to help move this along to production. I have very limited knowledge of the MM codebase, but I did attend the MM FAD, so I have at least a vague understanding of how it works. Are there any changes to these lists since last week? What might be productive to work on? Like I said, my knowledge is limited, but pickle validation sounds like a pretty general Python task. Maybe I could look into that?

Any direction and info on some task(s) I could try my hand at is appreciated. :)

-- David