On Mon, 3 Feb 2020 at 17:03, Kevin Fenzi <kevin@scrye.com> wrote:
>
> Thats... much more harsh than I would agree with. I still use it and
> find some of its information helpfull.
Sadly it does seem to have got a lot worse recently... I noticed last
weekend that a few of the packages I maintain (e.g. clide, colordiff,
perl-App-ccdiff, whowatch) can no longer found.
I remember some tickets being created about this - I'll see if I can
find them and comment there...
Hi all,
The indexing of the packages app full text search database relies almost only on mdapi [0] to populate the informations. The indexing sends a lot of requests to mdapi (at least 80 000, 1 for each package and subpackages) that causes a lot of load on mdapi which in returns makes some of the requests timeout and fail. I have improved mdapi performance last year [1] but unfortunately since we have moved it to OpenShift, mdapi is using an NFS volume mount which is rather slow making the performance improvement not as significant.
So the current situation is that every time the indexing process run, it is a little bit of a lottery. Depending on how many requests to mdapi are failing it will get different results, so a package might suddenly disappear. There is also a bug that I did not investigate but sometimes a package has another package description.
All that to say that I think, the indexing process needs to be rewritten or fix to be less aggressive towards mdapi or to be able to handle failure. I think it would be nice to have full text search of packages as a different service providing a simple API so anyone interested can build something cool using this. I personally don't have the time to look at this, but if anyone is interested I am happy to answer questions or provide pointers about the current process.
Hope this was an useful explanation :-)
Rich
--
Richard Fearn
richardfearn@gmail.com
_______________________________________________
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-leave@lists.fedoraproject.org
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org