On Thu, Jul 19, 2018 at 9:08 PM Igor Gnatenko <
ignatenkobrain(a)fedoraproject.org> wrote:
I'm trying to have shared tests between all 400+ rust packages.
I have few problems though:
* There is no package NEVRA in test environment so the shared test doesn't
know what to test - it is necessary to know which test to run.
We trigger tests for dist-git.
I think about dist-git as a SRPM.
SRPM can produce many RPMs.
CI pipeline: install all RPMS from Koji build and run tests from /tests for
all installed RPMs.
The same approach is for manual testing.
Conclusion: test-environment-system has installed RPMS.
Tests from /tests dir check test-environment-system as a whole.
https://fedoraproject.org/wiki/CI/Standard_Test_Interface doesn't define
NEVRA.
Reason: STI tests are for all test-environment-system (all installed
packages).
/tests directory from dist-git knows that packages goes from dist-git/pkg
/tests/tests.yml is written for each SRPM package.
/tests/tests.yml knows that it will run against: SRPM + distro version.
/tests/tests.yml for Fedora 27 and for Fedora 28 can are different files.
If you have common tests, you have different /tests/tests.yml where you can
specify exactly that this tests are for this SRPM and for Branch 28 (for
example).
* No dist-git sources of a package - while trying to workaround
previous
problem I have found that dist-git doesn't get into the environment so I
can't do something like dnf builddep
Please help me ;)
We should decide: if tests can exist independently without dist-git.
For now, we presume they can.
This is current state.
If yes. There is nothing to do.
If no. We should tight together dist-git branch + /tests as one entity.
And copy /tests to test-environment system together with dist-git.
If we decide to change this, than we need to make correspondent changes to
STI.
https://fedoraproject.org/wiki/CI/Standard_Test_Interface
P.S> I'm using standard-test-basic role.
Thanks in advance!
--
-Igor Gnatenko
_______________________________________________
CI mailing list -- ci(a)lists.fedoraproject.org
To unsubscribe send an email to ci-leave(a)lists.fedoraproject.org
Fedora Code of Conduct:
https://getfedora.org/code-of-conduct.html
List Guidelines:
https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/ci@lists.fedoraproject.org/...