Test Results

A very primitive database of test results.

It is assumed that test results are grouped in “test suites”, which are just a group of tests run together.

Tests are grouped in “streams” which can be viewed as the same set of tests performed repeatedly For example: daily regression tests can be a stream, unit tests upon merging to master can be another, and release tests can be yet another. All test suites can also be given “tags” that allow a more arbitrary grouping.

To add a test suite to the database, one normally uses the skare3-test-results script, which basically does this:

>>> from skare3_tools import test_results
>>> test_results.add('test_logs/', stream='ska3-masters')

And to retrieve all tests for a stream:

>>> from skare3_tools import test_results
>>> test_results.get(stream='ska3-masters')

Scripts

skare3-test-results

Add the test results from a given directory to the database.

usage: skare3-test-results [-h] --stream STREAM [--tag TAGS] directory

Positional Arguments

directory

The directory containing all test result logs.

Named Arguments

--stream

The named stream this test suite belongs to.

--tag

Optional string tags to refer to this test suite in the future.

Default: []