• Rae Moar's avatar
    kunit: tool: improve compatibility of kunit_parser with KTAP specification · d65d07cb
    Rae Moar authored
    Update to kunit_parser to improve compatibility with KTAP
    specification including arbitrarily nested tests. Patch accomplishes
    three major changes:
    
    - Use a general Test object to represent all tests rather than TestCase
    and TestSuite objects. This allows for easier implementation of arbitrary
    levels of nested tests and promotes the idea that both test suites and test
    cases are tests.
    
    - Print errors incrementally rather than all at once after the
    parsing finishes to maximize information given to the user in the
    case of the parser given invalid input and to increase the helpfulness
    of the timestamps given during printing. Note that kunit.py parse does
    not print incrementally yet. However, this fix brings us closer to
    this feature.
    
    - Increase compatibility for different formats of input. Arbitrary levels
    of nested tests supported. Also, test cases and test suites are now
    supported to be present on the same level of testing.
    
    This patch now implements the draft KTAP specification here:
    https://lore.kernel.org/linux-kselftest/CA+GJov6tdjvY9x12JsJT14qn6c7NViJxqaJk+r-K1YJzPggFDQ@mail.gmail.com/
    We'll update the parser as the spec evolves.
    
    This patch adjusts the kunit_tool_test.py file to check for
    the correct outputs from the new parser and adds a new test to check
    the parsing for a KTAP result log with correct format for multiple nested
    subtests (test_is_test_passed-all_passed_nested.log).
    
    This patch also alters the kunit_json.py file to allow for arbitrarily
    nested tests.
    Signed-off-by: default avatarRae Moar <rmoar@google.com>
    Reviewed-by: default avatarBrendan Higgins <brendanhiggins@google.com>
    Signed-off-by: default avatarDaniel Latypov <dlatypov@google.com>
    Reviewed-by: default avatarDavid Gow <davidgow@google.com>
    Signed-off-by: default avatarShuah Khan <skhan@linuxfoundation.org>
    d65d07cb
test_is_test_passed-all_passed_nested.log 1.13 KB