GLOB sdist-make: /tmp/tmp60tx9frq/pytest-json-report-1.2.4/setup.py py36 create: /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36 py36 installdeps: coverage, pytest==6.0.1, pytest-xdist, flaky py36 inst: /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/.tmp/package/1/pytest-json-report-1.2.4.zip py36 installed: apipkg==1.5,attrs==20.3.0,coverage==5.3,execnet==1.7.1,flaky==3.7.0,importlib-metadata==2.0.0,iniconfig==1.1.1,more-itertools==8.6.0,packaging==20.4,pluggy==0.13.1,py==1.9.0,pyparsing==2.4.7,pytest==6.0.1,pytest-forked==1.3.0,pytest-json-report @ file:///tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/.tmp/package/1/pytest-json-report-1.2.4.zip,pytest-metadata==1.10.0,pytest-xdist==2.1.0,six==1.15.0,toml==0.10.2,zipp==3.4.0 py36 run-test-pre: PYTHONHASHSEED='1916555839' py36 run-test: commands[0] | coverage run --parallel -m pytest -v ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .tox/py36/.pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'json-report': '1.2.4', 'forked': '1.3.0'}} rootdir: /tmp/tmp60tx9frq/pytest-json-report-1.2.4 plugins: metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, json-report-1.2.4, forked-1.3.0 collecting ... collected 102 items tests/test_jsonreport.py::tests_only[0] PASSED [ 0%] tests/test_jsonreport.py::tests_only[1] PASSED [ 1%] tests/test_jsonreport.py::tests_only[4] PASSED [ 2%] tests/test_jsonreport.py::test_arguments_in_help PASSED [ 3%] tests/test_jsonreport.py::test_no_report PASSED [ 4%] tests/test_jsonreport.py::test_create_report PASSED [ 5%] tests/test_jsonreport.py::test_create_report_file_from_arg PASSED [ 6%] tests/test_jsonreport.py::test_create_no_report PASSED [ 7%] tests/test_jsonreport.py::test_report_keys[0] FAILED [ 8%] tests/test_jsonreport.py::test_report_keys[1] FAILED [ 9%] tests/test_jsonreport.py::test_report_keys[4] FAILED [ 10%] tests/test_jsonreport.py::test_report_collectors[0] PASSED [ 11%] tests/test_jsonreport.py::test_report_collectors[1] PASSED [ 12%] tests/test_jsonreport.py::test_report_collectors[4] PASSED [ 13%] tests/test_jsonreport.py::test_report_failed_collector[0] PASSED [ 14%] tests/test_jsonreport.py::test_report_failed_collector[1] PASSED [ 15%] tests/test_jsonreport.py::test_report_failed_collector[4] PASSED [ 16%] tests/test_jsonreport.py::test_report_failed_collector2[0] PASSED [ 17%] tests/test_jsonreport.py::test_report_failed_collector2[1] PASSED [ 18%] tests/test_jsonreport.py::test_report_failed_collector2[4] PASSED [ 19%] tests/test_jsonreport.py::test_report_item_keys[0] PASSED [ 20%] tests/test_jsonreport.py::test_report_item_keys[1] PASSED [ 21%] tests/test_jsonreport.py::test_report_item_keys[4] PASSED [ 22%] tests/test_jsonreport.py::test_report_outcomes[0] PASSED [ 23%] tests/test_jsonreport.py::test_report_outcomes[1] PASSED [ 24%] tests/test_jsonreport.py::test_report_outcomes[4] PASSED [ 25%] tests/test_jsonreport.py::test_report_summary[0] PASSED [ 26%] tests/test_jsonreport.py::test_report_summary[1] PASSED [ 27%] tests/test_jsonreport.py::test_report_summary[4] PASSED [ 28%] tests/test_jsonreport.py::test_report_longrepr[0] PASSED [ 29%] tests/test_jsonreport.py::test_report_longrepr[1] PASSED [ 30%] tests/test_jsonreport.py::test_report_longrepr[4] PASSED [ 31%] tests/test_jsonreport.py::test_report_crash_and_traceback[0] PASSED [ 32%] tests/test_jsonreport.py::test_report_crash_and_traceback[1] PASSED [ 33%] tests/test_jsonreport.py::test_report_crash_and_traceback[4] PASSED [ 34%] tests/test_jsonreport.py::test_report_item_deselected[0] PASSED [ 35%] tests/test_jsonreport.py::test_report_item_deselected[1] PASSED [ 36%] tests/test_jsonreport.py::test_report_item_deselected[4] PASSED [ 37%] tests/test_jsonreport.py::test_no_traceback[0] PASSED [ 38%] tests/test_jsonreport.py::test_no_traceback[1] PASSED [ 39%] tests/test_jsonreport.py::test_no_traceback[4] PASSED [ 40%] tests/test_jsonreport.py::test_pytest_no_traceback[0] PASSED [ 41%] tests/test_jsonreport.py::test_pytest_no_traceback[1] PASSED [ 42%] tests/test_jsonreport.py::test_pytest_no_traceback[4] PASSED [ 43%] tests/test_jsonreport.py::test_no_streams[0] PASSED [ 44%] tests/test_jsonreport.py::test_no_streams[1] PASSED [ 45%] tests/test_jsonreport.py::test_no_streams[4] PASSED [ 46%] tests/test_jsonreport.py::test_summary_only[0] PASSED [ 47%] tests/test_jsonreport.py::test_summary_only[1] PASSED [ 48%] tests/test_jsonreport.py::test_summary_only[4] PASSED [ 49%] tests/test_jsonreport.py::test_report_streams[0] PASSED [ 50%] tests/test_jsonreport.py::test_report_streams[1] PASSED [ 50%] tests/test_jsonreport.py::test_report_streams[4] PASSED [ 51%] tests/test_jsonreport.py::test_json_metadata[0] FAILED [ 52%] tests/test_jsonreport.py::test_json_metadata[1] FAILED [ 53%] tests/test_jsonreport.py::test_json_metadata[4] FAILED [ 54%] tests/test_jsonreport.py::test_metadata_fixture_without_report_flag PASSED [ 55%] tests/test_jsonreport.py::test_environment_via_metadata_plugin[0] PASSED [ 56%] tests/test_jsonreport.py::test_environment_via_metadata_plugin[1] PASSED [ 57%] tests/test_jsonreport.py::test_environment_via_metadata_plugin[4] PASSED [ 58%] tests/test_jsonreport.py::test_modifyreport_hook[0] PASSED [ 59%] tests/test_jsonreport.py::test_modifyreport_hook[1] PASSED [ 60%] tests/test_jsonreport.py::test_modifyreport_hook[4] PASSED [ 61%] tests/test_jsonreport.py::test_runtest_stage_hook[0] PASSED [ 62%] tests/test_jsonreport.py::test_runtest_stage_hook[1] PASSED [ 63%] tests/test_jsonreport.py::test_runtest_stage_hook[4] PASSED [ 64%] tests/test_jsonreport.py::test_runtest_metadata_hook[0] PASSED [ 65%] tests/test_jsonreport.py::test_runtest_metadata_hook[1] PASSED [ 66%] tests/test_jsonreport.py::test_runtest_metadata_hook[4] PASSED [ 67%] tests/test_jsonreport.py::test_warnings[0] FAILED [ 68%] tests/test_jsonreport.py::test_warnings[1] FAILED [ 69%] tests/test_jsonreport.py::test_warnings[4] FAILED [ 70%] tests/test_jsonreport.py::test_process_report[0] PASSED [ 71%] tests/test_jsonreport.py::test_process_report[1] PASSED [ 72%] tests/test_jsonreport.py::test_process_report[4] PASSED [ 73%] tests/test_jsonreport.py::test_indent[0] PASSED [ 74%] tests/test_jsonreport.py::test_indent[1] PASSED [ 75%] tests/test_jsonreport.py::test_indent[4] PASSED [ 76%] tests/test_jsonreport.py::test_logging[0] PASSED [ 77%] tests/test_jsonreport.py::test_logging[1] PASSED [ 78%] tests/test_jsonreport.py::test_logging[4] PASSED [ 79%] tests/test_jsonreport.py::test_no_logs[0] PASSED [ 80%] tests/test_jsonreport.py::test_no_logs[1] PASSED [ 81%] tests/test_jsonreport.py::test_no_logs[4] PASSED [ 82%] tests/test_jsonreport.py::test_no_keywords[0] PASSED [ 83%] tests/test_jsonreport.py::test_no_keywords[1] PASSED [ 84%] tests/test_jsonreport.py::test_no_keywords[4] PASSED [ 85%] tests/test_jsonreport.py::test_no_collectors[0] PASSED [ 86%] tests/test_jsonreport.py::test_no_collectors[1] PASSED [ 87%] tests/test_jsonreport.py::test_no_collectors[4] PASSED [ 88%] tests/test_jsonreport.py::test_no_warnings[0] PASSED [ 89%] tests/test_jsonreport.py::test_no_warnings[1] PASSED [ 90%] tests/test_jsonreport.py::test_no_warnings[4] PASSED [ 91%] tests/test_jsonreport.py::test_direct_invocation PASSED [ 92%] tests/test_jsonreport.py::test_xdist[0] PASSED [ 93%] tests/test_jsonreport.py::test_xdist[1] PASSED [ 94%] tests/test_jsonreport.py::test_xdist[4] PASSED [ 95%] tests/test_jsonreport.py::test_bug_31[0] PASSED [ 96%] tests/test_jsonreport.py::test_bug_31[1] PASSED [ 97%] tests/test_jsonreport.py::test_bug_31[4] PASSED [ 98%] tests/test_jsonreport.py::test_bug_37 PASSED [ 99%] tests/test_jsonreport.py::test_bug_41 PASSED [100%] =================================== FAILURES =================================== _____________________________ test_report_keys[0] ______________________________ num_processes = 0 make_json = .func at 0x7f78197ed2f0> def test_report_keys(num_processes, make_json): data = make_json() keys = set([ 'created', 'duration', 'environment', 'collectors', 'tests', 'summary', 'root', 'exitcode' ]) if num_processes > 0: # xdist only reports failing collectors keys.remove('collectors') > assert set(data) == keys E AssertionError: assert {'collectors'..., 'root', ...} == {'collectors'..., 'root', ...} E Extra items in the left set: E 'warnings' E Full diff: E { E 'collectors', E 'created', E 'duration',... E E ...Full output truncated (8 lines hidden), use '-vv' to show /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:52: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_report_keys0 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 collecting ... collected 10 items test_report_keys.py::test_pass PASSED [ 10%] test_report_keys.py::test_fail_with_fixture FAILED [ 20%] test_report_keys.py::test_xfail XFAIL [ 30%] test_report_keys.py::test_xfail_but_passing XPASS [ 40%] test_report_keys.py::test_fail_during_setup ERROR [ 50%] test_report_keys.py::test_fail_during_teardown PASSED [ 60%] test_report_keys.py::test_fail_during_teardown ERROR [ 60%] test_report_keys.py::test_skip SKIPPED [ 70%] test_report_keys.py::test_fail_nested FAILED [ 80%] test_report_keys.py::test_parametrized[1] PASSED [ 90%] test_report_keys.py::test_parametrized[2] FAILED [100%] ==================================== ERRORS ==================================== ___________________ ERROR at setup of test_fail_during_setup ___________________ request = > @pytest.fixture def fail_setup_fixture(request): > assert False E assert False test_report_keys.py:17: AssertionError ________________ ERROR at teardown of test_fail_during_teardown ________________ def fn(): > assert False E assert False test_report_keys.py:22: AssertionError =================================== FAILURES =================================== ____________________________ test_fail_with_fixture ____________________________ setup_teardown_fixture = None def test_fail_with_fixture(setup_teardown_fixture): print('call') print('callerr', file=sys.stderr) > assert False E assert False test_report_keys.py:32: AssertionError ---------------------------- Captured stdout setup ----------------------------- setup ---------------------------- Captured stderr setup ----------------------------- setuperr ----------------------------- Captured stdout call ----------------------------- call ----------------------------- Captured stderr call ----------------------------- callerr --------------------------- Captured stdout teardown --------------------------- teardown --------------------------- Captured stderr teardown --------------------------- teardownerr _______________________________ test_fail_nested _______________________________ def test_fail_nested(): def baz(o=1): c = 3 return 2 - c - None def bar(m, n=5): b = 2 print(m) print('bar') return baz() def foo(): a = 1 print('foo') v = [bar(x) for x in range(3)] return v > foo() test_report_keys.py:66: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_report_keys.py:64: in foo v = [bar(x) for x in range(3)] test_report_keys.py:64: in v = [bar(x) for x in range(3)] test_report_keys.py:60: in bar return baz() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ o = 1 def baz(o=1): c = 3 > return 2 - c - None E TypeError: unsupported operand type(s) for -: 'int' and 'NoneType' test_report_keys.py:55: TypeError ----------------------------- Captured stdout call ----------------------------- foo 0 bar _____________________________ test_parametrized[2] _____________________________ x = 2 @pytest.mark.parametrize('x', [1, 2]) def test_parametrized(x): > assert x == 1 E assert 2 == 1 E +2 E -1 test_report_keys.py:70: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (9551 bytes) =========================== short test summary info ============================ FAILED test_report_keys.py::test_fail_with_fixture - assert False FAILED test_report_keys.py::test_fail_nested - TypeError: unsupported operand... FAILED test_report_keys.py::test_parametrized[2] - assert 2 == 1 ERROR test_report_keys.py::test_fail_during_setup - assert False ERROR test_report_keys.py::test_fail_during_teardown - assert False = 3 failed, 3 passed, 1 skipped, 1 xfailed, 1 xpassed, 1 warning, 2 errors in 0.51s = _____________________________ test_report_keys[1] ______________________________ num_processes = 1 make_json = .func at 0x7f7819743378> def test_report_keys(num_processes, make_json): data = make_json() keys = set([ 'created', 'duration', 'environment', 'collectors', 'tests', 'summary', 'root', 'exitcode' ]) if num_processes > 0: # xdist only reports failing collectors keys.remove('collectors') > assert set(data) == keys E AssertionError: assert {'created', '...summary', ...} == {'created', '...summary', ...} E Extra items in the left set: E 'warnings' E Full diff: E { E 'created', E 'duration', E 'environment',... E E ...Full output truncated (7 lines hidden), use '-vv' to show /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:52: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_report_keys1 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_report_keys1 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [10] scheduling tests via LoadScheduling test_report_keys.py::test_pass [gw0] [ 10%] PASSED test_report_keys.py::test_pass test_report_keys.py::test_fail_with_fixture [gw0] [ 20%] FAILED test_report_keys.py::test_fail_with_fixture test_report_keys.py::test_xfail [gw0] [ 30%] XFAIL test_report_keys.py::test_xfail test_report_keys.py::test_xfail_but_passing [gw0] [ 40%] XPASS test_report_keys.py::test_xfail_but_passing test_report_keys.py::test_fail_during_setup [gw0] [ 50%] ERROR test_report_keys.py::test_fail_during_setup test_report_keys.py::test_fail_during_teardown [gw0] [ 60%] PASSED test_report_keys.py::test_fail_during_teardown [gw0] [ 60%] ERROR test_report_keys.py::test_fail_during_teardown test_report_keys.py::test_skip [gw0] [ 70%] SKIPPED test_report_keys.py::test_skip test_report_keys.py::test_fail_nested [gw0] [ 80%] FAILED test_report_keys.py::test_fail_nested test_report_keys.py::test_parametrized[1] [gw0] [ 90%] PASSED test_report_keys.py::test_parametrized[1] test_report_keys.py::test_parametrized[2] [gw0] [100%] FAILED test_report_keys.py::test_parametrized[2] ==================================== ERRORS ==================================== ___________________ ERROR at setup of test_fail_during_setup ___________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python request = > @pytest.fixture def fail_setup_fixture(request): > assert False E assert False test_report_keys.py:17: AssertionError ________________ ERROR at teardown of test_fail_during_teardown ________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python def fn(): > assert False E assert False test_report_keys.py:22: AssertionError =================================== FAILURES =================================== ____________________________ test_fail_with_fixture ____________________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python setup_teardown_fixture = None def test_fail_with_fixture(setup_teardown_fixture): print('call') print('callerr', file=sys.stderr) > assert False E assert False test_report_keys.py:32: AssertionError ---------------------------- Captured stdout setup ----------------------------- setup ---------------------------- Captured stderr setup ----------------------------- setuperr ----------------------------- Captured stdout call ----------------------------- call ----------------------------- Captured stderr call ----------------------------- callerr --------------------------- Captured stdout teardown --------------------------- teardown --------------------------- Captured stderr teardown --------------------------- teardownerr _______________________________ test_fail_nested _______________________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python def test_fail_nested(): def baz(o=1): c = 3 return 2 - c - None def bar(m, n=5): b = 2 print(m) print('bar') return baz() def foo(): a = 1 print('foo') v = [bar(x) for x in range(3)] return v > foo() test_report_keys.py:66: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_report_keys.py:64: in foo v = [bar(x) for x in range(3)] test_report_keys.py:64: in v = [bar(x) for x in range(3)] test_report_keys.py:60: in bar return baz() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ o = 1 def baz(o=1): c = 3 > return 2 - c - None E TypeError: unsupported operand type(s) for -: 'int' and 'NoneType' test_report_keys.py:55: TypeError ----------------------------- Captured stdout call ----------------------------- foo 0 bar _____________________________ test_parametrized[2] _____________________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python x = 2 @pytest.mark.parametrize('x', [1, 2]) def test_parametrized(x): > assert x == 1 E assert 2 == 1 E +2 E -1 test_report_keys.py:70: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (11384 bytes) =========================== short test summary info ============================ FAILED test_report_keys.py::test_fail_with_fixture - assert False FAILED test_report_keys.py::test_fail_nested - TypeError: unsupported operand... FAILED test_report_keys.py::test_parametrized[2] - assert 2 == 1 ERROR test_report_keys.py::test_fail_during_setup - assert False ERROR test_report_keys.py::test_fail_during_teardown - assert False = 3 failed, 3 passed, 1 skipped, 1 xfailed, 1 xpassed, 1 warning, 2 errors in 2.70s = _____________________________ test_report_keys[4] ______________________________ num_processes = 4 make_json = .func at 0x7f78195fd268> def test_report_keys(num_processes, make_json): data = make_json() keys = set([ 'created', 'duration', 'environment', 'collectors', 'tests', 'summary', 'root', 'exitcode' ]) if num_processes > 0: # xdist only reports failing collectors keys.remove('collectors') > assert set(data) == keys E AssertionError: assert {'created', '...summary', ...} == {'created', '...summary', ...} E Extra items in the left set: E 'warnings' E Full diff: E { E 'created', E 'duration', E 'environment',... E E ...Full output truncated (7 lines hidden), use '-vv' to show /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:52: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_report_keys2 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I / gw1 I / gw2 I / gw3 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_report_keys2 [gw1] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_report_keys2 [gw2] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_report_keys2 [gw3] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_report_keys2 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw1] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw2] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw3] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] scheduling tests via LoadScheduling test_report_keys.py::test_pass test_report_keys.py::test_xfail [gw0] [ 10%] PASSED test_report_keys.py::test_pass test_report_keys.py::test_fail_with_fixture test_report_keys.py::test_fail_during_setup test_report_keys.py::test_xfail_but_passing [gw3] [ 20%] XPASS test_report_keys.py::test_xfail_but_passing test_report_keys.py::test_fail_nested [gw2] [ 30%] XFAIL test_report_keys.py::test_xfail test_report_keys.py::test_skip [gw2] [ 40%] SKIPPED test_report_keys.py::test_skip [gw1] [ 50%] FAILED test_report_keys.py::test_fail_with_fixture test_report_keys.py::test_fail_during_teardown [gw1] [ 60%] PASSED test_report_keys.py::test_fail_during_teardown [gw0] [ 70%] ERROR test_report_keys.py::test_fail_during_setup [gw1] [ 70%] ERROR test_report_keys.py::test_fail_during_teardown test_report_keys.py::test_parametrized[1] [gw0] [ 80%] PASSED test_report_keys.py::test_parametrized[1] [gw3] [ 90%] FAILED test_report_keys.py::test_fail_nested test_report_keys.py::test_parametrized[2] [gw3] [100%] FAILED test_report_keys.py::test_parametrized[2] ==================================== ERRORS ==================================== ___________________ ERROR at setup of test_fail_during_setup ___________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python request = > @pytest.fixture def fail_setup_fixture(request): > assert False E assert False test_report_keys.py:17: AssertionError ________________ ERROR at teardown of test_fail_during_teardown ________________ [gw1] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python def fn(): > assert False E assert False test_report_keys.py:22: AssertionError =================================== FAILURES =================================== ____________________________ test_fail_with_fixture ____________________________ [gw1] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python setup_teardown_fixture = None def test_fail_with_fixture(setup_teardown_fixture): print('call') print('callerr', file=sys.stderr) > assert False E assert False test_report_keys.py:32: AssertionError ---------------------------- Captured stdout setup ----------------------------- setup ---------------------------- Captured stderr setup ----------------------------- setuperr ----------------------------- Captured stdout call ----------------------------- call ----------------------------- Captured stderr call ----------------------------- callerr --------------------------- Captured stdout teardown --------------------------- teardown --------------------------- Captured stderr teardown --------------------------- teardownerr _______________________________ test_fail_nested _______________________________ [gw3] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python def test_fail_nested(): def baz(o=1): c = 3 return 2 - c - None def bar(m, n=5): b = 2 print(m) print('bar') return baz() def foo(): a = 1 print('foo') v = [bar(x) for x in range(3)] return v > foo() test_report_keys.py:66: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_report_keys.py:64: in foo v = [bar(x) for x in range(3)] test_report_keys.py:64: in v = [bar(x) for x in range(3)] test_report_keys.py:60: in bar return baz() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ o = 1 def baz(o=1): c = 3 > return 2 - c - None E TypeError: unsupported operand type(s) for -: 'int' and 'NoneType' test_report_keys.py:55: TypeError ----------------------------- Captured stdout call ----------------------------- foo 0 bar _____________________________ test_parametrized[2] _____________________________ [gw3] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python x = 2 @pytest.mark.parametrize('x', [1, 2]) def test_parametrized(x): > assert x == 1 E assert 2 == 1 E +2 E -1 test_report_keys.py:70: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (11371 bytes) =========================== short test summary info ============================ FAILED test_report_keys.py::test_fail_with_fixture - assert False FAILED test_report_keys.py::test_fail_nested - TypeError: unsupported operand... FAILED test_report_keys.py::test_parametrized[2] - assert 2 == 1 ERROR test_report_keys.py::test_fail_during_setup - assert False ERROR test_report_keys.py::test_fail_during_teardown - assert False = 3 failed, 3 passed, 1 skipped, 1 xfailed, 1 xpassed, 1 warning, 2 errors in 3.89s = ____________________________ test_json_metadata[0] _____________________________ make_json = .func at 0x7f780aea8bf8> def test_json_metadata(make_json): data = make_json(""" def test_metadata1(json_metadata): json_metadata['x'] = 'foo' json_metadata['y'] = [1, {'a': 2}] def test_metadata2(json_metadata): json_metadata['z'] = 1 assert False def test_unused_metadata(json_metadata): assert True def test_empty_metadata(json_metadata): json_metadata.update({}) def test_unserializable_metadata(json_metadata): json_metadata['a'] = object() import pytest @pytest.fixture def stage(json_metadata): json_metadata['a'] = 1 yield json_metadata['c'] = 3 def test_multi_stage_metadata(json_metadata, stage): json_metadata['b'] = 2 """) tests_ = tests_only(data) assert tests_['metadata1']['metadata'] == {'x': 'foo', 'y': [1, {'a': 2}]} assert tests_['metadata2']['metadata'] == {'z': 1} assert 'metadata' not in tests_['unused_metadata'] assert 'metadata' not in tests_['empty_metadata'] assert 'metadata' not in tests_['unserializable_metadata'] > assert len(data['warnings']) == 1 and ( 'test_unserializable_metadata is not JSON-serializable' in data['warnings'][0]['message']) E assert (2 == 1 E +2 E -1) /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:278: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_json_metadata0 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 collecting ... collected 6 items test_json_metadata.py::test_metadata1 PASSED [ 16%] test_json_metadata.py::test_metadata2 FAILED [ 33%] test_json_metadata.py::test_unused_metadata PASSED [ 50%] test_json_metadata.py::test_empty_metadata PASSED [ 66%] test_json_metadata.py::test_unserializable_metadata PASSED [ 83%] test_json_metadata.py::test_multi_stage_metadata PASSED [100%] =================================== FAILURES =================================== ________________________________ test_metadata2 ________________________________ json_metadata = {'z': 1} def test_metadata2(json_metadata): json_metadata['z'] = 1 > assert False E assert False test_json_metadata.py:7: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_json_metadata.py::test_unserializable_metadata /tmp/tmp60tx9frq/pytest-json-report-1.2.4/pytest_jsonreport/plugin.py:109: UserWarning: Metadata of test_json_metadata.py::test_unserializable_metadata is not JSON-serializable. 'Metadata of {} is not JSON-serializable.'.format(item.nodeid)) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (4620 bytes) =========================== short test summary info ============================ FAILED test_json_metadata.py::test_metadata2 - assert False =================== 1 failed, 5 passed, 2 warnings in 0.26s ==================== ____________________________ test_json_metadata[1] _____________________________ make_json = .func at 0x7f780ae78510> def test_json_metadata(make_json): data = make_json(""" def test_metadata1(json_metadata): json_metadata['x'] = 'foo' json_metadata['y'] = [1, {'a': 2}] def test_metadata2(json_metadata): json_metadata['z'] = 1 assert False def test_unused_metadata(json_metadata): assert True def test_empty_metadata(json_metadata): json_metadata.update({}) def test_unserializable_metadata(json_metadata): json_metadata['a'] = object() import pytest @pytest.fixture def stage(json_metadata): json_metadata['a'] = 1 yield json_metadata['c'] = 3 def test_multi_stage_metadata(json_metadata, stage): json_metadata['b'] = 2 """) tests_ = tests_only(data) assert tests_['metadata1']['metadata'] == {'x': 'foo', 'y': [1, {'a': 2}]} assert tests_['metadata2']['metadata'] == {'z': 1} assert 'metadata' not in tests_['unused_metadata'] assert 'metadata' not in tests_['empty_metadata'] assert 'metadata' not in tests_['unserializable_metadata'] > assert len(data['warnings']) == 1 and ( 'test_unserializable_metadata is not JSON-serializable' in data['warnings'][0]['message']) E assert (2 == 1 E +2 E -1) /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:278: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_json_metadata1 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_json_metadata1 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [6] scheduling tests via LoadScheduling test_json_metadata.py::test_metadata1 [gw0] [ 16%] PASSED test_json_metadata.py::test_metadata1 test_json_metadata.py::test_metadata2 [gw0] [ 33%] FAILED test_json_metadata.py::test_metadata2 test_json_metadata.py::test_unused_metadata [gw0] [ 50%] PASSED test_json_metadata.py::test_unused_metadata test_json_metadata.py::test_empty_metadata [gw0] [ 66%] PASSED test_json_metadata.py::test_empty_metadata test_json_metadata.py::test_unserializable_metadata [gw0] [ 83%] PASSED test_json_metadata.py::test_unserializable_metadata test_json_metadata.py::test_multi_stage_metadata [gw0] [100%] PASSED test_json_metadata.py::test_multi_stage_metadata =================================== FAILURES =================================== ________________________________ test_metadata2 ________________________________ [gw0] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python json_metadata = {'z': 1} def test_metadata2(json_metadata): json_metadata['z'] = 1 > assert False E assert False test_json_metadata.py:7: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_json_metadata.py::test_unserializable_metadata /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/pytest_jsonreport/plugin.py:109: UserWarning: Metadata of test_json_metadata.py::test_unserializable_metadata is not JSON-serializable. 'Metadata of {} is not JSON-serializable.'.format(item.nodeid)) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (5808 bytes) =========================== short test summary info ============================ FAILED test_json_metadata.py::test_metadata2 - assert False =================== 1 failed, 5 passed, 2 warnings in 2.45s ==================== ____________________________ test_json_metadata[4] _____________________________ make_json = .func at 0x7f780ad2f950> def test_json_metadata(make_json): data = make_json(""" def test_metadata1(json_metadata): json_metadata['x'] = 'foo' json_metadata['y'] = [1, {'a': 2}] def test_metadata2(json_metadata): json_metadata['z'] = 1 assert False def test_unused_metadata(json_metadata): assert True def test_empty_metadata(json_metadata): json_metadata.update({}) def test_unserializable_metadata(json_metadata): json_metadata['a'] = object() import pytest @pytest.fixture def stage(json_metadata): json_metadata['a'] = 1 yield json_metadata['c'] = 3 def test_multi_stage_metadata(json_metadata, stage): json_metadata['b'] = 2 """) tests_ = tests_only(data) assert tests_['metadata1']['metadata'] == {'x': 'foo', 'y': [1, {'a': 2}]} assert tests_['metadata2']['metadata'] == {'z': 1} assert 'metadata' not in tests_['unused_metadata'] assert 'metadata' not in tests_['empty_metadata'] assert 'metadata' not in tests_['unserializable_metadata'] > assert len(data['warnings']) == 1 and ( 'test_unserializable_metadata is not JSON-serializable' in data['warnings'][0]['message']) E assert (2 == 1 E +2 E -1) /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:278: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_json_metadata2 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I / gw1 I / gw2 I / gw3 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_json_metadata2 [gw1] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_json_metadata2 [gw2] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_json_metadata2 [gw3] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_json_metadata2 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw1] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw2] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw3] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [6] / gw1 [6] / gw2 [6] / gw3 [6] scheduling tests via LoadScheduling test_json_metadata.py::test_metadata1 test_json_metadata.py::test_metadata2 [gw0] [ 16%] PASSED test_json_metadata.py::test_metadata1 test_json_metadata.py::test_unused_metadata [gw2] [ 33%] PASSED test_json_metadata.py::test_unused_metadata test_json_metadata.py::test_unserializable_metadata [gw0] [ 50%] PASSED test_json_metadata.py::test_unserializable_metadata test_json_metadata.py::test_empty_metadata [gw3] [ 66%] PASSED test_json_metadata.py::test_empty_metadata [gw1] [ 83%] FAILED test_json_metadata.py::test_metadata2 test_json_metadata.py::test_multi_stage_metadata [gw1] [100%] PASSED test_json_metadata.py::test_multi_stage_metadata =================================== FAILURES =================================== ________________________________ test_metadata2 ________________________________ [gw1] linux -- Python 3.6.7 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python json_metadata = {'z': 1} def test_metadata2(json_metadata): json_metadata['z'] = 1 > assert False E assert False test_json_metadata.py:7: AssertionError =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_json_metadata.py::test_unserializable_metadata /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/pytest_jsonreport/plugin.py:109: UserWarning: Metadata of test_json_metadata.py::test_unserializable_metadata is not JSON-serializable. 'Metadata of {} is not JSON-serializable.'.format(item.nodeid)) -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (5807 bytes) =========================== short test summary info ============================ FAILED test_json_metadata.py::test_metadata2 - assert False =================== 1 failed, 5 passed, 2 warnings in 3.81s ==================== _______________________________ test_warnings[0] _______________________________ make_json = .func at 0x7f780bdc9840> num_processes = 0 def test_warnings(make_json, num_processes): warnings = make_json(""" class TestFoo: def __init__(self): pass def test_foo(self): assert True """)['warnings'] > assert len(warnings) == max(1, num_processes) E assert 2 == 1 E +2 E -1 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:357: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_warnings0 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 collecting ... collected 0 items =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_warnings.py:1 /tmp/pytest-of-travis/pytest-15/test_warnings0/test_warnings.py:1: PytestCollectionWarning: cannot collect test class 'TestFoo' because it has a __init__ constructor (from: test_warnings.py) class TestFoo: -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (1338 bytes) ============================= 2 warnings in 0.13s ============================== _______________________________ test_warnings[1] _______________________________ make_json = .func at 0x7f780bd8dc80> num_processes = 1 def test_warnings(make_json, num_processes): warnings = make_json(""" class TestFoo: def __init__(self): pass def test_foo(self): assert True """)['warnings'] > assert len(warnings) == max(1, num_processes) E assert 2 == 1 E +2 E -1 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:357: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_warnings1 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_warnings1 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [0] scheduling tests via LoadScheduling =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_warnings.py:1 /tmp/pytest-of-travis/pytest-15/test_warnings1/test_warnings.py:1: PytestCollectionWarning: cannot collect test class 'TestFoo' because it has a __init__ constructor (from: test_warnings.py) class TestFoo: -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (1023 bytes) ============================= 2 warnings in 2.02s ============================== _______________________________ test_warnings[4] _______________________________ make_json = .func at 0x7f780bd3e6a8> num_processes = 4 def test_warnings(make_json, num_processes): warnings = make_json(""" class TestFoo: def __init__(self): pass def test_foo(self): assert True """)['warnings'] > assert len(warnings) == max(1, num_processes) E assert 5 == 4 E +5 E -4 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/tests/test_jsonreport.py:357: AssertionError ----------------------------- Captured stdout call ----------------------------- ============================= test session starts ============================== platform linux -- Python 3.6.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1 -- /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/python cachedir: .pytest_cache metadata: {'Python': '3.6.7', 'Platform': 'Linux-4.15.0-1077-gcp-x86_64-with-debian-stretch-sid', 'Packages': {'pytest': '6.0.1', 'py': '1.9.0', 'pluggy': '0.13.1'}, 'Plugins': {'json-report': '1.2.4', 'metadata': '1.10.0', 'flaky': '3.7.0', 'xdist': '2.1.0', 'forked': '1.3.0'}} rootdir: /tmp/pytest-of-travis/pytest-15/test_warnings2 plugins: json-report-1.2.4, metadata-1.10.0, flaky-3.7.0, xdist-2.1.0, forked-1.3.0 gw0 I / gw1 I / gw2 I / gw3 I [gw0] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_warnings2 [gw1] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_warnings2 [gw2] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_warnings2 [gw3] linux Python 3.6.7 cwd: /tmp/pytest-of-travis/pytest-15/test_warnings2 [gw0] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw1] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw2] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] [gw3] Python 3.6.7 (default, Jun 12 2019, 02:05:21) -- [GCC 5.4.0 20160609] gw0 [0] / gw1 [0] / gw2 [0] / gw3 [0] scheduling tests via LoadScheduling =============================== warnings summary =============================== /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040 /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/lib/python3.6/site-packages/_pytest/config/__init__.py:1040: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: tests self._mark_plugins_for_rewrite(hook) test_warnings.py:1 test_warnings.py:1 test_warnings.py:1 test_warnings.py:1 /tmp/pytest-of-travis/pytest-15/test_warnings2/test_warnings.py:1: PytestCollectionWarning: cannot collect test class 'TestFoo' because it has a __init__ constructor (from: test_warnings.py) class TestFoo: -- Docs: https://docs.pytest.org/en/stable/warnings.html --------------------------------- JSON report ---------------------------------- JSON report written to: .report.json (1817 bytes) ============================= 5 warnings in 3.56s ============================== ===Flaky Test Report=== test_flaky_pass passed 1 out of the required 1 times. Success! test_flaky_fail failed (1 runs remaining out of 2). assert 1 == 2 +1 -2 [] test_flaky_fail passed 1 out of the required 1 times. Success! test_flaky_pass passed 1 out of the required 1 times. Success! test_flaky_fail failed (1 runs remaining out of 2). assert 1 == 2 +1 -2 [] test_flaky_fail passed 1 out of the required 1 times. Success! test_flaky_pass passed 1 out of the required 1 times. Success! test_flaky_fail failed (1 runs remaining out of 2). assert 1 == 2 +1 -2 [] test_flaky_fail passed 1 out of the required 1 times. Success! ===End Flaky Test Report=== =========================== short test summary info ============================ FAILED tests/test_jsonreport.py::test_report_keys[0] - AssertionError: assert... FAILED tests/test_jsonreport.py::test_report_keys[1] - AssertionError: assert... FAILED tests/test_jsonreport.py::test_report_keys[4] - AssertionError: assert... FAILED tests/test_jsonreport.py::test_json_metadata[0] - assert (2 == 1 FAILED tests/test_jsonreport.py::test_json_metadata[1] - assert (2 == 1 FAILED tests/test_jsonreport.py::test_json_metadata[4] - assert (2 == 1 FAILED tests/test_jsonreport.py::test_warnings[0] - assert 2 == 1 FAILED tests/test_jsonreport.py::test_warnings[1] - assert 2 == 1 FAILED tests/test_jsonreport.py::test_warnings[4] - assert 5 == 4 =================== 9 failed, 93 passed in 232.23s (0:03:52) =================== ERROR: InvocationError for command /tmp/tmp60tx9frq/pytest-json-report-1.2.4/.tox/py36/bin/coverage run --parallel -m pytest -v (exited with code 1) ___________________________________ summary ____________________________________ ERROR: py36: commands failed write json report at: /tmp/tmp60tx9frq/pytest-json-report-1.2.4/result.json Time: 273.3 seconds