components/python/pytest-benchmark/test/results-all.master

   1 py$(PYV): remove tox env folder $(@D)/.tox/py$(PYV)
   2 py$(PYV): commands[0]> pytest -vv --ignore=src
   3 ============================= test session starts ==============================
   4 platform sunos5 -- Python $(PYTHON_VERSION).X -- $(PYTHON)
   5 cachedir: .tox/py$(PYV)/.pytest_cache
   6 benchmark: 5.1.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
   7 rootdir: $(@D)
   8 configfile: pytest.ini
   9 testpaths: tests
  10 collecting ... collected 234 items / 31 deselected / 203 selected
  11
  12 tests/test_benchmark.py::test_help PASSED
  13 tests/test_benchmark.py::test_groups PASSED
  14 tests/test_benchmark.py::test_group_by_name PASSED
  15 tests/test_benchmark.py::test_group_by_func PASSED
  16 tests/test_benchmark.py::test_group_by_fullfunc PASSED
  17 tests/test_benchmark.py::test_group_by_param_all PASSED
  18 tests/test_benchmark.py::test_group_by_param_select PASSED
  19 tests/test_benchmark.py::test_group_by_param_select_multiple PASSED
  20 tests/test_benchmark.py::test_group_by_fullname PASSED
  21 tests/test_benchmark.py::test_double_use PASSED
  22 tests/test_benchmark.py::test_only_override_skip PASSED
  23 tests/test_benchmark.py::test_fixtures_also_skipped PASSED
  24 tests/test_benchmark.py::test_conflict_between_only_and_disable PASSED
  25 tests/test_benchmark.py::test_max_time_min_rounds PASSED
  26 tests/test_benchmark.py::test_max_time PASSED
  27 tests/test_benchmark.py::test_bogus_max_time PASSED
  28 tests/test_benchmark.py::test_pep418_timer PASSED
  29 tests/test_benchmark.py::test_bad_save PASSED
  30 tests/test_benchmark.py::test_bad_save_2 PASSED
  31 tests/test_benchmark.py::test_bad_compare_fail PASSED
  32 tests/test_benchmark.py::test_bad_rounds PASSED
  33 tests/test_benchmark.py::test_bad_rounds_2 PASSED
  34 tests/test_benchmark.py::test_compare PASSED
  35 tests/test_benchmark.py::test_compare_last PASSED
  36 tests/test_benchmark.py::test_compare_non_existing PASSED
  37 tests/test_benchmark.py::test_compare_non_existing_verbose PASSED
  38 tests/test_benchmark.py::test_compare_no_files PASSED
  39 tests/test_benchmark.py::test_compare_no_files_verbose PASSED
  40 tests/test_benchmark.py::test_compare_no_files_match PASSED
  41 tests/test_benchmark.py::test_compare_no_files_match_verbose PASSED
  42 tests/test_benchmark.py::test_verbose PASSED
  43 tests/test_benchmark.py::test_save PASSED
  44 tests/test_benchmark.py::test_save_extra_info PASSED
  45 tests/test_benchmark.py::test_update_machine_info_hook_detection PASSED
  46 tests/test_benchmark.py::test_autosave PASSED
  47 tests/test_benchmark.py::test_bogus_min_time PASSED
  48 tests/test_benchmark.py::test_disable_gc PASSED
  49 tests/test_benchmark.py::test_custom_timer PASSED
  50 tests/test_benchmark.py::test_bogus_timer PASSED
  51 tests/test_benchmark.py::test_sort_by_mean PASSED
  52 tests/test_benchmark.py::test_bogus_sort PASSED
  53 tests/test_benchmark.py::test_xdist PASSED
  54 tests/test_benchmark.py::test_xdist_verbose PASSED
  55 tests/test_benchmark.py::test_cprofile PASSED
  56 tests/test_benchmark.py::test_disabled_and_cprofile PASSED
  57 tests/test_benchmark.py::test_abort_broken PASSED
  58 tests/test_benchmark.py::test_basic PASSED
  59 tests/test_benchmark.py::test_skip PASSED
  60 tests/test_benchmark.py::test_disable PASSED
  61 tests/test_benchmark.py::test_mark_selection PASSED
  62 tests/test_benchmark.py::test_only_benchmarks PASSED
  63 tests/test_benchmark.py::test_columns PASSED
  64 tests/test_calibration.py::test_calibrate PASSED
  65 tests/test_calibration.py::test_calibrate_fast PASSED
  66 tests/test_calibration.py::test_calibrate_xfast PASSED
  67 tests/test_calibration.py::test_calibrate_slow PASSED
  68 tests/test_calibration.py::test_calibrate_stuck[True-0-1] PASSED
  69 tests/test_calibration.py::test_calibrate_stuck[True-0-0.01] PASSED
  70 tests/test_calibration.py::test_calibrate_stuck[True-0-1e-09] PASSED
  71 tests/test_calibration.py::test_calibrate_stuck[True-0-1e-10] PASSED
  72 tests/test_calibration.py::test_calibrate_stuck[True-0-1.000000000000001] PASSED
  73 tests/test_calibration.py::test_calibrate_stuck[True-1-1] PASSED
  74 tests/test_calibration.py::test_calibrate_stuck[True-1-0.01] PASSED
  75 tests/test_calibration.py::test_calibrate_stuck[True-1-1e-09] PASSED
  76 tests/test_calibration.py::test_calibrate_stuck[True-1-1e-10] PASSED
  77 tests/test_calibration.py::test_calibrate_stuck[True-1-1.000000000000001] PASSED
  78 tests/test_calibration.py::test_calibrate_stuck[True--1-1] PASSED
  79 tests/test_calibration.py::test_calibrate_stuck[True--1-0.01] PASSED
  80 tests/test_calibration.py::test_calibrate_stuck[True--1-1e-09] PASSED
  81 tests/test_calibration.py::test_calibrate_stuck[True--1-1e-10] PASSED
  82 tests/test_calibration.py::test_calibrate_stuck[True--1-1.000000000000001] PASSED
  83 tests/test_calibration.py::test_calibrate_stuck[False-0-1] PASSED
  84 tests/test_calibration.py::test_calibrate_stuck[False-0-0.01] PASSED
  85 tests/test_calibration.py::test_calibrate_stuck[False-0-1e-09] PASSED
  86 tests/test_calibration.py::test_calibrate_stuck[False-0-1e-10] PASSED
  87 tests/test_calibration.py::test_calibrate_stuck[False-0-1.000000000000001] PASSED
  88 tests/test_calibration.py::test_calibrate_stuck[False-1-1] PASSED
  89 tests/test_calibration.py::test_calibrate_stuck[False-1-0.01] PASSED
  90 tests/test_calibration.py::test_calibrate_stuck[False-1-1e-09] PASSED
  91 tests/test_calibration.py::test_calibrate_stuck[False-1-1e-10] PASSED
  92 tests/test_calibration.py::test_calibrate_stuck[False-1-1.000000000000001] PASSED
  93 tests/test_calibration.py::test_calibrate_stuck[False--1-1] PASSED
  94 tests/test_calibration.py::test_calibrate_stuck[False--1-0.01] PASSED
  95 tests/test_calibration.py::test_calibrate_stuck[False--1-1e-09] PASSED
  96 tests/test_calibration.py::test_calibrate_stuck[False--1-1e-10] PASSED
  97 tests/test_calibration.py::test_calibrate_stuck[False--1-1.000000000000001] PASSED
  98 tests/test_cli.py::test_help PASSED
  99 tests/test_cli.py::test_help_command PASSED
 100 tests/test_cli.py::test_help_list[list --help] PASSED
 101 tests/test_cli.py::test_help_list[help list] PASSED
 102 tests/test_cli.py::test_help_compare[compare --help] PASSED
 103 tests/test_cli.py::test_help_compare[help compare] PASSED
 104 tests/test_cli.py::test_list PASSED
 105 tests/test_doctest.rst::test_doctest.rst PASSED
 106 tests/test_elasticsearch_storage.py::test_handle_saving PASSED
 107 tests/test_elasticsearch_storage.py::test_parse_with_no_creds PASSED
 108 tests/test_elasticsearch_storage.py::test_parse_with_creds_in_first_host_of_url PASSED
 109 tests/test_elasticsearch_storage.py::test_parse_with_creds_in_second_host_of_url PASSED
 110 tests/test_elasticsearch_storage.py::test_parse_with_creds_in_netrc PASSED
 111 tests/test_elasticsearch_storage.py::test_parse_url_creds_supersedes_netrc_creds PASSED
 112 tests/test_elasticsearch_storage.py::test__mask_hosts PASSED
 113 tests/test_normal.py::test_normal PASSED
 114 tests/test_normal.py::test_fast PASSED
 115 tests/test_normal.py::test_slow PASSED
 116 tests/test_normal.py::test_slower PASSED
 117 tests/test_normal.py::test_xfast PASSED
 118 tests/test_normal.py::test_parametrized[0] PASSED
 119 tests/test_normal.py::test_parametrized[1] PASSED
 120 tests/test_normal.py::test_parametrized[2] PASSED
 121 tests/test_normal.py::test_parametrized[3] PASSED
 122 tests/test_normal.py::test_parametrized[4] PASSED
 123 tests/test_pedantic.py::test_single PASSED
 124 tests/test_pedantic.py::test_setup PASSED
 125 tests/test_pedantic.py::test_setup_cprofile PASSED
 126 tests/test_pedantic.py::test_args_kwargs PASSED
 127 tests/test_pedantic.py::test_iterations PASSED
 128 tests/test_pedantic.py::test_rounds_iterations PASSED
 129 tests/test_pedantic.py::test_rounds PASSED
 130 tests/test_pedantic.py::test_warmup_rounds PASSED
 131 tests/test_pedantic.py::test_rounds_must_be_int[0] PASSED
 132 tests/test_pedantic.py::test_rounds_must_be_int[x] PASSED
 133 tests/test_pedantic.py::test_warmup_rounds_must_be_int[-15] PASSED
 134 tests/test_pedantic.py::test_warmup_rounds_must_be_int[x] PASSED
 135 tests/test_pedantic.py::test_setup_many_rounds PASSED
 136 tests/test_pedantic.py::test_cant_use_both_args_and_setup_with_return PASSED
 137 tests/test_pedantic.py::test_can_use_both_args_and_setup_without_return PASSED
 138 tests/test_pedantic.py::test_cant_use_setup_with_many_iterations PASSED
 139 tests/test_pedantic.py::test_iterations_must_be_positive_int[0] PASSED
 140 tests/test_pedantic.py::test_iterations_must_be_positive_int[-1] PASSED
 141 tests/test_pedantic.py::test_iterations_must_be_positive_int[asdf] PASSED
 142 tests/test_sample.py::test_proto[SimpleProxy] PASSED
 143 tests/test_sample.py::test_proto[CachedPropertyProxy] PASSED
 144 tests/test_sample.py::test_proto[LocalsSimpleProxy] PASSED
 145 tests/test_sample.py::test_proto[LocalsCachedPropertyProxy] PASSED
 146 tests/test_skip.py::test_skip SKIPPED (bla)
 147 tests/test_stats.py::test_1 PASSED
 148 tests/test_stats.py::test_2 PASSED
 149 tests/test_stats.py::test_single_item PASSED
 150 tests/test_stats.py::test_length[1] PASSED
 151 tests/test_stats.py::test_length[2] PASSED
 152 tests/test_stats.py::test_length[3] PASSED
 153 tests/test_stats.py::test_length[4] PASSED
 154 tests/test_stats.py::test_length[5] PASSED
 155 tests/test_stats.py::test_length[6] PASSED
 156 tests/test_stats.py::test_length[7] PASSED
 157 tests/test_stats.py::test_length[8] PASSED
 158 tests/test_stats.py::test_length[9] PASSED
 159 tests/test_stats.py::test_iqr PASSED
 160 tests/test_stats.py::test_ops PASSED
 161 tests/test_storage.py::test_save_json[short] PASSED
 162 tests/test_storage.py::test_save_json[normal] PASSED
 163 tests/test_storage.py::test_save_json[long] PASSED
 164 tests/test_storage.py::test_save_json[trial] PASSED
 165 tests/test_storage.py::test_save_with_name[short] PASSED
 166 tests/test_storage.py::test_save_with_name[normal] PASSED
 167 tests/test_storage.py::test_save_with_name[long] PASSED
 168 tests/test_storage.py::test_save_with_name[trial] PASSED
 169 tests/test_storage.py::test_save_no_name[short] PASSED
 170 tests/test_storage.py::test_save_no_name[normal] PASSED
 171 tests/test_storage.py::test_save_no_name[long] PASSED
 172 tests/test_storage.py::test_save_no_name[trial] PASSED
 173 tests/test_storage.py::test_save_with_error[short] PASSED
 174 tests/test_storage.py::test_save_with_error[normal] PASSED
 175 tests/test_storage.py::test_save_with_error[long] PASSED
 176 tests/test_storage.py::test_save_with_error[trial] PASSED
 177 tests/test_storage.py::test_autosave[short] PASSED
 178 tests/test_storage.py::test_autosave[normal] PASSED
 179 tests/test_storage.py::test_autosave[long] PASSED
 180 tests/test_storage.py::test_autosave[trial] PASSED
 181 tests/test_utils.py::test_clonefunc[<lambda>] PASSED
 182 tests/test_utils.py::test_clonefunc[f2] PASSED
 183 tests/test_utils.py::test_clonefunc_not_function PASSED
 184 tests/test_utils.py::test_get_commit_info[git-True] PASSED
 185 tests/test_utils.py::test_get_commit_info[git-False] PASSED
 186 tests/test_utils.py::test_get_commit_info[hg-True] PASSED
 187 tests/test_utils.py::test_get_commit_info[hg-False] PASSED
 188 tests/test_utils.py::test_missing_scm_bins[git-True] PASSED
 189 tests/test_utils.py::test_missing_scm_bins[git-False] PASSED
 190 tests/test_utils.py::test_missing_scm_bins[hg-True] PASSED
 191 tests/test_utils.py::test_missing_scm_bins[hg-False] PASSED
 192 tests/test_utils.py::test_get_branch_info[git] PASSED
 193 tests/test_utils.py::test_get_branch_info[hg] PASSED
 194 tests/test_utils.py::test_no_branch_info PASSED
 195 tests/test_utils.py::test_commit_info_error PASSED
 196 tests/test_utils.py::test_parse_warmup PASSED
 197 tests/test_utils.py::test_parse_columns PASSED
 198 tests/test_utils.py::test_get_project_name[False-None] PASSED
 199 tests/test_utils.py::test_get_project_name[False-git] PASSED
 200 tests/test_utils.py::test_get_project_name[False-hg] PASSED
 201 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo-None] PASSED
 202 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo-git] PASSED
 203 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo-hg] PASSED
 204 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo.git-None] PASSED
 205 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo.git-git] PASSED
 206 tests/test_utils.py::test_get_project_name[https://example.com/pytest_benchmark_repo.git-hg] PASSED
 207 tests/test_utils.py::test_get_project_name[c:\\foo\\bar\\pytest_benchmark_repo.gitfoo@example.com:pytest_benchmark_repo.git-None] PASSED
 208 tests/test_utils.py::test_get_project_name[c:\\foo\\bar\\pytest_benchmark_repo.gitfoo@example.com:pytest_benchmark_repo.git-git] PASSED
 209 tests/test_utils.py::test_get_project_name[c:\\foo\\bar\\pytest_benchmark_repo.gitfoo@example.com:pytest_benchmark_repo.git-hg] PASSED
 210 tests/test_utils.py::test_get_project_name_broken[git] PASSED
 211 tests/test_utils.py::test_get_project_name_broken[hg] PASSED
 212 tests/test_utils.py::test_get_project_name_fallback PASSED
 213 tests/test_utils.py::test_get_project_name_fallback_broken_hgrc PASSED
 214 tests/test_with_testcase.py::TerribleTerribleWayToWriteTests::test_foo PASSED
 215
 216
 217 Legend:
 218   Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 219   OPS: Operations Per Second, computed as 1 / Mean
 220 =========================== short test summary info ============================
 221 ======== 202 passed, 1 skipped, 31 deselected ========
 222   py$(PYV): OK
 223   congratulations :)