Commits

Christian Heimes committed b4f1a43

add more windows timings

  • Participants
  • Parent commits 2fe524a

Comments (0)

Files changed (3)

     cmean = statistics.mean(changed)
     var = statistics.variance(diff)
     dev = statistics.stdev(diff)
-    return bsum, csum, (csum/bsum - 1)*100., bmean, cmean, var, dev
+    dev3 = cmean - (bmean + 3 * dev)
+    return bsum, csum, (csum/bsum - 1)*100., bmean, cmean, var, dev, dev3
 
 def main():
     print("filename                               base    changed diff%  bmean  cmean  var    stdev")
-    fmt = "{:<36}  {: 1.2f}  {: 1.2f}  {: 1.1f}%  {: 1.3f} {: 1.3f}  {:1.3f}  {:1.3f}"
+    fmt = "{:<36}  {: 1.2f}  {: 1.2f}  {: 1.1f}%  {: 1.3f} {: 1.3f}  {:1.3f}  {:1.3f}  {:1.3f}"
     for fname in sorted(findcsv()):
         lines = list(readcsv(fname))
         name = fname.lstrip("./")[:-4]

File win7_core_i7_virtbox/benchmark_x86.csv

+Benchmark,Base,Changed
+2to3,0.906000,0.906000
+call_method,0.546875,0.546875
+call_method_slots,0.541408,0.546875
+call_method_unknown,0.546875,0.501192
+call_simple,0.406250,0.390625
+chaos,0.500000,0.515625
+django_v2,0.984375,0.968750
+etree_generate,0.468750,0.468750
+etree_iterparse,0.734375,0.765625
+etree_parse,0.421875,0.468750
+etree_process,0.390625,0.390625
+fannkuch,2.109375,2.250000
+fastpickle,0.750000,0.765625
+fastunpickle,0.875000,1.000000
+float,0.546875,0.531250
+formatted_logging,0.656250,0.671875
+go,0.953125,0.953125
+iterative_count,0.265625,0.265625
+json_dump_v2,4.406250,4.343750
+json_load,0.671875,0.796875
+mako,0.062500,0.062500
+mako_v2,0.046875,0.046875
+meteor_contest,0.328125,0.328125
+nbody,0.468750,0.468750
+normal_startup,1.172000,1.188000
+nqueens,0.421875,0.437500
+pathlib,0.375000,0.375000
+pidigits,1.625000,1.625000
+raytrace,2.265625,2.203125
+regex_compile,0.625000,0.640625
+regex_effbot,0.093750,0.093750
+regex_v8,0.062500,0.062500
+richards,0.296875,0.312500
+silent_logging,0.125000,0.125000
+simple_logging,0.625000,0.640625
+spectral_norm,0.609375,0.625000
+startup_nosite,0.890000,0.906000
+telco,0.016543,0.016730
+threaded_count,0.281250,0.265625
+unpack_sequence,0.000000,0.000000

File win7_core_i7_virtbox/benchmark_x86.txt

+Running 2to3...
+Running call_method...
+Running call_method_slots...
+Running call_method_unknown...
+Running call_simple...
+Running chaos...
+Running django_v2...
+Running etree_generate...
+Running etree_iterparse...
+Running etree_parse...
+Running etree_process...
+Running fannkuch...
+Running fastpickle...
+Running fastunpickle...
+Running float...
+Running formatted_logging...
+Running go...
+Running iterative_count...
+Running json_dump_v2...
+Running json_load...
+Running mako...
+Running mako_v2...
+Running meteor_contest...
+Running nbody...
+Running normal_startup...
+Running nqueens...
+Running pathlib...
+Running pidigits...
+Running raytrace...
+Running regex_compile...
+Running regex_effbot...
+Running regex_v8...
+Running richards...
+Running silent_logging...
+Running simple_logging...
+Running spectral_norm...
+Running startup_nosite...
+Running telco...
+Running threaded_count...
+Running unpack_sequence...
+
+Report on Windows hamiller-win7 7 6.1.7601 AMD64 Intel64 Family 6 Model 42 Stepping 7, GenuineIntel
+Total CPU cores: 4
+
+### 2to3 ###
+0.906000 -> 0.906000: no change
+
+### call_method_slots ###
+Min: 0.541408 -> 0.546875: 1.01x slower
+Avg: 0.550689 -> 0.574792: 1.04x slower
+Significant (t=-3.39)
+Stddev: 0.00978 -> 0.02578: 2.6346x larger
+
+### call_method_unknown ###
+Min: 0.546875 -> 0.501192: 1.09x faster
+Avg: 0.592966 -> 0.537296: 1.10x faster
+Significant (t=6.40)
+Stddev: 0.02231 -> 0.02521: 1.1300x larger
+
+### call_simple ###
+Min: 0.406250 -> 0.390625: 1.04x faster
+Avg: 0.416667 -> 0.398958: 1.04x faster
+Significant (t=6.18)
+Stddev: 0.00762 -> 0.00807: 1.0583x larger
+
+### etree_iterparse ###
+Min: 0.734375 -> 0.765625: 1.04x slower
+Avg: 0.746875 -> 0.768750: 1.03x slower
+Significant (t=-4.95)
+Stddev: 0.00699 -> 0.00699: no change
+
+### etree_parse ###
+Min: 0.421875 -> 0.468750: 1.11x slower
+Avg: 0.434375 -> 0.475000: 1.09x slower
+Significant (t=-8.22)
+Stddev: 0.00699 -> 0.00856: 1.2247x larger
+
+### fannkuch ###
+Min: 2.109375 -> 2.250000: 1.07x slower
+Avg: 2.118750 -> 2.271875: 1.07x slower
+Significant (t=-15.12)
+Stddev: 0.00856 -> 0.02096: 2.4495x larger
+
+### fastunpickle ###
+Min: 0.875000 -> 1.000000: 1.14x slower
+Avg: 0.887500 -> 1.012500: 1.14x slower
+Significant (t=-18.86)
+Stddev: 0.01307 -> 0.00699: 1.8708x smaller
+
+### json_load ###
+Min: 0.671875 -> 0.796875: 1.19x slower
+Avg: 0.687500 -> 0.796875: 1.16x slower
+Significant (t=-22.14)
+Stddev: 0.01105 -> 0.00000: incomparable (one result was zero)
+
+### raytrace ###
+Min: 2.265625 -> 2.203125: 1.03x faster
+Avg: 2.281250 -> 2.228125: 1.02x faster
+Significant (t=5.67)
+Stddev: 0.01105 -> 0.01782: 1.6125x larger
+
+### richards ###
+Min: 0.296875 -> 0.312500: 1.05x slower
+Avg: 0.300000 -> 0.312500: 1.04x slower
+Significant (t=-4.00)
+Stddev: 0.00699 -> 0.00000: incomparable (one result was zero)
+
+### startup_nosite ###
+Min: 0.890000 -> 0.906000: 1.02x slower
+Avg: 0.895300 -> 0.925000: 1.03x slower
+Significant (t=-3.74)
+Stddev: 0.01040 -> 0.02289: 2.2003x larger
+
+### threaded_count ###
+Min: 0.281250 -> 0.265625: 1.06x faster
+Avg: 0.290625 -> 0.271875: 1.07x faster
+Significant (t=3.46)
+Stddev: 0.00856 -> 0.00856: no change
+
+The following not significant results are hidden, use -v to show them:
+call_method, chaos, django_v2, etree_generate, etree_process, fastpickle, float, formatted_logging, go, iterative_count, json_dump_v2, mako, mako_v2, meteor_contest, nbody, normal_startup, nqueens, pathlib, pidigits, regex_compile, regex_effbot, regex_v8, silent_logging, simple_logging, spectral_norm, telco, unpack_sequence.