Commits

Yit Phang Khoo committed 6971cad

Apply correction to PLDI 2014 AEC monotonic exptree results and regenerate summaries with tables.

Comments (0)

Files changed (29)

Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/exptree-0004.json.gz

Binary file modified.

Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/index.html

-<!doctype html>
-<meta charset=utf-8>
-<title>2013-07-10-20-38-47 monotonic monotonic-take-all</title>
-<style>figure.inline-figure { display: inline-block; margin: 0; }</style>
-<h1 id="exptree-0004">exptree-0004</h1>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-time-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-time-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-update-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-evaluate-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-evaluate-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-clean-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-dirty-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-max-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-max-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSAEager-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSALazy-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSAEager-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSALazy-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSAEager-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSALazy-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSAEager-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-NonSALazy-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-LazySABidi-details.pdf></figure>
-<figure class=inline-figure><img src=exptree-0004/exptree-0004-EagerSATotalOrder-details.pdf></figure>
-<h1 id="tfold(min)-0004">tfold(min)-0004</h1>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-time-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-time-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-update-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-evaluate-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-evaluate-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-clean-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-dirty-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-max-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-max-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSAEager-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSALazy-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSAEager-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSALazy-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSAEager-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSALazy-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSAEager-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-NonSALazy-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-LazySABidi-details.pdf></figure>
-<figure class=inline-figure><img src=tfold(min)-0004/tfold%28min%29-0004-EagerSATotalOrder-details.pdf></figure>
-<h1 id="tfold(sum)-0004">tfold(sum)-0004</h1>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-time-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-time-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-update-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-evaluate-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-evaluate-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-clean-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-dirty-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-max-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-max-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSAEager-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSALazy-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSAEager-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSALazy-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSAEager-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSALazy-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSAEager-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-NonSALazy-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-LazySABidi-details.pdf></figure>
-<figure class=inline-figure><img src=tfold(sum)-0004/tfold%28sum%29-0004-EagerSATotalOrder-details.pdf></figure>
-<h1 id="summary">Summary</h1>
-<pre>
-    Summarizing exptree-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/exptree-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  3.48e-05      87.9
-                              EagerSATotalOrder (from-scratch) ...  4.62e-05      18.5
-                                      NonSALazy (from-scratch) ...  3.22e-06     0.308
-                                     NonSAEager (from-scratch) ...  1.49e-06     0.143
-                                        LazySABidi (propagate) ...  2.01e-05   0.00124
-                                 EagerSATotalOrder (propagate) ...  1.56e-05  0.000413
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  3.48e-05      87.9
-                              EagerSATotalOrder (from-scratch) ...  4.62e-05      18.5
-                                      NonSALazy (from-scratch) ...  3.22e-06     0.308
-                                     NonSAEager (from-scratch) ...  1.49e-06     0.143
-                                        LazySABidi (propagate) ...  2.01e-05   0.00124
-                                 EagerSATotalOrder (propagate) ...  1.56e-05  0.000413
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  8.35e+08
-                              EagerSATotalOrder (from-scratch) ...         0  7.72e+08
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  4.39e+03
-                                     LazySABidi (from-scratch) ...         0  4.03e+03
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         2         2
-                                 EagerSATotalOrder (propagate) ...         2         2
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         7     2e+06
-                              EagerSATotalOrder (from-scratch) ...         7     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      6.38      35.8
-                                 EagerSATotalOrder (propagate) ...      6.38      35.8
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         7     2e+06
-                              EagerSATotalOrder (from-scratch) ...         7     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      6.38      35.8
-                                 EagerSATotalOrder (propagate) ...      6.38      35.8
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0      6.92
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      5.28      40.7
-                                 EagerSATotalOrder (propagate) ...      4.38      33.8
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.78e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.48e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06  1.53e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.52e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.78e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.48e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       680  4.86e+03
-                                     LazySABidi (from-scratch) ...       520   4.5e+03
-                                      NonSALazy (from-scratch) ...       520       888
-                                     NonSAEager (from-scratch) ...       520       888
-                                 EagerSATotalOrder (propagate) ...       680  4.86e+03
-                                        LazySABidi (propagate) ...       520   4.5e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      23.4       613
-                           EagerSATotalOrder ...        31       129
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      10.8       285
-                           EagerSATotalOrder ...      14.4      60.1
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...    0.0741       116
-                           EagerSATotalOrder ...    0.0956       347
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      0.16       248
-                           EagerSATotalOrder ...     0.206       746
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  2.01e-05   0.00124
-                              update ...  2.63e-06  6.69e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  1.56e-05  0.000413
-                              update ...  1.93e-06  1.39e-05
-    Summarizing tfold(min)-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  7.15e-05      44.5
-                              EagerSATotalOrder (from-scratch) ...  6.55e-05      22.1
-                                     NonSAEager (from-scratch) ...  1.27e-05      2.43
-                                      NonSALazy (from-scratch) ...  1.77e-05      1.43
-                                 EagerSATotalOrder (propagate) ...  2.24e-05  0.000461
-                                        LazySABidi (propagate) ...  1.78e-05  0.000328
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  7.15e-05      44.5
-                              EagerSATotalOrder (from-scratch) ...  6.55e-05      22.1
-                                     NonSAEager (from-scratch) ...  1.27e-05      2.43
-                                      NonSALazy (from-scratch) ...  1.77e-05      1.43
-                                 EagerSATotalOrder (propagate) ...  2.24e-05  0.000461
-                                        LazySABidi (propagate) ...  1.78e-05  0.000328
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  9.53e+08
-                              EagerSATotalOrder (from-scratch) ...         0  9.06e+08
-                                     NonSAEager (from-scratch) ...         0  1.43e+08
-                                      NonSALazy (from-scratch) ...         0   6.6e+07
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0   1.2e+08
-                                     NonSAEager (from-scratch) ...         0  2.76e+07
-                                     LazySABidi (from-scratch) ...         0  1.07e+04
-                                      NonSALazy (from-scratch) ...         0  6.51e+03
-                                        LazySABidi (propagate) ...      1.56         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...      20.6     2e+06
-                              EagerSATotalOrder (from-scratch) ...      15.4     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      10.5      31.6
-                                        LazySABidi (propagate) ...       7.4      21.2
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...      20.6     2e+06
-                              EagerSATotalOrder (from-scratch) ...      15.4     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      10.5      31.6
-                                        LazySABidi (propagate) ...       7.4      21.2
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      3.43      60.6
-                                 EagerSATotalOrder (propagate) ...     0.256    0.0102
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...        14      74.4
-                                 EagerSATotalOrder (propagate) ...      7.31        13
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.61e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.41e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06   2.4e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.79e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.61e+09
-                                 EagerSATotalOrder (propagate) ...  5.21e+06  1.44e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584   1.2e+08
-                                     NonSAEager (from-scratch) ...       424  2.76e+07
-                                     LazySABidi (from-scratch) ...       424  1.11e+04
-                                      NonSALazy (from-scratch) ...       424  6.88e+03
-                                 EagerSATotalOrder (propagate) ...       584   1.2e+08
-                                        LazySABidi (propagate) ...  1.36e+03  1.11e+04
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      5.64      18.3
-                           EagerSATotalOrder ...      5.17      9.08
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      4.03      31.2
-                           EagerSATotalOrder ...       3.7      15.5
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      0.71   7.4e+03
-                           EagerSATotalOrder ...     0.566  5.26e+03
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...     0.994  4.35e+03
-                           EagerSATotalOrder ...     0.792  3.09e+03
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  1.78e-05  0.000328
-                              update ...  1.57e-06  2.22e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  2.24e-05  0.000461
-                              update ...  7.89e-07  1.23e-06
-    Summarizing tfold(sum)-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  6.67e-05        45
-                              EagerSATotalOrder (from-scratch) ...  6.53e-05      22.5
-                                     NonSAEager (from-scratch) ...  1.13e-05      2.44
-                                      NonSALazy (from-scratch) ...  1.76e-05      1.48
-                                        LazySABidi (propagate) ...  2.08e-05  0.000903
-                                 EagerSATotalOrder (propagate) ...  2.49e-05   0.00035
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  6.67e-05        45
-                              EagerSATotalOrder (from-scratch) ...  6.53e-05      22.5
-                                     NonSAEager (from-scratch) ...  1.13e-05      2.44
-                                      NonSALazy (from-scratch) ...  1.76e-05      1.48
-                                        LazySABidi (propagate) ...  2.08e-05  0.000903
-                                 EagerSATotalOrder (propagate) ...  2.49e-05   0.00035
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.04e+09
-                                     LazySABidi (from-scratch) ...         0  9.59e+08
-                                     NonSAEager (from-scratch) ...         0  1.45e+08
-                                      NonSALazy (from-scratch) ...         0  8.33e+07
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0   1.2e+08
-                                     NonSAEager (from-scratch) ...         0  3.02e+07
-                                     LazySABidi (from-scratch) ...         0  1.09e+04
-                                      NonSALazy (from-scratch) ...         0   6.8e+03
-                                        LazySABidi (propagate) ...      2.49         0
-                                 EagerSATotalOrder (propagate) ...         0     0.724
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...      21.4     2e+06
-                              EagerSATotalOrder (from-scratch) ...      17.6     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      11.6      94.4
-                                        LazySABidi (propagate) ...      9.57      82.2
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...      21.4     2e+06
-                              EagerSATotalOrder (from-scratch) ...      17.6     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      11.6      94.4
-                                        LazySABidi (propagate) ...      9.57      82.2
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      1.69     0.151
-                                 EagerSATotalOrder (propagate) ...     0.354    0.0065
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      15.1      79.7
-                                 EagerSATotalOrder (propagate) ...      8.11      76.5
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.63e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.44e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06  2.55e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06   1.8e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.63e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.44e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584   1.2e+08
-                                     NonSAEager (from-scratch) ...       424  3.02e+07
-                                     LazySABidi (from-scratch) ...       424  1.12e+04
-                                      NonSALazy (from-scratch) ...       424  7.17e+03
-                                 EagerSATotalOrder (propagate) ...       584   1.2e+08
-                                        LazySABidi (propagate) ...  1.47e+03  1.12e+04
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      5.89      18.4
-                           EagerSATotalOrder ...      5.77      9.22
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.78      30.5
-                           EagerSATotalOrder ...       3.7      15.2
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...     0.543   2.7e+03
-                           EagerSATotalOrder ...     0.454  6.97e+03
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...     0.846  1.64e+03
-                           EagerSATotalOrder ...     0.708  4.22e+03
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  2.08e-05  0.000903
-                              update ...  1.48e-06  1.61e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  2.49e-05   0.00035
-                              update ...  8.81e-07   1.4e-06
-
-</pre>
-<style>div#header { position: fixed; top: 0; right: 0; padding: 0.5em; background: white }</style>
-<div id="header">
-<a href="#summary">Summary</a>
-<a href="#exptree-0004">exptree-0004</a>
-<a href="#tfold(min)-0004">tfold(min)-0004</a>
-<a href="#tfold(sum)-0004">tfold(sum)-0004</a>
-</div>

Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/summary.txt

-    Summarizing exptree-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/exptree-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  3.48e-05      87.9
-                              EagerSATotalOrder (from-scratch) ...  4.62e-05      18.5
-                                      NonSALazy (from-scratch) ...  3.22e-06     0.308
-                                     NonSAEager (from-scratch) ...  1.49e-06     0.143
-                                        LazySABidi (propagate) ...  2.01e-05   0.00124
-                                 EagerSATotalOrder (propagate) ...  1.56e-05  0.000413
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  3.48e-05      87.9
-                              EagerSATotalOrder (from-scratch) ...  4.62e-05      18.5
-                                      NonSALazy (from-scratch) ...  3.22e-06     0.308
-                                     NonSAEager (from-scratch) ...  1.49e-06     0.143
-                                        LazySABidi (propagate) ...  2.01e-05   0.00124
-                                 EagerSATotalOrder (propagate) ...  1.56e-05  0.000413
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  8.35e+08
-                              EagerSATotalOrder (from-scratch) ...         0  7.72e+08
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  4.39e+03
-                                     LazySABidi (from-scratch) ...         0  4.03e+03
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         2         2
-                                 EagerSATotalOrder (propagate) ...         2         2
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         7     2e+06
-                              EagerSATotalOrder (from-scratch) ...         7     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      6.38      35.8
-                                 EagerSATotalOrder (propagate) ...      6.38      35.8
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         7     2e+06
-                              EagerSATotalOrder (from-scratch) ...         7     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      6.38      35.8
-                                 EagerSATotalOrder (propagate) ...      6.38      35.8
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0      6.92
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      5.28      40.7
-                                 EagerSATotalOrder (propagate) ...      4.38      33.8
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.78e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.48e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06  1.53e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.52e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.78e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.48e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       680  4.86e+03
-                                     LazySABidi (from-scratch) ...       520   4.5e+03
-                                      NonSALazy (from-scratch) ...       520       888
-                                     NonSAEager (from-scratch) ...       520       888
-                                 EagerSATotalOrder (propagate) ...       680  4.86e+03
-                                        LazySABidi (propagate) ...       520   4.5e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      23.4       613
-                           EagerSATotalOrder ...        31       129
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      10.8       285
-                           EagerSATotalOrder ...      14.4      60.1
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...    0.0741       116
-                           EagerSATotalOrder ...    0.0956       347
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      0.16       248
-                           EagerSATotalOrder ...     0.206       746
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  2.01e-05   0.00124
-                              update ...  2.63e-06  6.69e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  1.56e-05  0.000413
-                              update ...  1.93e-06  1.39e-05
-    Summarizing tfold(min)-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  7.15e-05      44.5
-                              EagerSATotalOrder (from-scratch) ...  6.55e-05      22.1
-                                     NonSAEager (from-scratch) ...  1.27e-05      2.43
-                                      NonSALazy (from-scratch) ...  1.77e-05      1.43
-                                 EagerSATotalOrder (propagate) ...  2.24e-05  0.000461
-                                        LazySABidi (propagate) ...  1.78e-05  0.000328
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  7.15e-05      44.5
-                              EagerSATotalOrder (from-scratch) ...  6.55e-05      22.1
-                                     NonSAEager (from-scratch) ...  1.27e-05      2.43
-                                      NonSALazy (from-scratch) ...  1.77e-05      1.43
-                                 EagerSATotalOrder (propagate) ...  2.24e-05  0.000461
-                                        LazySABidi (propagate) ...  1.78e-05  0.000328
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  9.53e+08
-                              EagerSATotalOrder (from-scratch) ...         0  9.06e+08
-                                     NonSAEager (from-scratch) ...         0  1.43e+08
-                                      NonSALazy (from-scratch) ...         0   6.6e+07
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0   1.2e+08
-                                     NonSAEager (from-scratch) ...         0  2.76e+07
-                                     LazySABidi (from-scratch) ...         0  1.07e+04
-                                      NonSALazy (from-scratch) ...         0  6.51e+03
-                                        LazySABidi (propagate) ...      1.56         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...      20.6     2e+06
-                              EagerSATotalOrder (from-scratch) ...      15.4     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      10.5      31.6
-                                        LazySABidi (propagate) ...       7.4      21.2
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...      20.6     2e+06
-                              EagerSATotalOrder (from-scratch) ...      15.4     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      10.5      31.6
-                                        LazySABidi (propagate) ...       7.4      21.2
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      3.43      60.6
-                                 EagerSATotalOrder (propagate) ...     0.256    0.0102
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...        14      74.4
-                                 EagerSATotalOrder (propagate) ...      7.31        13
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.61e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.41e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06   2.4e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.79e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.61e+09
-                                 EagerSATotalOrder (propagate) ...  5.21e+06  1.44e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584   1.2e+08
-                                     NonSAEager (from-scratch) ...       424  2.76e+07
-                                     LazySABidi (from-scratch) ...       424  1.11e+04
-                                      NonSALazy (from-scratch) ...       424  6.88e+03
-                                 EagerSATotalOrder (propagate) ...       584   1.2e+08
-                                        LazySABidi (propagate) ...  1.36e+03  1.11e+04
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      5.64      18.3
-                           EagerSATotalOrder ...      5.17      9.08
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      4.03      31.2
-                           EagerSATotalOrder ...       3.7      15.5
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      0.71   7.4e+03
-                           EagerSATotalOrder ...     0.566  5.26e+03
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...     0.994  4.35e+03
-                           EagerSATotalOrder ...     0.792  3.09e+03
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  1.78e-05  0.000328
-                              update ...  1.57e-06  2.22e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  2.24e-05  0.000461
-                              update ...  7.89e-07  1.23e-06
-    Summarizing tfold(sum)-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  6.67e-05        45
-                              EagerSATotalOrder (from-scratch) ...  6.53e-05      22.5
-                                     NonSAEager (from-scratch) ...  1.13e-05      2.44
-                                      NonSALazy (from-scratch) ...  1.76e-05      1.48
-                                        LazySABidi (propagate) ...  2.08e-05  0.000903
-                                 EagerSATotalOrder (propagate) ...  2.49e-05   0.00035
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  6.67e-05        45
-                              EagerSATotalOrder (from-scratch) ...  6.53e-05      22.5
-                                     NonSAEager (from-scratch) ...  1.13e-05      2.44
-                                      NonSALazy (from-scratch) ...  1.76e-05      1.48
-                                        LazySABidi (propagate) ...  2.08e-05  0.000903
-                                 EagerSATotalOrder (propagate) ...  2.49e-05   0.00035
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.04e+09
-                                     LazySABidi (from-scratch) ...         0  9.59e+08
-                                     NonSAEager (from-scratch) ...         0  1.45e+08
-                                      NonSALazy (from-scratch) ...         0  8.33e+07
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0   1.2e+08
-                                     NonSAEager (from-scratch) ...         0  3.02e+07
-                                     LazySABidi (from-scratch) ...         0  1.09e+04
-                                      NonSALazy (from-scratch) ...         0   6.8e+03
-                                        LazySABidi (propagate) ...      2.49         0
-                                 EagerSATotalOrder (propagate) ...         0     0.724
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...      21.4     2e+06
-                              EagerSATotalOrder (from-scratch) ...      17.6     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      11.6      94.4
-                                        LazySABidi (propagate) ...      9.57      82.2
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...      21.4     2e+06
-                              EagerSATotalOrder (from-scratch) ...      17.6     2e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      11.6      94.4
-                                        LazySABidi (propagate) ...      9.57      82.2
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      1.69     0.151
-                                 EagerSATotalOrder (propagate) ...     0.354    0.0065
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      15.1      79.7
-                                 EagerSATotalOrder (propagate) ...      8.11      76.5
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  1.63e+09
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  1.44e+09
-                                     NonSAEager (from-scratch) ...  1.02e+06  2.55e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06   1.8e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.63e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.44e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584   1.2e+08
-                                     NonSAEager (from-scratch) ...       424  3.02e+07
-                                     LazySABidi (from-scratch) ...       424  1.12e+04
-                                      NonSALazy (from-scratch) ...       424  7.17e+03
-                                 EagerSATotalOrder (propagate) ...       584   1.2e+08
-                                        LazySABidi (propagate) ...  1.47e+03  1.12e+04
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      5.89      18.4
-                           EagerSATotalOrder ...      5.77      9.22
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.78      30.5
-                           EagerSATotalOrder ...       3.7      15.2
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...     0.543   2.7e+03
-                           EagerSATotalOrder ...     0.454  6.97e+03
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...     0.846  1.64e+03
-                           EagerSATotalOrder ...     0.708  4.22e+03
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  2.08e-05  0.000903
-                              update ...  1.48e-06  1.61e-05
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  2.49e-05   0.00035
-                              update ...  8.81e-07   1.4e-06

Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/index.html

-<!doctype html>
-<meta charset=utf-8>
-<title>2013-07-10-21-16-53 monotonic monotonic-take-all</title>
-<style>figure.inline-figure { display: inline-block; margin: 0; }</style>
-<h1 id="filter-0004">filter-0004</h1>
-<figure class=inline-figure><img src=filter-0004/filter-0004-time-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-time-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-update-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-evaluate-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-evaluate-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-clean-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-dirty-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-max-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-max-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSAEager-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSALazy-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSAEager-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSALazy-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSAEager-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSALazy-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSAEager-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-NonSALazy-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-LazySABidi-details.pdf></figure>
-<figure class=inline-figure><img src=filter-0004/filter-0004-EagerSATotalOrder-details.pdf></figure>
-<h1 id="map-0004">map-0004</h1>
-<figure class=inline-figure><img src=map-0004/map-0004-time-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-time-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-update-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-evaluate-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-evaluate-1.01-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-clean-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-dirty-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-max-heap-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-max-stack-1.01-from-scratch-propagate.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSAEager-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSALazy-time-overhead.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSAEager-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSALazy-time-speedup.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSAEager-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSALazy-evaluate-overhead.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSAEager-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-NonSALazy-evaluate-speedup.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-LazySABidi-details.pdf></figure>
-<figure class=inline-figure><img src=map-0004/map-0004-EagerSATotalOrder-details.pdf></figure>
-<h1 id="summary">Summary</h1>
-<pre>
-    Summarizing filter-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-21-16-53 monotonic monotonic-take-all/filter-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  3.86e-05        13
-                              EagerSATotalOrder (from-scratch) ...   4.6e-05        12
-                                     NonSAEager (from-scratch) ...  8.91e-06      1.05
-                                      NonSALazy (from-scratch) ...  1.11e-05     0.629
-                                        LazySABidi (propagate) ...  4.82e-06     0.309
-                                 EagerSATotalOrder (propagate) ...  3.43e-06     0.153
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  3.86e-05        13
-                              EagerSATotalOrder (from-scratch) ...   4.6e-05        12
-                                     NonSAEager (from-scratch) ...  8.91e-06      1.05
-                                      NonSALazy (from-scratch) ...  1.11e-05     0.629
-                                        LazySABidi (propagate) ...  4.82e-06     0.309
-                                 EagerSATotalOrder (propagate) ...  3.43e-06     0.153
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  5.71e+08
-                              EagerSATotalOrder (from-scratch) ...         0  5.03e+08
-                                      NonSALazy (from-scratch) ...         0  5.51e+07
-                                     NonSAEager (from-scratch) ...         0  2.23e+07
-                                 EagerSATotalOrder (propagate) ...         0  7.55e+04
-                                        LazySABidi (propagate) ...         0  4.52e+04
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.38e+08
-                                     NonSAEager (from-scratch) ...         0  2.65e+07
-                                     LazySABidi (from-scratch) ...         0       998
-                                      NonSALazy (from-scratch) ...         0       710
-                                        LazySABidi (propagate) ...         0      23.8
-                                 EagerSATotalOrder (propagate) ...         0      13.4
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      1.87      1.98
-                                        LazySABidi (propagate) ...      1.34      1.48
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      1.87      1.98
-                                        LazySABidi (propagate) ...      1.34      1.48
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...     0.272     0.493
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      1.67      1.97
-                                 EagerSATotalOrder (propagate) ...      1.37      1.48
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  9.13e+08
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  7.73e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.57e+08
-                                     NonSAEager (from-scratch) ...  1.02e+06  1.55e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.58e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.41e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584  1.38e+08
-                                     NonSAEager (from-scratch) ...       424  2.65e+07
-                                     LazySABidi (from-scratch) ...       424  1.37e+03
-                                      NonSALazy (from-scratch) ...       424  1.09e+03
-                                 EagerSATotalOrder (propagate) ...       584  1.38e+08
-                                        LazySABidi (propagate) ...       424  1.37e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      4.33      12.4
-                           EagerSATotalOrder ...      5.16      11.5
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.46      20.7
-                           EagerSATotalOrder ...      4.12      19.1
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      1.85      3.39
-                           EagerSATotalOrder ...       2.6      6.84
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      2.31      2.04
-                           EagerSATotalOrder ...      3.25      4.11
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  4.82e-06     0.309
-                              update ...  7.09e-07  5.85e-06
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  3.43e-06     0.153
-                              update ...  5.34e-07  5.07e-06
-    Summarizing map-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-21-16-53 monotonic monotonic-take-all/map-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...  5.82e-05      13.2
-                                     LazySABidi (from-scratch) ...  4.93e-05      12.9
-                                     NonSAEager (from-scratch) ...   1.1e-05      1.79
-                                      NonSALazy (from-scratch) ...  1.38e-05       1.2
-                                        LazySABidi (propagate) ...  4.55e-06     0.542
-                                 EagerSATotalOrder (propagate) ...  3.25e-06      0.36
-        Plotting time (1.01x of ('propagate',))
-                              EagerSATotalOrder (from-scratch) ...  5.82e-05      13.2
-                                     LazySABidi (from-scratch) ...  4.93e-05      12.9
-                                     NonSAEager (from-scratch) ...   1.1e-05      1.79
-                                      NonSALazy (from-scratch) ...  1.38e-05       1.2
-                                        LazySABidi (propagate) ...  4.55e-06     0.542
-                                 EagerSATotalOrder (propagate) ...  3.25e-06      0.36
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  5.89e+08
-                              EagerSATotalOrder (from-scratch) ...         0  5.03e+08
-                                      NonSALazy (from-scratch) ...         0  1.31e+08
-                                     NonSAEager (from-scratch) ...         0  8.84e+07
-                                        LazySABidi (propagate) ...         0  1.09e+05
-                                 EagerSATotalOrder (propagate) ...         0  1.09e+05
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.26e+08
-                                     NonSAEager (from-scratch) ...         0  3.38e+07
-                                     LazySABidi (from-scratch) ...         0       880
-                                      NonSALazy (from-scratch) ...         0       608
-                                        LazySABidi (propagate) ...         0      48.6
-                                 EagerSATotalOrder (propagate) ...         0      35.8
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...       1.5       1.5
-                                        LazySABidi (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...       1.5       1.5
-                                        LazySABidi (propagate) ...         1         1
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  9.34e+08
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  8.06e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  2.32e+08
-                                     NonSAEager (from-scratch) ...  1.02e+06  2.32e+08
-                                        LazySABidi (propagate) ...  1.02e+06   1.6e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.54e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584  1.26e+08
-                                     NonSAEager (from-scratch) ...       424  3.38e+07
-                                     LazySABidi (from-scratch) ...       424  1.26e+03
-                                      NonSALazy (from-scratch) ...       424       984
-                                 EagerSATotalOrder (propagate) ...       584  1.26e+08
-                                        LazySABidi (propagate) ...       424  1.26e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      4.49      7.22
-                           EagerSATotalOrder ...       5.3      7.35
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.58      10.8
-                           EagerSATotalOrder ...      4.23        11
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      2.42      3.31
-                           EagerSATotalOrder ...      3.38      4.97
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      3.02      2.21
-                           EagerSATotalOrder ...      4.23      3.32
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  4.55e-06     0.542
-                              update ...  6.65e-07  5.92e-06
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  3.25e-06      0.36
-                              update ...  5.02e-07  6.01e-06
-
-</pre>
-<style>div#header { position: fixed; top: 0; right: 0; padding: 0.5em; background: white }</style>
-<div id="header">
-<a href="#summary">Summary</a>
-<a href="#filter-0004">filter-0004</a>
-<a href="#map-0004">map-0004</a>
-</div>

Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/summary.txt

-    Summarizing filter-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-21-16-53 monotonic monotonic-take-all/filter-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  3.86e-05        13
-                              EagerSATotalOrder (from-scratch) ...   4.6e-05        12
-                                     NonSAEager (from-scratch) ...  8.91e-06      1.05
-                                      NonSALazy (from-scratch) ...  1.11e-05     0.629
-                                        LazySABidi (propagate) ...  4.82e-06     0.309
-                                 EagerSATotalOrder (propagate) ...  3.43e-06     0.153
-        Plotting time (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...  3.86e-05        13
-                              EagerSATotalOrder (from-scratch) ...   4.6e-05        12
-                                     NonSAEager (from-scratch) ...  8.91e-06      1.05
-                                      NonSALazy (from-scratch) ...  1.11e-05     0.629
-                                        LazySABidi (propagate) ...  4.82e-06     0.309
-                                 EagerSATotalOrder (propagate) ...  3.43e-06     0.153
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  5.71e+08
-                              EagerSATotalOrder (from-scratch) ...         0  5.03e+08
-                                      NonSALazy (from-scratch) ...         0  5.51e+07
-                                     NonSAEager (from-scratch) ...         0  2.23e+07
-                                 EagerSATotalOrder (propagate) ...         0  7.55e+04
-                                        LazySABidi (propagate) ...         0  4.52e+04
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.38e+08
-                                     NonSAEager (from-scratch) ...         0  2.65e+07
-                                     LazySABidi (from-scratch) ...         0       998
-                                      NonSALazy (from-scratch) ...         0       710
-                                        LazySABidi (propagate) ...         0      23.8
-                                 EagerSATotalOrder (propagate) ...         0      13.4
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      1.87      1.98
-                                        LazySABidi (propagate) ...      1.34      1.48
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...      1.87      1.98
-                                        LazySABidi (propagate) ...      1.34      1.48
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...     0.272     0.493
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...      1.67      1.97
-                                 EagerSATotalOrder (propagate) ...      1.37      1.48
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  9.13e+08
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  7.73e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  1.57e+08
-                                     NonSAEager (from-scratch) ...  1.02e+06  1.55e+08
-                                        LazySABidi (propagate) ...  1.02e+06  1.58e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.41e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584  1.38e+08
-                                     NonSAEager (from-scratch) ...       424  2.65e+07
-                                     LazySABidi (from-scratch) ...       424  1.37e+03
-                                      NonSALazy (from-scratch) ...       424  1.09e+03
-                                 EagerSATotalOrder (propagate) ...       584  1.38e+08
-                                        LazySABidi (propagate) ...       424  1.37e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      4.33      12.4
-                           EagerSATotalOrder ...      5.16      11.5
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.46      20.7
-                           EagerSATotalOrder ...      4.12      19.1
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      1.85      3.39
-                           EagerSATotalOrder ...       2.6      6.84
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      2.31      2.04
-                           EagerSATotalOrder ...      3.25      4.11
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  4.82e-06     0.309
-                              update ...  7.09e-07  5.85e-06
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  3.43e-06     0.153
-                              update ...  5.34e-07  5.07e-06
-    Summarizing map-0004.json.gz ...
-        Loading Results/SAList/2013-07-10-21-16-53 monotonic monotonic-take-all/map-0004.json.gz ...  done
-        Plotting time (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...  5.82e-05      13.2
-                                     LazySABidi (from-scratch) ...  4.93e-05      12.9
-                                     NonSAEager (from-scratch) ...   1.1e-05      1.79
-                                      NonSALazy (from-scratch) ...  1.38e-05       1.2
-                                        LazySABidi (propagate) ...  4.55e-06     0.542
-                                 EagerSATotalOrder (propagate) ...  3.25e-06      0.36
-        Plotting time (1.01x of ('propagate',))
-                              EagerSATotalOrder (from-scratch) ...  5.82e-05      13.2
-                                     LazySABidi (from-scratch) ...  4.93e-05      12.9
-                                     NonSAEager (from-scratch) ...   1.1e-05      1.79
-                                      NonSALazy (from-scratch) ...  1.38e-05       1.2
-                                        LazySABidi (propagate) ...  4.55e-06     0.542
-                                 EagerSATotalOrder (propagate) ...  3.25e-06      0.36
-        Plotting heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0  5.89e+08
-                              EagerSATotalOrder (from-scratch) ...         0  5.03e+08
-                                      NonSALazy (from-scratch) ...         0  1.31e+08
-                                     NonSAEager (from-scratch) ...         0  8.84e+07
-                                        LazySABidi (propagate) ...         0  1.09e+05
-                                 EagerSATotalOrder (propagate) ...         0  1.09e+05
-        Plotting stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...         0  1.26e+08
-                                     NonSAEager (from-scratch) ...         0  3.38e+07
-                                     LazySABidi (from-scratch) ...         0       880
-                                      NonSALazy (from-scratch) ...         0       608
-                                        LazySABidi (propagate) ...         0      48.6
-                                 EagerSATotalOrder (propagate) ...         0      35.8
-        Plotting update (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...       1.5       1.5
-                                        LazySABidi (propagate) ...         1         1
-        Plotting evaluate (1.01x of ('propagate',))
-                                     LazySABidi (from-scratch) ...         5     1e+06
-                              EagerSATotalOrder (from-scratch) ...         5     1e+06
-                                      NonSALazy (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                 EagerSATotalOrder (propagate) ...       1.5       1.5
-                                        LazySABidi (propagate) ...         1         1
-        Plotting clean (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         0         0
-                                 EagerSATotalOrder (propagate) ...         0         0
-        Plotting dirty (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...         0         0
-                                      NonSALazy (from-scratch) ...         0         0
-                              EagerSATotalOrder (from-scratch) ...         0         0
-                                     NonSAEager (from-scratch) ...         0         0
-                                        LazySABidi (propagate) ...         1         1
-                                 EagerSATotalOrder (propagate) ...         1         1
-        Plotting max-heap (1.01x of ('from-scratch', 'propagate'))
-                                     LazySABidi (from-scratch) ...  1.02e+06  9.34e+08
-                              EagerSATotalOrder (from-scratch) ...  1.02e+06  8.06e+08
-                                      NonSALazy (from-scratch) ...  1.02e+06  2.32e+08
-                                     NonSAEager (from-scratch) ...  1.02e+06  2.32e+08
-                                        LazySABidi (propagate) ...  1.02e+06   1.6e+09
-                                 EagerSATotalOrder (propagate) ...  1.02e+06  1.54e+09
-        Plotting max-stack (1.01x of ('from-scratch', 'propagate'))
-                              EagerSATotalOrder (from-scratch) ...       584  1.26e+08
-                                     NonSAEager (from-scratch) ...       424  3.38e+07
-                                     LazySABidi (from-scratch) ...       424  1.26e+03
-                                      NonSALazy (from-scratch) ...       424       984
-                                 EagerSATotalOrder (propagate) ...       584  1.26e+08
-                                        LazySABidi (propagate) ...       424  1.26e+03
-        Plotting time overhead using baseline NonSAEager ...
-                                  LazySABidi ...      4.49      7.22
-                           EagerSATotalOrder ...       5.3      7.35
-        Plotting time overhead using baseline NonSALazy ...
-                                  LazySABidi ...      3.58      10.8
-                           EagerSATotalOrder ...      4.23        11
-        Plotting time speed-up using baseline NonSAEager ...
-                                  LazySABidi ...      2.42      3.31
-                           EagerSATotalOrder ...      3.38      4.97
-        Plotting time speed-up using baseline NonSALazy ...
-                                  LazySABidi ...      3.02      2.21
-                           EagerSATotalOrder ...      4.23      3.32
-        Plotting evaluate overhead using baseline NonSAEager ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate overhead using baseline NonSALazy ...
-                                  LazySABidi ...       inf       inf
-                           EagerSATotalOrder ...       inf       inf
-        Plotting evaluate speed-up using baseline NonSAEager ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting evaluate speed-up using baseline NonSALazy ...
-                                  LazySABidi ...         0         0
-                           EagerSATotalOrder ...         0         0
-        Plotting LazySABidi details ...
-                           propagate ...  4.55e-06     0.542
-                              update ...  6.65e-07  5.92e-06
-        Plotting EagerSATotalOrder details ...
-                           propagate ...  3.25e-06      0.36
-                              update ...  5.02e-07  6.01e-06

Results/BenchmarkAdapton/PLDI 2014/batch/summary/index.html

+<!doctype html>
+<meta charset=utf-8>
+<title>summary</title>
+<style>figure.inline-figure { display: inline-block; margin: 0; }</style>
+<h1 id="table">Table</h1>
+<style>
+table, th, td { border: 1px solid black; border-collapse: collapse; font-size: smaller }
+td { text-align: right }
+td.highlight { background: silver }
+</style>
+<table>
+<thead>
+<tr>
+<th rowspan="4">task</th>
+<th rowspan="4">input #</th>
+<th rowspan="4">take #</th>
+<th colspan="2">NonSAEager</th>
+<th colspan="2">NonSALazy</th>
+<th colspan="8">LazySABidi</th>
+<th colspan="8">EagerSATotalOrder</th>
+</tr>
+<tr>
+<th rowspan="2">time</th>
+<th rowspan="2">max-heap</th>
+<th rowspan="2">time</th>
+<th rowspan="2">max-heap</th>
+<th colspan="4">from-scratch</th>
+<th colspan="4">incremental</th>
+<th colspan="4">from-scratch</th>
+<th colspan="4">incremental</th>
+</tr>
+<tr>
+<th>time</th>
+<th colspan="2">overhead</th>
+<th>max-heap</th>
+<th>time</th>
+<th colspan="2">speed-up</th>
+<th>max-heap</th>
+<th>time</th>
+<th colspan="2">overhead</th>
+<th>max-heap</th>
+<th>time</th>
+<th colspan="2">speed-up</th>
+<th>max-heap</th>
+</tr>
+<tr>
+<th>seconds</th>
+<th>bytes</th>
+<th>seconds</th>
+<th>bytes</th>
+<th>seconds</th>
+<th>NonSAEager</th>
+<th>NonSALazy</th>
+<th>bytes</th>
+<th>seconds</th>
+<th>NonSAEager</th>
+<th>NonSALazy</th>
+<th>bytes</th>
+<th>seconds</th>
+<th>NonSAEager</th>
+<th>NonSALazy</th>
+<th>bytes</th>
+<th>seconds</th>
+<th>NonSAEager</th>
+<th>NonSALazy</th>
+<th>bytes</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<th>exptree</th>
+<td>1000000</td>
+<td>1</td>
+<td>143e-3</td>
+<td>153e+6</td>
+<td>308e-3</td>
+<td>152e+6</td>
+<td>87.9e+0</td>
+<td>613e+0</td>
+<td>285e+0</td>
+<td>1.78e+9</td>
+<td>620e-6</td>
+<td>231e+0</td>
+<td>497e+0</td>
+<td>1.78e+9</td>
+<td>18.5e+0</td>
+<td>129e+0</td>
+<td>60.1e+0</td>
+<td>1.48e+9</td>
+<td>207e-6</td>
+<td class="highlight">694e+0</td>
+<td class="highlight">1.49e+3</td>
+<td class="highlight">1.48e+9</td>
+</tr>
+<tr>
+<th>filter</th>
+<td>1000000</td>
+<td>1000001</td>
+<td>1.05e+0</td>
+<td>155e+6</td>
+<td>629e-3</td>
+<td>157e+6</td>
+<td>13e+0</td>
+<td>12.4e+0</td>
+<td>20.7e+0</td>
+<td>913e+6</td>
+<td>309e-3</td>
+<td>3.39e+0</td>
+<td>2.04e+0</td>
+<td>1.58e+9</td>
+<td>12e+0</td>
+<td>11.5e+0</td>
+<td>19.1e+0</td>
+<td>773e+6</td>
+<td>153e-3</td>
+<td class="highlight">6.84e+0</td>
+<td class="highlight">4.11e+0</td>
+<td class="highlight">1.41e+9</td>
+</tr>
+<tr>
+<th>map</th>
+<td>1000000</td>
+<td>1000001</td>
+<td>1.79e+0</td>
+<td>232e+6</td>
+<td>1.2e+0</td>
+<td>232e+6</td>
+<td>12.9e+0</td>
+<td>7.22e+0</td>
+<td>10.8e+0</td>
+<td>934e+6</td>
+<td>542e-3</td>
+<td>3.31e+0</td>
+<td>2.21e+0</td>
+<td>1.6e+9</td>
+<td>13.2e+0</td>
+<td>7.35e+0</td>
+<td>11e+0</td>
+<td>806e+6</td>
+<td>360e-3</td>
+<td class="highlight">4.97e+0</td>
+<td class="highlight">3.32e+0</td>
+<td class="highlight">1.54e+9</td>
+</tr>
+<tr>
+<th>tfold(min)</th>
+<td>1000000</td>
+<td>1</td>
+<td>2.43e+0</td>
+<td>240e+6</td>
+<td>1.43e+0</td>
+<td>179e+6</td>
+<td>44.5e+0</td>
+<td>18.3e+0</td>
+<td>31.2e+0</td>
+<td>1.61e+9</td>
+<td>328e-6</td>
+<td class="highlight">7.4e+3</td>
+<td class="highlight">4.35e+3</td>
+<td>1.61e+9</td>
+<td>22.1e+0</td>
+<td>9.08e+0</td>
+<td>15.5e+0</td>
+<td>1.41e+9</td>
+<td>461e-6</td>
+<td>5.26e+3</td>
+<td>3.09e+3</td>
+<td class="highlight">1.44e+9</td>
+</tr>
+<tr>
+<th>tfold(sum)</th>
+<td>1000000</td>
+<td>1</td>
+<td>2.44e+0</td>
+<td>255e+6</td>
+<td>1.48e+0</td>
+<td>180e+6</td>
+<td>45e+0</td>
+<td>18.4e+0</td>
+<td>30.5e+0</td>
+<td>1.63e+9</td>
+<td>903e-6</td>
+<td>2.7e+3</td>
+<td>1.64e+3</td>
+<td>1.63e+9</td>
+<td>22.5e+0</td>
+<td>9.22e+0</td>
+<td>15.2e+0</td>
+<td>1.44e+9</td>
+<td>350e-6</td>
+<td class="highlight">6.97e+3</td>
+<td class="highlight">4.22e+3</td>
+<td class="highlight">1.44e+9</td>
+</tr>
+</tbody>
+</table>
+<h1 id="summary">Summary</h1>
+<pre>
+    Loading exptree ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/exptree-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/exptree-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/exptree-0004.json.gz ...  not found
+    Loading filter ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/filter-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/filter-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/filter-0004.json.gz ...  not found
+    Loading map ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/map-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/map-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/map-0004.json.gz ...  not found
+    Loading tfold(min) ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/tfold(min)-0004.json.gz ...  not found
+    Loading tfold(sum) ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/tfold(sum)-0004.json.gz ...  not found
+    Tabulating exptree ...
+    Tabulating filter ...
+    Tabulating map ...
+    Tabulating tfold(min) ...
+    Tabulating tfold(sum) ...
+      task | input # |  take # |         NonSAEager |          NonSALazy |                                                                                 LazySABidi |                                                                          EagerSATotalOrder
+           |         |         |    time | max-heap |    time | max-heap |                                from-scratch |                                  incremental |                                from-scratch |                                  incremental
+           |         |         |         |          |         |          |    time |               overhead | max-heap |    time |               speed-up |  max-heap |    time |               overhead | max-heap |    time |               speed-up |  max-heap
+           |         |         | seconds |    bytes | seconds |    bytes | seconds | NonSAEager | NonSALazy |    bytes | seconds | NonSAEager | NonSALazy |     bytes | seconds | NonSAEager | NonSALazy |    bytes | seconds | NonSAEager | NonSALazy |     bytes
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
+   exptree | 1000000 |       1 |  143e-3 |   153e+6 |  308e-3 |   152e+6 | 87.9e+0 |     613e+0 |    285e+0 |  1.78e+9 |  620e-6 |   231e+0   |  497e+0   | 1.78e+9   | 18.5e+0 |     129e+0 |   60.1e+0 |  1.48e+9 |  207e-6 |   694e+0 * | 1.49e+3 * | 1.48e+9 *
+    filter | 1000000 | 1000001 | 1.05e+0 |   155e+6 |  629e-3 |   157e+6 |   13e+0 |    12.4e+0 |   20.7e+0 |   913e+6 |  309e-3 |  3.39e+0   | 2.04e+0   | 1.58e+9   |   12e+0 |    11.5e+0 |   19.1e+0 |   773e+6 |  153e-3 |  6.84e+0 * | 4.11e+0 * | 1.41e+9 *
+       map | 1000000 | 1000001 | 1.79e+0 |   232e+6 |  1.2e+0 |   232e+6 | 12.9e+0 |    7.22e+0 |   10.8e+0 |   934e+6 |  542e-3 |  3.31e+0   | 2.21e+0   |  1.6e+9   | 13.2e+0 |    7.35e+0 |     11e+0 |   806e+6 |  360e-3 |  4.97e+0 * | 3.32e+0 * | 1.54e+9 *
+tfold(min) | 1000000 |       1 | 2.43e+0 |   240e+6 | 1.43e+0 |   179e+6 | 44.5e+0 |    18.3e+0 |   31.2e+0 |  1.61e+9 |  328e-6 |   7.4e+3 * | 4.35e+3 * | 1.61e+9   | 22.1e+0 |    9.08e+0 |   15.5e+0 |  1.41e+9 |  461e-6 |  5.26e+3   | 3.09e+3   | 1.44e+9 *
+tfold(sum) | 1000000 |       1 | 2.44e+0 |   255e+6 | 1.48e+0 |   180e+6 |   45e+0 |    18.4e+0 |   30.5e+0 |  1.63e+9 |  903e-6 |   2.7e+3   | 1.64e+3   | 1.63e+9   | 22.5e+0 |    9.22e+0 |   15.2e+0 |  1.44e+9 |  350e-6 |  6.97e+3 * | 4.22e+3 * | 1.44e+9 *
+
+</pre>
+<style>div#header { position: fixed; top: 0; right: 0; padding: 0.5em; background: white }</style>
+<div id="header">
+<a href="#table">Table</a>
+<a href="#summary">Summary</a>
+</div>

Results/BenchmarkAdapton/PLDI 2014/batch/summary/summary.txt

+    Loading exptree ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/exptree-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/exptree-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/exptree-0004.json.gz ...  not found
+    Loading filter ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/filter-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/filter-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/filter-0004.json.gz ...  not found
+    Loading map ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/map-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/map-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/map-0004.json.gz ...  not found
+    Loading tfold(min) ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/tfold(min)-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/tfold(min)-0004.json.gz ...  not found
+    Loading tfold(sum) ...
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-20-38-47 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  done
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/2013-07-10-21-16-53 monotonic monotonic-take-all/tfold(sum)-0004.json.gz ...  not found
+        Loading Results/BenchmarkAdapton/PLDI 2014/batch/summary.old/tfold(sum)-0004.json.gz ...  not found
+    Tabulating exptree ...
+    Tabulating filter ...
+    Tabulating map ...
+    Tabulating tfold(min) ...
+    Tabulating tfold(sum) ...
+      task | input # |  take # |         NonSAEager |          NonSALazy |                                                                                 LazySABidi |                                                                          EagerSATotalOrder
+           |         |         |    time | max-heap |    time | max-heap |                                from-scratch |                                  incremental |                                from-scratch |                                  incremental
+           |         |         |         |          |         |          |    time |               overhead | max-heap |    time |               speed-up |  max-heap |    time |               overhead | max-heap |    time |               speed-up |  max-heap
+           |         |         | seconds |    bytes | seconds |    bytes | seconds | NonSAEager | NonSALazy |    bytes | seconds | NonSAEager | NonSALazy |     bytes | seconds | NonSAEager | NonSALazy |    bytes | seconds | NonSAEager | NonSALazy |     bytes
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
+   exptree | 1000000 |       1 |  143e-3 |   153e+6 |  308e-3 |   152e+6 | 87.9e+0 |     613e+0 |    285e+0 |  1.78e+9 |  620e-6 |   231e+0   |  497e+0   | 1.78e+9   | 18.5e+0 |     129e+0 |   60.1e+0 |  1.48e+9 |  207e-6 |   694e+0 * | 1.49e+3 * | 1.48e+9 *
+    filter | 1000000 | 1000001 | 1.05e+0 |   155e+6 |  629e-3 |   157e+6 |   13e+0 |    12.4e+0 |   20.7e+0 |   913e+6 |  309e-3 |  3.39e+0   | 2.04e+0   | 1.58e+9   |   12e+0 |    11.5e+0 |   19.1e+0 |   773e+6 |  153e-3 |  6.84e+0 * | 4.11e+0 * | 1.41e+9 *