strictly:~/wayland/weston-meson(meson)% JOBS=6 ../benchmark.py Run configure stage (./autogen.sh vs. meson) x /tmp/tmpaibe2bma + /tmp/tmp6n6u8hg4 N Min Max Median Avg Stddev x 10 14.352025 15.486187 15.106074 15.030855 0.35847049 + 10 1.014587 1.063667 1.0378635 1.0382273 0.012394355 Difference at 95.0% confidence -13.9926 +/- 0.238308 -93.0927% +/- 0.122393% (Student's t, pooled s = 0.253628) Build from clean/configured tree (make clean && make vs. ninja clean && ninja) x /tmp/tmpbpbxbfyv + /tmp/tmphc8ng7nt N Min Max Median Avg Stddev x 10 24.546487 25.204513 24.610274 24.6885 0.19725132 + 10 6.680741 6.757809 6.7258585 6.7229063 0.025143938 Difference at 95.0% confidence -17.9656 +/- 0.132113 -72.7691% +/- 0.159602% (Student's t, pooled s = 0.140606) Build & test from clean/configured tree (make clean && make check vs. ninja clean && ninja test) x /tmp/tmp_pc7fkyk + /tmp/tmpnjk4xgjp N Min Max Median Avg Stddev x 10 27.713716 28.117872 27.929969 27.939729 0.12789916 + 10 9.341905 9.448576 9.386402 9.3945398 0.039352837 Difference at 95.0% confidence -18.5452 +/- 0.0889069 -66.3757% +/- 0.138619% (Student's t, pooled s = 0.0946225) Rebuild libweston from built tree (touch libweston/compositor.h && make vs. ninja) x /tmp/tmplsnv399v + /tmp/tmpzdvce8bn N Min Max Median Avg Stddev x 10 11.975254 12.257628 12.078304 12.084731 0.079931834 + 10 2.903433 3.030329 2.983296 2.9785613 0.037880038 Difference at 95.0% confidence -9.10617 +/- 0.0587679 -75.3527% +/- 0.234739% (Student's t, pooled s = 0.062546) Rebuild libweston & test from built tree (touch libweston/compositor.h && make check vs. ninja test) x /tmp/tmpn6zhjtzn + /tmp/tmp4x3qaxh8 N Min Max Median Avg Stddev x 10 15.272858 15.916218 15.401184 15.480642 0.21396422 + 10 5.623598 5.711625 5.643656 5.6519688 0.03075388 Difference at 95.0% confidence -9.82867 +/- 0.143618 -63.4901% +/- 0.360311% (Student's t, pooled s = 0.15285) Rebuild weston from built tree (touch compositor/main.c && make vs. ninja) x /tmp/tmp87cyspvi + /tmp/tmpdwqubal9 N Min Max Median Avg Stddev x 10 0.928377 12.120236 0.9396535 2.0560661 3.5361956 + 10 0.146213 0.300095 0.148563 0.1782828 0.063351618 No difference proven at 95.0% confidence Run tests from built tree (make check vs. ninja test) x /tmp/tmp7baa_mgy + /tmp/tmp578wnd6m N Min Max Median Avg Stddev x 10 3.557546 3.74388 3.637885 3.6452625 0.065220914 + 10 2.731574 2.842604 2.806387 2.7976536 0.039744444 Difference at 95.0% confidence -0.847609 +/- 0.0507442 -23.2523% +/- 1.16494% (Student's t, pooled s = 0.0540064) libtool: warning: relinking 'libweston-desktop-2.la' libtool: warning: relinking 'desktop-shell.la' Install (make install vs. ninja install) x /tmp/tmpzkanidwt + /tmp/tmpeqdfayk6 N Min Max Median Avg Stddev x 10 1.185946 1.422245 1.2327435 1.2607523 0.074275737 + 10 0.309364 0.328058 0.314535 0.3157114 0.0053643929 Difference at 95.0% confidence -0.945041 +/- 0.0494769 -74.9585% +/- 1.02013% (Student's t, pooled s = 0.0526577) JOBS=6 ../benchmark.py > ~/tmp/benchmarks/weston.laptop 2983.11s user 911.81s system 293% cpu 22:07.01 total