Internal/quantify/terminal heuristic (1)

[SSoelvsten]

Updates Adiar's terminal heuristic based on the data from our experiments.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.314%. Comparing base (e3ab240) to head (545f78d).

Additional details and impacted files

@@              Coverage Diff              @@
##              main      #645       +/-   ##
=============================================
- Coverage   97.315%   97.314%   -0.000%     
=============================================
  Files           90        90               
  Lines         6480      6479        -1     
=============================================
- Hits          6306      6305        -1     
  Misses         174       174               

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

🟢 Regression Test (QBF 'breakthrough/3x4_19_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.30% (stdev: 0.41%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	24289.67	24216.00
Standard Deviation	100.72	29.46

Number of samples: 3

[github-actions]

🟢 Regression Test (QBF 'domineering/5x5_13_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 4.29% (stdev: 0.37%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	22683.00	21709.00
Standard Deviation	69.76	80.67

Number of samples: 3

[github-actions]

🟢 Regression Test (QBF 'connect4/6x6_11_connect4_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.35% (stdev: 0.53%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	16830.00	16771.00
Standard Deviation	88.61	75.32

Number of samples: 3

[github-actions]

🔴 Regression Test (QBF 'ep/8x8_7_e-8-1_p-3-4_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of -135.62% (stdev: 2.82%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	11528.00	27162.67
Standard Deviation	325.09	175.91

Number of samples: 3

[github-actions]

🟢 Regression Test (QBF 'httt/4x4_9_tippy_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 1.11% (stdev: 0.30%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	17081.33	16891.33
Standard Deviation	27.61	49.94

Number of samples: 3

[github-actions]

🟢 Regression Test (QBF 'hex/hein_08_5x5-11_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 5.38% (stdev: 0.99%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	41406.00	39179.67
Standard Deviation	104.76	389.60

Number of samples: 3

[github-actions]

🔴 Regression Test (QBF 'breakthrough_dual/3x6_10_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of -50.57% (stdev: 1.62%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	3525.25	5308.00
Standard Deviation	42.32	85.95

Number of samples: 4

[github-actions]

🔴 Regression Test (QBF 'ep_dual/8x8_6_e-8-1_p-2-3_bwnib')

'origin/internal/quantify/terminal_heuristic' is a change in performance of -18.56% (stdev: 0.95%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	4195.50	4974.25
Standard Deviation	40.04	33.43

Number of samples: 4

[github-actions]

🟢 Regression Test (Picotrav 'adder')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.13% (stdev: 0.44%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	9304.00	9292.00
Standard Deviation	40.80	23.04

Number of samples: 4

[github-actions]

🟢 Regression Test (12-Queens)

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.17% (stdev: 0.72%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	11538.25	11519.00
Standard Deviation	9.25	83.19

Number of samples: 4

[github-actions]

🟢 Regression Test (Picotrav 'mem_ctrl')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.65% (stdev: 1.04%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	114213.00	113471.67
Standard Deviation	980.43	1184.42

Number of samples: 3

[github-actions]

🟡 Regression Test (14-Queens)

'origin/internal/quantify/terminal_heuristic' is a change in performance of -0.13% (stdev: 0.44%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	266226.67	266575.67
Standard Deviation	1180.64	467.88

Number of samples: 3

[github-actions]

🟢 Regression Test (Picotrav 'arbiter')

'origin/internal/quantify/terminal_heuristic' is a change in performance of 0.71% (stdev: 23.98%).

...	origin/main	origin/internal/quantify/terminal_heuristic
Mean	76455.22	75914.00
Standard Deviation	18332.92	16832.19

Number of samples: 9