SV-COMP 2023 Reproduction

Check rankings

ConcurrencySafety

(close in scores)

2. ConcurrencySafety – UAutomizer: 2733 (original / rebuilt: 2725)
3. ConcurrencySafety – UGemCutter: 2714 (original / rebuilt: 2714)
4. ConcurrencySafety – UTaipan: 2613 (original / rebuilt: 2607)

→ small changes in scores, but ranking preserved

JavaOverall

(to check some Java tools)

1. JavaOverall – JBMC: 667 (original / rebuilt: 669)
2. JavaOverall – GDart: 652 (original / rebuilt: 652)
3. JavaOverall – MLB: 496 (original / rebuilt: 495)

→ small changes in scores, but ranking preserved

SoftwareSystems

(close in scores, check true/false)

1. SoftwareSystems – Symbiotic: 1936 (original / rebuilt: 1936)
2. SoftwareSystems – Bubaak: 707 (original / rebuilt: 707)

→ exact match in scores

Check individual tools

VeriFuzz

(as a tool with one very negative score and one gold medal)

NoOverflows – VeriFuzz: -80 (original / rebuilt: -87)
Termination – VeriFuzz (original / rebuilt) – something went wrong with the validation here

→ need to check what went wrong in validation for Termination (it was called for VeriFuzz, as NoOverflows shows)

Symbiotic

(as a portfolio tool)

MemSafety – Symbiotic: 397 (original / rebuilt: 397)
Termination – Symbiotic: 1571 (original / rebuilt: 1571)

→ exact match in scores

lf-checker & Deagle

(as tools that are in only one category, and one is gold)

ConcurrencySafety – lf-checker: 988 (original / rebuilt: 982)
ConcurrencySafety – Deagle: 4754 (original / rebuilt: 4754)

→ only small change in score for lf-checker