Expanded Table 4: ObjSim and PraPR results (https://github.com/ali-ghanbari/objsim) compared with a random baseline. Columns renamed for clarity. Best ranks marked in bold.
plausible | genuine | Random rank | Random rank | Random rank | |||
---|---|---|---|---|---|---|---|
bug | patches | fixes | PraPR rank | ObjSim rank | with prob.80% | with prob.90% | with prob.100% |
Chart-26 | 100 | 1 | 17 | Time-out | 81 | 91 | 100 |
Time-11 | 32 | 1 | 1 | 1 | 26 | 29 | 32 |
Mockito-5 | 31 | 1 | 31 | 31 | 25 | 28 | 31 |
Math-50 | 30 | 1 | 30 | 30 | 24 | 28 | 30 |
Closure-11 | 15 | 3 | 1 | Time-out | 6 | 8 | 13 |
Jsoup-42 | 13 | 1 | 1 | Time-out | 11 | 12 | 13 |
Closure-126 | 12 | 2 | 5 | Time-out | 7 | 8 | 11 |
Closure-31 | 9 | 1 | 6 | Time-out | 8 | 9 | 9 |
Math-82 | 9 | 1 | 9 | 1 | 8 | 9 | 9 |
Closure-46 | 7 | 2 | 1 | 4 | 4 | 5 | 6 |
JacksonDatabind-39 | 7 | 1 | 5 | 1 | 6 | 7 | 7 |
Lang-10 | 7 | 2 | 2 | Time-out | 4 | 5 | 6 |
CommonsCli-4 | 6 | 1 | 6 | 6 | 5 | 6 | 6 |
Time-4 | 5 | 1 | 5 | 3 | 5 | 5 | 5 |
Math-85 | 4 | 1 | 4 | 4 | 4 | 4 | 4 |
Closure-10 | 4 | 1 | 1 | 4 | 4 | 4 | 4 |
CommonsJXPath-1 | 4 | 1 | 4 | 1 | 4 | 4 | 4 |
Closure-92 | 4 | 1 | 1 | 4 | 4 | 4 | 4 |
Closure-93 | 4 | 1 | 1 | 4 | 4 | 4 | 4 |
Lang-57 | 3 | 1 | 3 | 1 | 3 | 3 | 3 |
Mockito-38 | 3 | 1 | 2 | 2 | 3 | 3 | 3 |
Math-5 | 3 | 1 | 1 | 1 | 3 | 3 | 3 |
Closure-86 | 3 | 2 | 1 | 1 | 2 | 2 | 2 |
Chart-1 | 2 | 1 | 1 | 1 | 2 | 2 | 2 |
Lang-59 | 2 | 1 | 2 | 2 | 2 | 2 | 2 |
JacksonDatabind-34 | 2 | 1 | 2 | 1 | 2 | 2 | 2 |
Mockito-29 | 2 | 1 | 2 | 1 | 2 | 2 | 2 |
Math-58 | 2 | 1 | 2 | 2 | 2 | 2 | 2 |
Time-19 | 2 | 1 | 2 | 1 | 2 | 2 | 2 |
Chart-11 | 2 | 1 | 1 | 1 | 2 | 2 | 2 |
Chart-12 | 2 | 1 | 2 | 1 | 2 | 2 | 2 |
Chart-24 | 2 | 1 | 1 | 1 | 2 | 2 | 2 |
CommonsCli-23 | 2 | 2 | 1 | 1 | 1 | 1 | 1 |
%Chart-8 | 2 | 2 | 2 | 2 | 1 | 1 | 1 |
JacksonDatabind-36 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-63 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Chart-20 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-14 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-18 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-62 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Math-75 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Math-70 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Math-59 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-70 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Math-34 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Math-33 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Closure-73 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
CommonsCli-22 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Lang-33 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Lang-26 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
CommonsCodec-13 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Lang-6 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
CommonsCsv-5 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
Jsoup-3 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
JacksonDatabind-8 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |