Experiment results (January 2019)

Defects4J

Correct Fix #35

Chart1, Chart11, Closure18, Closure31, Closure40, Closure46, Closure62, Closure63, Closure70, Closure73, Math32, Math53, Math82, Mockito22, Time19, Chart24, Chart26, Chart9, Closure86, Lang45, Lang55, Math59, Math80, Closure33, Lang33, Lang59, Lang51, Math5, Math50, Closure126, Closure128, Math3, Lang38, Closure11, Math85

Valid (incorrect) Fix #59

Closure17, Closure5, Mockito38, Chart22, Closure38, Lang24, Lang7, Math24, Math34, Math63, Closure13, Lang15, Lang12, Lang48, Math23, Closure10, Closure124, Lang61, Math97, Closure121, Closure2, Math94, Lang16, Closure7, Math88, Mockito27, Math84, Lang39, Mockito8, Closure19, Time3, Lang63, Math46, Lang31, Chart4, Lang27, Lang6, Lang44, Closure48, Math79, Lang58, Closure125, Math40, Lang22, Chart25, Math69, Closure45, Math105, Math2, Math8, Chart5, Chart13, Math95, Closure115, Chart7, Lang50, Math30, Math28, Math31

IntroClassJava

Correct Fix #69

median-fcf70_003, median-af81f_004, smallest-3cf6d_003, smallest-30074_007, smallest-1b31f_003, smallest-e9c62_000, smallest-9013b_000, smallest-90834_005, median-48b82_000, smallest-90a14_001, smallest-2694a_000, smallest-c9d71_003, digits-6e464_003, smallest-93f87_000, median-e9c62_001, median-3b237_003, median-3cf6d_007, smallest-84602_007, smallest-f2997_000, smallest-d009a_001, median-af81f_007, median-b6fd4_001, median-9c930_003, median-9c930_007, median-d1204_000, digits-387be_002, digits-d2b88_006, median-89b1a_007, median-89b1a_003, smallest-88394_006, smallest-af81f_000, grade-bfad6_001, grade-bfad6_000, smallest-346b1_010, syllables-ca505_003, median-93f87_015, median-90834_010, median-90a14_000, digits-317aa_004, digits-6e464_004, smallest-346b1_005, median-93f87_012, median-fe9d5_002, median-fe9d5_000, grade-b1924_001, smallest-6aaea_001, grade-b1924_003, median-9c930_012, median-89b1a_010, smallest-818f8_003, grade-1b31f_003, smallest-15cb0_007, smallest-769cd_002, smallest-3b237_008, smallest-68eb0_000, smallest-f8d57_000, smallest-769cd_003, smallest-dedc2_000, smallest-769cd_010, smallest-36d80_003, smallest-48b82_001, smallest-ea67b_003, smallest-97f6b_003, median-0cdfa_003, digits-c9d71_001, median-317aa_002, digits-ca94e_002, median-317aa_000, digits-d5059_000

Valid (incorrect) Fix #15

syllables-b6fd4_000, median-93f87_010, median-fcf70_002, digits-d2b88_005, digits-98d87_003, median-d4aae_000, median-317aa_003, median-aacea_003, median-c716e_002, median-d009a_000, median-0cea4_003, median-1b31f_000, digits-0cdfa_005, digits-0cdfa_006, digits-f2997_002

QuixBugs

Correct Fix #9

QB_next_permutation, QB_knapsack, QB_is_valid_parenthesization, QB_max_sublist_sum, QB_reverse_linked_list, QB_bucketsort, QB_breadth_first_search, QB_lis, QB_quicksort

Valid (incorrect) Fix #2

QB_detect_cycle, QB_shortest_path_lengths

Back to Home