{PrefLib}: A Library for Preferences

ED-00025: Mechanical Turk Puzzle

The Mechanical Turk Dots datasets come from Andrew Mao and were collected using Mechanical Turk. These data sets each contain elections with 793-797 voters over 4 candidates.

Each of the candidates correspond to an instance of the sliding puzzle game presented to a user on Mechanical Turk, who is asked to rank the items from those in a position closest to solution (first) to those requiring the most moves to complete (last). Thus, for all of these data sets there is a ground truth ranking which corresponds to the candidate names in sorted order. In the Puzzle task, each task contains elements requiring d, d+3, d+6, and d+9 moves to complete, where d = {5, 7, 9, 11}. This allows for more noise to be introduced to various iterations of the task. For each i, 40 sets of puzzles were placed on Mechanical Turk and were ranked by 20 users. As per the data owners request these 160 individual trails have been aggregated into a single file for each i. The individual trial runs are available upon request.

Required Citations

Selected Citations Using This Dataset

Supported By:

DescriptionTypeModificationFile NameFile Size
all_11_14_17_20 Strict Order - Complete List Original ED-00025-00000001.soc 4.0K
all_11_14_17_20 Pairwise Graph Induced ED-00025-00000001.pwg 4.0K
all_11_14_17_20 Weighted Majority Graph Induced ED-00025-00000001.wmg 4.0K
all_11_14_17_20 Majority Graph Induced ED-00025-00000001.mjg 4.0K
all_5_8_11_14 Strict Order - Complete List Original ED-00025-00000002.soc 4.0K
all_5_8_11_14 Pairwise Graph Induced ED-00025-00000002.pwg 4.0K
all_5_8_11_14 Weighted Majority Graph Induced ED-00025-00000002.wmg 4.0K
all_5_8_11_14 Majority Graph Induced ED-00025-00000002.mjg 4.0K
all_7_10_13_16 Strict Order - Complete List Original ED-00025-00000003.soc 4.0K
all_7_10_13_16 Pairwise Graph Induced ED-00025-00000003.pwg 4.0K
all_7_10_13_16 Weighted Majority Graph Induced ED-00025-00000003.wmg 4.0K
all_7_10_13_16 Majority Graph Induced ED-00025-00000003.mjg 4.0K
all_9_12_15_18 Strict Order - Complete List Original ED-00025-00000004.soc 4.0K
all_9_12_15_18 Pairwise Graph Induced ED-00025-00000004.pwg 4.0K
all_9_12_15_18 Weighted Majority Graph Induced ED-00025-00000004.wmg 4.0K
all_9_12_15_18 Majority Graph Induced ED-00025-00000004.mjg 4.0K