I had the luxury of dashing out to California last week for the San Francisco Turk Meetup hosted by Dolores Labs (see the O’Reilly radar blog summary). The TurKit Application presented by Greg Little really caught my eye. You, too, can read the pre-publication paper:
- Little, Greg, Lydia B. Chilton, Robert C. Miller, and Max Goldman. 2009. TurKit: Tools for iterative tasks on Mechanical Turk. Not yet published.
TurKit’s an open-source package that lets you submit a single task to multiple Turkers in a novel way. Rather than having them all do the task independently, the Turkers work on the tasks sequentially. That is the first Turker does it from scratch, then the second Turker works to improve the first Turker’s answer. The example in the talk involved transcribing a very messily written note. It’s amazing to see the progression from the first Turker to the eighth Turker.