Human Computation and Crowdsourcing: Works in Progress and Demonstration Abstracts
An Adjunct to the Proceedings of the First AAAI Conference on Human Computation and Crowdsourcing
Jeffrey P. Bigham, Works in Progress and Demonstration Chair; Björn Hartman and Eric Horvitz, Conference Chairs
AAAI Technical Report CR-13-01 / WS-13-18
published by The AAAI Press, Palo Alto, California
This technical report is also available in book format.
Contents
Works in Progress
A Human-Centered Framework for Ensuring Reliability on Crowdsourced Labeling Tasks
Omar Alonso, Catherine C. Marshall, Marc A. Najork
Making Crowdwork Work: Issues in Crowdsourcing for Organizations
Obinna Anya, Melissa Cefkin, Steve Dill, Robert Moore, Susan Stucky, Osarieme Omokaro
Using Crowdsourcing to Generate an Evaluation Dataset for Name Matching Technologies
Alya Asarina, Olga Simek
Statistical Quality Estimation for General Crowdsourcing Tasks
Yukino Baba, Hisashi Kashima
Crowdsourcing Translation by Leveraging Tournament Selection and Lattice-Based String Alignment
Julien Bourdaillet, Shourya Roy, Gueyoung Jung, Yu-An Sun
Lottery-Based Payment Mechanism for Microtasks
L. Elisa Celis, Shourya Roy, Vivek Mishra
OnDroad Planner: Building Tourist Plans Using Traveling Social Network Information
Isabel Cenamor, Tomás de la Rosa, Daniel Borrajo
Using Human and Machine Processing in Recommendation Systems
Eric Colson
LabelBoost: An Ensemble Model for Ground Truth Inference Using Boosted Trees
Siamak Faridani, Georg Buscher
A Ground Truth Inference Model for Ordinal Crowd-Sourced Labels Using Hard Assignment Expectation Maximization
Siamak Faridani, Georg Buscher, Ya Xu
Frequency and Duration of Self-Initiated Task-Switching in an Online Investigation of Interrupted Performance
Sandy J. J. Gould, Anna L. Cox, Duncan P. Brumby
Assessing the Viability of Online Interruption Studies
Sandy J. J. Gould, Anna L. Cox, Duncan P. Brumby, Sarah Wiseman
Human Stigmergy in Augmented Environments
Kshanti Greene, Thomas Young
Reducing Error in Context-Sensitive Crowdsourced Tasks
Daniel Haas, Matthew Greenstein, Kainar Kamalov, Adam Marcus, Marek Olszewski, Marc Piette
Transcribing and Annotating Speech Corpora for Speech Recognition: A Three-Step Crowdsourcing Approach with Quality Control
Annika Hämäläinen, Fernando Pinto Moreira, Jairo Avelar, Daniela Braga, Miguel Sales Dias
An Initial Study of Automatic Curb Ramp Detection with Crowdsourced Verification Using Google Street View Images
Kotaro Hara, Jin Sun, Jonah Chazan, David Jacobs, Jon E. Froehlich
English to Hindi Translation Protocols for an Enterprise Crowd
Srinivasan Iyengar, Shirish Subhash Karande, Sachin Lodha
Joint Crowdsourcing of Multiple Tasks
Andrey Kolobov, - Mausam, Daniel S. Weld
GameLab: A Tool Suit to Support Designers of Systems with Homo Ludens in the Loop
Markus Krause
Automated Support for Collective Memory of Conversational Interactions
Walter Stephen Lasecki, Jeffrey Philip Bigham
Using Visibility to Control Collective Attention in Crowdsourcing
Kristina Lerman, Tad Hogg
Manipulating Social Roles in a Tagging Environment
Mieke H. R. Leyssen, Jacco van Ossenbruggen, Arjen P. de Vries, Lynda Hardman
Towards a Language for Non-Expert Specification of POMDPs for Crowdsourcing
Christopher H. Lin, - Mausam, Daniel S. Weld
Two Methods for Measuring Question Difficulty and Discrimination in Incomplete Crowdsourced Data
Sarah K. K. Luger, Jeff Bowles
Crowd, the Teaching Assistant: Educational Assessment Crowdsourcing
Pallavi Manohar, Shourya Roy
Crowdsourcing Quality Control for Item Ordering Tasks
Toshiko Matsui, Yukino Baba, Toshihiro Kamishima, Hisashi Kashima
Ontology Quality Assurance with the Crowd
Jonathan M. Mortensen, Mark A. Musen, Natalya F. Noy
Personalized Human Computation
Peter Organisciak, Jaime Teevan, Susan Dumais, Robert C. Miller, Adam Tauman Kalai
EM-Based Inference of True Labels Using Confidence Judgments
Satoshi Oyama, Yukino Baba, Yuko Sakurai, Hisashi Kashima
Task Redundancy Strategy Based on Volunteers' Credibility for Volunteer Thinking Projects
Lesandro Ponciano, Francisco Brasileiro, Guilherme Gadelha
Inserting Micro-Breaks into Crowdsourcing Workflows
Jeffrey M. Rzeszotarski, Ed Chi, Praveen Paritosh, Peng Dai
Effect of Task Presentation on the Performance of Crowd Workers — A Cognitive Study
Harini Alagarai Sampath, Rajeev Rajeshuni, Bipin Indurkhya, Saraschandra Karanam, Koustuv Dasgupta
HiveMind: Tuning Crowd Response with a Single Value
Preetjot Singh, Walter S. Lasecki, Paulo Barelli, Jeffrey P. Bigham
Aggregating Human-Expert Opinions for Multi-Label Classification
Evgueni Smirnov, Hua Zhang, Ralf Peeters, Nikolay Nikolaev, Maike Imkamp
Herding the Crowd: Automated Planning for Crowdsourced Planning
Kartik Talamadupula, Subbarao Kambhampati, Yuheng Hu, Tuan Anh Nguyen, Hankz Hankui Zhuo
Designing a Crowdsourcing Tool to Analyze Relationships Among Jazz Musicians: The Case of Linked Jazz 52nd Street
Hilary K. Thorsen, M. Cristina Pattuelli
A Framework for Adaptive Crowd Query Processing
Beth Trushkowsky, Tim Kraska, Michael J. Franklin
Understanding Potential MicrotaskWorkers for Paid Crowdsourcing
Ming-Hung Wang, Kuan-Ta Chen, Shuo-Yang Wang, Chin-Laung Lei
Boosting OCR Accuracy Using Crowdsourcing
Shuo-Yang Wang, Ming-Hung Wang, Kuan-Ta Chen
TrailView: Combining Gamification and Social Network Voting Mechanisms for Useful Data Collection
Michael Peter Weingert, Kate Larson
Task Sequence Design: Evidence on Price and Difficulty
Ming Yin, Yiling Chen, Yu-An Sun
Demonstrations
Wanted: More Nails for the Hammer — An Investigation Into the Application of Human Computation
Elizabeth Brem, Tyler Bick, Andrew Schriner, Daniel Oerther
Frenzy: A Platform for Friendsourcing
Lydia B. Chilton, Felicia Cordeiro, Daniel S. Weld, James A. Landay
The Work Exchange: Peer-to-Peer Enterprise Crowdsourcing
Stephen Dill, Robert Kern, Erika Flint, Melissa Cefkin
In-HIT Example-Guided Annotation Aid for Crowdsourcing UI Components
Yi-Ching Huang, Chun-I Wang, Shih-Yuan Yu, Yung-jen Hsu
Crowdsourcing Objective Answers to Subjective Questions Online
Ravi Iyer
Automating Crowdsourcing Tasks in an Industrial Environment
Vasilis Kandylas, Omar Alonso, Shiroy Choksey, Kedar Rudre, Prashant Jaiswal
Cobi: Community-Informed Conference Scheduling
Juho Kim, Haoqi Zhang, Paul André, Lydia B. Chilton, Anant Bhardwaj, David Karger, Steven P. Dow, Robert C. Miller
Curio: A Platform for Supporting Mixed-Expertise Crowdsourcing
Edith Law, Conner Dalton, Nick Merrill, Albert Young, Krzysztof Z. Gajos
Real-Time Drawing Assistance through Crowdsourcing
Alex Limpaecher, Nicolas Feltman, Adrien Treuille, Michael Cohen
An Introduction to the Zooniverse
Arfon M. Smith, Stuart Lynn, Chris J. Lintott
AAAI Digital Library
AAAI relies on your generous support through membership and donations. If you find these resources useful, we would be grateful for your support.