「人智運算」在電腦科學中是一種創新的概念。其概念目前是有許多事情是人能夠輕易解決而電腦做不到的事情。尤其在2004年ESP遊戲被推出之後開啟Games With A Purpose (GWAP)這塊新的領域，其目的是在玩家進行遊戲的時候也在幫系統標記圖片。這些圖片的標記能夠用在影像辨識和影像搜尋上，而且圖片標記的正確性和圖片標記產生的速率都非常高。ESP遊戲的成功使得人智運算和GWAP變成大家所矚目的焦點。GWAP是讓玩家在進行遊戲時不知不覺地幫系統進行運算，並產生對系統有用的資料。因為玩家覺得遊戲很好玩，所以玩家會一直沉迷或是狂熱地進行遊戲，並且幫系統進行運算產生有用的資料。本論文是探討如何增加GWAP系統的效能，此處針對ESP遊戲進行分析，並定義測量系統效能的函數，且提出能夠增加系統效能的圖片選擇演算法Optimal Puzzle Selection Algorithm (OPSA)。為了驗證OPSA確實能夠增加ESP遊戲的效能，實作實驗系統ESP Lite進行驗證。在二個月的實驗過程中，實際證實OPSA是能夠增加系統效能的圖片選擇演算法，並且發現OPSA的行為和玩家的行為有著相當大的關係。從此研究可以發現有策略地運行ESP遊戲系統就能增加系統的效能；同理其他的GWAP系統只要有策略地運行也同樣能增加系統的效能。

“Human Computation” is an innovative concept in computer science. The idea is there is a lot of things that human can easy do that computers can not yet do. In 2004, the ESP game has been launched and it created an emerging field, Games With A Purpose (GWAP), in computer science. The objective of GWAP is creating difficult metadata when players are playing the game voluntarily. This thesis presents how to enhance GWAP systems. In this thesis, we use the ESP game as an example and propose a puzzle selection algorithm, Optimal Puzzle Selection Algorithm (OPSA), to enhance the ESP game system. For validating our proposed algorithm, OPSA, which actually enhances the ESP game system in real world, we implement a quasi ESP game, called ESP Lite. During a two-month experiment, we investigated the inner properties of the OPSA, and verified that the OPSA scheme achieves the best system gain for the ESP game system. The results of this thesis also confirm that GWAP systems are more efficient if they are designed and played with strategies.

[1] Amazon Mechanical Turk. https://www.mturk.com/
[2] Brown Corpus Manual. http://khnt.aksis.uib.no/icame/manuals/brown/
[3] Distributed Proofreaders. http://www.pgdp.net/
[4] edict virtual language centre. http://www.edict.com.hk/textanalyser/wordlists.htm
[5] ESP Game Dataset. http://www.cs.cmu.edu/~biglou/resources/
[6] Flickr. http://www.flickr.com/
[7] Fotki. http://www.fotki.com/
[8] Google Image Labeler. http://images.google.com/imagelabeler/
[9] Google Image Search. http://images.google.com/
[10] gwap.com. http://www.gwap.com/gwap/
[11] Human-based computation – Wikipedia. http://en.wikipedia.org/wiki/Human-based_computation
[12] Project Gutenberg. http://www.gutenberg.org/
[13] Porter Stemming Algorithm. http://tartarus.org/~martin/PorterStemmer/
[14] Vipul's Razor. http://razor.sourceforge.net/
[15] Wikipedia. http://en.wikipedia.org/
[16] Yahoo! Answers. http://answers.yahoo.com/
[17] Marek Bell, Stuart Reeves, Barry Brown, and Scott Sherwood. Eyespy: supporting navigation through Play. ACM Conference on Human Factors in Computing Systems (CHI), 2009.
[18] Jeffrey P. Bigham, Ryan S. Kaminsky, Richard E. Ladner, Oscar M. Danielsson, and Gordon L. Hempton. WebInSight: making web images accessible. The Eighth International ACM SIGACCESS Conference on Computers and Accessibility (ASSET), 2006.
[19] Sean Casey, Ben Kirman, and Duncan Rowland, The Gopher Game: A social, mobile, locative game with user generated content and peer review. The International Conference on Advances in Computer Entertainment Technology (ACE), 2007.
[20] Tsung-Hsiang Chang, Chien-Ju Ho and, Jane Yung-jen Hsu. The PhotoSlap game: play to annotate. The Twenty-Second Conference on Artificial Intelligence (AAAI), 2007.
[21] Bruno Norberto da Silva and Ana Cristina Bicharra Garcia. KA-CAPTCHA: an opportunity for knowledge acquisition on the web. The Twenty-Second Conference on Artificial Intelligence (AAAI), 2007.
[22] Craig Gentry, Zulfikar Ramzan, and Stuart Stubblebine. Secure distributed Human Computation. The Sixth ACM Conference on Electronic Commerce (EC), 2005.
[23] Lyndsay Grant, Hans Daanen, Steve Benford, Alastair Hampshire, Adam Drozd, and Chris Greenhalgh. MobiMissions: the game of missions for mobile phones. The 34th International Conference and Exhibition on Computer Graphics and Interactive Techniques(SIGGRAPH), 2007.
[24] Severin Hacker and Luis von Ahn. Matchin: eliciting user preferences with an online game. ACM Conference on Human Factors in Computing Systems (CHI), 2009.
[25] Chien-Ju Ho, Tsung-Hsiang Chang and, Jane Yung-jen Hsu. PhotoSlap: a multi-player online game for semantic annotation. The Twenty-Second Conference on Artificial Intelligence (AAAI), 2007.
[26] Shaili Jain and David C. Parkes. A game-theoretic analysis of games with a purpose. The 4th International Workshop On Internet And Network Economics (WINE), 2008.
[27] Edith L. M. Law, Luis von Ahn, Roger B. Dannenberg, and Mike Crawford. TagATune: A game for music and sound annotation. The 8th International Conference on Music Information Retrieval (ISMIR), 2007.
[28] Edith Law and Luis von Ahn. Input-Agreement: A new mechanism for collecting data using human computation games. ACM Conference on Human Factors in Computing Systems (CHI), 2009.
[29] Henry Lieberman, Dustin A Smith, and Alea Teeters. Common Consensus: a webbased game for collecting commonsense goals. The Workshop on Common Sense and Intelligent User Interfaces (CSIUI), 2007.
[30] Michael Mandel and Daniel Ellis. A web-based game for collecting music metadata. Journal of New Music Research (JNMR), vol. 37, pp. 151-165, June 2008.
[31] Sebastian Matyas. Playful geospatial data acquisition by location-based gaming communities. The International Journal of Virtual Reality (IJVR), vol. 6, no. 3, pp. 1-10, September 2007.
[32] Sebastian Matyas, Christian Matyas, Christoph Schlieder, Peter Kiefer, Hiroko Mitarai, and Maiko Kamata. Designing location-based mobile games with a purpose - collecting geospatial data with CityExplorer. International Conference on Advances in Computer Entertainment Technology (ACE), 2008.
[33] Bryan C. Russell, Antonio Torralba, Kevin P. Murphy, and William T. Freeman. LabelMe: A database and web-based tool for image annotation. International Journal of Computer Vision (IJCV), vol. 77, no. 1-3, pp. 157-173, May 2008.
[34] Victor S. Sheng, Foster Provost, and Panagiotis G. Ipeirotis. Get another label? Improving data quality and data mining using multiple, noisy labelers. The 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2008.
[35] Pradeep Shenoy and Desney S. Tan. Human-aided computing: utilizing implicit human processing to classify images. ACM Conference on Human Factors in Computing Systems (CHI), 2008.
[36] Rion Snow, Brendan O’Connor, Daniel Jurafsky, and Andrew Y. Ng. Cheap and fast - but is it good? Evaluating non-expert annotations for natural language tasks. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2008.
[37] Qi Su, Dmitry Pavlov, Jyh­Herng Chow, and Wendell C. Baker. Internet-scale collection of human-reviewd data. The 16th International World Wide Web Conference (WWW), 2007.
[38] Douglas Turnbull, Ruoran Liu, Luke Barrington, and Gert Lanckriet. A Game-Based Approach for Collecting Semantic Music Annotations. The 8th International Conference on Music Information Retrieval (ISMIR), 2007.
[39] Luis von Ahn. Games with a purpose. IEEE Computer Magazine, pp 96-98, June 2006.
[40] Luis von Ahn, Manuel Blum, Nicholas Hopper, and John Langford. CAPTCHA: using hard AI problems for security. Advances in Cryptology - EUROCRYPT 2003, International Conference on the Theory and Applications of Cryptographic Techniques (EUROCRYPT), 2003.
[41] Luis von Ahn and Laura Dabbish. Labeling images with a computer game. ACM Conference on Human Factors in Computing Systems (CHI), 2004.
[42] Luis von Ahn and Laura Dabbish. Designing games with a purpose. Communications of the ACM, vol. 51, no. 8, pp. 58-67, August 2008.
[43] Luis von Ahn, Shiry Ginosar, Mihir Kedia, and Manuel Blum. Improving image search with PHETCH. The 32nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2007.
[44] Luis von Ahn, Shiry Ginosar, Mihir Kedia, Ruoran Liu, and Manuel Blum. Improving accessibility of the web with a computer game. ACM Conference on Human Factors in Computing Systems (CHI), 2006.
[45] Luis von Ahn, Mihir Kedia, and Manuel Blum. Verbosity: A game for collecting common-sense facts. ACM Conference on Human Factors in Computing Systems (CHI), 2006.
[46] Luis von Ahn, Ruoran Liu, and Manuel Blum. Peekaboom: A game for locating objects in images. ACM Conference on Human Factors in Computing Systems (CHI), 2006.
[47] Luis von Ahn, Benjamin Maurer, Colin McMillen, David Abraham, and Manuel Blum. reCAPTCHA: human-based character recognition via web security measures. Science, vol. 321, pp. 1465-1468, 12 Septemper 2008.
[48] Ingmar Weber, Stephen Robertson, and Milan Vojnović. Rethinking the ESP game. Technical Report MSR-TR-2008-132, Microsoft Research, 2008.