Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • September 2011 (Revised July 2012)
  • Case
  • HBS Case Collection

Building Watson: Not So Elementary, My Dear!

By: Willy Shih
  • Format:Print
  • | Pages:19
ShareBar

Abstract

This case is set inside IBM Research's efforts to build a computer that can successfully take on human challengers playing the game show Jeopardy! It opens with the machine named Watson offering the incorrect answer "Toronto" to a seemingly simple question during the championship match. Was the answer a reflection of a strategic weakness, or was it actually consistent with design principles established by the development team? The case seeks to expand students' view of the product development process. Traditional software development projects begin with the gathering of requirements and analysis of the problem, and the writing of a detailed specification. The Jeopardy! problem is different - it requires a probabilistic approach where there is no closed form solution. Instead statistical patterns in the data are important and there is no obvious mapping to the way queries are expressed. Such problems are increasingly common in data mining, optimization problems, or Internet applications where the goal is to find an acceptably good solution in a short amount of time, when a deterministic approach might be less fruitful or impractical. We aspire for students to recognize that product development can take many forms, and that these are enabled by creativity and the right organizational flexibility and mindset. The case highlights the key role of performance metrics in building a flexible system that could be refined through experimentation and testing, steadily improving performance with the incorporation of new algorithmic ideas and new data sources. The case then delves extensively into the analysis of the "Toronto" failure and why the answer that Watson produced was a rational product of a sound strategy. This leaves students to judge the generality of the strategy and its applicability to important business problems.

Keywords

Technological Innovation; Standards; Product Development; Organizational Change and Adaptation; Mathematical Methods; Research and Development; Information Technology

Citation

Shih, Willy. "Building Watson: Not So Elementary, My Dear!" Harvard Business School Case 612-017, September 2011. (Revised July 2012.)
  • Educators
  • Purchase

About The Author

Willy C. Shih

Technology and Operations Management
→More Publications

Related Work

    • September 2011 (Revised July 2012)
    • Faculty Research

    Building Watson: Not So Elementary, My Dear!

    By: Willy Shih
Related Work
  • Building Watson: Not So Elementary, My Dear! By: Willy Shih
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College