Hiding the Evidence of Valid Theories: How Coupled Search Processes Obscure Performance Differences Among Organizations

Nicolaj  Siggelkow; Jan   Rivkin

Article | Administrative Science Quarterly | December 2009

Hiding the Evidence of Valid Theories: How Coupled Search Processes Obscure Performance Differences Among Organizations

by Nicolaj Siggelkow and Jan Rivkin

Abstract

Theorists argue that an organization's high-level choices, such as its organizational design or the attributes of its top management team, should influence its performance, yet empirical researchers have struggled to detect such influence. The impact of high-level choices may appear weak, we theorize, because the choices are embedded in coupled search processes. A coupled search process exists in an organization when managers search for high-level choices that shape the search for low-level, operational choices, which in turn determine performance. Using a simulation model, we show that coupled search processes obscure the performance impact of high-level choices through two mechanisms: (1) a survivor effect, arising because firms that persist with poor high-level choices are those that luckily happened on good low-level choices despite their poor high-level choices and (2) a wanderer effect, arising when firms use good high-level choices to find good low-level choices and achieve strong performance, but then wander toward poor high-level choices. We show that these effects are particularly strong in stable environments, and we identify empirical strategies that can tease out the true performance impact of high-level choices.

Keywords: Decision Choices and Conditions; Management Teams; Organizational Design; Performance Effectiveness; Power and Influence; Balance and Stability;

Format: Print

33 pages

Find at Harvard

Citation:

Siggelkow, Nicolaj, and Jan Rivkin. "Hiding the Evidence of Valid Theories: How Coupled Search Processes Obscure Performance Differences Among Organizations." Administrative Science Quarterly 54, no. 4 (December 2009): 602 – 634.

In September 2017, the Internet giant Amazon announced that it aimed to open a second headquarters in some city other than Seattle, its current home base. By 2032, the company projected, this “HQ2” would be home to as many as 50,000 high-paying tech jobs and up to $5 billion of investment. The company invited North American cities to submit proposals to be the site of HQ2. The announcement set off a flurry of activity across the continent as civic leaders scrambled to prepare proposals by Amazon’s deadline. The case allows students to debate what companies should ask of cities and what cities should ask of companies.

This supplement discusses Amazon’s 2018 decision to split its HQ2 between two locations--Long Island City in New York and National Landing outside Washington, DC—as well as the ensuing response from local politicians and the public.

This Teaching Note accompanies the case HBS No. 718-419, “Hilti (A): Fleet Management.” It provides guidelines for class discussion, as well as a board plan and transcripts of the associated videos, Hilti Fleet Management Video Supplements.
The associated case explores the strategic decision-making process of premium power tools manufacturer Hilti in 1999, when the company was considering implementing a fleet management system in the construction industry. Fleet management would involve a shift from selling power tools to leasing them as a service. For Hilti, it represented an entirely new business model, which would substantially differentiate the company from its competitors. While fleet management had the potential to significantly improve the customer experience, Hilti was already a successful firm under its extant model and had to decide whether the restructuring of its business model was worth the risk.

Faculty & Research

Hiding the Evidence of Valid Theories: How Coupled Search Processes Obscure Performance Differences Among Organizations

Abstract

Citation:

About the Author

More from the Author