Skip to Main Content
HBS Home
  • About
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
Faculty & Research
  • Faculty
  • Research
  • Featured Topics
  • Academic Units
  • …→
  • Harvard Business School→
  • Faculty & Research→
Publications
Publications
  • Article
  • Pattern Recognition Letters

Pattern Detection in the Activation Space for Identifying Synthesized Content

By: Celia Cintas, Skyler Speakman, Girmaw Abebe Tadesse, Victor Akinwande, Edward McFowland III and Komminist Weldemariam
  • Format:Print
ShareBar

Abstract

Generative Adversarial Networks (GANs) have recently achieved unprecedented success in photo-realistic image synthesis from low-dimensional random noise. The ability to synthesize high-quality content at a large scale brings potential risks as the generated samples may lead to misinformation that can create severe social, political, health, and business hazards. We propose SubsetGAN to identify generated content by detecting a subset of anomalous node-activations in the inner layers of pre-trained neural networks. These nodes, as a group, maximize a non-parametric measure of divergence away from the expected distribution of activations created from real data. This enables us to identify synthesized images without prior knowledge of their distribution. SubsetGAN efficiently scores subsets of nodes and returns the group of nodes within the pre-trained classifier that contributed to the maximum score. The classifier can be a general fake classifier trained over samples from multiple sources or the discriminator network from different GANs. Our approach shows consistently higher detection power than existing detection methods across several state-of-the-art GANs (PGGAN, StarGAN, and CycleGAN) and over different proportions of generated content.

Keywords

Subset Scanning; Generative Models; Synthetic Content Detection

Citation

Cintas, Celia, Skyler Speakman, Girmaw Abebe Tadesse, Victor Akinwande, Edward McFowland III, and Komminist Weldemariam. "Pattern Detection in the Activation Space for Identifying Synthesized Content." Pattern Recognition Letters 153 (January 2022): 207–213.
  • Register to Read

About The Author

Edward McFowland III

Technology and Operations Management
→More Publications

More from the Authors

    • 2022
    • Journal of Computational and Graphical Statistics

    Nonparametric Subset Scanning for Detection of Heteroscedasticity

    By: Charles R. Doss and Edward McFowland III
    • MIS Quarterly

    A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects

    By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
    • 2021
    • Faculty Research

    Toward Automated Discovery of Novel Anomalous Patterns

    By: Edward McFowland III and Daniel B. Neill
More from the Authors
  • Nonparametric Subset Scanning for Detection of Heteroscedasticity By: Charles R. Doss and Edward McFowland III
  • A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
  • Toward Automated Discovery of Novel Anomalous Patterns By: Edward McFowland III and Daniel B. Neill
ǁ
Campus Map
Harvard Business School
Soldiers Field
Boston, MA 02163
→Map & Directions
→More Contact Information
  • Make a Gift
  • Site Map
  • Jobs
  • Harvard University
  • Trademarks
  • Policies
  • Accessibility
  • Digital Accessibility
Copyright © President & Fellows of Harvard College