Search a title or topic

Over 20 million podcasts, powered by 

Player FM logo
Artwork

Content provided by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Beyond the Binary: Why Your Survey Results Are Probably Wrong

45:05
 
Share
 

Manage episode 482772337 series 3552331
Content provided by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

When you ask "Mexican food for dinner?" you're engaging in the most basic form of survey methodology—but as Dr. Philip Garland reveals, there's a profound science to questioning that shapes everything from presidential elections to product development.
Dr. Garland's remarkable journey began with a personal mission. As a freshman experiencing racism at University of Washington, he abandoned engineering aspirations to study political science and communications, determined to understand how media shapes perceptions. This path led through Stanford, groundbreaking dissertation research on racial attitudes, and ultimately to transforming SurveyMonkey from a basic tool into a sophisticated research platform.
The difference between amateur and professional questioning is striking. Simply adding "if any" to "How many movies have you seen this month?" dramatically changes responses by normalizing zero as an acceptable answer. This precision matters enormously: Dr. Garland controversially argues that the widely-used Net Promoter Score is "not worth the paper it's printed on" because fundamentally different data patterns can yield identical scores, potentially driving businesses to identical conclusions from vastly different customer feedback.
During the 2012 presidential election, Dr. Garland's team correctly predicted 48 of 50 states, helping legitimize online polling by leveraging SurveyMonkey's massive reach. Looking ahead, he sees AI dramatically improving survey efficiency while still requiring human responses: "No amount of data simulation can replace asking real human beings real questions."
Perhaps most concerning is how media fragmentation affects our political landscape. When people only encounter views reinforcing existing beliefs, meaningful dialogue becomes impossible. For entrepreneurs, proper survey methodology helps determine whether you're solving a problem for five people or five million—critical information before investing significant resources.
Ready to harness the power of data-driven decision making? Dive deeper into digital media strategy with USC Annenberg's MS in Digital Media Management program.

This podcast is proudly sponsored by USC Annenberg’s Master of Science in Digital Media Management (MSDMM) program. An online master’s designed to prepare practitioners to understand the evolving media landscape, make data-driven and ethical decisions, and build a more equitable future by leading diverse teams with the technical, artistic, analytical, and production skills needed to create engaging content and technologies for the global marketplace. Learn more or apply today at https://dmm.usc.edu.

  continue reading

Chapters

1. Introduction to Dr. Philip Garland (00:00:00)

2. Educational Journey and Racial Attitudes Research (00:05:10)

3. The Science of Survey Methodology (00:13:39)

4. Transforming SurveyMonkey and Election Polling (00:18:28)

5. Survey Best Practices and AI Impact (00:31:00)

6. Media Polarization and Entrepreneurial Insights (00:33:40)

7. Finding Another Level of Effort (00:42:32)

65 episodes

Artwork
iconShare
 
Manage episode 482772337 series 3552331
Content provided by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Hosted by Joseph Itaya & Anika Jackson, Hosted by Joseph Itaya, and Anika Jackson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

When you ask "Mexican food for dinner?" you're engaging in the most basic form of survey methodology—but as Dr. Philip Garland reveals, there's a profound science to questioning that shapes everything from presidential elections to product development.
Dr. Garland's remarkable journey began with a personal mission. As a freshman experiencing racism at University of Washington, he abandoned engineering aspirations to study political science and communications, determined to understand how media shapes perceptions. This path led through Stanford, groundbreaking dissertation research on racial attitudes, and ultimately to transforming SurveyMonkey from a basic tool into a sophisticated research platform.
The difference between amateur and professional questioning is striking. Simply adding "if any" to "How many movies have you seen this month?" dramatically changes responses by normalizing zero as an acceptable answer. This precision matters enormously: Dr. Garland controversially argues that the widely-used Net Promoter Score is "not worth the paper it's printed on" because fundamentally different data patterns can yield identical scores, potentially driving businesses to identical conclusions from vastly different customer feedback.
During the 2012 presidential election, Dr. Garland's team correctly predicted 48 of 50 states, helping legitimize online polling by leveraging SurveyMonkey's massive reach. Looking ahead, he sees AI dramatically improving survey efficiency while still requiring human responses: "No amount of data simulation can replace asking real human beings real questions."
Perhaps most concerning is how media fragmentation affects our political landscape. When people only encounter views reinforcing existing beliefs, meaningful dialogue becomes impossible. For entrepreneurs, proper survey methodology helps determine whether you're solving a problem for five people or five million—critical information before investing significant resources.
Ready to harness the power of data-driven decision making? Dive deeper into digital media strategy with USC Annenberg's MS in Digital Media Management program.

This podcast is proudly sponsored by USC Annenberg’s Master of Science in Digital Media Management (MSDMM) program. An online master’s designed to prepare practitioners to understand the evolving media landscape, make data-driven and ethical decisions, and build a more equitable future by leading diverse teams with the technical, artistic, analytical, and production skills needed to create engaging content and technologies for the global marketplace. Learn more or apply today at https://dmm.usc.edu.

  continue reading

Chapters

1. Introduction to Dr. Philip Garland (00:00:00)

2. Educational Journey and Racial Attitudes Research (00:05:10)

3. The Science of Survey Methodology (00:13:39)

4. Transforming SurveyMonkey and Election Polling (00:18:28)

5. Survey Best Practices and AI Impact (00:31:00)

6. Media Polarization and Entrepreneurial Insights (00:33:40)

7. Finding Another Level of Effort (00:42:32)

65 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Listen to this show while you explore
Play