What did a documentary change? Read the evidence behind the audience number
· Give A Damn Doc editorial team · Worked example and worksheet
Netflix reported that 38 million member households chose The Social Dilemma in its first 28 days. Imagine a screening poster saying that the film changed 38 million people’s phone habits. Two things happened between those sentences. A household became a person, and playing a film became changing a habit. The following exercise traces each claim to the record that could support it.
1. Copy the unit and time window together
Open page 4 of Netflix’s October 2020 shareholder letter. The documentary paragraph gives the 38 million figure and the 28-day window. Record “member households” beside the number. One household might have several people watching together. The letter gives no headcount for that room and no follow-up on what anyone did with their phone.
Keep a separate row for each source making a claim about the film. The guide to tracing a documentary quotation shows how to preserve the speaker and source when another writer retells the story. Here, the company reporting its audience and the researchers questioning subscribers belong on different rows.
2. Find the people behind the survey total
The USC Norman Lear Center’s evaluation of The Social Dilemma contains a different number. Table 1 counts 3,881 US adult Netflix subscribers surveyed in 2021. Of those, 2,317 had viewed the film and 1,564 had not. Their sum gives the study total. Calling all 3,881 “viewers” would erase the comparison group.
Read down the recruitment columns before using a percentage. A research panel supplied some participants. The filmmakers and a partner also distributed survey links through newsletters and social media. The people who answered are a particular sample. The survey never says that these are the same households counted in Netflix’s release.
3. Match the verb to the observation
The researchers adjusted for measured differences between viewers and non-viewers. They found viewers were more likely to report placing limits on their own smartphone use. A screening handout can say exactly that, naming the study and its respondents. The record here is a person’s survey answer. There is no before-and-after phone log for each of the 38 million households. Applying the survey percentage to that audience total would join two different populations and two different measures.
Try crossing out the number in the poster’s claim. The words “the film changed” still ask a causal question. To examine it, ask how people were selected, what comparison the researchers made and which other differences could remain. Those questions survive even when the reach figure is very large.
4. Try the same edit on a screening-room tally
Suppose a club records 40 admissions. A week later, ten people return an optional card and four say they switched off an app notification. Write “Four of ten respondents reported switching off a notification.” The card records a specific action. The other 30 admissions have no follow-up response recorded. Dividing four by 40 and calling it the film’s success rate would silently assign outcomes to the nonrespondents.
Download the claim-check worksheet with the two published records, the fictional club example and space for a different film. If your group wants to try a follow-up of its own, the screening discussion guide will help choose a task that participants can actually report back on.