Look for another cause, an exception or a flaw in the data.
Step-by-step strategy
Ask what else could explain the result.
Common traps
Attacking a detail that doesn't matter.
Sample questions
Try to answer before opening the solution.
Question 1
Difficulty: easy≈ 2 min
A theater owner says ticket sales rose because of the new advertising campaign, noting that sales were higher in the month after it began.
Which of the following, if true, most weakens the owner's claim?
AA. The campaign ran in three local newspapers and on two of the city's radio stations.
BB. Ticket prices stayed the same in the month after the campaign began as they had been before.
CC. Most people who bought tickets that month said they had seen at least one of the new ads.
DD. A popular film star began a run at the theater in the same month.
EE. The campaign cost less to run than the owner had expected.
Show answer and explanation
Correct answer: D. A popular film star began a run at the theater in the same month.
Explanation
A new major attraction in the same month is a rival cause. Unchanged prices and buyers who saw the ads would, if anything, support the owner, and where the ads ran or what they cost is irrelevant.
Question 2
Difficulty: medium≈ 2 min
A school district argues that giving every student a tablet raised achievement, because average test scores rose in the two years after the tablets were distributed.
Which of the following, if true, most seriously weakens the district's argument?
AA. Students who used their tablets most often showed the largest gains in test scores over the two years.
BB. Test scores in the district had been stable for several years before the tablets were distributed.
CC. The state also introduced a new curriculum in every district during the same two years.
DD. The tablets were paid for with a grant.
EE. Teachers received training on the tablets.
Show answer and explanation
Correct answer: C. The state also introduced a new curriculum in every district during the same two years.
Explanation
A new curriculum introduced everywhere is a rival explanation for the rise. The other options do not undermine the district's claim.
Question 3
Difficulty: hard≈ 2 min
A researcher claims that children who attend preschool develop better language skills, because first-graders who attended preschool score higher on language tests than those who did not.
Which of the following, if true, most seriously weakens the researcher's claim?
AA. Children who attended preschool for two years scored higher on language tests than those who attended for one year.
BB. Families who send their children to preschool tend to read to them more often at home than other families do.
CC. Preschools in many cities are expensive, and some families cannot afford them.
DD. Language tests are given in the spring.
EE. Many preschools offer music classes.
Show answer and explanation
Correct answer: B. Families who send their children to preschool tend to read to them more often at home than other families do.
Explanation
If preschool families also read more at home, the home environment, not preschool, may explain the difference. The other options do not undermine the claim.