- Can experiments detect differences that matter?
This question is important because it asks if the results of a study are significant. This is important when discussing controversial scientific topics because it determines if research holds any weight in a discussion.
- Does the study show causation or correlation?
This is an important question because studies are not able to prove causation. The distinction here is important because it means that there may be confounding variables that were not considered (i.e something else causing an observed result.
- What is the mechanism?
This is an important question to ask because it determines how and/or why a result is being observed.
- How much do experiments reflect reality?
This question makes us consider if the results of a study are relevant to our actual day-to-day life. Just because something is shown under laboratory conditions doesn’t necessarily mean it will be observed in other conditions.
- Could anything else explain the results?
This question goes back to the second one. Confounding variables are important to consider because if something else explains the results, the findings of a study are not as relevant. Studies need to be controlled for variables outside of the ones being measured.
I think one of the most important questions being asked here is “Does the study show causation or correlation?” This is a question that is often not considered. When scientific findings are being reported on, we often see sensational headlines citing a study that established correlation, not causation.
