- Can experiments detect differences that matter?
- Absolutely, this is the basis of all advancement that has been made in all areas of science. The ability to experimentally prove causation allows us to build off of other ideas and develop new ideas, methods and technology.
- Does the study show causation or correlation?
- Causation occurs when the occurrence of something directly leads to an influence on something else. Correlation, on the other hand, just means that the occurrence of two things are somewhat linked. Correlation, at best, suggests a strong relationship between two variables while causation shows absolute linkage between two variables. As I read this question a quote from a previous stats course came to mind, “correlation does not imply causation!” It’s important to remember that while a correlation may insinuate a relationship, the presence of confounding variables is always possible.
- What is the mechanism?
- Essentially, the mechanism mentioned in this paper revolves around the idea that once a relationship is found, the next step is to try to determine the mechanisms behind it, how they influence each other, and if the relationship is replicable .
- How much do experiments reflect reality?
- This question is difficult to answer. The actual reflection on reality shifts between experiments and is a very important factor to keep in mind when reading any scientific literature. For example, reading a study about a biochemical reaction of a drug is informative, but considering the actual environment and other factors which could influence it within the human body is imperative before any human trials could occur.,
- Could anything else explain the results?
- As mentioned above, confounding variables are always important to keep in mind as they could be influencing the results. In some cases, it may be difficult to fully explain the results. But being vigilant for potentially confounding factors and emphasizing replicability can help to reduce their impact.
Overall, I would say that #4 and #5 are the most important when discussing controversy surrounding scientific literature. Peers suggesting possible confounding variables, or alternate mechanisms in differing environments are important comments and things the researchers may not have properly considered initially. However, these are all important questions to consider during the scientific review process.