- Can experiments detect differences that matter?
- Does the study show causation or correlation?
- What is the mechanism?
- How much do experiments reflect reality?
- Could anything else explain the results?
Can experiments detect differences that matter? Apparent similarities might cloak small differences. It is important to know whether your experiment is able to detect these differences. The good news is that technology is getting better and this discrepancy is being eliminated slowly.
Does the study show causation or correlation? This is a very important determination because it could skew the results of the study. It is important to show a 100% causation if you are making a statement. It is easy to make a correlation but harder to make determine a causation.
What is the mechanism? A mechanism is a plausible account of the process that causes a relationship between the 2 things. One must know this in an experiment when designing and looking over the results. Without it, you cannot accurately make a correlation.
How much do experiments reflect reality? This is also an important thing to determine to tell if you want to do the study and now important the results of the study are. This can also be determined by the reader.
Could anything else explain the results? This is the most important thing to consider in studies. It is also one of the hardest things to determine especially in advanced fields like biology. With so many moving parts, it is hard to determine for sure if another factor is causing something.
