Understanding the difference between reliability and validity is essential for a high-quality evaluation.
| Feature | Reliability | Validity |
|---|---|---|
| Focus | Consistency of the measurement | Accuracy and relevance of the measurement |
| Question | If I do it again, will I get the same result? | Am I actually measuring what I think I am? |
| Example | Using a standardized flow meter correctly every time. | Ensuring flow rate is the right metric for flood risk. |
Be Specific: When identifying limitations, avoid vague terms like 'bad weather'; instead, explain exactly how the rain affected the visibility or the river's discharge rate.
Suggest Tangible Improvements: Always follow a identified limitation with a specific solution, such as increasing the sample size from to to improve statistical significance.
Check for Bias: In exam questions involving secondary data or questionnaires, always look for 'vested interests' where a stakeholder might benefit from a particular outcome.
The 'So What?' Factor: For every error identified, explain its impact on the final conclusion. An error that doesn't change the overall trend is less critical than one that invalidates the hypothesis.