When Is Something Significantly Different?

When Is Something Significantly Different?

In principle, a statistically significant result (usually a difference) is a result that's not attributed to chance. More technically, it means that if the Null Hypothesis is true (which means there really is no difference), there's a low probability of getting a result that large or larger.

What does it mean if something is significantly different?

A Significant Difference between two groups or two points in time means that there is a measurable difference between the groups and that, statistically, the probability of obtaining that difference by chance is very small (usually less than 5%).

How do you know if results are significantly different?

Determine your alpha level and look up the intersection of degrees of freedom and alpha in a statistics table. If the value is less than or equal to your calculated t-score, the result is statistically significant.

Maya Lin-Takahashi
Author

Maya Lin-Takahashi

Maya is a hardware enthusiast who tests and reviews smart home devices, smartphones, wearables, and audio gear. She focuses on practical consumer value and build quality.