7 Comments
User's avatar
⭠ Return to thread
Adam Wilson's avatar

This seems like a really long winded way of explaining the p value.

My understanding is that it is a measure of the confidence that the result is not down to pure chance. A p value of 0.05 suggests that there is 5% likelihood that the result was down to chance, rather than the intervention. 0.05 has been set as the threshold of acceptable risk that the result is trustworthy. It does not mean the result is 100% accurate.

Expand full comment
JDK's avatar

Sigh. Your proposed definition is not what a p-value actual is.

Expand full comment
Adam Wilson's avatar

" The P stands for probability and measures how likely it is that any observed difference between groups is due to chance. Being a probability, P can take any value between 0 and 1. Values close to 0 indicate that the observed difference is unlikely to be due to chance, whereas a P value close to 1 suggests no difference between the groups other than due to chance."

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4111019/

Expand full comment
JDK's avatar

The p-value is the probability that IF you repeated the experiment ...

Expand full comment
Adam Wilson's avatar

ok, please share your understanding.

Expand full comment
Sander Greenland's avatar

Please see what I posted above about the mistakes in Recht's definition, especially https://amstat.tandfonline.com/doi/suppl/10.1080/00031305.2016.1154108/suppl_file/utas_a_1154108_sm5368.pdf

Expand full comment