Cohen's h explained

In statistics, Cohen's h, popularized by Jacob Cohen, is a measure of distance between two proportions or probabilities. Cohen's h has several related uses:

• It can be used to describe the difference between two proportions as "small", "medium", or "large".
• It can be used to determine if the difference between two proportions is "meaningful".
• It can be used in calculating the sample size for a future study.

When measuring differences between proportions, Cohen's h can be used in conjunction with hypothesis testing. A "statistically significant" difference between two proportions is understood to mean that, given the data, it is likely that there is a difference in the population proportions. However, this difference might be too small to be meaningful—the statistically significant result does not tell us the size of the difference. Cohen's h, on the other hand, quantifies the size of the difference, allowing us to decide if the difference is meaningful.

Uses

Researchers have used Cohen's h as follows.

• Describe the differences in proportions using the rule of thumb criteria set out by Cohen.^[1] Namely, h = 0.2 is a "small" difference, h = 0.5 is a "medium" difference, and h = 0.8 is a "large" difference.^{[2] [3]}
• Only discuss differences that have h greater than some threshold value, such as 0.2.^[4]
• When the sample size is so large that many differences are likely to be statistically significant, Cohen's h identifies "meaningful", "clinically meaningful", or "practically significant" differences.^{[4] [5]}

Calculation

Given a probability or proportion p, between 0 and 1, its arcsine transformation is

\varphi = 2 \arcsin \sqrt{p}.

Given two proportions,

p _{1} and p _{2} , h is defined as the difference between their arcsine transformations.^[1] Namely,h = \varphi _{1} - \varphi _{2.}

This is also sometimes called "directional h" because, in addition to showing the magnitude of the difference, it shows which of the two proportions is greater.

Often, researchers mean "nondirectional h", which is just the absolute value of the directional h:

h = \left| \varphi _{1} - \varphi _{2} \right|.

In R, Cohen's h can be calculated using the ES.h function in the pwr package^[6] or the cohenH function in the rcompanion package.^[7]

Interpretation

Cohen^[1] provides the following descriptive interpretations of h as a rule of thumb:

• h = 0.20: "small effect size".
• h = 0.50: "medium effect size".
• h = 0.80: "large effect size".

Cohen cautions that:

Nevertheless, many researchers do use these conventions as given.

See also

• Estimation statistics
• Clinical significance
• Cohen's d
• Cohen's g
• Odds ratio
• Effect size
• Sample size determination

Notes and References

1. Book: Statistical Power Analysis for the Behavioral Sciences . Cohen, Jacob . 1988 . 2nd.
2. The Patient Health Questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong . Yu, Xiaonan . Comprehensive Psychiatry . 2012 . 53 . 1 . 95–102 . 10.1016/j.comppsych.2010.11.002 . 21193179 . etal.
3. Characteristics of Youths With Hearing Loss Admitted to Substance Abuse Treatment . Titus, Janet C. . Journal of Deaf Studies and Deaf Education . February 2008 . 10.1093/deafed/enm068 . etal . 13 . 3 . 336–350. 18252698 .
4. Stigmatising attitudes towards people with mental disorders: Changes in Australia over 8 years . Reavley, Nicola J. . Psychiatry Research . 2012 . 197 . 3 . 302–306 . 10.1016/j.psychres.2012.01.011 . 22417929 . 33538798 . etal.
5. Intentions and helpfulness beliefs about first aid responses for young people with mental disorders: Findings from two Australian national surveys of youth . Yap, Marie Bee Hui . Journal of Affective Disorders . 2012 . 136 . 3 . 430–442 . 10.1016/j.jad.2011.11.006 . etal . 22137764.
6. Web site: pwr: Basic Functions for Power Analysis . 2015 . Champely, Stephane.
7. Web site: rcompanion: Functions to Support Extension Education Program Evaluation . 2020 . Mangiafico, Salvatore.