Table 2 Summary of multiple comparison methods

LSD

Highest error rate and power of any method. In general, it controls the FWER in the weak sense; when there are 3 treatment groups, the FWER is controlled in the strong sense.

DC

Error-rate and power intermediate between SNK and LSD. Controls the FWER in the weak sense.

SNK

Error-rate and power intermediate between TK and DC. Controls the FWER in the weak sense.

TK

SSP, Lowest error rate and power^*, controls the FWER in the strong-sense

BF

SSP, Controls the FWER in the strong sense, but it is too conservative (reduces the number of true positives)

Holm

SWP, Stepwise extension of BF; hence, it is more powerful. It should always be preferred over BF; controls the FWER in the strong sense. It doesn’t take logical constraints or correlations into account.

Westfall

More powerful than any MCP controlling the FWER in the strong sense. However, it is computationally expensive.