Skip to main content

Table 2 Point estimate (PE) relative bias, variance, and mean square error (MSE) of Intraclass Correlation Coefficient (ICC) for culture results of samples collected by 2 veterinarians and based on the negative binomial mixed model, linear mixed model with raw data, square-root transformed data and log-transformed data (bold values are nearest to zero within a row)

From: Reliability of environmental sampling culture results using the negative binomial intraclass correlation coefficient

Scenario Parameter Negative binomial Transformed data
    Raw Natural logarithm Square root
1 PE relative bias% -10.35 -16.14 -5.41 -5.32
  Variance 0.0098 0.0138 0.0145 0.0137
  MSE 0.011 0.0168 0.0148 0.014
2 PE relative bias% -10.8 -17.21 -1.13 -2.55
  Variance 0.0108 0.0136 0.0198 0.0183
  MSE 0.0126 0.0181 0.0198 0.0184
3 PE relative bias% -5.33 -7.65 8.45 12.43
  Variance 0.0052 0.0118 0.0115 0.012
  MSE 0.0056 0.0126 0.0124 0.014
4 PE relative bias% -9.3 -16.93 9.75 9.7
  Variance 0.0067 0.0107 0.0205 0.0152
  MSE 0.0081 0.0153 0.022 0.0167
5 PE relative bias% -8.28 -18.37 -10.46 -10.92
  Variance 0.0114 0.0135 0.0133 0.0136
  MSE 0.0129 0.0207 0.0156 0.0161
6 PE relative bias% -19.51 -30.33 -21.06 -22.33
  Variance 0.0148 0.0138 0.0162 0.0161
  MSE 0.0254 0.0394 0.0285 0.03
7 PE relative bias% -8.02 -14.27 0.41 2.54
  Variance 0.0095 0.012 0.0158 0.0122
  MSE 0.0112 0.0172 0.0158 0.0124
8 PE relative bias% -5.89 -15.66 9.03 7.11
  Variance 0.009 0.0107 0.016 0.0131
  MSE 0.01 0.0181 0.0185 0.0146
9 PE relative bias% 17.53 3.26 27.01 26.74
  Variance 0.0129 0.0105 0.0126 0.0118
  MSE 0.0144 0.0106 0.0162 0.0154
10 PE relative bias% 8.55 -0.51 31.12 27.35
  Variance 0.0165 0.0145 0.025 0.0225
  MSE 0.017 0.0145 0.0314 0.0275
11 PE relative bias% 30.36 27.17 62.05 66.58
  Variance 0.0104 0.0134 0.0144 0.015
  MSE 0.0154 0.0174 0.0351 0.0388
12 PE relative bias% 19.56 16.28 57.01 55.29
  Variance 0.0118 0.0157 0.0193 0.0183
  MSE 0.0144 0.0175 0.0416 0.0392
13 PE relative bias% 13.24 7.84 18.41 18.51
  Variance 0.0213 0.0185 0.0176 0.0183
  MSE 0.0229 0.0191 0.0207 0.0215
14 PE relative bias% 7.22 -2.79 17.15 15.39
  Variance 0.0217 0.0172 0.027 0.0255
  MSE 0.0223 0.0173 0.0306 0.0284
15 PE relative bias% 28.41 23.59 45.99 48.25
  Variance 0.0154 0.0182 0.0178 0.0188
  MSE 0.0236 0.0239 0.0394 0.0425
16 PE relative bias% 22.69 19.99 51.97 50
  Variance 0.0216 0.0205 0.0262 0.023
  MSE 0.0281 0.0256 0.0604 0.0546