Evenness indices once again: critical analysis of properties
- Tarald O Kvålseth^{1}Email author
Received: 19 December 2014
Accepted: 24 March 2015
Published: 16 May 2015
Abstract
Various properties have been advocated for biological evenness indices, with some properties being clearly desirable while others appear questionable. With a focus on such properties, this paper makes a distinction between properties that are clearly necessary and those that appear to be unnecessary or even inappropriate. Based on Euclidean distances as a criterion, conditions are introduced in order for an index to provide valid, true, and realistic representations of the evenness characteristic (attribute) from species abundance distributions. Without such value-validity property, it is argued that a measure or index provides only limited information about the evenness and results in misleading interpretations and evenness comparisons and incorrect results and conclusions. Among the overabundant variety of evenness indices, each of which is typically derived by rescaling a diversity measure to the interval from 0 to 1 and thereby controlling or adjusting for the species richness, most are found to lack the value-validity property and some lack the property of strict Schur-concavity. The most popular entropy-based index reveals an especially poor performance with a substantial overstatement of the evenness characteristic or a large positive value bias. One evenness index emerges as the preferred one, satisfying all properties and conditions. This index is based directly on Euclidean distances between relevant species abundance distributions and has an intuitively meaningful interpretation in terms of relative distances between distributions. The value validity of the indices is assessed by using a recently introduced probability distribution and from the use of computer-generated distributions with randomly varying species richness and probability (proportion) components.
Keywords
Biological evenness Evenness indices Value validity BiodiversityIntroduction
Proposed evenness indices varying over the interval from 0 to 1 and based on the species abundance probabilities (proportions) p _{1}, …, p _{ S } and species richness S
Designation | Formula | Reference | Notes |
---|---|---|---|
E _{1} | \( H/ logS=-{\displaystyle \sum_{i=1}^S{p}_i log{p}_i/ logS} \) | Pielou (1966) | |
E _{2} | (e ^{ H } − 1)/(S − 1) | Heip (1974) | a |
E _{3} | \( \Big(1-{\displaystyle \sum_{i=1}^S{p}_i^2\Big)/\left(1-1/S\right)} \) | Smith and Wilson (1996) | |
E _{4} | \( - log{\displaystyle \sum_{i=1}^S{p}_i^2/ logS} \) | Smith and Wilson (1996) | |
E _{5} | \( \Big(1/{\displaystyle \sum_{i=1}^S{p}_i^2-1\Big)/\left({e}^H-1\right)} \) | Alatalo (1981) | a |
E _{6} | \( \left(1-\sqrt{{\displaystyle \sum_{i=1}^S{p}_i^2}}\right)/\left(1-\sqrt{1/S}\right) \) | Pielou (1969) | |
E _{7} | \( \Big(1/{\displaystyle \sum_{i=1}^S{p}_i^2-1\Big)/\left(S-1\right)} \) | Kvålseth (1991) | |
E _{8} | \( \left({\displaystyle \sum_{i=1}^S \min \left\{{p}_i,1/S\right\}-1/S}\right)/\left(1-1/S\right) \) | Bulla (1994) | |
E _{9} | \( 1-{\left[\left(S{\displaystyle \sum_{i=1}^S{p}_i^2-1}\right)/\left(S-1\right)\right]}^{1/2} \) | Williams (1977) | b |
E _{10} | \( 2{\displaystyle \sum_{i=1}^S\left(i-1\right){p}_i/\left(S-1\right)} \) | Solomon (1979) | c |
E _{11} | \( \left(1-{\displaystyle \sum_{i=1}^S{p}_i/i}\right)/\left[1-\left(1/S\right){\displaystyle \sum_{i=1}^S1/i}\right] \) | New | c |
A variety of properties have been imposed on evenness indices (see, e.g., Smith and Wilson 1996; Taillie 1979; Engen 1979; Tuomisto 2012; Gosselin 2001; Ricotta 2004). Some of these appear to be entirely appropriate and generally agreed upon, while others seem to be unnecessary and even unreasonable. This paper starts off with a discussion of properties that are considered to be necessary for any acceptable evenness index, followed by comments about some dubious properties. One of the properties introduced as necessary is the value-validity property, which basically requires that an evenness index takes on values that are all reasonable with respect to an acceptable criterion. It is argued that this property, which nearly all proposed evenness indices lack, is necessary in order for comparisons between differences in evenness values to be valid. An index lacking this property may cause misleading results and incorrect conclusions.
The value-validity requirement of an index is based on the recently introduced lambda distribution (Kvålseth 2011) and a criterion involving Euclidean distances between species abundance distributions. The assessment of whether or not an index meets this requirement is then done analytically using the lambda distribution and empirically using computer-generated random species abundance distributions. It is also proved that some well-known indices are not valid since they lack the essential strict Schur-concavity property and hence do not preserve the Lorenz order.
Properties of evenness indices
Based on this notation, the various potential properties of an evenness index E will be discussed, starting with an outline and explanation of those properties that are suggested as being indeed necessary. Subsequent sections of this paper will discuss the value-validity property necessary for making appropriate comparisons and interpretations of E-values.
Necessary properties
(P1) Continuity: E is a continuous function of each of the p _{ i }, i = 1, …, S, for any given S.
(P2) Symmetry: E is (permutation) symmetric in p _{1}, …, p _{ S } so that the value of E is invariant with respect to all permutations of the p _{ i }’s.
(P3) Normalization: E takes on values between 0 and 1.
As a simple numerical example, consider the two distributions P _{4} = (0.40, 0.30, 0.20, 0.10) and Q _{4} = (0.70, 0.15, 0.10, 0.05) where the components have been ordered as in (3). It is readily apparent from (4) that P _{4} is majorized by Q _{4}, i.e., P _{4} ≺ Q _{4} Then, since the evenness index E is required to be strictly Schur-concave, E(P _{4}) > E(Q _{4}) from (5). Clearly, the components of P _{4} are “more evenly distributed” or “more nearly equal” than those of Q _{4} and the evenness based on P _{4} should be greater than that based on Q _{4}. This is precisely what Property P4 requires.
(P5) Value Validity: E takes on values that are all valid representations of the true extent of the species evenness characteristic.
This last property, which is considered necessary for making appropriate evenness difference comparisons, is explained in detail in subsequent sections of the paper.
Comment on property P1
The continuity requirement ensures that, for any given or fixed S, small changes in some of the p _{ i } ’s cause only a small change in the value of E. However, since E may be a function of both the p _{ i }(i = 1, …, S) and S, a change in S and hence changes in the p _{ i }’s will necessarily result in a discontinuous change in E. In fact, if S is very small, the addition of one more species may produce a substantial jump in the value of E. Such discontinuity with varying S has been discussed by, for instance, Routledge (1983), Jost (2010), and Ricotta (2004).
Other implications from property P4
(P4a) For any given species richness S, E attains its minimum and maximum values for the species abundance distributions \( {P}_S^0 \) and \( {P}_S^1 \) in (2), respectively.
Another consequence of Property P4 is that E satisfies the principle of transfers, which, within the context of income distributions, was introduced by Dalton (1920). That is, if p _{ i } < p _{ j } in the species abundance distribution P _{ S } = (p _{1}, …, p _{ S }) and if an amount δ is transferred from p _{ j } to p _{ i }, with δ < p _{ j } − p _{ i }, then the value of E increases. This can be seen to follow from (3)-(5). See also Marshall et al. (2011), pp. 6–8. That is, a sub-property of E is as follows:
(P4b) E satisfies the transfer property. As a simple example, consider the four-species distribution Q _{4} = (0.30, 0.15, 0.50, 0.05) with δ = 0.20 being transferred from p _{3} to p _{4} to produce the distribution P _{4} = (0.30, 0.15, 0.30, 0.25). It is then clear from (3)-(4) that P _{4} is majorized by Q _{4}, so that, from (5) and the strict Schur-concavity of E, E(P _{4}) > E(Q _{4}).
A third consequence of Property P4 may be stated in terms of Lorenz curves as follows (see Marshall et al. 2011, pp. 5–6, 713–715):
(P4c) E preserves the Lorenz order. As an explanation, the Lorenz curve for a distribution P _{ S } = (p _{1}, …, p _{ S }) is typically based on the cumulative probabilities \( {F}_{(i)}={\displaystyle \sum_{j=1}^i{p}_{(j)}} \) after the p _{ i }’s have been ordered such that p _{(1)} ≤ p _{(2)} ≤ … ≤ p _{(S)}. The Lorenz curve (after Lorenz 1905) is then obtained by joining the consecutive points (i/S, F _{(i)}) for i = 0, 1, …, S and F _{(0)} = 0 by successive line segments to connect the origin (0, 0) with the point (1, 1). If the Lorenz curve for P _{ S } is nowhere below and does not coincide everywhere with the Lorenz curve for the distribution Q _{ S } = (q _{1}, …, q _{ S }), this is equivalent to the majorization in (3)-(4) so that, from (5), E(P _{ S }) > E(Q _{ S }). The Lorenz curve for the uniform or completely even distribution \( {P}_S^1 \) in (2) is the straight line between the two points (0, 0) and (1, 1) so that the value E(P _{ S } ) increases as the Lorenz curve for P _{ S } gets closer to this straight line.
Introductory comments on value validity
The motivation behind the need for an evenness index to have value validity can perhaps be best illustrated by means of some simple numerical examples. Consider, for instance, the species abundance distributions P _{2} = (0.75, 0.25) and Q _{5} = (0.60, 0.10, 0.10, 0.10, 0.10) and the Pielou index E _{1} in Table 1 for which E _{1}(P _{2}) = 0.81 and E _{1}(Q _{5}) = 0.76. Both of these results would seem to indicate a “high” degree of evenness, with P _{2} indicating a more even distribution than Q _{5} of about 7%. However, the components of each of these two distributions are equally far from the corresponding components of the respective pairs of extreme distributions \( {P}_2^0 \) and \( {P}_2^1 \) and \( {Q}_5^0 \) and \( {Q}_5^1 \) defined in (2) so that the only reasonable evenness values should be 0.50 for both P _{2} and Q _{5}. Furthermore, if, say, \( \sqrt{E_1} \) or more generally \( {E}_1^{\alpha }\ \left(\alpha >0\right) \) were to be considered as alternative indices, which can be shown to have the same Properties P1-P4 as E _{1}, the results could be even more unreasonable such as \( \sqrt{E_1\left({Q}_5\right)}=0.87 \).
When making such comparisons, it is essential that they are not limited to the evenness index itself, but that they provide true representations of the attribute (characteristic) being measured. Otherwise, the results obtained may be invalid and misleading, which is not uncommon in the published literature. What is needed of the index E is that it takes on values throughout its range that are all accurate, true, or valid representations of the evenness attribute. That is, E has to have value validity (Property P5). In measurement theory, the term validity of a measurement procedure means that it does in fact measure what it purports to measure. While several different types of validity have been defined (see, e.g., Hand 2004, pp. 129–134), value validity as used here applies specifically to the requirement that all potential numerical values of a measure have to be appropriate or reasonable with respect to some generally acceptable criterion as explained in the next subsection of this paper.
The importance of a concept such as value validity does not appear to have been the subject of rigorous attention in the numerous publications involving evenness measurement and indices. Some have commented that certain evenness indices “tend to strongly overestimate evenness” or “give unreasonably high values of evenness” (Bulla 1994, pp. 167, 169). The results from computer-generated combinations of species frequencies by Fager (1972) implied that indices such as Pielou’s E _{1} and Smith and Wilson’s E _{3} in Table 1 tended to overstate evenness and had “strongly skewed distributions…” indicating that those indices “would give poor discrimination over much of the range of samples (p. 301).” Molinari (1989) did consider the importance of reasonable intermediate values of an evenness index, focusing on the case of two-species communities, and Smith and Wilson (1996) as well as Jost (2010) emphasized the need to consider intuitively reasonable intermediate index values. However, no specific value-validity conditions appear to have been formulated.
Conditions for value validity
Of course, for any given S, there may be any number of different P _{ S } -distributions for which the value of E would be the same and hence for which (10) would apply. Because of (10), the value validity of E and appropriate conditions can be considered in terms of the \( {P}_S^{\lambda } \) -distribution in (8).
The distance-based condition in (12) is also a logical implication from (9). That is, the evenness value in (12) consists of a weighted mean equivalent to that of the underlying species distributions in (9).
Further property comments
Distance criterion
The Euclidean distance is the metric being used as the basic criterion for the value-validity conditions in (11)-(14). Other metric distance functions could have been considered such as alternative members of the Minkowski family \( {d}_{\alpha}\left({P}_S,{Q}_S\right)={\left[{\displaystyle \sum_{i=1}^S{\left|{p}_i-{q}_i\right|}^{\alpha }}\right]}^{{}^{1/\alpha }} \) for parameter α ≥ 1, with α = 2 being the Euclidean metric and α = 1 being the so-called city-block or Manhattan metric (e.g., Upton and Cook 2008, pp. 118–119). While it is easily seen that, if any member of this distance family is used in (11), the expressions in (12)-(13) would still apply, but the right-hand side of (14) would generally differ for different values of α. The Euclidean distance is used here since it is the standard or ordinary measure of distance used in mathematics and the various sciences. The use of any other alternative distance metric or function would seem to require some particular justification or explanation.
Also, it is of importance to note that the right-hand side of (14) based on the Euclidean distance is strictly Schur-concave whereas, had it been based on the city-block distance, the corresponding expression would have been Schur-concave, but not strictly Schur-concave. This follows from the fact that (a) the Euclidean distance between P _{ S } and \( {P}_S^1 \) is strictly Schur-convex while the city-block distance is Schur-convex, but not strictly so (Kvålseth 2011), and (b) the right-hand side of (14) is a strictly decreasing function of those two alternative distance metrics (Marshall et al. 2011, pp. 88–91, 138–139).
Bounds on E
For a censused community with species abundance frequencies n _{1}, …, n _{ S } and total number of individuals \( N={\displaystyle \sum_{i=1}^S{n}_i} \), the most uneven species abundance distribution becomes \( {P}_S^{0+}=\left(1-\left(S-1\right)/N,1/N,\dots, 1/N\right) \) and the most even distribution \( {P}_S^{1-} \) equals \( {P}_S^1 \) in (2) only if N/S is an integer. For these extremal distributions, none of the evenness indices in Table 1 can attain the lower and upper bounds of 0 and 1 since \( {E}_i\left({P}_S^{0+}\right)>0 \) and \( {E}_i\left({P}_S^{1-}\right)<1 \). Of course, when N is large, \( {P}_S^{0+} \) and \( {P}_S^{1-} \) become effectively equal to the distributions in (2) and \( {E}_i\left({P}_S^{0+}\right)\approx 0 \) and \( {E}_i\left({P}_S^{1-}\right)\approx 1 \).
As a simple example, consider S = 5 and N = 98. Then, from the above definition, \( {P}_5^{0+}=\left(1-4/98,\kern0.5em 1/98,\dots, \kern0.5em 1/98\right) \) for the frequencies n _{ i } = 94, 1, …, 1 and \( {P}_5^{1-}=\left(20/98,\ 20/98,\ 20/98,\ 19/98,\ 19/98\right) \). For, say, the Williams’ E _{9} in Table 1, the values for these two extreme distributions are found to be \( {E}_9\left({P}_5^{0+}\right)=0.05 \) and \( {E}_9\left({P}_5^{1-}\right)=0.99 \) as compared to \( {E}_9\left({P}_5^0\right)=0 \) and \( {E}_9\left({P}_5^1\right)=1 \) for the \( {P}_5^0 \) and \( {P}_5^1 \) in (2).
However, there seems to be no particular basis for imposing such a rescaling requirement on an evenness index. In fact, on intuitive grounds, it seems unreasonable. To suggest that the above distribution \( {P}_5^{1-}=\left(20/98,\kern0.5em 20/98,\kern0.5em 20/98,\kern0.5em 19/98,\kern0.5em 19/98\right) \) indicates complete evenness is simply not appropriate. Rather, this \( {P}_S^{1-} \) is as even as it can be when S = 5 and N = 98. Similarly, the above distribution \( {P}_5^{0+}=\left(94/98,1/98,\dots, 1/98\right) \) is as uneven as possible for given S = 5 and N = 98, but it should not be considered to imply perfect unevenness. The above value, \( {E}_9\left({P}_5^{0+}\right)=0.05 \) rather than zero, would seem to provide a reasonable representation of the evenness.
Independence of S
It has been argued strongly by some that an evenness index E should be independent of the species richness S (e.g., Peet 1975; Hill 1973; Heip et al. 1998). Such a requirement would eliminate all indices in Table 1 for an insufficient reason. It is probably inevitable that any E with the above Properties P1-P5 will to some extent depend on S. This dependence has also been discussed more recently by Gosselin (2006) and Jost (2010).
It can certainly be argued that the dependence of E on S is not by itself an undesirable property. The purpose of an evenness index E is to measure how evenly (uniformly) the relative abundances p _{ i }(i = 1, …, S) are distributed across the S different species, irrespective of the value of S. The reason for normalizing (rescaling) an evenness index such that the values of E all fall within the interval from 0 to 1 (or nearly so) is simply to be able to properly compare values of E for species distributions with differing S -values. That is, the normalized E controls or adjusts for S. Without such control or adjustment of S, an evenness index would be a confounded representation of species richness S and the form of the species distribution. For such an index, one would not be able to tell whether different index values were due to differences in S -values or differences in the form of species distributions or both. An evenness index E ∈ [0, 1] is only supposed to measure the form of the species distribution, thereby requiring the control (adjustment) for S, and thus making E a function of both p _{ i }, …, p _{ S } and S.
In statistical analysis of categorical data, an evenness index such as E _{3} in Table 1 has been used as a measure of variation and referred to as the index of qualitative variation (IQV) (e.g., Mueller and Schuessler 1977, pp. 175–181; Reynolds 1984, pp. 61–64). For such measurement, the fact that the normalized E _{3} ∈ [0, 1] depends on the number of categories S does not appear to be much of an issue of concern, while papers on biological evenness seem to have made the dependence on S into an unnecessary issue. Just as it is for a measure of qualitative variation, inclusion of S into the formulation of E ∈ [0, 1], besides the ease of interpretation, is precisely for the purpose of obtaining an evenness index that can be used to compare the evenness of different species distributions of differing S.
One type of situation in which there is reason for genuine concern about E depending on species richness is when the relative species frequencies p _{ i } = n _{ i }/N (i = 1, …, S) and sample size \( N={\displaystyle \sum_{i=1}^S{n}_i} \) are based on random observations from a population of species and when the computed (sample) value E(n _{1}/N, …, n _{ S }/N) is used to make statistical inferences about the corresponding unknown population index E _{ p }. Such statistical inferences would include (a) the use of the sample value of E as an appropriate estimate of E _{ p } and (b) the construction of confidence intervals for E _{ p }. However, the necessary conditions for making such statistical inferences are rarely met in biological studies. It is typical for such sampling data that neither the total number of species S _{ p } in the defined population nor all the specific types of species are known, with S < S _{ p } and S depending to some extent on the sample size N. It is then most prudent to confine the evenness measurement to the sample itself.
Replication principle
A measurement property that has also been referred to as the “replication property” or “replication principle” was introduced by Dalton (1920) for the measurement of economic inequality. Thus, if (x _{1}, …, x _{ n }) denotes the set of incomes of n individuals and if another set of identical incomes for n other individuals are combined to produce the set of incomes (x _{1}, x _{1}, x _{2}, x _{2}, …, x _{ n }, x _{ n }) for 2n individuals, then a measure of income inequality should have the same value for (x _{1}, x _{1}, …, x _{ n }, x _{ n }) as for (x _{1}, …, x _{ n }). Any number of such replications should produce the same result. Dalton (1920) called this the “principle of proportionate additions to persons”, while others (e.g., Cowell 2011, pp. 63–64) have referred to it as the “principle of population”. The term “replication” property or principle, as also used for biological evenness measures (e.g., Taillie 1979; Tuomisto 2012), would seem to be most descriptive and will be used here.
However, it may perhaps be questionable if such a replication property should be considered necessary or even desirable, especially when the underlying data are categorical such as biological species frequencies (counts) as opposed to quatitative data such as personal incomes. Even when measuring income inequality, some feel that the desirability of this property is debatable and not self-evident (Cowell 2011, pp. 63–64), while others do not even mention this property when discussing inequality measures (Bellù and Liberati 2006; Marshall et al. 2011, Sec 13F).
For quantitive data, it does at least make realistic sense to consider a replication (x _{1}, x _{1}, …, x _{ n }, x _{ n }). However, for categorical data such as a set of biological species abundance frequencies (counts) (n _{1}, n _{2}, …, n _{ S }), a replication (n _{1}, n _{1}, n _{2}, n _{2}, …, n _{ S }, n _{ S }) would seem to be an unrealistic and intuitively meaningless concept. Each n _{ i } has to be identified with a specific species (or category) within a set of mutually exclusive and exhaustive set of species of size S. If, say, (n _{1}, …, n _{ S }) are the frequencies for a set of S different types of apple trees in one geographic area and if exactly the same frequencies are observed for the same set of S apple trees in an adjacent area, it would make no sense to determine an evenness value based on the data (n _{1}, n _{1}, …, n _{ S }, n _{ S }) for the two combined areas. Such determination should be based on (2n _{1}, …, 2n _{ S }). Otherwise, one would be “comparing apples and oranges”.
One situation in which it does make sense to consider replication would be when a set of S different species with frequencies (n _{1}, …, n _{ S }) are split into males and females, resulting in the species-sex frequencies (n _{1}/2, n _{1}/2, …, n _{ S }/2, n _{ S }/2). The S “species” categories have been split into 2S “species-sex” categories. These are two different sets of categories for which there would seem to be no basis for requiring that the evenness should be the same.
Jost (2010) has also argued against the requirement that an evenness index should possess the replication property. In fact, he argues that replication invariance would be an undesirable property for an evenness index E ∈ [0, 1].
Any proposed condition such as the one involving replication also has to make some intuitive sense when simply looking at the data, both in terms of frequencies n _{ i } and proportions (relative frequencies) p _{ i } = n _{ i }/N for i = 1, …, S and \( N={\displaystyle \sum_{i=1}^S{n}_i} \). For instance, consider two sets of data: frequencies (80, 20) or proportions P _{2} = (0.80, 0.20) versus the replicated (80, 80, 20, 20) or Q _{4} = (0.40, 0.40,0.10, 0.10). It would be hard to justify the proposition that both data sets reveal the same degree of evenness, especially when considering the P _{2} versus the Q _{4}. Clearly, Q _{4} indicates greater evenness than P _{2} since the components of Q _{4} differ less than those of P _{2}.
From the definition of the Lorenz curve under Property P4c, it is readily seen that the Lorenz curve of, say, P _{2} = (0.80, 0.20) and Q _{4} = (0.40, 0.40, 0.10, 0.10) coincide (one curve with two more points than the other), a result that holds for all replication situations. However, considering the preceding arguments, such a Lorenz-curve fact would not be sufficient to argue for a proposition that an evenness index should be invariant with respect to replication.
Assessment of proposed indices
Based on the above discussion of appropriate properties for an evenness index, the validity of various proposed indices may now be assessed. All of the indices listed in Table 1 can be seen to meet the requirements for continuity, symmetry, and normalization, i.e., Properties P1-P3. However, as will be explained next, some of those indices are not strictly Schur-concave (Property P4) and most do not satisfy the conditions for value validity (Property P5).
Schur-concavity
Alatalo’s index E _{5} in Table 1 is not Schur-concave. This is rather apparent since the denominator of E _{5} is strictly Schur-concave because (a) the entropy H is strictly Schur-concave and (b) a strictly increasing function of a strictly Schur-concave function is strictly Schur-concave (Marshall et al. 2011, pp. 89, 101). Also, as an example, consider the distributions P _{3} = (0.80, 0.10, 0.10) and Q _{3} = (0.80, 0.19, 0.01) for which E _{5}(P _{3}) = 0.58 exceeds E _{5}(Q _{3}) = 0.67 even though P _{3} is majorized by Q _{3} so that E _{5} cannot be Schur-concave (see (3)-(5)). Consequently, E _{5} is not a valid evenness index.
Bulla’s index E _{8} in Table 1 is Schur-concave, but it is not strictly Schur-concave as required by Property P4. A proof of the Schur-concavity of E _{8} is given below in Appendix A. The fact that this index is not strictly Schur-concave can be verified by the following counterexample: E _{8}(0.80, 0.15, 0.05) = E _{8}(0.80, 0.10, 0.10) = 0.30 even though (0.80, 0.10,0.10) is majorized by (0.80,0.15,0.05) as can be seen from (3)-(4). Consequently, from (5), E _{8} cannot be strictly Schur-concave.
Among other proposed evenness indices, Smith and Wilson (1996) introduced one as a strictly decreasing function of the variance V of the logged frequencies, i.e., \( V={\displaystyle \sum_{i=1}^S{\left[ log{n}_i-{\displaystyle \sum_{i=1}^S\left( log{n}_i\right)/S}\right]}^2/S} \). However, since V is not Schur-convex and a decreasing function of V is therefore not Schur-concave (Marshall et al. 2011, pp. 89, 561), the index proposed by Smith and Wilson (1996) is not Schur-concave and is therefore not a valid evenness index.
Value validity (condition (13))
Values of the evenness indices in Table 1 for the lambda distribution \( {P}_S^{\lambda } \) in (8) with different λ and S values
S | λ | E _{ 1 } | E _{ 2 } | E _{ 3 } | E _{ 4 } | E _{ 5 } | E _{ 6 } | E _{ 7 } | E _{ 8 } | E _{ 9 } | E _{ 10 } | E _{ 11 } |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | 0.2 | 0.47 | 0.38 | 0.36 | 0.29 | 0.57 | 0.61 | 0.22 | 0.20 | 0.20 | 0.20 | 0.20 |
2 | 0.5 | 0.81 | 0.75 | 0.75 | 0.68 | 0.79 | 0.72 | 0.60 | 0.50 | 0.50 | 0.50 | 0.50 |
2 | 0.8 | 0.97 | 0.96 | 0.96 | 0.94 | 0.96 | 0.95 | 0.92 | 0.80 | 0.80 | 0.80 | 0.80 |
5 | 0.2 | 0.41 | 0.23 | 0.36 | 0.21 | 0.43 | 0.28 | 0.10 | 0.20 | 0.20 | 0.20 | 0.20 |
5 | 0.5 | 0.76 | 0.60 | 0.75 | 0.57 | 0.62 | 0.66 | 0.38 | 0.50 | 0.50 | 0.50 | 0.50 |
5 | 0.8 | 0.96 | 0.92 | 0.96 | 0.91 | 0.90 | 0.94 | 0.83 | 0.80 | 0.80 | 0.80 | 0.80 |
10 | 0.2 | 0.38 | 0.15 | 0.36 | 0.17 | 0.35 | 0.26 | 0.05 | 0.20 | 0.20 | 0.20 | 0.20 |
10 | 0.5 | 0.73 | 0.48 | 0.75 | 0.49 | 0.48 | 0.63 | 0.23 | 0.50 | 0.50 | 0.50 | 0.50 |
10 | 0.8 | 0.94 | 0.87 | 0.96 | 0.87 | 0.81 | 0.92 | 0.71 | 0.80 | 0.80 | 0.80 | 0.80 |
20 | 0.2 | 0.35 | 0.10 | 0.36 | 0.14 | 0.28 | 0.24 | 0.03 | 0.20 | 0.20 | 0.20 | 0.20 |
20 | 0.5 | 0.70 | 0.37 | 0.75 | 0.42 | 0.35 | 0.60 | 0.13 | 0.50 | 0.50 | 0.50 | 0.50 |
20 | 0.8 | 0.93 | 0.80 | 0.96 | 0.81 | 0.68 | 0.91 | 0.55 | 0.80 | 0.80 | 0.80 | 0.80 |
30 | 0.2 | 0.34 | 0.07 | 0.36 | 0.13 | 0.25 | 0.24 | 0.02 | 0.20 | 0.20 | 0.20 | 0.20 |
30 | 0.5 | 0.68 | 0.32 | 0.75 | 0.38 | 0.29 | 0.58 | 0.09 | 0.50 | 0.50 | 0.50 | 0.50 |
30 | 0.8 | 0.92 | 0.76 | 0.96 | 0.77 | 0.58 | 0.89 | 0.44 | 0.80 | 0.80 | 0.80 | 0.80 |
It is clearly indicated by these results that, except for E _{8}, …, E _{11}, the various indices violate the condition in (13) that \( E\left({P}_S^{\lambda}\right)=\lambda \), some more so than others. For some of the indices, their values for the distribution \( {P}_S^{\lambda } \) exceed the λ -values, i.e., they overstate the extent of evenness, while such bias is reversed for other indices, depending upon the values of λ and S. Although these results are based on the specific distribution \( {P}_S^{\lambda } \) in (8), they have definite implications for species distributions P _{ S } = (p _{1}, …, p _{ S }) in general because of the relationship in (10).
For the evenness indices E _{9}, E _{10}, and E _{11}, which all have Properties P1-P4 and which meet the condition in (13), it remains to be determined if those indices also meet the value-validity condition in (14). This is considered next.
Value validity (condition (14))
This is so rather obvious an evenness index that undoubtedly others have also thought of it.
The determination of whether or not Solomon’s E _{10} and this author’s E _{11} comply with the requirement in (14) then becomes a comparison of E _{10} and E _{11} with the ‘gold standard’ E _{9} for different distributions P _{ S } = (p _{1}, …, p _{ S }). The E _{11} is presented as an interesting alternative to E _{10}, both of which are based on the ordering p _{1} ≥ p _{2} ≥ … ≥ p _{ S }. The E _{11} is based on the complement of the homogeneity (dominance, concentration) measure \( {\displaystyle \sum_{i=1}^S{p}_i/i} \) proposed by Kvålseth (1993) and normed to the [0, 1] -interval. For large S, the denominator of E _{11} can more conveniently be computed as 1 − (logS + 0.5772)/S + 1/2S ^{2}, which is found to be accurate to four decimal places when S > 11 (see, e.g., Knopp 1990, p. 538).
Values of indices E _{1}, E _{9}, E _{10}, and E _{11} defined in Table 1 for species distributions P _{ S } = (p _{1}, …, p _{ S }) with randomly generated S and p _{ i }(i = 1, …, S)
Data set | S | E _{ 9 } | E _{ 10 } | E _{ 11 } | E _{ 1 } |
---|---|---|---|---|---|
1 | 15 | 0.27 | 0.22 | 0.25 | 0.44 |
2 | 7 | 0.88 | 0.81 | 0.87 | 0.98 |
3 | 18 | 0.45 | 0.24 | 0.44 | 0.53 |
4 | 2 | 0.15 | 0.15 | 0.15 | 0.39 |
5 | 4 | 0.29 | 0.22 | 0.26 | 0.51 |
6 | 12 | 0.35 | 0.11 | 0.28 | 0.42 |
7 | 17 | 0.92 | 0.91 | 0.92 | 0.99 |
8 | 14 | 0.32 | 0.30 | 0.31 | 0.51 |
9 | 8 | 0.85 | 0.77 | 0.84 | 0.97 |
10 | 17 | 0.63 | 0.56 | 0.61 | 0.82 |
11 | 29 | 0.84 | 0.84 | 0.84 | 0.95 |
12 | 5 | 0.19 | 0.10 | 0.15 | 0.33 |
13 | 30 | 0.38 | 0.30 | 0.35 | 0.53 |
14 | 5 | 0.32 | 0.18 | 0.28 | 0.49 |
15 | 27 | 0.82 | 0.69 | 0.79 | 0.92 |
16 | 2 | 0.29 | 0.29 | 0.29 | 0.59 |
17 | 5 | 0.52 | 0.40 | 0.50 | 0.74 |
18 | 30 | 0.31 | 0.15 | 0.24 | 0.39 |
19 | 10 | 0.57 | 0.42 | 0.53 | 0.75 |
20 | 26 | 0.95 | 0.91 | 0.94 | 0.99 |
21 | 19 | 0.67 | 0.61 | 0.66 | 0.84 |
22 | 19 | 0.77 | 0.76 | 0.76 | 0.91 |
23 | 17 | 0.46 | 0.40 | 0.44 | 0.65 |
24 | 12 | 0.74 | 0.70 | 0.73 | 0.91 |
25 | 2 | 0.50 | 0.50 | 0.50 | 0.81 |
As expected from the results in Table 2 together with (10), Table 3 shows that E _{1} substantially and consistently violates the value-validity condition in (14) since its values generally differ considerably from those of the ‘gold standard’ E _{9}. The overstatement (positive value bias) of evenness by Pielou’s E _{1} appears to be as large as up to about 150 percent. By comparison, the approximation in (14) is much better for E _{10} and E _{11}, i.e., the values of E _{10} and E _{11} in Table 3 are generally much closer to the corresponding values of E _{9} than are those of E _{1}. This is especially the case for E _{11}.
In the case of Solomon’s E _{10}, the data in Table 3 indicate that values of E _{10} tend to be systematically and sometimes considerably smaller than those of E _{9}. For data Sets 3, 6, 12, 14, and 18, the E _{10} values are half or less of the E _{9} values. If E _{9} is used to predict E _{10} as Ê _{10} = E _{9}, then the coefficient of determination (when properly computed; see Kvålseth 1985) is found from Table 3 to be R ^{2} = 1 − ∑(E _{10} − E _{9})^{2}/∑(E _{10} − Ē _{10})^{2} = 0.86. Similarly, the root mean square difference (RMSD) between the values of E _{10} and E _{9} is found to be 0.10. When similarly comparing E _{11} with E _{9}, it turns out that R ^{2} = 0.99 and RMSD (E _{11}, E _{9}) = 0.03. That is, nearly 100% of the total variation of E _{11} (about its mean) is explained by the ‘fitted’ model Ê _{11} = E _{9} as compared to 86% in the case of E _{10}. Consequently, E _{11} cannot be rejected for lacking value validity since it complies with the requirement in (13) and seems to have a high degree of approximation to E _{9} as required by (14). However, in the case of Solomon’s E _{10}, while it complies with (13), one could certainly question its value validity since its approximation to E _{9} is rather marginal.
Concluding comments
Since all the indices in Table 1 can be seen to have Properties P1-P4, with the exception of Alatalo’s E _{5} and Bulla’s E _{8} that are not strictly Schur-concave (Property P4), those indices can reasonably be expected to provide valid size (order) comparisons as in (7a). That is, for an evenness index E with Properties P1-P4 and for which, say, E(P _{ S }) = 0.90 and E(Q _{ R }) = 0.60, one can reasonably say that the species with abundance distribution P _{ S } has higher evenness than that with abundance distribution Q _{ R }, but nothing more can be said with validity. One cannot credibly say that one has “considerably higher” evenness than the other or that the 0.90 value shows a “very high” degree of evenness even though the 0.90 value is near the top end of the [0, 1] -interval over which E is defined. Such interpretations and the types of difference comparisons in (7b)-(7c) require that E meets conditions (13)-(14) for value validity, conditions which are only clearly satisfied by Williams’ E _{9} and the new index E _{11} in Table 1.
In order to avoid misrepresentations and incorrect interpretations by using evenness indices lacking important properties, the conclusion from the analysis in this paper seems clear: E _{9} is the index of choice. Having all of the necessary properties (Properties P1-P5), E _{9} is a most informative index for which all of the comparisons in (7a)-(7c) can reasonably be considered valid.
Declarations
Acknowledgment
The author thanks an anonymous reviewer for helpful comments.
Authors’ Affiliations
References
- Alatalo RV (1981) Problems in the measurement of evenness in ecology. Oikos 37:199–204View ArticleGoogle Scholar
- Bellù LG, Liberati P (2006) Policy impacts on inequality: simple inequality measures. Food and Agriculture Organization (FAO) of the United Nations, Rome,ItalyGoogle Scholar
- Bulla L (1994) An index of eveness and its associated diversity measure. Oikos 70:167–171View ArticleGoogle Scholar
- Camargo JA (1993) Must dominance increase with the number of subordinate species in competitive interactions? J Theor Biol 161:537–542View ArticleGoogle Scholar
- Cowell FA (2011) Measuring inequality, 3rd edn. Oxford University Press, OxfordView ArticleGoogle Scholar
- Dalton H (1920) Measurement of the inequality of incomes. Econ J 30:348–361View ArticleGoogle Scholar
- Engen S (1979) Some basic concepts of ecological equitability. In: Grassle JF, Patil GP, Smith W, Taillie C (eds) Ecological diversity in theory and practice. International Co-operative Publishing House, Fairland, Maryland, USA, pp 37–50Google Scholar
- Fager EW (1972) Diversity: a sampling study. Am Nat 106:293–310View ArticleGoogle Scholar
- Gosselin F (2001) Lorenz partial order: the best known logical framework to define evenness indices. Commun Ecol 2:197–207View ArticleGoogle Scholar
- Gosselin F (2006) An assessment of the dependence of evenness indices on species richness. J Theor Biol 242:591–597View ArticleGoogle Scholar
- Grassle JF, Patil GP, Smith W, Taillie C (eds) (1979) Ecological Diversity in Theory and Practice. International Co-operative Publishing House, Fairland, Maryland, USAGoogle Scholar
- Hand DJ (2004) Measurement Theory and Practice. Wiley, Chichester, West Sussex, UKGoogle Scholar
- Heip C (1974) A new index measuring evenness. J Mar Biol Ass UK 54:555–557View ArticleGoogle Scholar
- Heip CHR, Herman PMJ, Soetaert K (1998) Indices of diversity and evenness. Océanis 24:61–87Google Scholar
- Hill MO (1973) Diversity and evenness: a unifying notation and its consequences. Ecology 54:427–432View ArticleGoogle Scholar
- Hill MO (1997) An evenness statistic based on the abundance-weighted variance of species proportions. Oikos 79:413–416View ArticleGoogle Scholar
- Jost L (2010) The relation between evenness and diversity. Diversity 2:207–232View ArticleGoogle Scholar
- Knopp K (1990) Theory and Application of Infinite Series. Dover Publications, New YorkGoogle Scholar
- Kvålseth TO (1985) Cautionary note about R^{2}. Am Stat 39:279–285Google Scholar
- Kvålseth TO (1991) Note on biological diversity, evenness, and homogeneity. Oikos 62:123–127View ArticleGoogle Scholar
- Kvålseth TO (1993) A measure of homogeneity for nominal categorical data. Percept Mot Skills 76:1129–1130View ArticleGoogle Scholar
- Kvålseth TO (1995) Coefficients of variation for nominal and ordinal categorical data. Percept Mot Skills 80:843–847View ArticleGoogle Scholar
- Kvålseth TO (2011) The lambda distribution and its applications to categorical summary measures. Adv Appl Stat 24:83–106Google Scholar
- Kvålseth TO (2014) Entropy evaluation based on value validity. Entropy 16:4855–4873View ArticleGoogle Scholar
- Lorenz MO (1905) Methods for measuring concentration of wealth. J Am Stat Assoc 9:209–219Google Scholar
- Magurran AE (2004) Measuring Biological Diversity. Blackwell Publishing, Oxford, UKGoogle Scholar
- Marshall AW, Olkin I, Arnold BC (2011) Inequalities: Theory of Majorization and its Applications, 2nd edn. Springer, New YorkView ArticleGoogle Scholar
- Molinari J (1989) A calibrated index for the measurement of evenness. Oikos 56:319–326View ArticleGoogle Scholar
- Mueller JH, Schuessler KF (1977) Statistical Reasoning in Sociology, 3rd edn. Houghton Mifflin Co., BostonGoogle Scholar
- Peet RK (1975) Relative diversity indices. Ecology 56:496–498View ArticleGoogle Scholar
- Pielou EC (1966) The measurement of diversity in different types of biological collections. J Theor Biol 13:131–144View ArticleGoogle Scholar
- Pielou EC (1969) An Introduction to Mathematical Ecology. Wiley, New YorkGoogle Scholar
- Rényi A (1961) On measures of entropy and information. Proc Fourth Berkeley Symposium on Math Stat Prob 1960, Vol I, University of California Press, Berkeley, CA, pp. 547–561Google Scholar
- Reynolds HT (1984) Analysis of Nominal Data, 2nd edn. Sage, Beverly Hills, CAGoogle Scholar
- Ricotta C (2004) A recipe for unconventional evenness measures. Acta Bioteoretica 52:95–104View ArticleGoogle Scholar
- Routledge RD (1983) Evenness indices: are any admissible? Oikos 40:149–151View ArticleGoogle Scholar
- Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:279-423,623-656Google Scholar
- Smith B, Wilson JB (1996) A consumer’s guide to evenness indices. Oikos 76:70–82View ArticleGoogle Scholar
- Solomon DL (1979) A comparative approach to species diversity. In: Grassle JF, Patel GR, Smith W, Taillie C (eds) Ecological diversity in theory and practice. International Co-operative Publishing House, Fairland, Maryland, USA, pp 29–35Google Scholar
- Taillie C (1979) Species equitability: a comparative approach. In: Grassle JF, Patel GR, Smith W, Taillie C (eds) Ecological diversity in theory and practice. International Co-operative Publishing House, Fairland, Maryland, USA, pp 51–61Google Scholar
- Tuomisto H (2012) An updated consumer’s guide to evenness and related indices. Oikos 121:1203–1218View ArticleGoogle Scholar
- Upton G, Cook I (2008) Oxford Dictionary of Statistics. Oxford Univiversity Press, Oxford, UKView ArticleGoogle Scholar
Copyright
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.