Jump to main content
Jump to site search

Issue 1, 2010
Previous Article Next Article

Equivalence versus classical statistical tests in water quality assessments

Author affiliations


To evaluate whether two unattended field organic carbon instruments could provide data comparable to laboratory-generated data, we needed a practical assessment. Null hypothesis statistical testing (NHST) is commonly utilized for such evaluations in environmental assessments, but researchers in other disciplines have identified weaknesses that may limit NHST's usefulness. For example, in NHST, large sample sizes change p-values and a statistically significant result can be obtained by merely increasing the sample size. In addition, p-values can indicate that observed results are statistically significantly different, but in reality the differences could be trivial in magnitude. Equivalence tests, on the other hand, allow the investigator to incorporate decision criteria that have practical relevance to the study. In this paper, we demonstrate the potential use of equivalence tests as an alternative to NHST. We first compare data between the two field instruments, and then compare the field instruments' data to laboratory-generated data using both NHST and equivalence tests. NHST indicated that the data between the two field instruments and the data between the field instruments and the laboratory were significantly different. Equivalence tests showed that the data were equivalent because they fell within a pre-determined equivalence interval based on our knowledge of laboratory precision. We conclude that equivalence tests provide more useful comparisons and interpretation of water quality data than NHST and should be more widely used in similar environmental assessments.

Graphical abstract: Equivalence versus classical statistical tests in water quality assessments

Back to tab navigation

Supplementary files

Publication details

The article was received on 19 Jun 2009, accepted on 11 Sep 2009 and first published on 21 Oct 2009

Article type: Paper
DOI: 10.1039/B912098J
Citation: J. Environ. Monit., 2010,12, 172-177
  •   Request permissions

    Equivalence versus classical statistical tests in water quality assessments

    M. Ngatia, D. Gonzalez, S. San Julian and A. Conner, J. Environ. Monit., 2010, 12, 172
    DOI: 10.1039/B912098J

Search articles by author