A critical review of measurement uncertainty in the enumeration of food micro-organisms

Food Microbiology

Volumn 24, Issue 3, 2007, Pages 230-253

  Corry, Janet E L ^a   Jarvis, Basil ^b   Passmore, Sue ^c   Hedges, Alan ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b Ross Biosciences Ltd   (United Kingdom)

^c Hickory Hollow   (United Kingdom)

Author keywords

Colony counts; Confidence limits; Precautions; Reference materials; Statistical procedures; Uncertainty; Validation; Variability

Indexed keywords

ANALYSIS OF VARIANCE; BACTERIAL COUNT; BIOLOGICAL MODEL; FOOD CONTROL; MATHEMATICS; METHODOLOGY; NONPARAMETRIC TEST; REVIEW; STANDARD; UNCERTAINTY;

ANALYSIS OF VARIANCE; COLONY COUNT, MICROBIAL; FOOD MICROBIOLOGY; MATHEMATICS; MODELS, BIOLOGICAL; STATISTICS, NONPARAMETRIC; UNCERTAINTY;

EID: 33845510102     PISSN: 07400020     EISSN: 10959998     Source Type: Journal    
DOI: 10.1016/j.fm.2006.05.003     Document Type: Review

References (174)

1. Accreditation Advisory Group of the Institute of Food Science Technology (AAG), 2005. Guideline no. 13. Uncertainty of measurement in food microbiology by analysis of variance.
2. Analytical Methods Committee. Robust statistics: a method of coping with outliers. Analytical Methods Brief No. 6, April 2001 (2001), Royal Society of Chemistry
3. Anderson J.M., and Baird-Parker A.C. A rapid and direct plate method for the enumeration of Escherichia coli biotype 1 in food. J. Appl. Bacteriol. 39 (1975) 111-117
4. Andrews W.H. Recommendations for preparing test samples for AOAC collaborative studies of microbiological procedures for foods. J. AOAC Int. 70 (1987) 931-936
5. Andrews W.H. Validation of modern methods in food microbiology by AOAC International, collaborative study. Food Control 7 (1996) 19-29
6. Andrews W.H. New trends in food microbiology: an AOAC International perspective. J. AOAC Int. 80 (1997) 908-912
7. Anon, 1979. EEC Report: Microbiological Methods for Control of Poultry Meat. Study P.203, VI/5021/79-EN, Commission of the European Communities.
8. Anon. MicroVal Rules and Certification Scheme (1998), MicroVal Sceretariat, NNI, Delft, The Netherlands
9. Augustin J.-C., and Cartier V. Lessons from the organisation of a proficiency testing program in food microbiology by interlaboratory comparison: analytical methods in use, impact of methods on bacterial counts and measurement uncertainty of bacterial counts. Food Microbiol. 26 (2006) 1-38
10. Beauregard M.R., Mikulak R.J., and Olson B.A. A Practical Guide to Statistical Quality Improvement (1992), Van Nostrand Reinhold, New York
11. Boisen F., Skovgaard N., Ewald S., Olsson G., and Wirtanen G. Quantitation of microorganisms in raw minced meat using the direct epifluorescence filter technique: NMKL Collaborative study. J. AOAC Int. 75 (1992) 465-473
12. BSI, 1991. BS 5763: Methods for the Microbiological Examination of Foods and Feeding Stuffs, Part 13, Enumeration of E. coli: Colony Count Technique Using Membranes, British Standards Institution, London.
13. BSI, 2003. Water Quality-Enumeration of micro-organisms in water samples-Guidance on the estimation of variation of results with particular reference to the contribution of uncertainty of measurement. DD 260:2003, British Standards Institution, London.
14. CCFRA, 2004a. A Code of Practice for Microbiological Laboratories Handling Food, Drink and Associated Samples, Guide no. 9, third edition. Campden and Chorleywood Food Research Association, Chipping Campden, UK.
15. CCFRA. Microbiological measurement uncertainty: a practical guide. In: Jewell K. (Ed). Guideline no. 47 (2004), Campden and Chorleywood Food Research Association, Chipping Campden, UK
16. Carabin H., Gyorkos T.W., Joseph L., Payment P., and Soto J.C. Comparison of methods to analyse imprecise faecal coliform data from environmental samples. Epidemiol. Infect. 126 (2001) 181-190
17. Che Y.H., Yang Z., Li Y., Paul D., and Slavik M. Rapid detection of Salmonella typhimurium using an immunoelectrochemical method coupled with immunomagnetic separation. J. Rapid Methods Automat. Microbiol. 7 (1999) 47-59
18. Cochran W.G. Estimation of bacterial densities by means of the "most probable number". Biometrics 6 (1950) 105-116
19. Codex Alimentarius, 2004. Draft Guidelines on Measurement Uncertainty (at Step 8 of the Codex Procedure).
20. In: Collins C.H., Lyne P.M., Grange J.M., and Falkinham J.O. (Eds). Collins and Lyne's Microbiological Methods. eighth ed (2004), Arnold, Oxford 144-155
21. Colquhoun K.O., Timms S., and Fricker C.R. A simple method for the comparison of commercially available ATP hygiene-monitoring systems. J. Food Prot. 61 (1998) 499-501
22. Corkidi G., Diaz-Uribe R., Folch-Mallol J.L., and Nieto-Sotelo J. COVASIAM: an image analysis method that allows detection of confluent microbial colonies and colonies of various sizes for automatic counting. Appl. Environ. Microbiol. 64 (1998) 1400-1404
23. Corry J.E.L. Quality assessment of culture media by the Miles and Misra method. In: Corry J.E.L. (Ed). Quality Assurance and Quality Control of Microbiological Culture Media (1982), G.I.T. Verlag, Darmstadt 21-37
24. In: Corry J.E.L., Curtis G.D.W., and Baird R.M. (Eds). Culture Media for Food Microbiology. Progress in Industrial Microbiology vol. 34 (1995), Elsevier, Amsterdam
25. Corry, J.E.L., Curtis, G.D.W., Baird, R.M. (Eds.), 2003. Handbook of Culture Media for Food Microbiology. Progress in Industrial Microbiology, second ed., vol. 37. Elsevier, Amsterdam.
26. Dahms S., and Weiss H. Estimation of precision values for microbiological reference methods-standardised pour-plate technique. Milchwissenschaft 53 (1998) 555-559
27. Davey G. Which method? A food microbiologist's nightmare. Food Aust. 53 (2001) 73-75
28. De Boer E., and Beumer R.R. Methodology for detection and typing of food borne microorganisms. Int. J. Food Microbiol. 50 (1999) 119-130
29. De Man J.C. MPN tables corrected. Eur. J. Appl. Microbiol. 17 (1983) 301-305
30. De Smedt J.M. AOAC validation of qualitative and quantitative methods for microbiology in foods. Int. J. Food Microbiol. 45 (1998) 25-28
31. De Smedt J.M., Bolderdijk R.F., Rappold H., and Lautenschlaeger D. Rapid salmonella detection in foods by motility enrichment on a modified semisolid Rappaport-Vassiliadis medium. J. Food Prot. 49 (1986) 510-514
32. Debevere J., and Uyttendale M. Validating detection techniques. In: McMeekin T.A. (Ed). Detecting Pathogens in Food (2003), Woodhead Publishing, Cambridge 69-92
33. Donnison A.M., Ross C.M., and Russell J.M. Quality control of bacterial enumeration. Appl. Environ. Microbiol. 59 (1993) 922-925
34. Dveyrin Z., Ben-David H., and Mates A. Proficiency testing as tool for ISO 17025 implementation in National Public Health Laboratory: a mean for improving efficiency. Accredit. Qual. Assur. 6 (2001) 190-194
35. European Co-operation for Accreditation (EA), 2002. Accreditation for Microbiological Laboratories. Document EA-04/10. 〈http://www.european-accreditation.org/〉.
36. European Co-operation for Accreditation (EA), 2003. EA Guidelines for the Expression of Uncertainty in Quantitative Testing. Document EA-4/16. 〈http://www.european-accreditation.org/〉.
37. EEC. Council Directive 85/397/EEC of 5 August 1985 on health and animal-health problems affecting intra-Community trade in heat-treated milk. O. J. Eur. Comm. L 226 (1985) 13-29 24.08.1985
38. EEC. Council Directive 93/43/EEC of 14 June 1993 on the hygiene of foodstuffs. O. J. Eur. Comm. L 175 (1993) 1-11 19.07.1993
39. EEC. Council Directive 93/99/EEC of 29 October 1993 on the subject of additional measures concerning the official control of foodstuffs. O. J. Eur. Comm. L 290 (1993) 14-17 24.11.93
40. EEC. Commission Regulation2073/2005 of 15 November 2005 on microbiological criteria for foodstuffs. O. J. Eur. Comm. L 338 (2005) 1-26 22.12.05
41. EURACHEM. Quantifying Uncertainty in Analytical Measurement. second ed (2000), Laboratory of the Government Chemist, London
42. Feldsine P., Abeyta C., and Andrews W.H. AOAC international methods committee guidelines for validation of qualitative and quantitative food microbiological official methods of analysis. J. AOAC Int. 85 (2002) 1187-1200
43. Fleet G.H. Microbiological methods-the Australian perspective. Food Control 7 (1996) 41-46
44. Fowler J.L., Clark W.S., Foster J.F., and Hopkins A. Analyst variation in doing the standard plate count as described in Standard Methods for the Examination of Dairy Products. J. Food Prot. 41 (1978) 4-7
45. Fruin J.T., Hill T.M., Clarke J.B., Fowler J.L., and Guthertz L.S. Accuracy and speed in counting agar plates. J. Food Prot. 40 (1977) 596-599
46. Gibson, D.M., Ogden, I.D., 1997. Sampling and statistics. In: Evaluation of Fish Freshness AIR3CT94, Nantes, France, pp. 140-145.
47. Gibson D.M., Coomes P., and Pimbley D.W. Automated conductance method for the detection of salmonella in foods-collaborative study. J. AOAC Int. 75 (1992) 293-302
48. Gill C.O. HACCP in primary processing: red meat. In: Brown M. (Ed). HACCP in the Meat Industry (2001), Woodhead, Cambridge, UK 81-122
49. Glassmoyer K.E., and Russell S.M. Evaluation of a selective broth for detection of Staphylococcus aureus using impedance microbiology. J. Food Prot. 64 (2001) 44-50
50. Havelaar A.H., Heisterkamp S.H., Hoekstra J.A., et al. Performance characteristics of methods for the bacteriological examination of water. Water Sci. Technol. 27 (1993) 1-13
51. Hedges A.J. On the dilution errors involved in estimating bacterial numbers by the plating method. Biometrics 23 (1967) 158-159
52. Hedges A.J. Estimating the precision of serial dilutions and viable bacterial counts. Int. J. Food Microbiol. 76 (2002) 207-214
53. Hedges A.J. Estimating the precision of serial dilutions and colony counts: contribution of laboratory re-calibration of pipettes. Int. J. Food Microbiol. 87 (2003) 181-185
54. Hedges, A.J., Jarvis, B., 2006. Application of robust methods to the analysis of collaborative trial data using bacterial colony counts. J. Microbiol. Methods, in press.
55. Hedges A.J., Shannon R., and Hobbs R.P. Comparison of the precision obtained in counting viable bacteria by the Spiral Plate Maker, the Droplette and the Miles & Misra methods. J. Appl. Bacteriol. 45 (1978) 57-65
56. Hitchins A.D. The International Dairy Federation's procedure for the validation of microbiological analytical methods for dairy foods. Food Control 7 (1996) 13-18
57. Hitchins, A.D., Burney, A.A., 2004. Determination of the limits of detection of AOAC validated qualitative microbiology methods. AOAC International, 118th Annual Meeting Program, Poster Abstract P-1021, p. 153.
58. Holbrook R. Detection of microorganisms in foods-principles of culture methods. In: Lund B.M., Baird-Parker T.C., and Gould G.W. (Eds). The Microbiological Safety and Quality of Food (2000), Aspen Publishers, Maryland 1761-1790
59. Horwitz W. Protocol for the design, conduct and interpretation of method-performance studies. Pure Appl. Chem. 67 (1995) 331-343
60. Horwitz W. The certainty of uncertainty. J. AOAC Int. 86 (2003) 109-111
61. ICMSF. Micro-organisms in Foods 7. Microbiological Testing in Food Safety Management (2002), Kluwer, Amsterdam
62. IDF 161A, 1995. Milk-Quantitative determination of bacteriological quality-guidance on evaluation of routine methods.
63. ILAC, 2000. Guide 13. Guideline for the requirements for competence of providers of proficiency-testing schemes, ILAC-G13: 2000.
64. In't Veld P.H. The use of reference materials in quality assurance programmes in food microbiology laboratories. Int. J. Food Microbiol. 45 (1998) 35-41
65. In't Veld P.H., and De Boer E. Recovery of Listeria monocytogenes on selective agar media in a collaborative study using reference samples. Int. J. Food Microbiol. 13 (1991) 295-300
66. Isenberg H.D., and D'Amato R.F. Does proficiency testing meet its objective?. J. Clin. Microbiol. 34 (1996) 2643-2644
67. ISO. Guide to the Expression of Uncertainty in Measurement (GUM) (1993), ISO, Geneva
68. ISO 5725-3, 1994. Accuracy (trueness and precision) of measurement methods and results: Intermediate measures of the precision of a measurement method, ISO, Geneva.
69. ISO 10272-1, 2006. Microbiology of food and animal feeding stuffs-Horizontal method for detection and enumeration of Campylobacter spp. -Part 1 detection method. ISO, Geneva.
70. ISO 11290-1, 1996. Microbiology of food and animal feeding stuffs-horizontal method for the detection and enumeration of Listeria monocytogenes: Part 1. Detection method, ISO, Geneva.
71. ISO 13530, 1997. Water Quality-Guide to Analytical Quality Control for Water Analysis, ISO, Geneva.
72. ISO 11290-2, 1998. Microbiology of food and animal feeding stuffs-horizontal method for the detection and enumeration of Listeria monocytogenes: Part 2. Enumeration method, ISO, Geneva.
73. ISO 5725-5, 1998. Accuracy (trueness and precision) of measurement methods and results-alternative methods for the determination of the precision of a standard measurement method, ISO, Geneva.
74. ISO 6887-1, 1999. Microbiology of food and animal feeding stuffs-preparation of test samples, initial suspension and decimal dilutions for microbiological examination. Part I: general rules for the preparation of the initial suspension and decimal dilutions, ISO, Geneva.
75. ISO 9308-1, 2000. Water quality-detection and enumeration of E. coli and coliform bacteria-Part 1: membrane filtration method, ISO, Geneva.
76. ISO 11133-1, 2000. Microbiology of food and animal feeding stuffs-guidelines on quality assurance and performance testing of culture media-Part 1: General guidelines on quality assurance of culture media in the laboratory, ISO, Geneva.
77. ISO 16649-1, 2001. Microbiology of food and animal feeding stuffs-horizontal method for the enumeration of β-glucuronidase-positive E. coli-Part I. Colony-count technique at 44 °C using membranes and 5-bromo-4-chlor-3-indolyl-β-d-glucuronide, ISO, Geneva.
78. ISO 16649-2, 2001. Microbiology of food and animal feeding stuffs-horizontal method for the enumeration of β-glucuronidase-positive E. coli-Part 2. Colony-count technique at 44 °C using 5-bromo-4-chloro-3-indolyl-β-d-glucuronide, ISO, Geneva.
79. ISO 6579, 2002. Microbiology of food and animal feeding stuffs-horizontal method for the detection of Salmonella spp., ISO, Geneva.
80. ISO 4833, 2003. Microbiology of food and animal feeding stuffs-horizontal method for the enumeration of micro-organisms-colony-count technique at 30 °C, ISO, Geneva.
81. ISO 16140, 2003. Microbiology of food and animal feeding stuffs-protocol for the validation of alternative methods, ISO, Geneva.
82. ISO 7937, 2004. Microbiology of food and animal feeding stuffs-horizontal method for the enumeration of Clostridium perfringens-colony-count technique, ISO, Geneva.
83. ISO 14461-1, 2005. Milk and milk products-quality control in the microbiology laboratory-Part 1: Analyst performance assessment for colony counts, ISO, Geneva.
84. ISO 14461-2, 2005. Milk and milk products-quality control in the microbiology laboratory-Part 2: Determination of the reliability of colony counts of parallel plates and subsequent dilution steps, ISO, Geneva.
85. ISO 7521, 2005. Microbiology of food and animal feeding stuffs-horizontal method for the detection and enumeration of presumptive E. coli-most probable number technique, ISO, Geneva.
86. ISO 8199, 2005. Water quality-general guidance on the enumeration of micro-organisms by culture, ISO, Geneva.
87. ISO 19036, 2005. Microbiology of food and animal feeding stuffs-guide on measurement of uncertainty for quantitative determinations, ISO, Geneva.
88. ISO/TS 21748, 2002. Guide to the use of repeatability, reproducibility and trueness estimates in measurement uncertainty estimation dilution steps, ISO, Geneva.
89. ISO/IEC Guide 43, 1997. Part 1. Proficiency testing by inter-laboratory comparison-development and operation of proficiency-testing schemes. Part 2: Selection and use of proficiency-testing schemes by laboratory accreditation bodies, ISO, Geneva.
90. ISO/IEC 17025, 1999. General requirements for the competence of testing and calibration laboratories, ISO, Geneva (revised 2005).
91. ISO/TR 13843, 2000. Water quality-guidance on validation of microbiological methods, ISO, Geneva.
92. ISO/TS 11133-2, 2003. Microbiology of food and animal feeding stuffs-guidelines on preparation and production of culture media-Part 2: Practical guidelines on performance testing of culture media, ISO, Geneva.
93. IUPAC. Protocol for the design, conduct and interpretation of collaborative studies. Prepared by Horwitz, W. Pure Appl. Chem. 60 (1988) 855-864
94. IUPAC/ISO/AOAC. International harmonised protocol for proficiency testing of (chemical) analytical laboratories, Protocol for proficiency testing. Prepared by Thompson, M. and Wood, R. J. AOAC Int. 76 (1993) 926-940
95. IUPAC. Protocol for the design, conduct and interpretation of method performance studies. Prepared by Horwitz, W. Pure Appl. Chem. 67 (1995) 331-343
96. Jackson G.J., and Wachsmuth I.K. The US Food and Drug Administration's selection and validation of tests for foodborne microbes and microbial toxins. Food Control 7 (1996) 37-39
97. Jarvis B. A chemical method for the estimation of mould in tomato products. J. Food Technol. 12 (1977) 581-591
98. Jarvis B. Statistical Aspects of the Microbiological Analysis of Foods. Progress in Industrial Microbiology vol. 21 (1989), Elsevier, Amsterdam
99. Jarvis, B., Corry, J.E.L., Hedges, A., 2005. Simple statistical procedures to estimate intermediate reproducibility based on microbiological quality assessment and routine analysis of food samples. AOAC International, 119th Annual Meeting Programme Abstract No. 1402, pp. 172-173.
100. Jarvis, B., Hedges, A., Corry, J.E.L., 2004. Microbiological uncertainty: estimates of uncertainty obtained from colony count data submitted for proficiency assessment schemes, data derived for internal laboratory quality monitoring and during routine enforcement examination of foods. In: Proceedings of the SfAM Conference on Dairy & Food Microbiology: Challenges and opportunities, Cork, July 2004 (Abstract No. P69).
101. Jewell K. Microbiological proficiency testing: a personal perspective. Accredit. Qual. Assur. 6 (2001) 154-159
102. Kolari M., Mannonen S., Takala T., Saris P., Suovaniemi, and Salkinoja-Salonen M.S. The effect of filters on aseptic pipetting lifetime of mechanical and electronic pipettors and carryover during pipetting. Lett. Appl. Microbiol. 29 (1999) 123-129
103. Kramer J.M., and Gilbert R.J. Enumeration of micro-organisms in food: a comparative study of five methods. J. Hyg. 81 (1978) 151-159
104. Lahellec C. Development of standard methods with special reference to Europe. Int. J. Food Microbiol. 45 (1998) 13-16
105. Langton S.D., Chevennement R., Nagelkerke N., and Lombard B. Analysing collaborative trials for qualitative microbiological methods: accordance and concordance. Int. J. Food Microbiol. 79 (2002) 175-181
106. Leclercq A., Lombard B., and Mossel D.A.A. Revue bibliographique. Normaliser les methodes d'analyse dans le cadre de la securite microbiologique francaise des aliments: atout ou contrainte. Sci. Aliments 20 (2000) 179-202
107. Lee R.J., and Cole S.R. Internal quality control samples for water bacteriology. J. Appl. Bacteriol. 76 (1994) 270-274
108. Leuschner R.G.K., Bew J., Simpson P., Ross P.R., and Stanton C. A collaborative study of a method for the enumeration of probiotic bifidobacteria in animal feed. Int. J. Food Microbiol. 83 (2003) 161-170
109. In: Lightfoot N.F., and Maier E.A. (Eds). Microbiological Analysis of Food and Water. Guidelines for Quality Assurance (1998), Elsevier, Amsterdam
110. Lightfoot N.F., Tillett H.E., Boyd P., and Eaton S. Duplicate split samples for internal quality-control in routine water microbiology. Lett. Appl. Microbiol. 19 (1994) 321-324
111. Lightfoot N.F., Richardson I.R., and Harford J.P. The use of Lenticules for the process control of enumeration techniques in food and environmental microbiology. J. Appl. Microbiol. 91 (2001) 660-667
112. Lombard B., Gomy C., and Catteau M. Microbiological analysis of foods in France: standardized methods and validated methods. Food Control 7 (1996) 5-11
113. Mackey B.M. Injured bacteria. In: Lund B.M., Baird-Parker T.C., and Gould G.W. (Eds). The Microbiological Safety and Quality of Food (2000), Aspen Publishers, Inc, Maryland 315-335
114. Made D., Petersen R., Trumper K., Stark R., and Grohmann L. In-house validation of a real-time PCR method for rapid detection of Salmonella spp. in food products. Eur. Food Res. Technol. 219 (2004) 171-177
115. Marotz J., Lubbert C., and Eisenbeiss W. Effective light recognition for automated counting of colonies in Petri dishes (automated colony-counting). Comput. Methods Prog. Biomed. 66 (2001) 183-198
116. MIKES (Centre for Metrology and Accreditation), 2002. Uncertainty of Quantitative Determinations Derived by Cultivation of Microorganisms. Advisory Commission for Metrology, Chemistry Section, Expert Group for Microbiology, Publication J3/2002, Helsinki, Finland.
117. Mossel D.A.A., and Corry J.E.L. Detection and enumeration of sublethally injured pathogenic and index bacteria in foods and water processed for safety. Alimenta 16 (1977) 19-34 (special issue on Microbiology)
118. Mossel D.A.A., Corry J.E.L., Struijk C.B., and Baird R.M. Essentials of the Microbiology of Foods (1995), Wiley, Chichester
119. Müller A., and Hildebrandt G. Sampling errors and systematic errors in bacterial count determination. The accuracy of colony-counting. A survey of the literature. Flieschwirtschaft 70 (1990) 680-684
120. Niemelä S.I. A semi-empirical precision control criterion for duplicate microbial colony counts. Lett. Appl. Microbiol. 22 (1996) 315-319
121. Niemelä, S.I., 2002. Uncertainty of quantitative determinations derived by cultivation of microorganisms, second ed. Centre for Metrology and Accreditation, Advisory Commission for Metrology, Chemistry Section, Expert Group for Microbiology, Publication J3/2002, Helsinki, Finland.
122. Niemi R.M., and Niemelä S.I. Measurement uncertainty in microbiological cultivation methods. Accredit. Qual. Assur. 6 (2001) 372-375
123. NMKL, 1994. Quality Assurance Guidelines-for microbiological laboratories, second ed., Report no. 5, Nordic Committee on Food Analysis, Oslo, Norway.
124. NMKL, 1999. Procedure No. 8, Measurement of Uncertainty in Microbiological Examination of Foods, Nordic Committee on Food Analysis, Oslo, Norway.
125. Novicki T.J., Daly J.A., Mottice S.L., and Carroll K.C. Comparison of sorbitol MacConkey agar and a two-step method which utilizes enzyme-linked immunosorbent assay toxin testing and a chromogenic agar to detect and isolate enterohemorrhagic E. coli. J. Clin. Microbiol. 38 (2000) 547-551
126. Ogden I.D., Brown G.C., Gallacher S., Garthwaite P.H., Gennari M., Gonzalez M.P., Jørgensen L.B., Lunestad B.T., MacRae M., Nunes M.C., Peterson A.C., Rosnes J.T., and Vliegenthart J. An interlaboratory study to find an alternative to the MPN technique for enumerating E. coli in shellfish. Int. J. Food Microbiol. 40 (1998) 57-64
127. Olsen J.E. DNA-based methods for detection of food-borne bacterial pathogens. Food Res. Int. 33 (2000) 257-266
128. Örnemark U., Boley N., Saeed K., van Berkel P.M., Schmidt R., Noble M., Mäkinen I., Keinänen M., Uldall A., Steensland H., Van der Veen A., Tholen D.W., Golze M., Christensen J.M., De Bièvre P., and De Leer W.B. Proficiency testing in analytical chemistry, microbiology, and laboratory medicine-working group discussions on current status, problems, and future directions. Accredit. Qual. Assur. 6 (2001) 140-146
129. Oscroft, C.A., Corry, J.E.L. (Eds.), 1991. Guidelines for the Preparation, Storage and Handling of Microbiological Culture Media. Campden Food and Drink Research Association Technical Manual no. 33.
130. Peeler J.T., Leslie J.E., Danielson J.W., and Messer J.W. Replicate counting errors by analysts and bacterial colony counters. J. Food Prot. 45 (1982) 238-240
131. Perez F.G., Mascini M., Tothil I.E., and Turner A.P.F. Immunomagnetic separation with mediated flow injection analysis amperometric detection of viable E. coli O157. Anal. Chem. 70 (1998) 2380-2386
132. Peterz M.E.G. Temperature in agar plates and its influence on the results of quantitative microbiological food analyses. Int. J. Food Microbiol. 14 (1991) 59-66
133. Peterz M. Laboratory performance in a food microbiology proficiency testing scheme. J. Appl. Bacteriol. 73 (1992) 210-216
134. Peterz M., and Norberg P. Freeze-dried mixed cultures as samples for proficiency tests and collaborative studies in food microbiology. J. AOAC Int. 66 (1983) 1510-1513
135. Peterz M., and Norberg P. A split-sample study of microbiological food laboratories used freeze-dried mixed cultures. Int. J. Food Microbiol. 3 (1986) 161-166
136. Peterz M., and Steneryd A.C. Freeze-dried mixed cultures as reference samples in quantitative and qualitative microbiological examinations of food. J. Appl. Bacteriol. 74 (1993) 143-148
137. PHLS, 1998. PHLS Guidance Note-Uncertainty of Measurement in Testing. Q. SOP4 Issue no. 2, 01.07.1998, Technical Services, H.Q., London.
138. Piton C., and Grappin R. A model for statistical evaluation of precison parameters of microbiological methods: application to dry rehydratable film methods and IDF reference methods for enumeration of total aerobic mesophilic flora and coliforms in raw milk. J. AOAC Int. 74 (1991) 92-103
139. Rattanasomboon N., Bellara S.R., Harding C.L., Fryer P.J., Thomas C.R., Al-Rubeai M., and McFarlane C.M. Growth and enumeration of the meat spoilage bacterium Brochothrix thermosphacta. Int. J. Food Microbiol. 51 (1999) 145-158
140. Reichmuth J., and Suhren G. Considerations concerning the evaluation of routine methods for assessing the bacteriological quality of raw milk. Kieler Milchwirtschaft. Forschung. 48 (1996) 175-185
141. Rentenaar I.M.F. MicroVal, a challenging Eureka project. Food Control 7 (1996) 31-36
142. In: Roberts D., and Greenwood M. (Eds). Practical Food Microbiology. third ed (2003), Blackwell Publishing, Oxford
143. Salkin I.F., Limberger R.J., and Stasik D. Commentary on the objectives and efficacy of proficiency testing in microbiology. J. Clin. Microbiol. 35 (1997) 1921-1923
144. Salo S., Laine A., Alanko T., Sjober A., and Wirtanen G. Validation of the microbiological methods Hygicult dipslide contact plate and swabbing in surface hygiene control: a Nordic collaborative study. J. AOAC Int. 83 (2000) 1357-1365
145. Standing Committee of Analysts (SCA). The Microbiology of Drinking Water (2002), Environment Agency, Nottingham. 〈www.environment-agency.gov.uk/science〉
146. Schulten S.M., in't Veld P.H., Nagalkerke N.J.D., Scotter S., de Buyser M.L., Rollier P., and Lahellec C. Evaluation of the ISO 7932 standard for the enumeration of Bacillus cereus in foods. Int. J. Food Microbiol. 57 (2000) 53-61
147. Scotter S., and Wood R. Validation and acceptance of modern methods for the microbiological analysis of foods in the UK. Food Control 7 (1996) 47-51
148. Scotter S., Aldridge M., Back J., and Wood R. Validation of European Community methods for microbiological and chemical analysis of raw and heat-treated milk. J. Ass. Pub. Anal. 29 (1993) 1-32
149. Scotter S.L. Proficiency testing in food microbiology, MAFF Central Science Laboratory 'Quality assessment scheme'. Food Sci. Technol. Today 10 (1996) 227-228
150. Scotter S.L., Langton S., Lombard B., Lahellec C., Schulten S., Nagelkerke N., in't Veld P.H., and Rollier P. Validation of ISO method 11290 Part 1. Detection of Listeria monocytogenes in foods. Int. J. Food Microbiol. 64 (2000) 294-306
151. Scotter S.L., Langton S., Lombard B., Lahellec C., Schulten S., Nagelkerke N., in't Veld P.H., and Rollier P. Validation of ISO method 11290 Part 2. Enumeration of Listeria monocytogenes in foods. Int. J. Food Microbiol. 70 (2001) 121-129
152. Silliker J.H., Gabis D.A., and May A. ICMSF Methods Studies. XI. Collaborative/comparative studies on determination of coliforms using the most probable number procedure. J. Food Prot. 42 (1979) 638-644
153. Snell J.J.S. The UK national external quality assessment scheme for microbiology. PHLS Microbiol. Dig. 8 (1991) 46-48
154. Sowers E.G., Wells J.G., and Strockbine N.A. Evaluation of commercial latex reagents for identification of O157 and H7 antigens of E. coli. J. Clin. Microbiol. 34 (1996) 1286-1289
155. Stephens P.J., and Mackey B.M. Recovery of stressed microorganisms. In: Corry J.E.L., Curtis G.D.W., and Baird R.M. (Eds). Handbook of Culture Media for Food Microbiology. Progress in Industrial Microbiology vol. 37 (2003) 25-48
156. Stephens P.J., Druggan P., and Nebe-von Caron G. Stressed Salmonella are exposed to reactive oxygen species from two independent sources during recovery in conventional culture media. Int. J. Food Microbiol. 60 (2000) 269-285
157. Suhren G., and Reichmuth J. Interpretation of quantitative microbiological results. Milchwissenschaft 55 1 (2000) 18-22
158. Swaroop S. The range of variation of most probable number of organisms estimated by the dilution method. Indian J. Med. Res. 39 (1951) 107-134
159. Tillett H.E., and Crone P.B. Quality control of the isolation rate of pathogens in medical microbiology laboratories. J. Hyg. 77 (1976) 359-367
160. Tillett H.E., and Lightfoot N.F. Preliminary statistical assessment of UK water-quality control trials. Water Sci. Technol. 24 2 (1991) 57-60
161. Tillett H.E., Lightfoot N.F., and Eaton S. External quality assessment in water microbiology: statistical analysis of performance. J. Appl. Bacteriol. 74 (1993) 497-502
162. Tillett H.E., Lightfoot N.F., Eaton S., and Place B.M. External quality assessment of microbial counts from water: to score or not to score for proficiency. J. Chart Inst. Water Environ. Manage. 14 (2000) 304-308
163. Tillett H.E., and Lightfoot N.F. Quality control in environmental microbiology compared with chemistry: what is homogeneous and what is random?. Water Sci. Technol. 31 (1995) 471-477
164. UKAS, 1997. M3003 The expression of uncertainty and confidence in measurement, 76pp.
165. UKAS, 2000. The Expression of Uncertainty in Testing, Edition 1, UKAS Publication ref: LAB 12.
166. van der Voet H., and van Raamsdonk L.W.D. Estimation of accordance and concordance in inter-laboratory trials of analytical methods with qualitative results. Int. J. Food Microbiol. 95 (2004) 231-234
167. van der Zee H., and Huis in't Velt J.H.J. Rapid and alternative screening methods for microbiological analysis. J. AOAC Int. 80 (1997) 934-940
168. Vesey, G., 2005. Precise reference materials for microbiology. 119th AOAC International Annual Meeting, Orlando, September 2005. Symposium on Microbiological Reference Materials, Abstract S802.
169. Vivegnis J., Oger R., and Decallonne J. Microbiologie alimentaire; évaluation de la précision d'essais d'aptitude sur un aliment frais réfrigéré contaminé naturellement. Sci. Aliments 17 (1997) 641-654
170. Voysey, P.A., Jewell, K., 1999. Uncertainty associated with microbiological measurement, Project no. 29732, Campden and Chorleywood Food Research Association Review no. 15, CCFRA, Chipping Campden, UK.
171. Westwood N., and Hodgkinson P. Variable recovery of heat damaged E. coli in stacked plastic dishes. J. Appl. Bacteriol. 42 (1977) 145-148
172. Wilson I.G. Use of the IUL Countermat automatic colony counter for spiral plated total viable counts. Appl. Environ. Microbiol. 61 (1995) 3158-3160
173. Woodward R.L. How probable is the most probable number?. J. Am. Waterworks Assoc. 49 (1957) 1060-1068
174. Youden W.J., and Steiner E.H. Statistical Manual of the Association of Official Analytical Chemists (1975), AOAC International, Washington, DC