Quality performance metrics in multivariate classification methods for qualitative analysis

TrAC - Trends in Analytical Chemistry

Volumn 80, Issue , 2016, Pages 612-624

  Cuadros Rodríguez, Luis ^a   Pérez Castaño, Estefanía ^a   Ruiz Samblás, Cristina ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Classification quality performance metrics; Classification scenario; Contingency chart; Multivariate classification methods; Qualitative analytical chemistry

Indexed keywords

CHEMICAL ANALYSIS;

ANALYTICAL PROBLEMS; CLASSIFICATION METHODS; CLASSIFICATION PROCESS; CLASSIFICATION QUALITY; CONTINGENCY CHART; MULTIVARIATE CLASSIFICATION; QUALITATIVE ANALYSIS; QUALITY PERFORMANCE;

QUALITY CONTROL;

ANALYTIC METHOD; AREA UNDER THE CURVE; CALIBRATION; CORRELATION COEFFICIENT; MEASUREMENT ACCURACY; MEASUREMENT PRECISION; PERFORMANCE MEASUREMENT SYSTEM; PREDICTIVE VALUE; PRIORITY JOURNAL; QUALITATIVE ANALYSIS; QUALITY CONTROL; RECEIVER OPERATING CHARACTERISTIC; REVIEW; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY;

EID: 84965158570     PISSN: 01659936     EISSN: 18793142     Source Type: Journal    
DOI: 10.1016/j.trac.2016.04.021     Document Type: Review

References (59)

1. Valcárcel M., Cárdenas S., Gallego M. Qualitative analysis revisited. Crit. Rev. Anal. Chem 2000, 30:345-361.
2. Trullols E., Ruisánchez I., Rius F.X. Validation of qualitative analytical methods. Trends Anal. Chem 2004, 23:137-145.
3. de Brabander H.F., Batjoens P., de Wasch K., Courtheyn D., Pottie G., Smets F. Qualitative or quantitative methods for residue analysis?. Trends Anal. Chem 1997, 16:485-489.
4. Muñoz-Olivas R. Screening analysis: an overview of methods applied to environmental, clinical and food analyses. Trends Anal. Chem 2004, 23:203-216.
5. Simonet B.M., Ríos A., Valcárcel M. Unreliability of screening methods. Anal. Chim. Acta 2004, 516:67-74.
6. Ellison S.L.R., Gregory S., Hardcastle W.A. Quantifying uncertainty in qualitative analysis. Analyst 1998, 123:1155-1161.
7. Pulido A., Ruisánchez I., Boqué R., Rius F.X. Estimating the uncertainty of binary test results to assess their compliance with regulatory limits. Anal. Chim. Acta 2002, 455:267-275.
8. Pulido A., Ruisánchez I., Boqué R., Rius F.X. Uncertainty of results in qualitative analysis. Trends Anal. Chem 2003, 22:647-654.
9. Milman B.L., Konopel'ko L.A. Uncertainty of Qualitative chemical analysis: General methodology and binary test methods. J. Anal. Chem 2004, 23:1128-1141.
10. Valcárcel M., Cárdenas S. Vanguard-reaguard analytical strategies. Trends Anal. Chem 2005, 24:67-74.
11. Valcárcel M., Cárdenas S. Editorial. Trends Anal. Chem 2005, 24:467.
12. Valcárcel M., Cárdenas S., Barceló D., Buydens L., Heydorn K., Karleberg B., et al. Metrology of qualitative chemical analysis (Project Ref.: G6MA-CT-2000-01012) 2002, Report EUR 20605. Office for Official Publication of the European Communities, Luxembourg.
13. Ríos A., Barceló D., Buydens L., Cárdenas S., Heydorn K., Karlberg B., et al. Quality assurance of qualitative analysis in the framework of the European project 'MEQUALAN'. Accred. Qual. Assur 2003, 8:68-77.
14. CORDIS Impact of qualitative chemical analysis in the VI European Framework Programme: networking with newly associated states (IQUALAN-NAS) (Project Ref.: G6MA-CT-2002-04043) Permalink, accessed 03.05.16. http://cordis.europa.eu/project/rcn/69714_en.html.
15. EURACHEM/CITAC Guide Expression of uncertainty in qualitative testing. (Ref.: LGC/VAM/2003/048) 2003, Committee Draft.
16. ISPAM ISPAM guidelines for validation of qualitative binary chemistry methods 2013, Apendix N, AOAC Official Methods of Analysis, AOAC International.
17. Macarthur R., von Holst C. A protocol for the validation of qualitative methods of detection. Anal. Methods 2012, 4:2744-2754. (NOTE: This paper presents the results of the IUPAC Project No. 2005-024-2-600: Establishment of guidelines for the validation of qualitative and semi-quantitative (screening) methods by collaborative trial: a harmonized protocol).
18. EURACHEM Guide The Fitness for Purpose of Analytical Methods. A Laboratory Guide to Method Validation and Related Topics 2014, 2nd ed.
19. EP12-A2 User Protocol for Evaluation of Qualitative Test Performance 2010, Clinical and Laboratory Standards Institute (CLSI). 2nd ed.
20. Mattocks C.J., Morris M.A., Matthijs G., Swinnen E., Corveleyn A., Dequeker E., et al. A standardized framework for the validation and verification of clinical molecular genetic test. Eur. J. Hum. Genet 2010, 18:1276-1288.
21. CRLs Guidelines for the validation of screening methods for residues of veterinary medicines (initial validation and transfer) 2010, Community Reference Laboratories Residues (CRLs).
22. World Organisation for Animal Health (OIE) Principles and methods of validation of diagnostic assays for infectious diseases 2013, OIE Terrestrial Manual, 1-17.
23. Milman B.L. Chemical Identification and its Quality Assurance 2011, Springer-Verlag, Berlin Heidelberg.
24. López M.I., Callao M.P., Ruisánchez I. A tutorial on the validation of qualitative methods: From the univariate to multivariate approach. Anal. Chim. Acta 2015, 891:62-72.
25. Valcárcel M. Principles of Analytical Chemistry 2000, Springer-Verlag, Berlin Heidelberg.
26. European Commission Decision 2002/657/EC implementing Council Directive 96/23/EC concerning the performance of analytical methods and the interpretation of results. Off. J. Eur. Commun 2002, L221/8-L221/36.
27. Lendl B., Karlberg B. Advancing from unsupervised, single variable-based to supervised, multivariate-based methods: a challenge for qualitative analysis. Trends Anal. Chem 2005, 24:488-492.
28. Valcárcel M., Cárdenas S., Simonet B.M., Carrillo Carrión C. Principles of qualitative analysis in the chromatographic context. J. Chromatogr. A 2007, 1158:234-240.
29. Cuadros Rodríguez L., Gámiz Gracia L., Carrasco Pancorbo A., Ruíz Samblás C. Glosario de Términos Analíticos/Glossary of Analytical Terms (spanish/english bilingual edition) GRASEQA (Grupo Regional Andaluz de la Sociedad Española de Química Analítica); Downloadable from:, accessed 03.05.16. http://www.seqa.es/SEQA2013/Glosario_archivo_final.pdf.
30. Cuadros Rodríguez L., Ruiz-Samblás C., Valverde-Som L., Pérez-Castaño E., Gonzalez-Casado A. Chromatographic fingerprinting: an innovative approach for food "identitation" and food authentication. Anal. Chim. Acta 2016, 909:9-23.
31. Kjeldahl K., Bro R. Some common misunderstandings in chemometrics. J. Chemom 2010, 24:558-564.
32. European commission decision 2009/886/CE amending decision 2002/364/EC on common technical specifications for in vitro diagnostic medical devices. Off. J. Eur. Union 2009, L318/25-L318/40.
33. Lavine B.K., Rayens W.S. Classification: basic concepts. Comprehensive Chemometrics: Chemical and Biochemical Data Analysis. Vol. 3: Linear Regression Modeling. Non-Linear Regression Modeling. Classification. Feature Selection. Multivariate Robust Techniques 2009, 507-515. Elsevier, New York. S.D. Brown, R. Rauler, B. Walczak (Eds.).
34. Ballabio D., Todeschini R. Multivariate classification for qualitative analysis. Infrared Spectroscopy for Food Quality Analysis and Control 2009, 83-104. Academic Press/Elsevier, Burlington, MA. D.-W. Sun (Ed.).
35. Danzer K., Staden J.F.V. Concepts and applications of the term "dimensionality" in analytical chemistry, IUPAC technical report. Pure Appl. Chem 2002, 74:1479-1487.
36. Booksh K.S., Kowalski B.R. Theory of analytical chemistry. Anal. Chem 1994, 66:782A-791A.
37. Ballabio D., Consonni V. Classification tools in chemistry. Part 1: linear models. PLS-DA. Anal. Meth 2013, 5:3790-3798.
38. Forina M., Oliveri P., Lanteri S., Casale M. Class-modeling techniques, classic and new, for old and new problems. Chemom. Intell. Lab. Syst 2008, 93:132-148.
39. Bevilacqua M., Nescatelli R., Bucci R., Magrì A.D., Magrì A.L., Marini F. Chemometric classification techniques as a tool for solving problems in analytical chemistry. J. AOAC Int 2014, 97:19-28.
40. Pérez Castaño E., Ruiz Samblás C., Medina Rodríguez S., Quirós Rodriguez V., Jiménez Carvelo A.M., Valverde Som L., et al. Comparison of different analytical classification scenarios: application for the geographical origin of edible palm oil by sterolic (NP)HPLC fingerprinting. Anal. Meth 2015, 7:4192-4201.
41. Trullols E., Ruisánchez I., Rius F.X., Huguet J. Validation of qualitative methods of analysis that use control samples. Trends Anal. Chem 2005, 24(6):516-524.
42. López M.I., Colomer N., Ruisánchez I., Callao M.P. Validation of multivariate screening methodology. Case study: detection of food fraud. Anal. Chim. Acta 2014, 827:28-33.
43. Bramer M. Principles of Data Mining 2013, Springer-Verlag, London. 2nd ed.
44. Xu L., Yan S.-M., Cai C.-B., Yu Y.-P. One-class partial least squares (OCPLS) classifier. Chemometr. Intell. Lab 2013, 126:1-5.
45. Khan S.S., Madden M.G. A survey of recent trends in one class classification 2010, Proceeding AICS'09 Proceedings of the 20th Irish conference on artificial intelligence and cognitive science, 188-197.
46. Xu L., Ye Z.-H., Yan S.-M., Shi P.-T., Cui H.-F., Fu X.-S., et al. Combining local wavelength information and ensemble learning to enhance the specificity of class modeling techniques: Identification of food geographical origins and adulteration. Anal. Chim. Acta 2012, 754:31-38.
47. López M.I., Trullos E., Callao M.P., Ruisánchez I. Multivariate screening in food adulteration: Untargeted versus targeted modelling. Food Chem 2014, 147:177-181.
48. Sokolova M., Lapalme G. A systematic analysis of performance measures for classification tasks. Inform. Process. Manag 2009, 45:427-437.
49. Powers D.M.W. Evaluation: from precision, recall and F-measure to ROC, informedness, markedness & correlation. J. Mach. Learn. Tech 2011, 2:37-63.
50. Bekkar M., Djemaa H.K., Alitouche T.A. Evaluation measures for models assessment over imbalanced data sets. J. Inf. Eng. Appl 2013, 3:27-38.
51. Quality Measures in Data Mining 2007, Springer-Verlag Berlin Heidelberg. F. Guillet, H.J. Hamilton (Eds.).
52. Brereton R.G. Chemometrics for Pattern Recognition 2009, John Wiley and Sons, Chichester.
53. Japkowicz N., Shah M. Evaluating Learning Algorithms - A Classification Perspective 2011, Cambridge University Press, New York.
54. Labatut V., Cherifi H. Evaluation of performance measures for classifiers comparison Downloadable from:, accessed 30.01.15. http://arxiv.org/pdf/1112.4133v1.
55. Fawcett T. An introduction to ROC analysis. Pattern Recogn. Lett 2006, 27:861-874.
56. Kohl M. Performance measures in binary classification. Int. J. Statis. Med. Res 2012, 1:79-81.
57. Kuhn M., Johnson K. Applied Predictive Modelling 2013, 247-273. ch. 11, Springer-Verlag, New York.
58. Oliveri P., Downey G. Multivariate class modeling for the verification of food-authenticity claims. Trends Anal. Chem 2012, 35:74-86.
59. Gwet K.L. Handbook of Inter-rater Reliability 2012, 15-46. ch. 2, Advance Analytics LLC, Gaithersburg. 3rd ed.