Performance analysis for machine-learning experiments using small data sets

Computers and Electronics in Agriculture

Volumn 38, Issue 1, 2003, Pages 1-17

  Pietersma, Diederik ^a   Lacroix, René ^a   Lefebvre, Daniel ^b   Wade, Kevin M ^a  

^a MCGILL UNIVERSITY   (Canada)

^b Programme d'Analyse des T L du Q   (Canada)

Author keywords

Algorithm configuration; Analysis of variance; Data preprocessing; Decision tree induction; Machine learning; ROC curves

Indexed keywords

AGRICULTURE; ALGORITHMS; DATA PROCESSING; GRAPHIC METHODS; NEURAL NETWORKS; NUTRITION; PERFORMANCE;

DATA SETS;

LEARNING SYSTEMS;

MACHINERY;

AGRICULTURE; DATA PROCESSING; GRAPHIC METHODS; NEURAL NETWORKS; NUTRITION; PERFORMANCE EVALUATION;

EID: 0037243907     PISSN: 01681699     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0168-1699(02)00104-7     Document Type: Article

References (27)

1. Bradley, A.P., 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30, 1145-1159.
2. Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J., 1984. Classification and Regression Trees. Wadsworth, Pacific Grove, CA.
3. Cohen, P.R., 1995. Empirical Methods for Artificial Intelligence. MIT Press, Cambridge, MA.
4. Dietterich, T.G., 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10, 1895-1923.
5. Hand, D.J., 1997. Construction and Assessment of Classification Rules. Wiley, Chichester, UK.
6. Henery, R.J., 1994. Methods for comparison. In: Michie, D., Spiegelhalter, D.J., Taylor, C.C. (Eds.), Machine Learning, Neural and Statistical Classification. Ellis Horwood, Hemel Hempstead, UK, pp. 107-124.
7. Jayas, D.S., Paliwal, J., Visen, N.S., 2000. Multi-layer neural networks for image analysis of agricultural products. J. Agric. Eng. Res. 77, 119-128.
8. Kim, T., Heald, C.W., 1999. Inducing inference rules for the classification of bovine mastitis. Comput. Electron. Agric. 23, 27-42.
9. Kubat, M., Holte, R.C., Matwin, S., 1998. Machine learning for the detection of oil spills in satellite radar images. Mach. Learn. 30, 195-215.
10. Lacroix, R., Wade, K.M., Kok, R., Hayes, J.F., 1995. Prediction of cow performance with a connectionist model. Trans. ASAE 38, 1573-1579.
11. Langley, P., Simon, H.A., 1995. Applications of machine learning and rule induction. Commun. ACM 38 (11), 55-64.
12. Littell, R.C., Milliken, G.A., Stroup, W.W., Wolfinger, R.D., 1996. SAS system for mixed models. SAS Institute Inc., Cary, NC.
13. McQueen, R.J., Garner, S.R., Nevill-Manning, C.G., Witten, I.H., 1995. Applying machine learning to agricultural data. Comput. Electron. Agric. 12, 275-293.
14. Mitchell, R.S., Sherlock, R.A., Smith, L.A., 1996. An investigation into the use of machine learning for determining oestrus in cows. Comput. Electron. Agric. 15, 195-213.
15. Mitchell, T.M., 1997. Machine learning. McGraw-Hill, New York.
16. Pietersma, D., Lacroix, R., Lefebvre, D., Block, E., Wade, K.M., 2001. A case-acquisition and decision-support system for the analysis of group-average lactation curves. J. Dairy Sci. 84, 730-739.
17. Pietersma, D., Lacroix, R., Lefebvre, D., Wade, K.M., 2002. Induction and evaluation of decision trees for lactation curve analysis. Comput. Electron. Agric. 38, 19-32.
18. Provost, F., Fawcett, T., Kohavi, R., 1998. The case against accuracy estimation for comparing induction algorithms. In: Shavlik, J. (Ed.), Proceeding of 15th International Conference Machine Learning, July 24-27, Madison, WI. Morgan Kaufmann, San Francisco, CA, pp. 445-453.
19. Salehi, F., Lacroix, R., Wade, K.M., 2000. Development of neuro-fuzzifiers for qualitative analyses of milk yield. Comput. Electron. Agric. 28, 171-186.
20. Schultz, A., Wieland, R., Lutze, G., 2000. Neural networks in agroecological modelling-stylish application or helpful tool? Comput. Electron. Agric. 29, 73-97.
21. Steel, R.G.D., Torrie, J.H., 1980. Principles and procedures of statistics: a biometrical approach, second ed., McGraw-Hill, New York.
22. Steinberg, D., Colla, P., 1997. CART-Classification and Regression Trees. Salford Systems, San Diego, CA.
23. Swets, J.A., 1988. Measuring the accuracy of diagnostic systems. Science 240, 1285-1293.
24. Verdenius, F., Timmermans, A.J.M., Schouten, R.E., 1997. Process models for neural network applications in agriculture. AI Appl. 11 (3), 31-45.
25. Weiss, S.M., Kulikowski, C.A., 1991. Computer Systems that Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems. Morgan Kaufmann, San Mateo, CA.
26. Witten, I.H., Frank, E., 2000. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco, CA.
27. Yang, X.Z., Lacroix, R., Wade, K.M., 1999. Neural detection of mastitis from dairy herd improvement records. Trans. ASAE 42, 1063-1071.