Parameter screening and optimisation for ILP using designed experiments

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 627-662

  Srinivasan, Ashwin ^a,c,d   Ramakrishnan, Ganesh ^b  

^a SOUTH ASIAN UNIVERSITY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

^d UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Experimental design; Inductive Logic Programming; Parameter screening and optimisation

Indexed keywords

COMPUTATIONAL OVERHEADS; CONSTRUCTING MODELS; CONTROLLED EXPERIMENTATION; DEFAULT VALUES; DESIGNED EXPERIMENTS; EXPERIMENTAL DESIGN; EXPLORATORY ANALYSIS; FRACTIONAL FACTORIAL DESIGNS; ILP MODELS; IMPROVING SYSTEMS; INDUCTIVE LOGIC; INPUT PARAMETER; OPTIMAL VALUES; OPTIMISATIONS; PARAMETER SCREENING; PARAMETER SELECTION; REGRESSION MODEL; RESPONSE SURFACE; RESPONSE SURFACE METHOD; SENSITIVE PARAMETER; SPECIFIC VALUES; STEEPEST ASCENT; STEPWISE REGRESSION;

BENCHMARKING; COMPUTER PROGRAMMING; DESIGN; EXPERIMENTS; OPTIMIZATION; REGRESSION ANALYSIS; STATISTICS; SURFACE PROPERTIES;

INDUCTIVE LOGIC PROGRAMMING (ILP);

EID: 79952760123     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. J. Ashby and R. W. Tennant. Definitive relationships among chemical structure, carcinogenicity and mutagenicity for 301 chemicals tested by the U. S. NTP. Mutation Research, 257:229-306, 1991. (Pubitemid 121007619)
2. M. Baz, B. Hunsaker, J. P. Brooks, and A. Gosavi. Automatic tuning of optimization software parameters. Technical Report 2007-7, University of Pittsburgh, Dept. of Industrial Engineering, 2007.
3. Y. Bengio. Gradient based optimisation of hyperparameters. Neural Computation, 12(8):1889-1900, 2000.
4. Y. Bengio and Y. Grandvalet. No unbiased estimator of the variance of k-fold cross-validation. Journal of Machine Learning Research, 5:1089-1105, 2004.
5. G. E. P. Box and K. B. Wilson. On the experimental attainment of optimum conditions. Journal of the Royal Statistical Society, Series B (Methodological), 13(1):1-45, 1951.
6. I. Bratko and S. H. Muggleton. Applications of inductive logic programming. Communications of the ACM, 38(11):65-70, 1995.
7. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Wadsworth, Belmont, 1984.
8. R. Bronson and G. Naadimuthu, editors. Schaum's Outline of Theory and Problems of Operations Research. McGraw Hill, New York, 1982. (2nd Edition).
9. A. K. Debnath, R. L. Lopez de Compadre, G. Debnath, A. J. Schusterman, and C. Hansch. Structureactivity relationship of mutagenic aromatic and heteroaromatic nitro compounds. Correlation with molecular orbital energies and hydrophobicity. Journal of Medicinal Chemistry, 34(2):786-797, 1991.
10. L. DeRaedt and M. Bruynooghe. Interactive concept-learning and constructive induction by analogy. Machine Learning, 8(2):107-150, 1992.
11. S. Dzeroski. Relational data mining applications: An overview. In S. Dzeroski and N. Lavrac, editors, Relational Data Mining, pages 339-360. Springer, Berlin, 2001.
12. M. C. Fu. Optimization via simulation. Annals of Operations Research, 53:199-248, 1994.
13. L. Getoor and B. Taskar, editors. Introduction to Statistical Relational Learning. MIT Press, Cambridge, 2007.
14. D. J. Hand. Construction and Assessment of Classification Rules. Wiley, Chichester, 1997.
15. J. C. Helton, J. D. Johnson, C. J. Sallaberry, and C. B. Storlie. Survey of sampling-based methods for uncertainty and sensitivity analysis. Reliability Engineering & System Safety, 91 (10-11): 1175-1209, 2006.
16. R. Jain. The Art of Computer Systems Performance Analysis. John Wiley, New York, 1991.
17. Frederik Janssen and Johannes Fürnkranz. On the quest for optimal rule learning heuristics. Mach. Learn., 78:343-379, March 2010. ISSN 0885-6125.
18. S. S. Keerthi, V. Sindhwani, and O. Chapelle. An efficient method for gradient-based adaptation of hyperparameters in svm models. In NIPS, pages 673-680, 2006.
19. R. D. King and A. Srinivasan. Prediction of rodent carcinogenicity bioassays from molecular structure using inductive logic programming. Environmental Health Perspectives, 104(5):1031-1040, 1996. (Pubitemid 26402347)
20. R. D. King, S. H. Muggleton, A. Srinivasan, and M. J. E. Sternberg. Structure-activity relationships derived by machine learning: The use of atoms and their bond connectivities to predict mutagenicity by inductive logic programming. Proc. of the National Academy of Sciences, 93:438-442, 1996. (Pubitemid 26038172)
21. R. Kohavi and G. H. John. Automatic parameter selection by minimizing estimated error. In A. Prieditis and S. Russell, editors, Proceedings of the Twelfth International Conference on Machine Learning, pages 204-212, San Francisco, CA, 1995. Morgan Kaufmann.
22. N. Landwehr, A. Passerini, L. De Raedt, and P. Frasconi. kfoil: Learning simple relational kernels. In AAAI, pages 389-396, 2006.
23. D. C. Montgomery. Design and Analysis of Experiments (5th Ed.). John Wiley, New York, 2005.
24. S. Muggleton. Inverse Entailment and Progol. New Gen. Comput., 13:245-286, 1995.
25. S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19, 20:629-679, 1994.
26. S. H. Muggleton, J. C. Almeida Santos, and A. Tamaddoni-Nezhad. Toplog: Ilp using a logic program declarative bias. In ICLP, pages 687-692, 2008.
27. H. G. Neddermeijer, G. J. van Oortmarssen, N. Piersma, and R. Dekker. A framework for response surface methodology for simulation optimization. In Winter Simulation Conference, pages 129-136, 2000. (Pubitemid 32873056)
28. M. H. Safizadeh and R. Signorile. Optimization of simulation via quasi-newton methods. ORSA Journal on Computing, 6(4):388-408, 1994.
29. S. Siegel. Nonparametric Statistics for the Behavioural Sciences. McGraw-Hill, New York, 1956.
30. A. Srinivasan. The aleph manual. 1999. URL http://www.comlab.ox.ac.uk/ oucl/research/areas/machlearn/Aleph/.
31. A. Srinivasan. Four suggestions and a rule concerning the application of ilp. In Nada Lavrac and Saso Dzeroski, editors, Relational Data Mining, pages 365-374. Springer-Verlag, Berlin, 2001a. URL ftp://ftp.comlab.ox.ac.uk/pub/ Packages/ILP/Papers/AS/ilpkdd.ps.gz.
32. A. Srinivasan. Extracting context-sensitive models in inductive logic programming. Machine Learning, 44:301-324, 2001b. URL ftp://ftp.comlab.ox.ac.uk/ pub/Packages/ILP/Papers/AS/relev. ps.gz. (Pubitemid 32761114)
33. D. D. Steppan, J. Werner, and R. P. Yeater. Essential Regression and Experimental Design for Chemists and Engineers. 1998. URL http://www.jowerner. homepage.t-online.de/download.htm.
34. R. E. Walpole and R. H. Myers. Probability and Statistics for Engineers and Scientists. Collier Macmillan, New York, 1978. 2nd Edition.
35. F. Zelezny, A. Srinivasan, and C. D. Page. Lattice-search runtime distributions may be heavytailed. In Proceedings of the Twelfth International Conference on Inductive Logic Programming (ILP2002), LNAI, Berlin, 2002. Springer. URL ftp://ftp.comlab.ox.ac.uk/pub/Packages/ILP/Papers/AS/rrr.ps.gz.