Empirical Evaluation of Scoring Methods

Frontiers in Artificial Intelligence and Applications

Volumn 142, Issue , 2006, Pages 108-119

  Pulina, Luca ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

Automated Reasoning; Scoring Methods; Systems Comparison

Indexed keywords

AUTOMATION; BOOLEAN ALGEBRA; COMPUTATION THEORY; COMPUTER CIRCUITS; LAKES;

AUTOMATED REASONING; EFFECTIVENESS MEASURE; EMPIRICAL EVALUATIONS; NUMERICAL QUANTITY; PERFORMANCE; PROBLEM INSTANCES; RESEARCH COMMUNITIES; SCORING METHODS; SYSTEMS COMPARISON; VOTING THEORY;

NUMERICAL METHODS;

EID: 84896062290     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: None     Document Type: Conference Paper

References (14)

1. G. Sutcliffe and C. Suttner. The CADE ATP System Competition. http://www.cs.miami.edu/~tptp/CASC . Visited in April 2006.
2. D. Le Berre and L. Simon. The SAT Competition. http://www.satcompetition. org. Visited in April 2006.
3. M. Narizzano, L. Pulina, and A. Taccchella. QBF solvers competitive evaluation (QBFEVAL). http://www.qbflib.org/qbfeval . Visited in April 2006.
4. D. Long and M. Fox. The 3rd International Planning Competition: Results and Analysis. Artificial Intelligence Research, 20:1–59, 2003.
5. J. N. Hooker. Testing Heuristics: We Have It All Wrong. Journal of Heuristics, 1:33–42, 1996.
6. D. G. Saari. Chaotic Elections! A Mathematician Looks at Voting. American Mathematical Society, 2001.
7. RangeVoting.org. http://math.temple.edu/~wds/crv/ . Visited in April 2006.
8. The Condorcet Method. Reference available on line from http://en.wikipedia.org/wiki/Condorcet_method . Visited in April 2006.
9. M. Narizzano, L. Pulina, and A. Tacchella. The third QBF solvers comparative evaluation. Journal on Satisfiability, Boolean Modeling and Computation, 2:145–164, 2006. Available on-line at http://jsat.ewi.tudelft.nl/.
10. E. Giunchiglia, M. Narizzano, and A. Tacchella. Quantified Boolean Formulas satisfiability library (QBFLIB), 2001. www.qbflib.org . Visited in April 2006.
11. Y. Yu and S. Malik. Verifying the Correctness of Quantified Boolean Formula(QBF) Solvers: Theory and Practice. In ASP-DAC, 2005.
12. M. Benedetti. Evaluating QBFs via Symbolic Skolemization. In Eleventh International Conference on Logic for Programming, Artificial Intelligence and Reasoning (LPAR 2004), volume 3452 of Lecture Notes in Computer Science. Springer Verlag, 2004.
13. A. Van Gelder, D. Le Berre, A. Biere, O. Kullmann, and L. Simon. Purse-Based Scoring for Comparison of Exponential-Time Programs, 2006. Unpublished draft.
14. M. Kendall. Rank Correlation Methods. Charles Griffin & Co. Ltd., 1948. Reference available on line from http://en.wikipedia.org/wiki/Rank_correlation.