Robust performance testing for digital forensic tools

Digital Investigation

Volumn 6, Issue 1-2, 2009, Pages 71-81

  Pan, Lei ^a   Batten, Lynn M ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

CFReDS project; Digital forensic tool testing; EESAG; Experimental errors; Performance testing

Indexed keywords

COMPUTER CRIME; DIGITAL FORENSICS; ELECTRONIC CRIME COUNTERMEASURES; ERRORS;

CFREDS PROJECT; DIGITAL FORENSIC TOOL TESTING; EESAG; EXPERIMENTAL ERRORS; PERFORMANCE TESTING;

RANDOM ERRORS;

EID: 70249086259     PISSN: 17422876     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.diin.2009.02.003     Document Type: Article

References (40)

1. Jason Beckett, Jill Slay. Digital forensics: validation and verification in a dynamic work environment. 40th Annual Hawaii International Conference on System Sciences (HICSS'07); 2007. p. 266a.
2. Brian Carrier. Defining digital forensic examination and analysis tools using abstraction layers. International Journal of Digital Evidence 1 4 (2003)
3. Casey E. Error, uncertainty, and loss in digital evidence. International Journal of Digital Evidence 1 2 (2002)
4. Colbourn C.J., and Dinitz J.H. CRC handbook of combinatorial designs (1996), CRC Press
5. Cohen D., Dalal S.R., Fredman M.L., and Patton G.C. The AETG system: an approach to testing based on combinatorial design. IEEE Transactions on Software Engineering 23 7 (1997) 437-444
6. CFTT group from NIST. Disk imaging specifications (2001), NIST
7. CFTT group from NIST. Digital data acquisition tool specification (2004), NIST
8. CFTT group from NIST. Digital data acquisition tool test assertions and test plan (2005), NIST
9. Duran J.W., and Ntafos S.C. An evaluation of random testing. IEEE Transactions on Software Engineering 10 4 (1984) 438-444
10. Barbara Endicott-Popovsky, Fluckiger JD, Deborah Frincke. Establishing tap reliability in expert witness testimony: using scenarios to identify calibration needs. In: Proceedings of the 2nd International Workshop on Systematic Approaches to Digital Forensic Engineering, SADFE 2007; 2007. p. 131-44.
11. Gutjahr W.J. Partition testing vs. random testing: the influence of uncertainty. IEEE Transactions on Software Engineering 25 5 (1999) 661-674
12. Hamlet D., and Taylor R. Partition testing does not inspire confidence. IEEE Transactions on Software Engineering 16 12 (1990) 1402-1411
13. ISO/IEC. Software engineering - product quality 9126 (2004), ISO/IEC
14. Jain R. The art of computer systems performance analysis: techniques for experimental design measurement, simulation, and modeling (1991), Wiley
15. Kornblum J.D. The Linux kernel and the forensic acquisition of hard discs with an odd number of sectors. International Journal of Digital Evidence 3 2 (2004)
16. Lyman Ott R., and Longnecker M.T. An introduction to statistical methods and data analysis (2000), Duxbury Press
17. Mandel J. The statistical analysis of experimental data (1984), Dover
18. Marziale L, Richard GG III, Roussev V. Massive threading: using GPUs to increase the performance of digital forensics tools. In: Proceedings of the 7th Annual Digital Forensics Research Workshop (DFRWS 2007); 2007.
19. McDonald J.T., Kim Y.C., and Yasinsac A. Software issues in digital forensics. SIGOPS Operating Systems Review 42 3 (2008) 29-40
20. Soumen Maity, Amiya Nayak. Improved test generation algorithms for pair-wise testing. In: Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering; 2005. p. 235-44.
21. Meyers M., and Rogers M. Computer forensics: the need for standardization and certification. International Journal of Digital Evidence 3 2 (2004)
22. George Mohay. Technical challenges and directions for digital forensics. In: Proceedings of the 1st International Workshop on Systematic Approaches to Digital Forensic Engineering SADFE 2005; 2005. p. 155-61.
23. NIST/SEMATECH. e-Handbook of statistical methods. http://www.itl.nist.gov/div898/handbook/; 2006.
24. Lei Pan, Lynn M. Batten. A lower bound on effective performance testing for digital forensic tools. In: Proceedings of the 2nd International Workshop on Systematic Approaches to Digital Forensic Engineering (SADFE'07); 2007. p. 117-30.
25. Peisert S., Bishop M., and Marzullo K. Computer forensics in forensis. SIGOPS Operating Systems Review 42 3 (2008) 112-122
26. Stuart C. Reid. An empirical analysis of equivalence partitioning, boundary value analysis and random testing. In: Proceedings of the 4th International Software Metrics Symposium (METRICS'97); 1997. p. 64-73.
27. Jessica Reust. DFRWS 2005 Workshop Report. Online at http://www.dfrws.org/2005/download/2005final.pdf; 2006.
28. Richards Adrion W., Branstad M.A., and Cherniavsky J.C. Validation, verification, and testing of computer software. ACM Computing Surveys 14 2 (1982) 159-192
29. Rocke D.M. Robust statistical analysis of interlaboratory studies. Biometrika 70 2 (1983) 421-431
30. Samad Hedayat A., Sloane N.J.A., and Stufken J. Orthogonal arrays: theory and applications (1999), Springer
31. Neil J.A. Sloane. A library of orthogonal arrays. Available from: http://www.research.att.com/njas/oadir/index.html.
32. Taguchi G. Introduction to quality engineering: designing quality into produces and processes (1986), White Plains
33. Taguchi G., Chowdhury S., and Wu Y. Taguchi's quality engineering handbook (2004), Wiley
34. Tai K.C., and Lei Y. A test generation strategy for pairwise testing. IEEE Transactions on Software Engineering 28 1 (2002) 109-111
35. Tom Wilsdon, Jill Slay. Digital forensics: exploring validation, verification and certification. In: Proceedings of the 1st International Workshop on Systematic Approaches to Digital Forensic Engineering (SADFE'05); 2005. p. 48-55.
36. Tom Wilsdon, Jill Slay. Forensic computing tool testing utilizing black box techniques. In: Proceedings of the 4th Australian Digital Forensics Conference; 2006.
37. Xu H. An algorithm for constructing orthogonal and nearly-orthogonal arrays with mixed levels and small runs. Technometrics 44 (2002) 356-368
38. Huifang Yin, Zemen Lebne-Dengely, Yashwant K. Malaiya. Automatic test generation using checkpoint encoding and antirandom testing. In: Proceedings of the 8th International Symposium on Software Reliability Engineering; 1997. p. 84-95.
39. Youden W.J. Statistical techniques for collaborative tests. Statistical manual of the association of official analytical chemists vol. 63 (1975)
40. Zhou J., and Zhu H. Robust estimation and design procedures for the random effects model. The Canadian Journal of Statistics 31 1 (2003) 99-110