Information technology measurement and testing activities at NIST

Journal of Research of the National Institute of Standards and Technology

Volumn 106, Issue 1, 2001, Pages 341-370

  Hogan, Michael D ^a   Carnahan, Lisa J ^a   Carpenter, Robert J ^a   Flater, David W ^a   Fowler, James E ^a   Frechette, Simon P ^a   Gray, Martha M ^a   Johnson, L Arnold ^a   McCabe, R Michael ^a   Montgomery, Douglas ^a   Radack, Shirley M ^a   Rosenthal, Robert ^a   Shakarji, Craig M ^a  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

Conformance; Hardware; Information technology; Interoperability; Measurement; Performance; Reference data; Software; Testing

Indexed keywords

EID: 0035040479     PISSN: 1044677X     EISSN: None     Source Type: Journal    
DOI: 10.6028/jres.106.013     Document Type: Article

References (61)

1. American National Standard Dictionary of Information Technology (ANSDIT), ANSI X3.172-1996, American National Standards Institute, New York.
2. International Vocabulary of Basic and General Terms in Metrology (the VIM), ISO, Geneva, Switzerland (1993) 59 pp.
3. ISO/IEC Guide 2: 1996, Standardization and related activities - General vocabulary, ISO/IEC, Geneva, Switzerland, 81 pp.
4. E. Passaglia, with K.A. Beal, A Unique Institution, The National Bureau of Standards 1950-1969, U.S. Government Printing Office, Washington, DC 20402 (1999).
5. G. N. Baird, The DoD COBOL Compiler Validation System, Fall Joint Computer Conference (1972) pp. 819-827.
6. C. Montanez-Rivera and L. A. Johnson, Conformance Test Specifications for COBOL Intrinsic Function Module, NIST SP 500-203, July 1992.
7. NIST Software Standards Validation Group, 1978 Fortran Compiler Validation System User's Guide, Version 2.1, August 1993.
8. J. V. Cugini, J. S. Bowden, and M. W. Skall, NBS Minimal BASIC Test Program-Version 2, User Manual, (Volume 1, Documentation and Volume 2, Source Listings and Sample Output), NBS SP 500-70/1 and NBS SP 500-70/2, November 1980.
9. D. Flater, L. Gallagher, S. Hurwitz, and J. Sullivan, User's Guide for the SQL Test Suite Version 6.0, NISTIR 5998, December 1996.
10. G. N. Baird and L. A. Johnson, Compiler Validation - An Assessment, National Computer Conference (1981) pp. 361-366.
11. R. Rosenthal and N. B. Meisner, (eds), Proceeding of the Local Area Communications Network Symposium-Update: Local Area Networks, Boston, May 1979.
12. R. Rosenthal, Local Area Networks: Baseband Carrier Sense Multiple Access with Collision Detection Access Method and Physical Layer Specification and Link Layer Protocol, NBS Federal Information Processing Standard FIPS 107, November 1984.
13. A. Mink, R. Carpenter, G. Nacht, and J. Roberts, Multiprocessor Performance-Measurement Instrumentation, IEEE Computer (1990) pp. 63-75.
14. A. Mink, W. Salamon, J. Hollingsworth, and R. Arunachalam, Performance Measurement using Low Perturbation and High Precision Hardware Assists, Proc. of the Proceedings of Rtss'98, 1 Dec 1998, IEEE, New York, pp. 379-388.
15. C. Martin, A. Mink, W. Salamon, M. Indovina, and M. Couson, Performance Measurement of Remote ATM Cluster, ATM99 Developments Conf, Mar-Apr 1999, Rennes, France.
16. A. Mink, R. Carpenter, and M. Courson, Time Synchronized Measurements in Cluster Computing Systems, 13th Intl. Conference on Parallel and Distributed Computing, PDSC2000, Aug 1-20, 2000, Las Vegas, NV.
17. M. D. Hogan, et al., Metrology for Information Technology, NISTIR 6025 (1997) 28 pp. (URL: http://www.nist.gov/itl/lab/nistirs/ir6025.htm).
18. M. Gray, Applicability of Metrology to Information Technology, J. Res. Natl. Inst. Stand. Technol. 104 (6), 567-578 (1999).
19. ISO/IEC TR13233: 1995 Information technology - Interpretation of accreditation requirements in ISO/IEC Guide 25 - Accreditation of Information Technology and Telecommunications testing laboratories for software and protocol testing services, ISO/IEC, Geneva, Switzerland.
20. ISO 10303-1:1994. Industrial automation systems and integration - Product data representation and exchange - Part 1: Overview and fundamental principles; ISO, Geneva, Switzerland. December 1994.
21. S. Kemmerer, ed., STEP The Grand Experience, NIST SP 939, July 1999.
22. NIST, Federal Information Processing Standard 46, Data Encryption Standard, 1999.
23. NIST, Federal Information Processing Standard 186, Digital Signature Standard, 2000.
24. NIST, Federal Information Processing Standard 180, Secure Hash Algorithm, 1995.
25. NIST, Federal Information Processing Standard 140, Security Requirements for Cryptographic Modules, 1994.
26. ISO/IEC 15408-3, Information Technology-Security Techniques - Evaluation criteria for IT Security, Parts 1-3, ISO/IEC, Geneva, Switzerland, 1999.
27. Document Object Model (DOM) level 2 Core Specification Version 1.0 W3C Proposed Recommendation, (URL: http://www.w3.org/TR/2000/PR-DOM-Level-2-Core-20000927/) September 2000.
28. Extensible Markup Language (XML) 1.0 (Second Edition), W3C Recommendation, (URL: http://www.w3.org/TR/2000/RED-xml-20001006) October 2000.
29. R. J. Linn, Conformance Testing for OSI Protocols, Computer Networks and ISDN Systems, Vol. 18, 1990.
30. L. Rosenthal, M. Skall, M. Brady, M. Kass, and C. Montanez-Rivera, Web-Based Conformance Testing For VRML, Standard-View, Vol. 5, No. 3, September 1997.
31. NIST Cerberus, An IPsec Reference Implementation for Linux, (URL: http://www.antd.nist.gov/ipsec/).
32. S. Kent and R. Atkinson, Security Architecture for the Internet Protocol, RFC 2401, ISOC, November 1998.
33. S. Kent and R. Atkinson, IP Encapsulating Security Payload, RFC 2406, ISOC, November 1998.
34. S. Kent and R. Atkinson, IP Authentication Header, RFC 2402, ISOC, November 1998.
35. NIST PlutoPlus: An IKE Reference Implementation for Linux, (URL: http://is2.antd.nist.gov/plutoplus/).
36. D. Harkins and D. Carrel, The Internet Key Exchange (IKE), RFC 2409, November 1998.
37. S. P. Frechette, STEP Implementation: Solid Model Exchange Results in the AutoSTEP Project, J. Agility Global Competition 1 (3), 1-12 (1997).
38. ISO 10303-203:1994. Industrial automation systems and integration - Product data representation and exchange - Part 203: Application protocol: Configuration controlled 3D designs of mechanical parts and assemblies ISO, Geneva, Switzerland. December 1994.
39. IEEE Standard Glossary of Software Engineering Terminology, IEEE 610.12-1990, IEEE, New York.
40. Project Brief: Advanced Process Control Framework Initiative, (URL: http://jazz.nist.gov/atpcf/prjbriefs/prjbrief.cfm?ProjectNumber=95-12-0027), NIST, 1996.
41. H. M. Bloom, N. Christopher, A Framework for Distributed and Virtual Discrete Part Manufacturing, Proceedings of the CALS EXPO '96, Long Beach, CA (1996).
42. CORBA Basics, (URL: http://sisyphus.omg.org/gettingstarted/corbataq.htm), Object Management Group.
43. D. Flater, Manufacturer's CORBA Interface Testing Toolkit: Overview, J. Res. Natl. Inst. Stand. Technol. 104 (2), 193-200 (1999).
44. MCITT Web Site, (URL: http://www.mel.nist.gov/msidstaff/flater/mcitt/), NIST, 1999.
45. American National Standard for Information Systems, Data Format for the Interchange of Fingerprint, Facial, and Scar Mark and Tattoo (SMT) Information, NIST SP 500-245, September 2000, 81 pp.
46. IAFIS-IC-0110 (V#) WSQ Gray-scale Fingerprint Image Compression Specification; Available from Criminal Justice Information Services Division. Federal Bureau of Investigation, 935 PA Ave, NW, Washington. DC 20535.
47. NIST Special Database 9 - NIST 8-bit Gray Scale Images of Mated Fingerprint Card Pairs available from NIST SRD program, (URL: http://www.nist.gov/srd/nistsd9.htm).
48. C. Diaz and T. H. Hopp, Evaluation of Software for Coordinate Measuring Systems, Proceedings of the SM 1995 Clinic & Interface '95 Symposium, June 1995.
49. C. M. Shakarji, Least-Squares Fitting Algorithms of the NIST Algorithm Testing System, J. Res. Nail. Inst. Stand. Technol. 103 (6), 633-641 (1998).
50. A. Martin, M. Przybocki, The NIST 1999 Speaker Recognition Evaluation - An Overview, Digital Signal Processing. Vol. 10, 2000, pp. 1-18.
51. E. M. Voorhees, D. K. Harman, The Eighth Text Retrieval Conference (TREC-8), NIST SP 500-246, September 2000.
52. J. Nechvatal et al., Report on the Development of the Advanced Encryption Standard (AES), (URL: http://csrc.nist.gov/encryption/aes/round2/r2report.pdf) National Institute of Standards and Technology, October 2000, 116 pp.
53. A. Rukhin et al., A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications, NIST SP 800-22. November 2000, 162 pp.
54. K. C. Morris, D. Flater, Standards-based Software Testing in a Net-Centric World, in Proceedings of the Ninth International Workshop on Software Technology and Engineering Practice (STEP '99), Pittsburgh, Pennsylvania, IEEE Computer Society, September 1999.
55. D. Flater, TIMS Project Description, (URL: http://www.mel.nist.gov/msid/tims/), April 2000.
56. D. Flater, Specification of Interactions in Integrated Manufacturing Systems, NISTIR 6484, March 2000.
57. Object Management Group PDM Enablers, (URL: http://www.omg.org/cgi-bin/doc?mfg/98-02-02.pdf), February 1998.
58. STEP PDM Schema Version 1.1, (URL: http://www.pdm-if.org/pdm_schema/), October 1999.
59. D. Flater and K. C. Morris, Testability of Product Data Management Interfaces, submitted to the 34th Hawaii International Conference on System Sciences, January 2001.
60. K. C. Morris and D. Flater, Design of a Flexible, Integrated Testing System for STEP and OMG Standards, submitted to the Journal of Computer Standards and Interfaces, February 2000.
61. President's IT Advisory Committee (PITAC) Report, Investing in Our Future, February 1999.