The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty

ACM Computing Surveys (CSUR)

Volumn 12, Issue 2, 1980, Pages 213-253

  Erman, Lee D ^a   Hayes Roth, Frederick ^b   Lesser, Victor R ^c   Reddy, D Raj ^d  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b RAND CORPORATION   (United States)

^c UNIVERSITY OF MASSACHUSETTS   (United States)

^d CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

artificial intelligence; blackboard; focus of control; knowledgebased system; multiple diverse knowledge sources; multiple levels of abstraction; problemsolving system; speech understanding systems; uncertainty resolving

Indexed keywords

EID: 84976736715     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/356810.356816     Document Type: Article

References (86)

1. Arbib, M A, and Caplan, D. “Neurolinguistics must be computational,” Behav. Brain Sci. 2, 3 (1979).
2. Bahl, L. R., Baker, J K., Cohen, P S., Dixon, N. R., Jelinek, F., Mercer, R. L., and Silverman, H. F. “Preliminary results on the performance of a system for the automatic recognition of continuous speech,” in 1976 IEEE Int Conf. Acoustics, Speech, and Signal Processing, Philadelphia, Apr. 1976, pp. 425-433.
3. Bahl, L. R., Baker, J. K., Cohen, P. S., Cole, A. G., Jelinek, F., Lewis, B. L., and Mercer, R. L. “Automatic recognition of continuously spoken sentences from a finite state grammar,” in Proc. IEEE Int. Conf Acoustics, Speech, and Signal Processing, Tulsa, Okla., Apr. 1978, pp. 418-421.
4. Balzer, R., Erman, L D., And Williams, C. Hearsay-III: A domain-independent base for knowledge-based problem-solving, Tech. Rep., USC/Information Sciences Institute, Manna del Rey, Calif, 1980. To appear.
5. Barnett, J A., And Bernstein, M. I. Knowledge-Based Systems. A tutorial, Tech. Rep. TM-(L)-5903/000/00 (NTIS AD/A-044-883), System Development Corp., Santa Monica, Calif., June 1977.
6. Bernstein, M. I. Interactive Systems Research. Final Report To The Director, Advanced Research Projects Agency, Tech. Rep. TM-5243/006/00, System Development Corp., Santa Monica, Calif., Sept. 1976.
7. Burton, R. R. Semantic Grammar. An Engineering Technique For Constructing Natural language understanding systems, Tech Rep BBN Rep. No. 3453, Bolt Beranek and Newman, Cambridge, Mass, 1976.
8. CMU Computer Science Speech Group. Summary Of The CMU Five-Year ARPA effort in speech understanding research, Tech. Rep., Computer Science Dep., Carnegie-Mellon Univ, Pittsburgh, Pa, 1977.
9. Cronk, R. “Word pair adjacency acceptance procedure in Hearsay-II,” In CMU77, PP 15-16.
10. Duda, R. O., Hart, P. E., Nilsson, N. J., And Southerland, G. L. “Semantic network representation in rule-based inference systems,” In Pattern-directed inference systems, D. A. Waterman and F. Hayes-Roth, Eds., Academic Press, New York, 1978, pp. 203-222.
11. Engelmore, R. S., and Nii, H. P. A knowledge-based system for the interpretation of protein X-ray crystallographic data, Tech. Rep Stan-CS-77-589, Computer Science Dep., Stanford Univ., Stanford, Cahf., 1977.
12. Erman L. D., and Lesser, V. R. “A multi-level organization for problem solving using many diverse cooperating sources of knowledge,” in Proc. 4th Int. Jt. Conf. Artificial Intelligence, Tbilisi, USSR, 1975, pp. 483-490.
13. Erman, L. D., and Lesser, V. R. “System engineering techniques for artificial intelligence systems,” in Computer vision systems, A. Hanson and E. Riseman, Eds., Academic Press, New York, 1978, pp. 37-45.
14. Ernst, G, and Newell, A. GPS: A case study in generality and problem solving, Academic Press, New York, 1969.
15. Feigenbaum, E A, Buchanan, B. G., and Lederberg, J. “On generality and problem solving A case study using the DENDRAL program,” in Machine intelligence 6, D. Michie, Ed, Edinburgh Univ Press, Edinburgh, Scotland, 1971.
16. Feigenbaum, E. A. “The art of artificial intelligence: Themes and case studies of knowledge engineering,” in Proc. 5th Int. Jt. Conf Artificial Intelligence, Cambridge, Mass., 1977, pp. 1014-1029.
17. Fox, M. S., and Mostow, D. J. “Maximal consistent interpretations of errorful data in hierarchically modelled domains,” in Proc 5th Int Jt Conf. Artificial Intelligence, Cambridge, Mass., 1977, pp 65-171.
18. Fox, M. S. “An organizational view of distributed systems,” in Proc. Int. Conf. Systems and Cybernetics, Denver, Colo., Oct. 1979.
19. Fox, M S. Organization structuring: Designing large, complex software, Tech. Rep CMU-CS-79-115, Computer Science Dep., Carnegie-Mellon Univ, Pittsburgh, Pa., 1979
20. Gill, G., Goldberg, H., Reddy, R., and Yegnanarayana, B. A recursive segmentation procedure for continuous speech, Tech. Rep. CMU-CS-78-134, Computer Science Dep, Carnegie-Mellon Univ., Pittsburgh, Pa., May 1978.
21. Goldberg, H., Reddy, R., and Gill, G “The ZAPDASH parameters, feature extraction, segmentation, and labeling for speech understanding systems,” in CMU77, pp. 10-11.
22. Goodman, G. Analysis of languages for man-machine voice communication, Tech. Rep., Computer Science Dep., Carnegie-Mellon Univ., Pittsburgh, Pa., May 1976.
23. Hanson, A. R., and Riseman, E. M. “VISIONS: A computer system for interpreting scenes,” in Computer vision systems, A. Hanson and E. Riseman, Eds., Academic Press, New York, 1978, pp. 303-333.
24. Harris, L. R. “The heuristic search under conditions of error,” Artif. Intell. 5, 3 (1974), 217-234
25. Hayes-Roth, F., and Mostow, D J. “An automatically compilable recognition network for structured patterns,” In Proc. 4th Int Jt. Conf. Artificial Intelligence, Tbilisi, USSR, 1975, pp. 246-252.
26. Hayes-Roth, F., and Lesser, V. R. “Focus of attention in the Hearsay-II system,” in Proc. 5th Int. Jt. Conf Artificial Intelligence, Cambridge, Mass., 1977, pp. 27-35.
27. Hayes-Roth, F., Erman, L. D., Fox, M., and Mostow, D. J. “Syntactic processing in Hearsay-II,” in CMU77, pp 16-18.
28. Hayes-Roth, F., Gill, G., and Mostow, D. J. “Discourse analysis and task performance in the Hearsay-II speech understanding system,” in CMU77, pp. 24-28.
29. Hayes-Roth, F., Lesser, V. R., Mostow, D. J., and Erman, L. D. “Policies for rating hypotheses, halting, and selecting a solution in Hearsay-II,” in CMU77, pp. 19-24
30. Hayes-Roth, F., Waterman, D. A., and Lenat, D. B. “Principles of pattern-directed inference systems,” in Pattern-directed inference systems, D. A. Waterman and F. Hayes-Roth, Eds., Academic Press, New York, 1978.
31. Hayes-Roth, F. “The role of partial and best matches in knowledge systems,” in Pattern-directed inference systems, D. A. Waterman and F. Hayes-Roth, Eds., Academic Press, New York, 1978.
32. Hayes-Roth, B., And Hayes-Roth, F. Cognitive processes in planning. Tech. Rep. R-2366-ONR, The RAND Corp., Santa Monica, Calif., 1979.
33. Hayes-Roth, B., and Hayes-Roth, F. “A cognitive model of planning,” Cognitive Sci 3 (1979), 275-310.
34. Hayes-Roth, B., Hayes-Roth, F., Rosenschein, S., And Cammarata, S. “Modeling planning as an incremental opportunistic process,” in Proc. 6th Int. Jt. Conf. Artificial Intelligence, Tokyo, 1979, pp. 375-383.
35. Hayes-Roth, F. “Syntax, semantics, and pragmatics in speech understanding,” in Trends in speech recognition, W. A. Lea, Ed., Prentice-Hall, Englewood Cliffs, N.J., 1980.
36. Itakura, F. “Minimum prediction residual principle applied to speech recogrtition,” IEEE Trans. Acoust., Speech, SignalProc. 23 (1975), 67-72.
37. Klatt, D. H. “Review of the ARPA speech understanding project,” J. Acoust. Soc. Am. 62 (Dec. 1977), 1345-1366.
38. Lea, W. A., and Shoup, J. E. Review of the ARPA SUR Project and survey of current technology in speech understanding, Final Rep., Office of Naval Research Contract No. N00014-77-C-0570, Speech Communications Research Lab., Los Angeles, Calif., Jan. 1979.
39. Lea, W. A., Ed. Trends in speech recognition, Prentice-Hall, Englewood Cliffs, N.J., 1980.
40. Lesser, V. R., Fennell, R. D., Erman, L. D., and Reddy, D. R. “Organization of the Hearsay-II speech understanding system,” IEEE Trans. Acous., Speech, Signal Proc. 23 (1975), 11-23.
41. Lesser, V. R., Hayes-Roth, F., Birnbaum, M., and Cronk, R. “Selection of word islands in the Hearsay-II speech understanding system,” in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Hartford, Conn., 1977, pp. 791-794.
42. Lesser, V. R., and Erman, L. D. “A retrospective view of the Hearsay-II architecture,” in Proc. 5th Int. Joint Conf. Artificial Intelligence, Cambridge, Mass., 1977, pp. 790-800.
43. Lesser, V. R., and Erman, L. D. “An experiment in distributed interpretation,” in 1st Int. Conf Distributed Computing Systems, IEEE Computer Society, Huntsville, Ala., Oct 1979, pp. 553-571.
44. Lesser, V. R., Pavlin, J., And Reed, S. Quantifying and simulating the behavior of knowledge-based systems, Tech. Rep., Dep Computer and Information Sciences, Univ. Massachusetts, Amherst, Mass., 1980.
45. Levine, M. D. “A knowledge-based computer vision system,” in Computer vision systems, A. Hanson and E. Riseman, Eds., Academic Press, New York, 1978, pp. 335-352.
46. Lowerre, B. T. The HARPY speech recognition system, Ph.D. thesis, Computer Science Dep., Carnegie-Mellon Univ., Pittsburgh, Pa., 1976.
47. Lowerre, B. T., and Reddy, R “The HARPY speech understanding system,” in Trends in speech recognition, W. A. Lea, Ed., Prentice-Hall, Englewood Cliffs, N.J., 1980, Chap. 15
48. Lowrance, J. Dependence-graph models of evidential support, Ph.D. thesis, Dep Computer and Information Sciences, Univ. Massachusetts, 1980 (forthcoming).
49. Mann, W. C. “Design for dialogue comprehension,” in 17th Ann. Meeting Assoc. Computational Linguistics, La Jolla, Calif., Aug. 1979.
50. McKeown, D. M. “Word verification in the Hearsay-II speech understanding system,” in Proc. IEEE Int. Conf Acoustics, Speech, and Signal Processing, Hartford, Conn., 1977, pp. 795-798.
51. Medress, M. F., Cooper, F. S., Forgie, J. W., Green, C. C., Klatt, D. H., O'Malley, M. H., Neuburg, E. P., Newell, A., Reddy, D. R., Ritea, B., Shoup-Hummel, J. E., Walker, D. E., and Woods, W. A. “Speech understanding systems: Report of a steering committee,” Artif. Intell. 9 (1978), 307-316.
52. Mostow, D. J. “A halting condition and related pruning heuristic for combinatorial search,” in CMU77, pp. 158-166.
53. Newell, A. “Heuristic programming: Ill-structured problems,” in Progress in operations research 3, J. Aronofsky, Ed., Wiley, New York, 1969, pp. 360-414.
54. Newell, A., Barnett, J., Forgie, J., Green, C., Klatt, D., Licklider, J. C. R., Munson, J., Reddy, R., and Woods, W Speech understanding systems Final report of a study group, North-Holland, Amsterdam, 1973.
55. Newell, A, “A tutorial on speech understanding systems,” in Speech recognition: Invited papers of the IEEE symposium, D. R. Reddy, Ed., Academic Press, New York, 1975, pp. 3-54.
56. Newell, A., McDermott, J., and Forgie, C. Artificial intelligence: A selfpaced introductory course, Computer Scienee Dep., Carnegie-Mellon Univ., Pittsburgh, Pa., 1977.
57. Newell, A. “HARPY, production systems and human cognition,” in Perception and production affluent speech, R. Cole, Ed., L. Erlbaum, Hillsdale, N.J., 1980, Chap. 11.
58. Nil, H. P., and Feigenbaum, E A. “Rule-based understanding of signals,” in Pattern-directed inference systems, D. A. Waterman and F. Hayes-Roth, Eds., Academic Press, New York, 1978.
59. Nil, H. P., and Aiello, N. “AGE (Attempt to Generalize). A knowledge-based program for building knowledge-based programs,” in Proc. 6th Int. Jt. Conf. Artificial Intelligence, Tokyo, Feb. 1979, pp. 645-655.
60. Nilsson, N. Problem-solving methods artificial intelligence, McGraw-Hill, New York, 1971
61. Norman, D A. “Copycat science or does the mind really work by table look-up?,” in Perception and production of fluent speech, R. Cole, Ed., L. Erlbaum, Hillsdale, N.J, 1980, Chap 12.
62. Pohl, I. “First results on the effects of error in heuristic search,” in Machine intelligence 5, B. Meltzer and D Michie, Eds, Edinburgh Univ Press, Edinburgh, Scotland, 1970
63. Pohl, I “Practical and theoretical considerations in heuristic search algorithms,” in Machine intelligence 8, E. Elcock and D. Michie, Eds., Ellis Horwood, Chichester, England, 1977
64. Reddy, D. R., Erman, L. D., And Neely, R B “A model and a system for machine recognition of speech,” IEEE Trans Audio and Electroacoustics AU-21 (1973), 229-238.
65. Reddy, D. R., Erman, L. D., Fennell, R. D., And Neely, R. B. “The Hearsay speech understanding system An example of the recognition process,” in Proc. 3rd Int. Jt. Conf. Artificial Intelligence, Stanford, Calif., 1973, pp. 185-193.
66. Reddy, D. R., Ed., Speech recognition Invited papers presented at the 1974 IEEE Symposium, Academic Press, New York, 1975
67. Reddy, D. R. “Speech recognition by machine: A review,” Proc IEEE 64 (Apr. 1976), 501-531.
68. Reiser, J. F. SAIL, Tech. Rep AIM-289, AI Lab., Stanford Univ., Stanford, Calif, 1976
69. Rubin, S. The ARGOS image understanding system, Ph D. thesis, Computer Science Dep., Carnegie-Mellon Univ, Pittsburgh, Pa., 1978.
70. Rumelhart, D. E. Toward an interactive model of reading, Tech. Rep 56, Center for Human Information Processing, Univ. California, San Diego, 1976
71. Sacerdoti, E. E. “Planning in a hierarchy of abstraction spaces,” Artif Intell 5 (1974), 115-135.
72. Shortliffe, E. H., And Buchanan, B. G. “A model of inexact reasoning in medicine,” Math Bio. Sci. 23 (1975)
73. Shortliffe, E Computer-based medical consultation MYCIN, Elsevier, New York, 1976
74. Smith, A. R. “Word hypothesization in the Hearsay-II speech system,” in Proc. IEEE Int Conf Acoustics, Speech, and Signal Processing, Philadelphia, Pa., 1976, pp. 549-552.
75. Smith, A. R. Word hypothesization for large-vocabulary speech understanding systems, Ph D. thesis, Computer Science Dep, Carnegie-Mellon Univ., Pittsburgh, Pa., 1977.
76. Smith, A. R., And Erman, L. D. “NOAH: A bottom-up word hypothesizer for large-vocabulary speech-understanding systems,” IEEE Trans. Pattern Anal. Mach. Intell. (1981), to be published.
77. Soloway, E. M., And Riseman, E M. “Levels of pattern description in learning,” in Proc 5th Int. J. Conf. Artificial Intelligence, Cambridge, Mass., 1977, pp 801-811
78. Sondhi, M. M., AND Levinson, S E “Computing relative redundancy to measure grammatical constraint in speech recognition tasks,” in Proc. IEEE Int Conf Acoustics, Speech, and Signal Processing, Tulsa, Okla., Apr. 1978.
79. Stefik, M. Planning with constraints, Ph.D thesis, Computer Science Dep., Stanford Univ., Stanford, Calif., Jan. 1980.
80. Walker, D. E., Ed. Understanding spoken language, Elsevier North-Holland, New York, 1978.
81. Walker, D. E. “SRI research on speech understanding,” in Trends in speech recognition, W. A. Lea, Ed., Prentice-Hall, Englewood Cliffs, N.J., 1980, Chap 13.
82. Wolf, J. J., And Woods, W. A. “The HWIM speech understanding system,” in Trends speech recognition, W A. Lea, Ed., Prentice-Hall, Englewood Cliffs, N.J., 1980, Chap. 14
83. Woods, W A. “Transition network grammars for natural language analysis,” Commun ACM 13, 10 (Oct. 1970), 591-606
84. Woods, W. A., And Makhoul, J. “Mechanical inference problems in continuous speech understanding,” in Proc 3rd Int. Jt. Conf. Artificial Intelligence, Stanford, Calif., 1973, pp 73-91, also Artif. Intell. 5, 1 (Spring 1974), 73-91.
85. Woods, W., Bates, M., Brown, G., Bruce, B., Cook, C., Klovstad, J., Mak-Houl, J., Nash-Webber, B., Schwartz, R, Wolf, J, And Zue, V. Speech understanding systems: Final technical progress report, Tech Rep 3438, Bolt Beranek and Newman, Cambridge, Mass., Dec. 1976 (in five volumes).
86. Woods, W. A. “Shortfall and density scoring strategies for speech understanding control,” in Proc. 5th Int. Jt. Conf Artificial Intelligence, Cambridge, Mass., 1977, pp. 13-26.