The use of associative semantic preprocessor in the interactive dialogue systems in natural language
https://doi.org/10.15514/ISPRAS-2018-30(4)-13
Abstract
The article explores the possibility of using an associative-semantic preprocessor for special text processing in natural language. The use of associations allow to abstract from the direct meaning of a word and to replace it with a set of other words. This has also the opposite effect: by typing words (associations) a person is able to restore the search word, which allows to form a query in a natural language without knowing the keywords or terms of a particular domain but at the same time to receive the required result, in contrast to systems oriented to frequency occurrences of words. In the semantic processing of text using associations, the order of words and their number are not important, which allows a person to communicate with the machine without formulating phrases in a special way, since the interactive dialog system itself will process the request clearing everything else. The use of a special text preprocessor based on the associative-semantic processing of text allows interactive systems to be able to understand the topic of the machine's dialogue with the user, improve interaction by communicating in a natural language, and also to simplify the process of system creation and development.
References
1. Sachkov V.E, Gilmutdinova E.F, Matyash E.D, Akimov D.A. Processing and computer analysis of the text in natural languages. Sovremennaja nauka: aktual'nye problemy teorii i praktiki, serija Estestvennye i tehnicheskie nauki [Journal of Contemporary Science: Actual Problems of Theory and Practice, Series of Natural and Technical Sciences], № 12. 2016. pp. 57-64 (in Russian)
2. Weizenbaum J. Computer Power and Human Reason: From Judgment to Calculation. Freeman and Company, New York, 1976, 281 p.
3. Wallace R. S. The Anatomy of A.L.I.C.E. In Parsing the Turing Test. Springer, 2009, pp. 181-210
4. Applied and Computational Linguistics, I.S Nikolaeva, O.V Mitrenina, T.M Lando, eds. Moscow, LENAND, 2016, 320 p. (in Russian)
5. Serban I. V., Lowe R., Henderson P., Charlin L., Pineau J. A Survey of Available Corpora for Building Data-Driven Dialogue Systems [online] URL: https://arxiv.org/abs/1512.05742 (accessed at: 01.06.18)
6. Walker M., Litman D., Kamm C., Abella A. Paradise: A framework for evaluating spoken dialogue agents, In Proc. of the Eighth Conference on European chapter of the Association for Computational Linguistics, Spain, 1997, pp. 271–280
7. Chia-Wei Liu, Lowe R., Serban I. V., Noseworthy M., Charlin L., Pineau J. How NOT to Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation [online] URL: https://arxiv.org/abs/1603.08023 (accessed at: 01.06.18)
8. Henderson M., Thomson B., Williams J. The Second Dialog State Tracking Challenge [online] URL: http://camdial.org/~mh521/dstc/downloads/handbook.pdf (accessed at: 01.06.18)
9. Hochreiter S., Schmidhuber J. Long Short-Term Memory. Neural Computation, vol. 9, issue 8, 1997, pp.1735-1780
10. Serban I. V., Sordoni A., Bengio Y., Courville A., Pineau J. Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models [online] URL: https://arxiv.org/abs/1507.04808 (accessed at: 01.06.18)
11. W3C Semantic web activity [online]. URL: https://www.w3.org/2001/sw/ (accessed at: 25.06.2018)
12. Resource Description Framework (RDF): Concepts and Abstract Syntax [online]. URL: https://www.w3.org/TR/2004/REC-rdf-concepts-20040210/ (accessed at 20.02.2017)
13. Landauer T., Foltz P. W., Laham D. Introduction to Latent Semantic Analysis. Discourse Processes, vol. 25, issue 2-3, 1998, pp. 259–284
14. Tomas Mikolov, Quoc V. Le, Ilya Sutskever. Exploiting Similarities among Languages for Machine Translation [online] URL: https://arxiv.org/pdf/1309.4168.pdf (accessed at: 20.04.2017)
15. Levy O., Golberg Y., Dagan I. Improving Distributional Similarity with Lessons Learned from Word Embeddings [online] URL: http://www.aclweb.org/anthology/Q15-1016 (accessed at: 01.06.2018)
16. Altszyler E., Sigman M., Ribeiro S., Slezak D.F. Comparative study of LSA vs Word2vec embeddings in small corpora: a case study in dreams database [onine] URL: https://arxiv.org/pdf/1610.01520.pdf (accessed at: 01.06.2018)
17. Semanticheskoe yadro [Semantic kernel] [online] URL: https://ru.wikipedia.org/wiki/%D0%A1%D0%B5%D0%BC%D0%B0%D0%BD%D1%82%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%BE%D0%B5_%D1%8F%D0%B4%D1%80%D0%BE, accessed at: 25.05.2017 (in Russian)
18. Rubner Y., Tomasi C., Guibas L. J. A metric for distributions with applications to image databases. In Proc. of the Sixth International Conference on Computer Vision, 1998, pp. 59-66
19. AIML: Artificial Intelligence Markup Language [online] URL: http://www.alicebot.org/aiml.html (accessed at: 13.06.2017)
20. Jason D. M., Rennie, Shih L., Teevan J., Karger D. R. Tackling the Poor Assumptions of Naive Bayes Text Classifiers. In Proc. of the Twentieth International Conference on Machine Learning (ICML), 2003, pp. 616-623
21. Morozova Yu.I. The construction of semantic vector spaces of different subject domains. In Proc. of the Third School of Young Scientists of the IPI RAS, 2012, pp. 4 – 11 (in Russian)
Review
For citations:
Sachkov V.E. The use of associative semantic preprocessor in the interactive dialogue systems in natural language. Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS). 2018;30(4):195-208. (In Russ.) https://doi.org/10.15514/ISPRAS-2018-30(4)-13
Email this article 