Conformance theory development: semantics, formal models, algorithms

The paper covers theoretical and practical works on conformance testing performed in ISP RAS since 1994 till now. The conformance theory development was done in various directions and, in the whole, was characterized by generalization of the interaction semantics, models and conformances in use. The necessity of such generalization was imposed, first of all, by requirements of testing practice. It is true for such system properties as nondeterminism, partial specified, asynchronous behavior, diversity of test stimuli and observations of the implementation behavior etc. It was always focused on testing effectiveness defined both by optimization of tests suites and by test generation algorithms including on-the-fly. We consider the main milestones on this way in a brief and informal discussion, paying attention not to details, but to the main problems and their solutions trying to reveal the common tendency of the development

Interaction semantics, finite state automata, LTS, IOLTS, traces, conformance, priorities, simulation, reduction, test generation, testing optimization, specification completion, system composition, mediators, modeling, implementation, specification, safe testing, graph learning, graph traversal, parallel testing

1. Bourdonov I., Kossatchev A., Petrenko A., Cheng S., Wong H. Formal Specification and Verification of SOS Kernel. BNR/NORTEL Design Forum, June 1996.

2. Barantsev А.V., Britvina E.N., Bourdonov I, Kossatchev A., Gomanyuk S.V., Demakov А.V., Ivanov А.V., Maksimov А.V., Petrenko A.K., Sazanov YU.L., Sortov А.А., Stefanov V.P., Sumar G.M. Аrkhitektura sistemy generatsii i propuska testov [Architecture of the system for test generation and running]. Voprosy kibernetiki, Moscow 1998. (in Russian).

3. Bourdonov I., Kossatchev A., Petrenko A., Galter D. KVEST: Automated Generation of Test Suites from Formal Specifications Proceedings of Formal Method Congress, Toulouse, France, 1999, LNCS, № 1708, pp.608-621.

4. Bourdonov I.B., Kossatchev A.S., Demakov А.V., Petrenko A.K., Maksimov А.V. Formal'nye spetsifikatsii v tekhnologiyakh obratnoj inzhenerii i verifikatsii programm [Formal specifications for the technology of reverse engineering fnd program verification] Trudy ISP RAN [The proceeding of ISP RAS], Vol. 1, 1999, pp. 31-43. (in Russian).

5. Bourdonov I.B., Kossatchev A.S., Petrenko A.K., Kuliamin V.V. UniTESK Test Suite Architecture Proceedings of FME’2002 conference, Copenhagen, Denmark, LNCS, № 2391, 2002, pp. 77-88.

6. Bourdonov I.B., Kossatchev A.S., Petrenko A.K., Kuliamin V.V. The UniTesK Approach to Designing Test Suites. Programming and Computer Software, Vol. 29, No. 6, 2003, pp. 310-322.

7.

8.

9. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V., Petrenko A.K., Pakoulin N.V. Integration of Functional and Timed Testing of Real-Time and Concurrent Systems. Perspectives of System Informatics. LNCS. № 2890, Springer-Verlag, 2003, pp.450 461.

10. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V., Petrenko A.K. UniTESK: Model Based Testing in Industrial Practice. Proceedings of 1-st European Conference on Model-Driven Software Engineering, Nurnberg, December 2003, pp. 55-63.

11. Bourdonov I.B., Barantsev А.V., Demakov А.V., Zelenov S.V., Kossatchev A.S., Kuliamin V.V., Omel'chenko V.А., Pakulin N.V., Petrenko A.K., KHoroshilov А.V. Podkhod UniTESK k razrabotke testov: dostizheniya i perspektivy [UniTESK approach to test development: achievements and perspectives]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 5, 2004, pp. 121-156. (in Russian)

12. Kalinov A. Ya., Kossatchev A.S., Posypkin M.А,, Sokolov А.А. Аvtomaticheskaya generatsiya testov dlya graficheskogo pol'zovatel'skogo interfejsa po UML diagrammam dejstvij [Automated test generation for user graphical interface by UML action diagrams]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 6, 2004, pp. 7-84. (in Russian)

13. Kuliamin V.V., Petrenko A.K.. Applying Model Based Testing in Different Contexts Proceedings of Seminar on Perspectives on Model Based Testing, Dagstuhl, Germany, September 2004.

14. Kuliamin V.V. Multi-paradigm Models as Source for Automated Test Construction. Proceedings of Workshop on Model Based Testing, Barcelona, Spain, March 2004. Electronic Notes in Theoretical Computer Science 111:137-160, 2005, Elseveir.

15. Sortov А.А., KHoroshilov А.V.. Funktsional'noe testirovanie Web-prilozhenij na osnove tekhnologii UniTESK [Functional testing of WEB applications on UniTESK technology base]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 8, 2004, pp. 77-97. (in Russian)

16. Kuliamin V.. Model Based Testing of Large-scale Software: How Can Simple Models Help to Test Complex System. Proc of ISOLA 2004, Cyprus, October 2004, pp. 311-316.

17. Ivannikov V.P., Kamkin A.S., Kuliamin V.V., Petrenko A.K. Primenenie tekhnologii UniTESK dlya funktsional'nogo testirovaniya modelej apparatnogo obespecheniya [UniTESK technology application for functional testing of hardware model] Preprint № 8, ISP RАN [Preprints of the Institute for System Programming of RAS, Preprint 8], 2005. (in Russian)

18. Kuliamin V., Petrenko A., Pakoulin N.. Extended Design-by-Contract Approach to Specification and Conformance Testing of Distributed Software. Proc. of 9-th WMSCI, Orlando, USA, July 2005, v. VII. Model Based Development and Testing, pp. 65-70.

19. Kuliamin V., Petrenko A., Pakoulin N.. Practical Approach to Specification and Conformance Testing of Distributed Network Applications. Proc. of 2-nd ISAS 2005, Berlin, Germany, April 2005, pp. 60-73 M. Malek, E. Nett, N. Suri, eds. Service Availability. LNCS 3694, pp. 68-83, Springer-Verlag, 2005.

20. Groshev S. Primenenie tekhnologii UniTESK dlya testirovaniya sistem s razlichnoj konfiguratsiej aktivnykh potokov upravleniya [UniTESK technology application for testing of the systems with various control flow configuration]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 9, 2006, pp. 67-81. (in Russian)

21. KHoroshilov А.V. Spetsifikatsiya i testirovanie sistem s asinkhronnym interfejsom [Specification and testing of the systems with asynchronous interfaces]. Preprint № 12, ISP RАN [Preprints of the Institute for System Programming of RAS, Preprint 12], 2006. (in Russian)

22. Grinevich А.I., Kulyamin V.V., Markovtsev D.А., Petrenko А.K., Rubanov V.V., KHoroshilov А.V. Ispol'zovanie formal'nykh metodov dlya obespecheniya soblyudeniya programmnykh standartov [Formal method usage for program standards compliance support]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 10, 2006, pp. 51-68. (in Russian)

23. Mutilin V.S. Patterny proektirovaniya testovykh stsenariev [Project patterns of test scenarios]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 9, 2006, pp. 97-128. (in Russian)

24. Grinevich A., Khoroshilov A., Kuliamin V., Markovtsev D., Petrenko A., V.Rubanov. Formal Methods in Industrial Software Standards Enforcement. Proc. of PSI'2006, Novosibirsk, Russia, June 2006.

25. Pakulin N.V., KHoroshilov А.V. Development of formal models and conformance testing for systems with asynchronous interfaces and telecommunications protocols. Programming and Computer Software, Vol. 33, No. 6, 2007,pp. 316-335.

26. Ivannikov V.P., Kamkin A.S., Kossatchev A.S., Kuliamin V.V., Petrenko A.K. The use of contract specifications for representing requirements and for functional testing of hardware models. Programming and Computer Software, Vol. 33, No. 5, 2007,pp. 272-282.

27. Kamkin A. Coverage-Directed Verification of Microprocessor Units Based on Contract Specifications. EWDTS 2008, pp. 84-87.

28. Kamkin A.. Generatsiya testovykh programm dlya mikroprotsessorov [Test program generation fo microprocessors]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 14.2, 2008, pp. 23-64. (in Russian)

29. Petrenko A.K. Unifikatsiya v avtomatizatsii testirovaniya. Pozitsiya UniTESK [Unification of test automatization. UniTESK position]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 14.1, 2008, pp. 7-22. (in Russian)

30. Petrenko A.. Formal Methods and Innovation Economy: Facing New Challenges. Proceedings of the 6th IEEE International Conference on Software Enginering and Formal Methods, Cape Town, South Africa, 10-14 November 2008.

31. S.G.Groshev. Bug localization by constructing reduced traces. Programming and Computer Software, Vol. 35, No 3, 2009, pp. 145-157.

32. Frenkel S., Kamkin A.. Verification Methodology Based on Algorithmic State Machines and Cycle-Accurate Contract Specifications. East-West Design & Test Symposium, September 18-21, 2009, pp. 39-42.

33. Kuliamin V.V. Integration of verification methods for program systems. Programming and Computer Software, Vol. 35, No 4, 2009, pp. 212-222.

34. Kuliamin V.V. Perspektivy integratsii metodov verifikatsii programmnogo obespecheniya [The perspective of software verification method integration]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 16, 2009, pp. 73-88. (in Russian)

35. Chupilko M.. Constructing Test Sequences for Hardware Designs with Parallel Starting Operations Using Implicit FSM Models. EWDTS-2009 (East-West Design and Test Symposium 2009). Proceedings of IEEE East-West Design & Test Symposium (EWDTS 2009), 393-396 pp.

36. Chupilko M., Kamkin A. Specification-Driven Testbench Development for Synchronous Parallel-Pipeline Designs. NorChip-2009, pp.1-4.

37. Gubenko Ya.S., Kamkin A.S., Chupilko M.M. Sravnitel'nyj analiz sovremennykh tekhnologij razrabotki testov dlya modelej apparatnogo obespecheniya [Comparative analysis of contemporary test development technologies for hardware models]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 17, 2009, pp. 133-143. (in Russian)

38. Smolov S.A. Razrabotka testovogo nabora dlya funktsional'nogo testirovaniya infrastrukturnogo programmnogo obespecheniya GRID s primeneniem tekhnologii UniTESK [Test case development for functional testing of GRID infrastructure software by UniTESK technology]. Sbornik nauchnykh trudov nauchno-prakticheskoj konferentsii «Аktual'nye problemy programmnoj inzhenerii» [The proceeding of conference “Actual problems of program engineering”]. 2009, pp.183-189. (in Russian)

39. Pakulin N.V., Tugaenko A.N. Razrabotka testovykh naborov dlya testirovaniya sootvetstviya pochtovykh protokolov [Test case development for mail protocol conformance testing]. Konferentsiya АPPI-2009 [APPI-2009 conference], pp. 154-160. (in Russian)

40. Kuliamin V.V. Аrkhitektura sredy testirovaniya na osnove modelej, postroennaya na baze komponentnykh tekhnologij [Model Based Testing Framework Using Component Technologies]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 18, 2010, pp. 9-44. (in Russian)

41. Groshev S.G. Tekhnologiya sozdaniya geterogennykh trass, ikh analiza i generatsii iz nikh otchyotov [Technology of heterogeneous logging, analysis and report generation]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 18, 2010, pp. 45-66. (in Russian)

42. Chupilko M.M. Аvtomatizatsiya sistemnogo testirovaniya modelej apparatury na osnove formal'nykh spetsifikatsij [Formal specifications-based automation of system testing of hardware designs]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 18, 2010, pp. 115-12897. (in Russian)

43. Nikeshin A.V., Pakulin N.V., Shnitman V.Z. Razrabotka testovogo nabora dlya verifikatsii realizatsij protokola bezopasnosti IPsec v2 [Conformance test suite for implementations of the security protocol suite IPsec v2]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 18, 2010, pp. 151-182. (in Russian)

44. Chupilko M. Models of Synchronous Hardware Designs Based on FSM at Different Abstraction Levels: Application to Functional Verification EWDTS-2010 (East-West Design and Test Symposium 2010). Proceedings of IEEE East-West Design & Test Symposium (EWDTS 2010), 127-130 pp.

45. Chupilko M., Kamkin A.. Developing cycle-accurate contract specifications for synchronous parallel-pipeline hardware: application to verification. BEC-2010 (Baltic Electronics Conference 2010). Proceedings of the 12th Biennial Baltic Electronics Conference (BEC 2010), 185-188 pp.

46. Pakulin N., Tugaenko A. Specification Based Conformance Testing for Email Protocols. Proceedings of ISoLA 2010, pp.371-382. Heraclion, Greece, 2010.

47. Kuliamin V.V. Component architecture of model-based testing environment. Programming and Computer Software, Vol. 36, No 5, 2010, pp. 289-305.

48. Pakulin N.V, Tugaenko A. Testirovanie protokolov ehlektronnoj pochty Interneta s ispol'zovaniem modelej [Model-based testing of Internet Mail Protocols]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 20, 2011, pp. 125-141. (in Russian)

49. Kamkin A.. Simulation-Based Verification with Time-Abstract Models. EWDTS, 2011.

50. Chupilko M., Kamkin A. A TLM-based approach to functional verification of hardware components at different abstraction levels. LATW, 2011.

51. Kamkin A., Chupilko M. Mekhanizmy podderzhki funktsional'nogo testirovaniya modelej apparatury na raznykh urovnyakh abstraktsii [Mechanisms for functional testing of hardware models at different levels of abstraction], Trudy ISP RAN [The proceeding of ISP RAS], Vol. 20, 2011, pp. 143-160. (in Russian)

52. Chupilko M. C++TESK-SystemVerilog united approach to simulation-based verification of hardware designs. EWDTS-2011.

53. Kuliamin V., Pakulin N., Tugaenko A.. Case Studies of Summer Model-based Testing Framework, Model-based Testing User Conference, October 18-20, 2011.

54. Ivannikov V.P., Petrenko A.K. Modeli v razrabotke i analize programmnykh system [Models for program system development and verification]. Lomonosovskie chteniya [Lomonosov MSU conference], MSU, 2011. (in Russian)

55. Y. Gerlits, A. Khoroshilov. «Model-Based Testing of Safety Critical Real-Time Control Logic Software» In Proceedings of the Seventh Workshop on Model-Based Testing (MBT 2012), Tallin, Estonia, March 25, 2012.

56. Pakulin N. Integrated Modular Avionics: New Challenges for MBT. ETSI TTCN-3 User Conference and Model Based Testing Workshop, Bangalore, India, 11-14 June 2012.

57. Shnitman V.Z., Nikeshin A.V. Pakulin N.V. Primenenie modelej dlya testirovaniya protokolov bezopasnosti [Model usage for security protocol testing]. Vserossijskaya konferentsiya «Infokommunikatsionnye tekhnologii v nauchnykh issledovaniyakh» [Russian conference “Infocommunication technologies for scientific research”, IKI RAN [Space Research Institute RAS], 2012. (in Russian)

58. Chupilko M.M. Developing test systems for multi-modules hardware designs. Programming and Computer Software, Vol. 38, No 1, 2012, pp. 34-42. http: www.UniTESK.com

59. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Application of Finite Automatons for Program Testing. Programming and Computer Software, Vol. 26, No. 2, 2000, pp. 61-73.

60. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Irredundant Algorithms for Traversing Directed Graphs: The Deterministic Case. Programming and Computer Software, Vol. 29, No. 5, 2003, pp. 245-258.

61. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Аsinkhronnye avtomaty: klassifikatsiya i testirovanie [Asynchronous automata: classification and testing]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 4, 2003, pp. 7-84. (in Russian)

62. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Irredundant Algorithms for Traversing Directed Graphs: The Nondeterministic Case. Programming and Computer Software, Vol. 30, No. 1, 2004, pp. 2-17.

63. Bourdonov I.B. Backtracking Problem in the Traversal of an Unknown Directed Graph by a Finite Robot. Programming and Computer Software, Vol. 30, No. 6, 2004, pp. 305-322.

64. Bourdonov I.B. Traversal of an Unknown Directed Graph by a Finite Robot. Programming and Computer Software, Vol. 30, No. 4, 2004, pp. 188-203.

65. I.B.Bourdonov, A.S.Kossatchev, Kuliamin V.V. Formal Conformance Testing of Systems with Refused Inputs and Forbidden Actions. Proceedings of the Workshop on Model Based Testing (MBT 2004), Elsevier, 2006.

66. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Formalization of Test Experiments. Programming and Computer Software, Vol. 33, No. 5, 2007, pp. 239-260.

67. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Bezopasnost', verifikatsiya i teoriya konformnosti [Safety, Verification and Conformance Theory]. Materialy Vtoroj mezhdunarodnoj nauchnoj konferentsii po problemam bezopasnosti i protivodejstviya terrorizmu [The proceeding of the Second international conference on the problems of safety and counteraction against terrorizm], Moscow, MNCMO, 2007, pp. 135-158. (in Russian)

68. Bourdonov I.B., Kossatchev A.S., Kuliamin V.V. Teoriya sootvetstviya dlya system s blokirovkami I razrusheniem [Conformance theory of the systems with Refused Inputs and Forbidden Actions]. Moscow, «Nauka», 2008, 412 p. (in Russian)

69. Bourdonov I.B., Kossatchev A.S. Sistemy s prioritetami: konformnost', testirovanie, kompozitsiya [Systems with priority: conformance, testing, composition]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 14.1, 2008, pp.23-54. (in Russian)

70. Bourdonov I.B., Kossatchev A.S. Obobshhyonnye semantiki testovogo vzaimodejstviya [Generic test interaction semantics]. Trudy ISP RAN [The proceeding of ISP RAS], v. 15, 2008, pp. 69-106. (in Russian)

71. Bourdonov I.B., Kossatchev A.S. Ehkvivalentnye semantiki vzaimodejstviya [Equivalent interaction semantics]. Trudy ISP RAN [The proceeding of ISP RAS], v. 14.1, 2008, pp.55-72. (in Russian)

72. Bourdonov I. Teoriya konformnosti (funkcional'noe testirovanie prorammny'kh system na osnove formal'ny'kh modelej [Conformance theory (functional testing on formal model base)]. LAP LAMBERT Academic Publishing, Saarbrucken, Germany, 2011, ISBN 978-3-8454-1747-9, 428 p. http://www.ispras.ru/~RedVerst/RedVerst/Publications/TR-01-2007.pdf) (in Russian)

73. Bourdonov I.B., Kossatchev A.S. Systems with Priorities: Conformance, Testing, and Composition. Programming and Computer Software, Vol. 35, No. 4, 2009, pp.198-211.

74. Bourdonov I.B., Kossatchev A.S. Polnoe testirovanie s otkrytym sostoyaniem ogranichenno nedeterminirovannykh system [Complete OpenState Testing of Limitedly Nondeterministic Systems]. Trudy ISP RAN [The proceeding of ISP RAS], v. 17, 2009, pp. 161-192. (in Russian)

75. Bourdonov I.B., Kossatchev A.S. Complete OpenState Testing of Limitedly Nondeterministic Systems. Programming and Computer Software, Vol. 35, No. 6, 2009,pp.301-313.

76. Bourdonov I.B., Kossatchev A.S. Testirovanie s preobrazovaniem semantic [Testing with Semantics Conversion] Trudy ISP RAN [The proceeding of ISP RAS], Vol. 17, 2009, pp. 193-208. (in Russian)

77. Bourdonov I.B., Kossatchev A.S. Testirovanie konformnosti na osnove sootvetstviya sostoyanij [Conformance testing based on a state relation]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 18, 2010, pp. 183-320. (in Russian)

78. Kossachev A., Burdonov I.. Formal Conformance Verifcation, Short Papers of the 22nd IFIP ICTSS, Alexandre Petrenko, Adenilso Simao, Jose Carlos Maldonado (eds.), Nov. 08-10, 2010, Natal, Brazil, pp.1-6.

79. Bourdonov I.B., Kossatchev A.S. Interaction Semantics with Refusals, Divergence, and Destruction. Programming and Computer Software, Vol. 36, No. 5, 2010, pp. 247-263.

80. Bourdonov I.B., Kossatchev A.S. Semantiki vzaimodejstviya s otkazami, divergentsiej i razrusheniem. CHast' 1. Gipoteza o bezopasnosti i bezopasnaya konformnost'. [Semantics of Interaction with Refused Inputs, Divergence and Forbidden Actions] «Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitel'naya tekhnika i informatika» [Tomsk State University. Journal of Control and Computer Science], №4, 2010, pp. 124-133. (in Russian)

81. Bourdonov I.B., Kossatchev A.S. Safe Simulation Testing of Systems with Refusals and Destructions Automatic Control and Computer Sciences, 2011, Vol. 45, No. 7.

82. Bourdonov I.B., Kossatchev A.S. Specification Completion for IOCO. Programming and Computer Software, Vol. 37, No. 1, 2011, pp. 1-14.

83. Bourdonov I.B., Groshev S.G., Demakov A.V., Kamkin A.S., Kossatchev A.S, Sortov A.A. Parallel'noe testirovanie bol'shikh avtomatnykh modelej [Parallel testing of large automata models], Vestnik NNGU [Vestnik of UNN], №3920, 2011, pp. 187-193. (in Russian)

84. Demakov A., Kamkin A., Sortov A. High-Performance Testing: Parallelizing Functional Tests for Computer Systems Using Distributed Graph Exploration. Open Cirrus, 2011.

85. Bourdonov I.B., Kossatchev A.S. Udalenie iz spetsifikatsii nekonformnykh trass [Nonconforming traces elimination from specification]. Preprint № 23, ISP RАN [Preprints of the Institute for System Programming of RAS, Preprint 23], 2011, pp. 1-219.

86. Bourdonov I.B., Kossatchev A.S.. Safe simulation testing of systems with refusals and destructions Automatic Control and Computer Sciences, Vol. 45, №7, 2011, pp. 380-389.

87. Bourdonov I.B., Kossatchev A.S. Semantiki vzaimodejstviya s otkazami, divergentsiej i razrusheniem. CHast' 2. Usloviya konechnogo polnogo testirovaniya. [Semantics of Interaction with Refused Inputs, Divergence and Forbidden Actions. Part 2. The condition of finite complete testing]. «Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitel'naya tekhnika i informatika» [Tomsk State University. Journal of Control and Computer Science]. №2, 2011, pp. 89-98. (in Russian).

88. Bourdonov I.B., Kossatchev A.S. Final'nye modeli spetsifikatsii [The final models of specification]. Trudy ISP RAN [The proceeding of ISP RAS], Vol. 22, 2012, pp. 233-276. DOI: 10.15514/ISPRAS-2012-22-15. (in Russian)

89. Bourdonov I.B., Kossatchev A.S., Zavisimosti mezhdu oshibkami na klassakh testiruemykh realizatsij [Error dependencies on classes of implementations under testing], Trudy ISP RAN [The proceeding of ISP RAS], Vol. 23, 2012, pp. 323-358. DOI: 10.15514/ISPRAS-2012-23-19. (in Russian)

90. Bourdonov I.B., Kossatchev A.S. Formalization of a Test Experiment – II. Programming and Computer Software, Vol. 39, No. 4, 2013, pp. 163-181.

91. Bourdonov I.B., Kossatchev A.S. Agreement between Conformance and Composition. Programming and Computer Software, Vol. 39, No. 6, 2013, pp. 269–278.

92. Bourdonov I.B., Kossatchev A.S. Obkhod neizvestnogo grafa kollektivom avtomatov [Unknown graph traversing by automata group]. Trudy Mezhdunarodnoj superkomp'yuternoj konferentsii “Nauchnyj servis v seti Internet: vse grani parallelizma ”(21-26 sentyabrya 2009 g., g. Novorossijsk) [The proceeding of Russian Supercomputer conference ‘Scientific service of Internet’ (2013, Novorossijsk)] – Moscow, MSU publ., 2013, pp. 228-232. (in Russian)

93. Milner R. Modal characterization of observable machine behaviour. In G. Astesiano & C. Bohm, editors: Proceedings CAAP 81, LNCS 112, Springer, pp. 25-34.

94. van Glabbeek R.J. The linear time – branching time spectrum. In J.C.M. Baeten and J.W. Klop, editors, CONCUR’90, Lecture Notes in Computer Science 458, Springer-Verlag, 1990, pp 278–297.

95. Vaandrager F. On the relationship between process algebra and Input/Output Automata. In Logic in Computer Science, pp. 387-398. Sixth Annual IEEE Symposium, IEEE Computer Society Press, 1991.

96. van Glabbeek R.J. The linear time - branching time spectrum II; the semantics of sequential processes with silent moves. Proceedings CONCUR ’93, Hildesheim, Germany, August 1993 (E. Best, ed.), LNCS 715, Springer-Verlag, 1993, pp. 66-81.

97. De Nicola R., Segala R. A process algebraic view of Input/Output Automata. Theoretical Computer Science, 138:391-423, 1995.

98. D. Lee and M. Yannakakis. Principles and Methods of Testing Finite-State Machines. A survey. Proceedings of the IEEE, Vol. 84, № 8, 1996, pp. 1090–1123.

99. Tretmans J. Test Generation with Inputs, Outputs and Repetitive Quiescence. In: Software-Concepts and Tools, Vol. 17, Issue 3, 1996.

100. Heerink L. Ins and Outs in Refusal Testing. PhD thesis, University of Twente, Enschede, The Netherlands, 1998.

101. Marine Tabourier, Ana Cavalli and Melania Ionescu , A GSM-MAP Protocol Experiment Using Passive Testing, Proceeding of FM'99 (World Congress on Formal methods in development of Computing Systems), Toulouse (France), 20-24 September 1999.

102. Jard C., Jéron T., Tanguy L., Viho C. Remote testing can be as powerful as local testing. In Formal methods for protocol engineering and distributed systems, FORTE XII/ PSTV XIX’ 99, Beijing, China, J. Wu, S. Chanson, Q. Gao (eds.), pp. 25-40, October 1999.

103. van der Bijl M., Rensink A., Tretmans J. Compositional testing with ioco. Formal Approaches to Software Testing: Third International Workshop, FATES 2003, Montreal, Quebec, Canada, October 6th, 2003. Editors: Alexandre Petrenko, Andreas Ulrich ISBN: 3-540-20894-1. LNCS volume 2931, Springer, pp. 86-100.

104. van der Bijl M., Rensink A., Tretmans J. Component Based Testing with ioco. CTIT Technical Report TR-CTIT-03-34, University of Twente, 2003.

105. Alexandre Petrenko, Nina Yevtushenko: Testing from Partial Deterministic FSM Specifications. IEEE Trans. Computers 54(9): 1154-1165 (2005).

106. Adenilso da Silva Simão, Alexandre Petrenko, Nina Yevtushenko: Generating Reduced Tests for FSMs with Extra States. TestCom/FATES 2009: 129-145.

107. Maurice P. Herllihy, Jeannette M. Wing. Linearizability: A Correctness Condition for Concurrent Objects ACM Transactions on Programming Languages and Systems, Vol. 12, No. 3, July 1990, pp. 463-492.