Model Based Testing Framework Using Component Technologies
Abstract
The article presents a component-based approach to construction of a model based testing framework. The main idea underlying the approach is non-invasive composition, which allows integration of a set of components along with their further reconfiguration without changing their code, and so with minimal effort. The article outlines the architecture of a model based testing framework using this idea and describes a prototype of such a framework implemented on the base of free libraries and tools. Test development case study in the prototype framework is also presented.
References
1. C. Szyperski. Component Software: Beyond Object-Oriented Programming. 2-nd ed. Addison-Wesley Professional, Boston, 2002.
2. G. T. Heineman, W. T. Councill. Component-Based Software Engineering: Putting the Pieces Together. Addison-Wesley Professional, 2001.
3. D. Parnas. Information Distribution Aspects of Design Methodology. Proc. of 1971 IFIP Congress, North Holland, 1971.
4. G. Tassey, ed. The Economic Impacts of Inadequate Infrastructure for Software Testing. NIST Report, 2002.
5. P. Hamill. Unit Test Frameworks. Tools for High-Quality Software Development. O’Reilly Media, 2004.
6. http://www.junit.org.
7. M. Broy, B. Jonsson, J.-P. Katoen, M. Leucker, A. Pretschner (Eds.) Model-Based Testing of Reactive Systems. Advanced Lectures. LNCS 3472, Springer-Verlag, 2005.
8. M. Utting, B. Legeard. Practical Model-Based Testing: A Tools Approach. Morgan-Kaufmann, 2007.
9. D. Peters, D. Parnas. Using Test Oracles Generated from Program Documentation. IEEE Trans. on Software Engineering, 24(3):161–173, 1998.
10. D. Hoffman. Analysis of a Taxonomy for Test Oracles. Quality Week, 1998.
11. L. Baresi, M. Young. Test Oracles. Tech. Report CIS-TR-01-02. http://www.cs.uoregon.edu/~michal/pubs/oracles.html.
12. D. Harel. Statecharts: A visual formalism for complex systems. Science of Computer Programming, 8(3):231-274, June 1987.
13. D. Drusinsky. Modeling and verification using UML statecharts. Elsevier, 2006
14. R. Alur, D. L. Dill. A Theory of Timed Automata. Journal of Theoretical Computer Science, 126(2):183-235, 1994.
15. J. Springintveld, F. Vaandrager, P. R. D'Argenio. Testing Timed Automata. Theoretical Computer Science, 254(1-2):225-257, March 2001.
16. H. Zhu, P. Hall, J. May. Software Unit Test Coverage and Adequacy. ACM Computing Surveys, 29(4):366-427, December 1997.
17. В. В. Кулямин, Н. В. Пакулин, О. Л. Петренко, А. А. Сортов, А. В. Хорошилов. Формализация требований на практике. Препринт 13, ИСП РАН, Москва, 2006.
18. K. Beck. Kent Beck's Guide to Better Smalltalk: A Sorted Collection. Cambridge University Press, 1998.
19. http://sunit.sourceforge.net/.
20. C. Beust, H. Suleiman. Next Generation Java Testing: TestNG and Advanced Concepts. Addison-Wesley Professional, 2007.
21. http://testng.org/.
22. http://www.dbunit.org.
23. http://www.httpunit.org.
24. http://jbehave.org/.
25. http://nspecify.sourceforge.net/.
26. http://mockito.org/.
27. http://easymock.org/.
28. J. Tretmans, E. Brinksma. TorX: Automated Model-Based Testing. Proc. of 1-st European Conference on Model-Driven Software Engineering, Nuremberg, Germany. pp. 31-43, December 2003.
29. http://fmt.cs.utwente.nl/tools/torx/introduction.html.
30. J.-C. Fernandez, C. Jard, T. Jéron, L. Nedelka, C. Viho. Using On-the-Fly Verification Techniques for the Generation of Test Suites. Proc of 8-th International Conference on Computer-Aided Verification, LNCS 1102:348-359, Springer, 1996.
31. http://www.inrialpes.fr/vasy/cadp/man/tgv.html.
32. F. Ambert, F. Bouquet, S. Chemin, S. Guenaud, B. Legeard, F. Peureux, N. Vacelet, M. Utting. Z-TT: A tool-set for test generation from Z and B using constraint logic programming, Proc. of Formal Approaches to Testing of Software, pp. 105-119, Brno, Czech Republic, August 2002.
33. A. Hartman, K. Nagin. TCBeans Software Test Toolkit. Proc. of 12-th International Software Quality Week, May 1999.
34. E. Farchi, A. Hartman, S. S. Pinter. Using a model-based test generator to test for standard conformance. IBM Systems Journal, 41(1):89-110, 2002.
35. http://www.conformiq.com/qtronic.php.
36. http://www.smartesting.com/index.php/cms/en/explore/products.
37. I. Bourdonov, A. Kossatchev, V. Kuliamin, A. Petrenko. UniTesK Test Suite Architecture. Proc. of FME 2002. LNCS 2391:77-88, Springer, 2002.
38. В. В. Кулямин, А. К. Петренко, А. С. Косачев, И. Б. Бурдонов. Подход UniTesK к разработке тестов. Программирование, 29(6):25-43, 2003.
39. http://www.unitesk.ru.
40. C. Campbell, W. Grieskamp, L. Nachmanson, W. Schulte, N. Tillmann, M. Veanes. Testing Concurrent Object-Oriented Systems with Spec Explorerю Proc. of Formal Methods Europe, LNCS582:542-547, Springer, 2005.
41. http://research.microsoft.com/en-us/projects/SpecExplorer/.
42. http://www.cs.waikato.ac.nz/~marku/mbt/modeljunit/.
43. J. Jacky, M. Veanes, C. Campbell, W. Schulte. Model-based Software Testing and Analysis with C#. Cambridge University Press, 2007.
44. http://nmodel.codeplex.com/.
45. http://mbt.tigris.org/.
46. M. Barnett, M. Fahndrich, P. de Halleux, F. Logozzo, N. Tillmann. Exploiting the Synergy between Automated-Test-Generation and Programming-by-Contract. Proc. of ICSE 2009, Vancouver, Canada, May 2009.
47. http://research.microsoft.com/en-us/projects/contracts/.
48. C. Kaner, J. Bach, B. Pettichord. Lessons Learned in Software Testing. John Wiley & Sons, 2002.
49. В. В. Кулямин. Интеграция методов верификации программных систем. Программирование, 35(4):41-55, 2009.
50. V. Kuliamin, A. Petrenko, N. Pakoulin. Practical Approach to Specification and Conformance Testing of Distributed Network Applications. Proc. of ISAS'2005, Berlin, Germany. M. Malek, E. Nett, N. Suri , eds. Service Availability. LNCS 3694, pp. 68-83, Springer-Verlag, 2005.
51. A. Grinevich, A. Khoroshilov, V. Kuliamin, D. Markovtsev, A. Petrenko, V. Rubanov. Formal Methods in Industrial Software Standards Enforcement. Proc. of PSI'2006, Novosibirsk, Russia, 2006.
52. M. Fowler. Inversion of Control Containers and the Dependency Injection Pattern. 2004. http://www.martinfowler.com/articles/injection.html.
53. R. Johnson, J. Hoeller, A. Arendsen, T. Risberg, C. Sampaleanu. Professional Java Development with the Spring Framework. Wrox, 2005.
54. http://www.springsource.org.
Review
For citations:
Kuliamin. V.V. Model Based Testing Framework Using Component Technologies. Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS). 2010;18. (In Russ.)
Email this article 