Requirements Validation and Its Impact in Software Quality in Use: A Case Study
https://doi.org/10.15514/ISPRAS-2023-35(6)-1
Abstract
In this study, the relationship between the improvement of software requirement quality and the software product quality in use was explored and analyzed. Analysis was based on the design of software product quality-in-use and the measure of metrics from ISO/IEC 25010 standard in two software products. The results show that the validation activities introduced in the software requirements stage have a positive relationship with the quality in use of the software products analyzed. In the software studied, it can be said that the improvement of the quality of the requirements has contributed to the improvement of the quality in use of software products.
Keywords
software requirements,
requirement quality validation,
software product quality-in-use,
ISO/IEC 25010 standard.
Supporting agencies: This research was supported by Software Engineering Research & Development Group (GIDIS) – Pontifical Catholic University of Peru.
About the Authors
Luis CANCHARI
Universidad Continental
Peru
Peru
Master's degree in Systems Engineering, Computer Engineer, Specialist in Government and Digital Transformation, Software Project Manager. Computer Engineer with a master's degree in Systems Engineering. Experienced in planning, directing, and executing information technology projects in the public sector. Responsible for implementing technological tools to optimize management of hospital centers in ESSALUD (Junín Network and INCOR). I am part of a group of IT professionals who monitor servers and services of the SUNAT systems. Academic and researcher in software quality and the application of ICTs in educational innovation. Education degree holder, with experience in both basic and universityteaching.
Paula Maria ANGELERI
Universidad de Belgrano
Argentina
Argentina
Paula Maria Angeleri currently works at the Information Technology, University of Belgrano - Universidad de Belgrano, Argentina (UB). Paula does research in Teaching Methods, Software Engineering and Information Systems (Business Informatics). She is the research director of MyFEPS project (2010-current) MyFEPS': Methodologies and Framework for software product evaluation (Metodologías y Framework para la Evaluación de Productos Software). Angeleri is an expert in IT standardization, and she participates actively in ISO/IEC JTC1/SC7 Software and Systems Engineering
Subcommittee. She is an expert in the field ot Software Quality Standards (SW processes, management systems, software products, IT services and information security, among others standards).
Abraham Eliseo DÁVILA RAMÓN
Universidad Católica del Perú
Peru
Peru
Abraham Dávila is a researcher and professor at the Pontifical Catholic University of Peru (PUCP) since 2000. He is a principal research of the ProCalProSer Project (2013-2016 Phase I and 2017-2019 Phase II) and he is a founding member of the research group in software engineering (GIDIS-PUCP). Master's degree in Computer Science from PUCP and bachelor's degree in science with a major in Mechanical Engineering. He is member of the ISO/IEC working group of ISO/IEC 29110 standards. Their main areas of interest are computer quality (at the level of software process, products and service management) and education in software engineering.
References
1. PCM: RM. N° 041-2017-PCM. Uso Obligatorio de la Norma Técnica Peruana NTP-ISO/IEC 12207:2016. , Peru (2017).
2. ISO/IEC: ISO/IEC TR 29110-1:2016 Systems and software engineering — Lifecycle profiles for Very Small Entities (VSEs) — Part 1: Overview, Geneva (2016).
3. Demirel, S.T., Das, R.: Software requirement analysis: Research challenges and technical approaches. In: 6th International Symposium on Digital Forensic and Security, ISDFS 2018 - Proceeding. pp. 1–6. Institute of Electrical and Electronics Engineers Inc. (2018). https://doi.org/10.1109/ISDFS.2018.8355322.
4. Atoum, I., Baklizi, M.K., Alsmadi, I., Otoom, A.A., Alhersh, T., Ababneh, J., Almalki, J., Alshahrani, S.M.: Challenges of Software Requirements Quality Assurance and Validation: A Systematic Literature Review, (2021). https://doi.org/10.1109/ACCESS.2021.3117989.
5. Anuar, U., Ahmad, S., Emran, N.A.: A simplified systematic literature review: Improving Software Requirements Specification quality with boilerplates. In: 2015 9th Malaysian Software Engineering Conference, MySEC 2015. pp. 99–105. Institute of Electrical and Electronics Engineers Inc. (2015). https://doi.org/10.1109/MySEC.2015.7475203.
6. García-Mireles, G.A.: Addressing product quality characteristics using the ISO/IEC 29110. In: Mejia J., Munoz M., Rocha Á., C.-M.J. (ed.) Trends and Applications in Software Engineering. Advances in Intelligent Systems and Computing. pp. 25–34. Springer, Cham, Sinaloa (2016). https://doi.org/https://doi.org/10.1007/978-3-319-26285-7_3.
7. Hussain, A., Mkpojiogu, E.O.C., Kamal, F.M.: The Role of Requirements in the Success or Failure of Software Projects. In: International Soft Science Conference (ISSC) in International Review of Management and Marketing. pp. 306–311. EconjournalsLimonluk Mah. 24117 sokSahinRezidance, A6 33100 Yenisehir, Langkawi Island, Kedah, Malaysia (2016).
8. Niazi, M., Mahmood, S., Alshayeb, M., Qureshi, A.M., Faisal, K., Cerpa, N.: Toward Successful Project Management in Global Software Development. International Journal of Project Management. 34, 1553–1567 (2016). https://doi.org/https://doi.org/10.1016/j.ijproman.2016.08.008.
9. Bhardwaj, M., Rana, A.: Key Software Metrics and its Impact on each other for Software Development Projects. International Journal of Electrical and Computer Engineering (IJECE). 6, 242–248 (2016). https://doi.org/https://doi.org/10.11591/ijece.v6i1.8247.
10. Duran Toro, A.: Un Entorno Metodológico de Ingeniería de Requisitos para Sistemas de Información, https://idus.us.es/handle/11441/15365, (2000).
11. Mishra, D., Abdalhamid, S.: Software Quality Issues in SCRUM: A Systematic Mapping. Journal of Universal Computer Science. 24, 1690–1716 (2018).
12. Atoum, I.: A novel framework for measuring software quality-in-use based on semantic similarity and sentiment analysis of software reviews. Journal of King Saud University - Computer and Information Sciences. 32, 113–125 (2020). https://doi.org/10.1016/j.jksuci.2018.04.012.
13. Salomón, S., Duque, R., Montaña, J.L., Tenés, L.: Towards automatic evaluation of the Quality-in-Use in context-aware software systems. Journal of Ambient Intelligence and Humanized Computing. (2022). https://doi.org/10.1007/s12652-021-03693-w.
14. Canchari, L., Dávila, A.: Requirements Validation in the Information Systems Software Development: An Empirical Evaluation of Its Benefits for a Public Institution in Lima. In: Mejia J., Muñoz M., Rocha Á., A.C.-M.J. (ed.) Trends and Applications in Software Engineering. CIMPS 2019. Advances in Intelligent Systems and Computing. pp. 23–35. Springer Nature Switzerland AG 2020, Guanajuato, Mexico (2020). https://doi.org/https://doi.org/10.1007/978-3-030-33547-2_3.
15. ISO/IEC: ISO/IEC 25022:2016 Systems and software engineering — Systems and software quality requirements and evaluation (SQuaRE) — Measurement of quality in use. Springer US, Geneva (2016).
16. Kim, S.-H., Kim, W.-J.: Evaluation of Software Quality-in-use Attributes Based on Analysis Network Process. Cluster Computing. 22, 2101–2114 (2019). https://doi.org/https://doi.org/10.1007/s10586-018-2309-6.
17. ISO/IEC: ISO/IEC 25001:2014 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Planning and management, Geneva (2014).
18. Marín, B., Condori-Fernández, N., Pastor, O.: Calidad en Modelos Conceptuales: Un Análisis Multidimensional de Modelos Cuantitativos Basados en la ISO 9126. In: VIII Conferencia Anual de la Asociación Española de Métricas de Sistemas Informáticos. In Revista de Procesos y Métricas (RPM) - AEMES. pp. 153–167 (2007).
19. ISO/IEC: ISO/IEC 25010:2011 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models, Geneva (2011).
20. Fenton, N., Nell, M.: Software Metrics: Roadmap. In: Conference on the Future of Software Engineering - In 22nd International Conference on Software Engineering - ICSE. pp. 357–370, Limerick Ireland (2000). https://doi.org/https://doi.org/10.1145/336512.336588.
21. Estayno, M., Dapozo, G., Cuenca Pletsch, L., Greiner, C.: Modelos y Métricas para Evaluar Calidad de Software. In: XI Workshop de Investigadores en Ciencias de la Computación. pp. 382–388, San Juan, Argentina (2009).
22. Bevan, N.: Los Nuevos Modelos de ISO para la Calidad y la Calidad en Uso del Software. In: Calero, C., Moraga, A., and Piattini, M. (eds.) Calidad del Producto y Proceso Software. pp. 55–78. RA-MA, Madrid - España (2012).
23. Kurosu, M.: Usability, Quality in Use and the Model of Quality Characteristics. In: Human-Computer Interaction: Design and Evaluation - HCI. In Lecture Notes in Computer Science. pp. 227–237. Springer International Publishing Switzerland 2015, Los Angeles (2015). https://doi.org/10.1007/978-3-319-20901-2_21.
24. Atoum, I., Bong, C.H., Kulathuramaiyer, N.: Towards Resolving Software Quality-in-Use Measurement Challenges. Journal of Emerging Trends in Computing and Information Sciences. 5, 877–885 (2014).
25. Charters, E.: The Use of Think-aloud Methods in Qualitative Research An Introduction to Think-aloud Methods. Brock Education Journal. 12, 68–82 (2003). https://doi.org/https://doi.org/10.26522/brocked.V12I2.38.
26. Nielsen, J.: Thinking Aloud: The #1 Usability Tool, https://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/, last accessed 2021/05/30.
27. Sauro, J.: 10 Things to Know About the Post Study System Usability Questionnaire, https://measuringu.com/pssuq/, last accessed 2019/03/03.
28. Allasi, D., Dávila, A.: Financial impact on the adoption of software validation tasks in the analysis phase: A business case. In: Mejia J., Muñoz M., Rocha Á., Quiñonez Y., C.-M.J. (ed.) Trends and Applications in Software Engineering. CIMPS 2017. Advances in Intelligent Systems and Computing. pp. 106–116. Springer International Publishing AG 2018, Zacatecas, Mexico (2018). https://doi.org/https://doi.org/10.1007/978-3-319-69341-5_10.
29. Pardo, C., García, F., Pino, F., Piattini, M.: Producto y Proceso: Una Relación Compleja en la Ingeniería de Software. El Hombre y la Máquina. 67–72 (2013).
30. Runeson, P., Höst, M.: Guidelines for Conducting and Reporting Case Study Research in Software Engineering. Empirical Software Engineering. 14, 131–164 (2009). https://doi.org/https://doi.org/10.1007/s10664-008-9102-8.
31. Genero Bocco, M., Cruz-Lemus, J.A., PiattiniVelthuis, M.G.: Métodos de Investigación en Ingeniería de Software. Ra-Ma, Madrid, España (2013).
32. Pedrosa, I., Suárez-Álvarez, J., García-Cueto, E.: Evidencias sobre la Validez de Contenido: Avances Teóricos y Métodos para su Estimación. Acción Psicológica. 10, 3–18 (2014). https://doi.org/https://doi.org/10.5944/ap.10.2.11820.
33. Canchari, L.: La validación de requisitos de software como base del éxito de los proyectos de sistemas informáticos desarrollados e implementados en la Comisión Nacional para el Desarrollo y Vida sin Drogas-DEVIDA. (2018).
34. Pérez-Verdejo, J.M., Sánchez-García, J., Ocharán-Hernández, J.O., Mezura-Montes, E., Cortés-Verdín, K.: Requirements and GitHub Issues: An Automated Approach for Quality Requirements Classification. Programming and Computer Software. 47, (2021). https://doi.org/10.1134/S0361768821080193.
35. González-Sánchez, J.-L., Montero-Simarro, F., Gutiérrez-Vela, F.-L.: Evolución del Concepto de Usabilidad como Indicador de Calidad del Software. El Profesional de la Informacion. 21, 529–536 (2012). https://doi.org/https://doi.org/10.3145/epi.2012.sep.13.
36. Covella, G., Olsina, L.: Medición y Evaluación de Calidad en Uso: Un Caso de Estudio para una Aplicación E-Learning. In: Castro, J., Cernuzzi, L., and Gordillo, S.E. (eds.) IX Conferencia Iberoamericana de Software Engineering - CIbSE. pp. 317–330. , La Plata, Argentina (2006).
37. Sierra González, J.C.: Métodos de Evaluación de Usabilidad para Sistemas de Información Web: Una Revisión. In: Conferencia Colombiana en Gestión de Sistemas de Información y de TIC - GSTIC. pp. 1–13. Universidad Nacional de Colombia, Manizalez (2013).
38. Hornbæk, K.: Current Practice in Measuring Usability: Challenges to Usability Studies and Research. International Journal of Human Computer Studies. 64, 79–102 (2006). https://doi.org/10.1016/j.ijhcs.2005.06.002.
39. Dávila Nicanor, L., MejiaAlvarez, P.: Evaluación de la Calidad de Software en Sistemas de Información en Internet. In: Congreso de IngenierıaElectrica, CInvestAv-IPN. pp. 1–11. , Zacatenco (2003).
Review
For citations:
CANCHARI L., ANGELERI P., DÁVILA RAMÓN A. Requirements Validation and Its Impact in Software Quality in Use: A Case Study. Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS). 2023;35(6):7-28. (In Russ.) https://doi.org/10.15514/ISPRAS-2023-35(6)-1
Email this article 