Role of Agile Methodologies for Ensuring Quality in Complex Systems: A Systematic Literature Review

Ihsan ullah; Jaweria Awan; Fatima Gillani; Iqra Shahzad

Authors

Ihsan ullah National University of Modern Languages
Jaweria Awan National University of Modern Languages
Fatima Gillani National University of Modern Languages
Iqra Shahzad National University of Modern Languages

Keywords:

Agile methodology, software quality, software quality attributes, complex systems, complex systems quality

Abstract

In software development, the selection of a software process model set the base for the success of a software product. An inappropriate selection may lead to a delay in project release, introduce defects and make the project difficult to update. This lack of quality characteristics may lead to the risk of losing customer expectations as well as the failure of the project itself. In the case of complex systems, the problems become more severe. To meet such expectations, agile methodologies are used to ensure quality in software and meet customers’ expectations. There is currently no literature that gives insights into the role of agile methodologies in ensuring quality in complex systems. The purpose of this paper is to evaluate the effectiveness and the impact of agile methodology in achieving the quality of complex systems.

For this, we perform a Systematic Literature Review (SLR) and define a review protocol. By performing a thorough search and screening, we selected 39 papers related to agile methods and complex systems. Our analysis shows that complex systems have various requirements of quality attributes some of the complex systems mainly focus on security, reliability, and efficiency whereas other emphasizes safety, response time, and maintainability. Our analysis also shows that agile methodologies are widely used for the development of complex systems because ensuring the quality requirements of complex systems is not possible with the use of traditional methods of software development.

References

A. Cockburn, “The end of software engineering and the start of economic-cooperative gaming,” Comput. Sci. Inf. Syst., vol. 1, no. 1, pp. 1–32, 2004, doi: 10.2298/csis0401001c.

M. Cohn and D. Ford, “Introducing an agile process to an organization,” Computer (Long. Beach. Calif)., vol. 36, no. 6, pp. 74–78, 2003, doi: 10.1109/MC.2003.1204378.

A. Qumer and B. Henderson-Sellers, “A framework to support the evaluation, adoption and improvement of agile methods in practice,” J. Syst. Softw., vol. 81, no. 11, pp. 1899–1919, Nov. 2008, doi: 10.1016/J.JSS.2007.12.806.

J. A. Livermore, “Factors that impact implementing an agile software development methodology,” Conf. Proc. - IEEE SOUTHEASTCON, pp. 82–86, 2007, doi: 10.1109/SECON.2007.342860.

J. Kanwal, O. Maqbool, H. A. Basit, and M. A. Sindhu, “Evolutionary Perspective of Structural Clones in Software,” IEEE Access, vol. 7, no. January, pp. 58720–58739, 2019, doi: 10.1109/ACCESS.2019.2913043.

T. Setiadi and S. B. Premapasha, “Scrum implementation for online transaction processing (oltp) in hospital management,” Proceeding 2018 12th Int. Conf. Telecommun. Syst. Serv. Appl. TSSA 2018, Jul. 2018, doi: 10.1109/TSSA.2018.8708797.

S. Abdalhamid, A. O. M. Mohammed, and A. Mishra, “Agile and quality: A systematic mapping study,” Proc. 2019 Int. Conf. Comput. Sci. Renew. Energies, ICCSRE 2019, Jul. 2019, doi: 10.1109/ICCSRE.2019.8807763.

R. S. Wingo and M. M. Tanik, “Using an agile software development methodology for a complex problem domain,” Conf. Proc. - IEEE SOUTHEASTCON, vol. 2015-June, no. June, Jun. 2015, doi: 10.1109/SECON.2015.7132890.

F. S. Silva, F. S. F. Soares, A. L. Peres, I. M. De Azevedo, P. P. Pinto, and S. R. De Lemos Meira, “A reference model for agile quality assurance: Combining agile methodologies and maturity models,” Proc. - 2014 9th Int. Conf. Qual. Inf. Commun. Technol. QUATIC 2014, pp. 139–144, Dec. 2014, doi: 10.1109/QUATIC.2014.25.

A. L. and S. A. Jain P., “Current state of the research in agile quality development | IEEE Conference Publication | IEEE Xplore,” 3rd International Conference on Computing for Sustainable Global Development, 2016.

M. B. Legowo, B. Indiarto, and D. Prayitno, “Agile Software Methodology with Scrum for Developing Quality Assurance System,” Proc. - 2019 2nd Int. Conf. Comput. Informatics Eng. Artif. Intell. Roles Ind. Revolut. 4.0, IC2IE 2019, pp. 104–109, Sep. 2019, doi: 10.1109/IC2IE47452.2019.8940831.

A. I. M. Leite, “An Approach to Support the Specification of Agile Artifacts in the Development of Safety-Critical Systems,” Proc. - 2017 IEEE 25th Int. Requir. Eng. Conf. RE 2017, pp. 526–531, Sep. 2017, doi: 10.1109/RE.2017.43.

A. Agarwal, N. K. Garg, and A. Jain, “Quality assurance for product development using Agile,” ICROIT 2014 - Proc. 2014 Int. Conf. Reliab. Optim. Inf. Technol., pp. 44–47, 2014, doi: 10.1109/ICROIT.2014.6798281.

M. Tanveer, “Agile for large scale projects - A hybrid approach,” 2015 Natl. Softw. Eng. Conf. NSEC 2015, pp. 14–18, Feb. 2016, doi: 10.1109/NSEC.2015.7396338.

B. Kitchenham and S. M. Charters, “Guidelines for performing Systematic Literature Reviews in Software Engineering Guidelines for performing Systematic Literature Reviews in Software Engineering EBSE Technical Report EBSE-2007-01 Software Engineering Group School of Computer Science and Ma,” no. October 2021, 2007.

N. Yildirim and A. Varol, “A research on security vulnerabilities in online and mobile banking systems,” 7th Int. Symp. Digit. Forensics Secur. ISDFS 2019, pp. 1–5, 2019, doi: 10.1109/ISDFS.2019.8757495.

L. Lopez, J. Partanen, P. Rodriguez, and S. Martinez-Fernandez, “How practitioners manage quality requirements in rapid software development: A survey,” Proc. - 2018 1st Int. Work. Qual. Requir. Agil. Proj. QuaRAP 2018, pp. 14–17, 2018, doi: 10.1109/QuaRAP.2018.00009.

D. Schneider and M. Trapp, “Runtime safety models in open systems of systems,” 8th IEEE Int. Symp. Dependable, Auton. Secur. Comput. DASC 2009, pp. 455–460, 2009, doi: 10.1109/DASC.2009.111.

P. Subsorn and S. Limwiriyakul, “A case study of internet banking security of mainland Chinese banks: A customer perspective,” Proc. - 2012 4th Int. Conf. Comput. Intell. Commun. Syst. Networks, CICSyN 2012, pp. 189–195, 2012, doi: 10.1109/CICSyN.2012.43.

H. M. Chen and R. Kazman, “Architecting ultra-large-scale green information systems,” 2012 1st Int. Work. Green Sustain. Software, GREENS 2012 - Proc., pp. 69–75, 2012, doi: 10.1109/GREENS.2012.6224259.

G. W. Noblit and R. D. Hare, “Meta-ethnography : synthesizing qualitative studies,” p. 88, 1988.

J. Kanwal, H. A. Basit, and O. Maqbool, “Structural clones: An evolution perspective,” 2018 IEEE 12th Int. Work. Softw. Clones, IWSC 2018 - Proc., vol. 2018-January, pp. 9–15, Mar. 2018, doi: 10.1109/IWSC.2018.8327313.

C. Kaufmann, A. Kock, and H. G. Gemünden, “Emerging strategy recognition in agile portfolios,” Int. J. Proj. Manag., vol. 38, no. 7, pp. 429–440, Oct. 2020, doi: 10.1016/J.IJPROMAN.2020.01.002.

O. Michael, L. T. Lun, and K. E. Keong, “Methodology to improve Safety Critical SoC based platform: A case study,” IEEE Int. Reliab. Phys. Symp. Proc., vol. 2021-March, pp. 12–15, 2021, doi: 10.1109/IRPS46558.2021.9405223.

E. P. Jharko, “The methodology of software quality assurance for safety-critical systems,” 2015 Int. Sib. Conf. Control Commun. SIBCON 2015 - Proc., 2015, doi: 10.1109/SIBCON.2015.7147057.

M. Younas, D. N. A. Jawawi, I. Ghani, and R. Kazmi, “Non-Functional Requirements Elicitation Guideline for Agile Methods,” J. Telecommun. Electron. Comput. Eng., vol. 9, no. 3-4 Special Issue, pp. 137–142, 2017.

M. N. Aydin, F. Harmsen, K. Van Slooten, and R. A. Stegwee, “An agile information systems development method in use,” Turkish J. Electr. Eng. Comput. Sci., vol. 12, no. 2, pp. 127–138, 2004.

S. Al-Saqqa, S. Sawalha, and H. Abdelnabi, “Agile software development: Methodologies and trends,” Int. J. Interact. Mob. Technol., vol. 14, no. 11, pp. 246–270, 2020, doi: 10.3991/ijim.v14i11.13269.

J. Kanwal, “Refactoring Patterns Study in Code Clones during Software Evolution,” 2017 IEEE 11th Int. Work. Softw. Clones, no. July 2019, pp. 1–2, 2017, doi: 10.1109/IWSC.2017.7880508.

L. Williams, “A Survey of Agile Development Methodologies,” Univercsty West Engl., pp. 209–227, 2007.

B. Henderson-Sellers and M. K. Serour, “Creating a Dual-Agility Method: The Value of Method Engineering,” https://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/jdm.2005100101, vol. 16, no. 4, pp. 1–24, Jan. 1AD, doi: 10.4018/JDM.2005100101.

A. Taufiq, T. Raharjo, and A. Wahbi, “Scrum evaluation to increase software development project success: A case study of digital banking company,” 2020 Int. Conf. Adv. Comput. Sci. Inf. Syst. ICACSIS 2020, pp. 241–246, Oct. 2020, doi: 10.1109/ICACSIS51025.2020.9263235.

J. of C. S. IJCSIS, “Cost Efficient Scrum Process Methodology to Improve Agile Software Development,” IJCSIS Vol 18 No. 4 April 2020 Issue, Jan. 2020.

A. Braz, C. M. F. Rubira, and M. Vieira, “Development of Complex Software with Agile Method,” Proc. - 2015 Agil. Conf. Agil. 2015, pp. 97–101, 2015, doi: 10.1109/Agile.2015.18.

R. Tommy, M. Mhaisekar, S. Kallepally, L. Varghese, S. Ahmed, and M. D. Somaraju, “Dynamic quality control in agile methodology for improving the quality,” 2015 IEEE Int. Conf. Comput. Graph. Vis. Inf. Secur. CGVIS 2015, pp. 233–236, 2016, doi: 10.1109/CGVIS.2015.7449927.

S. M. Faizi, S. Rahman, and K. Hopkins, “Implementing Large Enterprise Resource Planning Systems with Agile Methods,” ICIET 2019 - 2nd Int. Conf. Innov. Eng. Technol., pp. 23–24, 2019, doi: 10.1109/ICIET48527.2019.9290587.

T. Mcbride and M. Lepmets, “Quality assurance in agile safety-critical systems development,” Proc. - 2016 10th Int. Conf. Qual. Inf. Commun. Technol. QUATIC 2016, pp. 44–51, Jan. 2017, doi: 10.1109/QUATIC.2016.016.

D. Oxenham, “Agile approaches to meet complex system of system engineering challenges: A defence perspective,” 2010 5th Int. Conf. Syst. Syst. Eng. SoSE 2010, 2010, doi: 10.1109/SYSOSE.2010.5544092.

H. Zan, L. Pan, and Y. Wang, “Design & implementation of laboratory information management system based on agile method,” 2012 2nd Int. Conf. Consum. Electron. Commun. Networks, CECNet 2012 - Proc., pp. 2490–2493, 2012, doi: 10.1109/CECNet.2012.6201497.

M. Younas et al., “Elicitation of Nonfunctional Requirements in Agile Development Using Cloud Computing Environment,” IEEE Access, vol. 8, pp. 209153–209162, 2020, doi: 10.1109/ACCESS.2020.3014381.