A Conceptual Framework for Metrics Selection: SMeS

Zubaidah Bukhari, Jamaiah Yahaya, Aziz Deraman

Abstract


Measurement is an emerging field of software engineering. A systematic and efficient measurement process can assist in the production of quality government web applications since it can support planning, monitoring, and improving the software development process. The quality of software products is often measured using the metrics-based method. Various types of software metrics have been suggested in the last three decades to measure software quality, track software progress, estimate effort and certify software products. However, the process of identifying and determining a suitable software metrics is still lacking in term of guidance and structure. Without an effective method to evaluate and select suitable metrics, the time spent for selecting the correct and relevant metrics may offset the advantages of using them. In this paper, using the Evaluation Theory as the base theory and building upon the integration of Goal Question Metric (GQM) approach, a conceptual framework of software metrics selection (SMeS) was proposed. The main elements of the proposed conceptual framework include goal-based metrics selection process integrating with GQM, evaluation criteria, reference standard, and synthesis technic in decision making mechanisms. The integrated framework produces a software metrics selection process which is more structured, transparent, and directive in choosing a set of relevant metrics that may help the organizations’ measurement program. The result from this study improves the existing metrics software selection model and serves as a guideline in implementing a clear and practical software metrics selection.

Keywords


software metrics; software quality; evaluation theory; goal question metrics

Full Text:

PDF

References


J. E. Gaffney Jr, “Metrics in software quality assurance,†in Proceedings of the ACM’81 conference, 1981, pp. 126–130.

I. R. Management Association, Application Development and Design: Concepts, Methodologies, Tools, and Applications: Concepts, Methodologies, Tools, and Applications. IGI Global, 2017.

A. Jula, E. Sundararajan, and Z. Othman, “Cloud computing service composition: A systematic literature review,†Expert Syst. Appl., vol. 41, no. 8, pp. 3809–3824, Jun. 2014.

Y. Jamaiah, D. Aziz, K. Siti Sakira, and A. Ruzita, “INTELLIGENT SOFTWARE QUALITY MODEL: THE THEORETICAL FRAMEWORK,†Proc. 3rd Int. Conf. Comput. Informatics, ICOCI, 2011.

H. Wang, T. M. Khoshgoftaar, R. Wald, and A. Napolitano, “A comparative study on the stability of software metric selection techniques,†Proc. - 2012 11th Int. Conf. Mach. Learn. Appl. ICMLA 2012, vol. 2, pp. 301–307, 2012.

M. Noman, T. Tahir, and G. Rasool, “An assessment of key factors for implementing measurement processes in SMEs,†2017 Int. Conf. Open Source Syst. Technol., no. March 2018, pp. 60–66, 2017.

C. Jones, A Guide to Selecting Software Measures and Metrics. CRC Press, 2017.

M. Unterkalmsteiner, Coordinating Requirements Engineering and Software Testing. 2015.

T. Tahir, G. Rasool, and M. Noman, “A Systematic Mapping Study on Software Measurement Programs in SMEs,†e-Informatica Softw. Eng. J., vol. 12, no. 1, pp. 133–165, 2018.

M. Díaz-Ley, F. García, and M. Piattini, “Implementing a software measurement program in small and medium enterprises: a suitable framework,†IET Softw., vol. 2, no. 5, pp. 417–436, 2008.

C. Gencel, K. Petersen, A. A. Mughal, and M. I. Iqbal, “A decision support framework for metrics selection in goal-based measurement programs: GQM-DSFMS,†J. Syst. Softw., vol. 86, no. 12, pp. 3091–3108, 2013.

T. Tahir, G. Rasool, and C. Gencel, “A systematic literature review on software measurement programs,†Inf. Softw. Technol., vol. 73, pp. 101–121, 2016.

S. A. Ansar and R. A. Khan, “A Phase-wise Review of Software Security Metrics,†in Networking Communication and Data Knowledge Engineering, Springer, 2018, pp. 15–25.

R. M. Carvalho, R. M. de Castro Andrade, and K. M. de Oliveira, “AQUArIUM-A suite of software measures for HCI quality evaluation of ubiquitous mobile applications,†J. Syst. Softw., vol. 136, pp. 101–136, 2018.

N. H. Mansol, N. H. M. Alwi, and W. Ismail, “Managing organizational culture requirement for business continuity management (BCM) implementation using goal-question-metric (GQM) approach,†J. Teknol., vol. 78, no. 12–3, pp. 13–22, 2016.

T. Tahir and A. Jafar, “A Systematic Review on Software Measurement Programs,†Front. Inf. Technol. (FIT), 2011, vol. 73, pp. 39–44, 2011.

D. Aziz, Y. Jamaiah, and Z. A. Zaiha Nadiah, “Software Ageing Measurement Framework Based on GQM Structure,†J. Softw. Syst. Dev., vol. 2014, 2014.

P. Berander and P. Jönsson, “A goal question metric based approach for efficient measurement framework definition,†Proc. 2006 ACM/IEEE Int. Symp. Int. Symp. Empir. Softw. Eng. - ISESE ’06, p. 316, 2006.

N. Kumar, R. Dadhich, and A. Shastri, “Quality Models for Web-based Application: A Comparative Study,†Int. J. Comput. Appl., vol. 125, no. 2, 2015.

S. Islam and P. Falcarin, “Measuring security requirements for software security,†in Cybernetic Intelligent Systems (CIS), 2011 IEEE 10th International Conference on Cybernetic Intelligent Systems, 2011, pp. 70–75.

V. R. Basili, M. Lindvall, M. Regardie, C. Seaman, J. Heidrich, J. Münch, D. Rombach, and A. Trendowicz, “Linking software development and business strategy through measurement,†no. April, pp. 57–65, 2010.

F. Yahya, R. J. Walters, and G. B. Wills, “Using Goal-Question-Metric (GQM) Approach to Assess Security in Cloud Storage,†in Enterprise Security, Springer, 2017, pp. 223–240.

V. Garousi, M. Felderer, M. Kuhrmann, and K. Herkiloğlu, “What industry wants from academia in software testing?: Hearing practitioners’ opinions,†in Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, 2017, pp. 65–69.

S. A. Muaz, Y. K. Chiam, and B. S. Galadanci, “A GQM-Based Method to Support Elicitation of Sustainability Requirements for Mobile Applications,†Adv. Sci. Lett., vol. 24, no. 2, pp. 1268–1272, 2018.

K. Petersen, C. Gencel, N. Asghari, and S. Betz, “An elicitation instrument for operationalising GQM+ Strategies (GQM+ S-EI),†Empir. Softw. Eng., vol. 20, no. 4, pp. 968–1005, 2015.

V. R. Basili, M. Lindvall, M. Regardie, C. Seaman, J. Heidrich, J. Münch, D. Rombach, and A. Trendowicz, “Linking software development and business strategy through measurement,†Computer (Long. Beach. Calif)., vol. 43, pp. 57–65, 2010.

M. Villavicencio, “Facts and Perceptions Regarding Software Measurement in Education and in Practice: Preliminary Results,†J. Softw. Eng. Appl., vol. 4, no. 4, pp. 227–234, 2011.

M. Scriven, Evaluation Thesaurus. SAGE Publications, 1991.

F. H. Al-Tarawneh, “A framework for COTS software evaluation and selection for COTS mismatches handling and non-functional requirements,†Universiti Utara Malaysia, Kedah, Malaysia, 2014.

M. Zarour, “Methods to evaluate lightweight software process assessment methods based on evaluation theory and engineering design principles,†Ecole de Technologie Superieure (Canada), 2009.

S. T. Acuña, A. De Antonio, X. Ferré, M. López, and L. Maté, “The Software Process: Modelling, Evaluation and Improvement,†Handb. Softw. Eng. Knowl. Eng., vol. 1 Fundamen, no. 0, pp. 193–237, 2001.

S. F. P. Mohamad, “A process based approach software certification model for agile and secure environment,†Universiti Utara Malaysia, Kedah, Malaysia, 2015.

M. Zarour, “The use of evaluation theory and square standards to develop user needs experience evaluation method,†J. Eng. Technol., vol. 6, no. 1, 2018.

IEEE Standard Dictionary of Measures to Produce Reliable Software. IEEE, 1996.

J. Dobbins, “IEEE guide for the use of IEEE standard dictionary of measures to produce reliable software,†Inst. Electr. Electron. Eng. New York, NY, USA, Tech. Rep. IEEE Std 982.2–1988, 1989.

Y. Xia, G. Yan, X. Jiang, and Y. Yang, “A new metrics selection method for software defect prediction,†2014 IEEE Int. Conf. Prog. Informatics Comput., pp. 433–436, May 2014.

S. Gu, S. Y. Kim, H. Jeong, and K.-A. Sohn, “Constructing and Exploiting Software Metrics Networks for Software Quality Assessment,†2015 5th Int. Conf. IT Converg. Secur., pp. 1–5, 2015.

H. Bahadur and D. Kumar, “Construction of Membership Function for Software Metrics,†Procedia - Procedia Comput. Sci., vol. 46, no. Icict 2014, pp. 933–940, 2015.

N. Fenton and J. Bieman, Software Metrics: A Rigorous and Practical Approach. CRC Press, 2014.

A. Stefani and M. Xenos, “Meta-metric evaluation of e-commerce-related metrics,†Electron. Notes Theor. Comput. Sci., vol. 233, pp. 59–72, 2009.

R. S. Pressman, Software Engineering A Practitioner’s Approach Seventh Edition. 2010.

C. Jones, “Evaluating Software Metrics and Software Measurement Practices,†Ma,cook, pp. 1–100, 2014.

K. V Padmini, H. M. N. Dilum Bandara, and I. Perera, “Use of software metrics in agile software development process,†in Moratuwa Engineering Research Conference (MERCon), 2015, 2015, pp. 312–317.

Z. G. Dand and H. Vasishtha, “Analysis and Evaluation of Quality Metrics in Software Engineering,†Int. J. Adv. Res. Comput. Commun. Eng., vol. 4, no. 4, 2015.

R. A. Austin and J. M. Case Jr, “Software metrics useful tools or wasted measurements,†DTIC Document, 1990.

R. S. Pressman, Software Engineering: A Practitioner’s Approach. Palgrave Macmillan, 2005.

T. Hall and N. Fenton, “Implementing effective software metrics programs,†IEEE Softw., vol. 14, no. 2, pp. 55–64, 1997.

P. Bozzelli, Q. Gu, and P. Lago, “A systematic literature review on green software metrics,†VU Univ. Amsterdam, 2013.

R. Baidya, P. K. Dey, S. K. Ghosh, and K. Petridis, “Strategic maintenance technique selection using combined quality function deployment, the analytic hierarchy process and the benefit of doubt approach,†Int. J. Adv. Manuf. Technol., vol. 94, no. 1–4, pp. 31–44, 2018.

M.-C. Tsai, Y.-Y. Chien, and C.-C. Cheng, “Upgrading service quality of mobile banking,†Int. J. Mob. Commun., vol. 16, no. 1, pp. 82–115, 2018.

N. Raissi, “Using QFD method for assessing higher education programs: an examination of key stakeholders’ visions,†Int. J. Manag. Educ., vol. 12, no. 1, pp. 70–93, 2018.

E. Bulut, O. Duru, and S. T. Huang, “A multidimensional QFD design for the service quality assessment of Kansai International Airport, Japan,†Total Qual. Manag. Bus. Excell., vol. 29, no. 1–2, pp. 202–224, 2018.

T. T. Sousa-Zomer and P. A. C. Miguel, “A QFD-based approach to support sustainable product-service systems conceptual design,†Int. J. Adv. Manuf. Technol., vol. 88, no. 1–4, pp. 701–717, 2017.

R. S. Schillo, D. A. Isabelle, and A. Shakiba, “Linking advanced biofuels policies with stakeholder interests: A method building on Quality Function Deployment,†Energy Policy, vol. 100, pp. 126–137, 2017.

M. K. Santos, A. M. F. Danilevicz, and R. Tubino, “Environmental service providers assessment: A multi-criteria model applied to industrial waste,†J. Clean. Prod., vol. 159, pp. 374–387, 2017.

D. Sarkar and R. Panchal, “Quality Function Deployment (QFD): A Six Sigma Tool for Performance Monitoring of Ready Mixed Concrete,†framework, vol. 4, no. 2, 2017.

B. Fauziah, Y. Jamaiah, D. Aziz, and H. Abdul Razak, “SPQF: Software Process Quality Factor,†in Electrical Engineering and Informatics (ICEEI), 2011 International Conference on, 2011, pp. 1–7.

K. Nanath and R. Pillai, “A Model for Cost-Benefit Analysis of Cloud Computing.,†J. Int. Technol. …, pp. 93–118, 2013.

V. R. Basili, M. Lindvall, M. Regardie, C. Seaman, J. Heidrich, J. Münch, D. Rombach, and A. Trendowicz, “Linking Software Development and Business Strategy through Measurement,†no. April, pp. 57–65, 2010.

N. Alshahwan, M. Harman, A. Marchetto, R. Tiella, and P. Tonella, “Crawlability metrics for web applications,†in Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on, 2012, pp. 151–160.

L. Olsina and G. Rossi, “Measuring Web application quality with WebQEM,†MultiMedia, IEEE, vol. 9, no. 4. pp. 20–29, 2002.

L. Baresi, F. Garzotto, and P. Paolini, “From web sites to web applications: New issues for conceptual modeling,†Int. Conf. Concept. Model. Springer Berlin Heidelb., pp. 89–100, 2000.

D. R. Danielson, “Web navigation and the behavioral effects of constantly visible site maps,†Interact. Comput., vol. 14, no. 5, pp. 601–618, 2002.

R. Dörner and P. Grimm, “Three-dimensional Beans—creating Web content using 3D components in a 3D authoring environment,†in Proceedings of the fifth symposium on Virtual reality modeling language (Web3D-VRML), 2000, pp. 69–74.

Z. Zhou, “Evaluating websites using a practical quality model.,†2009.

B. Clifton, Advanced web metrics with Google Analytics. John Wiley & Sons, 2012.

A. Kolios, V. Mytilinou, E. Lozano-Minguez, and K. Salonitis, “A comparative study of multiple-criteria decision-making methods under stochastic inputs,†Energies, vol. 9, no. 7, pp. 1–21, 2016.

R. R. Kumar and C. Kumar, “A Multicriteria Decision-Making Method for Cloud Service Selection and Ranking,†in Advances in Computer and Computational Sciences, Springer, 2018, pp. 139–147.

I. C. Study and A. Jayant, “An Analytical Hierarchy Process ( AHP ) Based Approach for Supplier Selection : An Automotive An Analytical Hierarchy Process ( AHP ) Based Approach for Supplier Selection : An Automotive Industry Case Study,†Int. J. Latest Technol. Eng. Manag. Appl. Sci., vol. VIII, no. January, 2018.

A. Awasthi, K. Govindan, and S. Gold, “Multi-tier sustainable global supplier selection using a fuzzy AHP-VIKOR based approach,†Int. J. Prod. Econ., vol. 195, pp. 106–117, 2018.

A. Hammouri, “An integrated AHP-topsis methodology to evaluate for adoption cots database components based on usability,†J. Theor. Appl. Inf. Technol., vol. 96, no. 1, pp. 270–281, 2018.

T. Yaghoobi, “Prioritizing key success factors of software projects using fuzzy AHP,†J. Softw. Evol. Process, vol. 30, no. 1, 2018.




DOI: http://dx.doi.org/10.18517/ijaseit.8.6.6441

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development