Now showing 1 - 10 of 11
  • Publication
    Data-Driven Technical Debt Management: Software Engineering or Data Science Challenge?
    Software technical debt (TD) is a relevant software engineering problem. Only if properly managed can TD provide benefits while avoiding risks. Current TD management (TDM) support is limited. Recent advances in software engineering (SE) and data science (DS) promote data-driven TDM. In this paper, we summarize experiences concerning data-driven TDM gained in several research projects with industry. We report challenges and their consequences, propose solutions, and sketch improvement directions.
  • Publication
    Continuously Assessing and Improving Software Quality With Software Analytics Tools: A Case Study
    ( 2019)
    Martínez-Fernández, Silverio
    ;
    ; ;
    Franch, Xavier
    ;
    López, Lidia
    ;
    Ram, Prabhat
    ;
    Rodríguez, Pilar
    ;
    Aaramaa, Sanja
    ;
    Bagnato, Alessandra
    ;
    Choras, Michal
    ;
    Partanen, Jari
    In the last decade, modern data analytics technologies have enabled the creation of software analytics tools offering real-time visualization of various aspects related to software development and usage. These tools seem to be particularly attractive for companies doing agile software development. However, the information provided by the available tools is neither aggregated nor connected to higher quality goals. At the same time, assessing and improving the software quality has also been the key targets for the software engineering community, yielding several proposals for standards and software quality models. Integrating such quality models into software analytics tools could close the gap by providing the connection to higher quality goals. This paper aims at understanding whether the integration of quality models into software analytics tools provides understandable, reliable, useful, and relevant information at the right level of detail about the quality of a process or product and whether practitioners intend to use it. Over the course of more than a year, four companies involved in this case study deployed such a tool to assess and improve software quality in several projects. We used standardized measurement instruments to elicit the perception of 22 practitioners regarding their use of the tool. We complemented the findings with debriefing sessions held at the companies. In addition, we discussed challenges and lessons learned with four practitioners leading the use of the tool. The quantitative and qualitative analyses provided positive results, i.e., the practitioners' perception with regard to the tool's understandability, reliability, usefulness, and relevance was positive. Individual statements support the statistical findings, and constructive feedback can be used for future improvements. We conclude that the potential for future adoption of quality models within software analytics tools definitely exists and encourage other practitioners to use the presented seven challenges and seven lessons learned and adopt them in their companies.
  • Publication
    Empirical software engineering experts on the use of students and professionals in experiments
    ( 2018)
    Falessi, Davide
    ;
    Juristo, Natalia
    ;
    Wohlin, Claes
    ;
    Turhan, Burak
    ;
    Münch, Jürgen
    ;
    ;
    Oivo, Markku
    [Context] Controlled experiments are an important empirical method to generate and validate theories. Many software engineering experiments are conducted with students. It is often claimed that the use of students as participants in experiments comes at the cost of low external validity while using professionals does not. [Objective] We believe a deeper understanding is needed on the external validity of software engineering experiments conducted with students or with professionals. We aim to gain insight about the pros and cons of using students and professionals in experiments. [Method] We performed an unconventional, focus group approach and a follow-up survey. First, during a session at ISERN 2014, 65 empirical researchers, including the seven authors, argued and discussed the use of students in experiments with an open mind. Afterwards, we revisited the topic and elicited experts' opinions to foster discussions. Then we derived 14 statements and asked the ISERN attendees excluding the authors, to provide their level of agreement with the statements. Finally, we analyzed the researchers' opinions and used the findings to further discuss the statements. [Results] Our survey results showed that, in general, the respondents disagreed with us about the drawbacks of professionals. We, on the contrary, strongly believe that no population (students, professionals, or others) can be deemed better than another in absolute terms. [Conclusion] Using students as participants remains a valid simplification of reality needed in laboratory contexts. It is an effective way to advance software engineering theories and technologies but, like any other aspect of study settings, should be carefully considered during the design, execution, interpretation, and reporting of an experiment. The key is to understand which developer population portion is being represented by the participants in an experiment. Thus, a proposal for describing experimental participants is put forward.
  • Publication
    Quality-aware architectural model transformations in adaptive mashups user interfaces
    ( 2018)
    Criado, Javiera
    ;
    Martínez-Fernández, Silverio
    ;
    Ameller, David
    ;
    Iribarne, Luis
    ;
    Padilla, Nicolás
    ;
    Mashup user interfaces provides their functionality through the combination of different services. The integration of such services can be solved by using reusable and third-party components. Furthermore, these interfaces must be adapted to user preferences, context changes, user interactions and component availability. Model transformation is a useful mechanism to address this adaptation but normally these operations only focus on the functional requirements. In this sense, quality attributes should be included in the adaptation process to obtain the best adapted mashup user interface. This paper proposes a generic quality-aware transformation process to support the adaptation of software architectures. The transformation process has been applied in ENIA, a geographic information system, by constructing a specific quality model for the adaptation of mashup user interfaces. This model is taken into account for evaluating the different transformation alternatives and choosing the one that maximizes the quality assessments. The approach has been validated by a set of adaptation scenarios that are intended to maximize different quality factors and therefore apply distinct combinations of metrics.
  • Publication
    Four commentaries on the use of students and professionals in empirical software engineering experiments
    ( 2018)
    Feldt, Robert
    ;
    Zimmermann, Thomas
    ;
    Bergersen, Gunnar R.
    ;
    Falessi, Davide
    ;
    ;
    Juristo, Natalia
    ;
    Münch, Jürgen
    ;
    Oivo, Markku
    ;
    Runeson, Per
    ;
    Shepperd, Martin
    ;
    Sjøberg, Dag I.K.
    ;
    Turhan, Burak
    The relative pros and cons of using students or practitioners in experiments in empirical software engineering have been discussed for a long time and continue to be an important topic. Following the recent publication of ""Empirical software engineering experts on the use of students and professionals in experiments"" by Falessi, Juristo, Wohlin, Turhan, Münch, Jedlitschka, and Oivo (EMSE, February 2018) we received a commentary by Sjøberg and Bergersen. Given that the topic is of great methodological interest to the community and requires nuanced treatment, we invited two editorial board members, Martin Shepperd and Per Runeson, respectively, to provide additional views. Finally, we asked the authors of the original paper to respond to the three commentaries. Below you will find the result. Even though we are under no illusion that these views settle the issue we hope you find them interesting and illuminating, and that they can help the empirical software engineering community navigate some of the subtleties involved when selecting representable samples of human subjects.
  • Publication
    4th International Workshop on Conducting Empirical Studies in Industry (CESI 2016). Post-workshop Report
    ( 2017)
    Duarte, Carlos Henrique
    ;
    ;
    Bener, Ayse
    Few would deny today the importance of empirical studies in the field of Software Engineering. An increasing number of studies are being conducted involving the software industry, but, while literature abounds on idealistic empirical procedures, relatively little is known about the dynamics and complexity of conducting empirical studies in the software industry. How research results are put into action in industrial settings and how much cross company learning takes place through replication of empirical studies in different contexts? What are the impediments when attempting to follow prescriptive procedures in the organizational setting and how to best handle them? These drivers underly the organization of the fourth in a series of workshops, CESI 2016, held on 17th May, 2016 at ICSE 2016. This report summarizes the workshop details and the proceedings of the day.
  • Publication
    The electronic, personalizable Rosetta system for dementia care: Exploring the user-friendliness, usefulness and impact
    ( 2016)
    Hattink, B.J.J.
    ;
    Meiland, F.J.M.
    ;
    Overmars-Marx, T.
    ;
    Boer, M.E. de
    ;
    Ebben, P.W.G.
    ;
    Blanken, M. van
    ;
    Verhaeghe, S.
    ;
    Stalpers-Croeze, I.I.N.W.
    ;
    ;
    Flick, Simone
    ;
    Leeuw, J. van der
    ;
    Karkowski, I.P.
    ;
    Dröes, R.M.
    Purpose: This research aimed to integrate three previously developed assistive technology (AT) systems into one modular, multifunctional system, which can support people with dementia and carers throughout the course of dementia. In an explorative evaluation study, the integrated system, called Rosetta, was tested on usefulness, user-friendliness and impact, in people with dementia, their informal carers and professional carers involved. The Rosetta system was installed in participants' homes in three countries: The Netherlands, Germany and Belgium. Methods: Controlled trial with pre- and post-test measures across three countries (randomized controlled trial in Germany; matched groups in the Netherlands and Belgium). Participants completed questionnaires for impact measurement and participated in semi-structured interviews regarding usefulness and user-friendliness of Rosetta. Results: All participants agreed that Rosetta is a very useful development. They did not rate the user-friendliness of the system highly. No significant effects were found on impact measurements. Conclusion: All participants found Rosetta a very useful development for future care, and would consider using it. Since Rosetta was still in development during evaluation, a discrepancy between expectations and actual functioning of Rosetta existed, which may explain the lack of findings on the impact of the system and the low appreciation of user-friendliness. Implications for Rehabilitation: - People with dementia and carers find assistive technology (AT) a useful future development and they are willing to use it in the future. - People with dementia and carers have little privacy issues with AT. If they have concerns, they are willing to accept the trade-off of reduced privacy in exchange for the ability to live in their own homes for longer. - Given that a system works flawlessly, informal carers indicate that integrated AT can reduce their burden and stress. This can in turn help informal carers to provide better care for a longer period of time.
  • Publication
    Participation of end users in the design of assistive technology for people with mild to severe cognitive problems
    ( 2014)
    Meiland, F.J.M.
    ;
    Hattink, B.J.J.
    ;
    Overmars-Marx, T.
    ;
    Boer, M.E. de
    ;
    ;
    Ebben, P.W.G.
    ;
    Stalpers-Croeze, I.I.N.W.
    ;
    Flick, S.
    ;
    Leuw, J. van der
    ;
    Karkowski, I.P.
    ;
    Döres, R.M.
    Background: In the European Rosetta project three separate, previously developed, ICT systems were improved and integrated to create one modular system that helps community-dwelling people with mild cognitive impairment and dementia in different stages of the disease. The system aims to support them in daily functioning, monitor deviations from) patterns in daily behaviour and to automatically detect emergency situations. The study aimed to inventory the end users' needs and wishes regarding the development and design of the new integrated Rosetta system, and to describe the to be developed Rosetta system. Methods: Qualitative user-participatory design with in total 50 persons: 14 people with dementia, 13 informal carers, 6 professional carers, 9 dementia experts, 7 care partners within the project, and 1 volunteer. In the Netherlands user focus group sessions were performed and in Germany individual interviews. Dementia experts were consulted by means of a questionnaire, an expert meeting session, and interviews. Results: Persons with dementia and informal carers appreciated the following functionalities most: help in cases of emergencies, navigation support and the calendar function. Dementia experts rated various behaviours relevant to monitor in order to detect timely changes in functioning, e.g. eating, drinking, going to the toilet, taking medicine adequately, performance of activities and sleep patterns. No ethical issues regarding the use of sensors and cameras were mentioned. Conclusion: The user participatory design resulted in valuable input from persons with dementia, informal carers and professional carers/dementia experts, based on which a first prototype Rosetta system was built.
  • Publication
    Reporting experiments to satisfy professionals' information needs
    ( 2014) ;
    Juristo, Natalia
    ;
    Rombach, H. Dieter
    Although the aim of empirical software engineering is to provide evidence for selecting the appropriate technology, it appears that there is a lack of recognition of this work in industry. Results from empirical research only rarely seem to find their way to company decision makers. If information relevant for software managers is provided in reports on experiments, such reports can be considered as a source of information for them when they are faced with making decisions about the selection of software engineering technologies. To bridge this communication gap between researchers and professionals, we propose characterizing the information needs of software managers in order to show empirical software engineering researchers which information is relevant for decision-making and thus enable them to make this information available. We empirically investigated decision makers' information needs to identify which information they need to judge the appropriateness and impact of a software technology. We empirically developed a model that characterizes these needs. To ensure that researchers provide relevant information when reporting results from experiments, we extended existing reporting guidelines accordingly. We performed an experiment to evaluate our model with regard to its effectiveness. Software managers who read an experiment report according to the proposed model judged the technology's appropriateness significantly better than those reading a report about the same experiment that did not explicitly address their information needs. Our research shows that information regarding a technology, the context in which it is supposed to work, and most importantly, the impact of this technology on development costs and schedule as well as on product quality is crucial for decision makers.
  • Publication
    Mundus project: MUltimodal Neuroprosthesis for daily Upper limb Support
    ( 2013)
    Pedrocchi, Alessandra
    ;
    Ferrante, Simona
    ;
    Ambrosini, Emilia
    ;
    Gandolla, Marta
    ;
    Casellato, Claudia
    ;
    Schauer, Thomas
    ;
    Klauer, Christian
    ;
    Pascual, Javier
    ;
    Vidaurre, Carmen
    ;
    Gföhler, Margit
    ;
    Reichenfelser, Werner
    ;
    Karner, Jakob
    ;
    Micera, Silvestro
    ;
    Crema, Andrea
    ;
    Molenti, Franco
    ;
    Rossini, Mauro
    ;
    Palumbo, Giovanna
    ;
    Guanziroli, Eleonora
    ;
    ;
    Hack, Marco
    ;
    Bulgheroni, Maria
    ;
    D'Amico, Enrico
    ;
    Schenk, Peter
    ;
    Zwicker, Sven
    ;
    Duschau-Wicke, Alexander
    ;
    Miseikis, Justinas
    ;
    Graber, Lina
    ;
    Ferrigno, Giancarlo
    Background MUNDUS is an assistive framework for recovering direct interaction capability of severely motor impaired people based on arm reaching and hand functions. It aims at achieving personalization, modularity and maximization of the user's direct involvement in assistive systems. To this, MUNDUS exploits any residual control of the end-user and can be adapted to the level of severity or to the progression of the disease allowing the user to voluntarily interact with the environment. MUNDUS target pathologies are high-level spinal cord injury (SCI) and neurodegenerative and genetic neuromuscular diseases, such as amyotrophic lateral sclerosis, Friedreich ataxia, and multiple sclerosis (MS). The system can be alternatively driven by residual voluntary muscular activation, head/eye motion, and brain signals. MUNDUS modularly combines an antigravity lightweight and non-cumbersome exoskeleton, closed-loop controlled Neuromuscular Electrical Stimulation for arm and hand motion, and potentially a motorized hand orthosis, for grasping interactive objects. Methods The definition of the requirements and of the interaction tasks were designed by a focus group with experts and a questionnaire with 36 potential end-users. Five end-users (3 SCI and 2 MS) tested the system in the configuration suitable to their specific level of impairment. They performed two exemplary tasks: reaching different points in the working volume and drinking. Three experts evaluated over a 3-level score (from 0, unsuccessful, to 2, completely functional) the execution of each assisted sub-action. Results The functionality of all modules has been successfully demonstrated. User's intention was detected with a 100% success. Averaging all subjects and tasks, the minimum evaluation score obtained was 1.13 ± 0.99 for the release of the handle during the drinking task, whilst all the other sub-actions achieved a mean value above 1.6. All users, but one, subjectively perceived the usefulness of the assistance and could easily control the system. Donning time ranged from 6 to 65 minutes, scaled on the configuration complexity. Conclusions The MUNDUS platform provides functional assistance to daily life activities; the modules integration depends on the user's need, the functionality of the system have been demonstrated for all the possible configurations, and preliminary assessment of usability and acceptance is promising.