Professional Documents
Culture Documents
com
ScienceDirect
Procedia CIRP 50 (2016) 222 – 227
Abstract
During conceptual design, concept generation and selection methods can be used to facilitate the generation of new ideas and the selection of
the most promising suggestions. The present paper is an effort to understand better how action design research can be utilized to develop such
methods. Using action design research, methods were developed through iterative cycles of building, testing and evaluation in the context of a
deregulated railway market, through a close collaboration between actors from industry, a government agency and academia. The approach was
found to be feasible and to provide generalization of the context-specific findings through the formulation of design principles.
© 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license
© 2016 The Authors. Published by Elsevier B.V.
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Selectionunder
Peer-review and peer-review
responsibility ofunder responsibility
the organizing committeeof Professor
of the Lihui
26th CIRP Wang.
Design Conference
Keywords: concept generation; concept selection; methods; action design research; collaboration; design principles; In2Rail
2212-8271 © 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Peer-review under responsibility of the organizing committee of the 26th CIRP Design Conference
doi:10.1016/j.procir.2016.05.024
Anna Malou Petersson and Jan Lundberg / Procedia CIRP 50 (2016) 222 – 227 223
and selection methods to be used in cross-functional inter- [5]. This stage is guided by the principles of reciprocal
organizational groups would be an interesting research topic, shaping, mutually influential roles, and authentic and
as deregulation and outsourcing have become increasingly concurrent evaluation. The principle of reciprocal shaping
common. As a result, the research of this part of the project implies that increased understanding of the organizational
was framed as addressing the following class of field context influences the design of the artefact, and the artefact
problems: concept generation and concept selection in cross- influences the practices in the organizational context. The
functional inter-organizational groups. principle of mutually influential roles emphasizes the different
Task 4 involves identifying contributing theoretical bases types of knowledge which the project participants bring with
and prior (technology) advances. A literature review was them and the mutual learning among the different participants
performed on idea generation, decision making and methods [5]. The principle of authentic and concurrent evaluation
for the conceptual design phase. A test of three established emphasizes that the evaluation should be on-going and
concept generation methods was executed among the project interwoven with the activities throughout the BIE stage [5].
participants [14] to find empirical evidence as to how a cross- The evaluation should occur spontaneously in the
functional inter-organizational group interacts during concept organizational context, and opportunities should be sought
generation. following natural controls when possible, rather than in a
Task 5 involves securing long-term organizational controlled environment [5,8].
commitment. The participants were carefully selected in The first task of the BIE stage is to define an initial
consideration of their background, expertise and function knowledge-creation target. In this project, our target was
within the organization, so that they could give a structured methods that would encourage information sharing
representative view of what would be useful for the actor in a cross-functional inter-organizational group, leading to an
which they represented. Formal letters of intent regarding the enhanced idea flow and facilitating the selection of the most
contributions from each participating organization were promising alternatives.
signed, as well as intellectual property agreements. The The next task involves selecting or customizing the form of
organizational commitment was followed up during the entire BIE to be implemented. According to Sein et al. [5], the form
project and secured through adherence to the project plan, of BIE to be used should be determined by whether the
keeping the participants updated, and showing them that innovation is mainly technological or organizational, and they
concrete results were achieved which each organization could suggest a generic BIE scheme for each case [5]. In the case of
benefit from. concept generation and selection methods, we have re-
The last task of this stage involves clarifying roles and interpreted this to mean that the form of BIE to be used
assigning responsibilities. On the Swedish deregulated should depend on whether the focus is mainly on the method
railway market, we identified different stakeholders with design or organizational intervention. We customized the
respect to the development of infrastructure-related products: form of BIE to suit our specific case and the given
the infrastructure manager (the Swedish Transport circumstances, and adapted the BIE according to the
Administrator (STA)), product manufacturers, contractors possibilities appearing in the course of the project. As an
performing maintenance of the products, and academia. In example, the BIE scheme adopted in the development of the
Sweden, the infrastructure manager typically runs its concept generation method is given in Fig. 2.
development and research projects in cooperation with or In the case of the development of the concept generation
through research institutes and universities, and therefore method, the iteration cycles started in the creative team (the
academic researchers were relevant stakeholders. All these “alpha phase”). The requirements for the method emerged
stakeholders in the case of turnouts were represented in the during interviews and discussions within the project group.
project group of seven participants. Two academics were Connecting relevant findings from the literature review and
given the role of leading the project and managing the the evidence derived from tests of established concept
research part, and formed the “scientific team”. The other generation methods in the creative team [14] with the stated
participants and one of the academics in the scientific team requirements and demands, tentative design principles were
formed the “creative team”, in which issues concerning formulated in parallel with setting up an initial concept
turnouts would be proposed and addressed by means of the generation method. The suggested method was discussed in
methods proposed by the scientific team. The scientific team the group and a few changes were introduced before the
would analyse the data from the interventions and propose performance of interventions. An evaluation of each of the
changes to the method under development. The creative team two BIE cycles was made by means of questionnaires,
would give their views on the methods after the interventions interviews, material from the ideation sessions, observations
and comment on any changes which the scientific team would and transcribed recordings from the ideation sessions. The
propose. creative team was quite satisfied with the method already after
the first iteration, but two changes were introduced to give the
3.2. Building, intervention and evaluation (BIE) participants enough time in certain steps of the method and to
address the unequal distribution of spoken words among the
Carried out as an iterative process in a target environment, participants. After the second iteration, the participants were
the BIE phase interweaves the building of the artefact, satisfied with the method and did not want to make any
intervention in the organization, and evaluation, and the further modifications. The method also gave satisfactory
outcome of the BIE stage is the realized design of the artefact
Anna Malou Petersson and Jan Lundberg / Procedia CIRP 50 (2016) 222 – 227 225
the generic and abstract” on three levels [5]: 1) generalization be formalized. However, although we found it worthwhile to
of the problem instance, 2) generalization of the solution use the method, there are some issues that we would like to
instance, and 3) derivation of design principles from the highlight.
design research outcome, i.e. recommendations on how Rather than employing one or more control groups, ADR
methods addressing the same type of problems should be relies on comparing the social situation before an ADR
designed. The first and third task of this stage involve intervention with that after the ADR intervention. In the case
abstracting the learning into concepts for a class of field of the OptiKrea project, the overarching problem was the lack
problems and articulating the outcomes as design principles. of interaction during the conceptual design phase on a
The developed concept generation method has been deregulated railway market. The OptiKrea project can be
viewed as belonging to the class of concept generation viewed as a case of the overarching problem, as it was an
methods for cross-functional inter-organizational groups. intervention addressing this problem limited to a group of
Reconceptualizing the learning from this specific instance into participants representing different actors involved in turnouts.
design principles for the class of solutions to which it belongs The participants in the creative team agreed that working in
was performed tentatively in the first proposal for the new this way in the future would be very beneficial, and according
method. The tentative design principles were confirmed to them the methods should be beneficial for other railway
during the alpha and beta cycles, and three additional design products as well, since the problem in the case of turnouts is
principles emerged as a result of the interventions. very similar to that encountered with other railway products.
The class of field problems for the concept selection In the beta phase, the organizational context was reframed as
method had to be reframed. We realized in the course of the a European organizational context, having previously been
project that the method would be relevant for rather expensive framed as a Swedish context. In retrospect, we would have
products with a rather long life span to be purchased for the benefited from defining a wider organizational context clearly
provision of a public utility, or a product that is to be from the start. The goal of the OptiKrea project was to deliver
purchased in a large quantity for the provision of a public methods that would be ready for implementation at the
utility. The design of the product has an impact on the direct infrastructure manager. Implementing the methods at STA is
costs (e.g. investment and maintenance costs), which are the most appropriate wider organizational context in this case,
financed by taxes, and the indirect societal costs (e.g. costs and one should arrange for a follow-up of the outcome of the
originating from a failure to provide public transport for implementation. However, it seems very likely that there is
citizens). Therefore, we decided that the concept selection now a higher probability of the implementation being
method should belong to the class of methods that facilitate successful than if the method had been developed without
the selection of one or more large-investment products that interaction with practitioners. The concept selection method
are to contribute to the provision of a public utility. The has so far only been tested in the creative team, and it is very
design principles were formulated for this class of solutions, likely that a further need for improvements will be discovered
emphasizing the importance of a cross-functional team in the after the implementation.
selection process. Applying ADR was successful in that the participants
The second task involves sharing the outcomes and thought that the intervention led to a much better outcome
assessment with practitioners. The practitioners involved in than that which they would normally reach in other kinds of
the project were continuously updated on its progress and meetings dealing with a similar problem. It was encouraging
emerging outcomes. A step that belongs to this task, but has that the method worked well, but from these interventions we
not yet been executed, is the implementation of the methods cannot draw the conclusion that the developed method is the
in the routines of STA. Furthermore, the outcome was shared “best” method, and can merely conclude that it is one possible
through presentations, workshops and publications. solution. There are probably a large number of methods which
Task 4 involves articulating the learning in the light of the would have resulted in a better outcome than not using a
theories selected in Stage 1 to formalize the results for method at all. We would recommend defining the situation in
dissemination. It is an important step to relate the findings to which interventions are to be made and the wider
previous research and theories, and this step is not restricted organizational context at the start of the ADR work, and
to ADR. The developed artefacts and the learning from the tentatively defining how to measure the success or failure of
development process have been viewed in the light of the the outcome. For instance, in the case of the present project, is
relevant literature identified during Stage 1. it a question of the concept generation method actually
generating a higher quantity of ideas than previous strategies,
4. Reflections on using ADR or a question of the participants merely considering the
method to be a better and more useful way of working?
The descriptive and practical nature of the present paper Moreover, how is this to be measured or assessed? It might be
may enable other researchers facing a similar situation in very difficult to measure or assess a former situation (i.e. that
other organizational contexts to understand if ADR can be existing before intervention) at a later stage. We found that
feasible in their case. ADR has proved to be a feasible testing the developed method among participants not familiar
framework for the presented project. Through the guidance of with it in a typical use setting is very fruitful in judging its
ADR, it has been possible to structure the study in a feasibility and acquiring additional insights, since the group
meaningful way. Especially, ADR has contributed an participating in the development of the method might be at
understanding of how the learning derived from the study can least partly biased.
Anna Malou Petersson and Jan Lundberg / Procedia CIRP 50 (2016) 222 – 227 227
In the case of the concept generation method, we understanding gained of how the learning from the study can
conducted a more comprehensive preliminary study by testing be formalized, and the authentic and concurrent evaluation.
several established methods and reviewing relevant literature To apply the method with success, we recommend taking the
before building the first version of the method. In the case of necessary steps to secure long-term commitment from the
the concept selection method, we started out with the method participants, defining the situation where interventions are to
developed by Lundberg [15] and, after the first cycle, the be made and the wider organizational context, and specifying
findings derived from reviewing relevant literature were how to measure the success or failure of the outcome at the
incorporated. After the first cycle of the development of the start of the project. Finally, researchers aiming to test ADR
concept generation method in the creative team, only minor should be aware that the solution developed might not be the
changes were introduced in the method. On the other hand, “best” solution, but might instead be one possible solution
large parts of the concept selection method were eliminated optimized for the given context.
and changed after the first cycle of its development in the
creative team. This implies that a thorough preliminary study Acknowledgements
will be rewarded by a reduction in the work needed between
the BIE cycles. However, the changes made in the concept The financial support provided by Luleå Railway Research
selection method were not radical. We are concerned that Center at Luleå University of Technology is gratefully
ADR might lead to incremental improvements rather than a acknowledged. Moreover, the OptiKrea partners, the Swedish
radical change in the artefact once the first version has been Transport Administration, Vossloh Nordic Switch Systems
built, although it is impossible to judge this only on the basis and Infranord, are gratefully acknowledged for their
of the present case. If this is so, it is even more important to contributions to the project.
conduct a thorough preliminary study and consider or try
different approaches, because once the first version of the References
artefact is built, the direction of development is determined.
The organizational commitment worked very well. We [1] Shah JJ, Kulkarni SV, Vargas-Hernandez N. Evaluation of idea generation
recommend taking the necessary steps to lay the foundation methods for conceptual design: effectiveness metrics and design of
experiments. J Mech Des 2000;122:377-384.
for a good collaboration between the participants and to align [2] Gish L, Hansen CT. A socio-technical analysis of work with ideas in
the participants’ goals. We believe that the interacting nature NPD: an industrial case study. Res Eng Design 2013;24:411-427.
of ADR, in which the participants’ views are continuously [3] Almefelt L, Sutinen K, Malmqvist J. Computer support for systematic
taken into account, plays an important part in building this design applied in a cross-functional commercial concept development
commitment. On the other hand, the scientific researchers project. Concurr Eng Res Appl 2003;11:107-120.
[4] Rexfelt O, Almefelt L, Zackrisson D, Hallman T, Malmqvist J, Karlsson
should challenge the views of the participants whenever M. A proposal for a structured approach for cross-company teamwork: a
necessary and explain why they are doing so. As the case study of involving the customer in service innovation. Res Eng
researchers conducting the study and evaluating the scientific Design 2011;22:153-171.
part, we believe that it is more important to try to acquire [5] Sein M, Henfridsson O, Purao S, Rossi M, Lindgren R. Action design
knowledge of the organizational context and its interplay with research. MIS Q 2011;35:37-56.
[6] Hevner AR, March ST, Park J, Ram S. Design science in information
the artefact on the basis of unexpected events and sudden systems research. MIS Q 2004;28:75-105.
changes in plan, rather than to try to adhere to the original [7] Susman GI, Evered RD. An assessment of the scientific merits of action
plan. This exemplifies how authentic and concurrent research. Adm Sci Q 1978;23:582-603.
evaluation, as opposed to evaluation using controlled settings, [8] Rogerson C, Scott E. Motivating an action design research approach to
plays an important role in the application of ADR. However, implementing online training in an organisational context. Interact
Technol Smart Educ 2014;11:32-44.
this makes it more difficult to compare methods to each other, [9] Petersson AM, Lundberg J. Developing an ideation method to be used in
and statistical methods are probably more capable of cross-functional inter-organizational teams by means of action design
determining what methods are inherently better. On the other research. To be submitted.
hand, ADR appears to be a better approach to adapting [10] Petersson AM, Lundberg J. Evaluating an ideation method in a real-life
methods to certain contexts while simultaneously context: A field test from the railway sector. Accepted to ASME 28th
International Conference on Design Theory and Methodology; 2016.
understanding how those methods perform in reality, and to [11] Petersson AM, Lundberg J. A concept selection method for railway
identifying context-dependent factors that are not part of products. To be submitted to Journal of Rail and Rapid Transit.
controlled experiments. Therefore, we found that ADR and [12] Okudan GE, Tauhid S. Concept selection methods: a literature review
statistical research methods complement each other. from 1980 to 2008. Int J Des Eng 2008;1:243-277.
[13] Straus SG, Parker AM, Bruce JB. The group matters: a review of
processes and outcomes in intelligence analysis. Group Dyn Theory Res
4. Conclusions Pract 2011;15:128-146.
[14] Petersson AM, Lundberg J, Rantatalo M. Ideation methods applied in a
From our experience of using ADR in a project developing cross-functional inter-organizational group: an exploratory case study
concept generation and selection methods in close from the railway sector. Submitted to Res Eng Design.
collaboration with practitioners, we draw the conclusion that [15] Lundberg J. Grease lubrication of roller bearings in railway waggons.
Part 1: Field tests and systematic evaluation to determine the optimal
ADR is a feasible complement to other research methods in greases. Ind Lubr Tribol 2000;52:36-44.
the field of engineering design. In our case, we found the [16] Pahl G, Beitz W, Feldhusen J, Grote KH. Engineering design: a
main advantages of ADR to be the structure provided, the systematic approach. 3rd ed. London: Springer; 2007.