You are on page 1of 12

Ecologically Grounded Creative Practices in

Ubiquitous Music

D A M I N K E L L E R * and V I C T O R L A Z Z A R I N I * *
*
Amazon Center for Music Research NAP, Federal University of Acre, Rio Branco, AC, Brazil
**
Maynooth University, Maynooth, Co. Kildare, Ireland
Emails: dkeller@ccrma.stanford.edu; victor.lazzarini@nuim.ie

Instrumentally oriented and individualistic approaches theoretical models and arguing for empirically groun-
dominate the current perspectives on musical interaction and ded creativity-centred design techniques.
technologically oriented composition. A view that focuses on Moving towards an organic methodology for sound
the broad aspects of creativity support is proposed as a viable
art (as idealised in the 1930s by Edgard Varse), sonic
theoretical and methodological alternative: ubiquitous music
practice. This article summarises several ndings in ubiquitous
eco-compositional approaches propose creative actions
music research, pointing to new theoretical frameworks that as by-products of action-perception cycles. The
tackle the volatile and distributed creativity factors involved in eco-compositional perspective rests on the empirical
musical activities that take place outside of traditional venues, evidence provided by embedded-embodied cognition
involving the audience as an active creative partner. A new (Gibson 1979; Varela 1992; Hutchins 1995, 2010).
denition of ubiquitous music is proposed encompassing four Rather than abstract manipulation of symbols, com-
components related to the human and the material resources, position is thought as interaction among agents and
the emergent properties of musical activities and the design objects (Keller 1998, 1999). Eco-compositional activity
strategies involved in supporting distributed decision making. engages in the exploration of local resources as key
We highlight the application of embedded-embodied cognition creative ingredients (Burtner 2005). Similar to the
in creative practice, arguing for the adoption of an ecologically
soundscape compositional approach (Truax 2002),
grounded framework as an alternative to the mainstream
anthropocentric and disembodied acoustic-instrumental
it incorporates place as a creativity factor highlighting
paradigms. We discuss the relevance of the new materialist the interaction with the environment as one of the
concepts of ecologies and meshworks within artistic creative central aspects of the creative process (Rhodes 1961).
practice, highlighting the implications of the emergent The open-ended creative methods adopted by eco-
creativity support methods for context-based composition. composers have helped to turn musicians (Nance 2007)
and audience (Keller 2000) into active participants of
the creative process. This increased reliance on (1) social
1. INTRODUCTION interaction, (2) everyday settings, and (3) the open-
ended, exploratory activities have underscored the lim-
This article summarises several ndings in ubiquitous itations of the existing toolset for creativity support.
music (ubimus) research that underline the need for new During the rst decade of the twenty-rst century,
theoretical frameworks to handle the volatile and dis- several composers started a search for methods to
tributed creativity factors involved in creative music- handle action-perception cycles within their composi-
making (Keller, Lazzarini and Pimenta 2014a). As tional practice. Barrett (2000), Opie and Brown (2006)
pointed out by Rudi (2015), there has been a paradigm developed data-extraction techniques that provided
shift in technologically based creative practices. Con- tools to deal with the complexity of the local sonic
trasting with the historical electroacoustic music ten- resources for musical purposes. Burtner (2005)
dencies, the artistic value of recent technology-based explored the usage of synthesis techniques in external
music is not necessarily determined by experts (Rudi settings as sources of creativity, coining the concept of
2015: 36), blurring the lines between composer, audi- socio-synthesis. Di Scipio (2008) employed a venues
ence, composition, performance and mediation. acoustical properties to increase the available resour-
Musical activities that take place outside of traditional ces for performance-based compositional systems.
venues and that feature the audience as an active crea- Nance (2007) proposed the use of aural scores as a way
tive partner demand design techniques that are not to increase the openness of instrumental works. Cdiz
currently supported by mainstream musical interaction (2012) employed ecologically based synthesis methods
approaches.1 We discuss recent advances in ubimus
in the context of orchestral works and Aliel and
research, highlighting the limitations of the current
Fornari (2014) applied these techniques in remote
1
See Wessel and Wright (2002) or Tanaka (2009) for examples of improvisatory performances. Basanta (2010) and
current views in musical interaction. the Capasso + Keller + Tinajero Collective (Capasso,
Organised Sound 22(1): 6172 Cambridge University Press, 2017. doi:10.1017/S1355771816000340

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
62 Damin Keller and Victor Lazzarini

Figure 1. Revised model of the xed use of material resources in sonic ecologies (the two states reect pre- and post-
intervention status).

Keller and Tinajero 1999, 2000, 2012, 2014) made use yielding behavioural adjustments to new conditions.
of ecologically based interaction techniques to enhance Compositional strategies that apply a strict separation
the creative participatory potential of their installation between the decision-making process and the ecologi-
artworks. All these initiatives have contributed to the cal niche do not necessarily depend on the local
methods presently gathered under the rubric ecologi- resources. Therefore, the creative products remain
cally grounded creative practice. independent from the ecological niche. Multiple
This article tackles the application of an ecologically examples of this approach are provided both by the
based framework to the problem of supporting acousmatic practices (Wishart 2009) and by traditional
distributed and socially grounded manifestations of soundscape composition (Westerkamp 1989). These
musical creativity. The remaining sections are struc- sonic ecologies are classied as xed (Figure 1).
tured as follows. First, we present two updated models When the creative products are shaped through
of sonic ecologies. These models provide the con- processes that depend on the local resources, the sonic
ceptual basis to deal with three aspects of sonic creative ecologies are labelled adaptive. The mismatch between
practices: the material, the cognitive and the social the eco-niche and the creative procedures seems to
factors. Then we analyse the contributions and sever the link between the composers experience of the
limitations of a recent community-constructed deni- environment and the listeners experience. For many
tion of ubiquitous music phenomena. This denition is years, Barry Truax and other soundscape composers
parsed into four components, encompassing the have been working on techniques to reconnect these
human factors, the material resources, the properties two separate realms (Truax 2002). The interactive
that emerge during the creative activities and the installation The Urban Corridor (Keller, Capasso and
design strategies that foster creative outcomes Wilson 2002; Keller 2012; Pimenta et al. 2009) suggests
including both creative processes and products. The an alternative path by creating a setting that enables
nal section addresses the potential impact of the emergent properties dened by the participants
ecological frameworks within ubiquitous music- behaviours. The material dimension is shaped by the
making on context-based creative practice. interaction among agents and objects. The computa-
tional infrastructure developed for this piece uses
accumulation as an organising strategy (Keller et al.
2002). Event densities and timbre proles depend both
2. MODELLING ECOLOGIES FOR MUSIC-
on community behaviour and on the compositional
MAKING
systems activation of visual and sonic events. Thus,
The relationships between the material resources and the material dimension is driven by the participants
the ecological niche in music-making activities have behaviours which in turn are constrained by the
been addressed in (Keller 2012) and (Keller, Lazzaini physical layout of the piece. Given that the agents
and Pimenta 2014b). From an ecologically grounded behaviours impact the sonic outcome, what we see here
perspective, two strategies were identied in ve is a process of mutual adaptation: the eco-niche
representative musical projects of the late twentieth determines the material resources of the piece but at
century: xed and adaptive usage of material resour- the same time the piece also shapes the eco-niche.
ces. These two strategies emerge from the relationships These processes cannot be separated. Their dynamic
established between the creative potential of the local can be described as an adaptive sonic ecology: a habitat
settings and the decision-making processes that impact where agents and objects interact producing a creative
the choice of material resources. These relationships sonic by-product that depends on local material and
have been modelled through three operations: behavioural resources (Figure 2).
constrain, expand and shift. Constrain implies the Based on the usage of technological tools
reduction of resources. Expand involves exploratory by an individual composer, Jones, Brown and
actions to introduce more resources into the ecological dInverno (2012) strip the creative cycle down to two
niche. Shift combines the two former operations activities: generation and evaluation (henceforth the

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
Ecologically Grounded Creative Practices in Ubiquitous Music 63

Figure 2. Revised model of the adaptive use of material and behavioural resources in sonic ecologies.

generation-evaluation model). Following McGraw embedded. That is, they do not depend exclusively
and Hofstadters (1993) proposal, generation encom- on the cognitive resources of the participants.
passes gathering materials and the internal processes Eco-grounded musical activities feature emergent
that lead to new ideas. Evaluation involves processes properties arising from interactions among material
of selection of the available resources. The generation- resources and behaviourial resources. Behaviours
evaluation model gives support to the ecologically change materials and materials change behaviours,
grounded view on musical creativity as laid out by fostering a process of affordance formation. This
Keller (2012). The procedural analysis of ve repre- process impacts the way the resources are employed to
sentative musical works of the late twentieth century support creative activities, yielding dynamic relation-
suggests that sonic ecologies involve interactions ships among resources and agents, also called
among human agents and material resources. These relational properties (Keller et al. 2014c, 2015c Keller,
interactions can be described by three operations on Otero and Costalonga 2015b).
the material resources: expand, when the pool of Complementarily, creative musical activities are
resources gets larger (or amplify, in Jones et al. 2012 social. This means that the material resources are not
nomenclature); constrain, when the pool of resources limited by the experiential knowledge of a single crea-
gets smaller; and shift, when a qualitative change of tor. Knowledge is accumulated and distributed among
resources is involved (or impose). Jones and coauthors all the agents participating in the creative act, some-
propose the no operation label, when the resources are times conforming a community of practice (Wenger
unmodied. 2010). The social aspects of creativity highlight the
The introduction of the nil operator, suggested by need to consider the distributed nature of the agents
the lack of change in the resource pool is consistent involved in the creative act. The stereotype of the
with the incubation stage proposed by Wallas (1926) genius-composer working in his studio isolated from
and later incorporated by most musical creativity the hustle of mundane distractions is currently being
models (cf. reviews in Keller et al. 2014b). This is challenged by ubiquitous musical practices (Keller
usually described as time spent away from the creative et al. 2014a). The situated methods that have emerged
activity. But given the recent ndings on the function from ecologically grounded creative practices t well
of the default mental network that is, neural path- within the context of community-oriented ubimus
ways that stay active despite the lack of conscious research (Lima et al. 2012; Pimenta et al. 2014). While
processes which are usually linked to the area of the the generation-evaluation model was developed keep-
pre-frontal cortex (Beaty et al. 2015) it is very likely ing in mind a single participant, ecologically grounded
that activities that have no impact on the material practices have traditionally targeted the integration of
resources, such as sleeping or doing physical activity, the audience as an active shaper of the artistic experi-
provide an opportunity for reconguring the cognitive ence (Keller and Capasso 2006; Basanta 2010; Burtner
resources devoted to the creative act. Hence, a more 2011; Keller et al. 2014d). Thus implying that a revised
accurate depiction of the nil operator is the reduction notion of agency is necessary to account for the
of explicit or conscious processes, enhancing the role of socially distributed resources involved in community-
the implicit cognitive resources. based creative phenomena.
Despite Jones and his coauthors acknowledgement So far, we have dealt with two instances of the
of the distributed nature of the creative act, the application of the concept of ecology or meshwork in
generation-evaluation model does not account for creative music practice. Fixed sonic ecologies are
phenomena that involve the active participation of characterised by a strict separation between the
distributed agents and resources. There are two aspects decision-making process and the ecological niche.
to be considered. On the one hand, as multiple studies Therefore, they do not necessarily depend on the local
have shown since the early ecologically grounded material resources. Adaptive sonic ecologies are
proposals (Keller 1999, 2000; Burtner 2005; Keller habitats where agents and objects interact producing
and Capasso 2006), creative musical activities are creative sonic by-products that depend on local

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
64 Damin Keller and Victor Lazzarini

material and behavioural resources. Recent develop- projects that make use of environmental features to
ments in ecologically grounded creative practices may constrain the behaviours of the agents or to generate
expand the frontiers of ubiquitous music research. and organise other material resources. Ecological
Thus, it might be useful to revisit the denition of modelling proposes creative heuristics that is, deci-
ubimus while considering the latest tendencies in eco- sion helpers that are based on the objects sonic
logically grounded creative practices. behaviours in terrestrial settings (Keller 1999, 2000).
These heuristics have been applied in sound synthesis
(Keller and Truax 1998; Keller and Berger 2001;
3. PUSHING THE DEFINITION OF Burtner 2005; Di Scipio 2008), haptics design (Barrass
UBIQUITOUS MUSIC FORWARD and Adcock 2002; Castle, Adcock and Barrass 2002),
interaction design (Keller et al. 2002; Basanta 2010;
A community-constructed denition of ubiquitous
Keller et al. 2010; Keller et al. 2011), instrumental
music proposes that the study of ubimus targets sys-
composition (Nance 2007; OCallaghan 2013), and
tems of 1) human agents and 2) material resources that
environmental data extraction and sonication for
3) afford musical activities through 4) creative support
artistic purposes (Barrett 2000; Opie and Brown 2006;
tools (Keller et al. 2014a). Let us deal with each of the
Gomes et al. 2014; Connors 2015). All these techniques
four components of this denition separately before we
make use of local resources providing open approaches
tackle the implications of the ecologically grounded
to sonic organisation. They highlight the emergent
perspective within the context of ubimus research.
qualities of behavioural patterns across modalities,
sometimes exploring contradictions and paradoxes
3.1. Human agents through the expansion of the sonic properties of real-
world events. Thus, we could classify the ubimus sys-
Component 1 of the denition refers to the factors that tems that make heavy use of environmental features as
shaped hominid evolution. Two of the currently most multimodal ecologies.
inuential perspectives on evolution theory are the
social brain hypothesis (Shultz and Dunbar 2007) and
the niche construction theory (Odling-Smee, Laland 3.3. Relational properties
and Feldman 2003). The former highlights the impor- Both component 1 and component 2 interact to shape
tance of social interaction mechanisms for survival. component 3 affordances. The concept of affordance
Apparently, the ability to perceive and predict the that is, opportunities for action provided by the features
intentions of others may have been one of the key of the environment as perceived by the active agent as
demands of early hominid interactions that required a coined by psychologist Gibson (1977), has a very long
high investment of cognitive resources. The latter the- tradition of use and misuse. Particularly in the area of
ory stresses the impact of the organisms on the local humancomputer interaction (Norman 1988/2002), it
environment leading to the formation of the ecologi- has fostered multiple confusions. Normans perspective
cal niches and the environmental pressures on beha- implies that somehow affordances could be designed
viour that may have demanded increasingly rened and attached to objects or that material properties of
cognitive mechanisms to cope with uncertain condi- objects could be equated to social usage of objects
tions. Both approaches have gathered strong evidence (see Keller et al. 2010 for a critical discussion of the
from diversied elds, including biology, paleontology, implications of the concept of affordance for creative
anthropology, social psychology and cognitive science. practice). Affordances remain problematic until today.
These theories have several implications on creative For this reason, we have opted to adopt the more neu-
practice. As suggested by Emmerson in 2001, installa- tral label relational properties for the design qualities
tion art provides an ideal venue to experiment with the that emerge from interaction (Keller et al. 2015b,
social factors underlying group behaviours (Emmerson 2015c). So far, we have identied three types of rela-
2001). Interactions encompass visual, sonic and tactile tional properties: material, social and formal. Material
cues produced by the agents behaviours and impacting relational properties arise from the interactions with
the behavioural resources. Given that ecologically physical objects. Social relational properties emerge
grounded creative practices have focused on social from interactions among agents. And formal relational
interaction (Keller et al. 2002; Keller and Capasso 2006; properties include cognitive simulations and conceptual
Basanta 2010; Connors 2015), it makes sense to think of operations handled through ofine cognitive resources
this type of ubimus systems as behavioural ecologies. (Wilson 2002). Hence, formal relational properties
are decoupled from agentobject and agentagent
synchronous interactions.
3.2. Material resources
A longitudinal design study was implemented to
Component 2 of the denition of ubimus systems determine how relational properties can be supported
material resources is highlighted by the creative and how they impact the creative decision-making

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
Ecologically Grounded Creative Practices in Ubiquitous Music 65

creative coders behaviours. Participants were con-


tacted via the coding communitys mailing lists,
including users of the visual programming language
Max/MSP and of the Processing language forum as
well as members of the Computer Arts Society list.
Figure 3. Asynchronous decision-making support in Thirty-nine respondents completed the survey. Bowns
Palato 1.0: audiovisual sketches. analysis yielded four main topics: 1) time-demands
of specic activities; 2) sources of knowledge and
approaches to problem-solving; 3) approaches to
processes (Keller et al. 2014d). This ten-month design exploration; and 4) information-seeking versus intui-
study targeted the observation of the creative processes tive styles of working. The results of this study suggest
of a video-artist, a sculptor and a composer, while that the usage of complex tools was centred around
working on the multimedia installation Palato/Pala- epistemic (exploratory) activities. Generative tools and
ta/Home-on-stilts 1.0 (Capasso et al. 2012) (see Movie abstract visualisation tools seem to be at the core of
example 1, featuring an excerpt of the audiovisual the support of exploratory actions. Given the users
material). Asynchronous, ubiquitous group activities preference for batch processing, asynchronous support
were carried out by the three subjects through light- appears to be more accessible than synchronous
weight, off-the-shelf infrastructure. Data was extracted exploration of data. These ndings complement the
from a virtual forum and a le repository. The analysis conclusions of the Palato 1.0 study: rather than
of the creative exchange indicated cycles of activity focusing exclusively on performance-oriented tasks,
alternating between reection, exploratory action creativity support systems should foster the increase of
and product-oriented action. Technological support creative potentials through exploratory activities that
was incorporated through cycles of demandtrial target high-level conceptual relationships.
assessment, embracing a parsimonious approach to the
adoption of new tools. Priority was given to repur-
3.4. Ubimus ecosystems
posing of existing resources as opposed to development
from scratch. Creative results included 19:30 minutes The fourth component of the ubimus denition stems
of sonic material and video footage, and three 5x8x3 from the incorporation of creativity as a relevant target
metre raw-wood sculptures. for technological support (through creativity support
The procedures underlying the Palato 1.0 study are tools). Humancomputer interaction research in this
summarised in Figure 3. Given the collective character area was pioneered by Edmonds and Fischer
of the endeavour, a common reference system becomes (Edmonds et al. 1995). Creativity support has recently
a requirement. Well-grounded local decisions can only gained impetus through the emerging area of Infor-
be made if the stakeholders have access to the status of mation Technology Creative Practices (Mitchell,
the other participants activities. Local data, in this Inouye and Blumenthal 2003; Shneiderman 2007).
case representations of sounds and footage, were Shneiderman et al. (2005) have suggested that the
shared through volatile resources in the form of development of creativity support tools can provide a
audiovisual (AV) sketches to increase the exibility new focus to humancomputer interaction research.
of the exchange (Keller et al. 2014d; Keller, Miletto But tools as the central concepts of a research agenda
and Otero 2015a). The AV sketches provided a on creativity may be problematic. The investment on
temporal reference system for the asynchronous isolated tools may prove to be effective when dealing
decision-making process. Overall, the results indicated with well-dened problems. This strategy suits the tel-
that social relational properties and material relational eological techniques (Fantauzzacofn and Rogers
properties do not abide by the same mechanisms. The 2013) in which the target of the procedure is dened
temporal investment on formal relational properties before the start of the activity. In this scenario, the
(related to reective activities) was very high when design and the choice of the tool do not impact the
compared to product-oriented activities. This points to denition of the epistemic target. However, most
a gap in musical interaction research. While most of artistic endeavours not only demand the solution of
the mainstream development has targeted musical both undened and clearly dened problems, but may
instruments and musical performance systems (Wessel also challenge established worldviews (Donald 2006).
and Wright 2002; Tanaka 2009), it seems that a better For this reason, artistic activity has been described as
strategy to boost creative potentials involves the self-reective (Hamman 2002; Donald 2006). In other
support of exploratory and reective activities. words, the objectives of the activity are established
Within the context of computationally assisted during the act rather than a priori. The support of
artistic practices, Bown (2014) discusses the implica- exploratory creative activity may demand more uid
tions of adopting complex tools for creative activities. methods than those provided by the teleological
He conducted a questionnaire-based study to probe approach.

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
66 Damin Keller and Victor Lazzarini

Another factor fostering a conceptual change in the providing a path for the development of ubiquitous
fourth component of the ubimus denition involves the music ecosystems based on standard web browser
support infrastructure. Technological support for technology. On the down side, support for the
pervasive musical activities increases the difculty of the deployment of applications is not universal, as it is the
design task on several fronts. Ubimus systems may case in all browser-based software development
enhance the users creative potential by providing access systems. This avenue of research emphasises the
to previously unavailable material and social resources. interrelated character of ubiquitous musical interac-
But a more intensive usage of resources can introduce tions featuring support both for audio processing and
unintended complexities, narrowing the access to a small for rapid user interface prototyping. Hence, it may
user base. Thus, one challenge faced by ubimus designers provide a methodological alternative to the tools
is to provide intuitive tools for diverse creative tasks. designed for musical performance and based on sim-
Furthermore, custom-made, special purpose hardware plistic acoustic-instrumental concepts.
interfaces such as those proposed by the tangible user An important dimension of the emerging ubimus
interface design approaches (Fitzmaurice et al. 1995; ecosystems has ourished under the Maker Movement
Ishii, Mazalek and Lee 2001) may full the require- (Dougherty 2012), the do-it-yourself (DIY) interven-
ments of transparency and naturalness reducing the tions. Much of the context under which ubimus has
cognitive load of complex tasks. But they do not guar- been considered, as far as the supporting hardware is
antee wide accessibility. In this case, the catch lies in the concerned, is based on the use of existing manu-
nancial toll. Special purpose systems are difcult to factured technology (off-the-shelf devices), sometimes
distribute and maintain. As a consequence, the user base repurposed through software or hardware modica-
is narrowed by the increased costs of the hardware. tions for application-specic needs. This can be seen in
A promising proposal to tackle this issue involves a number of projects reported in the ubimus literature
repurposing that is, using existing technology for (Flores et al. 2010; McGlynn, Lazzarini and Delap
creative ends. Flores et al. (2010) target personal mobile 2012; van Troyer 2014). By bringing the dimension
devices as platforms for ubimus support. Lazzarini et al. of DIY electronics platforms into the ubimus
(2012) introduce a sound synthesis platform for mobile playground, designers are able to tap into a much
devices based on the widely used musical programming wider source of technology solutions. In fact, many of
language Csound. Despite the enhanced support for the initial ideas that motivated ubicomp (Weiser 1995)
mobile devices, the ubimus initiative still faces a chal- become more tangible, as custom-made devices seam-
lenge related to the sustainability of its technological lessly fuse with our surroundings.
infra-structure. Software development makes sense As we integrate multiple objects into the ubimus
when there is stable hardware base available for ecosystems, a key potential of embedded technologies
deployment. The fast renewal cycle of mobile devices becomes evident: we can take advantage of the internet
makes it difcult to support sustainable musical prac- infrastructure to offer connectivity over a wide area.
tices. Hence, rather than targeting devices or instru- Small computing units can be remotely controlled, to
ments, ubimus design may require concepts that can gather data and to interact with people and other
handle permanent changes in the underlying technology. objects in the environment. This brings the possibility
Lazzarini and coauthors (2014b) propose the itera- of functional extensions through ubimus devices.
tive implementation of ubimus ecosystems. Ubimus Combinations of customised hardware and ready-
ecosystems function as technological hubs that support made components can cooperate in systems where
the integration of audio and interaction tools. These there is effectively no separation of computing devices
ecosystems can be recongured according to the needs and peripherals. Kevin Ashton has coined the term the
of the users through rapid prototyping techniques. As a Internet of Things (IoT) to describe this trend (von
case study, Lazzarini et al. (2014a) report the devel- Kranenburg and Bassi 2012). IoT will be composed of
opment PNaCl Csound. PNaCl Csound provides an trillions of devices. While it is unlikely that all devices
environment that can be employed for the develop- will be connected in a mesh [...] the number of inter-
ment of a variety of ubimus applications on standard connected object will outnumber by several orders of
internet browsers. It is based on a well-understood, magnitude the current internet (von Kranenburg and
domain-specic language that features a wide-ranging Bassi 2012: 4). This massive, heterogeneous infra-
variety of unit generators (over 1,500 Csound structure furnishes new opportunities for creative
opcodes). Thus, while it supports the prototyping of action while it introduces several challenges for design.
reasonably complex audio processing applications, it Increased energy usage (von Kranenburg and Bassi
can also benet from a large library of code from the 2012) and potential increase of waste point to zero-
various pre-existing catalogues of Csound algorithms. entropy (or self-sufcient) devices act as design targets.
The Csound PNaCl environment features a relatively Shared communication protocols will be required for
low-latency performance and incorporates the know- full integration. Another issue that has to be addressed
how developed over thirty years of Csound usage, is a user-centred approach to privacy. Given the

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
Ecologically Grounded Creative Practices in Ubiquitous Music 67

pervasive presence of the IoT, transparent privacy IoMT, the distributed nature of its resources may force
mechanisms will have to be supported on computa- the reduction of explicit control of its components.
tionally limited devices. Hence, music-making as a hierarchical, centralised
Currently, with the appearance of small connectable activity may not be feasible in some forms of IoMT.
units, such as the Arduino, Raspberry Pi, Galileo and Community-based and shared decision making may be
Edison, we can build custom hardware systems based more amenable strategies for creativity activities based
on components that interact with an unspecied num- on the IoMT infra-structure.
ber of other computational elements. The musical We can also glimpse some new perspectives for eco-
counterpart of the IoT points to the emergence of an logically grounded creative practices, providing a wider
Internet of Musical Things (IoMT), where a number of scope for a multimodal integration of various artistic
new possibilities of interaction with music-making formats, as well as for the delivery of artistically moti-
devices may open up for both musicians and audi- vated educational projects. As an example of the artistic
ences. Lazzarini, Timoney and Byrne (2015) demon- applications of the IoMT, the Memory Tree project
strate this potential by creating a fully featured system (Ribeiro Netto et al. 2015) uses very simple recording
for musical signal processing on an embedded platform and playback devices installed at a remote physical
(the Intel Galileo). Although a prototype proof-of- location, accessible through the internet. In this multi-
concept is provided in terms of a conventional MIDI modal installation, users were able to record short audio
instrument, the authors describe the development of an extracts via a social-network environment. These snip-
open prototyping platform, whose applications target pets would be left for others to listen to at a tree holding
the Internet of Things (strictly speaking this is effectively playback devices. The technology probed the ranges
an instance of the IoMT). As this ubimus ecosystem is from users mobile phones and used an existing internet
based on both hardware and software interventions, service infrastructure (for the production and content
creativity becomes a feature of the system design, its use uploading), featuring custom-made, DIY hardware (for
and the emergent properties that arise from the multiple the playback system itself). In such a IoMT scenario,
forms of interaction afforded by its components. Hence, location and environment are directly employed in and
previously perceived boundaries between design, artistic designed for the ubimus ecosystem. IoMT functional
concept, technical realisation and deployment are dis- extensions can increase the geographical and the social
solved into a continuum of creative activities. signicance of ubimus activities, fostering community
A possible caveat of the IoMT infrastructure is the engagement beyond co-located support. They also pro-
increased complexity of the systems, reducing the vide means of spreading the computational load of ubi-
ability of the stakeholders to interact in meaningful mus interventions over a heterogeneous collection of
ways. Miniaturisation of devices implies reduction or units. It is also important to point out that IoMT appli-
disappearance of surfaces for visual display or tactile cations do not necessarily require the development of
interaction. This problem is already present in the dedicated networking infrastructures, since ubimus sys-
design for mobile personal devices (Flores, Pimenta tems can hitch a ride on the extant functionality of the
and Keller 2014). Ubimus research points to the internet. As observed in projects such as the Memory
development of interaction patterns (Pimenta et al. Tree (Ribeiro Netto et al. 2015), constructs pertaining to
2014) and creativity support metaphors (Bernardo, ecologically grounded creative phases, namely potential,
Pestana and Martins 2015; Keller et al. 2011), striving deployment and outcome, can be explored deeply,
to achieve design once, deploy many times strategies expanding the use of cognitive, material and social
(Lazzarini et al. 2014b). Lack of integration among resources, thus fostering both local and remote forms of
components is particularly problematic when dealing social interaction without disrupting the ties to the
with time-sensitive activities, such as music-making. ecological niche.
Given the heterogeneous prole of the IoMT, general- While revisiting the denition of ubiquitous music,
purpose protocols may not be sufcient for synchro- we have reconsidered four components of the ubimus
nous activities. The deployment of the Musical systems. Component 1, linked to their human-related
Instrument Digital Interface protocol which predates aspects, nds theoretical scaffolding on the emerging
the internet could serve as an initial path for inte- views on evolutionary theory. When the system relies
gration. But hybrid approaches, involving both tight on social interaction, it can be construed as a beha-
synchronisation and loose aggregation, may be better vioural ecology. Ubimus projects that make intensive
suited to the dynamically changing demands of ubimus use of environmental features to modulate the beha-
activities. Another problem is the anonymity of the viours of the agents or to generate and organise the
sonic resources available through online sound data- material resources emphasise the role of component 2
bases. As pointed out by Truax (2015: 1089), the lack of the ubimus denition the material resources.
of contextualisation of digitised sounds paves the way Given their heavy usage of environmental features and
to their use as isolated objects, rather than as situated the exploration of the emergent qualities of beha-
events. Despite the new opportunities furnished by the vioural patterns across modalities, these systems can be

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
68 Damin Keller and Victor Lazzarini

described as multimodal ecologies. The third properties emerge from interactions among material
component of the denition relies on interactions and social resources. Ubimus systems that make heavy
between components 1 and 2, encompassing relational usage of social interactions are labelled behavioural
properties. Material relational properties arise from ecologies and systems scaffolded on environmental
activities with physical objects. Social relational prop- features are described as multimodal ecologies. The
erties emerge from exchanges among the agents. And use of decoupled resources characterises algorithmic
formal relational properties are featured in cognitive meshworks which yield formal relational properties.
simulations and conceptual operations that employ Theoretical and experimental treatment of this latter
ofine cognitive resources that is, resources that are form of creativity support still needs to be tackled by
decoupled from the activity (Wilson 2002; Keller et al. the eco-compositional literature. Furthermore, the
2014c). Broadly speaking, these formal operations fourth component of the ubimus ecologies initially
engage what Evans and Stanovich (2013: 230) call the labelled creativity support tools needs to be expanded
algorithmic mind. Thus, algorithmic meshworks can be to handle the distributed and volatile qualities of
dened as forms of material and cognitive arrange- ubimus socio-technological resources. Ubimus eco-
ments that act on formal relational properties. While systems may provide an alternative avenue for
social and material relational properties are aligned exploratory design strategies.
with the well-established concepts of social and natural One of the objectives of this article is to explore the
affordances (Keller et al. 2010), formal relational implications of ecologically grounded practices within
properties have not yet been thoroughly explored from the context of ubiquitous music-making. After having
ecologically grounded creative perspectives. Aside presented several examples of ubimus projects, we are
from the hybrid forms of processing inspired on Von in a better position to discuss the implications of the
Foersters (2003) concept of computing (Di Scipio eco-based framework for context-based creative
2014), these relational properties may play a signicant endeavours. Truax (2015: 109) denes context-based
role in both the planning and the conceptual stages of composition as a powerful artistically and socially
the ubimus design cycle. motivated means of re-engaging both the composer
Given the previous discussion, the fourth compo- and the listener with real-world contexts. The sonic
nent of the ubimus denition creativity support tools outcomes of this practice are not just channelled
does not seem to address the needs of ecologically through concert-style venues, they are also featured on
grounded creative activity. Isolated tools even when radio, on the web, and on wearable computing devices.
designed for creative action may not be suited to the These location-oriented technologies are the focus of
open, iterative and multi-tiered methods that are ubimus research. Truax suggests that musical practices
emerging in eco-based creative practices. A desirable enabled by ubiquitous technology may establish a
quality of ubimus systems is self-reectivity. Both trend to be followed over the next decade. Further-
Bowns and the Palato 1.0 study indicate that creative more, he observes that todays job market [] seems
support systems should not only provide the means to to require everyone to carve out an innovative path,
achieve pre-dened objectives, they should also foster rather than t into a standard pre-dened mould
the exploration of new epistemic targets. Rather than (Truax 2015: 109). Hence, the proposal of designing
dealing with well-dened problems, ubimus activities for creativity as stated in a recent ubimus manifesto
may involve open-ended handling of both material and (Pimenta et al. 2014) seems to be aligned with the
social relational properties. A concept that may full needs of context-based composition.
the requirements of the fourth component of the de- Despite contributing with the introduction of the
nition of ubiquitous music is the ubimus ecosystem. place factor within creative musical practice, sounds-
Handling material resources through ubimus ecosys- cape literature has not yet addressed the distributed
tems may open opportunities for the application of nature of creative activity. We detected a similar
exploratory design strategies. shortcoming in one component of the denition of
ubiquitous music. Creativity support tools, as pro-
posed within the context of humancomputer interac-
tion research (Shneiderman 2007), do not seem to take
4. IMPLICATIONS OF THE ECOLOGICALLY
into account the interrelated properties of material and
GROUNDED UBIMUS FRAMEWORKS FOR
behavioural ubimus resources. The proposed revised
CONTEXT-BASED COMPOSITION
denition (mentioned at the beginning of section 3)
Let us summarise what we have learnt so far. Ubimus incorporates creative ecologies as key elements of
ecologies provide a promising context for the expan- ubimus practice, featuring three layers: behavioural
sion of ecologically grounded creative practice. These ecologies, multimodal ecologies and algorithmic
ecologies can be characterised as xed or adaptive meshworks. Algorithmic meshworks are forms of
depending on the relationships between the local material and cognitive arrangements that act on for-
resources and the ecological niche. Relational mal relational properties. These meshworks may be

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
Ecologically Grounded Creative Practices in Ubiquitous Music 69

relevant for the planning and conceptual activities coauthors adopted an opportunistic, ecologically
involved in the early stages of creative practice. light-footprint approach. Cognitive simulations and
Multimodal ecologies target activities scaffolded on conceptual operations that are enabled by manipula-
environmental features, highlighting the interactions tions of material resources can also be dened as
among agents and material resources. Finally, beha- self-assembling sets of interrelationships in which
viourial ecologies are based on social interactions information is directly inscribed (see Introduction).
targeting outcomes that shape new human behaviours. The results of both studies indicate that creative
The view of musical creativity as an individual activities demand a heavy usage of conceptual opera-
endeavour carried out inside the composers head and tions through asynchronous support. What contexts
involving the abstract manipulations of symbols may demand light-weight tools or complex generative
t the demands of concert-oriented formats but does strategies is still an open question. Design choices have
not fare well for everyday settings. The artistic projects several implications for context-based composition.
discussed in this article challenge the anthropocentric Adaptive sonic ecologies are open to the inuence of
and instrumentally biased perspectives on creative the habitat, so they usually demand synchronous
practice pointing to the need of more uid creativity support. And they are tightly constrained by the sta-
support strategies. Distributed forms of creativity such keholders cognitive resources. Fixed sonic ecologies
as those fostered by ecologically grounded creative are not bound by temporal constraints, hence they
practices imply sharing the responsibility of aesthetic foster complex sonic manipulations. In this case, the
decision making. As articulated in Keller et al.s barrier lies in the knowledge transfer mechanisms.
(2014b) ubimus application of Glveanus (2013) gen- When the decision-making process is distributed across
eral creativity model, both audience and agents time and space, the local cues are lost. These cues can
become active participants of the creative process. be partially shared through creative surrogates (Keller
Hence, the concept of musical performance as a dis- et al. 2015a) as exemplied by the usage of audiovisual
play of previously established choices gives way to sketches (see section 3.3). But how much and what type
the deployment of sonic resources. On the one hand, of knowledge is necessary to ground informed aesthetic
the musical results do not depend purely on the com- decision making is still unknown.
positional choices. On the other hand, distributed The footprint of context-based compositions can be
creativity engages the usage of local material resources signicantly extended by exploring the creative
and of socially shared knowledge, both fostering and potential of the IoMT. The IoMT can be understood
limiting creative outcomes. This form of distributed both as a geographical and as a social design tool. With
agency has been labelled adaptive sonic ecology (Kel- the embedding of musical devices in a variety of loca-
ler 2012). Adaptive sonic ecologies occur in habitats tions, the modes of interaction between the audience/
where agents and objects interact, yielding creative by- public and the sonic resources are multiplied. While
products that make intensive usage of local material sharing local resources over a wide area, stakeholders
and behavioural resources. In contrast, xed sonic can experience an expanded, enveloping environment.
ecologies enforce a strict separation of the decision- Actions and events in one location can have long-
making processes and the ecological niche. This means ranging effects over a number of interlinked resources.
that decisions do not necessarily depend on the local It is true that interactions between external, remote
material resources. These two models provide useful agents have already been used in web-based musical
guidelines of ubimus designs for context-based music- works. However, IoMT infrastructure based on mini-
making. Support for adaptive sonic ecologies relies on mal, customised, embedded and connected devices
volatile resources, thus it needs to ensure graceful enhances the exibility of creativity support systems
degradation of system performance when the resources to explore both the sonic and the social potentials of
are not accessible (e.g. because of connectivity break- distributed ecosystems. As observed in IoT scenarios,
down or because of stakeholders with limited musical design decisions occur both at local and at distributed
expertise). Fixed sonic ecologies provide more robust levels, demanding a balance between bottom-up and
support but the toll is reduced exibility. The link top-down strategies.
between the resources and the eco-niche is severed, The emerging trend of widely distributed and par-
yielding sonic materials that can be freely manipulated tially connected systems of heterogeneous devices
but which are not necessarily ecologically valid (see the points to increased access to volatile material resour-
previous discussion of usage of online sonic databases). ces, demanding a type of expertise that is not supported
Algorithmic meshworks emerge as interesting tools by current musical training (Brown 2015). As we have
to deal with formal relational properties. Two studies seen, ubimus ecosystems function as technological
reviewed in this article (Bown 2014; Keller et al. 2014d) hubs that support the integration of audio and inter-
highlight the key role of exploratory (also called epis- action tools. These ecosystems can be recongured
temic) activities in creativity-centred design. While to t the creative needs of stakeholders through
Bown focused on the use of complex tools, Keller and rapid prototyping techniques. Future context-based

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
70 Damin Keller and Victor Lazzarini

compositional practices will probably demand stron- Connors, T. M. 2015. Audiovisual Installation as Ecological
ger and more exible support for distributed decision Performativity. In Proceedings of the Create World
making. Given this set of requirements, ubimus Conference 2015. Brisbane, Australia: Grifth University.
research may furnish viable solutions to the challenges Di Scipio, A. 2008. mergence du Son, Son demergence:
raised by context-based creative practices. Essai dpistmologie Exprimentale par un Composi-
teur. Intellectica 489: 22149.
Di Scipio, A. 2014. The Place and Meaning of Computing in
a Sound Relationship of Man, Machines, and Environ-
Supplementary material
ment. In Proceedings of the ICMC|SMC|2014. Athens,
To view supplementary material for this article, please Greece: ICMA.
visit https://doi.org/10.1017/S1355771816000340 Donald, M. 2006. Art and Cognitive Evolution. In M. Turner
(ed.) The Artful Mind. Oxford: Oxford University Press.
Dougherty, D. 2012. The Maker Movement. Innovations
7(3): 1114.
REFERENCES Edmonds, E., Fischer, G., Mountford, S. J., Nake, F.,
Riecken, D. and Spence, R. 1995. Creativity Interacting
Aliel, L. and Fornari, J. 2014. Destino Pirilampo Project: A
with Computers. In Proceedings of the ACM CHI
Study on Meta-Soundscape Composition in Ubiquitous
Conference on Human Factors in Computing Systems
Music (Projeto destino pirilampo: um estudo sobre a
(CHI 95). Denver, Colorado, 711 May.
composio de meta-soundscapes em msica ubqua).
Emmerson, S. 2001. From Dance! to Dance: Distance
Msica Hodie 14(1): 10521.
and Digits. Computer Music Journal 25(1): 1320.
Barrass, S. and Adcock, M. 2002. Interactive Granular
Evans, J. S. B. T. and Stanovich, K. E. 2013. Dual-Process
Synthesis of Haptic Contact Sounds. In Proceedings of the
Theories of Higher Cognition: Advancing the Debate.
Audio Engineering Society Conference: 22nd International
Perspectives on Psychological Science 8(3): 22341.
Conference: Virtual, Synthetic, and Entertainment Audio.
Fantauzzacofn, J. and Rogers, J. D. 2013. Considering
Espoo, Finland, 1517 June.
Patterns of Creative Work Process in Creativity Support.
Barrett, N. 2000. A Compositional Methodology Based on
In Proceedings of the ACM CHI Conference on Human
Data Extracted from Natural Phenomena. In Proceedings
Factors in Computing Systems (CHI13), Paris, France,
of the International Computer Music Conference (ICMC 27 April2 May.
2000. Ann Arbor, MI: MPublishing, University of Fitzmaurice, G., Ishii, H. and Buxton, W. 1995. Bricks:
Michigan Library. Laying the Foundations for Graspable User Interfaces.
Basanta, A. 2010. Syntax as Sign: The Use of Ecological In Proceedings of the ACM SIGCHI Conference on
Models within a Semiotic Approach to Electroacoustic Human Factors in Computing Systems (CHI95). Denver,
Composition. Organised Sound 15(2): 12532. Colorado, 711 May.
Beaty, R. E., Benedek, M., Kaufman, B. S. and Silvia, P. J. Flores, L. V., Pimenta, M. S. and Keller, D. 2010. Patterns
2015. Default and Executive Network Coupling Supports for the Design of Musical Interaction with Everyday
Creative Idea Production. Scientic Reports 5(10964). Mobile Devices. In Proceedings of the 9th Brazilian
Bernardo, F., Pestana, P. and Martins, L. 2015. The Smart Symposium on Human Factors in Computing Systems,
Stage: Designing 3D Interaction Metaphors for Immer- Belo Horizonte, MG.
sive and Ubiquitous Music Systems. In Proceedings of the Flores, L. V., Pimenta, M. S. and Keller, D. 2014. Patterns of
International Conference on New Music Concepts Musical Interaction with Computing Devices. Cadernos
(ICNMC 2015). Treviso, Italy: ICNMC. de Informtica 8(2): 6881.
Bown, O. 2014. Empirically Grounding the Evaluation of Gibson, J. J. 1977. The Theory of Affordances. In R. Shaw
Creative Systems: Incorporating Interaction Design. In and J. Bransford (eds.) Perceiving, Acting, and Knowing:
Proceedings of the Fifth International Conference on Toward an Ecological Psychology. Mahwah, NJ: Lawr-
Computational Creativity (ICCC 2014). Libjubljana, ence Erlbaum Associates.
Slovenia: ICCC. Gibson, J. J. 1979. The Ecological Approach to Visual
Brown, A. R. 2015. Engaging in a Sound Musicianship. In Perception. Boston, MA: Houghton Mifin.
G. E. McPherson (ed.) The Child as Musician: A Handbook Glveanu, V. P. 2013. Rewriting the Language of Creativity:
of Musical Development. Oxford: Oxford University Press. The Five As Framework. Review of General Psychology
Burtner, M. 2005. Ecoacoustic and Shamanic Technologies 17(1): 6981.
for Multimedia Composition and Performance. Gomes, J., Pinho, N., Lopes, F., Costa, G., Dias, R., Tudela,
Organised Sound 10(1): 319. D. and Barbosa, . 2014. Capture and Transformation of
Burtner, M. 2011. EcoSono: Adventures in Interactive Ecoa- Urban Soundscape Data for Artistic Creation. Journal of
coustics in the World. Organised Sound 16(3): 23444. Science and Technology of the Arts 6(1): 97109.
Cdiz, R. F. 2012. Musical Creation in the Post-Digital Era Hamman, M. 2002. From Technical to Technological: The
(Creacin musical en la era postdigital). Aisthesis 52: 44975. Imperative of Technology in Experimental Music
Castle, G., Adcock, M. and Barrass, S. 2002. Integrated Composition. Perspectives of New Music 40(1): 92120.
Modal and Granular Synthesis of Haptic Tapping and Hutchins, E. 1995. Cognition in the Wild. Cambridge, MA:
Scraping Sounds. In S. A. Wall, B. Riedel, A. Crossan MIT Press.
and M. R. McGee (eds.) Eurohaptics 2002 Conference Hutchins, E. 2010. Cognitive Ecology. Topics in Cognitive
Proceedings. University of Edinburgh, July. Science 2(4): 70515.

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
Ecologically Grounded Creative Practices in Ubiquitous Music 71

Ishii, H., Mazalek, A. and Lee, J. 2001. Bottles as a Minimal Aesthetics and Ubiquitous Music. In N. Zagalo and P.
Interface to Access Digital Information. In Extended Blanco (eds.) Creativity in the Digital Age. Berlin and
Abstracts on Human Factors in Computing Systems Heidelberg: Springer.
(CHI 01). New York: ACM. Keller, D., Timoney, J., Costalonga, L., Capasso, A.,
Jones, D., Brown, A. R. and dInverno, M. 2012. The Tinajero, P., Lazzarini, V., Pimenta, M. S., Lima, M. H.
Extended Composer. In J. McCormack and M. dInverno and Johann, M. 2014d. Ecologically Grounded
(eds.) Computers and Creativity. Berlin and Heidelberg: Multimodal Design: The Palato 1.0 Study. Proceedings
Springer. of the International Computer Music Conference (ICMC
Keller, D. 1999. touchngo: Ecological Models in 2014).0 Athens: ICMA.
Composition. Master of Fine Arts thesis, Burnaby, BC: Keller, D. and Truax, B. 1998. Ecologically Based Granular
Simon Fraser University. www.sfu.ca/sonic-studio/srs/ Synthesis. In Proceedings of the International Computer
EcoModelsComposition/Title.html. Music Conference. Ann Arbor, MI: MPublishing,
Keller, D. 2000. Compositional Processes from an Ecological University of Michigan Library.
Perspective. Leonardo Music Journal 10: 5560. Lazzarini, V., Costello, E., Yi, S. and ftch, J. 2014a.
Keller, D. 2012. Sonic Ecologies. In A. R. Brown (ed.) Sound Development Tools for Ubiquitous Music on the World
Musicianship: Understanding the Crafts of Music. Wide Web. In D. Keller, V. Lazzarini and M. S. Pimenta
Newcastle upon Tyne, UK: Cambridge Scholars. (eds.) Ubiquitous Music. Berlin and Heidelberg: Springer.
Keller, D., Barreiro, D. L., Queiroz, M. and Pimenta, M. S. Lazzarini, V., Keller, D., Pimenta, M. and Timoney, J.
2010. Anchoring in Ubiquitous Musical Activities. In 2014b. Ubiquitous Music Ecosystems: Faust Programs in
Proceedings of the International Computer Music Csound. In D. Keller, V. Lazzarini and M. S. Pimenta
Conference. Ann Arbor, MI: MPublishing, University of (eds.) Ubiquitous Music. Berlin and Heidelberg: Springer.
Michigan Library. Lazzarini, V., Timoney, J. and Byrne, S. 2015. Embedded
Keller, D. and Berger, J. 2001. Everyday Sounds: Synthesis Sound Synthesis. In Proceedings of the Linux Audio
Parameters and Perceptual Correlates. In Proceedings of Conference 2015. Mainz, Germany: Johannes Gutenberg
the VIII Brazilian Symposium on Computer Music (SBCM University.
2001). http://gsd.ime.usp.br/~lku/site-sbcm/2001/. Lazzarini, V., Yi, S., Timoney, J., Keller, D. and Pimenta,
Keller, D. and Capasso, A. 2006. New Concepts and Techni- M. S. 2012. The Mobile Csound Platform. In Proceedings
ques in Eco-Composition. Organised Sound 11(1): 5562. of the International Computer Music Conference. Ann
Keller, D., Capasso, A. and Wilson, S. R. 2002. Urban Arbor, MI: MPublishing, University of Michigan
Corridor: Accumulation and Interaction as Form- Library.
Bearing Processes. In Proceedings of the International Lima, M. H., Keller, D., Pimenta, M. S., Lazzarini, V. and
Computer Music Conference (ICMC 2002. Ann Arbor, Miletto, E. M. 2012. Creativity-Centred Design for
MI: MPublishing, University of Michigan Library. Ubiquitous Musical Activities: Two Case Studies. Journal
Keller, D., Flores, L. V., Pimenta, M. S., Capasso, A. and of Music, Technology and Education 5(2): 195222.
Tinajero, P. 2011. Convergent Trends Toward McGlynn, P., Lazzarini, V. and Delap, G. 2012. Recontex-
Ubiquitous Music. Journal of New Music Research 40(3): tualizing the Multi-Touch Surface. In G. Essl, B.
26576. Gillespie, M. Gurevich and S. OModhrain (eds.)
Keller, D., Lazzarini, V. and Pimenta, M. S. 2014a. Ubiqui- Proceedings of the International Conference on New
tous Music. Vol. XXVIII. Berlin and Heidelberg: Springer Interfaces for Musical Expression. Ann Arbor, Michigan:
International. University of Michigan.
Keller, D., Lazzarini, V. and Pimenta, M. S. 2014b. Ubimus McGraw, G. and Hofstadter, D. 1993. Perception and
Through the Lens of Creativity Theories. In D. Keller, V. Creation of Diverse Alphabetic Styles. AISB Quarterly
Lazzarini and M. S. Pimenta (eds.) Ubiquitous Music. 85: 429.
Berlin and Heidelberg: Springer International. Mitchell, W. J., Inouye, A. S. and Blumenthal, M. S. 2003.
Keller, D., Miletto, E. M. and Otero, N. 2015a. Creative Beyond Productivity: Information Technology, Innovation,
Surrogates: Supporting Decision-Making in Ubiquitous and Creativity. Washington, DC: National Academies
Musical Activities. In Proceedings of the 3rd International Press.
Conference on Computation, Communication, Aesthetics Nance, R. W. 2007. Compositional Explorations of Plastic
and X (xCoAx 2015). Glasgow, Scotland: xCoAx. Sound. Doctoral thesis in Music, De Montfort
Keller, D., Otero, N. and Costalonga, L. 2015b. Aesthetic University, UK.
Heuristics in Ubimus. In Proceedings of the Electronic Norman, D. A. 1988/2002. The Design of Everyday Things.
Visualisation and the Arts Conference (EVA 2015). Lon- New York: Basic Books.
don: BCS, Computer Arts Society Specialist Group. OCallaghan, J. 2013. Orchestration of Ecology, as Ecology.
Keller, D., Otero, N., Lazzarini, V., Pimenta, M. S., Lima, In Proceedings of the Music and Ecologies of Sound
M. H., Johann, M. and Costalonga, L. 2014c. Relational Conference 2013, Paris. http://goo.gl/86emp9.
Properties in Interaction Aesthetics: The Ubiquitous Odling-Smee, F., Laland, K. and Feldman, M. 2003. Niche
Music Turn. In K. Ng, J. P. Bowen and S. McDaid (eds.) Construction: The Neglected Process in Evolution.
Proceedings of the Electronic Visualisation and the Arts Princeton, NJ: Princeton University Press.
Conference (EVA 2014). London: BCS, Computer Arts Opie, T. and Brown, A. 2006. An Introduction to
Society Specialist Group. Eco-Structuralism. In Proceedings of the International
Keller, D., Otero, N., Lazzarini, V., Pimenta, M. S., Lima, Computer Music Conference (ICMC 2006), New
M. H., Johann, M. and Costalonga, L. 2015c. Interaction Orleans, LA, 611 November.

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340
72 Damin Keller and Victor Lazzarini

Pimenta, M. S., Flores, L. V., Capasso, A., Tinajero, P. and (eds.) Understanding Origins. Amsterdam, Netherlands:
Keller, D. 2009. Ubiquitous Music: Concept and Meta- Springer.
phors. In R. R. A. Farias, M. Queiroz and D. Keller (eds.) Von Foerster, H. 2003. Understanding Understanding: Essays
Proceedings of the XII Brazilian Symposium on Computer on Cybernetics and Cognition. New York: Springer-
Music (SBCM 2009). Recife, PE: SBC. Verlag.
Pimenta, M. S., Keller, D., Flores, L. V., Lima, M. H. and Wallas, G. 1926. The Art of Thought. New York: Harcourt,
Lazzarini, V. 2014. Methods in Creativity-Centred Brace and Company.
Design for Ubiquitous Musical Activities. In D. Keller, Weiser, M. 1995. The Computer for the 21st Century. In R.
V. Lazzarini and M. S. Pimenta (eds.) Ubiquitous Music. M. Baecker, J. Grudin, W. A. S. Buxton and S. Greenberg
Heidelberg and Berlin: Springer. (eds.) Human-Computer Interaction. San Francisco, CA:
Rhodes, M. 1961. An Analysis of Creativity. The Phi Delta Morgan Kaufmann.
Kappan 42: 30511. Wenger, E. 2010. Communities of Practice and Social
Ribeiro Netto, A., Castheloge, L., Oliosi, A., Mateus, A., Learning Systems: The Career of a Concept. In C.
Costalonga, L. and Coura, D. 2015. Memory Tree: Blackmore (ed.) Social Learning Systems and Commu-
Multimedia Interactive Installation (rvore das Memr- nities of Practice. London: Springer.
ias: Instalao Multimdia Interativa). In Proceedings of Wessel, D. and Wright, M. 2002. Problems and Prospects for
the XV Brazilian Symposium on Computer Music (SBCM Intimate Musical Control of Computers. Computer Music
2015, Campinas, So Paulo, 2325 November. Journal 26(3): 1122.
Rudi, J. (2015). Past and Current Tendencies in Technology- Wilson, M. 2002. Six Views of Embodied Cognition. Psy-
Based Music. Organised Sound 20(1): 3036. chonomic Bulletin & Review 9(4): 62536.
Shneiderman, B. 2007. Creativity Support Tools: Accelerat- Wishart, T. 2009. Computer Music: Some Reections. In
ing Discovery and Innovation. Communications of the R. T. Dean (ed.) The Oxford Handbook of Computer
ACM 50(12): 2032. Music, 15160. New York: Oxford University Press.
Shneiderman, B., Fischer, G., Czerwinski, M., Myers, B. and
Resnick, M. 2005. Creativity Support Tools: A Workshop
Sponsored by the National Science Foundation [Technical DISCOGRAPHY
Report]. Washington, DC: National Science Foundation.
Shultz, S. and Dunbar, R. 2007. The Evolution of the Social Westerkamp, H. 1989. Kits Beach Soundwalk [Spoken voice
Brain: Anthropoid Primates Contrast with Other and two-channel tape]. Montreal: Empreintes Digitales,
Vertebrates. Proceedings of the Royal Society of London CD.
B: Biological Sciences 274(1624): 2429436. Capasso, A., Keller, D. and Tinajero, P. 1999. The Trade/
Tanaka, A. 2009. Sensor-Based Musical Instruments and Oro por Baratijas. [Installation]. Boulder, CO: CU Art
Interactive Music. In R. T. Dean (ed.) The Oxford Handbook Galleries.
of Computer Music. New York: Oxford University Press. Capasso, A., Keller, D. and Tinajero, P. 2000. The Urban
Truax, B. 2002. Genres and Techniques of Soundscape Corridor/Corredor Urbano. [Ubiquitous Music Work].
Composition as Developed at Simon Fraser University. Boulder, CO: CU Art Galleries.
Organised Sound 7(1): 514. Capasso, A., Keller, D. and Tinajero, P. 2012. Palato/
Truax, B. 2015. Paradigm Shifts and Electroacoustic Music: Palata/Home-on-stilts 1.0. [Ubiquitous Music Work].
Some Personal Reections. Organised Sound 20(1): 10510. New York, NY: Floor4Art.
van Kranenburg, R. and Bassi, A. 2012. IoT Challenges. Capasso, A., Keller, D. and Tinajero, P. 2014. InMesh 1.0/
Communications in Mobile Computing 1(1): 9. Enmaraados 1.0/Emaranhados 1.0. [Ubiquitous Music
van Troyer, A. 2014. Repertoire Remix in the Context of Work]. New York: MediaNoche Gallery.
Festival City. In D. Keller, V. Lazzarini and M. S. Pimenta Keller, D. 1998. ... soretes de punta. [8-channel Tape]. New
(eds.) Ubiquitous Music. Berlin and Heidelberg: Springer. Westminster, BC: earsay productions. https://earsaymusic.
Varela, F. J. 1992. Whence Perceptual Meaning? A Carto- bandcamp.com/track/soretes-de-punta (accessed 8 August
graphy of Current Ideas. In F. J. Varela and J.-P. Dupuy 2016).

Downloaded from https:/www.cambridge.org/core. Columbia University Libraries, on 31 May 2017 at 02:52:44, subject to the Cambridge Core terms of use, available at
https:/www.cambridge.org/core/terms. https://doi.org/10.1017/S1355771816000340

You might also like