Workshop Summary of Cross-Surface 2015 at ITS2015

We had an amazing workshop day at the ITS2015 conference in Madeira. We would like to thank all our participants for their effort, work and enthusiasm. Special thanks to Professor Yvonne Rogers for her inspiring and provocative keynote kicking off the workshop day. In this workshop, we reviewed and discussed opportunities, technical challenges and problems with cross-device interactions in real world interactive multi-surface and multi-device ecologies. We aim to bring together researchers and practitioners currently working on novel techniques for cross-surface interactions, focusing both on technical as well as interaction challenges for introducing these technologies into the wild, and highlighting opportunities for further research. The workshop will help to facilitate knowledge exchange on the inherent challenges of building robust and intuitive cross-surface interactions, identify application domains and enabling technologies for cross-surface interactions in the wild, and establish a research community to develop effective strategies for successful design of cross-device interactions. Please find more details about the workshop, in the submitted proposal.


09:00 Introduction to workshop by the organizers (Chairs: Steven Houben and Jo Vermeulen)
09:15 Keynote by Professor Yvonne Rogers (Chair: Johannes Schöning)
10:00 Paper Presentations (Chair: Jo Vermeulen)
10:30 Coffee break
11:00 Brainstorm based on prepared insights and patterns (Chair: Nicolai Marquardt and Jo Vermeulen)
12:30 Lunch
13:30 Session 1: Use cases in the real world ( Chairs: Steven Houben and Yvonne Rogers)
14:15 Reflections on session 1
14:30 Session 2: From lab technologies to real-world solutions (Chairs: Johannes Schöning and Harald Reiterer)
15:00 Coffee Break
15:30 Reflections on session 2
15:45 Session 3: Beyond interaction techniques and Social Issues (Chairs: Nicolai Marquardt and Jo Vermeulen)
16:30 Reflections on session 3
16:45 Closing (Chair: Harald Reiterer)



Title: “Research in the Wild”
There have been several turns in Interaction Design. Most notable has been ‘a turn to the social’, ‘a turn to design’ and a ‘turn to experience’. Each has called for a new way of framing research and conceptualizing its discourse. During the last 10 years, there has been a move towards doing more ‘in the wild’; be it deploying and evaluating new technologies in situ or observing whatever is happening out there. As part of this ‘turn to the wild’ I will discuss the challenges of doing research in the wild – illustrating the new discoveries that can be achieved together with the tensions and problems that can arise when giving up control.

Yvonne Rogers is a Professor of Interaction Design, the director of UCLIC and a deputy head of the Computer Science department at UCL. Her research interests are in the areas of ubiquitous computing, interaction design and human-computer interaction. A central theme is how to design interactive technologies that can enhance life by augmenting and extending everyday, learning and work activities. This involves informing, building and evaluating novel user experiences through creating and assembling a diversity of pervasive technologies. Central to her work is a critical stance towards how visions, theories and frameworks shape the fields of HCI, cognitive science and Ubicomp. She has been instrumental in promulgating new theories (e.g., external cognition), alternative methodologies (e.g., in the wild studies) and farreaching research agendas (e.g., “Being Human: HCI in 2020” manifesto). She has also published a monograph (2012) called “HCI Theory: Classical, Modern and Contemporary.”

List of accepted papers

  1. XD-MVC: Support for Cross-Device Development
    Maria Husmann and Moira Norrie
    ETH Zurich, Switserland.
  2. Reporting Experiences on Group Activities in Cross-Device Settings
    Johannes Zagermann a, Ulrike Pfeil a, Mario Schreiner a, Roman Rädle b, Hans-Christian Jetter c and Harald Reiterer a
    a University of Konstanz, Germany
    b Microsoft Research, UK
    c University of Applied Sciences, Austria
  3. Deployable Cross-Device Experiences: Proposing Additional Web Standards
    Mario Schreiner a , Roman Rädle b , Kenton O’Hara b  and Harald Reiterer a
    a University of Konstanz, Germany
    b Microsoft Research, UK
  4. A Framework Towards Challenges and Issues of Multi-Surface Environments
    Chi Tai Dang and Elisabeth Andre
    University of Augsburg, Germany
  5. Towards Enhancing Data Exploration with Multiple Mobile Devices
    Sven Mayer a, Przemysław Kucharski b , Lars Lischke a  and Paweł Woźniak c
    a University of Stuttgart, Germany
    b Lodz University of Technology, Poland
    c Chalmers University of Technology Gothenburg, Sweden
  6. Using Semantic and Responsive Web Design Technologies for Cross-Device Interactions in Industrial Applications
    Jens Ziegler, Sebastian Heinze, Markus Graube, Stephan Hensel and Leon Urbas
    Technische Universität Dresden, Germany
  7. Device Boundaries: Posture in Interaction Ecologies
    Daniele Savasta
    Yasar University, Turkey
  8. Mixed Reality Environments as Ecologies for Cross Device Interaction
    Jens Müller and Harald Reiterer
    University of Konstanz, Germany
  9. Toward Utopian Multi-Surface Interactive Systems
    Cornelius Toole
    Tougaloo College Tougaloo, USA
  10. A Reality Checklist for Multi-Device Systems in the Wild?
    Henrik Korsgaard a , Steven Houben b  and Clemens Klokmose a
    a Aarhus University, Denmark.
    b University College London, UK
  11. Ad hoc adaptability in video-calling
    Sean Rintel, Kenton O’Hara, Behnaz Rostami Yeganeh and Roman Rädle
    Microsoft Research, UK
  12. Challenges for Managing Multi-Device Notifications
    Abhinav Mehrotra ab , Jo Vermeulen a , Robert Hendley a  and Mirco Musolesi b
    a University of Birmingham, UK
    b University College London, UK

Full Proceedings of the First Workshop on Cross-Surface workshop

Pre-workshop Preparation: Design Synthesis Method (Kolko, CHI 2014)

We asked each group of authors to review two other workshop abstracts and synthesize 2-3 insights and/or design patterns (or a combination of both) that represent this work (see examples below). Based on this, we performed an “insight combination” design activity (Kolko, CHI ’14: Design Synthesis course) during the workshop to rapidly generate cross-device interaction design ideas based on randomly selected insight/design pattern combinations

An insight is a “provocative statement of truth” (that may be wrong); it is a “clear, deep, meaningful perception into human behavior in a particular design context”. In each insight, feel free to combine your empirical data (e.g., from user studies) with what you know from the scientific knowledge base and/or your interpretations/world views based on real-world experience. Design patterns “describe a possible solution to a problem, based on a problem/solution set in other context.” They can also be thought of as “trending paradigms” that reference past, present, or proposed solutions.


Examples Examples
Afford simple setup.
Connecting devices together should be simple and easy to configure.
The “internet of things” is allowing people to maintain remote connections to physical objects and places.
Be Loud and Public.
The display should encourage passive participation from those in the nearby vicinity.
Smart technology is appearing in unexpected places – like thermostats or vehicles – enabling new and often unexpected behaviors.
Encourage Group Activity.
People tend to arrive in groups, and are looking for ways to engage the whole party.
The connected world has created an artificial sense of urgency, and has changed the nature of time.

You can download all submitted patterns and insights: CS-indexcardsInsights CS-indexcards-Patterns




Based on the work done and the discussion at the workshop, we envision three main outcomes:

  1. Material and research projects that can be submitted to our special issue on INTERACTING ACROSS SURFACES: Multi-Device Ecologies “In the Wild” in the journal of Personal and Ubiquitous Computing
  2. A list of topics, ideas, and challenges for future work in the space of multi-device cross-surface systems and technology.
  3. A second edition of the workshop that will be held at CHI 2016 in San Jose, USA in May 2016. More info coming soon!