EAI banner

Mix Experiential Reality Workshop – Call for Papers

In-Visible Island: Shareable Experience Through Non-Linear Story Creation

Workshop Chair

Ruhiyati Idayu Abu Talib

Media and Game Innovation Centre of Excellence ( MaGICX), Institute of Human Centered Engineering (iHumEn), Universiti Teknologi Malaysia


Description of workshop

Children with visual disabilities have difficulty communicating, engaging and interacting in full play behavior with their peers. In addition, they spend more time engaging in solitary interaction or playing with their parents alone, which could have a negative impact on their personal and emotional skills development. This situation may cause frustration rather than self-efficiency and independence, which are necessary characteristics for healthy children’s social competence.

SmCLES is a multi-sensory platform that offer visually impaired children an opportunity to experience interactive, non-linear, multi-sensory storytelling while actively involving them in creating stories, rather than just listening to them passively. It is a multimodal modular table supported by multi-sensory disks capable of producing sound, vibration and able to detect gestures in the progressive context of the storyline while triggering the central computer to generate the next part of the story and connect it to the previous part.

Participants of the workshop will be introduced to the concept and technical solution of the platform as well as to experience SmCLES platform and in direct interaction between each other to enjoy in the non-
linear story creation.

The objectives of the workshop are to:

  • In this project, we tried to identify environmental barriers that are limiting visually impaired child’s abilities to play together with their sighted peers. We adopted a Research through Design (RtD) method and focused on non – linear story, creating activity between sighted children and visually impaired children. We hypothesise that this activity will improve interactions, understanding and communication between these groups and play a role in accelerating their
    social learning curve.
  • We designed Smart Collaborative Learning Environment System (SmCLES) to achieve common multi-sensory user experience between groups of users with different physical preferences by using tactile and sound stimulations, common elements of realities for both groups, as essential for users’ experience design. Two user studies will be conducted to evaluate the usability and affordance of the system as a medium to create suitable social space for the children to interact together.

The goals of the workshop are to:

  • We will use the workshop to conduct user studies to evaluate the usability and affordance of the system as a medium to create suitable social space for the children to interact together.

The expected outcomes:

  • To publish one paper based on the result of the workshop.
  • New multi-disciplinary partnerships among researchers/stakeholders leading to new working groups seeking to address specific Robot Creativity and Artificial Intelligence Mindfulness questions and projects.


Our main goal of this thesis project is to deepen in an area of knowledge that has generated little research
for the moment; understanding the environmental barriers that discourage visually impaired children
from playing together with their sighted peer. Specifically, on how we can overcome barriers present in
traditional interactive experiences requiring a consistent set of abilities among the participants and
support interaction between people of varying sensory abilities to participate in shared playful experience
controlled by user’s action.

The specific objectives are:

  • To design interaction that would help evoke play behaviour between visually impaired children and their sighted peer.
  • To deliver an experience that focus on evoking play behaviour in visually impaired children but also can be understood by their sighted peer.
  • To evaluate and analysis type and a number of interaction that the children experience.


  • Multi-sensory experience
  • Interactivity
  • Multi-sensory interfaces
  • Machine storytelling
  • Mix experiential reality
  • Human-centered design


All registered papers will be submitted for publication by Springer and made available through SpringerLink Digital Library.

Intetain proceedings are indexed in leading indexing services, including Ei Compendex, ISI Web of Science, Scopus, CrossRef, Google Scholar, DBLP, as well as EAI’s own EU Digital Library (EUDL).

All accepted authors are eligible to submit an extended version in a fast track of:

Additional publication opportunities:


Short papers should be from 4 to 8 pages long and submitted via the Confy submission system.

Important Deadlines

Full Paper Submission deadline
13 September 2019 [final]

Workshop Submission deadline
20 September 2019 [final]

Notification deadline
11 October 2019

Camera-ready deadline
1 November 2019

Start of Conference
29 November 2019

End of Conference
1 December 2019

EAI Institutional Members