We propose a solution focusing on  mixed reality interaction

by combining computer vision and 

ubiquitous computing techniques, to allow the user to simply 

point to the device of interest, to be controlled, via the 

smartphone camera

(proposed solution)
The scope of area of research

Traditional user interaction with home domain 

consumer electronics 

Our goal is to afford greater consumer 

engagement and acceptance of ne

tworked home applications by 

introducing a simple and intuitive interaction metaphor 

borrowed from the Mixed Reality field: mixing the digital and 

physical environment through the use of computer vision [1]. 

the lack of a tangible real-world 

interaction metaphor complicates

 the everyday usage of those 

devices in a smartphone. 

although there are various different  home device interaction 

exist they have not become ubiquitous
The achievements

The methodology
to exchange data and 

control messages. Among these, DLNA (Digital Living 

Network Alliance) solutions, which are based on the Universal 

Plug and Play (UPnP) set of networking protocols published by the UPnP Forum. Many smartphones already utilize UPnP 

protocols for discovering home devices (such as media 

renderers) and playing out their audio-visual (AV) content there. 

However, the human-machine interaction designs employed are 

list based user interfaces (UI) - essentially a simplified 

directory/file system metaphor - akin to the desktop PC 

environment.