Touch Projector

Touch Projector: Mobile Interaction through Video


This paper examines the use of a hand held device like an iPhone 3G to interact with remote displays.


1) The device effectively eliminates the need for direct contact with the screen in question. Hence, it can be used to interact with displays of all shapes and sizes and those that are not directly accessible, like if the screen was behind a glass wall for instance. In addition, this would be a good way for patrons to access the different features of our video wall through a gesture-based interaction, which would otherwise have been impractical.
2) This could drastically cut the costs of building gesture-based systems. Making a phone capable of touch interface is a lot cheaper than building a television with the same capability.
3) One feature that I found very interesting was the auto-zoom. The video feed on the phone automatically calibrated itself based on the distance between the screen and the user.
4) The system also allows for a seamless interaction with several remote displays at once. You could drag and drop tabs from one screen to another much like mouse allows us to do so between multiple displays.


1) The video feed on the phone was a little jittery. The experience was not as smooth as a regular iPhone application.
2) As stated by the researchers, the system was not as effective with displays of small apparent sizes on the mobile phone.
3) There was a tradeoff between task completion time and precision of target placement with the auto zoom feature.