Publication: A Middleware for Seamless Use of Multiple Displays

Current multi-display environments (MDEs) can be composed of displays with different characteristics (e.g. resolution, size) located in any position and at different angles. These heterogeneous arrangements present specific interface problems: it is difficult to provide meaningful transitions of cursors between displays; it is difficult for users to visualize information that is presented on oblique surfaces; and it is difficult to spread visual information over multiple displays. In this paper we present a middleware architecture designed to support a new kind of perspective-aware GUI that solves the aforementioned problems. Our interaction architecture combines distributed input and position tracking data to generate perspective-corrected output in each of the displays, allowing groups of users to manipulate existing applications from current operating systems across a large number of displays. To test our design we implemented a complex MDE prototype and measured different aspects of its performance.




Satoshi Sakurai Yuichi Itoh
Yoshifumi Kitamura Miguel Nacenta
University of St Andrews, University of Saskatchewan, University of Calgary
Tokuo Yamaguchi Sriram Subramanian
University of Bristol
Fumio Kishino


Sakurai, S., Itoh, Y., Kitamura, Y., Nacenta, M.A., Yamaguchi, T., Subramanian, S., Kishino, F. 2008. A Middleware for Seamless Use of Multiple Displays. In Interactive Systems. Design, Specification, and Verification, vol. 5136/2008, Lecture Notes In Computer Science. ISBN 978-3-540-70568-0. 252-266. DOI=10.1007/978-3-540-70569-7_23.


@inbook {156-Middleware-for-seamless-use-of-multiple-displays,
author= {Satoshi Sakurai and Yuichi Itoh and Yoshifumi Kitamura and Miguel Nacenta and Tokuo Yamaguchi and Sriram Subramanian and Fumio Kishino},
title= {A Middleware for Seamless Use of Multiple Displays},
booktitle= {Interactive Systems. Design, Specification, and Verification},
year= {2008},
volume= {5136/2008},
series= {Lecture Notes In Computer Science},
pages= {252-266}