Extended Workspace using a Smartphone with a Depth Camera

We propose a user interface which expands the workspace of a smartphone by superimposing a virtual touchscreen on a flat surface such as a desk and the user’s lap and allowing the user to perform touch operation on the surface. Information is displayed not only on the flat surface but also outside and above the surface and is fixed in real space, which enables the user to effectively utilize the space and change the area to be displayed quickly by moving the device. The user can drag the entire workspace by swiping the surface or performing gesture operation in the air. This enables the user to move the objects outside the surface or out of the user's reach toward the user so that the user can touch the objects.
Masashi Miyazaki, Takashi Komuro: Extended Workspace using a Smartphone with a Depth Camera, Adj. Proc. 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2018), pp. 115-116 (2018)