- 33
- 21 765
KomuroLab
Registrace 1. 11. 2012
Komuro Laboratory, Saitama University, Japan
www.is.ics.saitama-u.ac.jp
www.is.ics.saitama-u.ac.jp
AR Digital Workspace Using a Mobile Device
We propose an Augmented Reality (AR) technology called “AR Digital Workspace” that augments a workspace in real space by superimposing windows on a plane in real space. In the proposed interface, a plane in real space is detected when a user moves a mobile device, and multiple windows are superimposed on the detected plane. By touching the screen of the device, the user can change the position and size of the windows, and copy and paste text between windows. The user can also copy text in real space using character recognition on document images acquired from the camera. This system enables users to work while displaying a large amount of information in a pseudo spacious workspace. We implemented the proposed interface on a mobile device using ARCore, an AR framework for Android devices.
Yuki Kojima, Taishi Iriyama, Takashi Komuro: AR Digital Workspace Using a Mobile Device, Proc. Symposium on Spatial User Interaction, Article No. 21.
Yuki Kojima, Taishi Iriyama, Takashi Komuro: AR Digital Workspace Using a Mobile Device, Proc. Symposium on Spatial User Interaction, Article No. 21.
zhlédnutí: 24
Video
Lightweight Wearable AR System using Head-Mounted Projector for Work Support
zhlédnutí 82Před měsícem
We propose a lightweight wearable AR system for work support in which a user mounts a projector and a monocular camera on his or her head. The system can present information in front of the user's line of sight by superimposing images on a surface in real space. The system uses monocular SLAM to estimate the pose of the user's head, and changes images depending on the head movement, enabling th...
A Mid-air Multi-touch Interface using an Ultrafast Pan-tilt Camera
zhlédnutí 36Před měsícem
We propose an interface that enables bare hand interaction with fingers of both hands even from a distance, using an ultrafast pan-tilt camera and a wide view camera. In this interface, a user can perform multi-touch interaction with a large display using mid-air finger motions. In order to acquire accurate finger motions required for multi-touch interaction, a wide view camera is used to detec...
Palm-controlled Pointing Interface using a Dynamic Photometric Stereo Camera
zhlédnutí 324Před 4 lety
We propose a user interface that allows pointing operation with a user’s palm orientation by measuring the normal directions in the palm region using a dynamic photometric stereo camera based on a multi-tap CMOS image sensor. Our system allows users to control a pointer smoothly with small hand movement. We implemented two types of user interface designs and an interactive game to show the appl...
Dynamic Layout Optimization for Multi-user Interaction with a Large Display
zhlédnutí 288Před 4 lety
We propose a user interface that allows multiple users to obtain information interactively and to operate the interface simultaneously on a large display. Users can interact with the display using hand gestures, which enables many users to easily use the system from a distance. In order for each user to effectively use the screen and also not to be interfered with by other users, the system dyn...
Reproducing Material Appearance of Real Object using Mobile Augmented Reality
zhlédnutí 1,1KPřed 5 lety
We propose a system that can reproduce the material appearance of real objects using mobile augmented reality (AR). Our proposed system allows a user to manipulate a virtual object, whose model is generated from the shape and reflectance of a real object, using the user’s own hand. The shape of the real object is reconstructed by integrating depth images of the object, which are captured using ...
Extended Workspace using a Smartphone with a Depth Camera
zhlédnutí 453Před 5 lety
We propose a user interface which expands the workspace of a smartphone by superimposing a virtual touchscreen on a flat surface such as a desk and the user’s lap and allowing the user to perform touch operation on the surface. Information is displayed not only on the flat surface but also outside and above the surface and is fixed in real space, which enables the user to effectively utilize th...
A Multi-user Interactive Public Display with Dynamic Layout Optimization
zhlédnutí 179Před 5 lety
We propose a user interface that allows multiple users to obtain information interactively and perform simultaneous operation on a public display. Users can interact with the display using hand gestures, which enables many users to easily and remotely use the system. A window pops up when a user selects an item on the screen, and information about the item is displayed in the window. In order f...
Mobile Augmented Reality for Providing Perception of Materials
zhlédnutí 394Před 6 lety
We propose an AR system using a mobile display that allows the user to manipulate a virtual object using the user’s own hand to provide the user with perception of materials. To realize more natural interaction with a virtual object, our proposed system provides visual information that is consistent with the user’s somatic sensation by displaying user-perspective images on the mobile display. R...
Comparative Study on Text Entry Methods for Mobile Devices with a Hover Function
zhlédnutí 172Před 6 lety
We compared text entry methods for mobile devices such as smartphones, in which part of a software keyboard around the finger position is enlarged by using a hover function. We examined four methods: fixing the center of enlargement, not fixing the center of enlargement, adding a scrolling function, and using a standard software keyboard for reference. The result showed that fixing the center o...
On-mouse Projector: Peephole Interaction using a Mouse with a Projector
zhlédnutí 323Před 6 lety
We propose a system that combines a mouse with a projector and that allows users to perform peephole interaction, which enables stable operation in a wide workspace. In our prototype system, a mobile projector is attached above a mouse and projects part of the workspace on the plane in front of the mouse. The user can change the area he/she wishes to see by moving the mouse and can perform oper...
VolGrab: Realizing 3D View Navigation by Aerial Hand Gestures
zhlédnutí 237Před 7 lety
We propose a user interface that combines the existing touch interface with 3D view navigation by aerial hand gestures and that realizes simultaneous zooming and scrolling. While the touch interface enables only planar operation, aerial hand gestures enable 3D operation with an increased number of axes, and enables smooth navigation that integrates zoom and scroll operations by assigning the di...
AR Tabletop Interface using a Head-Mounted Projector
zhlédnutí 2KPřed 7 lety
We propose a tabletop interface in which a user wears a projector with a depth camera on his or her head and can perform touch operations on an image projected on a flat surface. By using the head-mounted projector, images are always projected in front of the user in the direction of the user’s gaze. By changing the image to be projected based on the user’s head movement, this interface realize...
On-mouse Projector: Extended Workspace using a Mouse with a Projector
zhlédnutí 678Před 8 lety
We propose On-mouse projector, an interface that combines a mouse and a mobile projector. This system satisfies both portability and large information space and enables stable operation. The mobile projector is placed on the mouse and projects images on a surface in front of the mouse. The projected image presents a part of large information space and users can change the area to see by moving ...
PZBoard: A Prediction-based Zooming Interface for Supporting Text Entry on a Mobile Device
zhlédnutí 230Před 8 lety
We propose Predictive Zooming Keyboard (PZBoard) which predicts a target position from the finger movement above the touch-screen of a mobile device and that enlarges a part of the keyboard around the predicted position. We use a hover function of the mobile device to obtain the finger position above the touch-screen. While a finger is detected, a part of the keyboard around the finger position...
A Pseudo-3D Interactive Projection System Using Motion Parallax
zhlédnutí 998Před 8 lety
A Pseudo-3D Interactive Projection System Using Motion Parallax
Real-time 3D Hand Pointing Recognition using Appearance Difference between Two Camera Images
zhlédnutí 576Před 8 lety
Real-time 3D Hand Pointing Recognition using Appearance Difference between Two Camera Images
3D Tabletop User Inteface using a High-speed Stereo Camera
zhlédnutí 943Před 8 lety
3D Tabletop User Inteface using a High-speed Stereo Camera
Natural 3D Interaction using a See through Mobile AR System
zhlédnutí 2,4KPřed 8 lety
Natural 3D Interaction using a See through Mobile AR System
A Tabletop Projector-camera System for Remote and Nearby Pointing Operation
zhlédnutí 970Před 9 lety
A Tabletop Projector-camera System for Remote and Nearby Pointing Operation
Three dimensional VR Interaction using the Motion of a Mobile Display
zhlédnutí 456Před 9 lety
Three dimensional VR Interaction using the Motion of a Mobile Display
Dynamic 3D Interaction System using an Optical See-through HMD
zhlédnutí 691Před 9 lety
Dynamic 3D Interaction System using an Optical See-through HMD
Multi-finger AR Typing Interface for Mobile Devices Using High-Speed Hand Motion Recognition
zhlédnutí 1,1KPřed 9 lety
Multi-finger AR Typing Interface for Mobile Devices Using High-Speed Hand Motion Recognition
3D Tabletop User Interface Using Virtual Elastic Objects
zhlédnutí 548Před 9 lety
3D Tabletop User Interface Using Virtual Elastic Objects
Three-Dimensional Hand Pointing Recognition using Two Cameras
zhlédnutí 312Před 9 lety
Three-Dimensional Hand Pointing Recognition using Two Cameras
See-through Mobile AR System for Natural 3D Interaction
zhlédnutí 1,1KPřed 10 lety
See-through Mobile AR System for Natural 3D Interaction
Multi-finger AR Typing Interface for Mobile Devices
zhlédnutí 1,7KPřed 10 lety
Multi-finger AR Typing Interface for Mobile Devices
AR Typing Interface for Mobile Devices
zhlédnutí 785Před 10 lety
AR Typing Interface for Mobile Devices
A Virtually Tangible 3D Interaction System using an Autostereoscopic Display
zhlédnutí 679Před 11 lety
A Virtually Tangible 3D Interaction System using an Autostereoscopic Display
A Zooming Interface for Accurate Text Input on Mobile Devices
zhlédnutí 313Před 11 lety
A Zooming Interface for Accurate Text Input on Mobile Devices
Very cool. This is kinda like the Manna system from en.wikipedia.org/wiki/Manna_(novel)
What game name
That looks very similar to my research project "HoverZoom Keyboard" (dm.tzi.de/hoverzoom-keyboard) that I presented at CHI 2014. Very interesting approach to use the movement speed of the finger to predict which letter the user intends to touch. How big of a problem is the latency in your case? In my measurements the average latency was about 250 ms and this unfortunately made the prototype not easy to use.
It doesn't look like this new keyboard is able to support the typing speed of the average teenager.
i need to know the name "model" of the camera urgently. please contact me, my mail is sika1995@live.com
www.kickstarter.com/projects/1942860935/seer-the-first-ar-helmet-that-makes-you-a-real-iro check this out guys, If you can implement something like this in an android input environment before I do... but anyway. I'd pay for this capability
This seems to be a good idea, but I think it'll take a lot of getting used to even if it becomes commercially available. Typing isn't just about sight; a lot of it is touch. People will definitely have a hard time typing on thin air, even if the keyboard is shown on the screen.