VISTouch

Abstract

We constructed a novel system that achieves new operational capability and increases user interest in mobile devices by enabling multiple devices to be used in combination dynamically and spatially. We call the system “VISTouch.” We focused on developing a mobile device feature that would enable users to easily move the position of a device connected with another device and keep track of it. We implemented a novel approach with intuitive handling in 3D virtual space. When a smartphone is spatially connected to a horizontally positioned tablet that is displaying a map as viewed from above, these devices dynamically obtain the correct relative position by using VISTouch. The smartphone displays images viewed from its position, direction, and angle in real time as a window that shows virtual 3D space. In addition to the old way of recognizing directions, which depends on virtual 3D images, we use real space information to improve a userʼs spatial perception by combining real space and virtual space. Thus, our VISTouch offers a novel way to interact with multiple devices by moving or inclining a smartphone on the tablet display and uses detailed information of the relative position in real space.

For Entertainment

In this game app, a tablet displays a 3D map as viewed from above, and a user can spatially look into 3D space with a smartphone, which displays images viewed from its position, direction, and angle. Also, more than two devices dynamically share the same 3D space. Another app can be used that combines Google Maps and Google Street View with VISTouch.

For Visualization

This application specializes in visualizing 3D information and aims to visualize medical information. An MRI/CT image group is converted to a point cloud, and a section is displayed on the device surface. This makes it possible to intuitively and easily observe the cross section and the solid.

For Art

This VISTouch Technology is used the art work. CUBISTA is the project to support the nurturing of media arts creators of Agency for Cultural Affairs in Japan. The author of this work is Dr. Masasuke Yasumoto.

VISTouch

VISTouch AIR

This application does not directly implement the VISTouch system but uses the concept. Positional tracking is performed on the tablet. It is possible to obtain a bird's-eye view of a solid object existing virtually in a single mobile terminal and display its cross section.

VISTouch Slicer

CUBISTA

Papers

1. Masasuke Yasumoto and Takehiro Teraoka. 2015. VISTouch: dynamic three-dimensional connection between multiple mobile devices. In Proceedings of the 6th Augmented Human International Conference (AH '15). ACM, New York, NY, USA, 89-92. DOI: http://dx.doi.org/10.1145/2735711.2735823

2. Masasuke Yasumoto and Takehiro Teraoka. 2015. VISTouch. In ACM SIGGRAPH 2015 Posters (SIGGRAPH '15). ACM, New York, NY, USA, , Article 41 , 1 pages. DOI=http://dx.doi.org/10.1145/2787626.2787636

3. 安本匡佑　寺岡丈博. 2015. VISTouch – 複数デバイスを用いた動的かつ立体的連携. インタラクション2015

4. Masasuke Yasumoto, Takehiro Teraoka. 2016. Game Applications of Dynamic and Spatial Connections between Multiple Mobile Devices. Replaying Japan 2016. Leipzig Germany.

Prize

1. 安本匡佑、寺岡丈博. 2014. 優秀賞. Mashup Awards 10. 東京　日本.

2. 安本匡佑、寺岡丈博. 2015. インタラクティブ発表賞（PC委員会推薦）. 情報処理学会　インタラクション2015. 東京 日本　

3. Masasuke Yasumoto, Takehiro Teraoka. 2015. Prize of INTERFACE & MULTIPURPOSE EQUIPMENT. Laval Virtual Awards 2015. Laval France

4. 安本匡佑、寺岡丈博. 2015. 優秀賞. アート＆テクノロジー東北　2015. 日本

5. Masasuke Yasumoto, Takehiro Teraoka. 2015. Prize of Microsoft. Open Park Day #1. Tokyo Japan.

6. Masasuke Yasumoto, Takehiro Teraoka. 2016. 19th Jury Selections. Japan Media Arts Festival. Tokyo Japan.

Product

We are a fabless research company. For that reason, we are taking a production system by licensing. we make it, we accept it by order of 1000 pieces. We are currently looking for commercialization including cloud funding. Please inquire in detail.

CeBIT 2017

We exhibited our booth at CeBIT2017 held from 20th to 24th March. Our three projects, VISTouch, Electric Bow System, and VAIR were […]

CeBIT 2017

We will exhibit at the Japan Pavilion of CeBIT 2017 to be held in Hanover, Germany from 20th to 24th March. We […]

VISTouch in the media

Our exhibition at Gadget JAPAN, Digital Content EXPO was introduced in the media. https://mizica.me/m/Jp4dMbLDozm https://mizica.me/m/4HXd5A6tV6A

See all our news