3DPhone Blog

This report describes the interim progress on the studies within the scope of 3D User Interfaces and Direct Manipulation Solutions. The report is organized as separate chapters, each of which includes the related state of the art, the project, and the progress made so far.

The report starts with the direct manipulation techniques. In sections 1 and 2 several camera-based and sensor-based direct manipulation solutions are described. Section 3 describes how to define gestures using the input devices and the meanings of these gestures. In sections 4 and 5, 3D UI and rendering related solutions are presented.

Download document

TAT has joined to 3DPhone project. They are responsible for Applications.

TAT is a Swedish software technology and design company offering products and services that differentiate and enhance the user experience of portable devices. TAT is headquartered in Malmö, Sweden, and has local offices in Korea and USA.

TATwas founded on a passion for developing digital visual experiences through the combination of aesthetics and technology. This passion emerged from years of experimenting with computer graphics on restrained platforms. The six founders successfully competed as a team on the Nordic demo scene in the 90s, where the challenge was to create beautiful and advanced visual experiences in limited time on a limited hardware platform.

TAT has added the WOW effect to mobile user interfaces for more than 250 million devices worldwide. TAT works with 4 of the 6 leading OEMs in the mobile device space today. Publicly announced clients include SonyEricsson, Motorola, S60, Samsung, Vodafone and Orange. TAT has an extensive network of partners covering the whole value chain in the mobile device market. This ensures that our products are fully compliant towards market-leading operating systems, technology standards and hardware and software platforms. Texas Instruments, Freescale, Teleca, Macnica Networks, Montavista, Nvidia and Symbian are among TAT’s partners.

Duration: 8 June 09 - 2 July 09

Participants: Holografika, TID, Bilkent

In this sprint, rendering engine is updated. New widget classification is done. UML of the UI Library is redesigned and updated.

Demo: 3 July 09

Duration: 15 May 09 - 4 June 09

Participants: Holografika, TID, Bilkent

This sprint is after the project’s review. Thus, it is a test/review/check sprint. Moreover, the touch sensor is integrated to the event system and ported to OMAP Zoom.

Demo: 5 June 09

http://the3dphone.eu./images/s2.1.png

Duration: 17 March 09 - 27 March 09

Participants: Holografika, TID, Bilkent, HHI

This sprint is before the project’s review. Thus, it is an integration and minor changes sprint. The addressbook application is completed and all applications are ported to OMAP Zoom. In addition to this, we have some sensor based applications running on UMPC, Touch application and Stereo Proccessin applications.

Demo: 30 March 09

http://the3dphone.eu./images/s6.png

Duration: 12 Feb 09 - 16 March 09

Participants: Holografika, TID, Bilkent

In this sprint, some applications such as gallery, 3D addressbook, StereoVideoPlaybackApp are implemented and Rendering team implemented some material properties and texture mapping to SceneGraph. For input side, team stated some basic gestures such as left, right,up and down with sensor and they made a demo that showed the interaction on UMPC.

Demo: 16-18 March 09

Present document has been prepared in fulfillment of Deliverable 3.1.1, required as an intermediate result of Work Package 3 of the EU Seventh Framework Program ALL 3D IMAGING PHONE Project. Specification of 3D display HW module means the description of the 3D display related hardware, low level software, mechanical and optical components which will be developed and integrated in the project.

Download Document

Capin, T.; Pulli, K.; Akenine-Moller,” The State of the Art in Mobile Graphics Research“, T. Computer Graphics and Applications, IEEE Volume 28, Issue 4, July-Aug. 2008 Page(s):74 - 84 Digital Object Identifier 10.1109/MCG.2008.83

Abstract: High-quality computer graphics let mobile-device users access more compelling content. Still, the devices’ limitations and requirements differ substantially from those of a PC. This survey of mobile graphics research describes current solutions in terms of specialized hardware (including 3D displays), rendering and transmission, visualization, and user interfaces.

T. Balogh, P. T. Kovács, Z. Megyesi, A. Barsi. “HoloVizio - True 3D Display System“. 2008 NEM Summit, Saint Malo, France, October 2008.

Abstract: This paper presents HoloVizio true 3D display technology, and its real life implementations, the HoloVizio display models from Holografika. Our patented technology uses a specially arranged array of optical modules and a holographic screen. Each point of the holographic screen emits light beams of different color and intensity to various directions. The light beams generated in the optical modules hit the screen points in various angles and the holographic screen makes the necessary optical transformation to compose these beams into a perfectly continuous 3D view. With proper software control, light beams leaving the pixels propagate in multiple directions, as if they were emitted from the points of 3D objects at fixed spatial locations. We describe the 10 Mpixel desktop display and the 50Mpixel large-scale system. We cover the real-time control issues at high pixel-count systems with the HoloVizio software environment, give solutions for displaying various kinds of content, including 3D scenes from existing computer applications, 3D CAD models and natural content. We also describe concrete 3D applications developed in the frame of European projects.

K. Müller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, “View Synthesis for Advanced 3D Video Systems”, EURASIP Journal on Image and Video Processing, 2009.

Abstract: The paper is about 3D video applications and systems based on multiview autostereoscopic displays. These are expected to play an important role in home user environments, since they support multi-user 3D sensation and motion parallax impression. The tremendous data rate cannot be handled efficiently by representation and coding formats such as MVC or MPEG-C Part 3. Multiview video plus depth is a new format that efficiently supports such advanced 3DV systems, but this requires high quality intermediate view synthesis. For this, a new approach is presented that separates unreliable image regions along depth discontinuities from reliable image regions, which are treated separately and fused to the final interpolated view. In contrast to previous layered approaches, our algorithm uses two boundary layers and one reliable layer, performs image-based 3D warping only and was generically implemented, i.e. doesn’t necessarily rely on 3D graphics support. Furthermore, different hole-filling and filtering methods are added to provide high-quality intermediate views. As a result, high quality intermediate views for an existing 9-view auto-stereoscopic display as well as other stereo- and multiscopic displays are presented, which prove the suitability of our approach for advanced 3DV systems.