3DPHONE Objectives

In order to reach the goal of building an end-to-end system for mobile 3D experience, the project will have the following scientific and technical objectives:

  • Develop a 3D mobile phone prototype that has 3D image capture and display capability, featuring a 3D display and multiple cameras. This prototype will be Linux-based; and as the common project platform, will provide all the software facilities needed to support the software libraries and applications developed in the project: 3D video prototypes, 3D UIs, direct manipulation interactions, PIM applications.
  • Carry out a detailed evaluation of formats and algorithms, and provide implementations for mobile 3D video solutions. In the first year of the project, we will set requirements for 3D video data representation formats for content creation, encoding/decoding, and rendering. Subsequently, the project, we will implement algorithms to meet the 3D video requirements, such as setting the bounds for capturing, sender side 3D signal processing, encoding, transmission, decoding, and rendering 3D video content.

    The evaluation will cover algorithms and work flows for content creation, coding, and rendering. Lower bounds for processing power, memory, bandwidth, etc. for future mobile 3D devices will be determined. Achievable quality and functionality will be reported, and recommendations will be given for the design of mobile 3D video applications such as 3DTV, downloadable 3D movies, 3D teleconferencing, 3D video and image capture.
  • Develop new mobile 3D user interface modalities that satisfy end-users requirements and meet usability metrics. In 3D user interfaces will consist of both 3D user input (such as direct manipulation) and 3D output (such as 3D UI rendering, perceptually-guided rendering) techniques. In the first year of the project, we will set usability targets, using metrics (as described below) for developing 3D enabled applications on mobile devices. After the development of the initial version of our tools, the project will evaluate the developed techniques, by using wellknown UI methodologies such as heuristic evaluation and usability testing.

    We will employ the following usability metrics to measure whether we have achieved this objective:
    • Learnability: are the interaction techniques easy to learn?
    • Effectiveness: is it effective to solve the target tasks?
    • Efficiency: once learned, is it fast to use?
    • Memorability: is it easy to remember what the users have learned?
    • Low error rate and safety to use: are errors few and recoverable?
    • Subjective User Satisfaction: is it enjoyable to use?
    • Customizability: is it possible to customise the tool to consider diverse cognitive and perceptual abilities of end users?
  • Evaluate the appropriateness of 3D technology, by performing ergonomics and experience testing in which we measure the possible negative symptoms, such as eye strain, created by the stereoscopic contents. These will be measured by standardized subjective questionnaires and objective physiological measurement devices. At the same time we will also measure positive experiences by using state of the art image quality measurement methodologies. We will evaluate the perceptual experiences created by the different use contexts and contents and will produce quantitative results which will rate the negative effects and positive experiences created by the stereoscopic contents in different situations.
  • Build 3DPHONE applications, by applying the learned knowledge in 3D user interfaces, mobile video, and ergonomics. We will assess the use of 3D user experience on mobile devices. The assessment will produce and compare three case studies addressing the market segments:
    • Entertainment (3D movies/3D TV)
    • 3D games adaptation to 3D Displays
    • 3D PIM (Personal Information Management) applications
    • 3D teleconferencing
    • 3D visualization and 3D navigation
    • 3D sketching / input – includes 3D input techniques for key applications (such as creating and organizing notes in 3D).