The Computing Innovation Fellows Project

Posted on: Monday, May 23rd, 2011
Broad Research Area: AI / Machine Learning / Robotics / Vision, Graphics / Visualization, Hardware / Architecture, HCI / CSCW, Mobile / Ubiquitous / Embedded Computing, Networks / Operating Systems, Numerical/Scientific Computing / HPC / Data-Intensive Scalable Computing, Scientific/Medical Informatics, Social Computing / Social Informatics

Research Interests:

HP Labs Immersive 3D

HP Labs is conducting research using large display walls, 2D and 3D. HP has multiple product and services offerings in the so-called “Big Walls” area ranging from digital signage to large telepresence facilities (such as HP’s Halo). Our research extends this by following two main, intertwined branches. The first examines a new style of 3D entertainment, and the other targets commercial and industrial uses for 3D enabled operations centers, brainstorm or war rooms, and control centers. We are conducting research in:
• Computer vision, image processing, and recognition,
• Robust multi-imager and multi-camera modeling and calibration,
• 3D data visualization,
• High performance computation, transport, and imaging on hardware accelerated platforms (CPUs and/or GPUs),
• Novel human-big wall interaction modalities across heterogenous systems, and
• Local and remote collaboration technologies.

We have publicly shown our Immersive 3D Entertainment efforts with events at the 2010 Sundance Film Festival and the Earth Wind and Fire Concert at 2011 CES in Las Vegas (links listed below). HP’s goal is to experiment with non-standard aspect ratios (e.g. 3:1 for concert stage, 5.5:1 for basketball court) to allow the audience to experience the event as though you are seated at the best seat in the house. This is a break from the traditional movie view from the director’s eyes and allows the audience to “look around” and soak up the scene which works so well in 3D. To do this, we are experimenting with large multi-projector 3D displays (Pluribus), multi-imager camera capture (Herodion), and advanced digital image pipelines (Pericles). We conduct in-situ laboratory studies at entertainment events such as concerts, sports events, fashion shows, and other gaming.

We have built an experimental operations center with multiple 2D and 3D walls and other services. Together with many HP customers, we are exploring novel ways to use Big Walls to address issues in areas such as disaster recovery, emergency response, hospital wards, city monitoring and management, mergers and acquisition planning, product planning, and supply chain management. We are creating a next generation capability by using Big Walls together with mobile devices, touch surfaces, 3D data visualization techniques, and techniques for displaying, manipulating and visualizing large amounts of unstructured data. In addition to our research, we participate in the real world by providing support for HP’s worldwide operations centers and the HP supported gallery at the Newseum due to open in 2012.

Links to entertainment reviews
HP 3D Live: CES Earth Wind and Fire concert

http://blogs.forbes.com/oliverchiang/2011/01/08/ces-hp-believes-in-3-d-too-but-on-a-larger-scale-much-larger/

http://www.monstercable.com/events/ces2011/3dexperience.asp

http://h20435.www2.hp.com/t5/The-Next-Bench-Blog/Earth-Wind-and-Fire-Going-Large-Live-and-in-3D-at-CES/ba-p/60745

http://www.hardwaregeeks.com/index.php/site/comments/hp_streams_concert_live_in_3d/

http://venturebeat.com/2011/01/14/hp-streams-earth-wind-fire-in-live-3d-on-a-huge-screen/

2010 Sundance Film Festival

http://philmckinney.com/archives/2010/01/sundance-and-3d.html

http://h20435.www2.hp.com/t5/The-Next-Bench-Blog/Stories-in-3D/ba-p/52743

HP Newseum announcements

http://www.hp.com/hpinfo/newsroom/press/2010/100930a.html

http://www.newseum.org/news/2010/09/hp-announcement.html

Contact Information:

Nelson.Chang@hp.com Phone: +1-650-857-5563 HP Labs Hewlett-Packard Company 1501 Page Mill Road MS 1203 Palo Alto, CA 94304