Teleimmersion

Summary. Teleimmersion project was focused on developing three-dimensional (3D) communication platform to facilitate interaction of geographically distributed users in a shared virtual environment. The platform consisted of 48 cameras to capture and reconstruct 3D models of users in real-time using stereo vision techniques. These digitized models were sent over the network and rendered in a shared virtual environment that allowed for interaction. During the course of this research, several application areas were studied, including digital dance and choreography (with UC Berkeley Dance Department and University of Illinois Urbana Champagne), learning of physical activities (with Stanford University), scientific and medical interaction (with University of California Davis), digital archeology (with University of California Merced and University of Tokyo), and tele-rehabilitation (with University of California at Davis Medical Center).

My Contributions. Research and engineering. Development of photometric and geometric calibration toolbox for multi-camera calibration. Overall system maintenance and development. Coordination of activities and experiments with external collaborators. Development of collaborative applications for remote interaction.

Gallery:

Teleimmersive Dance
Digital Archeology

Videos.



Selected Publications:

  • G. Kurillo, R. Bajcsy, “3D Teleimmersion for Collaboration and Interaction of Geographically Distributed Users”, Virtual Reality, vol. 17, no. 1, pp 29-43, 2013.
  • R. Vasudevan, G. Kurillo, E. Lobaton, T. Bernardin, O. Kreylos, R. Bajcsy, K. Nahrstedt, “High Quality Visualization for Geographically Distributed 3D Teleimmersive Applications,” IEEE Transactions on Multimedia, Vol. 13, No. 3, pp. 573 – 584, 2011.
  • M. Forte, G. Kurillo, “Cyberarchaeology – Experimenting with Teleimmersive Archaeology,” 16th International Conference on Virtual Systems and Multimedia (VSMM 2010), Oct 20-23, 2010, Seoul, South Korea.
  • Z. Yang, W. Wu, K. Nahrstedt, G. Kurillo and R. Bajcsy, “Enabling Multi-party 3D Tele-immersive Environments with ViewCast,” ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), vol. 6, no. 2, p. 1-30, 2010.
  • G. Kurillo, Z. Li, R. Bajcsy, “Wide-Area External Multi-Camera Calibration Using Vision Graphs and Virtual Calibration Object,” In Proceedings of 2nd ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC ’08), Stanford, CA, 2008
  • J.N. Bailenson, K. Patel, A. Nielsen, R. Bajcsy, S. Jung, G. Kurillo, “The Effect of Interactivity on Learning Physical Actions in Virtual Reality”. Media Psychology, vol. 11, pp. 354-376, 2008.