Ce diaporama a bien été signalé.
Le téléchargement de votre SlideShare est en cours. ×



Consultez-les par la suite

1 sur 38 Publicité

Plus De Contenu Connexe

Diaporamas pour vous (18)

Les utilisateurs ont également aimé (20)


Similaire à Teleimmersion (20)

Plus récents (20)



  1. 1. Internet-Wide Multi-Party Tele-Immersion Framework for Remote 3D Collaboration RINU MARKS.P REG NO.73023 [email_address]
  2. 2. <ul><li>Tele-Immersion is a new technology that enables a user to share a virtual space with remote participants. </li></ul>WHAT IS TELE-IMMERSION ???
  3. 3. Existing System <ul><li>Video conferencing. </li></ul><ul><li>Fails to keep eye to eye contact. </li></ul><ul><li>User interaction is limitted. </li></ul><ul><li>When no. of persons conferencing increases it will be hard to concentrate on person who is actually talking. </li></ul>
  4. 4. site 3 site 1 site 2 BASIC CONCEPT
  5. 5. <ul><li>Not merely the 3D reproduction of the human body. </li></ul><ul><li>It also allows us to interact with virtual objects in the shared virtual environment </li></ul>
  6. 6. Interaction with virtual objects
  7. 7. <ul><li>Tele-immersion reconstructs the objects in the real world in real-time, and mixes the real objects with the virtual environment </li></ul>
  8. 8. Remote Controller Function(wii)
  9. 9. <ul><li>Various operations on 3d virtual objects such as “move”, “rotate”, “select”, “change texture”, “expand”, “shrink”, “highlight” </li></ul><ul><li>Helps in eye to eye communication in multi party enironment. </li></ul>
  10. 10. <ul><li>ARRANGEMENTS </li></ul>
  11. 11. ARRANGEMENTS <ul><li>B&W cameras are for stereo construction. </li></ul><ul><li>The color camera is for extracting the appearance </li></ul>
  14. 14. 3D image construction
  15. 15. Stages in 3D conversion <ul><li>Acquisition stage </li></ul><ul><li>Reconstruction stage </li></ul>
  16. 16. Acquisition stage <ul><li>capture a variable amount of camera feeds . </li></ul><ul><li>image-based calculations and color silhouette extraction. </li></ul><ul><li>Image compression. </li></ul>
  17. 17. Sterio based reconstruction stage
  18. 18. Sterio based reconstruction <ul><li>1. Calculate initial matching cost </li></ul><ul><li>and are the color intensities in the left and right images </li></ul><ul><li>d is the disparity hypothesis. </li></ul><ul><li>denotes pixel in the left image and denotes pixel in the right image </li></ul>
  19. 19. <ul><li>2. Construct a square window of predefined size with p as centre. </li></ul><ul><li>3. For each pixel q in window calculate adaptive support weight. </li></ul><ul><li>and denotes the color and euclidean distance between p and q. </li></ul><ul><li>are constants. </li></ul>
  20. 20. <ul><li>4. Calculate aggregated cost of each support window. </li></ul><ul><li>5. By using optimization technique we calculate depth of discontinuous areas and reconstruct the body. </li></ul>
  21. 21. The user whole body is extracted by taking the difference between the current video frame and the registered background image. BACK GROUND SUBTRACTION
  22. 22. Real time compression <ul><li>Reconstructed 3d model is very large in size. </li></ul><ul><li>Real-time compression is essential for real-time delivery. </li></ul><ul><li>Modified jpeg compression. </li></ul>
  23. 23. JPEG COMPRESSION Each block is defined as M[x,y] ( i -1) * d <= x < i * d , 0 <= i < w ( j -1) * d <= y < j * d , 0 <= j < h d is the size w width and h height.
  24. 24. For each M[i , j] <ul><li>If all M[x, y] == 0 , then M '[i, j] = N . </li></ul><ul><li>If all M[x, y] == 1, then M '[i, j] = A . </li></ul><ul><li>If exists any M[x, y] == 0 and any M[x, y] == 1 , then M '[i, j] = B </li></ul>
  25. 25. Multi-Party Tele-Immersion using internet
  26. 26. Server side <ul><li>The TI server provides a virtual environment and room model to divide the users into groups. </li></ul><ul><li>The system information such as user login/logout and their manipulations are written in database. </li></ul><ul><li>The portal provides user login and real-time status display through web browsers with the help of database </li></ul>
  27. 27. Communication model
  28. 28. Hardware Requirements <ul><li>4-core Intel Xeon W3530 processor </li></ul><ul><li>6GB DDR3 RAM </li></ul><ul><li>2*500GB 7200rpm SATA Hard disk </li></ul><ul><li>NVIDIA Geforce GTX 470 display card </li></ul>
  29. 29. Time delays
  30. 30. Time cost of 3D reconstruction & encoding
  31. 31. Time cost of decoding & rendering
  32. 32. Remote interaction delay on 3D objects
  33. 33. Bandwidth requirement
  34. 34. Applications <ul><ul><li>Remote medical diagnosis and therapy. </li></ul></ul><ul><ul><li>Remote and distributed education. </li></ul></ul><ul><ul><li>Distributed artistic performance and interaction. </li></ul></ul><ul><ul><li>Virtual travel and tourism. </li></ul></ul><ul><ul><li>Automobile Engineering </li></ul></ul>
  35. 35. Challenges <ul><li>Quality of transmission affected by high packet loss </li></ul><ul><li>Very Expensive </li></ul><ul><li>High bandwidth requirement. </li></ul><ul><li>High speed internet is required (min of 60 MBPS) </li></ul>
  36. 36. CONCLUSION <ul><li>Still in its early stages of development. </li></ul><ul><li>Challenges are need to be met. </li></ul><ul><li>3d reconstruction technology needs to be improved since the reproduced images are jittering. </li></ul><ul><li>Tele immersion technology can surely lead to great developments in the field of communication. </li></ul>
  37. 37. References <ul><li>Proposal of Multimodal Communications System Using Tele-Immersion Technology ; IEEE Conference </li></ul><ul><li>Tele-Immersion Environment for Video Avatar Based CVE ; IEEE Conference </li></ul><ul><li>Distance Learning in Tele-Immersion Environment; IEEE Conference </li></ul><ul><li>http://tele-immersion.citris-uc.org </li></ul><ul><li>http://graphics.cs.brown.edu/research/telei </li></ul>
  38. 38. <ul><li>THANK YOU </li></ul>