Bringing Telepresence to Every Desk

April 03, 2023 · Entered Twilight · 🏛 arXiv.org

"No code URL or promise found in abstract"
"Derived repo from GitHub Pages (backfill)"

Evidence collected by the PWNC Scanner

Repo contents: .DS_Store, .idea, Bringing_Telepresence_to_Every_Desk__Arxiv_.pdf, MPC_construction.png, README.md, comparisons.mov, comparisons.mp4, index.html, main_video.mp4, overview.png, spatial_skip.png, static, sweep_comparison.png, table.png, teaser.png, test1.mp4, test2.mp4, test5.mp4, test7.mp4, test9.mp4

Authors Shengze Wang, Ziheng Wang, Ryan Schmelzle, Liujie Zheng, YoungJoong Kwon, Soumyadip Sengupta, Henry Fuchs arXiv ID 2304.01197 Category cs.CV: Computer Vision Cross-listed cs.GR Citations 1 Venue arXiv.org Repository https://github.com/mcmvmc/PersonalTelepresence ⭐ 1 Last Checked 3 months ago

Abstract

In this paper, we work to bring telepresence to every desktop. Unlike commercial systems, personal 3D video conferencing systems must render high-quality videos while remaining financially and computationally viable for the average consumer. To this end, we introduce a capturing and rendering system that only requires 4 consumer-grade RGBD cameras and synthesizes high-quality free-viewpoint videos of users as well as their environments. Experimental results show that our system renders high-quality free-viewpoint videos without using object templates or heavy pre-processing. While not real-time, our system is fast and does not require per-video optimizations. Moreover, our system is robust to complex hand gestures and clothing, and it can generalize to new users. This work provides a strong basis for further optimization, and it will help bring telepresence to every desk in the near future. The code and dataset will be made available on our website https://mcmvmc.github.io/PersonalTelepresence/.