图灵讲坛(第24期):Learning to Build a New Reality

发布时间:2018-11-14  阅读次数:172

 

活动时间:2018-11-21 10:30am
活动地点:济事楼 417

 

如何学习打造一个新的现实?
Learning to Build a New Reality

 

虞晶怡 教授
Prof. Yu Jingyi

 上海科技大学信息科学与技术学院教授、副院长

邀请人:贾金原 教授


Abstract:

There have been tremendous advances on applying deep learning techniques for 2d image understanding. In contrast, very little work has focused on employing deep learning for modeling datasets beyond 2D such as 3D geometry and 4D light fields. In this talk, I present several latest works from our group on in this exciting new arena, with a focus on their applications to virtual and augmented reality and computational photography. I first present a novel deep surface light field (DSLF) technique. A surface light field represents the radiance of rays originating from any points on the surface in any directions. Traditional approaches require ultra-dense sampling to ensure the rendering quality. Our DSLF works on sparse data and automatically filling in the missing data by leveraging different sampling patterns across the vertices and at the same time eliminates redundancies due to the network's prediction capability. For real data, we address the image registration problem as well as conduct texture-aware remeshing for aligning texture edges with vertices to avoid blurring. Next, I present an end-to-end deep learning scheme to establish dense shape correspondences and subsequently compress 3d dynamic human bodies. Our approach uses sparse set of “panoramic” depth maps or PDMs, each emulating an inward-viewing concentric mosaics (CM). We then develop a learning-based technique to learn pixel-wise feature descriptors on PDMs. The results are fed into an autoencoder-based network to achieve ultra-high compression ratio. 

 

Bio:
虞晶怡教授2000年获美国加州理工学院(Caltech)应用数学及计算机科学双学士学位,2005年获美国麻省理工学院(MIT)计算机与电子工程博士学位。自2005年起,先后任美国特拉华大学助理教授、副教授和正教授,现任上海科技大学信息科学与技术学院正教授、副院长。虞教授长期从事计算机视觉、计算成像、计算机图形学、生物信息学等领域的研究工作,已发表120多篇学术论文, 其中超60篇发表于国际会议CVPR/ICCV/ECCV和期刊TPAMI上。他的研究获得美国自然科学基金会、美国国立卫生研究院、美国陆军研究所以及美国空军科学研究所等机构资助。虞教授是美国国家科学基金杰出青年奖(NSF CAREER Award)获得者。他曾担任CVPR/ICCV/ECCV/ICCP/NIPS等多个人工智能国际顶级会议的程序主席、领域主席。现为三个国际顶级期刊IEEE TPAMI、IEEE TIP、Elsevier CVIU 的编委。虞教授将担任人工智能顶会 ICPR 2020和IEEE CVPR 2021的大会程序主席。

联系我们

地址:中国 上海曹安公路4800号同济大学软件学院

邮编:201804

联系电话:86-21-69589585,69589332(FAX)

 Copyright© 2017 同济大学软件学院

技术支持: 上海维程