ML p(r)ior | Novel Views of Objects from a Single Image

Novel Views of Objects from a Single Image

2016-01-31
Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not easily revertible. As a consequence, possibilities of changing viewpoint are limited. Given a single image depicting an object, novel-view synthesis is the task of generating new images that render the object from a different viewpoint than the one given. The main difficulty is to synthesize the parts that are disoccluded; disocclusion occurs when parts of an object are hidden by the object itself under a specific viewpoint. In this work, we show how to improve novel-view synthesis by making use of the correlations observed in 3D models and applying them to new image instances. We propose a technique to use the structural information extracted from a 3D model that matches the image object in terms of viewpoint and shape. For the latter part, we propose an efficient 2D-to-3D alignment method that associates precisely the image appearance with the 3D model geometry with minimal user interaction. Our technique is able to simulate plausible viewpoint changes for a variety of object classes within seconds. Additionally, we show that our synthesized images can be used as additional training data that improves the performance of standard object detectors.
PDF

Highlights - Most important sentences from the article

Login to like/save this paper, take notes and configure your recommendations

Related Articles

2018-08-11

In view-based 3D shape recognition, extracting discriminative visual representation of 3D shapes fro… show more
PDF

Highlights - Most important sentences from the article

2018-08-03

Understanding and extracting 3D information of objects from monocular 2D images is a fundamental pro… show more
PDF

Highlights - Most important sentences from the article

2016-12-02
1612.00603 | cs.CV

Generation of 3D data by deep neural network has been attracting increasing attention in the researc… show more
PDF

Highlights - Most important sentences from the article

2018-04-03

Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of tra… show more
PDF

Highlights - Most important sentences from the article

2018-04-12

We study 3D shape modeling from a single image and make contributions to it in three aspects. First,… show more
PDF

Highlights - Most important sentences from the article

2017-08-26

In this paper, we propose a novel 3D-RecGAN approach, which reconstructs the complete 3D structure o… show more
PDF

Highlights - Most important sentences from the article

2018-09-26

Existing online 3D shape repositories contain thousands of 3D models but lack photorealistic appeara… show more
PDF

Highlights - Most important sentences from the article

2018-12-06

Spherical convolutional networks have been introduced recently as tools to learn powerful feature re… show more
PDF

Highlights - Most important sentences from the article

2016-04-02

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructi… show more
PDF

Highlights - Most important sentences from the article

2019-05-02

We present a practical and robust deep learning solution for capturing and rendering novel views of … show more
PDF

Highlights - Most important sentences from the article

2014-11-21

We train generative 'up-convolutional' neural networks which are able to generate images of objects … show more
PDF

Highlights - Most important sentences from the article

2017-05-11

We present the first image-based generative model of people in clothing for the full body. We sidest… show more
PDF

Highlights - Most important sentences from the article

2019-04-14
1904.06699 | cs.CV

In this paper, we present a new perspective towards image-based shape generation. Most existing deep… show more
PDF

Highlights - Most important sentences from the article

2015-05-21

Object viewpoint estimation from 2D images is an essential task in computer vision. However, two iss… show more
PDF

Highlights - Most important sentences from the article

2018-03-23
1803.08709 | cs.CV

Person re-identification (re-id) is the task of recognizing and matching persons at different locati… show more
PDF

Highlights - Most important sentences from the article