3D Painting on Real Object : Presentation

(photomontage of expected result)

Introduction

Few research works are interesting to modify appearance of a real objects. However, it seem very attracting : computer graphics have give advantages for realized virtual representation of an object and rapid change of appearance/shape but it can't replace the advantages of a real mockup : easy manipulating/visualization (we can't turn around or turn the object), haptic/tactile rendering, good resolution of elements (not display limited), 3D perception. The combination of computer graphics possibility in the real environment can be use in a lot of differents domains.
In architecture designer generally realized real mockup of their final project. Designers dream to modify color of external wall on their mockup, change material of roof, changing environmental lighting for directly see effect on the building, etc.

Automobile industry usually work with no color mockup. The car designer, would modify the mockup in real time, adding some materials, change color, but also modify the mockup, by adding matter, directly on the real elements (even virtual prototyping have take important place now, a scale model is always use before the conception).
>
In art domain, artist generally realized small prototypes of their final sculpture. They want to modify texture of their mockup and for example after display in space a virtual representation of their mockup directly on the structure, for helping during the modeling (from [Ban02]).

for product prototype model, design and enginneer can directly visualize where to put label, design packaging, or have general final result, for e.g on bottle. Rapid Prototyping don't actually furnish a realistic model in the sense of material, color, and are more use for have a geometric representation of the object : have the possibility to display differents materials on the object can be an improvement of the work.

User generally want to digitalize some of their models (for movie/game), and hardware solution are generally to cost,and vision solution can't be use for all objects (concave/transparency/lighting conditions). The last solution is to manually realize the construction, but it's difficult due to lack of hand-eye coordination. Like propose by Lee (see bibliography part), construct interactively the object with a visual feedback, can increase the digitalization phase, and become easy for all users. User can after paint on their real objects, for see a first result for the designer : it give them a better sense of painting, haptic feedback, and all power of computer in real (and for important studio, the model can be digitalize in a final phase).

Augmented Reality can add new solutions for enhance the representation of real objects : user can visualize virtual elements (e.g texture modification) directly on the real environment, and in consequence on real objects. With the possibilty of augmented reality, user can interact and visualize a real object enhance with virtual informations (texture, lighting, material, sketching, geometric deformation ..etc..).