Skip to content

Commit

Permalink
update overview
Browse files Browse the repository at this point in the history
  • Loading branch information
Zzlongjuanfeng committed Dec 23, 2023
1 parent c21ec98 commit f4cb7ae
Show file tree
Hide file tree
Showing 2 changed files with 36 additions and 1 deletion.
37 changes: 36 additions & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -141,7 +141,20 @@ <h1 class="title is-1 publication-title">Paint3D: Paint Anything 3D with Lightin
type="video/mp4">
</video>
<h2 class="subtitle has-text-centered">
Paint3D is capable of producing high-resolution, lighting-less, and diverse 2K UV texture maps for untextured 3D meshes conditioned on text or image inputs.
We present Paint3D, a novel coarse-to-fine generative framework that is capable of producing
high-resolution, lighting-less, and diverse 2K UV texture maps for untextured 3D meshes
conditioned on text or image inputs. The key challenge addressed is generating high-quality
textures without embedded illumination information, which allows the textures to be
re-lighted or re-edited within modern graphics pipelines. To achieve this, our method first
leverages a pre-trained depth-aware 2D diffusion model to generate view-conditional images
and perform multi-view texture fusion, producing an initial coarse texture map. However, as
2D models cannot fully represent 3D shapes and disable lighting effects, the coarse texture
map exhibits incomplete areas and illumination artifacts. To resolve this, we train separate
UV Inpainting and UVHD diffusion models specialized for the shape-aware refinement of
incomplete areas and the removal of illumination artifacts. Through this coarse-to-fine
process, Paint3D can produce high-quality 2K UV textures that maintain semantic consistency
while being lighting-less, significantly advancing the state-of-the-art in texturing 3D
objects.
</h2>
</div>

Expand All @@ -151,6 +164,28 @@ <h2 class="subtitle has-text-centered">
</div>
</section>

<section class="section">
<div class="container is-max-desktop">

<!-- Overview. -->
<div class="columns is-centered has-text-centered">
<div class="column is-full-width">
<h2 class="title is-3">Method Overview</h2>
<img src="./static/imgs/overview.jpg"/>
<div class="content has-text-justified">
<p>
The overview of our coarse-to-fine framework. The coarse stage samples multi-view images
from the pre-trained 2D image diffusion models, then back-projects these images onto the
mesh surface to create initial texture maps. The refinement stage generates high-quality
textures with a diffusion model in UV space, conditioned on the position map and the coarse
texture map.
</p>
</div>
</div>
</div>
</div>
</section>

<section class="section">
<div class="container is-max-desktop">
<div class="container">
Expand Down
Binary file removed static/imgs/overview.png
Binary file not shown.

0 comments on commit f4cb7ae

Please sign in to comment.