1st Place Solution to the 8th HANDS Workshop Challenge -- ARCTIC Track: 3DGS-based Bimanual Category-agnostic Interaction Reconstruction
This report describes our 1st place solution to the 8th HANDS workshop challenge (ARCTIC track) in conjunction with ECCV 2024. In this challenge, we address the task of bimanual category-agnostic hand-object interaction reconstruction, which aims to generate 3D reconstructions of both hands and the object from a monocular video, without relying on predefined templates. This task is particularly challenging due to the significant occlusion and dynamic contact between the hands and the object during bimanual manipulation. We worked to resolve these issues by introducing a mask loss and a 3D contact loss, respectively. Moreover, we applied 3D Gaussian Splatting (3DGS) to this task. As a result, our method achieved a value of 38.69 in the main metric, CD, on the ARCTIC test set.
本报告描述了我们在ECCV 2024第八届HANDS研讨会挑战赛（ARCTIC赛道）中获得第一名的解决方案。在此次挑战赛中，我们应对了双手类无关手物交互重建任务，旨在从单目视频生成双手和物体的三维重建，而无需依赖预定义模板。由于双手操作过程中双手与物体的显著遮挡和动态接触，这一任务尤其具有挑战性。为了解决这些问题，我们分别引入了掩码损失和三维接触损失。此外，我们将三维高斯分布（3D Gaussian Splatting, 3DGS）应用于该任务。最终，我们的方法在ARCTIC测试集上的主要指标CDh中取得了38.69的成绩。