Gyeongsik Moon

avatar

From 29th, April, I start a new adventure as an assistant professor of DGIST EECS. For motivated students, please reach out to me if you’re interested in joining our group.

Email: mks0601@gmail.com
Lab website
Google Scholar
CV
Github

Research Interests

Designing artificial intelligence to perceive, model, and represent human-centric 3D worlds through state-of-the-art computer vision, computer graphics, and machine learning techniques.

Publications (Selected)

Authentic Hand Avatar from a Phone Scan via Universal Hand Model
Gyeongsik Moon, Weipeng Xu, Rohan Joshi, Chenglei Wu, Takaaki Shiratori
CVPR 2024
[CODE] [ARXIV] [PDF]




URHand: Universal Relightable Hands
Zhaoxi Chen, Gyeongsik Moon, Kaiwen Guo, Chen Cao, Stanislav Pidhorskyi, Tomas Simon, Rohan Joshi, Yuan Dong, Yichen Xu, Bernardo Pires, He Wen, Lucas Evans, Bo Peng, Julia Buffalini, Autumn Trimble, Kevyn McPhail, Melissa Schoeller, Shoou-I Yu, Javier Romero, Michael Zollhöfer, Yaser Sheikh, Ziwei Liu, Shunsuke Saito
CVPR 2024 (Oral presentation (top 0.78%))
[PROJECT] [ARXIV]




Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformer
Hyeongjin Nam*, Daniel Sungho Jung*, Gyeongsik Moon, Kyoung Mu Lee (* equal contribution)
CVPR 2024
[ARXIV] [CODE]




A Dataset of Relighted 3D Interacting Hands
Gyeongsik Moon, Shunsuke Saito, Weipeng Xu, Rohan Joshi, Julia Buffalini, Harley Bellan, Nicholas Rosen, Jesse Richardson, Mallorie Mize, Philippe de Bree, Tomas Simon, Bo Peng, Shubham Garg, Kevyn McPhail, Takaaki Shiratori
NeurIPS 2023 (Datasets and Benchmarks Track)
[DATASET] [CODE] [ARXIV] [PDF] [VIDEO]





Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wild
Gyeongsik Moon
CVPR 2023
[ARXIV] [PDF] [VIDEO] [CODE]





Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfolding
Yeonguk Oh*, JoonKyu Park*, Jaeha Kim*, Gyeongsik Moon, Kyoung Mu Lee (* equal contribution)
CVPR 2023
[ARXIV] [PDF] [CODE/DATASET]





Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation
Hongsuk Choi*, Hyeongjin Nam*, Taeryung Lee, Gyeongsik Moon, Kyoung Mu Lee (* equal contribution)
ICLR 2023
[ARXIV] [PDF]




MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labels
Taeryung Lee*, Gyeongsik Moon* , Kyoung Mu Lee (* equal contribution)
AAAI 2023 (Oral presentation)
[ARXIV] [PDF] [CODE]





MonoNHR: Monocular Neural Human Renderer
Hongsuk Choi*, Gyeongsik Moon* , Vincent Leroy, Matthieu Armando, Kyoung Mu Lee, Gregory Rogez (* equal contribution)
3DV 2022
[ARXIV] [PDF]




3D Clothed Human Reconstruction in the Wild
Gyeongsik Moon* , Hyeongjin Nam*, Takaaki Shiratori, Kyoung Mu Lee (* equal contribution)
ECCV 2022
[ARXIV] [PDF] [CODE]




HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network
JoonKyu Park*, Yeonguk Oh*, Gyeongsik Moon* , Hongsuk Choi, Kyoung Mu Lee (* equal contribution)
CVPR 2022
[ARXIV] [PDF] [CODE]




Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenes
Hongsuk Choi, Gyeongsik Moon, JoonKyu Park, Kyoung Mu Lee
CVPR 2022
[ARXIV] [PDF] [CODE]




Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation
Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee
CVPRW 2022
[ARXIV] [PDF] [VIDEO] [CODE]




NeuralAnnot: Neural Annotator for 3D Human Mesh Training Sets
Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee
CVPRW 2022
[ARXIV] [PDF] [PROJECT]




Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Video
Hongsuk Choi, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
CVPR 2021
[ARXIV] [PDF] [CODE] [VIDEO]




IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in Videos
Gyeongsik Moon* , Heeseung Kwon*, Kyoung Mu Lee, Minsu Cho (* equal contribution)
CVPRW 2021
[ARXIV] [PDF] [CODE]




DeepHandMesh: A Weakly-Supervised Deep Encoder-Decoder Framework for High-Fidelity Hand Mesh Modeling
Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee
ECCV 2020 (Oral presentation (top 2%))
[DATASET] [ARXIV] [PDF] [CODE] [VIDEO]




InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image
Gyeongsik Moon, Shoou-i Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee
ECCV 2020
[DATASET] [ARXIV] [PDF] [CODE] [VIDEO]




I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image
Gyeongsik Moon, Kyoung Mu Lee
ECCV 2020
Winners and 2nd place of the 3D human pose estimation in the wild (3DPW) challenge (workshop in conjunction with ECCV 2020)
[ARXIV] [PDF] [CODE] [VIDEO]




Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose
Hongsuk Choi*, Gyeongsik Moon* , Kyoung Mu Lee (* equal contribution)
ECCV 2020
[ARXIV] [PDF] [CODE] [VIDEO]




Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image
Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
ICCV 2019
[ARXIV] [PDF] [CODE (ROOTNET)] [CODE (POSENET)]




PoseFix: Model-agnostic General Human Pose Refinement Network
Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
CVPR 2019
[ARXIV] [PDF] [CODE]




V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map
Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
CVPR 2018
Winners of the HANDS 2017 3D hand pose estimation challenge (workshop in conjunction with ICCV 2017)
[ARXIV] [PDF] [CODE]




Depth-based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Shanxin Yuan, Guillermo Garcia-Hernando, Björn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim
CVPR 2018
[ARXIV] [PDF]




Experiences

Honors

Service