3DGS 서비스화 이슈 by DoYeon Kim https://padlet.com/xoftdo/rymqr6bu1e8z8hb4 en-us 2024-05-18 07:59:10 UTC 2024-05-23 14:04:21 UTC hello@padlet.com Vanila 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998205481 Mip-NeRF360 / A6000

7K - 6분25초, 30K - 41분

]]> 2024-05-18 08:12:06 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998205481 Vanila 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998205969 Mip-NeRF360 / A6000

7K - 160FPS, 30K - 134FPS

]]> 2024-05-18 08:13:39 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998205969 Vanila 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998206435 Mip-NeRF360 / PSNR

7K - 25.6, 30K - 27.21

]]> 2024-05-18 08:15:28 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998206435 Vanila 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998206603 Mip-NeRF360

7K - 523MB, 30K - 734MB


3DGaussian 갯수 1M 기준 - 236MB

]]> 2024-05-18 08:16:08 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998206603 라이센스 이슈 xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998207358 Inria 프랑스 국립디지털과학기술연구소

]]> 2024-05-18 08:18:36 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998207358 Artifacts xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998207957 너무 많음

]]> 2024-05-18 08:20:43 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998207957 Test https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998208837 파일 20MB 제약 있습니다~ 큰 이미지 파일 업로드 자제해주세요!

]]> 2024-05-18 08:22:43 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998208837 GPS-Gaussian xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998211049 8대 카메라 위치 고정 / RTX3090

generalization 모델 학습 : 15시간

new scene 학습 : 25FPS

]]> 2024-05-18 08:29:11 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998211049 대부분 COLMAP사용 xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998212949 2024-05-18 08:35:10 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998212949 InstantSplat + COLMAP free 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998214305 Tanks and Temples / A100

이미지 갯수 12장 이하 제약됨

pose 추정과 함께 학습 : 37초


12장이하view : NopeNeRF(95분)-> COLMAP-free 3DGS(60초)

multiview : NopeNeRF(20시간) -> COLMAP-Free 3DGS(2시간)


]]> 2024-05-18 08:38:41 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998214305 InstantSplat xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998215433 COLMAP대신 DUSt3r 사용

sparse view가능 but 12장 이하 제약

]]> 2024-05-18 08:42:34 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/2998215433 SuGaR kkh23834022 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004221001 Surface Reconstruction

Nvidia A40 GPU 이용하여 2시간 보다 적게 소요.

]]> 2024-05-23 02:24:16 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004221001 GS2Mesh kkh23834022 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004221917 Surface Reconstruction

Nvidia A40 GPU 이용하여 1시간 보다 적게 소요.

]]> 2024-05-23 02:24:42 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004221917 SuGaR kkh23834022 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004224147 Surface Reconstruction Quality가 논문에 나온 것처럼 매끄럽지 않음.

Cherry picking을 많이 한 듯 함.

]]> 2024-05-23 02:25:51 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004224147 GS2Mesh kkh23834022 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004232206 아직 코드 미공개.

]]> 2024-05-23 02:29:58 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004232206 COLMAP-Free 3DGS xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004938108 첫번째 이미지의 Depth map으로 GS Init-> next 이미지에 대한 pose를 추정-> 3D GS growing (선호님 발표논문)

]]> 2024-05-23 11:58:31 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004938108 EAGLES trikang22 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004988926 Mip-NeRF360 / A6000

30K - 137FPS


Tanks & Temples / A6000

30K - 244FPS


Deep Blending

30K - 160FPS

]]> 2024-05-23 12:44:37 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004988926 EAGLES(직접 실험) trikang22 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004992195 Tanks & Temples / RTX 4090

30K - 236.75FPS


Blender / RTX 4090

30K - 1052FPS


LLFF / RTX 4090

30K - 428FPS

]]> 2024-05-23 12:47:29 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004992195 VastGaussian - 대규모 장면 학습 trikang22 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004998847

  • 사진 (좌) 분할 학습 후 병합 이전 사진 (우) 중복 영역 제거 후 병합 사진


  • 코드 비공개로 인해 직접 리프로듀싱한 결과임

  • OpenDroneMap 데이터 셋 기준, 8개의 구역으로 나누어 각각 학습 및 병합 진행

  • 최종 결과물의 파일 용량이 40GB에 육박함

  • 용량도 크지만, 해당 PLY 파일을 한 번에 읽어서 렌더링 하는 것도 어려워 보임

    • ]]>     2024-05-23 12:53:12 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3004998847     EAGLES trikang22 https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005001723 Mip-NeRF 360 / A6000

    19m 59s(3D-GS는 23m 14s)


    • COLMAP 시간을 고려하지 않음. 따라서 3D-GS의 학습 시간과의 대조를 위해 3D-GS의 학습 시간을 표기함

    ]]>     2024-05-23 12:55:38 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005001723     GS-SLAM / Gaussian Splatting SLAM https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005007308 아직 기존의 SLAM 방법들에 비해 정확도가 떨어짐


    ]]>     2024-05-23 13:00:07 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005007308     EAGLES xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005056691 기법 : quantization + progressive training(2배씩 키우는것) + densification(step간격 늘이기)

    Mip-NeRF360

    30K - 68MB (PSNR비슷)

    ]]>     2024-05-23 13:41:00 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005056691     Compact Gaussian https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005065031 기법

    • Residual Vector Quantization

    • hash grid를 통한 컬러 표현

    • 학습 후 추가적인 Qunatization + 허프만 인코딩


    734MB -> 48.8MB -> 29.1MB (포스트 프로세싱 적용 시)

    ]]>     2024-05-23 13:47:41 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005065031     RadSplat xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005073309 zip-nerf를 가우시안화

    zip-nerf만큼 PSNR이 높음

    ]]>     2024-05-23 13:54:24 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005073309     image->3d xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005081139 vertex수 너무 많음

    경계가 매끄럽지 못함

    ]]>     2024-05-23 14:00:41 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005081139     3DGS Segmentation xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005083278 원하는 object만 떼어내기

    원하는 object만 제거하기

    ]]>     2024-05-23 14:02:20 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005083278     3DGS fun요소 xoftdo https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005085740 물 붓기

    모양 변화시키기

    ]]>     2024-05-23 14:04:21 UTC https://padlet.com/xoftdo/rymqr6bu1e8z8hb4/wish/3005085740