I am a second year M.Sc student at SKKU(Sungkyunkwan University), South Korea, advised by Prof. Sungeun Hong. My primary research interests center on advancing A.I through multimodal learning and efficient supervision. By integrating diverse data modalities—vision, language, audio, and touch—I aim to enable machines to develop a more comprehensive understanding of their environment. Recently, I am working on with tactile modality. Also, I am honored to collaborate with Prof. Sangmin Lee and Prof. Tae-Hyun Oh.
Research Interests
- Multi-modal Perception, Integrating vision, language, audio, and touch for comprehensive machine understanding
- Self-supervision, Leveraging unlabeled or weakly labeld data for efficient representation learning
- Human-robot Interaction, Enhancing communication and collaboration between humans and AI-driven robotic systems
🔥 News
- Feb. 2025 🎉🎉 Question-Aware Gaussian Experts for Audio-Visual Question Answering is accpeted at CVPR 2025!
📖 Educations
- Sep. 2023 - Aug. 2025 (expected): M.Sc Student, Dept. of Immersive Media Engineering, Sungkyunkwan University, Korea
- Mar. 2013 - Aug. 2019: B.E., Dept. of Mechanical Engineering, Korea & Maritime Ocean University, Korea
📝 Publications
Equal contribution are denoted by *, [C] for conference, [J] for journal.
-
[C02] Question-Aware Gaussian Experts for Audio-Visual Question Answering, CVPR 2025 (Accept. rate 22.12%)
Hongyeob Kim*, Inyoung Jung*, Dayoon Suh, Youjia Zhang, Sangmin Lee, Sungeun Hong
[Project page] | [arXiv] | [code] -
[C01] TextManiA: Enriching Visual Feature by Text-driven Manifold Augmentation, ICCV 2023 (Accept. rate 25.00%)
Moon Ye-Bin, Jisoo Kim, Hongyeob Kim, Kilho Son, Tae-Hyun Oh
[Project page] | [arXiv] | [paper] | [code]
💡 Projects
-
Audio-Visual Question Answering via Question-aware Encoder and Prompt Generation (Sep. 2024 - Aug. 2025)
- M.Sc. Students Fellowship by National Research Foundation of Korea (NRF)
🎖 Honors and Awards
- Aug. 2020, 2nd place, NAVER AIRUSH2020 (Abnormal Behavior Detection through Action Time-Series Analysis, $ 4800 prize)
- May. 2018, Academic Excellence & Need-Based Scholarship, SOAM Scholarship Foundation (approx. $3400)
- 2013-2019, Academic Excellence Scholarship, Korea Maritime & Ocean University (KMOU)