Papers
MVPrompt: Building Music-Visual Prompts for AI Artists to Craft Music Video Mise-en-scène
ChungHa Lee *, DaeHo Lee, and Jin-Hyuk Hong †
CHI 2025 (In Press)
Introducing MVPrompt, we explored how AI artists can create music videos with text-to-video generative AI, enhancing mise-en-scène specification through structured prompt refinement and collaborative creativity.
Guaranteeing Equitable Musical Collaboration: Lessons Learned from the Music-Making Activities in Mixed-Hearing Groups
ChungHa Lee *, Youjin Choi, Songmin Chung, Eunhye Cho and Jin-Hyuk Hong †
CSCW 2025 (In Press)
By observing musical collaboration in mixed-hearing groups, we examined how multimodal assistive tool foster engagement, role transition, and equitable contributions, proposing guidelines for inclusive music-making.
musicolors: Bridging Sound and Visuals For Synesthetic Creative Musical Experience
ChungHa Lee * and Jin-Hyuk Hong †
arXiv (2025)
Exploring everyday music visualization, we developed musicolors and conducted a user study with music composers, developers, and listeners. We found that they used musicolors to sketch ideas, integrate visuals, and experience synesthetic listening.
Enhancing collaborative signing songwriting experience of the d/Deaf individuals
Youjin Choi *, ChungHa Lee, Songmin Chung, Eunhye Cho, Suhyeon Yoo and Jin-Hyuk Hong †
International Journal of Human-Computer Studies (2025)
Introducing a multimodal synthesizer with visual and vibrotactile feedback, we found out the synthesizer enabled d/Deaf individuals to create music and enhance social connection.
Youjin Choi *, Junryeol Jeon *, ChungHa Lee, Yeo-Gyeong Noh and Jin-Hyuk Hong †
CHI 2024 (Conference on Human Factors in Computing Systems)
Creating a cross-modal music conceptualization system, we aimed to enhance the music appreciation experience for Deaf and Hard-of-hearings enabling them to explore and customize visuals and vibrations associated with music.
JooYeong Kim *, ChungHa Lee, JuYeon Kim and Jin-Hyuk Hong †
Universal Access in the Information Society (2023)
Adding simple interaction functionality enhanced information accessibility and engagement during the museum visit experience of Deaf and Hard-of-hearing.