Masato
Ishii

Profile

Masato Ishii is a Senior Research Scientist at Sony Research Inc. He received his Ph.D. from the University of Tokyo under the supervision of Professor Masashi Sugiyama. From 2010 to 2019, he worked as a researcher at NEC. Between 2017 and 2019, he served as a visiting researcher at RIKEN AIP. In 2019, he joined Sony Group Corporation and has been seconded to Sony Research Inc. since 2023. His research interests span from the fundamentals of machine learning to its applications in computer vision, with a current focus mainly on audio-visual generation.

Publications

TITAN-Guide: Taming Inference-Time Alignment for Guided Text-to-Video Diffusion Models

ICCV, 2025
Christian Simon, Masato Ishii, Akio Hayakawa, Zhi Zhong*, Shusuke Takahashi*, Takashi Shibuya, Yuki Mitsufuji

In the recent development of conditional diffusion models still require heavy supervised fine-tuning for performing control on a category of tasks. Training-free conditioning via guidance with off-the-shelf models is a favorable alternative to avoid further fine-tuning on th…

A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Join…

IJCNN, 2025
Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji

In this work, we build a simple but strong baseline for sounding video generation. Given base diffusion models for audio and video, we integrate them with additional modules into a single model and train it to make the model jointly generate audio and video. To enhance align…

MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis

CVPR, 2025
Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander Schwing, Yuki Mitsufuji

We propose to synthesize high-quality and synchronized audio, given video and optional text conditions, using a novel multimodal joint training framework MMAudio. In contrast to single-modality training conditioned on (limited) video data only, MMAudio is jointly trained wit…

JOIN US

Shape the Future of AI with Sony AI

We want to hear from those of you who have a strong desire
to shape the future of AI.