AI for Creators
Discovering new pathways for AI to enhance the creative pursuits of artists
and creators of all kinds, enabling rich experiences and
undiscovered avenues for creative human pursuits from visual arts,
speech, content analysis, sound and music.
Our Approach
Our research focuses on enhancing AI foundation models to empower creators and expand global access to diverse content. We prioritize developing real-time, controllable systems that improve efficiency in editing, restoration, translation and creation. Key areas of research include speech, language, music, sound and visual technologies, with emphasis on professional-grade precision and control.
Projects
Music and Sound
Translation and Dubbing
User Engagement Research
Latest Publications
Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for discriminating between re…
Vector quantization (VQ) is a technique to deterministically learn features with discrete codebook representations. It is commonly performed with a variational autoencoding model, VQ-VAE, which can be further extended to hierarchical structures for making high-fidelity recon…
Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for discriminating between re…
Latest Blog
Unlocking the Future of Video-to-Audio Synthesis: Inside the MMAudio Model
In a world increasingly driven by multimedia content, AI researchers have long struggled to generate high-quality, synchronized audio from video. Recently, audio generation models …
Revolutionizing Creativity with CTM and SAN: Sony AI's Groundbreaking Advances …
In the dynamic world of generative AI, the quest for more efficient, versatile, and high-quality models continues to push forward without any reduction in intensity. At the forefro…
JOIN US
Shape the Future of AI with Sony AI
We want to hear from those of you who have a strong desire
to shape the future of AI.
