Skip to content

AI for Creators

Our work explores new pathways for AI to enhance the creative pursuits of artists and creators of all kinds, enabling rich experiences and undiscovered avenues.

Empowering Creators with Enhanced AI

Expanding Global Access to Diverse Content

We prioritize developing real-time, controllable systems that improve efficiency in editing, restoration, translation, and creation. Key areas of research include speech, language, music, sound, and visual technologies, with emphasis on professional-grade precision and control.

A group of people enjoys dancing in a skate park bathed in warm sunlight

Deep Dive into Our Research

Explore how our researchers are analyzing AI tools for creativity, centered on human artistic expression and the ability of technology to empower the creative spirit.

Abstract image of wavy lines and dots in gradient colors of orange and purple, creating a sense of motion and depth against a dark background

Music and Sound

Our current research is focused on where AI can impact various media, including the controllability and real-time functionality of AI foundation models with efficiency and speed for editing, restoration, creation, and the fine-grain control needed by professional creators in music, sound, 2D and 3D.

speech-audio-waves

Translation and Dubbing

Using speech analysis, synthesis, and large language models, we assist labor-intensive tasks with high accuracy while seamlessly integrating cultural and linguistic nuances, enabling creators to connect with diverse audiences worldwide.

Four people collaborate at a table with laptops in a modern room

User Engagement Research

We aim to use the foundation model along with LLMs and flexible natural language interfaces to effortlessly provide insights to business users as well as content creators about their customers and content.

Industry Accolades & Awards

Neural Information Processing Systems logo Neural Information Processing Systems logo Neural Information Processing Systems logo Neural Information Processing Systems logo

Recent Publications

See how our researchers are pushing the limits and contributing to the latest scientific findings in advanced AI technology for creators of all kinds.

A person joyfully singing with headphones on, eyes closed, and hand near their mouth
Read Now

BigVSAN

Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network

A young man’s face is split, merging into pixelated squares on the right, blending with a waterfront sunset
Read Now

HQ-VAE

Hierarchical Discrete Representation Learning with Variational Bayes

audio-waves
Read Now

ICASSP Special Session

Enhancing Semantic Communication with Deep Generative Models

Latest Updates from Sony AI

Explore our latest resources to stay informed on our progress in advancing creative pursuits across visual realms, anime, dubbing and translation, music, and sound, and beyond.

Close-up of a large speaker cone with vibrant orange and black hues, set against a background of colorful lights
Read Now

Blog

Inside the MMAudio Model: Unlocking the Future of Video-to-Audio Synthesis

A woman with glasses and a pink jacket smiles while using a laptop on a dark sofa

Shape the Future of AI with Sony AI

View Open Roles