* External authors




MyStyle++: A Controllable Personalized Generative Prior

Libing Zeng*

Lele Chen

Yi Xu*

Nima Kalantari*

* External authors

SIGGRAPH Asia 2023



In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face generator on a few images of an individual. This system allows synthesizing, editing, and enhancing images of the target individual with high fidelity to their facial features. However, it relies on the latent space of StyleGAN, and thus inherits its limitations in controllability. We propose to address this problem through a novel optimization system that organizes the latent space in addition to tuning the generator. Our key contribution is to formulate a loss that arrange the latent codes, corresponding to the input images, along a set of specific directions according to their attribute. We demonstrate that our approach, dubbed MyStyle++, is able to synthesize, edit, and enhance images of an individual with great control over the attributes, while preserving the unique facial characteristics of that individual.

Related Publications

NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions

ICCV, 2023
Zhang Chen*, Zhong Li*, Liangchen Song*, Lele Chen, Jingyi Yu*, Yi Xu*

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear kernels for interpolating features at con…

Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecasting

ICCV, 2023
Wentao Bao*, Lele Chen, Libing Zeng*, Zhong Li*, Yi Xu*, Junsong Yuan*, Yu Kong*

Hand trajectory forecasting from egocentric views is crucial for enabling a prompt understanding of human intentions when interacting with AR/VR systems. However, existing methods handle this problem in a 2D image space which is inadequate for 3D real-world applications. In …


Shape the Future of AI with Sony AI

We want to hear from those of you who have a strong desire
to shape the future of AI.