DisneyResearchHub
DisneyResearchHub
  • Видео 257
  • Просмотров 22 579 872
Learning a Generalized Physical Face Model From Data Video
Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic anatomy edits. Today’s methods are data-driven, where the actuations for finite elements are inferred from captured skin geometry. Unfortunately, these approaches have not been widely adopted due to the complexity of initializing the material space and learning the deformation model for each character separately, which often requires a skilled artist followed by lengthy network training. In this work, we aim to make physics-based facial animation more acces...
Просмотров: 3 542

Видео

Controllable Neural Style Transfer for Dynamic Meshes Video
Просмотров 10 тыс.21 день назад
In recent years, animation movies are shifting from realistic representations to more stylized depictions that support unique de- sign languages. To favor that, recent works implemented a Neural Style Transfer (NST) pipeline that supports the stylization of 3D assets by 2D images. In this paper we propose a novel mesh stylization technique that improves previous NST works in several ways. First...
Design and Control of a Bipedal Robotic Character
Просмотров 67 тыс.Месяц назад
Legged robots have achieved impressive feats in dynamic locomotion in challenging unstructured terrain. However, in entertainment applications, the design and control of these robots face additional challenges in appealing to human audiences. This work aims to unify expressive, artist-directed motions and robust dynamic mobility for legged robots. To this end, we introduce a new bipedal robot, ...
Infinite 3D Landmarks: Improving Continuous 2D FacialLandmark Detection
Просмотров 3,9 тыс.2 месяца назад
Abstract In this paper, we examine 3 important issues in the practical use of state-of-the-art facial landmark detectors and show how a combination of specific architectural modifications can directly improve their accuracy and temporal stability. First, many facial landmark detectors require a face normalization step as a preprocess, often accomplished by a separately-trained neural network th...
Stylize My Wrinkles: Bridging the Gap from Simulation to Reality
Просмотров 1,8 тыс.2 месяца назад
Modeling realistic human skin with pores and wrinkles down to the milli- and micrometer resolution is a challenging task. Prior work showed that such micro geometry can be efficiently generated through simulation methods, or in specialized cases via 3D scanning of real skin. Simulation methods allow to highly customize the wrinkles on the face, but can lead to a synthetic look. Scanning methods...
QUADify: Extracting Meshes with Pixel-level Details and Materials from Images
Просмотров 3,4 тыс.2 месяца назад
Despite exciting progress in automatic 3D reconstruction from images, excessive and irregular triangular faces in the resulting meshes still constitute a significant challenge when it comes to adoption in practical artist work- flows. Therefore, we propose a method to extract regular quad-dominant meshes from posed images. More specifically, we generate a high-quality 3D model through de- compo...
Artist-Friendly Relightable and Animatable Neural Heads
Просмотров 3,7 тыс.2 месяца назад
An increasingly common approach for creating photorealistic digital avatars is through the use of volumetric neural fields. The original neural radiance field (NeRF) allowed for impressive novel view synthesis of static heads when trained on a set of multi-view images, and follow up methods showed that these neural representations can be extended to dynamic avatars. Recently, new variants also ...
Anatomically Constrained Implicit Face Models
Просмотров 1,6 тыс.2 месяца назад
Coordinate based implicit neural representations have gained rapid popularity in recent years as they have been successfully used in image, geometry and scene modeling tasks. In this work, we present a novel use case for such implicit representations in the context of learning anatomically constrained face models. Actor specific anatomically constrained face models are the state of the art in b...
Soft Pneumatic Actuator Design using Differentiable Simulation
Просмотров 18 тыс.2 месяца назад
We propose a computational design pipeline for pneumatically-actuated soft robots interacting with their environment through contact. We optimize the shape of the robot with a shape optimization approach, using a physically-accurate high-order finite element model for the forward simulation. Our approach enables fine-grained control over both deformation and contact forces by optimizing the sha...
Interactive Design of Stylized Walking Gaits for Robotic Characters
Просмотров 15 тыс.2 месяца назад
Procedural animation has seen widespread use in the design of expressive walking gaits for virtual characters. While similar tools could breathe life into robotic characters, existing techniques are largely unaware of the kinematic and dynamic constraints imposed by physical robots. In this paper, we propose a system for the artist-directed authoring of stylized bipedal walking gaits, tailored ...
The Impulse Particle-In-Cell Method
Просмотров 3,3 тыс.3 месяца назад
An ongoing challenge in fluid animation is the faithful preservation of vortical details, which impacts the visual depiction of flows. We propose the Impulse Particle-In-Cell (IPIC) method, a novel extension of the popular Affine Particle-In-Cell (APIC) method that makes use of the impulse gauge formulation of the fluid equations. Our approach performs a coupled advection-stretching during part...
Fast Dynamic Facial Wrinkles
Просмотров 7 тыс.3 месяца назад
We present a new method to animate the dynamic motion of skin micro wrinkles under facial expression deformation. Since wrinkles are formed as a reservoir of skin for stretching, our model only deforms wrinkles that are perpendicular to the stress axis. Specifically, those wrinkles become wider and shallower when stretched, and deeper and narrower when compressed. In contrast to previous method...
Name Pronunciation Extraction and Reuse in Human-Agent Conversation
Просмотров 3,3 тыс.5 месяцев назад
Personalization in human-robot interaction (HRI) has been shown to have powerful effects on both users' perception of robots and objective interaction outcomes. Calling a human user by their name, an important signal to communicate understanding the user and memorizing information about them, remains an ongoing challenge in HRI research as typical text-to-speech algorithms struggle correctly pr...
Trajectory Augmentation for Robust Neural Locomotion Controllers
Просмотров 3,6 тыс.5 месяцев назад
In this work, we show that this is due to training on unbalanced biased datasets with poor representation for many important gaits and transitions. To solve this poor data problem, we introduce Trajectory Augmentation (TrajAug), a fully automatic data augmentation technique that generates synthetic motion data by using motion matching to stitch sequences from the original dataset to follow rand...
Optimal Design of Robotic Character Kinematics Video
Просмотров 8 тыс.8 месяцев назад
We propose a technique that simultaneously solves for optimal design and control parameters for a robotic character whose design is parameterized with configurable joints. At the technical core of our technique is an efficient solution strategy that uses dynamic programming to solve for optimal state, control, and design parameters, together with a strategy to remove redundant constraints that ...
Pose and Skeleton Aware Neural IK
Просмотров 4,8 тыс.8 месяцев назад
Pose and Skeleton Aware Neural IK
An Implicit Physical Face Model Driven by Expression and Style
Просмотров 3,2 тыс.8 месяцев назад
An Implicit Physical Face Model Driven by Expression and Style
A Perceptual Shape Loss for Monocular 3D Face Reconstruction
Просмотров 3,3 тыс.10 месяцев назад
A Perceptual Shape Loss for Monocular 3D Face Reconstruction
Transformer-based Neural Augmentation of Robot Simulation Representations
Просмотров 13 тыс.10 месяцев назад
Transformer-based Neural Augmentation of Robot Simulation Representations
ReNeRF:Relightable Neural Radiance Fields with Nearfield Lighting
Просмотров 9 тыс.10 месяцев назад
ReNeRF:Relightable Neural Radiance Fields with Nearfield Lighting
Kernel-Based Frame Interpolation for Spatio-Temporally Adaptive Rendering
Просмотров 6 тыс.Год назад
Kernel-Based Frame Interpolation for Spatio-Temporally Adaptive Rendering
DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots
Просмотров 15 тыс.Год назад
DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots
GraphSimulationForSkinMicroWrinkles Video
Просмотров 6 тыс.Год назад
GraphSimulationForSkinMicroWrinkles Video
Continuous Landmark Detection with 3D Queries
Просмотров 7 тыс.Год назад
Continuous Landmark Detection with 3D Queries
Video Compression with Entropy-Constrained Neural Representations
Просмотров 3,5 тыс.Год назад
Video Compression with Entropy-Constrained Neural Representations
Kernel Aware Resampler
Просмотров 2,5 тыс.Год назад
Kernel Aware Resampler
Frame Interpolation Transformer and Uncertainty Guidance
Просмотров 4,2 тыс.Год назад
Frame Interpolation Transformer and Uncertainty Guidance
Physics-Informed Neural Corrector for Deformation-based Fluid
Просмотров 5 тыс.Год назад
Physics-Informed Neural Corrector for Deformation-based Fluid
Self-Supervised Effective Resolution Estimation with Adversarial Augmentations
Просмотров 4,3 тыс.Год назад
Self-Supervised Effective Resolution Estimation with Adversarial Augmentations
Efficient Neural Style Transfer For Volumetric Simulations
Просмотров 9 тыс.Год назад
Efficient Neural Style Transfer For Volumetric Simulations