- 249
- 22 428 369
DisneyResearchHub
Registrace 11. 10. 2011
Disney Research is a network of research labs that collaborate closely with academic institutions We're able to combine the best of academia and industry: we work on a broad range of commercially important challenges, we view publication as a principal mechanism for quality control, we encourage engagement with the global research community, and our research has applications that are experienced by millions of people. We're honoring Walt Disney's legacy of innovation by researching novel technologies and deploying them on a global scale.
Soft Pneumatic Actuator Design using Differentiable Simulation
Soft Pneumatic Actuator Design using Differentiable Simulation
zhlédnutí: 14 139
Video
Interactive Design of Stylized Walking Gaits for Robotic Characters
zhlédnutí 12KPřed 12 hodinami
Procedural animation has seen widespread use in the design of expressive walking gaits for virtual characters. While similar tools could breathe life into robotic characters, existing techniques are largely unaware of the kinematic and dynamic constraints imposed by physical robots. In this paper, we propose a system for the artist-directed authoring of stylized bipedal walking gaits, tailored ...
The Impulse Particle-In-Cell Method
zhlédnutí 2,8KPřed 28 dny
An ongoing challenge in fluid animation is the faithful preservation of vortical details, which impacts the visual depiction of flows. We propose the Impulse Particle-In-Cell (IPIC) method, a novel extension of the popular Affine Particle-In-Cell (APIC) method that makes use of the impulse gauge formulation of the fluid equations. Our approach performs a coupled advection-stretching during part...
Fast Dynamic Facial Wrinkles
zhlédnutí 7KPřed měsícem
We present a new method to animate the dynamic motion of skin micro wrinkles under facial expression deformation. Since wrinkles are formed as a reservoir of skin for stretching, our model only deforms wrinkles that are perpendicular to the stress axis. Specifically, those wrinkles become wider and shallower when stretched, and deeper and narrower when compressed. In contrast to previous method...
Name Pronunciation Extraction and Reuse in Human-Agent Conversation
zhlédnutí 3KPřed 2 měsíci
Personalization in human-robot interaction (HRI) has been shown to have powerful effects on both users' perception of robots and objective interaction outcomes. Calling a human user by their name, an important signal to communicate understanding the user and memorizing information about them, remains an ongoing challenge in HRI research as typical text-to-speech algorithms struggle correctly pr...
Trajectory Augmentation for Robust Neural Locomotion Controllers
zhlédnutí 3,4KPřed 3 měsíci
In this work, we show that this is due to training on unbalanced biased datasets with poor representation for many important gaits and transitions. To solve this poor data problem, we introduce Trajectory Augmentation (TrajAug), a fully automatic data augmentation technique that generates synthetic motion data by using motion matching to stitch sequences from the original dataset to follow rand...
Optimal Design of Robotic Character Kinematics Video
zhlédnutí 7KPřed 5 měsíci
We propose a technique that simultaneously solves for optimal design and control parameters for a robotic character whose design is parameterized with configurable joints. At the technical core of our technique is an efficient solution strategy that uses dynamic programming to solve for optimal state, control, and design parameters, together with a strategy to remove redundant constraints that ...
Pose and Skeleton Aware Neural IK
zhlédnutí 4,5KPřed 5 měsíci
In this work introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose, and designed to flow information directly onto the skeletal graph structure, such that hard constraints can be enforced by blocking information flows at certain joints. As a result, we are able to satisfy both hard and soft constraints, as well as preserve un-manipulated parts of the bod...
An Implicit Physical Face Model Driven by Expression and Style
zhlédnutí 3KPřed 5 měsíci
We propose a new face model, based on a data-driven implicit neural physics model, that can be driven by both expression and style separately. At the core, we present a framework for learning implicit physics-based actuations for multiple subjects simultaneously, trained on a few arbitrary performance capture sequences from a small set of identities. Once trained, our method allows generalized ...
A Perceptual Shape Loss for Monocular 3D Face Reconstruction
zhlédnutí 3KPřed 7 měsíci
In this work we propose a new loss function for monocular face capture, inspired by how humans would perceive the quality of a 3D face reconstruction given a particular image. It is widely known that shading provides a strong indicator for 3D shape in the human visual system. As such, our new ‘perceptual’ shape loss aims to judge the quality of a 3D face estimate using only shading cues. Public...
Transformer-based Neural Augmentation of Robot Simulation Representations
zhlédnutí 13KPřed 7 měsíci
Simulation representations of robots have advanced in recent years. Yet, there remain significant sim-to-real gaps because of modeling assumptions and hard-to-model behaviors such as friction. We propose to augment common simulation representations with a transformer-inspired architecture, by training a network to predict the true state of robot building blocks given their simulation state. Bec...
ReNeRF:Relightable Neural Radiance Fields with Nearfield Lighting
zhlédnutí 9KPřed 7 měsíci
In this paper, we target the application scenario of capturing high-fidelity assets for neural relighting in controlled studio conditions, but without requiring a dense light stage. Instead, we leverage a small number of area lights commonly used in photogrammetry. We propose ReNeRF, a relightable radiance field model based on the intuitive and powerful approach of image-based relighting, which...
Kernel-Based Frame Interpolation for Spatio-Temporally Adaptive Rendering
zhlédnutí 6KPřed 10 měsíci
Recently, there has been exciting progress in frame interpolation for rendered content. In this setting, additional inputs, such as albedo and depth, can be extracted from a scene at a very low cost and, when integrated in a suitable fashion, can significantly improve the quality of the interpolated frames. Although existing approaches have been able to show good results, most high-quality inte...
DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots
zhlédnutí 14KPřed 10 měsíci
Legged robots are designed to perform highly dynamic motions. However, it remains challenging for users to retarget expressive motions onto these complex systems. In this paper, we present a Differentiable Optimal Control (DOC) framework that facilitates the transfer of rich motions from either animals or animations onto these robots. Interfacing with either motion capture or animation data, we...
GraphSimulationForSkinMicroWrinkles Video
zhlédnutí 6KPřed 10 měsíci
We present a novel graph-based simulation approach for generating micro wrinkle geometry on human skin, which can easily scale up to the micro-meter range and millions of wrinkles. The simulation first samples pores on the skin and treats them as nodes in a graph. These nodes are then connected and the resulting edges become candidate wrinkles. An iterative optimization inspired by pedestrian t...
Continuous Landmark Detection with 3D Queries
zhlédnutí 7KPřed 11 měsíci
Continuous Landmark Detection with 3D Queries
Video Compression with Entropy-Constrained Neural Representations
zhlédnutí 3,5KPřed 11 měsíci
Video Compression with Entropy-Constrained Neural Representations
Frame Interpolation Transformer and Uncertainty Guidance
zhlédnutí 4,2KPřed 11 měsíci
Frame Interpolation Transformer and Uncertainty Guidance
Physics-Informed Neural Corrector for Deformation-based Fluid
zhlédnutí 5KPřed rokem
Physics-Informed Neural Corrector for Deformation-based Fluid
Self-Supervised Effective Resolution Estimation with Adversarial Augmentations
zhlédnutí 4,2KPřed rokem
Self-Supervised Effective Resolution Estimation with Adversarial Augmentations
Efficient Neural Style Transfer For Volumetric Simulations
zhlédnutí 8KPřed rokem
Efficient Neural Style Transfer For Volumetric Simulations
Production Ready Face Re Aging for Visual Effects
zhlédnutí 246KPřed rokem
Production Ready Face Re Aging for Visual Effects
TempFormer: Temporally Consistent Transformer for Video Denoising
zhlédnutí 6KPřed rokem
TempFormer: Temporally Consistent Transformer for Video Denoising
Learning Dynamic 3D Geometry and Texture for Video Face Swapping
zhlédnutí 7KPřed rokem
Learning Dynamic 3D Geometry and Texture for Video Face Swapping
Facial Animation with Disentangled Identity and Motion using Transformers
zhlédnutí 7KPřed rokem
Facial Animation with Disentangled Identity and Motion using Transformers
MoRF: Morphable Radiance Fields for Multiview Neural Head Modeling
zhlédnutí 11KPřed rokem
MoRF: Morphable Radiance Fields for Multiview Neural Head Modeling
Facial Hair Tracking for High Fidelity Performance Capture
zhlédnutí 13KPřed rokem
Facial Hair Tracking for High Fidelity Performance Capture
Local Anatomically-Constrained Facial Performance Retargeting
zhlédnutí 4,9KPřed rokem
Local Anatomically-Constrained Facial Performance Retargeting
Implicit Neural Representation for Physics-driven Actuated Soft Bodies
zhlédnutí 4,5KPřed rokem
Implicit Neural Representation for Physics-driven Actuated Soft Bodies