HMS Publications

Final Report to NSF of the Standards for Facial Animation Workshop

Catherine Pelachaud
Norman I. Badler
Marie-Luce Viaud

October 1994

University of Pennsylvania
School of Engineering and Applied Science
Computer and Information Science Department
Philadelphia, PA 19104-6389

• Acknowledgment
• Contents
• Motivation
  • Introduction
  • Modeling
  • Animation Control
  • Workshop Themes
    • Significance
  • Workshop Format
• Mosaic
• Organization of the Report
• Modeling
  • Modeling: Definition and Application
    • Definition
    • Applications
      • Education
      • Entertainment
      • Medicine
      • Narration
      • Telecommunication
      • Criminology
      • Psychology
      • Forensic Medicine and Anthropology
      • Advertising
  • Properties and attributes of faces
    • Physical structures
    • Primary Facial Features
      • Nose
      • Eyebrows
      • Eyes
      • Ears
      • Mouth
      • Teeth
      • Tongue and Vocal Tract
      • Cheeks
      • Chin
      • Neck
      • Hair
      • Accessories
    • Secondary Details
      • Nerves and Vessels
      • Physical Trauma and Surgery
      • Vascular Expression
      • Tears and Sweats
      • Illness and Fatigue
      • Gender and Race
      • Growth and Aging
  • Technologies and Representations
    • Inheritance and Hierarchy for Facial Models
      • The importance of genericity in facial animation.
      • High level tools and genericity.
    • Representation Techniques
      • Polygons
      • Splines
      • Implicit surfaces
      • Physics-based models
    • Rendering
      • Image library
      • Image warping and morphing
      • Shadowing techniques
      • Texturing/shading models (multi-spectral)
  • Hooks to data
    • 3D Input
    • 2D Input
    • Expression libraries
    • Speech/Sound
    • Rendering/Material Properties
    • Real-Time Performance Data
      • Vision
      • 3D trackers
      • MIDI controllers
  • Hooks to Control
  • Validation
• Recognition/Data Mapping
  • Facial Feature Acquisition And Processing Techniques
    • Introduction
    • Instrumentation for Facial Animation Data
    • Imaging Techniques
    • Rangefinding and Position Sensing
    • Medical Imaging Technology
    • Direct Contact Sensing
  • General Facial Data Processing Techniques
    • Geometric feature-based matching
    • 3D features and principal component analysis
    • Deformable templates
    • Detection by Generalized Symmetry
    • Frame Differencing
    • Features vs. Templates
    • Predictive Estimation
    • Optical Flow
    • Feature extraction
    • Facial Markers
    • Structured Light
    • Active contour model
    • Conclusions
  • Visual Speech Feature Processing
• Control
  • Introduction and Overview
  • Basic Techniques
    • Shape Interpolation
    • Key-Node Parameterization
    • Muscle-Based
    • Physically Based
  • Framework for Control
  • Control Architecture Examples
    • A Muscle Model
    • Physically Based
    • Semantic (Speech/Linguistics) Driven
    • Text-To-Visual/Auditory Speech
    • Lip Contour Parameterization
    • Mix And Match
    • Vision/Performance Driven
  • Temporal Control Issues
    • Timing of Facial Action
    • Facial Expressions, Speech and Emotion
    • Dialogue Situation
  • Validation
    • Measurement Based Validation
    • Facial Measurement Techniques
    • Validation Corpora
    • Comparing Measurements
    • Perception Based Validation
    • Perceptual Paradigms
• Summary
  • Facial features
  • Motivation
  • Final Remarks
• Goals Acheived and Recommendations
• List of Participants
• References
• About this document ...