Machine Learning

Sound Rendering pipeline diagram


  • Developd material recognition system based on spatial mapping and scene understanding.

Material Tagging System

  • The system applies to real-time platforms by inferring from framebuffers and projecting materials into a live virtual environment.

Segmentation Network


  • Developed an alternative system that works directly on texture data by leveraging texture superpixels.

Material Classifier

  • The system trains on virtual environments reconstructed from real space.

Environment Reconstruction

  • These methods allow automatic material recognition for acoustic rendering tasks.

Environment Reconstruction with Materials