TPEPlatform/MediaEncoderFramework

Architecture

Dependency among modules

• GetUserMedia
  • Recoderging Pipeline
    • Audio Encoding - Wav/ Opus/ Vorbis/ AAC/ HEAAC
    • Video Encoding - VP8/ VP9/ H.264/ HEVC
    • Container multiplexer - MP4/ OGG/ WebM
  • ImageCapture
    • Image Encoding - JPG?

Class Diagram

The class diagram of encoder framework

Sequential Diagram

The sequence diagram of receiving input source from MediaStreamGraph, and outputting final container data from MediaEncoder to MediaRecorder

Reference

• GetUserMedia Spec
• MediaStream Recording Spec
• Image Capture Spec
• HTML media capture (only supports simple capture functionalities), associated bug bug 741393