Semantic multimedia analysis for content-adaptive video streaming

Abstract

This paper provides a survey of recent approaches for semantic content analysis using multiple modalities, such as video, audio, and on- screen text. It also introduces new methods for shot (GoP) level rate allocation for content-adaptive multimedia streaming in order to achieve the best user utility given relevance-distortion policy and available average channel bandwidth of a user. Some examples are provided.