MPEG 138

MPEG 138 took place as an online conference from 2022-04-25 until 2022-04-29 .

Press Release

MPEG Systems receives two Emmy® Awards

In its 73rd annual ceremony on April 26, 2022, the National Academy of Television Arts & Sciences (NATAS) awarded ISO/IEC MPEG Systems Working Group (WG 3) with two Technology & Engineering Emmy® Awards for its MPEG-DASH and Open Font Format standards.

Since 1948, the Technology & Engineering Emmy® Awards honor development and innovation in TV-related technology and recognize companies, organizations, and individuals for breakthroughs in this field.

This year, MPEG Systems received a Technology & Engineering Emmy® for its work on “Standardization of HTTP Encapsulated Protocols”. 3GPP, which partnered with MPEG on the collaborative development of the MPEG-DASH standard, was also recognized with an Emmy.

MPEG Systems started the project on HTTP streaming in 2009. MPEG published the first edition of the Dynamic Adaptive Streaming over HTTP (DASH) standard (ISO/IEC 23009) in 2012, followed by three more editions since then. The 5th edition of the MPEG-DASH standard is expected to be published in 2022.

The MPEG-DASH standard defines a delivery format for streaming multimedia content with the highest quality possible over networks with variable bandwidth using CDNs. Its features support many services and applications such as on-demand video, live streaming, low latency streaming, and targeted ad insertion. MPEG-DASH is the first true open international standard for video streaming over the internet that enabled multi-vendor interoperable solutions and has been widely adopted by industry and various consortia.

The standard was developed with the strong participation of experts from around the world. More than 90 experts from over 60 companies participated in the development of the state-of-art technology defined by the standard for more than a decade. The following experts, in particular, are recognized by MPEG for contributing to the development of the standards in various ways: Ali C. Begen, Romain Bouqueau, Imed Bouzazi, Zachary Cava, Mary-Luc Champel, Cyril Concolato, Igor Curcio, Franck Denoual, Mike Dolan, Wang Fang Gerard Fernando, Per Fröjdh, Alexander Giladi, Jeff Goldberg, Miska Hannuksela, Mitsuhiro Hirabayashi, Paul Higgs, Ingo Hoffmann, Kilroy Hughes, Will Law, Jin Young Lee, Jean Le Feuvre, Brendan Long, Sylvain Kervadec, Yongliang Liu, Brenden Long, Shivakumar Mahadevappa, Frederic Maze, Nhut Nguyen, Harry Pile (late), Yuriy Reznik, Sungryeul Rhyu, Yago Sanchez, Thomas Schierl, Iraj Sodagar, Thomas Stockhammer, Kevin Streeter, Yasser Syed, Viswanathan (Vishy) Swaminathan, Emmanuel Thomas, Christian Timmerer, Ye Xiaoyang, Xin Wang, Ye-Kui Wang, Mark Watson, Yang Yanzi, Shaobo Zhang, Zhijie Zhao and Waqar Zia. Many companies and institutions participated by providing experts and resources for the development of the DASH standard, including Adobe, Akamai, Bitmovin, Brightcove, Bytedance, CableLabs, Canon, Cisco, Comcast, Ericsson, ETRI, Fraunhofer, Google, Huawei, Hulu, InterDigital Communications, LG Electronics, KPN, Microsoft, Netflix, Orange, Nokia, Ozyegin University, Panasonic, Qualcomm, Samsung, Sony, Telecom Paris, Tencent America, Xiaomi, University of Hannover, University of Klagenfurt, Vubiquity, and ZTE Corporation.

The chair of the MPEG-DASH subgroup, Iraj Sodagar said, “The success of the DASH standard shows that when the industry as a whole participates in a standardization project under a reputable SDO such as ISO/IEC JTC 1, the resulting standard can make a direct impact on the entire industry by enabling interoperability between different parts of the ecosystem.”

The second Technology & Engineering Emmy® Award presented to MPEG Systems this year is for the development of the ISO/IEC 14496-22 “Open Font Format”, with its 4th edition published in 2019 and work currently underway toward 5th edition. The Emmy was presented for “Standardization of Font Technology for Custom Downloadable Fonts and Typography for Web and TV Devices”.

Font technology standardization work as part of the MPEG-4 family of standards was initiated in 2004 with the publication of the ISO/IEC 14496-18 “Font compression and streaming”. This work continued with the development of the new part 22 (ISO/IEC 14496-22), “Open Font Format”, which was based on the contribution of OpenType technology by Microsoft and Adobe in 2004. Since then, the standard has been revised and extended many times, with the participation of a wide community of experts who offer combined expertise in typography, linguistics, font design, and computer science. Experts contributing to this work include representatives of a number of large companies, including Adobe, Apple, Google, Microsoft, Monotype, and many individual contributors and subject matter experts including John Hudson, Laurence Penney, and Adam Twardoch (among many others) who made valuable contributions. Vladimir Levantovsky (Type Standards LLC) has served as a chair of the Font subgroup and the Project Editor for both standards.

“Fonts are the critical components of any written communication. Text carries a meaning, but it’s a font that makes text readable – fonts give the written word a voice! Standardization of the Open Font Format technology by ISO/IEC JTC 1’s MPEG Systems Working Group (SC 29/WG 3) significantly influenced the capabilities of all classes of consumer electronic devices bringing advanced font technology for digital TV, streaming media environments, and the Web. It also inspired many open-source projects that enabled mass adoption of high-quality font rendering and advanced text support, making it easy and cost-effective for OEMs, service providers, and content authors to deploy new features and applications supporting all world languages and writing systems,” the chair of the Fonts subgroup, Vladimir Levantovsky, said.

Winners Emmy Awards - OFF
The experts of WG3 won an Emmy Award for the standardization of font technology for custom downloadable fonts and typography for web and TV devices
Emmy Awards DASH
MPEG won an Emmy Award for the standardization of HTTP encapsulated protocols

MPEG selects Technology for MPEG-I Video-based Dynamic Mesh Compression

MPEG had previously issued a Call for Proposals (CfP) for dynamic mesh compression technology in October 2021. At the 138th MPEG meeting, MPEG Coding of 3D Graphics (WG 7) reviewed submissions to this CfP and selected technology for the subsequent standardization process. Five submissions covering full codecs were evaluated based on (i) objective measurements for geometry and attributes and (ii) subjective visualization tests conducted at two test sites.

The technology selected in the CfP already enables the efficient representation of realistic dynamic objects (including humans), and the MPEG 3D Graphics Coding will conduct additional experiments to further improve this basis technology and to produce a standard specification document and test model for the full codec (encoder and decoder). The final standard will make it possible to include realistic 3D dynamic objects in games and VR or AR experiences, transmit them between virtual worlds, and create immersive experiences for artistic performances and sports events.

It is expected that the standard will progress to the first formal stage of its approval process with a Committee Draft (CD) in April 2023, followed by a Draft International Standard (DIS) in January 2024 and completed International Standard (IS) by October 2024.

MPEG selects Technologies for Encoder and Packager Synchronization and Asset Storage

At the previous 137th MPEG meeting of January 2022, MPEG Technical Requirements (WG 2) had issued a Call for Proposals (CfP) on technologies for encoder and packager synchronization and asset storage. At the 138th meeting, MPEG concluded the evaluation of the responses to the CfP. The CfP responses fulfilled and supplemented the CfP requirements, with one proposal dealing with encoder/packager synchronization and a second proposal dealing with asset storage and recording. The combination of the responses already covers 85 percent of the expressed synchronization requirements and 75 percent of the storage requirements. Furthermore, the proposals are well aligned with existing MPEG specifications, in particular MPEG-DASH and CMAF. As a result, MPEG produced a draft text of a Working Draft at this meeting for the upcoming specification. The final standard is expected to be completed at the beginning of 2023.

This standard will greatly assist the industry in achieving effective interoperability for the production and storage of 24×7 live content. It meets specific requirements for 24×7 live media production and distribution in cloud-based workflows, such as the use of object-based cloud storage. The proposal addresses the use cases of redundant encoder synchronization for failover handling, distributed encoding of (multi-codec) bit-rate ladders, and A/B watermarking. As the proposals are based on MPEG-DASH and CMAF, this standard also introduces best practices for using these MPEG technologies for the key use cases targeted by broadcasters and content owners.

The MPEG Technical Requirements WG thanks the proponents who submitted responses to the CfP. MPEG will continue to collect and solicit feedback to improve the solution in the upcoming meetings.

MPEG completes CMAF support of EVC and VVC

As a part of efforts to integrate recently developed video coding standards into storage and delivery standards, at the 138th MPEG meeting, MPEG Systems (WG 3) completed the standardization process for carriage of Versatile Video Coding (VVC) and Essential Video Coding (EVC) by the Common Media Application Format (CMAF).

The third edition of ISO/IEC 23000-19 Common media application format (CMAF) for segmented media has reached the final milestone of standard development, Final Draft International Standard (FDIS) with support for these new video coding technologies. The specification defines CMAF track and media profiles for VVC and EVC. For both video codecs, constraints on elementary streams for use in CMAF and constraints on permitted values of some fields of parameter sets are specified. Additionally, restrictions on the usage of Supplemental Enhancement Information (SEI) and Video Usability Information (VUI) are also specified. The method to indicate the conformance point of the video codecs, such as profile, level, toolset indication, etc., are also defined by this specification. Concerning VVC, the specification supports the carriage of both single- and multilayer bitstreams.

As CMAF has already been adopted by other Standards Development Organizations (SDOs) and many of them have been anticipating the integration of new video codecs into CMAF with various application requirements and constraints, and the development process has been conducted with active collaboration with them. Through liaison communications and public GitHub discussions, many valuable inputs have been received, carefully studied, and reflected as much as possible.

MPEG issues Call for Proposal for Video Coding for Machines

At the 138th MPEG meeting, MPEG Technical Requirements (WG 2) issued a Call for Proposals (CfP) for technologies and solutions enabling efficient video coding for machine vision tasks.

This work on “Video Coding for Machines” aims at compressing input videos and images or feature maps for machine tasks. As machines consume and understand visual data differently to human vision, coding technologies and solutions could be different from conventional ones, even for coding videos and images, in order to achieve optimized performance for machine usage. With the rise of machine learning technologies and machine vision applications, the amount of video and images consumed by machines has been rapidly growing. Typical use cases include intelligent transportation, smart city, intelligent content management, etc., which incorporate machine vision tasks such as object detection, instance segmentation, and object tracking. Due to the large volume of video data, it is essential to compress video for efficient transmission and storage. Besides the highly demanded compression benefit, VCM can also be helpful in some other regards, such as computational offloading and privacy protection.

Over the last three years, MPEG has investigated potential technologies for efficient compression of visual data for machine vision tasks and established an evaluation mechanism that includes common test conditions (CTC), rate-distortion based metrics, and evaluation pipelines. In addition to existing image datasets, some new datasets, and video datasets in particular, have been built and donated to MPEG which are valuable for future research and standardization.

This CfP welcomes submissions of proposals from companies and other organizations. Registration is required by 06 July 2022; the submission of bitstream files, results, and decoders are required by 30 September 2022; and the submission of proponent documentation is due by 12 October 2022. Evaluation of the submissions in response to the CfP will be performed at the 140th MPEG meeting in October 2022.

Companies and organizations that have developed VCM technologies are kindly invited to bring such information in response to this CfP by contacting Dr. Igor Curcio, MPEG Technical Requirements Convenor at igor.curcio@nokia.com.

MPEG White Paper on MPEG Smart Contracts for Media

At the 138th MPEG meeting, MPEG Liaison and Communication (AG 03) approved a white paper on MPEG Smart Contracts for Media.

In the last few years, MPEG has developed a set of standardized RDF ontologies and XML schemas for the codification of intellectual property (IP) rights information related to music and media. ISO/IEC 21000-19 Media Value Chain Ontology (MVCO) facilitates rights tracking for fair, timely, and transparent transactions by capturing user roles and their permissible actions on a particular IP entity. ISO/IEC 21000-19/AMD1 Audio Value Chain Ontology (AVCO) extends MVCO functionality related to the description of IP entities in the audio domain, e.g., multitrack audio and time segments. ISO/IEC 21000-21 (2nd Ed) Media Contract Ontology (MCO) facilitates the conversion of narrative contracts to digital ones related to the exploitation of IP rights, payments, and notifications. With respect to the latter, XML schemas have been developed as ISO/IEC 21000-20 (2nd Ed) Contract Expression Language (CEL).

Furthermore, the axioms in these XML schemas and RDF ontologies can drive the execution of rights-related workflows in controlled environments, e.g., Distributed Ledger Technologies (DLTs), where transparency and interoperability are favoured toward fair trade of music and media. Thus, the aim of ISO/IEC 21000-23 Smart Contracts for Media is to provide the means (e.g., application programming interfaces) for converting these XML and RDF media contracts to smart contracts that can be executed on existing DLT environments. By performing this conversion in a standard way for several smart contract languages, MPEG-21 CEL/MCO schemas and ontologies will prevail as the interlingua for transferring verified contractual data from one DLT to another.

Another important feature of this standard is that it offers the possibility to bind the clauses of a smart contract with those of a narrative contract and vice versa. In this way, each party signing a smart contract knows exactly what the clauses stored in the smart contract express.

Standard documents published in MPEG 138

MPEG-I

#PartTitle
2Omnidirectional Media FormatTechnologies under Consideration for OMAF
3Versatile Video CodingText of ISO/IEC 23090-3:202x (2nd Ed.) CDAM 1 New level and systems-related supplemental enhancement information
5Visual Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression (V-PCC)V-PCC Test Model v18
6Immersive Media MetricsTechnologies under Consideration for ISO/IEC 23090-6
7Immersive Media MetadataWD of ISO/IEC 23090-7 AMD 1 Common metadata for immersive media
7Immersive Media MetadataTechnologies under Consideration for Immersive media metadata
8Network based Media ProcessingTechnologies under Consideration for NBMP
8Network based Media ProcessingNBMP reference software and conformance framework
9Geometry-based Point Cloud CompressionG-PCC Test Model v18
9Geometry-based Point Cloud CompressionG-PCC 2nd Edition codec description
9Geometry-based Point Cloud CompressionEE 13.47 on spherical coordinate geometry
10Carriage of Visual Volumetric Video-based Coding DataTechnologies under consideration on carriage of V3C data
10Carriage of Visual Volumetric Video-based Coding DataDefect under investigation on ISO/IEC 23090-10
12Immersive VideoCommon test conditions for MPEG immersive video
12Immersive VideoCall for MPEG immersive video test materials
13Video Decoding Interface for Immersive MediaProcedures for standard development and software of ISO/IEC 23090-13
13Video Decoding Interface for Immersive MediaTechnologies under consideration for VDI
14Scene Description for MPEG MediaTechnologies under Consideration on Scene Description
14Scene Description for MPEG MediaProcedures for standard development for ISO/IEC 23090-14 (MPEG-I Scene Description)
14Scene Description for MPEG MediaRequirements Coverage of MPEG-I Scene Description
14Scene Description for MPEG MediaExploration Experiments for MPEG-I Scene Description
14Scene Description for MPEG MediaRegistration of Khronos extensions
17Reference Software and Conformance for OMAFWD of Reference software and conformance for omnidirectional media format (OMAF) 2nd edition
18Carriage of Geometry-based Point Cloud Compression DataTechnologies under Considerations on Carriage of geometry-based point cloud compression data
24Conformance and Reference Software for Scene Description for MPEG MediaWD of Conformance and reference software for scene description
24Conformance and Reference Software for Scene Description for MPEG MediaProcedures for test scenarios and reference software development for MPEG-I Scene Description
25Conformance and Reference Software for Carriage of Visual Volumetric Video-based Coding DataWD of ISO/IEC 23090-25 Conformance and reference software for carriage of visual volumetric video-based coding data
26Conformance and Reference Software for Carriage of Geometry-based Point Cloud Compression DataWD of ISO/IEC 23090-26 Conformance and reference software for carriage of geometry-based point cloud compression data

MPEG-DASH

#PartTitle
1Media Presentation Description and Segment FormatsWD of ISO/IEC 23009-1 5th edition AMD 2 EDRAP streaming and other extensions
1Media Presentation Description and Segment FormatsTechnologies under Consideration for DASH
1Media Presentation Description and Segment FormatsDefects under Investigation on DASH
1Media Presentation Description and Segment FormatsDraft text of WD of Encoder and Packager Synchronization

MPEG-H

#PartTitle
12Image File FormatText of ISO/IEC 23008-12 CDAM 1 Support for progressive rendering signaling and other improvements
12Image File FormatDefect Report for ISO/IEC 23008-12:2017
12Image File FormatTechnology under Consideration on ISO/IEC 23008-12

MPEG-4

#PartTitle
1SystemsProposed draft of ISO/IEC 14496-1 5th edition Systems
1SystemsProposed draft of Syntactic description language
12ISO base Media File FormatTechnologies under Consideration for ISOBMFF
12ISO base Media File FormatDefect Report of ISO/IEC 14496-12
14MP4 File FormatTechnologies under Consideration for ISO/IEC 14496-14
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatProposed draft of ISO/IEC 14496-15 6th edition AMD 2
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatTechnologies under Consideration for NAL File Format
22Open Font FormatWD of ISO/IEC 14496-22 5th edition Open font format
32File Format ReferenceTechnology under consideration on ISO/IEC 14496-32 File format reference software and conformance

MPEG-2

#PartTitle
1SystemsText of ISO/IEC 13818-1 8th edition DCOR 1

MPEG-CICP

#PartTitle
2VideoText of ISO/IEC WD 23091-2:202x Coding-independent code points – Part 2: Video (3rd edition)

MPEG-C

#PartTitle
7Versatile Supplemental Enhancement Information Messages for Coded Video BitstreamsWorking draft of ISO/IEC 23002-7:202x (2nd Ed.) Amd.1 Additional SEI messages

MPEG-B

#PartTitle
10Carriage of Timed Metadata Metrics of Media in ISO Base Media File FormatTechnologies under Consideration for ISO/IEC 23001-10
16Derived Visual Tracks in the ISO Base Media File FormatTechnologies under Consideration for Derived visual tracks including further visual derivations
17Carriage of Uncompressed Video in ISOBMFFText of ISO/IEC CD 23001-17 Carriage of Uncompressed Video in ISOBMFF

MPEG-A

#PartTitle
19Common Media Application Format (CMAF) for Segmented MediaText of ISO/IEC 23000-19 3rd edition CDAM 2 Support of LCEVC and other technologies
19Common Media Application Format (CMAF) for Segmented MediaTechnology under consideration on CMAF
22Multi-Image Application Format (MIAF)Proposed draft of ISO/IEC 23000-22 AMD 3

MPEG-21

#PartTitle
23MPEG IPR Smart ContractsTechnologies under Consideration for ISO/IEC 21000-23

Administrative

#PartTitle
Request for offers to host a MPEG meeting (MPEG 142 - MPEG 149)

Explorations

#PartTitle
Learning-based quality metrics and 2D video databases under study (v2)
34Video Coding for MachinesUse cases and requirements for Video Coding for Machines
34Video Coding for MachinesCall for Proposals on Video Coding for Machines
34Video Coding for MachinesCommon Test Conditions and Evaluation Methodology for Video Coding for Machines
44AI-based coding for graphicsGuidelines for conducting AI exploration experiments for PCC
44AI-based coding for graphicsPerformance analysis of currently AI-based available solutions for PCC
44AI-based coding for graphicsPreliminary data set collection for AI experiments

Management

#PartTitle
List of SC 29/WG 03 AHGs established at the 7th meeting
MPEG Roadmap after the MPEG 138 meeting
MPEG Roadmap after the MPEG 138 meeting (Extended PPT)

All

#PartTitle
White paper on MPEG Smart Contracts for Media
Assets of Communication
Press Release of MPEG 138th meeting