New FADGI Guidelines for Embedded Metadata in DPX Files

The Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce that its new draft publication, Embedding Metadata in Scanned Motion Picture Film Files: Guideline for Federal Agency Use of DPX Files, is available for public comment.

FADGI DPX Guidelines

FADGI’s Embedded Metadata Guidelines for DPX Files

The Digital Picture Exchange format typically stores image-only data from scanned motion picture film or born-digital images created by a camera that produces a DPX output. Each DPX file represents a single image or frame in a sequence of a motion picture or video data stream. As a structured raster image format, DPX is intended to carry only picture or imagery data, with corresponding sound carried in a separate format, typically the WAVE format.  In practice, this means that a single digitized motion picture film will consist of a sequence of tens of thousands of individual DPX files, each file corresponding to a frame of scanned film with sequentially numbered file names, as well as a separate audio file for sound data.

FilmReels

Film reel. Photo courtesy of emma.buckley on Flickr. CC BY-ND 2.0.

This document is limited in scope to embedded-metadata guidelines and does not look to define other technical characteristics of what a DPX file might carry, including image tonal settings, aspect ratios, bit depths, color models and resolution.  Recommended capture settings are defined for a variety of source material in the companion FADGI document, Digitizing Motion Picture Film: Exploration of the Issues and Sample SOW.

The new guidelines define FADGI implementations for embedded metadata in DPX file headers, including core fields defined by the SMPTE ST268 family of standards as well as selected fields Strongly Recommended, Recommended or Optional for FADGI use. The non-core fields take advantage of existing header structures as well as define new metadata fields for the User Defined fields to document, among other things, digitization-process history.

For all metadata fields addressed in this guideline, FADGI has definitions, including those for fields that do not have a definition in SMPTE ST268. For all core fields, the FADGI use complies with the SMPTE use. In non-core fields, especially those with no definition from SMPTE, FADGI defines the use. One example is the Creator field, which FADGI proposes to be used for the name of the institution or entity responsible for the creation, maintenance and preservation of this digital item. This use aligns with other FADGI embedded-metadata guidelines for BWF and MXF AS-07 files.

MetadataHasWings

Metadata has wings. Photo courtesy of Gideon Burton on Flickr. CC BY-SA 2.0

FADGI draws inspiration from the EBU R98-1999: Format for the <CodingHistory> Field in Broadcast Wave Format (PDF) document for defining a use for field 76, User Defined Data Header, to summarize data on the digitizing process, including signal-chain specifics and other elements. The Digitization Process History field employs a defined string variable for each parameter of the digitization process: the first line documents the source film reel, the second line contains data on the capture process and the third line of data records information on the storage of the file.

Initiated in spring 2016, this project is led by the FADGI Film Scanning subgroup with active participation from the Smithsonian’s National Museum of African American History and Culture (NMAAHC), the National Archives and Records Administration (NARA), NASA’s Johnson Space Center and the Library of Congress, including Digital Collections and Management Services, the Packard Campus for Audio-Visual Conservation and the American Folklife Center. The fast pace of this project marks a new work ethos for the always-collaborative FADGI, moving from initial concept to draft publication in under eight months. This iterative nature allows the working group to be more agile in its project management and to get stakeholder feedback early in the project.

At the 2016 Association of Moving Images annual conference in Pittsburgh, FADGI members Criss Kovac from NARA and Blake McDowell from NMAAHC presented a well-received poster (PDF) and handout (PDF) on the project.

FADGI welcomes comments on the draft guidelines through February 28, 2017.

FADGI MXF Video Specification Moves Up an Industry-organization Approval Ladder

The following is a guest post by Carl Fleischhauer, who organized the FADGI Audio-Visual Working Group in 2007. Fleischhauer recently retired from the Library of Congress. The Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce a milestone in the development of the AS-07 MXF video-preservation format specification. AS-07 has taken shape […]

Avoid Jitter! Measuring the Performance of Audio Analog-to-Digital Converters

The following is a guest post by Carl Fleischhauer, a Project Manager in the National Digital Initiatives unit at the Library of Congress. It’s not for everyone, but I enjoy trying to figure out specialized technical terminology, even at a superficial level. For the last month or two, I have been helping assemble a revision […]

Digitizing Motion Picture Film: FADGI Report on Current Practices and Future Directions

The following is a guest post by Carl Fleischhauer, a Digital Initiatives Project Manager at the Library of Congress. More often than not, the Federal Agencies Digitization Guidelines Initiative Working Groups (one for still images, one for audio-visual) find themselves walking a line between codifying widely adopted practices and exploring new ideas and new technologies […]

Improving Technical Options for Audiovisual Collections Through the PREFORMA Project

The digital preservation community is a connected and collaborative one. I first heard about the Europe-based PREFORMA project last summer at a Federal Agencies Digitization Guidelines Initiative meeting when we were discussing the Digital File Formats for Videotape Reformatting comparison matrix. My interest was piqued because I heard about their incorporation of FFV1 and Matroska, […]

All in the (Apple ProRes 422 Video Codec) Family

We’ve spent a lot of time recently thinking about digital video issues. As mentioned in a previous blog post, the Federal Agencies Digitization Guidelines Initiative published several reports on this topic including “Creating and Archiving Born Digital Video.” Work on the “Eight Federal Case Histories” (PDF) report nudged us to add the Apple ProRes 422 […]

New FADGI Report: Creating and Archiving Born Digital Video

As part of a larger effort to explore file formats, the Born Digital Video subgroup of the Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce the release of a new four-part report, “Creating and Archiving Born Digital Video.” This report has already undergone review by FADGI members and invited colleagues including […]

Comparing Formats for Video Digitization

The following is a guest post by Carl Fleischhauer, a Digital Initiatives Project Manager in the Office of Strategic Initiatives. FADGI format comparison projects. The Audio-Visual Working Group within the Federal Agencies Digitization Guidelines Initiative recently posted a comparison of a few selected digital file formats for consideration when reformatting videotapes. We sometimes call these […]

Audio for Eternity: Schüller and Häfner Look Back at 25 Years of Change

The following is a guest post by Carl Fleischhauer, a Digital Initiatives Project Manager in the Office of Strategic Initiatives. During the first week of October, Kate Murray and I participated in the annual conference of the International Association of Sound and Audiovisual Archives in Cape Town, South Africa.  Kate’s blog describes the conference.  This blog […]

Convergence of Audiovisual Archivists in the ‘Fairest Cape’: A Report of the 2014 IASA Conference

Upon seeing the Cape of Good Hope near Cape Town, South Africa, for the first time in 1580, Sir Francis Drake wrote in his diary that “this cape is the most stately thing and the fairest cape we saw in the whole circumference of the earth” And I have to say that I agree. In […]