New Audio Digitization Performance Testing Guidelines and Software from FADGI

The following is a guest post by Kate Murray, organizer of the FADGI Audio-Visual Working Group and Digital Projects Coordinator at the Library of Congress.

The Federal Agencies Digital Guidelines Initiative is pleased to announce the release of ADCTest, an open source software application designed to facilitate performance testing of analog-to-digital converters (ADC) used in audio digitization preservation workflows. Developed by AVP in collaboration with Christian Landone, ADCTest automates a series of tests to measure the performance of ADC devices against FADGI’s 2017 Audio Analog-to-Digital Converter Performance Specification and Test Method Guideline (Low Cost).

Federal Agencies Digital Guidelines Initiative logo

Federal Agencies Digital Guidelines Initiative

A complement to the high quality ADC performance test guidelines approved in summer 2016, the pass-fail specifications recommended in the low cost guideline are for modified performance testing which takes into account minimum levels of performance, with lower equipment costs and requiring more modest engineering skills.  This low cost test guideline, approved by FADGI in September 2017, is not intended for absolute, high precision testing for the purpose of comparing the performance multiple ADCs, or analyzing nuanced aspects of ADC performance. Instead, its primary purpose is to provide users with a low-cost and simple test tool that will be employed routinely. In FADGI’s ADC performance testing work, we found that one of the biggest issues was that performance testing wasn’t being performed routinely, or at all, due to cost and complexity. Routine performance testing, even with lower performance test tools, enables the identification of significant failures, the relative comparison of ADCs in certain cases, and the ability to establish a benchmark for a given ADC to track trends in performance over time.

For more background and history of FADGI’s ADC performance testing project, see Avoid Jitter! Measuring the Performance of Audio Analog-to-Digital Converters.

The ADCTest software, available for download on the Library of Congress GitHub site, automates the testing protocol for all the low cost guidelines with a goal towards answering three basic questions:

  • Is my ADC/system failing?
  • How does my calibrated, healthy ADC perform relative to the guideline and other ADCs?
  • Is my ADC/system performing optimally relative to its own specifications?

It provides a flexible approach – with the ability to enable and disable individual test and accommodate support up to 24 bit, 96kHz signals – combined with easy to interpret pass/fail results, allowing users to customize the tool based on their needs.

Screenshot of ADC Performance Test tool interface for selecting test procedure

Selecting and deselecting tests to run in ADCTest.

ADCTest evaluates the performance of the ADC device against the seven criteria specified in the FADGI low cost guidelines including frequency response, dynamic range and crosstalk. The reports for each test are clearly identified as pass/fail against the FADGI criteria spelled out in the low cost guidelines.

Screenshot of ADC Perfomance Test tool interface

Pass/fail test results.

Double clicking on a given test will open up a detailed view of the test results to allow further investigation and interpretation. Users can even create their own test suite XML file and open it from the file menu to replace the FADGI test suite represented by default.xml in the application directory.

Screenshot of ADC Performance Test Tool options

Inserting a user-defined test suite.

ADCTest will continue to be refined with support from AVP and feedback is welcome through GitHub or directly to FADGI.

In keeping with FADGI’s goal to provide wide access to improved tools and workflows, ADCTest carries a BSD-3 license and the low cost guidelines carry a CC0 1.0 Universal license for worldwide use and reuse.

For more information about the FADGI ADC Performance Testing project, see http://www.digitizationguidelines.gov/guidelines/digitize-audioperf.html.

ADCTest software is available for download on the Library of Congress GitHub site.

New FADGI MXF AS-07 Specification and Sample Files Published

The following is a guest post by Kate Murray, organizer of the FADGI Audio-Visual Working Group and Digital Projects Coordinator at the Library of Congress. The Federal Agencies Digital Guidelines Initiative (FADGI) is pleased to announce the publication of a new version of the MXF AS-07 Application Specification (with CC BY-SA 4.0 license) and its […]

FADGI’s 10th Anniversary: Adapting to Meet the Community’s Needs

This is a guest post by Kate Murray, IT Specialist in the Library of Congress’s Digital Collections and Management Services. Started in 2007 as a collaborative effort by federal agencies, FADGI has many accomplishments under its belt, including the widely implemented Technical Guidelines for Digitizing Cultural Heritage Materials (newly updated in 2016); open source software, […]

New FADGI Guidelines for Embedded Metadata in DPX Files

The Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce that its new draft publication, Embedding Metadata in Scanned Motion Picture Film Files: Guideline for Federal Agency Use of DPX Files, is available for public comment. The Digital Picture Exchange format typically stores image-only data from scanned motion picture film or born-digital […]

FADGI MXF Video Specification Moves Up an Industry-organization Approval Ladder

The following is a guest post by Carl Fleischhauer, who organized the FADGI Audio-Visual Working Group in 2007. Fleischhauer recently retired from the Library of Congress. The Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce a milestone in the development of the AS-07 MXF video-preservation format specification. AS-07 has taken shape […]

Avoid Jitter! Measuring the Performance of Audio Analog-to-Digital Converters

The following is a guest post by Carl Fleischhauer, a Project Manager in the National Digital Initiatives unit at the Library of Congress. It’s not for everyone, but I enjoy trying to figure out specialized technical terminology, even at a superficial level. For the last month or two, I have been helping assemble a revision […]

Digitizing Motion Picture Film: FADGI Report on Current Practices and Future Directions

The following is a guest post by Carl Fleischhauer, a Digital Initiatives Project Manager at the Library of Congress. More often than not, the Federal Agencies Digitization Guidelines Initiative Working Groups (one for still images, one for audio-visual) find themselves walking a line between codifying widely adopted practices and exploring new ideas and new technologies […]

Improving Technical Options for Audiovisual Collections Through the PREFORMA Project

The digital preservation community is a connected and collaborative one. I first heard about the Europe-based PREFORMA project last summer at a Federal Agencies Digitization Guidelines Initiative meeting when we were discussing the Digital File Formats for Videotape Reformatting comparison matrix. My interest was piqued because I heard about their incorporation of FFV1 and Matroska, […]

All in the (Apple ProRes 422 Video Codec) Family

We’ve spent a lot of time recently thinking about digital video issues. As mentioned in a previous blog post, the Federal Agencies Digitization Guidelines Initiative published several reports on this topic including “Creating and Archiving Born Digital Video.” Work on the “Eight Federal Case Histories” (PDF) report nudged us to add the Apple ProRes 422 […]

New FADGI Report: Creating and Archiving Born Digital Video

As part of a larger effort to explore file formats, the Born Digital Video subgroup of the Federal Agencies Digitization Guidelines Initiative Audio-Visual Working Group is pleased to announce the release of a new four-part report, “Creating and Archiving Born Digital Video.” This report has already undergone review by FADGI members and invited colleagues including […]