01
Introduction to Digital Preservation
September 3, Tue 5:30-9:30p
Topics
Introduction to digital technology and preservation
Digital Technology History Timeline, 1820 - 1995
Exercise: Digital technology timeline, 1995 - present
Recommended Readings
Digital Preservation Coalition: Digital Preservation Handbook
ALA Freedom to Read Statement & Bill of Rights
Clark & Steadman: Alan Turing's Legacy (WIRED)
DP Workshop Digital Technology and Preservation Timeline
The Signal: Digital Preservation Pioneer: Clifford Lynch
Lynch: Accessibility and Integrity of Networked Information Collections (1993)
02
History of Digital Preservation Efforts, Intro to OAIS Model
September 10, Tue 5:30-9:30p
Topics
OAIS reference model, history, and context
History of digital preservation efforts and initiatives
Bacoum: A Breif History of Digital Preservation
Lab *Bring Laptops to Class*
Booting from the digital preservation class disk image USB thumb drive
Follow along exercise: Navigate file systems with the command line, create files, create folders, list files and directories (pwd, cd, mkdir, touch, ls, etc.)
Individual exercise: Create your own directory structures and files based on a theme of your choice. Create an inventory report with "ls".
Readings
Besser: Moving from Digital Collections to Interoperable Libraries (2002)
Lavoie: Meeting the Challenges of Digital Preservation: The OAIS Reference Model
Rosenthal: Requirements for Digital Preservation Systems
Reccommended
Lavoie: The Open Archival System Introductory Guide
Reference
1996 Task Force on Archiving of Digital Information
Reference Model for an Open Archival Information System (The Magenta Book)
Lab Exercise Files
w2-lab.zip
03
Software, Operating Systems & Computing Environments
September 17, Tue 5:30-9:30p
Topics
Operating systems and digital preservation: UNIX and GNU/Linux
Free Software Movement and Open Source Software
Discussion of Assignment #1
Lab *Bring Laptops to Class*
Introduction to the bash shell and command line structure
Readings
Finley: Linux Took Over the Web. Now, It’s Taking Over the World (WIRED)
Kelty: Two Bits: The Cultural Significance of Free Software (Chapter 3 only) – alternate download here
Lyons: Introduction to Using the Command Line
Recommended Reading
Raymond: The Cathedral and the Bazaar
Lab Exercise & Files
Command line scavenger hunt
cli-scavenger-hunt.zip
04
Digital Format Identification, NDSA Levels of Preservation
September 24, Tue 5:30-9:30p
Topics
NDSA Levels of Preservation
File identification and format sustainability
Characteristics and Specifications of digital files
Lab *Bring Laptops to Class*
Encoder/Decoder exercise
Command-line file playback with mplayer, analysis with mediainfo
Review file sustainability factors: Sustainability of Digital Formats
Readings
NDSA Levels of Preservation
Peltzman: Expanding NDSA Levels of Preservation
Martin: What is a file?
Lacinak: Primer on Codecs
Jackson: Formats Over Time, UK Libraries
Recommended/Reference
Rosenthal: Formats Through Time, DHSR Blog
Library of Congress: Sustainability of Digital Formats (Introduction, Sustainability)
Video Formats, Codecs and Containers
Nagels (BAVC): PAR, SAR, and DAR: Making Sense of Standard Definition (SD) video pixels
Digital Preservation Coalition: Digital Preservation Handbook, File Formats and Standards
Lab Exercise Files
w4-lab-files.zip
05
Data Storage: Architecture & File Systems
October 1, Tue 5:30-9:30p
Topics
Digital File Systems and Storage Media
Networked Storage Architecture
Lab *Bring Laptops to Class*
Follow along exercise: Write a bash shell script using ATOM text editor
Individual exercise: Customize a bash shell script using ATOM (GUI) with a prepared script to perform a batch process (ffmpeg, disk usage, df, etc.)
Readings
Google – Pinheiro, Weber, Barroso: Failure Trends in a Large Disk Drive Population
Glicksman: Storage Architectures and Network
2017 NDSA Storage Survey & Report
Clipper Notes: LTO tape advantages over disk
Recommended/Reference
Backblaze – Klein: What Can 49,056 Hard Drives Tell Us?
06
Data Transfer, Fixity, & Integrity
October 8, Tue 5:30-9:30p
Topics
Safe file transfer and maintaining data integrity
Fixity and checksums for preservation of audiovisual digital objects
Lab *Bring Laptops to Class*
Follow along: “for loop”
Follow along exercise: File transfer (cp, mv, rsync)
Follow along exercise: Fixity and checksums (md5, sha1, hashdeep, framemd5)
Readings
Checking Your Digital Content: An NDSA Publication
Baily: Protect Your Data (The Signal)
Rice: Reconsidering Checksums
Havemeyer-King: Trojan Dots and DIY Solutions (NDSR Blog)
Recommended/Reference
Goldin: A gentle introduction to rsync, a free, powerful tool for media ingest
Lab Exercises
w6-fixity-transfer.zip
##
Legislative Day
October 15, Tue 5:30-9:30p
No Class
Classes meet according to a Monday schedule
07
Midterm Presentations
October 22, Tue 5:30-9:30p
DUE – In Class
Assignment #1 Presentations
Readings
Summers: Web as a Preservation Medium (Medium)
Fino-Radin: Rhizome Preservation
Topics
Introduction to the Internet and World Wide Web, Web Architecture and Preservation
Web Preservation and the Internet Archive
Lab *Bring Laptops to Class*
Web archiving with WGET
Rhizome Webrecorder demo
Readings & Resources
Rhizome: Old Web Today Portal (enter URL and date to explore archived web pages from the past)
Lasar: 25 Years of Hypercard (Ars Technica)
Berners-Lee: WorldWideWeb Executive Summary
McKeehan: Symmetrical Web Archiving with Webrecorder (NDSR Blog)
ArchiveIt: Known Challenges of Web Archiving
Reference
Berners-Lee: Original Proposal for Information Management for CERN
ArchiveIt: Scoping guidance for specific types of sites (Social Media, etc.)
ArchiveIt: Glossary of Web Archiving Terms
Bill Atkinson: Reflecting on Hypercard in 2016
Lab Exercise Files
w8-lab.zip
09 🇺🇸
Preservation Metadata
November 5, Tue 5:30-9:30p
Topics
Introduction to preservation metadata
PREMIS, METS & XML
Lab *Bring Laptops to Class*
Review of PREMIS/METS metadata records
Exploring NANO, CRON & FIND
Readings
Caplan: Understanding PREMIS
Amaral: METS for Transferable Metadata
Lavoie, Gardener: Preservation Metadata
Recommended/Reference
PREMIS Data Dictionary
Lab Exercise Files
w9-lab (10MB)
see also: https://crontab.guru/
No Class
Students in Baltimore for Association of Moving Image Archivists Conference
## 🎥
AMIA
November 12, Tue
10
Digital Repository Design & Microservices
November 19, Tue 5:30-9:30p
Topics
Microservices for digital preservation and repositories
Digital repository design
Lab *Bring Laptops to Class*
File Signatures and Hexercises
Gary Kessler: List of File Signatures
Corkami File Signature Posters
Readings
Handel: Data Migration, Digital Asset Management and Microservices at CUNY TV
Spalenka: Some Assembly Required: Micro-services and Digital Preservation
Cramer & Kott: Designing and Implementing Second Generation Digital Preservation Services (Standford Univeristy)
Recommended
Abrams, et al: Preservation Is Not a Place
Abrams, et al: An Emergent Micro-Services Approach to Digital Curation Infrastructure
Microservice Links
Lab
w10-lab.zip (30MB)
11 🦃
Digital Preservation Packaging & Automation
November 26, Tue 5:30-9:30p
Topics
Digital Preservation Packaging & the Bagit Specification
Automating Ingest of Submission Information Packages
Review ingest script
LTO Tape: Formats, indexes and LTFS
Lab *Bring Laptops to Class*
Review Ingest Script
Create "bags" and reports with Bagit command line software
Readings
Bagit: A Video Introduction
Gates: Using Bagit – The Patch Bay
Gates: Using Bagit in 2018 – The Patch Bay
Kim, Ross: Digital Forensics Formats: Seeking a Digital Preservation Storage Container Format
Recommended Readings
Lavoie: The fifth blackbird
Lab Exercise Files
w11-lab.zip
12
Trusted Digital Repositories & Sustainability
December 3, Tue 5:30-9:30p
Topics
Sustainability and policy for digital preservation environments
TDR, TRAC and the TRAC Checklist
LOCKSS and CLOCKSS
Lab: Guest Lecturer Ethan Gates
80s & 90s Digital Storage Formats and Connection Interfaces
Readings
TRAC Checklist (read pages 1–8, skim/review remainder of document)
Rosenthal: TRAC Audit, Lessons Learned (DSHR Blog)
What is LOCKSS? and LOCKSS Preservation Principles
The CLOCKSS Archive and What is the Difference Between LOCKSS and CLOCKSS?
Center for Research Libraries: Certification Report on CLOCKSS
Recommended Readings
Lavoie: The fifth blackbird
13
Final Project Presentations
December 10, Tue 2:30-6:30p
721 Broadway, Room 635
DUE – In Class
Assignment #2 Presentations
Last class!
##
Final Papers Due
December 13, Fri 6p
DUE – Email: FRIDAY, December 14th, 6pm
Assignment #2 Papers
Last day of Fall 2019 classes
Friday, December 13, 2018
Additional Recommended Readings
Rosenthal: The Medium Term Prospects for Long Term Storage
Pease, Amir, et al: The Linear Tape File System
Lazorchak: Digital Forensics and Digital Preservation: An Interview with Kam Woods of BitCurator
Educopia Institute: BagIt Usage Instructions
Internet Draft: BagIt File Packaging Format Specifications for the Internet Engineering Task Force (IETF)