Package specifications

Ingest can be carried out automatically or manually. During ingest, the transfer information package is transformed to a pre-ingest SIP using a submission application. If the pre-ingest SIP is transferred to Rosetta, it is transformed to a post-ingest SIP in the deposit process. Following successful transfer to permanent archival storage, an AIP is created.

The various package structures are explained in the overview graphic package structures.

The ingest process

Ingest workflows are configured individually for each library team. Workflows vary according to the transfer information package and metadata that are added during the ingest process:

• Number of representations
• Data structure
• Licence texts deposited
• Access rights granted
• Identification of the collection type
• Identifier for the collection and production path

The processing steps in Rosetta are identical at the process level. The graphic Transforming transfer information packages to SIPs and AIPs shows in detail the process involved in transforming the transfer information package to a pre-ingest SIP, a post-ingest SIP and an AIP.

At the technical level, objects are handled according to their format requirements using appropriate plugins. Identifying, structural and descriptive metadata are recorded in the METS file during the ingest process.

During deposit, Rosetta creates a checksum for every file.

Various processes are performed in the validation stack during ingest:

• Format identification using DROID
• Format validation using JHOVE
• Crosscheck of three checksums
• Virus check
• Extraction of technical metadata using JHOVE, mediainfo or the NLNZ Metadata Extraction Tool
• Validation of the METS file

New identification tools and validation tools can be integrated in Rosetta as plug-ins at any time.

The results of the validation stack are written to the METS file and are indexed.

The extracted technical metadata are written as significant properties.

Ingest takes places automatically for all acquisition teams, with the exception of university publications. The automatic ingest process is described in the process diagram Automatic ingest.

The workflow for university publications is described separately. Due to specific process requirements, university publications are submitted manually by the University Publications team. The manual ingest process is described in the process diagram Manual ingest.

After every automatic ingest of a collection, the Digital Preservation team conducts matching with the results of the preliminary analysis, which involves the following steps:

• Matching the results of the preliminary analysis with the results of identification and validation in Rosetta
• Checking objects in Rosetta for completeness and the correct assignment of descriptive, administrative, legal, technical and structural metadata.