Skip to content
This repository has been archived by the owner on Oct 19, 2020. It is now read-only.

BBATools/PreservationWorkbench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Archived. Development continues here: https://github.com/Preservation-Workbench/PWCode

Preservation Workbench (PWB) implements the features we need to extract data from systems and generate data packages suitable for long time storage. PWB is implemented on top of SQL Workbench/J (installed as a dependency): https://www.sql-workbench.eu/

Some features are only available when installed as part of Arkimint:
https://github.com/BBATools/Arkimint

Install instructions (extract and verify features only):

Windows:

Download this repo as zip or git clone. Run or click PWB.vbs which will download any missing dependencies on first run. Run or click PWB.vbs again after install has finished to run the program.

Many database drivers are available as part of the install, but for licensing reasons Oracle drivers are not included. Download ojdbc10.jar from here https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html and add to the PreservationWorkbench\bin directory.

The resulting PreservationWorkbench directory can be used as a portable app:
https://en.wikipedia.org/wiki/Portable_application

Linux:

Portable generic Linux install will be made available after we switch to a custom SQL Workbench/J build with jlink: https://docs.oracle.com/javase/9/tools/jlink.htm

Usage:

Start SQL Workbench/J with PWB.vbs (Windows) or PWB.sh (Linux). PWB specific features are started via macros and are thus found under the Macros menu.

Extract:

Extract data from database and/or disk. If database export, Use File->Connect window first to connect to database/schema. Use Export to Disk once per database schema (and any files on disk that are connected to schema) or (if no database) any collection of files on disk that constitute a separate part of the system. Use Create System Data Package when all parts of the system have been extracted to package the data as one data package (packaged as a wim file to retain file metadata) and generate checksum.

Verify:

Verify checksum and make backup of raw SIP before processing.

Dispose:

Dispose/remove parts of the extracted data that has no archival value
WIP

Process:

Normalize documents (convert to archival formats) and data (convert to ISO/SQL and TSV). Generate AIP.
Generated SQL and tsv-data are automatically tested for compatibility with the following databases:

  • PostgreSQL 12
  • Oracle 11.2
  • SQL Server 2019
  • SQLite 3.27
Other:

SQL Workbench/J standard features are described here:
https://www.sql-workbench.eu/manual/workbench-manual.html

About

Solution for extracting data from systems and generating archive packages for long time storage.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages