SIP transfers to Digital Stewardship
- 1 Methods for Transfer
- 1.1 Teracopy
- 1.2 Total Commander
- 1.3 Rsync
- 2 Delivery Locations
Once SIPs are ready for transfer, the information packages must be deposited into the Digital Stewardship network share where the Digital Preservation Coordinator will perform quality control on the payload structure and metadata before preparing the packages for transfer into Archivematica.
Choose one of the methods for transfer listed below and use it to deliver the SIPs to the established location in the /dps network share pertaining to your respective unit or repository.
Please use these recommended transfer methods instead of copying material directly from your file explorer window as they will help avoid data loss or corruption during the transfer process.
Methods for Transfer
Teracopy
(Windows/Mac compatible)
A file management tool that allows for a faster and more secure file copy with file verification, error detection, and automation.
Download and install TeraCopy to your device. For Windows users, TeraCopy can be found in the Microsoft Store.
Open the application. Select the Source folder or drag and drop the ready-to-transfer SIP folders from your workspace area.
Click “Target” and select “Browse”. Select the established location in the /dps network share pertaining to your unit or repository.
Once the Source and Target have been selected, ensure that the “Options” tab remains as is set during default with data, timestamps, attributes, and streams selected, and all the options below security unselected.
Select “Copy” to initiate the transfer. Do not close the application until the transfer is completed.
Total Commander
(Windows compatible)
A file management tool that features two file windows side by side and allows for file copying, file comparison, and directory synchronization, among other features.
Download and install Total Commander 64-bit version to your Windows computer.
Open the application and press the button indicated in the pop-up window to start the program.
On the left window, navigate to your workspace area where the ready-to-transfer SIPs are located. Change network shares by selecting the drop down arrow next to the current network share name displayed at the top of the left window pane.
On the right window, navigate to the established location in the /dps network share pertaining to your unit or repository.
Select each ready-to-transfer SIPs on the left window pane by pressing Ctrl on your keyboard and left-clicking on the desired folder simultaneously. Once a folder is selected, it should appear highlighted in red.
Drag and drop the selected folders to the right window pane to copy them over to the delivery location. In the pop-up window, select the “Verify” option to ensure the files transfer safely, then select “Ok” to start the transfer.
Once the transfer is finished, you will see the folders in the right window pane and you may close the program.
Rsync
(Mac/Linux compatible)
A command-line tool for secure data transfer that allows for remote file transferring, file synchronization, file comparison, among other options.
Open the command-line interface terminal in your MacOS computer by clicking the launchpad icon in the dock, searching for “terminal”, and opening the terminal application.
Type the following into the terminal window to perform a dry run of the rsync command and ensure that the transfer process will not encounter any unexpected errors:
rsync -rltvPn --stats --inplace /path/to/source/directory/ /path/to/delivery/location/ 2>&1The /path/to/source/directory/ should be the complete path to your workspace directory where your ready-to-transfer SIPs are located. Alternatively, you can drag and drop the parent folder containing the ready-to-transfer SIPs into the terminal window instead of typing out the entire path.
The /path/to/delivery/location/ is the established delivery location in the /dps network share pertaining to your unit or repository. Alternatively, you can drag and drop the folder into the terminal window instead of typing out the entire path.
This command will run rsync with the following options:
-r (recurse into directories)
-l (copy symlinks as symlinks)
-t (preserve last modified timestamps)
-v (increase verbosity)
-P (keep partially transferred files and show progress during transfer)
-n (perform a "dry run", to test the validity of the command without actually copying files)
--stats (give some file-transfer statistics)
--inplace (update destination files in-place)
"2>&1" (redirects any errors to the output of the command)
Note: Always include a trailing slash ( / ) after the source and delivery directory names!
Press enter to perform this command.
If the "dry run" goes through without outputting an error message, delete the n option, and re-run the command to securely transfer SIPs to the delivery location. The final command should look like this:
rsync -rltvP --stats --inplace /path/to/source/directory/ /path/to/delivery/location/ 2>&1
Once the command has finished, the terminal window can be closed.
If the rsync command disconnected or failed midway, simply rerun the same command away and it will resume from where it left off.
If you’re having trouble with permissions, try to run the command with sudo permissions.
Delivery Locations
Producers | Workflow | Delivery location |
AAA | For Alexander Architecture Archives’ born-digital materials sent directly to DPC. | \\disk2.lib.utexas.edu\aaa_AMtransfer |
AILLA | For AILLA repository’s digital transfers sent directly to DPC. | \\disk2.lib.utexas.edu\ailla_AMtransfer |
DS | For born-digital material processed by Digital Archivist. | \\disk2.lib.utexas.edu\dps\archivematica\born-digital\ds |
DS | For physical material processed by Digitization staff. | \\disk2.lib.utexas.edu\dps\archivematica\digitized |