Old Data Backup Procedure

This procedure is based on the one outlined by Moo-Young Chun here: https://docs.google.com/document/d/1Nh-vrKHGmwLOPa4Z-0qiD-I4Vg8kxWrzsBcrDyFC9Dc/edit

 

The IGRINS data is located on 5 different machines:

DCCS - S Detector Control Computer

DCCH - H Detector Control Computer

DCCK - K Detector Control Computer

ICC - Instrument Control Computer

DSC - Data Server Computer

 

The DCC hard drives are each 1TB, but only 888GB are available for detector readout.

The ICC has a 1TB hard drive, and the DSC has a 250GB fusion drive and two 2TB hard drives.

All of these hard drives are accessible from the ICC once the volumes have been mounted as part of the IGRINS Startup Procedure.

 

During a trimester, files are to be copied from the ICC to the DSC in order to make a duplicate of each file. This is in addition to the copy saved by each observer, ensuring at least three copies.

At the start of a trimester all files from the previous trimester will be archived.  This is accomplished by:

  1. Copy ICC files to DSC, UT external HD, and KASI external HD. 
    1. Each system is setup with a storage tree that identifies the initial hard drive and the trimester of the files. (HD>DCCS_4> 2014T2>files sorted by local date of observation)
    2. To copy the files while maintaining the files dates and copying every subdirectory
      1. cd to the target directory        cd /Volumes/HD/2014T2
      2. use this format.          cp -apv /IGRINS/obsdata/201409* .
    3. To copy to the DSC you need to first make DSC>OBSDATA a shared drive, and then complete the steps above.
  2. Copy DCC files to external hard drive.
    1. cd to the target directory        cd /Volumes/HD/2014T2
    2. use this format.          cp -apv /IGRINS/obsdata/201409* .
    3. or drag and drop.

 

In order to avoid filling hard drives they must be cleaned after the copies have been made. 

The DCC appears to save every fowler read as a separate file, producing 32x8.4MB files for each nod position. For a 12 hour night this is roughly 25GB of storage, and for a 60 night trimester this is 1.5TB of data on a 1TB HD.

So, it is necessary to copy and clean the DCC hard drives more than once per trimester.

The ICC only has space issues if the observer saves every image. The slit view camera produces ~30GB of files each night. We can avoid filling this hard drive by turning off the autosave function.

The DSC should be able to store a year of ICC copied files at a time.

 

When the ICC and DSC hard drives are full, we will delete the oldest trimester stored. The DCC hard drives will be cleared every other month.