How to copy a subset of INTEGRAL data

skip to content
 

HEASARC Staff Scientist Position - Applications are now being accepted for a Staff Scientist with significant experience and interest in the technical aspects of astrophysics research, to work in the High Energy Astrophysics Science Archive Research Center (HEASARC) at NASA Goddard Space Flight Center (GSFC) in Greenbelt, MD. Refer to the AAS Job register for full details.

INTEGRAL U.S. Guest Observer Facility
SPI: News! User Manuals Data IRFs and RMFs Documents & Links ISDC SPI page FAQs Contact

How to copy a subset of INTEGRAL data

last update of this page: 30.04.2004


Here I describe how to copy a subset of data from the ISDC. To do so, you need an existing INTEGRAL data set at your site, a user account at the ISDC, and the data rights to access the INTEGRAL data you want to copy. Even though this is very similar, I give the explanation for copying near-real-time (NRT) data, and for copying consolidated data.

ASCII version of this page for download and print-out.


Copy NRT data

Create a new data directory:

mkdir data_rep_nrt
cd data_rep_nrt
setenv REP_BASE_PROD $PWD

Link the idx/ and ic/ directories of local consolidated data you have at your site:

ln -s /whereever/consolidated/ic ic
ln -s /whereever/consolidated/idx idx

Create an aux/ directory with the adp/ subdirectory:

mkdir aux
cd aux
mkdir adp

Link the org/ directory from your local consolidated data here:

ln -s /wherever/consolidated/aux/org org

and the ref/ directory in aux/adp/:

cd adp
ln -s /whereever/consolidated/aux/adp/ref ref

Now go back to the aux/adp/ directory:

cd ..

and copy the auxiliary data for the revolutions you want to copy from ISDC here:

scp -r your_username@isdcsf4.unige.ch:/isdc/pvphase/nrt/ops_1/aux/adp/XXXX.000 .

where XXXX is the revolution number (e.g. 0180). Now you have to copy the science window data:

cd $REP_BASE_PROD
mkdir scw
cd scw

If you want to copy a complete revolution:

scp -r your_username@isdcsf4.unige.ch:/isdc/pvphase/nrt/ops_1/scw/XXXX/ .

In case you want to download only part of the data:

mkdir XXXX
(where XXXX is the revolution number, e.g. 0180)

cd XXXX
scp -r your_username@isdcsf4.unige.ch:/isdc/pvphase/nrt/ops_1/scw/XXXX/rev.000 .

And now copy the science window directories here:

scp -r your_username@isdcsf4.unige.ch:/isdc/pvphase/nrt/ops_1/scw/XXXX/science_window_number .

NOTE! scp does not allow the wildcard ('*' or '?') when copying from another machine. BUT you can use the wildcard when you are on the system where to copy from, i.e. log onto ISDC, go to the scw/XXXX/ directory and use
scp -r science_window_* username@your_home_computer.wherever.it:.


Copy consolidated data

Create a new data directory:

mkdir data_rep_cons
cd data_rep_cons
setenv REP_BASE_PROD $PWD

Link the idx/ and ic/ directories of local consolidated data you have at your site:

ln -s /whereever/consolidated/ic ic
ln -s /whereever/consolidated/idx idx

Create an aux/ directory with the adp/ subdirectory:

mkdir aux
cd aux
mkdir adp

Link the org/ directory from your local consolidated data here:

ln -s /wherever/consolidated/aux/org org

and the ref/ directory in aux/adp/:

cd adp
ln -s /whereever/consolidated/aux/adp/ref ref

Now go back to the aux/adp/ directory:

cd ..

and copy the auxiliary data for the revolutions you want to copy from ISDC here:

scp -r your_username@isdcsf4.unige.ch:/isdc/arc/rev_1/aux/adp/XXXX.001 .

where XXXX is the revolution number (e.g. 0180). Now you have to copy the science window data:

cd $REP_BASE_PROD
mkdir scw
cd scw

If you want to copy a complete revolution:

scp -r your_username@isdcsf4.unige.ch:/isdc/arc/rev_1/scw/XXXX/ .

In case you want to download only part of the data:

mkdir XXXX
(where XXXX is the revolution number, e.g. 0180)

cd XXXX
scp -r your_username@isdcsf4.unige.ch:/isdc/arc/rev_1/scw/XXXX/rev.000 .

And now copy the science window directories here:

scp -r your_username@isdcsf4.unige.ch:/isdc/arc/rev_1/scw/XXXX/science_window_number .

NOTE! scp does not allow the wildcard ('*' or '?') when copying from another machine. BUT you can use the wildcard when you are on the system where to copy from, i.e. log onto ISDC, go to the scw/XXXX/ directory and use
scp -r science_window_* username@your_home_computer.wherever.it:.


In case of questions and comments: contact me.