Data Backup
Contents |
[edit] SCP
[edit] SCP FROM THE ALS:
- Data may be scp'ed from your user account by typing:
scp -pr datadirectory username@hostname:/datadirectory
where hostname is the name of your home institution computer. - EXAMPLE: scp -pr /data/dcsuser/arnold ArnoldS@berkeley.edu:/home/usraccounts
NOTE: The -r is for recursive, so that a directory and all its contents are copied, while the -p preserves the original date on the file. At home, you can then type ls -Flart *.img to list the image files in the order in which they were taken.) If you want to copy a single file or several files, use scp -p filename username@hostname:/datadirectory (or *.img in place of the filename)
[edit] SCP / SFTP FROM OFFSITE:
- Log onto the download machine by typing one of the following commands:
- ssh username@bcsb-nx.als.lbl.gov
- ssh username@bcsb-download.als.lbl.gov
- ssh username@bcsb-download-1.als.lbl.gov
- ssh username@bcsb-nx.als.lbl.gov
- You will be logged into your processing directory so you can scp processed data directly.
- For raw images you must go to the directory that corresponds to the beamline at which you collected your data. For example, type cd /data/bl8222/dcsuser/yourdata
- Once in the correct directory you can scp as indicated above
Note: group accounts such as stanford, ucberkeley, ucsf etc will not be able to log on to the bcsb-download-1 machine; you must have an individual PI account.
[edit] FTP
- First, tar your image files using the command tar -cvf name.tar directory where directory is the directory full of processed data.
- At the prompt, type ftp, or sftp sitename (i.e. ftp home.berkeley.edu)
- At the ftp prompt type passive
- At the ftp prompt type prompt
- At the ftp prompt type bin
- At the ftp prompt type cd datadirectory (where datadirectory is the directory at the destination server where you want to store your files)
- At the ftp prompt type put name.tar
- When done, type bye to end the session
[edit] RSYNC
Go to the /data/dcsuser directory and type:
rsync -avz dirname user@hostname:/destination
where dirname is your directory with processed data, and destination is the directory in which you want the data to be sent to.
[edit] Firewire Drive (Linux)
- Plug in the firewire or usb cable to the linux box. Firewire cables are provided at most data processing machines.
- Plug in the power supply (if necessary) and switch the drive on.
- Wait 5-20 seconds. A window with the /firewire directory should appear
- Drag and drop your files.
- When done, right click the disk drive icon on the desktop and select "unmount volume", or type "umount /firewire" in the prompt.
- Be sure to unmount before unplugging to prevent loss of data.
If the drive is Mac OS formatted (HFS+), Linux may not recognize the drive. If no processing machine recognizes the drive, you may have to reformat it.
To format a drive on Linux, please refer to External Hard Drive Issues
[edit] DVD Burning
DVD burning is available through Nero on the Windows machines, and K3B on the Linux data processing machines. To run K3B, run the command 'k3b' in any console, and the graphical user interface should appear.