{"id":123,"date":"2026-10-08T22:08:47","date_gmt":"2026-10-08T22:08:47","guid":{"rendered":"https:\/\/bcsb.als.lbl.gov\/?page_id=123"},"modified":"2026-10-08T22:08:47","modified_gmt":"2026-10-08T22:08:47","slug":"data-backup","status":"publish","type":"page","link":"https:\/\/bcsb.als.lbl.gov\/?page_id=123","title":{"rendered":"Data Backup"},"content":{"rendered":"\n

PLEASE NOTE: ALL DATA ON THE DATA DISKS IS DELETED AFTER TWO WEEKS<\/strong><\/p>\n\n\n\n

BACK UP YOUR DATA IMMEDIATELY AFTER YOUR RUN!<\/strong><\/p>\n\n\n\n

RSYNC<\/strong><\/h3>\n\n\n\n

To back up all the data from a source directory into a destination directory on your drive, use:<\/p>\n\n\n\n

rsync -ravz source_directory destination_dir<\/em><\/p>\n\n\n\n

If you are logging in from offsite, you can log in through rsync. For instance:<\/p>\n\n\n\n

rsync -ravz user@bcsb-cnx.als.lbl.gov:\/data\/etc\/ destination_dir<\/em><\/p>\n\n\n\n

where \/data\/etc is your directory with processed data, and destination is the directory you want the data to be stored in.<\/p>\n\n\n\n

SCP<\/strong><\/h3>\n\n\n\n

FROM THE ALS, data may be scp\u2019ed from your user account by typing:<\/p>\n\n\n\n

scp -pr datadirectory username@destination:\/datadirectory<\/em><\/p>\n\n\n\n

where destination is the name of your home institution computer.<\/p>\n\n\n\n

EXAMPLE: scp -pr \/data\/bl502\/arnold ArnoldS@hollywood.edu:\/arnold\/awesomedata<\/em><\/p>\n\n\n\n

NOTE: The -r is for recursive, so that a directory and all its contents are copied, while the -p preserves the original date on the file. At home, you can then type ls -Flart *.img to list the image files in the order in which they were taken. If you want to copy a single file or several files, use:<\/p>\n\n\n\n

scp -p filename username@destination:\/datadirectory<\/em> (or *.img in place of the filename)<\/p>\n\n\n\n

To SCP FROM OFFSITE, log onto the download machine by typing one of the following commands:<\/p>\n\n\n\n

ssh username@bcsb-cnx.als.lbl.gov<\/em><\/p>\n\n\n\n

You will be logged into your home directory so you can scp processed data directly. For raw images you must go to the directory that corresponds to the beamline at which you collected your data. For example, type cd \/data\/bl822\/yourdata. Once in the correct directory you can scp as indicated above.<\/p>\n\n\n\n

Alternatively, you can pull data data in from your remote location with scp:<\/p>\n\n\n\n

scp -r username@bcsb-cnx.als.lbl.gov:\/data\/bl???\/directory\/where\/the\/data\/is<\/em> .
(don\u2019t forget the \u201c.\u201d at the end of the command \u2013 this indicates to put the data in the current directory, where you ran the scp command)<\/p>\n\n\n\n

FTP<\/strong><\/h3>\n\n\n\n

First, tar your image files using the command tar -cvf name.tar directory where directory is the directory full of processed data.<\/p>\n\n\n\n