{"id":128,"date":"2026-10-08T22:11:46","date_gmt":"2026-10-08T22:11:46","guid":{"rendered":"https:\/\/bcsb.als.lbl.gov\/?page_id=128"},"modified":"2026-10-08T22:15:27","modified_gmt":"2026-10-08T22:15:27","slug":"data-processing","status":"publish","type":"page","link":"https:\/\/bcsb.als.lbl.gov\/?page_id=128","title":{"rendered":"Data Processing"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\"><strong>Processing machines at the beamlines<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">For local data processing, several machines are available at the beamlines. They are named with a suffix of \u201ck\u201d. For instance, beamline 5.0.1 processing machines are bl501k1 and bl501k2.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Link to current site files <a href=\"https:\/\/bcsb.als.lbl.gov\/?page_id=130\" data-type=\"page\" data-id=\"130\" target=\"_blank\" rel=\"noopener\">here<\/a><\/strong><\/h3>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Automatic&nbsp;processing<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">All data collected on beamlines 5.0.1, 5.0.2, 5.0.3, 8.2.1 and 8.2.2 is automatically processed using both XDS and DIALS. The results show up in your data directory under new directories labeled XDS_yourdataname and DIALS_yourdataname. The XDS results should complete within 5 minutes of the end of your data collection. The DIALS results usually complete within 30 minutes. Please note that since these results are in your data directory, they will be automatically deleted two weeks after your run. Be sure to back up the autoprocessed folders along with your data, if you want to keep the results.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The results are also available directly from the beamline b4 GUI. Open up the gui by typing <strong>b4<\/strong> at a terminal prompt at the beamline (or in your remote session.)&nbsp; In the b4 GUI, go to the Data tab, and the results from both XDS and DIALS are linked there.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Results can also be accessed through the b4 portal (<a href=\"https:\/\/buds.als.lbl.gov\/b4portal\">Here<\/a>).&nbsp; Enter your username and password and you will see a menu where you can access your data, autoprocessing, etc..:<\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img decoding=\"async\" src=\"https:\/\/bcsb.als.lbl.gov:8443\/wp-content\/uploads\/2019\/12\/Screen-Shot-2022-02-08-at-9.34.34-AM.png\" alt=\"\" class=\"wp-image-13351\" style=\"aspect-ratio:1.6;width:2560px;height:auto\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img decoding=\"async\" src=\"https:\/\/bcsb.als.lbl.gov:8443\/wp-content\/uploads\/2019\/12\/Screen-Shot-2022-02-08-at-9.35.43-AM.png\" alt=\"\" class=\"wp-image-13354\" style=\"aspect-ratio:1.6;width:2560px;height:auto\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Click <a href=\"https:\/\/bcsb.als.lbl.gov:8443\/wordpress\/?page_id=11404\" target=\"_blank\" rel=\"noopener\">HERE<\/a>&nbsp;for more details about the autoprocessing \u2013 how it works and the files generated.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Remote processing<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">To process data remotely, you may log in anytime to bcsb-cnx.als.lbl.gov or bcsb-nx.als.lbl.gov using the NX remote desktop client and your BCSB user credentials. Click <a href=\"https:\/\/bcsb.als.lbl.gov:8443\/wordpress\/?page_id=386\">here<\/a> for information on logging in remotely.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Using HKL2000 At The Beamline or Remotely<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">PLEASE NOTE: The&nbsp;HKL license for beamlines 5.0.1 an 5.0.2 is only available on our bcsb-cnx machine, and only for users who have already purchased a license directly from HKL Research.&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Log on to one of the processing machines using your account.<\/li>\n\n\n\n<li>Open up a terminal window and type HKL2000 (You must do this from your home directory, not the data directory).<\/li>\n\n\n\n<li>Under the Directory Tree (the data page of HKL2000), click down to your data. For example: \/data\/bl822\/corie\/lyso.<\/li>\n\n\n\n<li>Select the double arrow key (&gt;&gt;) to read the directory path into the Raw Data Directory field.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Note that if you collected binned images you need to click the \u201cbinned\u201d button on the main page under other options. License information and manual (pdf) can be found on the&nbsp; <a href=\"http:\/\/www.hkl-xray.com\/\">HKL-xray<\/a>&nbsp;website.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Using Mosflm At The Beamline or Remotely<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Log on to one of the processing machines using your account.<\/li>\n\n\n\n<li>Open up a terminal window and type imosflm (You must do this from your home directory, not the data directory).<\/li>\n\n\n\n<li>Navigate to the data directory to point mosflm to the images.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>A Note on the Beam Center<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Currently, the beam center is written to the .img files in the adxv format. The beam center as written on the hutch page in b3 is in denzo\/mosflm format, and these numbers should be correct in the prep scripts. If you do need to enter the numbers manually, you can convert the adxv format to the mosflm\/denzo format as follows:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">mosflm x = 315 \u2013 adxv y<br>mosflm y = adxv x<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Using 2-theta in HKL2000<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">First find the new direct beam position. You can do this one of two ways:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>(the easy, less accurate way): Estimate the beam center by looking at the beamstop shadow on the image. Enter the values in the \u201cBeam position\u201d pop-up from the Index\/Refinement page.<\/li>\n\n\n\n<li>(the harder, more accurate way): Take a powder diffraction image and find the exact beam center using the program Fit2d. (Staff can help with this)<\/li>\n\n\n\n<li>Put the 2-theta value in the \u201cRotation X\u201d under the \u201cSite Configuration\u201d menu.<\/li>\n\n\n\n<li>Calculate the number cos(2-theta). This is a correction to the detector distance. Add this to the detector distance used and input the value in the main page of HKL2000.<\/li>\n\n\n\n<li>Proceed with processing as usual.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Using 2-theta in Mosflm<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">First find the new direct beam position. You can do this one of two ways:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>(the easy, less accurate way): Estimate the beam center by looking at the beamstop shadow on the image. Enter the values in the \u201cDirect X beam\u201d and \u201cDirect Y beam\u201d on the main window. Note: you can also enter these values using the keywords \u201cbeam swung_out x y\u201d.<\/li>\n\n\n\n<li>(the harder, more accurate way): Take a powder diffraction image and find the exact beam center using the program Fit2d. (Staff can help with this). Enter the values in the \u201cDirect X beam\u201d and \u201cDirect Y beam\u201d on the main window.<\/li>\n\n\n\n<li>Enter the value of -(2theta) on the main page. For example, if your 2theta is 5, you will enter -5 (a negative number)<\/li>\n\n\n\n<li>Proceed with processing as usual.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Prep scripts<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The prep scripts copy files that can be modified in any text editor and then used as input files to the software of interest. You must edit items such as the directory path, name of the first filename you wish to analyze and various other parameters, such as wavelength, beam center, etc.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">denzoprep&nbsp;creates the files:&nbsp;auto.dat, &nbsp;batch.com, and&nbsp;scale.com<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">mosflmprep&nbsp;creates the files:&nbsp;index.inp, &nbsp;strategy.help<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">solveprep&nbsp;creates the files:&nbsp;add_solve.txt (add on more sites),&nbsp;analyze_solve.txt (input heavy atom sites that are known),&nbsp;ccp4_mir.txt (for ccp4 .mtz files), &nbsp;ccp4_mad.txt (for ccp4 .mtz files)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Processing machines at the beamlines For local data processing, several machines are available at the beamlines. They are named with a suffix of \u201ck\u201d. For instance, beamline 5.0.1 processing machines are bl501k1 and bl501k2. Link to current site files here Automatic&nbsp;processing All data collected on beamlines 5.0.1, 5.0.2, 5.0.3, 8.2.1 and 8.2.2 is automatically processed&hellip; <a class=\"more-link\" href=\"https:\/\/bcsb.als.lbl.gov\/?page_id=128\">Continue reading <span class=\"screen-reader-text\">Data Processing<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-128","page","type-page","status-publish","hentry","entry"],"_links":{"self":[{"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/pages\/128","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=128"}],"version-history":[{"count":2,"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/pages\/128\/revisions"}],"predecessor-version":[{"id":133,"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=\/wp\/v2\/pages\/128\/revisions\/133"}],"wp:attachment":[{"href":"https:\/\/bcsb.als.lbl.gov\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=128"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}