New Python-based methods for data processing
Nicholas K. Sauter, Johan Hattne, Ralf W. Grosse‐Kunstleve et al. · Acta Crystallographica Section D Biological Crystallography · 2013
Current pixel-array detectors produce diffraction images at extreme data rates (of up to 2 TB h(-1)) that make severe demands on computational resources. New multiprocessing frameworks are required to achieve rapid data analysis, as it is important to be able to inspect the data quickly in order to guide the experiment in real time. By utilizing readily available web-serving tools that interact with the Python scripting language, it was possible to implement a high-throughput Bragg-spot analyzer (cctbx.spotfinder) that is presently in use at numerous synchrotron-radiation beamlines. Similarly, Python interoperability enabled the production of a new data-reduction package (cctbx.xfel) for serial femtosecond crystallography experiments at the Linac Coherent Light Source (LCLS). Future data-reduction efforts will need to focus on specialized problems such as the treatment of diffraction spots on interleaved lattices arising from multi-crystal specimens. In these challenging cases, accurate modeling of close-lying Bragg spots could benefit from the high-performance computing capabilities of graphics-processing units.
Cited by 114 works. doi:10.1107/s0907444913000863 Open-access PDF
Authors
References
- OLEX2 : a complete structure solution, refinement and analysis program
- PHENIX : a comprehensive Python-based system for macromolecular structure solution
- An optimal algorithm for approximate nearest neighbor searching fixed dimensions
- Overview of the CCP 4 suite and current developments
- A Survey of General‐Purpose Computation on Graphics Hardware
- Scaling and assessment of data quality
- Programming Massively Parallel Processors: A Hands-on Approach
- TheComputational Crystallography Toolbox: crystallographic algorithms in a reusable software framework
- Femtosecond X-ray protein nanocrystallography
- Version Control with Subversion