The National Renewable Energy Laboratory's (NREL's) high-performance computing (HPC) center operates the Peregrine and Gyrfalcon Mass Storage HPC systems in NREL's Energy Systems Integration Facility data center.
Peregrine is the ESIF High Performance Computing user facilty's flagship HPC capability. It is the largest HPC system in the world exclusively dedicated to advancing renewable energy and energy efficiency technologies. Peregrine has 6,912 Intel Xeon E5-2670 "SandyBridge" processors, 24,192 Intel Xeon E5-2695v2 "IvyBridge" processors and 27,648 Intel Xeon E5-2670v3 "Haswell" processors for a total of 58,752 Intel Xeon processors which provide a total of about 1.680 PetaFLOPS or quadrillion floating point calculations per second. Peregrine also has 576 Intel Phi many-core co-processors with an aggregate performance of about 582 TeraFLOPS. Peregrine is capable of 2.24 PetaFLOPS.
The system is a Linux cluster that uses a fast InfiniBand network to connect nodes. It has 2.25 Petabytes of disk space. It was designed and built by Hewlett-Packard Enterprise (HPE) and has an innovative warm water liquid cooling system that allows waste heat to be captured for reuse.
The Gyrfalcon Mass Storage System provides long-term data retention for the HPC environment. It is designed to keep the most frequently used data quickly accessible and to economically store data that is accessed less often, which is achieved by employing high-performance disks for the freshest working data and by moving older data to economical tape storage with the help of software algorithms, a large Oracle StorageTek robotic tape library, and a set of high-performance T10000C tape drives.
The system uses Oracle's QFS file system and SAM archiving software, which allows users to simply copy data to and from the file system without worrying about which tier the data is stored on. Data is dynamically migrated from tape to disk when a user accesses a file. The system provides more than 5 Petabytes disk and tape storage with an architecture that allows the capacity to be easily expanded at relatively low cost. Data are fully protected without external backups.