ARC released a new cluster named Huckleberry in late 2017. The Huckleberry system, accessed at huckleberry1.arc.vt.edu, was installed with deep learning applications in mind. To this end, it consists of 14 IBM “Minsky” S822LC nodes and NVIDIA’s proprietary NVLink interconnect network. This system enables highly parallel and highly distributed workloads. IBM unveiled its deep learning AI toolkit called PowerAI alongside the launch of Minsky nodes that leverage CPUs linked to Power CPUs with NVLink making it possible to have high speed high performance computing. PowerAI is available under
/opt/DL in Huckleberry.
Each compute node on Huckleberry (i.e. IBM “Minsky” nodes) consists of :
- Two IBM Power8 with 10 cores, 8 threads per core and memory bandwidth 115gb/s per socket
- Four NVIDIA P100 GPUs advertised to have 21 teraFLOPS of 16-bit floating-point performance ideal for deep learning applications deliver high performance, massive parallelism
- NVIDIA’s NVLink technology which provides high bandwidth data transfers between CPUs and GPUs; an improvement over PCI-Express
- Mellanox EDR Infiniband (100 GB/s) interconnect used to connect compute nodes
The PowerAI toolkit contains Caffe, TensorFlow etc. which are optimized for the Power servers. IBM provides support for it as well.
While the rest of the clusters make use of the PBS batch systems, Huckleberry makes use of the Slurm batch system using the command
Individuals may request a Huckleberry account. Instructors can get set up class accounts for Huckleberry as well.
From any ARC login node, you can explore how to use ARC software by checking the directory /opt/examples
Details on the examples directory are in
The Winged Insect Exhibition is designed by students in Environmental Design and New Media course. Students created multiple virtual versions of The Winged Insects exhibition before holding the exhibition in the actual space. The 3D designs were developed with tools like Sketchup, Maya, and Blender to produce ISO-IEC standard X3D. The X3D version of the Exhibition allows for multi-stakeholder and multi-platform design presentations through Web3D and Immersive Hyper Cube experience.
Through the X3D version of Winged Insects exhibition in the Hyper Cube students experienced multiple prototypes and changed their design in the virtual space. This is the final design of The Winged Insects exhibition in the Cowgill Hall at Virginia Tech.
ARC is happy to announce the addition of 39 new GPU nodes to the NewRiver cluster. Each of these nodes is equipped with two Intel Xeon E5-2680v4 (Broadwell) 2.4GHz GPU (28 cores/node in all), 512 GB memory, and two NVIDIA P100 GPUs. Each GPU is capable of up to 4.7 TeraFLOPS of double-precision performance, so including CPU and GPU these nodes add over 400 TFLOPS of peak double-precision throughput to ARC’s resources.
Continue reading P100 GPU Nodes added to NewRiver
HPC Day Agenda
We are looking forward to seeing you at our Annual HPC Day event March 24 from 10am-5pm!
The event includes: a keynote by James Ahrens from LANL, a machine learning workshop, and faculty and student presentations.
Keynote: “Supercharging the Scientific Process Via Data Science at Scale”
Dr. James Ahrens is a senior research scientist at the Los Alamos National Laboratory (LANL). He is the founder and design lead of ParaView, a widely adopted visualization and data analysis package for large-scale scientific simulation data ( http://paraview.org). ParaView has had an extremely positive impact on the large-scale data analytic capabilities available to simulation scientists around the world. Dr. Ahrens graduated in 1989 with a B.S. in computer science from the University of Massachusetts and in 1996 with a Ph.D. in computer science from the University of Washington. At LANL, he is part of a data science team of twenty staff, postdocs and students. He is also a national leader of programmatic initiatives important to the United States Department of Energy’s National Nuclear Security Administration and Office of Science. Dr. Ahrens is the Data Analysis and Visualization lead for the U.S. Exascale Computing Project and the general chair for this year’s IEEE Scientific Visualization conference to be held in Phoenix, AZ in early October.
ARC member Nicholas Polys helped organize a session at the CHCI Workshop Technology on the Trail on March 2-3. The session “From Experience to Abstraction and Back Again” discussed the challenges and opportunities for citizen science, especially the use of uncertain data to build new scientific models. The event was covered with an article in the Roanoke Times!
Featuring sessions on big data workflows, data visualization, data publishing, and reproducible research practices, the 2017 Big Data Science Workshop will also incorporate a brainstorming/strategy session aimed at improving research workflows, a networking breakfast, and lightning talks.
ARC’s Nicholas Polys and Brian Marshall each presented. The event flyer is here:
Big Data Science Workshop
The Visionarium got a spot in the 2016 Hokie Halftime commercial, which aired during Virginia Tech’s first football game against Liberty University. Check us out and see what we have been up to recently! Go Hokies! https://www.youtube.com/watch?v=Jl9iL2a-pmw
Our last halftime spot was 2012 : https://www.youtube.com/watch?v=p8nER5wb6cA
ARC is happy to announce the release of a new cluster, named DragonsTooth, available at
dragonstooth1.arc.vt.edu. DragonsTooth is made up of 48 nodes, each equipped with:
- 2 x Intel Xeon E5-2680v3 (Haswell) 2.5 GHz 12-core CPU (same CPU as NewRiver)
- 256 GB 2133 MHz DDR4 memory for large-memory problems
- 4 x 480 GB SSD Hard Drives for fast local I/O ($TMPDIR)
- 806 GFlops/s theoretical double-precision peak
Continue reading New ARC Cluster: DragonsTooth