MSI Facilities Statement (Short Version)

PDF version

The Minnesota Supercomputing Institute (MSI) is the University of Minnesota's principal center for computational research. Its main data center is located in the basement of Walter Library (room B40) on the U of M Twin Cities campus. It has an IT raised floor surface of approximately 3700 sq.ft. and over 1 MW of available power. The Institute HPC systems are composed of over 90,000 x86 64-bit compute cores, NVIDIA GPUs, and 500 TB of RAM, which can support over 6 double-precision PFLOPS of peak performance. HPC nodes are connected via Infiniband and are equipped with between 64 GB and 2 TB of RAM to support applications that require small and large amounts of memory, all nodes have local scratch drives, and 83 nodes include various configurations of the NVIDIA general purpose GPU accelerators (V100, A100), from 2- to 8-way.

In addition to the supercomputing systems, MSI also supports on-premise cloud platforms for specialized data use agreements, prototyping, and customizable software environments, interfaces and systems for advanced scientific visualization, and interactive computing 80 GPUs dedicated for interactive use. MSI manages three active storage systems: a high-performance all-flash file system (2 PB), a hybrid ssd/hdd high performance parallel file system (9 PB), and a CEPH-based object storage system (12 PB). MSI also partners with other campus providers to support disaster recovery and cold storage using a SpectraLogic Tfinity tape library with expansion capabilities for over 100 PB of storage. The data center is connected to the 100 Gbps campus research network via multiple 40 GbE connections. The University maintains 100 Gbps connections to our regional optical network, which in turn is connected to Internet2 and beyond. MSI provides the infrastructure and expertise to the greater University of Minnesota System. In addition to the diverse systems, more than half of the MSI staff are available to provide expert consulting in areas such as research informatics, software development, and algorithm optimization.

MSI is home to 31 research informatics staff (25 Ph.D. level) who work to foster and accelerate computational research across the University of Minnesota System in all scholarly pursuits by providing informatics services and consultations. Some consultation services are conducted in close collaboration with U of M-based high-throughput core facilities including genomics, metagenomics, optical and electron microscopy, small animal imaging, neuroimaging, material science and mass spectrometry. Informatics staff also provide consulting services and tutorials in the areas of high-performance computing, high-throughput computing, data management, and specific application support. In addition to the general support, many of the informatics staff are associated with long-term partnerships to provide dedicated informatics consulting services to specific departments.

MSI Facilities Statement (Extended Version)

PDF version

Established in 1983, the Minnesota Supercomputing Institute (MSI) is the University of Minnesota's principal center for computational and data intensive research. MSI provides services to over 900 active groups that sponsor more than 4,500 unique users from 19 different university colleges, maintaining an array of systems dedicated to the computational and data intensive research needs of investigators in the state of Minnesota's higher education institutions and their collaborators.

Established in 1983, the Minnesota Supercomputing Institute (MSI) is the University of Minnesota's principal center for computational and data intensive research. MSI provides services to over 900 active groups that sponsor more than 4,500 unique users from 19 different university colleges, maintaining an array of systems dedicated to the computational and data intensive research needs of investigators in the state of Minnesota's higher education institutions and their collaborators.

High Performance Computing

MSI's High Performance Computing (HPC) systems are designed with high speed networks, high performance storage, GPUs, and large amounts of memory to support some of the most compute and memory intensive programs developed today. MSI's HPC systems are composed of over 90,000 x86 64-bit compute cores and 500 TB of RAM, which can support over 6 double-precision PFLOPS of peak performance. HPC nodes are equipped with between 64 GB and 2 TB of RAM to support applications that require small and large amounts of memory, all nodes have local scratch drives, and 83 nodes include various configurations of the NVIDIA general purpose GPU accelerators (V100, A100), from 2- to 8-way.

Interactive Computing and Scientific Visualization

In collaboration with the Laboratory of Computational Science and Engineering, MSI supports a visualization laboratory. The Lab can accommodate up to 24 people and is located in the same building as MSI. MSI also supports Open OnDemand for web-based interfaces and hardware for remote visualization and interactive computing. Interactive HPC systems allow real-time user inputs to facilitate code development, real-time data exploration, and visualizations. Interactive HPC systems are used when data are too large to download to a desktop or laptop, software is difficult or impossible to install on a personal machine, or specialized hardware resources (e.g.; GPUs) are needed to visualize large datasets.

Cloud Computing

MSI supports an on-premise cloud computing platform built on OpenStack to support special data use agreements and to allow quick deployment of web, database, and other non-High Performance Computing systems. The virtual instances in this environment are available for a fee in a variety of sizes depending on the number of processors and the amount of memory and disk space required for the project.

Data Storage

All MSI researchers have access to two high-performance storage systems to support their research: a high-performance all-flash storage platform (2 PB), and a hybrid ssd/hdd high-performance parallel storage platform (9 PB) with sustained read and write speeds of up to 48 GB/sec. The integrity of the data is protected by daily snapshots and tape backups. High value datasets are backed up to an off-site facility as a part of the Institute's disaster recovery plan. MSI also supports a second-tier storage solution (12 PB) designed to address the growing need for resources that support data-intensive research. The system is tightly integrated with other MSI storage and computing resources in order to support a wide variety of research data life cycles and data analysis workflows and uses the standard S3 interface, so that researchers can better manage their data, more seamlessly share data with other researchers, and migrate entire data analysis pipelines to cloud-based platforms. Finally, MSI partners with other campus providers to support disaster recovery and cold storage using a SpectraLogic Tfinity tape library with expansion capabilities for over 100 PB of storage.

Data Centers, Network Connectivity, and Office Facilities

MSI enables interdisciplinary research through its robust data center facilities with over 1 MW of IT capacity to support leading edge computational and data storage systems. MSI supports two data centers, both of which are connected to the campus network with speeds up to 100 Gbps. Campus networks connect to our regional optical network and Internet2 at 100 Gbps giving our researchers the network capacity and capability needed to collaborate with researchers from around the world. Located in the Walter Library building, MSI office and data center space (~18,000 sq. ft) are centrally located on the Twin Cities campus in Minneapolis. MSI also maintains office spaces on the Twin Cities campus in St. Paul, where additional researchers are located. MSI also provides computer and teaching laboratories, which are primarily used for outreach and teaching workshops.

Research Informatics

MSI is home to 31 research informatics staff (25 Ph.D. level) who work to foster and accelerate computational research across the University of Minnesota System in all scholarly pursuits by providing informatics services and consultations. Some consultation services are conducted in close collaboration with U of M-based high-throughput core facilities including genomics, metagenomics, optical and electron microscopy, small animal imaging, neuroimaging, material science, and mass spectrometry. Informatics staff also provide consulting services and tutorials in the areas of high-performance computing, high-throughput computing, data management, and specific application support. In addition to the general support, many of the informatics staff are associated with long-term partnerships to provide dedicated informatics consulting services to specific department.

U-Spatial Facilities Statement

PDF Version

U-Spatial is nationally recognized as a leading model for how universities can successfully integrate spatial data, visualization, analysis, and spatial thinking. U-Spatial has supported over 2,000 researchers across 150 departments and centers through a help desk, training, consulting, and events. While we collaborate with large research centers and programs, U-Spatial seeks to serve researchers working in the so-called “long tail” of the scientific enterprise. These are often smaller projects that may not be able to support full-time spatial research staff, but with help from U-Spatial, cumulatively help to enable and advance the many missions of a land-grant university and offer disproportionately great benefits.

U-Spatial is home to 14 professional staff and three to six undergraduate and graduate student research assistants with expertise in geographic information systems (GIS), remote sensing, and spatial computing. Staff design and develop full stack solutions, which may include database hosting, as well as server and client-side applications such as web-based maps and decision support tools. Staff often leverage the Esri infrastructure for project development efforts, but are also skilled in drawing from open source solutions where projects would benefit from such an approach. U-Spatial co-supports with the U of M Libraries a Spatial Data Curator whose job it is to ensure that all spatial data contains full and appropriate metadata.

U-Spatial is physically located on two U of M campuses, the Twin Cities and Duluth. U-Spatial labs have dedicated desktop computers, and staff utilizes a robust centrally managed virtual infrastructure to provide its spatial software and databases. Dedicated development and database hosting options are available to U of M research for a reasonable cost. 

The University of Minnesota has an extensive site license with Esri (a leader in GIS software), which gives all students, faculty, and staff access to nearly all of Esri’s enterprise resources for teaching and research, including ArcGIS Online, desktop software, database software, and extensive data resources. Over 20,000 students, faculty and staff have an ArcGIS Online account through the University. U-Spatial provides and supports broad access to other geospatial applications including LAStools and Planet Imagery, and participates in the Open Geospatial Consortium and University Consortium for Geospatial Information Science.