Research Data Storage

Research Data Storage provides large-scale networked attached access to research data from a variety of endpoints: compute cluster, instrument workstations, laptops, etc. Various storage types are typically designed for specific I/O (literally data in/out) needs that stems from raw data collection, data processing and analysis, data transfer and sharing, data preservation and archiving. These storage types usually have different data retention and replication policies as well. For information related to the security level required for the data being stored, please refer to the Data Security page.

Eligibility information is outlined below based on providers with offerings that are available to the entire Harvard community or a specific unit/appointment. 

University-wide

Faculty of Arts and Sciences, Research Computing

DATA STORAGE TIER 0: SCRATCH/TEMP

FASRC Features: High-performance, temporary, single copy, network attached to cluster via (Lustre/NFS), quota (files + size), 90-day retention policy.
Mount point: /n/scratchlfs Quota: 50TB max per lab

DATA STORAGE TIER 1: HOME DIRECTORIES

FASRC Features: Regular performance, snapshot, DR copy, network attached to cluster via (NFS), quota, SMB
Mount point: /home/username
Quota: 100GB

DATA STORAGE TIER 2: LAB/PROJECT SHARE

FASRC Features: Regular performance, object store, snapshot, DR copy, network attached to cluster, SMB
Mount point: /n/pi_lab
Quota: 4TB, with more available for purchase

DATA STORAGE TIER 3: ATTIC STORAGE

FASRC Features: Low performance, object store, snapshot, single copy, network attached to cluster, SMB

Audience

All PIs with an active FASRC account from any Harvard School

Service Provider

FASRC

Service Fee

TBD

Service Website

https://docs.rc.fas.harvard.edu/kb/cluster-storage/

Contact Information

Contact Brian White at rchelp@rc.fas.harvard.edu 

Institute for Quantitative Social Sciences

DATA STORAGE TIER 0:  SCRATCH/TEMP

Features: Local server storage  
Mount point: /tmp  
Quota: as much as available on a per-server basis  
Cost: Free  

DATA STORAGE TIER 1: HOME DIRECTORIES

Features:  Network attached to cluster (NFS)  
Mount point: /nfs/home/username  
Quota: 50 GB  
Cost: Free  

DATA STORAGE TIER 2: LAB/PROJECT SHARE

Features: Network attached to cluster (NFS)  
Mount point: /nfs/projects{_ci3}{_nobackup}/project_name  
Quota: 50 GB, by default, can be increased up to 10s of TBs by request and available resources   
Cost: Free  

DATA STORAGE TIER 3: BACKUP STORAGE 

Features: Low performance, remote encrypted disk storage  
Cost: Free for home directories and smaller (< 1 TB) project spaces; $0.05/GB per month for larger project spaces  

Audience

Social science researchers at Harvard and MIT 

Service Provider

IQSS

Service Fee

  • Tier 0: Free
  • Tier 1: Free
  • Tier 2: Free
  • Tier 3: Free for home directories and smaller (< 1 TB) project spaces; $0.05/GB per month for larger project spaces  

Service Website

https://www.iq.harvard.edu/research-computing

Contact Information

help@iq.harvard.edu

Unit/Appointment-specific

Harvard Business School

DATA STORAGE TIER 0: SCRATCH/TEMP

HBS Features: Network attached to cluster via (NFS), quota (files + size), 30-day retention policy.
Mount point: /export /scratch
Quota: 5TB per group

DATA STORAGE TIER 1: HOME DIRECTORIES

HBS Features: Regular performance, Snapshot, DR copy, network attached to cluster (NFS), quota
Mount point: /export/home/username
Quota: 100GB

DATA STORAGE TIER 2: LAB/PROJECT SHARE

HBS Features: Regular performance, object store, Snapshot, DR copy, network attached to cluster (NFS)
Mount point: /export/projects/projectname
Quota: Negotiated

Audience

Policies are currently being developed to define what services classes of researchers are entitled to

Service Provider

HBS RCS

Service Fee

TBD

Service Website

https://grid.rcs.hbs.org/ 

Contact Information

research@hbs.edu  

Harvard Medical School

All storage is setup with a minimum RAID/6 resiliency or similar via declustered RAID.  
 

DATA STORAGE TIER 0: SCRATCH/TEMP

HMS Features: High-performance, temporary, single copy, network attached to cluster via (Lustre/NFS), quota (files + size), 30-day retention policy
Mount point: /n/scratch3
Quota: 10TiB per Lab

DATA STORAGE TIER 1: HOME DIRECTORIES

HMS Features: Regular performance, Snapshot, DR copy, network attached to cluster via (NFS), quota
Mount point: /home/username
Quota: 100GiB

Lab/project shares (HMS)

Features: Regular performance, Snapshot, DR copy, network attached to cluster via (NFS), quota
Mount point: /n/data1, /n/data2, /n/groups
Quota: Negotiated

Lab/project share with no DR (HMS)

Features: Regular performance, Snapshot, single copy, network attached to cluster via (NFS), quota
Mount point: /n/no_backup2
Quota: Negotiated

End point accessible (laptops/desktops/instruments): User defined collaborations (HMS)

Features: Regular performance, Snapshot, DR copy, network accessible, SMB, quota
Share: \\research.files.med.harvard.edu
Quota: Dept. level quota

DATA STORAGE TIER 2: LAB/PROJECT SHARE

HMS Features: Regular performance, object store, Snapshot, DR copy, network attached to cluster via SMB
Mount point: Integrated into Tier 1 mount points
Quota: Lab level quota

DATA STORAGE TIER 3: TBD

HMS Features: Low performance, object store, snapshot, single copy, network attached to cluster, SMB  

Audience

Policies are currently being developed to define what services classes of researchers are entitled to

Service Provider

HMS

Service Fee

TBD

Service Website

https://it.hms.harvard.edu/our-services/research-computing/services/research-data-management 

Contact Information

Contact Jessica Pierce at rdmhelp@hms.harvard.edu