FAS Research Computing - Status Page

Holyoke Tier 2 NFS experiencing partial outage

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.
h-nfs11-p down
IdentifiedPartial outage
  • Update
    UTC
    Update

    The vendor has dispatched parts. The vendor has indicated that this may not get fixed until Monday, but the storage team is pressing them to accelerate that timeline. We will update here when we know more.

    Thanks for your understanding.

  • Update
    UTC
    Update

    After lengthy troubleshooting, h-nfs11-p is still down. The vendor is scheduling a datacenter visit for on-site repairs. We will update as we know more.

  • Identified
    UTC
    Identified

    Our engineers are diagnosing the root cause of the failure and are working with the vendor to troubleshoot further

    We are continuing to work on a fix for this incident.

  • Investigating
    UTC
    Investigating

    h-nfs11-p is currently down. The following shares are inaccessible on FASSE

    • ncf_cnl01

    • ncf_cnl02

    • ncf_cnl03

    • ncf_cnl04

    • ncf_gspdata

    • ncf_mri_l3

    • cnl05

    • cnl06

    • eldaief

    • ncf_apps

    • jcamprodon_lab_l3

    We are investigating this incident.

OCT4
Power work on row 7c October 4th 5pm - October 5th 5pm
Planned9:00 PM – October 05, 2026 at 9:00 PMUTC24 hours
  • Planned
    September 24, 2026 at 2:06 PMUTC
    Planned
    September 24, 2026 at 2:06 PMUTC

    MGHPCC will be upgrading power on Pod 7c Even Side on October 4th 5pm - October 5th 5pm. This necessitates idling half the nodes on that side of the pod. A blocking reservation has been put in place to accomplish this. No jobs will be canceled but users will notice degraded scheduling throughput due to half the nodes being closed in the following partitions:

    arguelles_delgado

    blackhole

    conroy

    davies

    desai

    doshi-velez

    dsouza

    eddy

    edwards

    geophysics

    giribet

    gpu_test

    hernquist

    huce_cascade

    huttenhower

    imasc

    jacobsen2

    janson_cascade

    janson

    ke

    lukin

    murphy

    nguyen

    ni_lab

    olveczky

    ortegahernandez

    pehlevan

    seas_compute

    shared

    shakhnovich

    tambe

    unrestricted

    vishwanath

    whipple

    xlin

    yin

    zon



OCT5
Monthly maintenance October 5th, 2026 9am-1pm.
Planned1:00 PM – 5:00 PMUTC4 hours
  • Planned
    September 24, 2026 at 1:54 PMUTC
    Planned
    September 24, 2026 at 1:54 PMUTC

    Our maintenance tasks should be completed between 9am-1pm.

    - CDU work continues until October 2nd 8am-5pm but will not affect running jobs or new jobs.

    Phase 1 is complete. See status page for timeline and affected partitions.

    ​- Power work on row 7c October 4th 5pm - October 5th 5pm. See status page for affected partitions.

    NOTICES:

    • VPN: The VPN will be cut over to new hardware on Sunday Sept. 27th. connections will drop and you will need to reconnect.

    • Training: Upcoming training from FASRC and other sources can be found on our Training Calendar. at https://www.rc.fas.harvard.edu/upcoming-training/

    • Status Page: You can subscribe to our status to receive notifications of maintenance, incidents, and their resolution at https://status.rc.fas.harvard.edu/ (click Get Updates for options).

    MAINTENANCE TASKS

    Cannon cluster will be paused during this maintenance?: YES
    FASSE cluster will be paused during this maintenance?: YES

    • Network maintenance 

      • Audience: Clusters (Cannon and FASSE)

      • Impact: The cluster will be paused during this work.
        Some network disruption may occur.

    • Login node reboots 

      • Audience: All login nodes

      • Impact: Login nodes will be unavailable until after maintenance

    • OOD/Open OnDemand reboots

      • Audience: All OOD users

      • Impact: OOD will be unavailable until after maintenance

    • Netscratch 90-day retention cleanup

      • Audience; All netscratch users

      • Update: Due to low space on netscratch, please note that retention cleanup will be run more frequently. We are reviewing our 90 day policy with a possible age reduction.

      • Impact: Files older than 90 days will be removed per our scratch policy. Please note that this cleanup can happen at any time, not just during maintenance.

    Thank you,
    FAS Research Computing
    https://docs.rc.fas.harvard.edu/
    https://www.rc.fas.harvard.edu/upcoming-training/



Operational

SLURM Scheduler - Cannon - Operational

Cannon Compute Cluster (Holyoke) - Operational

Boston Compute Nodes - Operational

GPU nodes (Holyoke) - Operational

seas_compute - Operational

Operational

SLURM Scheduler - FASSE - Operational

FASSE Compute Cluster (Holyoke) - Operational

Operational

Kempner Cluster CPU - Operational

Kempner Cluster GPU - Operational

Operational

FASSE login nodes - Operational

Operational

Cannon Open OnDemand - Operational

FASSE Open OnDemand - Operational

Partial outage

Netscratch (Global Scratch) - Operational

Home Directory Storage - Boston - Operational

Tape - (Tier 3) - Operational

Holylabs - Operational

Isilon Storage Holyoke (Tier 1) - Operational

Holystore01 (Tier 0) - Operational

HolyLFS04 (Tier 0) - Operational

HolyLFS05 (Tier 0) - Operational

HolyLFS06 (Tier 0) - Operational

Holyoke Tier 2 NFS - Partial outage

Holyoke Specialty Storage - Operational

holECS - Operational

Isilon Storage Boston (Tier 1) - Operational

BosLFS02 (Tier 0) - Operational

Boston Tier 2 NFS - Operational

CEPH Storage Boston (Tier 2) - Operational

Boston Specialty Storage - Operational

bosECS - Operational

Samba Cluster - Operational

Globus Data Transfer - Operational

Recent notices

Show history
Show history
For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu