NVIDIA NIM Status · StatusForAI

MajorAug 10, 05:15 PM

Cloud Functions experiencing Deployment Failures (Partial outage)

Started: Mon, Aug 10, 2026, 02:19:04 PM
Updated: Mon, Aug 10, 2026, 05:15:44 PM
Resolved: Mon, Aug 10, 2026, 05:15:44 PM
Duration: 2h 56m

resolvedMon, Aug 10, 2026, 05:15:44 PM
This incident has been resolved.
monitoringMon, Aug 10, 2026, 03:02:44 PM
A fix has been applied and we are monitoring the service for stability.
investigatingMon, Aug 10, 2026, 02:19:04 PM
We are currently investigating an issue impacting new deployments for the Cloud Functions. Customers will not be able to deploy new functions or restart existing ones during the impact time. Other services, functionalities and existing deployments remain operational. There are currently no workarounds available. We will provide the next update once mitigated or sooner if any conditions change.

CriticalApr 29, 02:08 PM

Issues with Private Registry service

Started: Wed, Apr 29, 2026, 01:20:49 PM
Updated: Wed, Apr 29, 2026, 02:08:04 PM
Resolved: Wed, Apr 29, 2026, 02:08:04 PM
Duration: 47m

resolvedWed, Apr 29, 2026, 02:08:04 PM
Issues affecting the Private Registry service have been resolved and the service is operating normally.
monitoringWed, Apr 29, 2026, 01:24:54 PM
We are continuing to monitor for any further issues.
monitoringWed, Apr 29, 2026, 01:23:52 PM
A fix for the Private Registry service issues has been applied and we are monitoring the service for stability.
identifiedWed, Apr 29, 2026, 01:20:49 PM
The cause of issues with Private Registry service has been identified and a fix is being applied.

MajorApr 27, 01:57 PM

Issues with Core & Catalog service

Started: Mon, Apr 27, 2026, 12:47:59 PM
Updated: Mon, Apr 27, 2026, 01:57:24 PM
Resolved: Mon, Apr 27, 2026, 01:57:24 PM
Duration: 1h 9m

resolvedMon, Apr 27, 2026, 01:57:24 PM
Issues affecting the Core & Catalog service have been resolved and the service is operating normally.
monitoringMon, Apr 27, 2026, 01:06:47 PM
A fix for the Core & Catalog service issues has been applied and we are monitoring the service for stability.
identifiedMon, Apr 27, 2026, 01:06:17 PM
The cause of issues with Core & Catalog service has been identified and a fix is being applied.
investigatingMon, Apr 27, 2026, 12:47:59 PM
The Core & Catalog service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorMar 11, 02:19 AM

Issues with NGC Catalog service

Started: Wed, Mar 11, 2026, 02:06:49 AM
Updated: Wed, Mar 11, 2026, 02:19:28 AM
Resolved: Wed, Mar 11, 2026, 02:19:28 AM
Duration: 12m

resolvedWed, Mar 11, 2026, 02:19:28 AM
Issues affecting the NGC Catalog service have been resolved and the service is operating normally.
investigatingWed, Mar 11, 2026, 02:06:49 AM
Issues with NGC Catalog service are still being investigated. Further updates will be posted on this status page.

MajorMar 9, 07:57 AM

Issues with NGC Catalog service

Started: Mon, Mar 9, 2026, 02:13:16 AM
Updated: Mon, Mar 9, 2026, 07:57:14 AM
Resolved: Mon, Mar 9, 2026, 07:57:14 AM
Duration: 5h 43m

resolvedMon, Mar 9, 2026, 07:57:14 AM
Issues affecting the NGC Catalog service have been resolved and the service is operating normally.
monitoringMon, Mar 9, 2026, 07:07:46 AM
A fix for the NGC Catalog service issues has been applied and we are monitoring the service for stability.
identifiedMon, Mar 9, 2026, 03:34:49 AM
The cause of issues with NGC Catalog service has been identified and a fix is being applied.
investigatingMon, Mar 9, 2026, 02:13:16 AM
Issues with NGC Catalog service are still being investigated. Further updates will be posted on this status page.

CriticalFeb 17, 11:20 PM

Issues with NGC Core Services

Started: Tue, Feb 17, 2026, 10:13:46 PM
Updated: Tue, Feb 17, 2026, 11:20:27 PM
Resolved: Tue, Feb 17, 2026, 11:20:27 PM
Duration: 1h 6m

resolvedTue, Feb 17, 2026, 11:20:27 PM
Issues affecting the NGC Core Services has been resolved and the service is operating normally.
monitoringTue, Feb 17, 2026, 11:19:54 PM
We are continuing to monitor for any further issues.
monitoringTue, Feb 17, 2026, 10:14:16 PM
A fix for the NGC Core Services issues has been applied and we are monitoring the service for stability.
investigatingTue, Feb 17, 2026, 10:13:46 PM
The NGC Core Services are currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorJan 22, 11:07 PM

Cloud Functions Deployment Failures

Started: Thu, Jan 22, 2026, 10:14:41 PM
Updated: Thu, Jan 22, 2026, 11:07:32 PM
Resolved: Thu, Jan 22, 2026, 11:07:32 PM
Duration: 52m

resolvedThu, Jan 22, 2026, 11:07:32 PM
This incident is resolved, all cloud function deployments should be working as expected. Thank you for your patience.
identifiedThu, Jan 22, 2026, 10:14:41 PM
We are investigating an issue causing new Cloud Functions deployments to fail. There is no workaround right now and we are working on a fix. Existing deployed functions continue to run normally. Thank you for your patience.

MinorJan 22, 12:51 AM

Cloud Functions Elevated latencies and Error rate for gRPC connections

Started: Wed, Jan 21, 2026, 10:44:16 PM
Updated: Thu, Jan 22, 2026, 12:51:01 AM
Resolved: Thu, Jan 22, 2026, 12:51:01 AM
Duration: 2h 6m

resolvedThu, Jan 22, 2026, 12:51:01 AM
This incident has been resolved.
investigatingThu, Jan 22, 2026, 12:47:23 AM
We are continuing to investigate this issue.
investigatingWed, Jan 21, 2026, 11:06:04 PM
We are continuing to investigate this issue.
investigatingWed, Jan 21, 2026, 10:44:16 PM
Cloud Functions is experiencing elevated invocation errors and increased latency for some customers in US-west2, primarily due to gRPC connection timeouts. We’re actively mitigating and will provide updates as we restore full stability. Thank you for your patience.

NoneJan 9, 06:26 PM

Cloud Functions Deployment Failures

Started: Fri, Jan 9, 2026, 12:14:12 PM
Updated: Fri, Jan 9, 2026, 06:26:25 PM
Resolved: Fri, Jan 9, 2026, 06:26:25 PM
Duration: 6h 12m

resolvedFri, Jan 9, 2026, 06:26:25 PM
This incident has been resolved.
monitoringFri, Jan 9, 2026, 03:48:12 PM
We have implemented a fix and are monitoring the status. Thank you.
identifiedFri, Jan 9, 2026, 03:18:06 PM
We are in the process of applying a fix. Thank you.
identifiedFri, Jan 9, 2026, 12:14:12 PM
We have identified some Cloud Functions deployments are failing. Please bear with us as we address this issue. Thank you.

MinorDec 17, 06:50 AM

Cloud Functions Logs Outage

Started: Wed, Dec 17, 2025, 01:43:26 AM
Updated: Wed, Dec 17, 2025, 06:50:27 AM
Resolved: Wed, Dec 17, 2025, 03:14:37 AM
Duration: 1h 31m

resolvedWed, Dec 17, 2025, 03:14:37 AM
This incident is now resolved and closed. During the impact window, log visibility and observability for affected workflows were partially reduced. We apologize for any inconvenience this may have caused.
investigatingWed, Dec 17, 2025, 01:43:26 AM
We are experiencing an outage affecting logs reporting for Cloud Functions across all regions. This may result in monitoring dashboards showing stale or missing data. Please bear with us as we address this. Thank you.

MajorDec 5, 07:48 PM

Cloud Functions Metrics Outage

Started: Fri, Dec 5, 2025, 07:22:21 PM
Updated: Fri, Dec 5, 2025, 07:48:43 PM
Resolved: Fri, Dec 5, 2025, 07:48:43 PM
Duration: 26m

resolvedFri, Dec 5, 2025, 07:48:43 PM
This incident has been resolved.
monitoringFri, Dec 5, 2025, 07:30:38 PM
A fix has been implemented and we are monitoring the results.
investigatingFri, Dec 5, 2025, 07:22:21 PM
We are experiencing an outage affecting metric reporting for Cloud Functions across all regions. This may result in monitoring dashboards showing stale or missing data. Please bear with us as we address this. Thank you.

MajorNov 15, 06:42 AM

Cloud Functions Deployment Failures

Started: Sat, Nov 15, 2025, 03:02:54 AM
Updated: Sat, Nov 15, 2025, 06:42:03 AM
Resolved: Sat, Nov 15, 2025, 06:42:03 AM
Duration: 3h 39m

resolvedSat, Nov 15, 2025, 06:42:03 AM
This incident has been resolved.
investigatingSat, Nov 15, 2025, 03:02:54 AM
Cloud Functions deployments are failing for some users. Please bear with us as we address this issue. Thank you.

MajorNov 14, 08:57 PM

Cloud Functions Deployment Failures

Started: Fri, Nov 14, 2025, 07:01:53 PM
Updated: Fri, Nov 14, 2025, 08:57:38 PM
Resolved: Fri, Nov 14, 2025, 08:57:38 PM
Duration: 1h 55m

resolvedFri, Nov 14, 2025, 08:57:38 PM
This incident has been resolved.
investigatingFri, Nov 14, 2025, 07:01:53 PM
Cloud Functions deployments are failing for some users. Please bear with us as we address this issue. Thank you.

MajorNov 6, 11:57 PM

Cloud Functions Metrics Outage

Started: Thu, Nov 6, 2025, 11:39:04 PM
Updated: Thu, Nov 6, 2025, 11:57:50 PM
Resolved: Thu, Nov 6, 2025, 11:57:50 PM
Duration: 18m

resolvedThu, Nov 6, 2025, 11:57:50 PM
This incident has been resolved.
monitoringThu, Nov 6, 2025, 11:43:02 PM
A fix has been implemented and we are monitoring the results.
identifiedThu, Nov 6, 2025, 11:39:47 PM
The issue has been identified and a fix is being implemented.
investigatingThu, Nov 6, 2025, 11:39:04 PM
We are experiencing an outage affecting metric reporting for Cloud Functions across all regions. This may result in monitoring dashboards showing stale or missing data. Please bear with us as we address this. Thank you.

MajorOct 31, 08:23 AM

Cloud Functions - Metrics Outage

Started: Thu, Oct 30, 2025, 10:41:54 PM
Updated: Fri, Oct 31, 2025, 08:23:25 AM
Resolved: Fri, Oct 31, 2025, 08:23:25 AM
Duration: 9h 41m

resolvedFri, Oct 31, 2025, 08:23:25 AM
This incident has been resolved.
identifiedFri, Oct 31, 2025, 01:59:52 AM
The issue has been identified and a fix is being implemented.
investigatingThu, Oct 30, 2025, 10:41:54 PM
We are experiencing an outage affecting metric reporting for Cloud Functions across all regions. This may result in monitoring dashboards showing stale or missing data. Please bear with us as we address this. Thank you.

MinorOct 20, 11:53 PM

Cloud Functions Increased Latency

Started: Mon, Oct 20, 2025, 09:55:17 AM
Updated: Mon, Oct 20, 2025, 11:53:07 PM
Resolved: Mon, Oct 20, 2025, 11:53:07 PM
Duration: 13h 57m

resolvedMon, Oct 20, 2025, 11:53:07 PM
This incident has been resolved.
monitoringMon, Oct 20, 2025, 11:42:58 PM
A fix has been implemented and we are monitoring the results.
identifiedMon, Oct 20, 2025, 09:55:17 AM
Cloud Functions is experiencing increased latency due to an ongoing outage. We are working on minimizing the impact.

MinorOct 19, 05:33 AM

Cloud Functions Invocation Performance is Degraded for Some Customers

Started: Sun, Oct 19, 2025, 03:47:20 AM
Updated: Sun, Oct 19, 2025, 05:33:31 AM
Resolved: Sun, Oct 19, 2025, 05:33:31 AM
Duration: 1h 46m

resolvedSun, Oct 19, 2025, 05:33:31 AM
This incident has been resolved.
investigatingSun, Oct 19, 2025, 03:47:21 AM
Cloud Functions invocation performance is degraded for some customers. Please bear with us as we address this issue. Thank you.

MajorSep 30, 11:18 PM

Cloud Functions Elevated Rate of Errors

Started: Tue, Sep 30, 2025, 12:25:52 AM
Updated: Tue, Sep 30, 2025, 11:18:35 PM
Resolved: Tue, Sep 30, 2025, 11:18:35 PM
Duration: 22h 52m

resolvedTue, Sep 30, 2025, 11:18:35 PM
This incident has been resolved.
monitoringTue, Sep 30, 2025, 08:18:03 PM
A fix has been implemented and we are monitoring the results.
identifiedTue, Sep 30, 2025, 12:45:59 PM
We are continuing implementation of the fix, rate of errors will be elevated until completed. Please bear with us as we address this. Thank you.
identifiedTue, Sep 30, 2025, 02:26:09 AM
The issue has been identified and a fix is being implemented.
investigatingTue, Sep 30, 2025, 12:25:52 AM
Cloud Functions is experiencing an elevated rate of errors. Please bear with us as we address this. Thank you.

MajorAug 30, 05:10 AM

Cloud Functions Elevated Rate of Errors

Started: Sat, Aug 30, 2025, 03:56:13 AM
Updated: Sat, Aug 30, 2025, 05:10:48 AM
Resolved: Sat, Aug 30, 2025, 05:10:48 AM
Duration: 1h 14m

resolvedSat, Aug 30, 2025, 05:10:48 AM
This incident has been resolved.
monitoringSat, Aug 30, 2025, 04:32:54 AM
A fix has been implemented and we are monitoring the results.
identifiedSat, Aug 30, 2025, 04:12:05 AM
The issue has been identified and a fix is being implemented.
investigatingSat, Aug 30, 2025, 03:56:13 AM
Cloud Functions is experiencing an elevated rate of errors. Please bear with us as we address this. Thank you.

CriticalAug 25, 02:20 AM

Cloud Functions Elevated Rate of Errors

Started: Mon, Aug 25, 2025, 01:28:29 AM
Updated: Mon, Aug 25, 2025, 02:20:03 AM
Resolved: Mon, Aug 25, 2025, 02:20:03 AM
Duration: 51m

resolvedMon, Aug 25, 2025, 02:20:03 AM
This incident has been resolved.
monitoringMon, Aug 25, 2025, 01:51:12 AM
A fix has been implemented and we are monitoring the results.
identifiedMon, Aug 25, 2025, 01:30:33 AM
The issue has been identified and a fix is being implemented.
investigatingMon, Aug 25, 2025, 01:28:29 AM
Cloud Functions is experiencing an elevated rate of function invocation errors. Please bear with us as we address this. Thank you.

MinorAug 22, 01:12 PM

Cloud Functions Elevated Rate of Errors

Started: Fri, Aug 22, 2025, 08:05:50 AM
Updated: Fri, Aug 22, 2025, 01:12:36 PM
Resolved: Fri, Aug 22, 2025, 01:12:36 PM
Duration: 5h 6m

resolvedFri, Aug 22, 2025, 01:12:36 PM
This incident has been resolved.
monitoringFri, Aug 22, 2025, 10:55:02 AM
A fix has been implemented and we are monitoring the results.
investigatingFri, Aug 22, 2025, 08:05:50 AM
Cloud Functions is experiencing an elevated rate of errors for new function deployment or scaling. Please bear with us as we address this. Thank you.

MajorAug 12, 04:37 AM

Issues with multiple NGC Cloud services

Started: Mon, Aug 11, 2025, 07:55:15 PM
Updated: Tue, Aug 12, 2025, 04:37:52 AM
Resolved: Tue, Aug 12, 2025, 04:37:52 AM
Duration: 8h 42m

resolvedTue, Aug 12, 2025, 04:37:52 AM
This incident has been resolved.
monitoringTue, Aug 12, 2025, 03:50:50 AM
A fix for the NGC Cloud service issues has been applied and we are monitoring the service for stability.
identifiedTue, Aug 12, 2025, 03:43:47 AM
The cause of issues with NGC Cloud services have been identified and a fix is being applied.
investigatingMon, Aug 11, 2025, 08:22:09 PM
We are continuing to investigate this issue.
investigatingMon, Aug 11, 2025, 07:55:15 PM
Multiple NGC Cloud services are currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MajorJul 17, 09:41 PM

Issues with Fleet Command service

Started: Thu, Jul 17, 2025, 04:01:02 PM
Updated: Thu, Jul 17, 2025, 09:41:02 PM
Resolved: Thu, Jul 17, 2025, 09:41:02 PM
Duration: 5h 39m

resolvedThu, Jul 17, 2025, 09:41:02 PM
Issues affecting the Fleet Command service have been resolved and the service is operating normally.
monitoringThu, Jul 17, 2025, 06:26:41 PM
A fix for the Fleet Command service issues has been applied and we are monitoring the service for stability.
identifiedThu, Jul 17, 2025, 05:06:54 PM
The cause of issues with Fleet Command service has been identified and a fix is being applied.
investigatingThu, Jul 17, 2025, 04:01:03 PM
The Fleet Command service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorJun 10, 06:20 PM

Issues with NGC services

Started: Tue, Jun 10, 2025, 03:40:31 PM
Updated: Tue, Jun 10, 2025, 06:20:41 PM
Resolved: Tue, Jun 10, 2025, 06:20:41 PM
Duration: 2h 40m

resolvedTue, Jun 10, 2025, 06:20:41 PM
Issues affecting the NGC services have been resolved and the service is operating normally.
monitoringTue, Jun 10, 2025, 05:26:57 PM
We are continuing to monitor for any further issues.
monitoringTue, Jun 10, 2025, 05:22:57 PM
A fix for the NGC services issues has been applied and we are monitoring the service for stability.
identifiedTue, Jun 10, 2025, 04:44:39 PM
The cause of issues with NGC services have been identified and a fix is being applied.
investigatingTue, Jun 10, 2025, 03:40:31 PM
NGC services are currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

NoneMay 1, 12:32 PM

Cloud Functions Elevated Rate of Errors for Secrets Management

Started: Thu, May 1, 2025, 06:55:13 AM
Updated: Thu, May 1, 2025, 12:32:55 PM
Resolved: Thu, May 1, 2025, 12:32:55 PM
Duration: 5h 37m

resolvedThu, May 1, 2025, 12:32:55 PM
This incident has been resolved.
identifiedThu, May 1, 2025, 06:55:13 AM
Cloud functions is experiencing an elevated rate of errors for secrets management. Running functions may not pick up secrets updates. Impacted functions can be redeployed to resolve. Please bear with us as we address this. Thank you.

MajorMay 1, 03:00 AM

Issues with Aerial Omniverse Digital Twin service

Started: Wed, Apr 30, 2025, 11:16:41 PM
Updated: Thu, May 1, 2025, 03:00:50 AM
Resolved: Thu, May 1, 2025, 03:00:50 AM
Duration: 3h 44m

resolvedThu, May 1, 2025, 03:00:50 AM
Issues affecting the Aerial Omniverse Digital Twin service have been resolved and the service is operating normally.
monitoringThu, May 1, 2025, 02:59:47 AM
A fix for the Aerial Omniverse Digital Twin service issues has been applied and we are monitoring the service for stability.
identifiedThu, May 1, 2025, 02:58:48 AM
The cause of issues with Aerial Omniverse Digital Twin service has been identified and a fix is being applied.
identifiedThu, May 1, 2025, 02:57:41 AM
The cause of issues with Aerial Omniverse Digital Twin service has been identified and a fix is being applied.

MinorApr 25, 01:27 AM

Issues with Base Command service

Started: Thu, Apr 24, 2025, 10:14:57 PM
Updated: Fri, Apr 25, 2025, 01:27:03 AM
Resolved: Fri, Apr 25, 2025, 01:27:03 AM
Duration: 3h 12m

resolvedFri, Apr 25, 2025, 01:27:03 AM
Issues affecting the Base Command service have been resolved and the service is operating normally.
monitoringFri, Apr 25, 2025, 12:41:06 AM
A fix for the Base Command service issues has been applied and we are monitoring the service for stability.
identifiedThu, Apr 24, 2025, 11:28:35 PM
The cause of issues with Base Command service has been identified and a fix is being applied.
investigatingThu, Apr 24, 2025, 10:14:57 PM
The Base Command service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MajorApr 24, 10:13 PM

Issues with Private Registry service

Started: Thu, Apr 24, 2025, 06:48:40 PM
Updated: Thu, Apr 24, 2025, 10:13:46 PM
Resolved: Thu, Apr 24, 2025, 10:13:46 PM
Duration: 3h 25m

resolvedThu, Apr 24, 2025, 10:13:46 PM
Issues affecting the Private Registry service have been resolved and the service is operating normally.
monitoringThu, Apr 24, 2025, 07:40:26 PM
A fix for the Private Registry service issues has been applied and we are monitoring the service for stability.
identifiedThu, Apr 24, 2025, 07:02:05 PM
The cause of issues with Private Registry service has been identified and a fix is being applied.
investigatingThu, Apr 24, 2025, 06:48:40 PM
The Private Registry service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorApr 23, 04:45 PM

Cloud Functions Deployment Failures

Started: Wed, Apr 23, 2025, 10:59:21 AM
Updated: Wed, Apr 23, 2025, 04:45:11 PM
Resolved: Wed, Apr 23, 2025, 04:45:11 PM
Duration: 5h 45m

resolvedWed, Apr 23, 2025, 04:45:11 PM
This incident has been resolved.
identifiedWed, Apr 23, 2025, 11:10:48 AM
We have identified, that the issue is still ongoing. We are investigating it further.
monitoringWed, Apr 23, 2025, 10:59:21 AM
Multiple NVCF function deployment calls were recently failing with error 504 Gateway timeout to NGC API. We have implemented a fix and are monitoring the situation.

MinorApr 16, 04:47 PM

Cloud Functions Deployment Failures

Started: Wed, Apr 16, 2025, 02:15:53 PM
Updated: Wed, Apr 16, 2025, 04:47:21 PM
Resolved: Wed, Apr 16, 2025, 04:47:21 PM
Duration: 2h 31m

resolvedWed, Apr 16, 2025, 04:47:21 PM
This incident has been resolved.
monitoringWed, Apr 16, 2025, 04:36:58 PM
A fix has been implemented and we are monitoring the results.
investigatingWed, Apr 16, 2025, 02:15:53 PM
Multiple NVCF function deployment calls are failing with error 504 Gateway timeout to NGC API. Please bear with us as we investigate and address this issue. Thank you.

NoneFeb 20, 04:15 PM

Issues with NVCF metrics collection

Started: Thu, Feb 20, 2025, 03:37:25 PM
Updated: Thu, Feb 20, 2025, 04:15:12 PM
Resolved: Thu, Feb 20, 2025, 04:15:12 PM
Duration: 37m

resolvedThu, Feb 20, 2025, 04:15:12 PM
This incident has been resolved.
investigatingThu, Feb 20, 2025, 03:37:25 PM
We are currently investigating an issue with NVCF metrics visibility in NGC UI. Further updates will be posted on this status page.

MinorFeb 7, 07:41 PM

Issues with Private Registry service

Started: Fri, Feb 7, 2025, 06:51:44 PM
Updated: Fri, Feb 7, 2025, 07:41:51 PM
Resolved: Fri, Feb 7, 2025, 07:41:51 PM
Duration: 50m

resolvedFri, Feb 7, 2025, 07:41:51 PM
Issues affecting the Private Registry service have been resolved and the service is operating normally.
monitoringFri, Feb 7, 2025, 06:56:36 PM
A fix for the Private Registry service issues has been applied and we are monitoring the service for stability.
identifiedFri, Feb 7, 2025, 06:52:33 PM
The cause of issues with Private Registry service has been identified and a fix is being applied.
investigatingFri, Feb 7, 2025, 06:51:44 PM
The Private Registry service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorJan 22, 12:23 AM

Issues with NGC Core service

Started: Tue, Jan 21, 2025, 08:35:36 PM
Updated: Wed, Jan 22, 2025, 12:23:44 AM
Resolved: Wed, Jan 22, 2025, 12:23:44 AM
Duration: 3h 48m

resolvedWed, Jan 22, 2025, 12:23:44 AM
Issues affecting the NGC Core service have been resolved and the service is operating normally.
monitoringTue, Jan 21, 2025, 08:52:02 PM
A fix for the NGC Core service issues has been applied and we are monitoring the service for stability.
identifiedTue, Jan 21, 2025, 08:36:17 PM
The cause of issues with NGC Core service has been identified and a fix is being applied.
investigatingTue, Jan 21, 2025, 08:35:36 PM
The NGC Core service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorNov 22, 02:28 AM

Cloud Functions Elevated Rate of Errors for Some Customers

Started: Fri, Nov 22, 2024, 01:18:25 AM
Updated: Fri, Nov 22, 2024, 02:28:03 AM
Resolved: Fri, Nov 22, 2024, 02:28:03 AM
Duration: 1h 9m

resolvedFri, Nov 22, 2024, 02:28:03 AM
This incident has been resolved.
monitoringFri, Nov 22, 2024, 02:10:08 AM
A fix has been implemented and we are monitoring the results.
identifiedFri, Nov 22, 2024, 01:36:25 AM
The issue has been identified and a fix is being implemented.
investigatingFri, Nov 22, 2024, 01:18:25 AM
Cloud Functions is experiencing an elevated rate of errors for some customers. Please bear with us as we address this. Thank you.

CriticalOct 29, 05:16 AM

Issues with NGC Core Services

Started: Mon, Oct 28, 2024, 09:34:28 PM
Updated: Tue, Oct 29, 2024, 05:16:31 AM
Resolved: Tue, Oct 29, 2024, 05:16:31 AM
Duration: 7h 42m

resolvedTue, Oct 29, 2024, 05:16:31 AM
Issues affecting the NGC Core Services have been resolved and the service is operating normally.
monitoringMon, Oct 28, 2024, 10:52:26 PM
We are continuing to monitor for any further issues.
monitoringMon, Oct 28, 2024, 10:39:52 PM
A fix for the NGC Core Services service issues has been applied and we are monitoring the service for stability.
identifiedMon, Oct 28, 2024, 10:02:07 PM
The cause of issues with NGC Core Services has been identified and a fix is being applied.
investigatingMon, Oct 28, 2024, 09:34:28 PM
The NGC Core services are currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorOct 24, 07:20 PM

Cloud Functions Invocation Performance is Degraded for Some Customers

Started: Thu, Oct 24, 2024, 06:58:56 PM
Updated: Thu, Oct 24, 2024, 07:20:59 PM
Resolved: Thu, Oct 24, 2024, 07:20:59 PM
Duration: 22m

resolvedThu, Oct 24, 2024, 07:20:59 PM
This incident has been resolved.
monitoringThu, Oct 24, 2024, 07:08:44 PM
A fix has been implemented and we are monitoring the results.
identifiedThu, Oct 24, 2024, 07:07:53 PM
The issue has been identified and a fix is being implemented.
investigatingThu, Oct 24, 2024, 06:58:57 PM
Cloud Functions invocation performance is degraded for some customers. Please bear with us as we address this issue. Thank you.

CriticalOct 22, 04:01 AM

Cloud Functions Elevated Rate of Errors

Started: Tue, Oct 22, 2024, 03:12:39 AM
Updated: Tue, Oct 22, 2024, 04:01:16 AM
Resolved: Tue, Oct 22, 2024, 04:01:16 AM
Duration: 48m

resolvedTue, Oct 22, 2024, 04:01:16 AM
This incident has been resolved.
monitoringTue, Oct 22, 2024, 03:37:16 AM
A fix has been implemented and we are monitoring the results.
investigatingTue, Oct 22, 2024, 03:12:40 AM
Cloud Functions is experiencing an elevated rate of errors. Please bear with us as we address this. Thank you.

MinorOct 8, 12:27 AM

Cloud Functions Elevated Rate of Errors for Some Customers

Started: Mon, Oct 7, 2024, 09:01:51 PM
Updated: Tue, Oct 8, 2024, 12:27:49 AM
Resolved: Tue, Oct 8, 2024, 12:27:49 AM
Duration: 3h 25m

resolvedTue, Oct 8, 2024, 12:27:49 AM
This incident has been resolved.
monitoringMon, Oct 7, 2024, 10:26:08 PM
A fix has been implemented and we are monitoring the results.
investigatingMon, Oct 7, 2024, 09:01:51 PM
Cloud Functions is experiencing an elevated rate of errors for some customers. Please bear with us as we address this. Thank you.

MajorSep 26, 03:39 AM

Cloud Functions Capacity

Started: Wed, Sep 25, 2024, 08:21:50 PM
Updated: Thu, Sep 26, 2024, 03:39:13 AM
Resolved: Thu, Sep 26, 2024, 03:39:13 AM
Duration: 7h 17m

resolvedThu, Sep 26, 2024, 03:39:13 AM
This incident has been resolved.
monitoringThu, Sep 26, 2024, 01:27:45 AM
A fix has been implemented and we are monitoring the results.
identifiedWed, Sep 25, 2024, 09:31:50 PM
The issue has been identified and a fix is being implemented.
investigatingWed, Sep 25, 2024, 08:21:50 PM
There is a Cloud Functions capacity issue. Please bear with us as we address it. Thank you.

MinorSep 20, 11:03 PM

Cloud Functions Elevated Rate of Errors for Some Customers

Started: Fri, Sep 20, 2024, 08:12:44 PM
Updated: Fri, Sep 20, 2024, 11:03:40 PM
Resolved: Fri, Sep 20, 2024, 11:03:40 PM
Duration: 2h 50m

resolvedFri, Sep 20, 2024, 11:03:40 PM
This incident has been resolved.
monitoringFri, Sep 20, 2024, 10:38:38 PM
A fix has been implemented and we are monitoring the results.
identifiedFri, Sep 20, 2024, 08:34:29 PM
The issue has been identified and a fix is being implemented.
investigatingFri, Sep 20, 2024, 08:12:44 PM
Cloud Functions is experiencing an elevated rate of streaming errors for some customers. Please bear with us as we address this. Thank you.

MinorSep 5, 08:27 PM

Cloud Functions Invocation Performance is Degraded for Some Customers

Started: Thu, Sep 5, 2024, 05:42:16 PM
Updated: Thu, Sep 5, 2024, 08:27:44 PM
Resolved: Thu, Sep 5, 2024, 08:27:44 PM
Duration: 2h 45m

resolvedThu, Sep 5, 2024, 08:27:44 PM
This incident has been resolved.
monitoringThu, Sep 5, 2024, 07:05:09 PM
A fix has been implemented and we are monitoring the results.
identifiedThu, Sep 5, 2024, 06:50:56 PM
The issue has been identified and a fix is being implemented.
investigatingThu, Sep 5, 2024, 05:42:16 PM
Cloud Functions invocation performance is degraded for some customers. Please bear with us as we address this issue. Thank you.

MinorAug 31, 01:46 AM

Issues with NGC Core service

Started: Fri, Aug 30, 2024, 11:16:58 PM
Updated: Sat, Aug 31, 2024, 01:46:59 AM
Resolved: Sat, Aug 31, 2024, 01:46:59 AM
Duration: 2h 30m

resolvedSat, Aug 31, 2024, 01:46:59 AM
Issues affecting the NGC Core service have been resolved and the service is operating normally.
monitoringSat, Aug 31, 2024, 12:33:11 AM
A fix for the NGC Core service issues has been applied and we are monitoring the service for stability.
investigatingFri, Aug 30, 2024, 11:16:58 PM
The NGC Core service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

NoneAug 22, 01:54 PM

Cloud Functions Invocation Performance is Degraded

Started: Thu, Aug 22, 2024, 01:39:35 PM
Updated: Thu, Aug 22, 2024, 01:54:53 PM
Resolved: Thu, Aug 22, 2024, 01:54:53 PM
Duration: 15m

resolvedThu, Aug 22, 2024, 01:54:53 PM
This incident has been resolved.
investigatingThu, Aug 22, 2024, 01:39:35 PM
Cloud Functions invocation performance is degraded. Please bear with us as we address this issue. Thank you.

MinorJul 22, 11:00 PM

Cloud Functions Invocation Performance is Degraded for Some Customers

Started: Mon, Jul 22, 2024, 09:30:00 PM
Updated: Mon, Jul 22, 2024, 11:00:59 PM
Resolved: Mon, Jul 22, 2024, 09:30:00 PM
Duration: 0m

resolvedMon, Jul 22, 2024, 11:00:14 PM
Cloud Functions invocation performance was degraded for some customers resulting in queuing from 2:42 PM PDT to 3:27 PM PDT. This issue is resolved.

NoneJul 10, 07:59 PM

Cloud Functions Invocation Performance is Degraded

Started: Wed, Jul 10, 2024, 07:00:00 PM
Updated: Wed, Jul 10, 2024, 07:59:53 PM
Resolved: Wed, Jul 10, 2024, 07:00:00 PM
Duration: 0m

resolvedWed, Jul 10, 2024, 07:59:53 PM
Cloud Functions invocation performance was degraded from 12:15 PM PDT to 12:30 PM PDT due to an infrastructure failure. This issue is remediated.

CriticalJul 10, 06:42 AM

Issues with Base Command service

Started: Tue, Jul 9, 2024, 07:15:30 PM
Updated: Wed, Jul 10, 2024, 06:42:40 AM
Resolved: Wed, Jul 10, 2024, 06:42:40 AM
Duration: 11h 27m

resolvedWed, Jul 10, 2024, 06:42:40 AM
Issues affecting the Base Command service have been resolved and the service is operating normally.
monitoringTue, Jul 9, 2024, 07:33:04 PM
A fix for the Base Command service issues has been applied and we are monitoring the service for stability.
identifiedTue, Jul 9, 2024, 07:26:09 PM
The cause of issues with Base Command service has been identified and a fix is being applied.
investigatingTue, Jul 9, 2024, 07:15:30 PM
The Base Command service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MajorJul 3, 07:07 PM

Cloud Functions elevated rate of errors for some customers

Started: Wed, Jul 3, 2024, 04:06:30 PM
Updated: Wed, Jul 3, 2024, 07:07:53 PM
Resolved: Wed, Jul 3, 2024, 07:07:53 PM
Duration: 3h 1m

resolvedWed, Jul 3, 2024, 07:07:53 PM
This incident has been resolved.
monitoringWed, Jul 3, 2024, 06:46:04 PM
A fix has been implemented and we are monitoring the results.
investigatingWed, Jul 3, 2024, 06:25:02 PM
We are currently investigating this issue.
monitoringWed, Jul 3, 2024, 04:57:09 PM
A fix has been implemented and we are monitoring the results.
identifiedWed, Jul 3, 2024, 04:36:42 PM
The issue has been identified and a fix is being implemented.
investigatingWed, Jul 3, 2024, 04:06:30 PM
There is an elevated rate of errors for some customers. Please bear with us as we address this. Thank you.

MinorJul 3, 06:58 PM

Issues with Private Registry service

Started: Wed, Jul 3, 2024, 05:08:59 PM
Updated: Wed, Jul 3, 2024, 06:58:41 PM
Resolved: Wed, Jul 3, 2024, 06:58:41 PM
Duration: 1h 49m

resolvedWed, Jul 3, 2024, 06:58:41 PM
Issues affecting the Private Registry service have been resolved and the service is operating normally.
monitoringWed, Jul 3, 2024, 05:49:51 PM
A fix for the Private Registry service issues has been applied and we are monitoring the service for stability.
identifiedWed, Jul 3, 2024, 05:37:18 PM
The cause of issues with Private Registry service has been identified and a fix is being applied.
investigatingWed, Jul 3, 2024, 05:08:59 PM
The Private Registry service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorJul 3, 06:57 PM

Issues with NGC service

Started: Wed, Jul 3, 2024, 04:22:02 PM
Updated: Wed, Jul 3, 2024, 06:57:18 PM
Resolved: Wed, Jul 3, 2024, 06:57:18 PM
Duration: 2h 35m

resolvedWed, Jul 3, 2024, 06:57:18 PM
Issues affecting the NGC service have been resolved and the service is operating normally.
monitoringWed, Jul 3, 2024, 04:46:07 PM
A fix for the NGC service issues has been applied and we are monitoring the service for stability.
identifiedWed, Jul 3, 2024, 04:29:44 PM
The cause of issues with NGC service has been identified and a fix is being applied.
investigatingWed, Jul 3, 2024, 04:22:03 PM
The NGC service is currently experiencing issues which are affecting users. The issues are being actively investigated and updates will be posted on this status page.

MinorJul 1, 08:48 PM

Cloud Functions is queuing/invocation performance degraded

Started: Mon, Jul 1, 2024, 07:27:55 PM
Updated: Mon, Jul 1, 2024, 08:48:05 PM
Resolved: Mon, Jul 1, 2024, 08:48:05 PM
Duration: 1h 20m

resolvedMon, Jul 1, 2024, 08:48:05 PM
This incident has been resolved.
monitoringMon, Jul 1, 2024, 08:05:22 PM
A fix has been implemented and we are monitoring the results.
investigatingMon, Jul 1, 2024, 07:27:55 PM
There is queuing or invocation performance is degraded for Cloud Functions. Please bear with us as we address this issue. Thank you.

Overview

Components7

Incidents50

History 50

Cloud Functions experiencing Deployment Failures (Partial outage)

Issues with Private Registry service

Issues with Core & Catalog service

Issues with NGC Catalog service

Issues with NGC Catalog service

Issues with NGC Core Services

Cloud Functions Deployment Failures

Cloud Functions Elevated latencies and Error rate for gRPC connections

Cloud Functions Deployment Failures

Cloud Functions Logs Outage

Cloud Functions Metrics Outage

Cloud Functions Deployment Failures

Cloud Functions Deployment Failures

Cloud Functions Metrics Outage

Cloud Functions - Metrics Outage

Cloud Functions Increased Latency

Cloud Functions Invocation Performance is Degraded for Some Customers

Cloud Functions Elevated Rate of Errors

Cloud Functions Elevated Rate of Errors

Cloud Functions Elevated Rate of Errors

Cloud Functions Elevated Rate of Errors

Issues with multiple NGC Cloud services

Issues with Fleet Command service

Issues with NGC services

Cloud Functions Elevated Rate of Errors for Secrets Management

Issues with Aerial Omniverse Digital Twin service

Issues with Base Command service

Issues with Private Registry service

Cloud Functions Deployment Failures

Cloud Functions Deployment Failures

Issues with NVCF metrics collection

Issues with Private Registry service

Issues with NGC Core service

Cloud Functions Elevated Rate of Errors for Some Customers

Issues with NGC Core Services

Cloud Functions Invocation Performance is Degraded for Some Customers

Cloud Functions Elevated Rate of Errors

Cloud Functions Elevated Rate of Errors for Some Customers

Cloud Functions Capacity

Cloud Functions Elevated Rate of Errors for Some Customers

Cloud Functions Invocation Performance is Degraded for Some Customers

Issues with NGC Core service

Cloud Functions Invocation Performance is Degraded

Cloud Functions Invocation Performance is Degraded for Some Customers

Cloud Functions Invocation Performance is Degraded

Issues with Base Command service

Cloud Functions elevated rate of errors for some customers

Issues with Private Registry service

Issues with NGC service

Cloud Functions is queuing/invocation performance degraded

Details

Related in Coding LLMs