Forge.AI - No new documents are loaded – Incident details

All systems operational

Show current status

No new documents are loaded

ResolvedPartial outage12 hours 5 minutes

Affected

Anvil

Partial outage from 4:00 AM to 4:05 PM

Articles

Partial outage from 4:00 AM to 4:05 PM

  • ResolvedUTC

    The catchup job finished and all documents have been loaded.

  • MonitoringUTC

    The catchup job is currently running and is expected to complete before 11am (EST).

  • IdentifiedUTC

    It appears that the 3am (UTC) loader job "got stuck" and was still running as of this morning. We've manually killed it so normal operations can resume. The catchup job is currently running.

    Our monitoring catches jobs that fail, including jobs that fail because of a timeout. We are continuing to investigate the exact circumstances that lead to a job remaining in a running state without timing out.

  • InvestigatingUTC

    We are currently investigating this incident.