Modern Treasury - Notice history

All systems operational

Platform/API - Operational

Ledgers API - Operational

Push to Warehouse - Operational

Marketing Website - Operational

Notice history

Oct 2022

Elevated Error Rates
  • Resolved
    Resolved

    This issue was resolved.

  • Investigating
    Investigating

    We're experiencing an elevated level of API errors and are currently looking into the issue.

High API and application latencies
  • Resolved
    Resolved

    The issue is resolved and we've solved the underlying cause of the contention.

  • Monitoring
    Monitoring

    The issue is resolved and we've solved the underlying cause of the contention.

  • Identified
    Identified

    We have identified the cause of the contention. Working to mitigate and ultimately resolve this issue.

  • Investigating
    Investigating

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

We are experiencing API and UI issues due to database contention.
  • Resolved
    Resolved

    We have addressed the underlying database contention and will follow-up with further improvements to the system to prevent reoccurrence.

  • Identified
    Identified

    We have identified the issue inside our database.

  • Investigating
    Investigating

    We are experiencing API and UI issues due to database contention.

Modern Treasury UI temporarily unavailable
  • Resolved
    Resolved

    All services are operational and healthy.

  • Identified
    Identified

    We had deployed a bad commit which fails to render UI. This downtime did not affect API calls.

Sep 2022

An automated up-time check has failed. (False positive)
  • Resolved
    Resolved

    This automated check has been resolved. No customer was impacted.

  • Investigating
    Investigating

    We are in the process of changing the application and triggered a false positive alarm. No customer was impacted.

API outage due to load balancer misconfiguration
  • Resolved
    Resolved

    At 9:55 PM UTC, we recovered from 4 minutes outage due to load balancer misconfiguration. This incident has been resolved and services are now healthy to continue normal traffic.

  • Investigating
    Investigating

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

An automated up-time check has failed. (False Positive.)
  • Resolved
    Resolved

    The issue is determined to be related to the service degradation of our integration with Plaid. For more details, please see Observability issues in Development and Sandbox with potential increased API errors rates.

    The Modern Treasury production application and API are NOT impacted by this.

  • Investigating
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Partner Issue: app.moderntreasury.com is experiencing login issues
  • Resolved
    Resolved

    The authentication issue has been resolved by Auth0. Modern Treasury web application at app.moderntreasury.com is now fully functional.

  • Monitoring
    Monitoring

    `app.moderntreasury.com` is having authentication issues with Auth0. Some users may have trouble logging into the Modern Treasury web application. Our API, which does not depend on Auth0, remains 100% functional.

    For more information, please refer to the Auth0 status page: Elevated errors in Auth0.

Partial API and Application Outage
  • Resolved
    Resolved

    At around 9:22am PT on September 1, we were alerted about unexpected resource utilization across our system. For about 23 minutes, we experienced intermittent failures of API calls. Roughly 75% of incoming API calls failed.

  • Investigating
    Investigating

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

Aug 2022

High Application and API Latencies
  • Resolved
    Resolved

    We have resolved the underlying issue at the source of the latencies.

  • Monitoring
    Monitoring

    The high latencies have subsided. API performance is returning to normal. We are continuing to monitor.

  • Investigating
    Investigating

    We are currently investigating this incident.

    The previous incidents were automatically generated from one of our monitoring tools. We apologize for the numerous emails. The check had entered a middling state where it passed and then failed several times as the latency of the responses changed.

Partial API and Application Outage
  • Monitoring
    Monitoring

    We have implemented a fix and are monitoring our system for stability. More information will be provided as it becomes available.

  • Resolved
    Resolved

    At around 10:13 PT on Aug 3, a faulty database upgrade caused downtime on our application and API. For approximately 13 minutes (until 10:26 PT), a large amount of calls against Modern Treasury’s platform failed.

  • Investigating
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Aug 2022 to Oct 2022

Next