Modern Treasury - Notice history

All systems operational

Platform/API - Operational

Ledgers API - Operational

Compliance API - Operational

Push to Warehouse - Operational

Marketing Website - Operational

Notice history

Aug 2024

Elevated Reconciliation Delays
  • Resolved
    Resolved

    This incident has been resolved.

  • Update
    Update

    We are continuing to work on a fix for this incident. With the increased processing rate the reconciliation backlog should be processed ~1 hour.

  • Identified
    Identified

    We have identified and quarantined the issue. We are taking steps to increase our processing rate in order to process the reconciliation backlog.

Scheduled Maintenance: Push to Warehouse
  • Completed
    August 21, 2024 at 2:00 AM
    Completed
    August 21, 2024 at 2:00 AM
    Maintenance has completed successfully
  • In progress
    August 21, 2024 at 12:00 AM
    In progress
    August 21, 2024 at 12:00 AM
    Maintenance is now in progress
  • Planned
    August 21, 2024 at 12:00 AM
    Planned
    August 21, 2024 at 12:00 AM

    A Push to Warehouse maintenance window will take place per our regular schedule next week, on Tuesday 8/20, from 5 to 7 PM PST.


    We plan to make the following changes during this time:

    • Cease syncing ledger_transactions records with a ledgerable_type of PaymentOrderAttempt. New ledger_transactions records associated with a Modern Treasury Payment Order will have a ledgerable_type of PaymentOrder, and their respective ledgerable_id values will identify the relevant Payment Order. By default, this change will apply only to newly-synced records. Please contact Modern Treasury Support if you would like for us to re-sync historical ledger_transactions records to ensure they also reflect this change.

    • Cease syncing the ledger_account_balances table, which does not contain meaningful Ledger balance information. ledger_entries is and will remain authoritative with respect to account balances.

    • Perform a one-off resync of the payment_orders table, to address a bug that made it possible in rare cases for transaction_ids to become out-of-sync with our application database.

    • Add a transaction_id column to the incoming_payment_details table, and perform a one-off re-sync of the table to ensure the field is populated correctly on historical records.

    Regularly-scheduled warehouse transfers may be delayed for the duration of the maintenance window (up to two hours).

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Push to Warehouse transfers of Incoming Payment Detail data are failing
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We've implemented a fix, and transfers of incoming_payment_details are now succeeding.

    We're waiting for a few remaining transfers to complete to confirm that the issue is resolved for all subscribed destinations.

  • Identified
    Identified

    Push to Warehouse transfers are occurring as scheduled, but transfers of the incoming_payment_details table are failing due to an error. We have identified the source of the issue and are working on resolving it.

Payment order API failures
  • Resolved
    Resolved

    This incident has been resolved and the Payment Order API is operating as expected.

  • Monitoring
    Monitoring

    The Payment Order API is now operating as expected and we are continuing to monitor.

  • Investigating
    Investigating

    We are currently investigating an issue with the Payment Orders API. We will provide updates as we learn more.

API POST & UI Creation workflows in US001
  • Resolved
    Resolved

    This incident has been resolved. We identified a spike in memory which impacted API POST & UI creation workflows. POST & UI creation functionality has been fully restored for affected organizations in cell us001.

  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating

    We are currently investigating this incident impacting customers in US001. Errors may be experienced when submitting API POST requests or using creation based workflows in the web application.

Jul 2024

Partner Issue: Goldman Sachs API service degraded
  • Resolved
    Resolved

    This incident has been resolved by our partner bank.

  • Monitoring
    Monitoring

    We are seeing requests to Goldman Sachs' API succeeding again. We will continue to monitor to ensure new and previously impacted requests complete as expected.

  • Investigating
    Investigating

    We are currently investigating an issue with Goldman Sachs' API. We will provide updates as we learn more.

Bulk Imports functionality undergoing maintenance
  • Resolved
    Resolved

    Bulk Imports functionality maintenance is complete, this feature is now available.

  • Investigating
    Investigating

    Bulk Imports functionality is currently undergoing maintenance, this feature is currently unavailable. The team is working to complete necessary work as quickly as possible to restore functionality.

Database Upgrades
  • Completed
    July 28, 2024 at 6:50 AM
    Completed
    July 28, 2024 at 6:50 AM

    maintenance completed

  • Update
    July 28, 2024 at 6:11 AM
    In progress
    July 28, 2024 at 6:11 AM

    starting maintenance window

  • In progress
    July 28, 2024 at 6:11 AM
    In progress
    July 28, 2024 at 6:11 AM
    Maintenance is now in progress.
  • Planned
    July 28, 2024 at 6:00 AM
    Planned
    July 28, 2024 at 6:00 AM

    Modern Treasury is planning to perform database maintenance in cell us000 on Saturday, July 27th at 11:00PM PDT. During this time, access to the platform for customers in cell us000 will be inaccessible. All operations will resume immediately after the maintenance window.

Partner Issue: Possible Multi-Bank
  • Resolved
    Resolved

    This incident has been resolved by our partner banks.

  • Monitoring
    Monitoring

    Partner banks have started reporting resolution. MT will continue to monitor.

  • Investigating
    Investigating

    Modern Treasury is currently investigating possible impact for partner banks regarding an ongoing CrowdStrike issue.
    Customers of impacted banks could experience payment processing and reporting delays. MT systems are not impacted. 

Scheduled Maintenance: Push to Warehouse
  • Completed
    July 17, 2024 at 2:00 AM
    Completed
    July 17, 2024 at 2:00 AM
    Maintenance has completed successfully
  • In progress
    July 17, 2024 at 12:00 AM
    In progress
    July 17, 2024 at 12:00 AM
    Maintenance is now in progress
  • Planned
    July 17, 2024 at 12:00 AM
    Planned
    July 17, 2024 at 12:00 AM

    A Push to Warehouse maintenance window will take place per our regular schedule next week, on Tuesday 7/16, from 5 to 7 PM PST.

    During this time, we plan to cease syncing the tables associated with our discontinued Compliance service. This includes:

    • user_onboardings

    • cases

    • decisions

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Jun 2024

Role Based Access-Control: Backend Upgrade
  • Completed
    June 06, 2024 at 10:42 PM
    Completed
    June 06, 2024 at 10:42 PM
    Maintenance has completed successfully.
  • In progress
    June 06, 2024 at 10:00 PM
    In progress
    June 06, 2024 at 10:00 PM
    Maintenance is now in progress
  • Planned
    June 06, 2024 at 10:00 PM
    Planned
    June 06, 2024 at 10:00 PM

    On Thursday 6/6 at 3 PM PT, we are migrating to a new backend system for the Roles Based Access-Control system. We do not anticipate any downtime, we will be actively monitoring for any access issues. There are no UI changes at this time.

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Push to Warehouse: Data Store Upgrade
  • Completed
    June 05, 2024 at 12:00 AM
    Completed
    June 05, 2024 at 12:00 AM
    Maintenance has completed successfully
  • In progress
    June 04, 2024 at 10:00 PM
    In progress
    June 04, 2024 at 10:00 PM
    Maintenance is now in progress
  • Planned
    June 04, 2024 at 10:00 PM
    Planned
    June 04, 2024 at 10:00 PM

    On Tuesday 6/4 at 3 PM PT, we plan to migrate to a new data store for customer Push to Warehouse data. We expect regularly-scheduled transfers to be paused for ~2 hours during this process. The migration will also require a re-sync of historical data for the following tables:

    • ledger_account_balances

    • ledger_account_settlements

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Jun 2024 to Aug 2024

Next