tag:status.phrase.com,2005:/historyPhrase Status - Incident History2024-03-19T09:48:29+01:00Phrasetag:status.phrase.com,2005:Incident/202251812024-03-12T16:55:35+01:002024-03-14T08:18:44+01:00Degraded Performance of Most of Phrase Strings (EU) Components between 2:02 PM and 4:45 PM CET<p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>16:55</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>16:21</var> CET</small><br><strong>Update</strong> - The engineering team keeps working towards fully restoring functionality of the system.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>15:23</var> CET</small><br><strong>Identified</strong> - The engineering team has identified the cause of the issue and is working on fully restoring functionality of the system.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>14:50</var> CET</small><br><strong>Investigating</strong> - We're currently experiencing a large spike in jobs and have currently paused job processing as a result. We are investigating the cause.</p>tag:status.phrase.com,2005:Incident/201932222024-03-08T15:47:35+01:002024-03-08T17:21:05+01:00Degraded performance of IDM (US) between 9:40 AM and 13:42 CET<p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>15:47</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>13:42</var> CET</small><br><strong>Investigating</strong> - Some users at US server might experience issues when accessing Phrase through IDM. Engineers are currently investigating the root cause.</p>tag:status.phrase.com,2005:Incident/201857412024-03-08T12:05:21+01:002024-03-18T11:54:36+01:00Degraded performance of Identity Management - IDM (EU) and IDM (US) between March 7 10:36 AM CET and March 8 3:48 PM CET<p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>12:05</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved and the fix has been implemented.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>10:15</var> CET</small><br><strong>Update</strong> - The fix for the issue is still being tested on our QA environment. If the testing is successful, the aim is to deploy it today around noon.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>07:21</var> CET</small><br><strong>Update</strong> - The fix for the issue is now being tested on our QA environment and if the testing is successful, the aim is to deploy it today around noon.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>04:22</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>02:59</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>01:47</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>00:50</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>23:46</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:48</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>21:43</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>20:46</var> CET</small><br><strong>Update</strong> - Our engineers are still working on the fix.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>19:34</var> CET</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>16:15</var> CET</small><br><strong>Identified</strong> - Some users have reported issues when logging in through IDM using the 2FA authentication. The issue has been identified and the fix is being implemented.</p>tag:status.phrase.com,2005:Incident/201675672024-03-06T08:00:57+01:002024-03-06T08:00:59+01:00Scheduled Maintenance - Phrase Strings (EU) - Database Maintenance<p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>08:00</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>07:00</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>16:40</var> CET</small><br><strong>Scheduled</strong> - <b>Start time:</b> March 6, 2024 @ 07:00 AM CET<br /><b>End time:</b> March 6, 2024 @ 08:00 AM CET<br /><br /><b>Customers affected:</b> All customers of Strings EU instance. <br /><b>Products affected:</b> All components except for OTA.<br /><br /><b>What will occur during maintenance:</b><br />• Database migration or update.<br />• Strings applications might be potentially slow or unavailable for 5-10 min.<br /><br /><b>Why we're doing this: </b><br />• We will implement performance improvements.</p>tag:status.phrase.com,2005:Incident/200310082024-02-20T18:31:58+01:002024-02-20T18:31:59+01:00Degraded Performance of all Phrase TMS (EU) components<p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>18:31</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>18:18</var> CET</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>18:16</var> CET</small><br><strong>Investigating</strong> - We are experiencing performance issues affecting all Phrase TMS (EU) components. We are currently investigating the issue.</p>tag:status.phrase.com,2005:Incident/200207492024-02-19T09:15:00+01:002024-02-19T14:53:34+01:00Degraded Performance of Pre-translation from MT in Phrase Strings (EU and US) between 9:15 and 11:30 AM CET<p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>09:15</var> CET</small><br><strong>Resolved</strong> - Between 9:15 and 11:30 AM CET there was a problem with pre-translation from machine translation in Phrase Strings. This was caused by a bug in requesting MT through API. The service has been working as expected again since 11:30 AM CET.</p>tag:status.phrase.com,2005:Incident/199110132024-02-05T14:02:46+01:002024-02-06T10:18:22+01:00Unable to log in via Strings SSO login (redirect issue)<p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>14:02</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>11:48</var> CET</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>10:50</var> CET</small><br><strong>Identified</strong> - We are currently working on a fix for this issue</p>tag:status.phrase.com,2005:Incident/196764022024-01-18T07:00:28+01:002024-01-18T07:00:28+01:00Scheduled Maintenance - January 18th, 2024 - Database maintenance (EU)<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>07:00</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>06:01</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>11:25</var> CET</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.phrase.com,2005:Incident/195936482024-01-04T10:27:39+01:002024-01-04T10:27:40+01:00Scheduled Maintenance - January 4th, 2024 - Database maintenance (US)<p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>10:27</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed</p><p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>10:01</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'> 2</var>, <var data-var='time'>16:42</var> CET</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.phrase.com,2005:Incident/194392252023-12-14T17:17:53+01:002023-12-19T16:51:59+01:00Degraded Performance of all Phrase TMS (EU) components between 03:01 PM and 4:58 PM CET<p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>17:17</var> CET</small><br><strong>Resolved</strong> - Our engineers identified the root cause of the degraded performance and the incident is resolved.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>16:31</var> CET</small><br><strong>Investigating</strong> - Our engineering team is investigating the degraded performance of all the Phrase TMS (EU) components.</p>tag:status.phrase.com,2005:Incident/193556802023-12-06T20:07:23+01:002023-12-06T20:07:24+01:00Degraded Performance of Most of Phrase Strings (EU) Components between 6:36 and 6:41 CET<p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>20:07</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>19:47</var> CET</small><br><strong>Identified</strong> - The brief disruption happened between 6:36 and 6:41 CET. A fix to fully resolve its effects is being implemented.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>19:23</var> CET</small><br><strong>Investigating</strong> - The issue has been identified and we're working on fixing it.</p>tag:status.phrase.com,2005:Incident/193525502023-12-06T13:00:00+01:002023-12-07T11:37:06+01:00Performance Disruption of Phrase TMS (EU) Term base component between 1:00 and 3:10 PM CEST<p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>13:00</var> CET</small><br><strong>Resolved</strong> - Phrase TMS (EU) experienced intermittent issues affecting the Term base component. Phrase engineers investigated the issues and were able to resolve them.</p>tag:status.phrase.com,2005:Incident/192645692023-12-05T20:00:17+01:002023-12-05T20:00:20+01:00Scheduled Maintenance - December 5, 2023 - IDM DB Maintenance (EU)<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>20:00</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>19:02</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>19:24</var> CET</small><br><strong>Scheduled</strong> - <b>Customers affected:</b> Users of Phrase Suite in the EU data center. <br /><b>Products affected:</b> Phrase Suite.<br /><br /><b>What will occur during maintenance:</b><br />New users might not be able to sign up to the Phrase Suite.<br />Phrase Suite users might not be able to sign in.<br />Already logged in users might not be able to finish their tasks in IDM (Dashboard, User profile, Organization settings, etc.).<br /><br /><b>Why we're doing this:</b><br />We are changing configurations of an underlying DB.</p>tag:status.phrase.com,2005:Incident/192645232023-12-05T10:02:12+01:002023-12-05T10:02:13+01:00Scheduled Maintenance - December 5, 2023 - IDM DB Maintenance (US)<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>10:02</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>09:00</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>19:20</var> CET</small><br><strong>Scheduled</strong> - <b>Customers affected:</b> Users of Phrase Suite in the US data center. <br /><b>Products affected:</b> Phrase Suite.<br /><br /><b>What will occur during maintenance:</b><br />New users might not be able to sign up to the Phrase Suite.<br />Phrase Suite users might not be able to sign in.<br />Already logged in users might not be able to finish their tasks in IDM (Dashboard, User profile, Organization settings, etc.).<br /><br /><b>Why we're doing this:</b><br />We are changing configurations of an underlying DB.</p>tag:status.phrase.com,2005:Incident/192489742023-11-30T11:17:51+01:002023-12-07T16:59:15+01:00Performance Disruption of Phrase Strings Translation Editor between 10:40 AM and 11:05 AM CET<p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>11:17</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p>tag:status.phrase.com,2005:Incident/192446042023-11-29T20:58:27+01:002023-11-29T20:58:30+01:00Degraded Performance of Phrase TMS (EU) CAT Web Editor between between 8:20 PM and 8:35 PM CET<p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>20:58</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>20:48</var> CET</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>20:43</var> CET</small><br><strong>Investigating</strong> - Users are currently experiencing issues with access to Phrase TMS (EU) CAT Web Editor. Our engineers are investigating at the moment.</p>tag:status.phrase.com,2005:Incident/192018462023-11-23T08:30:00+01:002023-11-23T12:34:21+01:00Performance disruption of Phrase Strings Editor between 08:39:58 UTC and 09:00:00 UTC<p><small>Nov <var data-var='date'>23</var>, <var data-var='time'>08:30</var> CET</small><br><strong>Resolved</strong> - The Phrase Strings Editor was showing up blank. The disruption started on Thursday, November 23rd around 08:39:58 UTC and lasted approx. 20 minutes.</p>tag:status.phrase.com,2005:Incident/191189252023-11-15T17:21:15+01:002023-11-15T17:21:16+01:00Scheduled Maintenance - November 15, 2023 - Term Base Service Maintenance<p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>17:21</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>09:00</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>16:42</var> CET</small><br><strong>Scheduled</strong> - <b>Customers affected:</b> Customers utilizing Term base TMS APIs.<br /><b>Products affected:</b> Term base component of TMS.<br /><br /><b>What will occur during maintenance:</b><br />During the scheduled maintenance window, users calling Term base APIs may experience intermittent 404 errors, lasting up to a maximum of 120 minutes.<br /><br /><b>Why we're doing this:</b><br />This maintenance is undertaken to streamline internal identifiers, facilitating future enhancements and improvements to the Term base component.<br />We appreciate your understanding during this brief period of potential disruption.</p>tag:status.phrase.com,2005:Incident/191370502023-11-13T16:15:00+01:002023-11-20T10:40:03+01:00Jobs Not Being Processed<p><small>Nov <var data-var='date'>13</var>, <var data-var='time'>16:15</var> CET</small><br><strong>Resolved</strong> - One of our employed middleware stopped performing jobs after merging a PR. Jobs that were being enqueued were not being processed, there were no errors or retries triggered during this time.</p>tag:status.phrase.com,2005:Incident/189240542023-10-25T02:26:00+02:002023-10-25T15:56:30+02:00Degraded Performance of Phrase TMS (EU) Translation Memory component between 02:26 AM and 11:38 AM CEST<p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>02:26</var> CEST</small><br><strong>Resolved</strong> - Performance issues affecting Translation Memory component have prevented some users from creating new Translation Memories. This incident has been resolved and Translation Memories can be successfully created now.</p>tag:status.phrase.com,2005:Incident/189110232023-10-24T12:25:25+02:002023-10-24T12:25:26+02:00Performance Disruption - Phrase Strings (EU Data Center)<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>12:25</var> CEST</small><br><strong>Resolved</strong> - The issue with Phrase Strings (EU Data Center) has been resolved.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>12:19</var> CEST</small><br><strong>Investigating</strong> - Our engineers are currently investigating why Phrase Strings (EU Data Center) is not available.</p>tag:status.phrase.com,2005:Incident/187090272023-10-10T10:09:23+02:002023-10-10T10:09:23+02:00Charging issues with translation orders<p><small>Oct <var data-var='date'>10</var>, <var data-var='time'>10:09</var> CEST</small><br><strong>Resolved</strong> - We are treating this incident as resolved. Orders are currently still not available at this moment, but we have now toggled an in-app warning when trying to access the Orders tab. We are working with our payment service provider to resolve this ASAP.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>21:44</var> CEST</small><br><strong>Update</strong> - Another update is going to be provided by Monday, 11AM CEST the latest.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>18:45</var> CEST</small><br><strong>Identified</strong> - We were able to reproduce the issue, and it has been identified. This will take some time, as it needs to be resolved with an external provider. As long as the customers do not retry confirming the order, they won't be charged multiple times.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>17:46</var> CEST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>15:54</var> CEST</small><br><strong>Investigating</strong> - We are currently investigating this issue. Please do not attempt to place translation orders if you are hosted on the US data center. You might be charged multiple times.</p>tag:status.phrase.com,2005:Incident/185568922023-09-20T20:41:42+02:002023-09-20T20:41:42+02:00Performance Disruption for Strings Pluralisation of StringsDict File<p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>20:41</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>19:20</var> CEST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>18:10</var> CEST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>17:14</var> CEST</small><br><strong>Identified</strong> - We have identified the cause, and we're currently investigating the issue.</p>tag:status.phrase.com,2005:Incident/185002572023-09-19T00:00:25+02:002023-09-19T00:00:26+02:00Scheduled Maintenance - September 18, 2023 - Subscription management and billing details<p><small>Sep <var data-var='date'>19</var>, <var data-var='time'>00:00</var> CEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>00:00</var> CEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>14:02</var> CEST</small><br><strong>Scheduled</strong> - <b>Customers affected:</b> Admins and owners who can access billing and subscription of TMS or Strings<br /><b>Products affected:</b> Subscription management and Billing details in TMS, Strings, and Suite.<br /><br /><b>What will occur during maintenance:</b><br />Due to a scheduled maintenance, the subscription management and billing details section will not be available from 0:00 to 24:00h CET on Monday, September 18. <br />Updating subscription (buying seats, Phrase Translate add-on etc.) will not be possible<br />Purchasing translation orders in Strings will not be possible<br />Users will not be able to access billing details or make changes to their subscriptions<br /><br /><b>Why we're doing this:</b><br />Making improvements to our billing and subscription experience</p>tag:status.phrase.com,2005:Incident/185120092023-09-18T17:32:03+02:002023-09-18T17:32:03+02:00Scheduled Maintenance - September 18, 2023 - Analytics Page Maintenance<p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>17:32</var> CEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>17:01</var> CEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>17:25</var> CEST</small><br><strong>Scheduled</strong> - <b>Customers affected:</b> Users of Phrase Suite and Analytics page in TMS. <br /><b>Products affected:</b> Phrase Analytics, Advanced Analytics, Phrase Suite.<br /><br /><b>What will occur during maintenance:</b><br />● Users visiting the Analytics page might receive an error message within the page and the content might not load.<br />● Users already on the Analytics page might receive an error message upon refresh of the page and the content might not load.<br /><br /><b>Why we're doing this:</b><br />● We are upgrading the version of an underlying database.</p>