Snapshot 14551
Normalized text
Scripts and page chrome removed; this is what change detection compares.
<?xml version="1.0" encoding="UTF-8"?> <rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/"> <channel> <title>Sumble Status - Incident history</title> <link>https://status.sumble.com</link> <description>Sumble</description> <pubDate>Thu, 13 Aug 2026 21:10:00 +0000</pubDate> <item> <title>Magic link and Okta login is down</title> <description> Type: Incident Duration: 1 hour and 11 minutes Affected Components: Website Aug 13, 21:36:46 GMT+0 - Identified - We have applied a mitigation to the magic link path and are seeing sign-ins recover. Okta SSO sign-in remains affected and we're working on a fix. Aug 13, 22:18:17 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Aug 13, 21:18:34 GMT+0 - Identified - We are continuing to work on a fix for this incident. Aug 13, 22:20:31 GMT+0 - Resolved - This incident has been resolved. Aug 13, 21:10:00 GMT+0 - Investigating - We are currently investigating this incident. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 1 hour and 11 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>21:36:46</var> GMT+0</small><br><strong>Identified</strong> - We have applied a mitigation to the magic link path and are seeing sign-ins recover. Okta SSO sign-in remains affected and we're working on a fix..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>22:18:17</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>21:18:34</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>22:20:31</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Aug <var data-var='date'> 13</var>, <var data-var='time'>21:10:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> ]]> </content:encoded> <pubDate>Thu, 13 Aug 2026 21:10:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmss0ixlv00lq1bo5jecw182x</link> <guid>https://status.sumble.com/incident/cmss0ixlv00lq1bo5jecw182x</guid> </item> <item> <title>Our webapp is unstable</title> <description> Type: Incident Duration: 49 minutes Affected Components: Website Aug 10, 19:22:33 GMT+0 - Investigating - We are currently investigating this incident. Aug 10, 20:00:42 GMT+0 - Identified - We're applying a mitigation that worked on our testing environments. Aug 10, 20:05:58 GMT+0 - Monitoring - Mitigation seems to have worked, we're monitoring the systems now Aug 10, 20:11:34 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 49 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Aug <var data-var='date'> 10</var>, <var data-var='time'>19:22:33</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Aug <var data-var='date'> 10</var>, <var data-var='time'>20:00:42</var> GMT+0</small><br><strong>Identified</strong> - We're applying a mitigation that worked on our testing environments..</p> <p><small>Aug <var data-var='date'> 10</var>, <var data-var='time'>20:05:58</var> GMT+0</small><br><strong>Monitoring</strong> - Mitigation seems to have worked, we're monitoring the systems now.</p> <p><small>Aug <var data-var='date'> 10</var>, <var data-var='time'>20:11:34</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Mon, 10 Aug 2026 19:22:33 +0000</pubDate> <link>https://status.sumble.com/incident/cmsnmc43q019l0klofpuvjwgb</link> <guid>https://status.sumble.com/incident/cmsnmc43q019l0klofpuvjwgb</guid> </item> <item> <title>We're seeing bugs when accessing the people details page</title> <description> Type: Incident Duration: 13 minutes Affected Components: Data Shares, Website Jul 27, 17:48:59 GMT+0 - Investigating - We are currently investigating this incident. Jul 27, 17:57:38 GMT+0 - Identified - The issue has been identified, and we’re implementing a mitigation. Jul 27, 18:01:41 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 13 minutes</p> <p><strong>Affected Components:</strong> , </p> <p><small>Jul <var data-var='date'> 27</var>, <var data-var='time'>17:48:59</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jul <var data-var='date'> 27</var>, <var data-var='time'>17:57:38</var> GMT+0</small><br><strong>Identified</strong> - The issue has been identified, and we’re implementing a mitigation..</p> <p><small>Jul <var data-var='date'> 27</var>, <var data-var='time'>18:01:41</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Mon, 27 Jul 2026 17:48:59 +0000</pubDate> <link>https://status.sumble.com/incident/cms3itui1000p1alrikptpyw4</link> <guid>https://status.sumble.com/incident/cms3itui1000p1alrikptpyw4</guid> </item> <item> <title>Degraded performance</title> <description> Type: Incident Duration: 25 minutes Affected Components: Website Apr 28, 17:30:00 GMT+0 - Identified - We have noticed degraded performance in the web application and are resolving the underlying issue. Apr 28, 17:55:24 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 25 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Apr <var data-var='date'> 28</var>, <var data-var='time'>17:30:00</var> GMT+0</small><br><strong>Identified</strong> - We have noticed degraded performance in the web application and are resolving the underlying issue..</p> <p><small>Apr <var data-var='date'> 28</var>, <var data-var='time'>17:55:24</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Tue, 28 Apr 2026 17:30:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmoix0r6l00sh100wzc9lgxzy</link> <guid>https://status.sumble.com/incident/cmoix0r6l00sh100wzc9lgxzy</guid> </item> <item> <title>Scheduled maintenance on Saturday 18th at 6PM Pacific Time</title> <description> Type: Maintenance Duration: 1 hour and 13 minutes Affected Components: Data Shares, Website Apr 19, 01:00:00 GMT+0 - Identified - We'll be taking Sumble offline to upgrade our database. We expect the work to take up to 2 hours. We'll post status updates here when the maintenance starts, if anything changes mid-window, and once we're back online. Apr 18, 23:40:20 GMT+0 - Identified - Pre-maintenance checks are complete and all prerequisites have been confirmed. We are on track to begin at the scheduled start time as previously communicated. Status updates will be posted every 30 minutes until the maintenance window concludes. Apr 19, 01:00:01 GMT+0 - Identified - Maintenance is now in progress Apr 19, 01:06:35 GMT+0 - Identified - We've started the maintenance window. Our services will go down shortly Apr 19, 01:37:11 GMT+0 - Identified - Maintenance is going according to plan. We expect to wrap it up on schedule Apr 19, 02:08:55 GMT+0 - Identified - We've updated all the components we were planning to update. We're now validating the status and expect to make all the services available shortly Apr 19, 02:12:58 GMT+0 - Completed - Maintenance has completed successfully. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Maintenance</p> <p><strong>Duration:</strong> 1 hour and 13 minutes</p> <p><strong>Affected Components:</strong> , </p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>01:00:00</var> GMT+0</small><br><strong>Identified</strong> - We'll be taking Sumble offline to upgrade our database. We expect the work to take up to 2 hours. We'll post status updates here when the maintenance starts, if anything changes mid-window, and once we're back online..</p> <p><small>Apr <var data-var='date'> 18</var>, <var data-var='time'>23:40:20</var> GMT+0</small><br><strong>Identified</strong> - Pre-maintenance checks are complete and all prerequisites have been confirmed. We are on track to begin at the scheduled start time as previously communicated. Status updates will be posted every 30 minutes until the maintenance window concludes..</p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>01:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>01:06:35</var> GMT+0</small><br><strong>Identified</strong> - We've started the maintenance window. Our services will go down shortly.</p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>01:37:11</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is going according to plan. We expect to wrap it up on schedule.</p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>02:08:55</var> GMT+0</small><br><strong>Identified</strong> - We've updated all the components we were planning to update. We're now validating the status and expect to make all the services available shortly.</p> <p><small>Apr <var data-var='date'> 19</var>, <var data-var='time'>02:12:58</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> ]]> </content:encoded> <pubDate>Sun, 19 Apr 2026 01:00:00 +0000</pubDate> <link>https://status.sumble.com/maintenance/cmo2wls24001711t7gg3gqiqk</link> <guid>https://status.sumble.com/maintenance/cmo2wls24001711t7gg3gqiqk</guid> </item> <item> <title>Site performance degredation</title> <description> Type: Incident Duration: 1 hour and 2 minutes Feb 11, 17:35:00 GMT+0 - Monitoring - Our monitoring systems alerted us to performance issues with the site. We identified some impacts on the underlying resources, and are resolving the impacts and monitoring the site. We will continue to investigate and will resolve the issue once we are confident we have fully remediated the performance impacts. Feb 11, 18:37:04 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 1 hour and 2 minutes</p> <p><small>Feb <var data-var='date'> 11</var>, <var data-var='time'>17:35:00</var> GMT+0</small><br><strong>Monitoring</strong> - Our monitoring systems alerted us to performance issues with the site. We identified some impacts on the underlying resources, and are resolving the impacts and monitoring the site. We will continue to investigate and will resolve the issue once we are confident we have fully remediated the performance impacts..</p> <p><small>Feb <var data-var='date'> 11</var>, <var data-var='time'>18:37:04</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Wed, 11 Feb 2026 17:35:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmlibxkcq00j0aunv2y6bdjnz</link> <guid>https://status.sumble.com/incident/cmlibxkcq00j0aunv2y6bdjnz</guid> </item> <item> <title>Site outage</title> <description> Type: Incident Duration: 26 minutes Affected Components: Website Dec 29, 16:21:00 GMT+0 - Investigating - We are currently investigating this incident affecting our webapp Dec 29, 16:47:00 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 26 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Dec <var data-var='date'> 29</var>, <var data-var='time'>16:21:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident affecting our webapp.</p> <p><small>Dec <var data-var='date'> 29</var>, <var data-var='time'>16:47:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Mon, 29 Dec 2025 16:21:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmjrlrbcx0126bayldc4x9muw</link> <guid>https://status.sumble.com/incident/cmjrlrbcx0126bayldc4x9muw</guid> </item> <item> <title>Data Shares out of Date</title> <description> Type: Incident Duration: 3 days, 16 hours and 11 minutes Affected Components: Data Shares Sep 20, 02:00:00 GMT+0 - Identified - Data Shares haven't been updated since Friday, September 19\. The issue has been identified and a fix has been released. We're monitoring the latest runs and will provide an update when data has been delivered. Apologies for the inconvenience. Sep 22, 17:16:36 GMT+0 - Monitoring - Data Share processing is proceeding as expected. We anticipate all shares to be updated by Midnight Eastern time/9 P.M. Pacific tonight (Monday 22 September). We will also update again if there are any further developments. Sep 23, 04:00:36 GMT+0 - Monitoring - The latest data are still generating for all customers. We now expect this process to continue running overnight, and will update by noon Eastern tomorrow with further updates as needed. Sep 23, 18:11:16 GMT+0 - Resolved - All customers now have updated data shares, and the underlying issues have been resolved. We are investigating multiple options going forward to help prevent delays on data shares in the future. Thanks for your patience and please reach out to us with any further questions. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 3 days, 16 hours and 11 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Sep <var data-var='date'> 20</var>, <var data-var='time'>02:00:00</var> GMT+0</small><br><strong>Identified</strong> - Data Shares haven't been updated since Friday, September 19\. The issue has been identified and a fix has been released. We're monitoring the latest runs and will provide an update when data has been delivered. Apologies for the inconvenience..</p> <p><small>Sep <var data-var='date'> 22</var>, <var data-var='time'>17:16:36</var> GMT+0</small><br><strong>Monitoring</strong> - Data Share processing is proceeding as expected. We anticipate all shares to be updated by Midnight Eastern time/9 P.M. Pacific tonight (Monday 22 September). We will also update again if there are any further developments..</p> <p><small>Sep <var data-var='date'> 23</var>, <var data-var='time'>04:00:36</var> GMT+0</small><br><strong>Monitoring</strong> - The latest data are still generating for all customers. We now expect this process to continue running overnight, and will update by noon Eastern tomorrow with further updates as needed..</p> <p><small>Sep <var data-var='date'> 23</var>, <var data-var='time'>18:11:16</var> GMT+0</small><br><strong>Resolved</strong> - All customers now have updated data shares, and the underlying issues have been resolved. We are investigating multiple options going forward to help prevent delays on data shares in the future. Thanks for your patience and please reach out to us with any further questions..</p> ]]> </content:encoded> <pubDate>Sat, 20 Sep 2025 02:00:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmfv633lc15jum6nbpjh3icxa</link> <guid>https://status.sumble.com/incident/cmfv633lc15jum6nbpjh3icxa</guid> </item> <item> <title>Website unresponsive to requests</title> <description> Type: Incident Affected Components: Website Sep 4, 16:13:00 GMT+0 - Resolved - Sumble's website is unresponsive to requests Sep 4, 16:20:00 GMT+0 - Resolved - This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Affected Components:</strong> </p> <p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>16:13:00</var> GMT+0</small><br><strong>Resolved</strong> - Sumble's website is unresponsive to requests.</p> <p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>16:20:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Thu, 4 Sep 2025 16:13:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmf5mgueu007rxln2pdsmkb0k</link> <guid>https://status.sumble.com/incident/cmf5mgueu007rxln2pdsmkb0k</guid> </item> <item> <title>Weekly alert feed emails are delayed</title> <description> Type: Incident Duration: 11 hours and 26 minutes Affected Components: Website Jun 16, 11:00:00 GMT+0 - Investigating - This morning, we noticed an issue with generating the weekly alert feed emails. Out of an abundance of caution, we are delaying sending further emails until we have identified a proper fix to assure all users get content that meets our standards for quality and relevance. We will update as emails are ready to send later today. No other services are affected at this time. Jun 16, 22:25:39 GMT+0 - Resolved - We have confirmed a fix and all email alerts will go out on Tuesday. Thanks for your patience while we assure we're providing you high quality information. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 11 hours and 26 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Jun <var data-var='date'> 16</var>, <var data-var='time'>11:00:00</var> GMT+0</small><br><strong>Investigating</strong> - This morning, we noticed an issue with generating the weekly alert feed emails. Out of an abundance of caution, we are delaying sending further emails until we have identified a proper fix to assure all users get content that meets our standards for quality and relevance. We will update as emails are ready to send later today. No other services are affected at this time..</p> <p><small>Jun <var data-var='date'> 16</var>, <var data-var='time'>22:25:39</var> GMT+0</small><br><strong>Resolved</strong> - We have confirmed a fix and all email alerts will go out on Tuesday. Thanks for your patience while we assure we're providing you high quality information..</p> ]]> </content:encoded> <pubDate>Mon, 16 Jun 2025 11:00:00 +0000</pubDate> <link>https://status.sumble.com/incident/cmbz5xf7p000b13g9u10j88sy</link> <guid>https://status.sumble.com/incident/cmbz5xf7p000b13g9u10j88sy</guid> </item> <item> <title>User favorite lists were temporarily deleted</title> <description> Type: Incident Affected Components: Website Apr 2, 18:06:00 GMT+0 - Resolved - Between 6:06 and 6:40 PM GMT, a feature deploy unintentionally deleted the organizations associated with custom favorite lists. The issue was identified from logs and the changes were reverted. All favorite lists are restored. The feature was reviewed and a patch has been deployed. This incident has been resolved. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Affected Components:</strong> </p> <p><small>Apr <var data-var='date'> 2</var>, <var data-var='time'>18:06:00</var> GMT+0</small><br><strong>Resolved</strong> - Between 6:06 and 6:40 PM GMT, a feature deploy unintentionally deleted the organizations associated with custom favorite lists. The issue was identified from logs and the changes were reverted. All favorite lists are restored. The feature was reviewed and a patch has been deployed. This incident has been resolved..</p> ]]> </content:encoded> <pubDate>Wed, 2 Apr 2025 18:06:00 +0000</pubDate> <link>https://status.sumble.com/incident/cm90agyix00017krjczas7tvj</link> <guid>https://status.sumble.com/incident/cm90agyix00017krjczas7tvj</guid> </item> <item> <title>Snowflake data share permissions issue</title> <description> Type: Incident Duration: 5 days, 12 hours and 24 minutes Affected Components: Data Shares Feb 28, 16:07:00 GMT+0 - Investigating - Overnight permission grants to data share customers through Snowflake failed, and access to the shares was revoked Feb 28, 17:15:00 GMT+0 - Resolved - Overnight permission grants to data share customers through Snowflake failed, and access to the shares was revoked. We have restored access to the shares and are working on a full fix and tests to catch this condition. </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 5 days, 12 hours and 24 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>16:07:00</var> GMT+0</small><br><strong>Investigating</strong> - Overnight permission grants to data share customers through Snowflake failed, and access to the shares was revoked.</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>17:15:00</var> GMT+0</small><br><strong>Resolved</strong> - Overnight permission grants to data share customers through Snowflake failed, and access to the shares was revoked. We have restored access to the shares and are working on a full fix and tests to catch this condition..</p> ]]> </content:encoded> <pubDate>Fri, 28 Feb 2025 16:07:00 +0000</pubDate> <link>https://status.sumble.com/incident/cm7p0243c007qngq3rihpmdc1</link> <guid>https://status.sumble.com/incident/cm7p0243c007qngq3rihpmdc1</guid> </item> <item> <title>All-NULL enrichment Values in Snowflake data shares</title> <description> Type: Incident Duration: 31 minutes Affected Components: Data Shares Feb 24, 19:01:00 GMT+0 - Resolved - This incident has been resolved, all data shares should be back to normal Feb 24, 18:30:00 GMT+0 - Investigating - The ENRICHED\_ORGANIZATIONS table in Snowflake data shares has been overwritten with all-NULL values </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 31 minutes</p> <p><strong>Affected Components:</strong> </p> <p><small>Feb <var data-var='date'> 24</var>, <var data-var='time'>19:01:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved, all data shares should be back to normal.</p> <p><small>Feb <var data-var='date'> 24</var>, <var data-var='time'>18:30:00</var> GMT+0</small><br><strong>Investigating</strong> - The ENRICHED\_ORGANIZATIONS table in Snowflake data shares has been overwritten with all-NULL values.</p> ]]> </content:encoded> <pubDate>Mon, 24 Feb 2025 18:30:00 +0000</pubDate> <link>https://status.sumble.com/incident/cm7mvhgys003712wv3t5k0n0i</link> <guid>https://status.sumble.com/incident/cm7mvhgys003712wv3t5k0n0i</guid> </item> <item> <title>Sumble down</title> <description> Type: Incident Duration: 45 minutes Affected Components: Website, Data Shares Jan 29, 21:05:02 GMT+0 - Investigating - Sumble is temporarily down as we investigate a new deployment Jan 29, 21:19:45 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jan 29, 21:50:14 GMT+0 - Resolved - This incident has been resolved. Sorry for the inconvenience, and have a great day! </description> <content:encoded> <![CDATA[<p><strong>Type:</strong> Incident</p> <p><strong>Duration:</strong> 45 minutes</p> <p><strong>Affected Components:</strong> , </p> <p><small>Jan <var data-var='date'> 29</var>, <var data-var='time'>21:05:02</var> GMT+0</small><br><strong>Investigating</strong> - Sumble is temporarily down as we investigate a new deployment.</p> <p><small>Jan <var data-var='date'> 29</var>, <var data-var='time'>21:19:45</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Jan <var data-var='date'> 29</var>, <var data-var='time'>21:50:14</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved. Sorry for the inconvenience, and have a great day!.</p> ]]> </content:encoded> <pubDate>Wed, 29 Jan 2025 21:05:02 +0000</pubDate> <link>https://status.sumble.com/incident/cm6ieak7500h1vrnus67h7w01</link> <guid>https://status.sumble.com/incident/cm6ieak7500h1vrnus67h7w01</guid> </item> </channel> </rss>