tag:globalgiving.statuspage.io,2005:/historyGlobalGiving Status - Incident History2023-10-06T11:40:52-04:00GlobalGivingtag:globalgiving.statuspage.io,2005:Incident/187093312023-10-06T11:40:52-04:002023-10-06T11:40:52-04:00Checkout Not Working<p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>11:40</var> EDT</small><br><strong>Resolved</strong> - A fix has been deployed and we have verified that checkout is working now. Thank you for your patience.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>10:35</var> EDT</small><br><strong>Identified</strong> - We have identified the root cause, and are working to get a fix deployed</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>10:34</var> EDT</small><br><strong>Investigating</strong> - We are investigating an issue with checkout not allowing users to complete donations on GlobalGiving.org</p>tag:globalgiving.statuspage.io,2005:Incident/163155442023-03-26T01:39:54-04:002023-03-26T01:39:54-04:00Annual Maintenance<p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>01:39</var> EDT</small><br><strong>Completed</strong> - Thank you for your patience, GlobalGiving.org and other GlobalGiving services are available again.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>21:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>11:11</var> EST</small><br><strong>Scheduled</strong> - We will be performing annual maintenance and recovery testing. During this time all GlobalGiving sites and services will be unavailable.</p>tag:globalgiving.statuspage.io,2005:Incident/97771342022-04-13T12:55:38-04:002022-04-13T12:55:38-04:00Site Unavailable<p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>12:55</var> EDT</small><br><strong>Resolved</strong> - Everything appears to be operating normally again. Thank you for your patience</p><p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>12:43</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented, and we are showing traffic able to reach the site again. It may take a few minutes for the fix to propagate to all users.</p><p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>12:39</var> EDT</small><br><strong>Identified</strong> - GlobalGiving's Site and API are currently unavailable. We are aware of the situation and implementing a fix now.</p>tag:globalgiving.statuspage.io,2005:Incident/96066572022-03-22T23:06:42-04:002022-03-22T23:06:42-04:00GlobalGiving Learn Outage<p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>23:06</var> EDT</small><br><strong>Resolved</strong> - The fix has been deployed and everything looks to be working again. Thank you for your patience.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>21:05</var> EDT</small><br><strong>Identified</strong> - Our upstream provider for GlobalGiving Learn (https://www.globalgiving.org/learn/) has migrated us to a new server, and we are experiencing trouble with getting that to work. We are working on a fix.</p>tag:globalgiving.statuspage.io,2005:Incident/93941312022-02-23T22:32:36-05:002022-02-23T22:32:36-05:00Unplanned outage of the website and API.<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>22:32</var> EST</small><br><strong>Resolved</strong> - This issue has now been resolved. <br /><br />The root cause was an expired SSL certificate due to a break in our notification process. This process has also been corrected to include multiple notifications to a larger group with a longer lead time.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>21:35</var> EST</small><br><strong>Update</strong> - We are deploying the fix now and estimate one hour to the completed resolution.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>20:31</var> EST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>19:45</var> EST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>19:22</var> EST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>19:19</var> EST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:globalgiving.statuspage.io,2005:Incident/93457122022-02-18T08:57:40-05:002022-02-18T08:57:40-05:00DNS Resolution Issue<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>08:57</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>16:31</var> EST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>15:29</var> EST</small><br><strong>Monitoring</strong> - We are now using a new DNS provider and some users will see service restored immediately. Others may still see some issues over the next 12 hours as the change propagates.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>15:10</var> EST</small><br><strong>Identified</strong> - A service provider we rely on for Domain Name Services (DNS) is currently experiencing an outage. This impacts our API and Website. We are moving our DNS records to a different provider and will provide updates here as that progresses. We expect to resolve the core issue within the hour, but some users may see interruptions of service over the next 12 hours.</p>tag:globalgiving.statuspage.io,2005:Incident/82436602021-10-16T14:34:05-04:002021-10-16T14:34:05-04:00High Website Error Rates<p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>14:34</var> EDT</small><br><strong>Resolved</strong> - The issue has been resolved.</p><p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>14:33</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>10:55</var> EDT</small><br><strong>Investigating</strong> - We are investigating higher than normal error rates on requests to GlobalGiving.org. If you get an "Oops" when using the site, please try again.</p>tag:globalgiving.statuspage.io,2005:Incident/65015102021-03-10T21:10:02-05:002021-03-10T21:10:02-05:00Website and API unavailable<p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>21:10</var> EST</small><br><strong>Resolved</strong> - Our upstream DNS provider has indicated that service has been fully restored, and our own monitoring indicates that the GlobalGiving website and API are functioning normally again.</p><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>19:55</var> EST</small><br><strong>Monitoring</strong> - Our upstream provider is working to restore service. It looks like things are starting to work again for some people. We will continue to monitor and ensure that service is restored for all users.</p><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>19:15</var> EST</small><br><strong>Investigating</strong> - We have identified a problem with our upstream DNS provider which is making the GlobalGiving website and API unavailable to a large percentage of visitors. We are investigating ways to get everything back up and available as quickly as possible</p>tag:globalgiving.statuspage.io,2005:Incident/63576622021-02-22T10:13:23-05:002021-02-22T10:13:23-05:00Site Unavailable/General Errors<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>10:13</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>10:04</var> EST</small><br><strong>Update</strong> - We are continuing to work on a fix for the issue and hope for everything to be restored shortly</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>09:54</var> EST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:globalgiving.statuspage.io,2005:Incident/62357002021-02-10T10:54:46-05:002021-02-10T12:04:25-05:00Slow Response and Server Busy Messages<p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>10:54</var> EST</small><br><strong>Resolved</strong> - We have finished verifying that all GlobalGiving sites and services are up and operational again. We determined the root cause and have documented how to prevent it from happening again. Thank you for your patience and understanding.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>10:42</var> EST</small><br><strong>Monitoring</strong> - We have a fix in place and the site appears to be working. We are verifying that all features of the site are functional now and will update as soon as we are confident that everything looks great.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>10:28</var> EST</small><br><strong>Update</strong> - Our first fix was not the entire solution. We are working on another deploy which we believe will solve the problem</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>08:25</var> EST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>08:24</var> EST</small><br><strong>Identified</strong> - We have identified the cause of the problem and are working to deploy a fix as quickly as possible. Thank you for your patience</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>07:30</var> EST</small><br><strong>Investigating</strong> - Our automated monitoring tools have alerted us that there’s a problem with the API and some of the dynamic functions on the site (e.g. things slow to respond, getting server busy messages). We’re investigating and working on a fix. </p>tag:globalgiving.statuspage.io,2005:Incident/61928452021-02-04T23:37:14-05:002021-02-04T23:37:14-05:00Infrastructure Maintenance<p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>23:37</var> EST</small><br><strong>Completed</strong> - All work has been completed, and everything is working correctly. Thank you for your patience!</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>22:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>09:41</var> EST</small><br><strong>Scheduled</strong> - We will be undergoing maintenance on all of our backend infrastructure, in order to ensure that we keep everything running smoothly and securely. During this time all of our sites and services will be unavailable.</p>tag:globalgiving.statuspage.io,2005:Incident/40755212020-05-10T11:00:25-04:002020-05-10T11:00:25-04:00API Outage<p><small>May <var data-var='date'>10</var>, <var data-var='time'>11:00</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'> 9</var>, <var data-var='time'>23:47</var> EDT</small><br><strong>Investigating</strong> - Due to an HTTP routing problem, our API is not properly returning results. We are working to resolve the issue.</p>tag:globalgiving.statuspage.io,2005:Incident/30431592019-09-29T04:02:09-04:002019-09-29T04:02:09-04:00Infrastructure Maintenance<p><small>Sep <var data-var='date'>29</var>, <var data-var='time'>04:02</var> EDT</small><br><strong>Completed</strong> - GlobalGiving's website and associated services are all up and available again. Thank you for your patience.</p><p><small>Sep <var data-var='date'>29</var>, <var data-var='time'>03:30</var> EDT</small><br><strong>Verifying</strong> - Everything is coming up now, we are just monitoring things to ensure that all of our systems come up properly. Thank you for your patience.</p><p><small>Sep <var data-var='date'>29</var>, <var data-var='time'>02:05</var> EDT</small><br><strong>Update</strong> - We are continuing to work through issues with our cloud provider. Sorry for the inconvenience, more updates to follow as we have information.</p><p><small>Sep <var data-var='date'>29</var>, <var data-var='time'>00:20</var> EDT</small><br><strong>Update</strong> - We are continuing to work to get our infrastructure back up. We encountered problems with our cloud provider and are working with them to get things resolved. We apologize for the inconvenience</p><p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>22:20</var> EDT</small><br><strong>Update</strong> - We ran into some hiccups that slowed down the process, but we have gotten through those and are working at the pace we originally anticipated again. However, that means we are behind schedule. At this time we believe we will be done by 11pm eastern. We do not anticipate any further delays at this time.</p><p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>20:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>13:15</var> EDT</small><br><strong>Scheduled</strong> - We will be undergoing maintenance on all of our backend infrastructure, in order to ensure that we keep everything running smoothly and securely. During this time all of our sites and services will be unavailable.</p>tag:globalgiving.statuspage.io,2005:Incident/28337512019-08-08T15:14:38-04:002019-08-08T15:14:38-04:00API Slow to Respond<p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>15:14</var> EDT</small><br><strong>Resolved</strong> - Everything has been running smoothly for a few hours. We are going to mark this incident as resolved. Sorry for the inconvenience</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>12:43</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>11:30</var> EDT</small><br><strong>Investigating</strong> - We are responding to alerts that the GlobalGiving API is responding much slower than expected. We are attempting to narrow down the cause of the issue and are taking steps to provide a better experience to our users in the interim.</p>tag:globalgiving.statuspage.io,2005:Incident/23361982019-04-18T09:16:50-04:002019-04-18T09:16:50-04:00Elevated Error Counts<p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>09:16</var> EDT</small><br><strong>Resolved</strong> - Everything is running smoothly now. Thank you for your patience.</p><p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>07:51</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and the problem appears to be resolved. We will continue to monitor the situation for a while before resolving this incident.</p><p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>07:21</var> EDT</small><br><strong>Update</strong> - A fix for the problem is being deployed to our infrastructure now. It will be about 30 minutes before it is fully rolled out.</p><p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>07:07</var> EDT</small><br><strong>Identified</strong> - We have identified the problem and are working on a fix for it now.</p><p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>06:34</var> EDT</small><br><strong>Investigating</strong> - We have received reports of increased errors, and are investigating the cause.</p>tag:globalgiving.statuspage.io,2005:Incident/23236562019-04-13T22:13:37-04:002019-04-13T22:13:37-04:00Database Maintenance<p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>22:13</var> EDT</small><br><strong>Completed</strong> - The work on our database has been completed, and everything is operating normally again. Thank you for your patience.</p><p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>21:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'>11</var>, <var data-var='time'>21:44</var> EDT</small><br><strong>Scheduled</strong> - We will be performing some quick maintenance on our database which will require the site to be offline. We apologize for the inconvenience.</p>tag:globalgiving.statuspage.io,2005:Incident/23176452019-04-09T11:49:01-04:002019-04-09T16:49:40-04:00Slow Page Loads<p><small>Apr <var data-var='date'> 9</var>, <var data-var='time'>11:49</var> EDT</small><br><strong>Resolved</strong> - Everything appears to be operating normally again.</p><p><small>Apr <var data-var='date'> 9</var>, <var data-var='time'>10:37</var> EDT</small><br><strong>Identified</strong> - Some pages on GlobalGiving.org are slow to load right now. ˇWe have identified the problem and are deploying a fix for it right now. Thank you for your understanding</p>tag:globalgiving.statuspage.io,2005:Incident/23158802019-04-08T20:49:32-04:002019-04-08T20:49:32-04:00GlobalGiving.org slow to respond, timing out<p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>20:49</var> EDT</small><br><strong>Resolved</strong> - We have put some changes into place to better handle the traffic coming in for the Little by Little campaign, which have resolved the issues on the rest of the site. If you have any further problems, please email customerservice@globalgiving.org</p><p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>17:38</var> EDT</small><br><strong>Update</strong> - We have taken some corrective actions, which have helped. We are continuing to investigate the root cause and put additional fixes into place. Sorry for the inconvenience.</p><p><small>Apr <var data-var='date'> 8</var>, <var data-var='time'>15:10</var> EDT</small><br><strong>Investigating</strong> - We have received reports that some parts of our site are loading very slowly or failing to load all together. We are looking into the issue and seeking to resolve it as quickly as possible.</p>tag:globalgiving.statuspage.io,2005:Incident/22455182019-03-07T01:00:18-05:002019-03-07T01:00:18-05:00Elevated Site Errors<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>01:00</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>00:59</var> EST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>21:16</var> EST</small><br><strong>Monitoring</strong> - We are continuing to monitor the situation and will work to fix any issues as they come up. Sorry for the inconvenience.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>20:53</var> EST</small><br><strong>Investigating</strong> - We are currently investigating reports of elevated site errors and problems with responsiveness.</p>tag:globalgiving.statuspage.io,2005:Incident/22108612019-02-17T00:57:52-05:002019-02-17T00:57:52-05:00Database Upgrades<p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>00:57</var> EST</small><br><strong>Completed</strong> - All the upgrades and updates have been completed, and we have verified that things are working. If you experience any trouble with GlobalGiving's website or API, please contact us: https://www.globalgiving.org/aboutus/contact/</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>00:47</var> EST</small><br><strong>Verifying</strong> - Work is complete, we are just checking to make sure everything is functioning properly. As we check things, we will starting allowing traffic in to the different parts of our services.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>20:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>16:37</var> EST</small><br><strong>Scheduled</strong> - We will be upgrading our database software and performing some upgrades on the data itself. These changes are to enable new features and enhancements on the GlobalGiving platform. Updates will be posted here if anything changes, and when the work is completed.</p>tag:globalgiving.statuspage.io,2005:Incident/21224692018-12-30T23:47:52-05:002018-12-30T23:47:52-05:00Database Issues Causing Site Outage<p><small>Dec <var data-var='date'>30</var>, <var data-var='time'>23:47</var> EST</small><br><strong>Resolved</strong> - Everything appears to be operating normally again. Sorry for the inconvenience.</p><p><small>Dec <var data-var='date'>30</var>, <var data-var='time'>23:35</var> EST</small><br><strong>Monitoring</strong> - We have finished verifying the integrity of our database and everything appears to be fine. The database is under heavier than normal load as lots of things play catch-up, so some transactions with our website may respond slower than normal. We will continue to monitor the situation.</p><p><small>Dec <var data-var='date'>30</var>, <var data-var='time'>23:19</var> EST</small><br><strong>Update</strong> - Our database is back up, and we are verifying the integrity of all of the data.</p><p><small>Dec <var data-var='date'>30</var>, <var data-var='time'>23:04</var> EST</small><br><strong>Identified</strong> - We are working to restore a database error that has stopped our site from functioning</p>tag:globalgiving.statuspage.io,2005:Incident/20419222018-11-16T17:57:10-05:002018-11-16T17:57:10-05:00Website Not Responding<p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>17:57</var> EST</small><br><strong>Resolved</strong> - Everything appears to be back to normal. Thank you for your patience.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>14:42</var> EST</small><br><strong>Update</strong> - API is now fully operational again. The rest of our site continues to operate at a lower capacity while we work on getting things scaled back up.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>14:34</var> EST</small><br><strong>Update</strong> - GlobalGiving.org is now responding to requests, but may be slow for some users. We are continuing to work on scaling our infrastructure back to where it needs to be. Additionally, our API is only responding to some requests, but we hope for that situation to be resolved within the next few minutes</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>12:52</var> EST</small><br><strong>Identified</strong> - Website is currently not responding to any requests. We have identified the issue and are working to bring things back up now</p>tag:globalgiving.statuspage.io,2005:Incident/20204732018-11-06T23:40:02-05:002018-11-06T23:40:02-05:00Website Not Responding<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>23:40</var> EST</small><br><strong>Resolved</strong> - Everything appears to be fully operational again. Sorry for the inconvenience.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>22:35</var> EST</small><br><strong>Identified</strong> - GlobalGiving.org is not responding to requests at this time. Our team is working to resolve this situation as quickly as possible</p>tag:globalgiving.statuspage.io,2005:Incident/19622982018-10-10T20:39:43-04:002018-10-10T20:45:41-04:00Website Not Responding<p><small>Oct <var data-var='date'>10</var>, <var data-var='time'>20:39</var> EDT</small><br><strong>Resolved</strong> - Website became unresponsive from 8:28pm EST to 8:39pm EST due to a problem with one of the components in our web server.</p>tag:globalgiving.statuspage.io,2005:Incident/18819282018-08-28T14:25:30-04:002018-08-28T14:25:30-04:00PayPal Checkouts Failing<p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>14:25</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>14:24</var> EDT</small><br><strong>Update</strong> - We have resolved the underlying problem with our PayPal integration and donations are working.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>12:24</var> EDT</small><br><strong>Investigating</strong> - All donations made on GlobalGiving.org using PayPal payments are not working right now. Recurring donations that were previously setup with PayPal are functioning correctly. We are investigating the root cause.</p>