After the technical issues throughout the last week, we further observed our infrastructure and are meanwhile confident to say that our backend system has generally stabilized. Therefore, we will close this incident.
Summary: Customers using our German infrastructure experienced several service disruptions including the following behaviours:
- Delayed or failing push and email notifications
- Slow operation of publishing news posts and comments
- Slow operating user management
We diagnosed that our backend system had difficulties processing the notification requests under certain circumstances which led to a slow-down of the entire infrastructure.
Once we identified the root cause, we implemented several hotfixes, which eventually had a lasting effect by Wednesday afternoon (September 1st). Ever since our German system has been operating as expected.
Due to the frequency of similar incidents in recent times, we will take further prioritized actions that should clearly improve the performance of the affected functions.
We would like to apologize for the unstable situation and the troubles this has caused you. We understand that these functions are central to your use of the app and we were not able to provide the necessary reliability lately.
If you have further questions about this incident, you can contact us at email@example.com
and we will be happy to answer them.