We have identified a delay in the processing of sending and receiving through the information system network of ChangemakerZ. We are implementing a fix in the system. You may experience error codes 503, 504, 101, or 111
18:10, Jan 15 UTC
We have enabled extra security elements for professional accounts. CheckingMail service has been enabled for the email addresses. You can learn more at https://madebyvasilis.site/email
We have received reports from our staff that there is an unauthorized person that sends emails pretending our CEO. We are evaluating how and why this is happening. We still don’t know if this person is using our emails systems.
18:16, Jan 14 UTC
Our systems have bannister the sender before there a serious damage or a leak through our professional email provider. The sender is considered to be a bot that auto selected email address that doesn’t really exist like on our network under changemakerz.org (explained on discord channel).
18:34, Jan 14 UTC
I temporary fixed has been implemented and we are monitoring the results.
We have enabled CDN security and extra security for all staff accounts. You may not receive emails for the next 2 hours while we are scanning the system for threads.
We're experiencing an elevated level of API errors and slow response. This is particularly affecting when users are creating and updating links.
You may have a slow experience and or errors when updating or creating links.
While this is ongoing you may continue you daily work and simply retry.
We are working on mitigating actions.
Existing links are not affected, and there is no loss of data during this incident.
18:14, Jan 14 UTC
We are continuing to experience errors in our system. We have implemented a series of mitigating actions that have reduced it but not resolved it.
While this is ongoing you may experience;
- Slow or Errors on create link
- Link waiting for scan at 10%
- Slow or Errors when updating links
- Updates not being applied to Published Links
We are continuing work on resolving the issue, in the meantime you may continue your daily work are retry when you experience issues.
We apologies for any inconvenience this may cause.
All Existing published links are not affected and no data is lost during this incident.
Updates will follow here as we progress with a resolution
18:45, Jan 14 UTC
A fix has been implemented, which has alleviated all the error in our system. We continue to monitor the performance and stability.
This means you can now create and edit links as usual.
Links created or updated during the incident which was potentially stuck in scanning process will have to be rescanned manually.
18:45, Jan 14 UTC
This incident has been resolved and the new pages are available