Page MenuHomec4science

2020 Week 20 (Late May)
Updated 140 Days AgoPublic

Follow our twitter account for updates: https://twitter.com/c4science

Outage

12th - 17th May

Outage on our virtual machine provider, SwitchEngine. Their Ceph cluster suffered a memory consumption problem. Information about the outage can be found here: https://switchengines-1564678076272.site24x7signals.com/#/incident/-fIX8sNu-ilFX5UtJzmCzXSiq-ukEntqLFAOHX16DXSNCNmhLfrlFcT7xEpg8Jyaa5HgETBE20fYvvi0bIVrGg==

  • 2020-05-16 - 2020-05-17: c4science upgrade, we took the chance to upgrade our infrastructure

29th May - 4th June

The Ceph cluster is still in bad shape: https://switchengines-1564678076272.site24x7signals.com/#/incident/-fIX8sNu-ilFX5UtJzmCzXSiq-ukEntqLFAOHX16DXS-bSsH8mjGvL-9nCltIH92b_nlVTJjdEgz3UjItwgXqw==

  • 2020-05-29: We are experiencing huge performance issue and virtual machine lockup.
  • 2020-06-02: Repositories write are not possible but the rest service is in write mode again. Repositories can be fetched again !
  • 2020-06-03: SVN and Hg write operatoins have been restored. GIT will follow later if everything is stable.
  • 2020-06-04: GIT operations have been restored.

Bugfixes

  • Fix repositories synchronization
  • Fix some authentication performance
  • Upgrade to GIT 2.22
  • Fix PHP version on some cases
  • Backup service in an other datacenter almost ready to be used at all time (from backups)
NOTE: If you find some bugs, please create a ticket.
Last Author
aubort
Last Edited
Jun 9 2020, 15:33

Event Timeline

admin created this document.May 17 2020, 21:33
admin edited the content of this document. (Show Details)
admin added a project: c4science.
admin changed the title from 20201705 to 2020 Week 20 (Late May).
admin edited the content of this document. (Show Details)May 17 2020, 21:36
admin edited the content of this document. (Show Details)
admin edited the content of this document. (Show Details)
aubort edited the content of this document. (Show Details)May 26 2020, 01:54
admin edited the content of this document. (Show Details)Jun 2 2020, 10:11
aubort edited the content of this document. (Show Details)Jun 2 2020, 10:22
aubort edited the content of this document. (Show Details)Jun 3 2020, 13:01
admin edited the content of this document. (Show Details)Jun 8 2020, 09:55
aubort edited the content of this document. (Show Details)Jun 8 2020, 10:37
aubort edited the content of this document. (Show Details)Jun 9 2020, 15:33