Skip to content

2025-12-17 Moji Down#

Symptoms#

We had two simultaneous alerts at 8:36 about query.openfoodfacts.org and robotoff.openfoodfacts.org backend being no more reachable (gateway timeout).

Actions#

Alex and Raphaël checked:

  • if the dockers were running on the docker prod VM on osm45 (VM 200) and if the apps where locally accessible (using curl)
  • if the stunnel were running, on the different servers:
    • stunnel-server on ovh proxy (acting as a client, only serving on 127.0.0.1)
    • stunnel-client on off2
    • stunnel-server on osm45
  • then they try to check connections between the servers using ping and mtr

The last point show a problem, with osm45 ipv6 as well as the stunnel-server ipv6 on osm45 not being accessible. Also pinging google in ipv6 from osm45 was not working.

While trying to understand what was happening, after some time it magically begin to work again progressively.

Resolution#

Raphaël found that it was indeed a planned maitenance at Moji. The information was available at https://mojistatus.fr/

I subscribed myself and root - at - off to the notification for the next time !