And we're back! 12.5 minutes! I said it'd be less than 15 and it was. ;-)
#adminstuff #fediadmin #firefish
A critical security vulnerability was fixed today in #Firefish (the software that powers nsfw.social and nsfw.lgbt). The developers are urging all instance admins to patch ASAP.
If you're curious, more information is here:
https://info.firefish.dev/notes/9sp24cf0zugjued4
Doesn't look like the patching/ upgrade is too intense so hopefully downtime will be kept to a minimum. I'm figuring 15 minutes. Look for me to make an official announcement tomorrow with a 1 hour countdown.
It sucks with all these little interruptions but keeping systems exposed to the internet regularly patched and updated is just a fact of life.
#fediadmin #adminstuff
Apologies everyone for the utter and complete lack of stability and downtime today with [nsfw.social]. Not sure what happened but suddenly over the past 36 hours queries to the database were taking too long and timing out which was having a cascading effect across the board.
In other words, the worse the problem was getting, it was only compounding things further.
To remediate the issue I've stood up a new database server.
Expect some more downtime on Saturday (tomorrow) as I tweak things a little more.
As always let me know if you notice any weirdness.
And again, please accept my humble apologies.
@mike30030@nsfw.social
#fediadmin #adminstuff
We made some changes to the databases earlier today to hopefully take care of some mysterious slowness that were plaguing both nsfw.social
and nsfw.lgbt
. As always please DM me if you notice anything weird but so far so good and the site is much faster now too! Woo hoo! #fediadmin #adminstuff
And we're back! 'nsfw.social' has been upgraded to the latest version of #Firefish. Please send me a DM if you run into any problems! #fediadmin #adminstuff
Attention nsfw.social
peeps... In about 20 minutes or so I'm going to be bringing nsfw.social
down to perform it's upgrade to the latest #Firefish version. But given how everything has been going these past two days that is a very rough estimate. Hahaha! So don't freak out when the site goes down. It's all good! #fediadmin #adminstuff
And we're back! Sorry for the extended downtime. Things took a little longer than I anticipated, but nsfw.lgbt
is now running the latest #Firefish version with new hardware to boot. Please let me know if you run into any issues by sending me a DM! Thanks! #fediadmin #adminstuff
Next up... nsfw.social
..............
Getting ready to bring nsfw.lgbt
down to migrate it and its database to a new server and upgrade Firefish. Total downtime should be about 30-45 minutes unless the shit hits the fan. #fediadmin #adminstuff
Going to be taking nsfw.social down tomorrow morning (before lunch in Atlanta) to #upgrade it to the latest #Firefish version. My business partner and I just finished upgrading our safe for work instances this afternoon and the upgrades went relatively smoothly. There were a few minor hiccups but we now know what to look out for. We learned a lot. I expect downtime to be about 30-45 minutes per server and that's mainly because once we begin I have to take the database offline and it has to stay offline until we're finished. #fediadmin #adminstuff
Morgen neuen Proxmox Cluster mit lokalem Ceph live nehmen. Weiß nicht ob ich mich mehr auf #TGIF oder auf den #Cluster freue ;) #nerdstuff #server #proxmox #adminstuff