We’re glad to announce we have opened our forum board today! You can join now! New exciting news soon!
As we mentioned in the last post we’re going to explain how to migrate your site to another host if you’re hosted with us. In normal circumstances we have enabled backup option on cPanel but we had to disable it for security reasons, as we don’t know many sites will be migrated we had to temporally remove the option as it could slow down the server, produce small downtimes or in case there were a lot of migrations it could exceed server’s memory. How do we’ll proceed?
Sign up in our client area (my.fan-village.net), open a support ticket under Backup Request’s helpdesk, mention all sites you want to migrate and provide us cPanel log ins details of your new hosting account or instead a ftp account (you can create it on cPanel and then remove it, please, only one account, we’ll send all backups there so your hosting company can restore all of them), we’ll do it fast, so in less than 24-12 hours your backups will be there, time will depend on the amount of sites you have and its size .
In a week backup option will be available again for all users, understand we do this so hostess who decided to stay won’t suffer any downtime or server low-speed, after the issue we don’t want them to have any more issues. Security and performance is important for us and we want to keep providing good services.
Of course, any issue or doubt contact us and we’ll be glad to help you!
UPDATE (26/08): Backup option is avaliable for all hostess again
It’s been two days since the situation came back to normal and we wanted to provide a detailed explanation of the issue. At the beginning of the week -as every night- our server checks if there’s updates avaliable -updates from OS (in our case CentOS 7), RPMs to cPanel versions-, there was a new cPanel version avaliable and some others scripts updates so cPanel automatically started to update everything, issue starts here; since memory usage (RAM) was high the updates increased it and made it surpass its limits turning the server down, in normal situations this wouldn’t affect anything, server would just have a small downtime but as there was an update going on cPanel and OS failed, most of the sites were still browsable but some of them weren’t and cPanel wasn’t working at all.
What we wanted to do first -and the easiest thing to do it- was buy another server and use the transfer tool that cPanel provides to move accounts over, that would only take ~2 hours if not less, unfortunately due to the failure update “transfer tool” wasn’t working, what could we do? Reinstall the server and restore all the sites from our backup server using the script we use. Here comes the second problem, the first problem of this second problem was that It was impossible for us to reissue the license from script’s client area so it was impossible for us to access the script from WHM, after they reissued it for us we noticed that old backups didn’t show up in WHM, reaching the script developers they told us that the script database was hosted on “the old server” not the storage one making it impossible to restore the accounts right away, we got really pissed off and mad at them since before purchasing the script we asked everything about it and they did not tell us that. How can a script backup every single file of a site and its databases but not backup its own database? who was the genius that thought that? – We told them – What could we do next? Hire one of their programmers to manually rebuild the database so we could restore all sites, we could also restore site to site the backups but that would take much longer since the backups are not full backups but incremental backups. Things didn’t work out as we expected, rebuilding the database didn’t work either but we had another solution that could at least speed things up as the other solution was manually restore everything.
We want to also point out that the issue could have been also solved faster if we had only restored monthly backups and not daily incremental ones, but we understand how much effort do you put in your site(s) and we had to restore all files. We made a mistake not making an announcement earlier, that won’t happen again, but we did reply everyone who emailed or dmed us with all information we had at the moment and we kept them up to date with the process until we started to update vía Twitter, also we made clear on the first reply that there wouldn’t be any data loss.
Now that everything have been solved, we have created our client area, you need to registrer through my.fan-village.net, on the support board you can ask for help, log in to cPanel, change cPanel password and a few other features. Client area is hosted on another server so in case the server goes down you will still be able to access to it! Also, we will be able to send emails to all hostess with the mass mail tool the client area has. We want to let you know that we’ll also be installing a forum soon and a new responsive theme will be installed along a tutorials center for newbies.
We have also replaced our old backup system to JetBackup -which as proven- is better than the old one we used, so in case this happened again -it won’t but just in case- the issue would be fixed in minutes. We have also increased the RAM on the server.
click to zoom
We want to apologize again for the issue, sadly, this things happens and the only thing we can do by our end is fix it and improve. We love Fan Village as much as you love your sites, well.. we even have our own sites hosted here and as you may know, we don’t want to loose anything. We want to remember that we have been online for 10 months and all prior months we have had 99.9% uptime and we want to keep it that way.
For those who still want to move to another hosts, we’ll be making a new post about how to migrate your sites, if we own the domain you can also migrate your site, we can push the domain to your new hosting or to you.
I’m writing this due to the situation Fan Village is having right now, I’ll start from the start. Two days ago due to a cPanel update our server exceeded memory usage during the update that messed up the whole cPanel installation and somehow the OS of the server that made that anyone could enter on their cPanel account also there was some content missing in some accounts (including Fan-Village.net wordpress directory)
What I wanted to do and the easiest thing to do was buy another server and use the transfer tool that cPanel offers to move accounts over, that would only take 2 hours, unfortunately due to the failure update that option wasn’t working, what could we do? Reinstall the server and restore all the sites from our backup server using the app we use to do so. Here comes the second problem, the first one is that It was impossible for us to reissue the license, after they did we noticed that old backups didn’t show up, reaching the script creator they tell us that the script database was hosted on the cPanel server not the storage one making impossible to restore the accounts right away, I got really mad since before purchasing the script I asked everything about it and they did not tell me that. What can we do? Hire one of their programmers to manually make the database so we could restore all sites, we could also restore site to site the backups but that would take much longer since the backups are not full backups but incremental backups.
We couldn’t be able to reach anyone of you for various reasons: not being able to log in to WordPress or not having any tool where we could send mass emails. We replied to everyone who sent us an email and we’ve been updating with the whole situation. We know how much stressful this is for all of you, but trust me not only for you, we’ve been working to fix this issue since it appeared, non-stop, almost not sleeping. We’ve also learnt from our mistake and we’ll be setting up a client area that will be hosted in other server so we can always reach every single one of you in case anything happens.
We’re still working on bringing the sites up and running, data is safe, don’t worry about it. We understand if you want to leave after this incident and we won’t do anything to stop but improve our services and provide the best service we can, trust me this is being as stressful for me as it is for you or even more.
UPDATE 1: Sites are starting to being restored, please, we know this is stressful but it may take some time.
Update 2: Almost all sites should be up, there are some with missing files that are being worked on and restored as soon as possible.
Update 3: All sites should be up, if any of your sites have any issue, please reach us through DM or firstname.lastname@example.org