SteemDB Migration - ETA ??

in #steemdev7 years ago (edited)

Once again, just a quick post to keep you all informed.

I'm currently migrating SteemDB to a new server. To keep the transfer rate at it's maximum throughput I've disabled the site and it's APIs. I'm not entirely sure how long this process is going to take due to how I'm being forced to perform the migration (due to the limited resources of the existing server).

It may complete overnight or it may take a day or two, but I'll have a more formal announcement once this process is complete and the new server is live.

My apologies for any disruptions this may cause!


Update #1 - 2hrs in and 6gb of 92gb transferred. If it maintains this rate, It'll be around 30 hours total for the transfer. The outbound traffic from the server it was on is abysmal, I could have mailed a USB drive faster.

Update #2 - ~17hrs in and 36gb transferred. Seems to have slowed a bit, glad to be moving out of this data center :)

Update #3 - 47gb transferred, over half way done. Looks like it's going to be on the longer end of the spectrum and take a little over 2 full days, maybe up to 3.

Update #4 - 62gb of 92gb completed, about 48 hours in. I'm going to assume that another 24 hours will complete the transfer and sometime on Friday I'll be able to complete the final steps and bring the site back online. What a painfully long process.

Update #5 (last one) - DB migration is complete and I'm firing up the services on the new server and migrating the DNS. SteemDB should come back online soon (next hour-ish), but it'll probably take a while for the database to fully sync back up to todays date. I'll make a new post outlining all of this once I've completed all the manual tasks that I need to perform.

Sort:  

Thanks for the heads up, @jesta. Are the recent SteemDB headaches the cause of a lot of downstream app problems for other Steem tools and services? Seems quite a few rely on your site and wondering for my own education how it all links together.

Nope, this one's unrelated to that. SteemDB has been suffering for a month or so simply because the server it was on had reached it's capacity while Steem itself had a very busy month.

Understood, and thanks. Just seems quite a few tools are having some issues recently. Appreciate the insight.

thank you for informing us @jesta you are the best ;)

can you make a post on how this migration can be done would be a little informative because I am kind of always curious how stuff works

a database, depending on the underlying technology, is basically a collection of files that represent the data contained therein.

A migration usually involves copying those file(s) to a new server - so first the new server (installation of underlying database software) would need to be set up, the files copied over, attached and loaded into the new server software, and then all database references in software will need to be repointed to the new server address (or DNS entries changed, etc.)

that's a very quick explanation, that's rather technology agnostic - obviously it can vary due to a number of reasons but this is the basics of it.

Pretty accurate representation of what's going on here.

It's nothing innovative or exciting - the exciting part (the blockchain) doesn't have to be migrated :)

Thank you :)

yeah i've never worked with blockchain before so i guess i should have added the caveat that my description of the process is limited to old world technology :)

thanks indeed that gave a little idea

oh this thing was new for me on steemit i am new and still learning about steemit that how it work.and @farq you explain very well.

Thanks @jesta! I often forget just how many things I use on a daily basis are thanks to you... from SteemDB to Vessel to ChainBB. Appreciate the update and hard work.

Takes a village!

Thank you, @jesta for the information

Thank you @jesta! You've given the steemit community some awesome tools. Hope the migration runs smoothly for you.

Thank you for keeping up with the whole community I wish you luck and I look forward to your return

Thanks for information by @jesta .I hope your work goes well..

And I am currently doing this post resteemed.I will make sure that my followers are informed.. @jesta

Apologies accepted 😊
Thank you for informing us.

Okay and Thanks for the information. I am daily using Steemdb.com for getting live informations and data of my account but since two more days i am disappointed. that's ok i am awaiting.