Electric Skateboard Builders Forum backup data

1

I decided to create a separate topic for this. Last Sunday I spent some time to back up all forum data for preservation purposes and store it on Github.

Today I created a simple human-readable version.

The simple backup in JSON format with basic data:

and the human-readable version for the latest version:

I will try to run the dump once a week at least to keep data up to date.

Dump data is until: 2020-02-16 03:47

34 Likes
2

Thanks for doing this. Many have tried!

2 Likes
3

No worries, I will try to find a way to save images too somehow. First trying to calculate the size of all images to see whats options…

4 Likes
4

Thanks for doing this…!!! I understand the effort involved!!! I’t much appreciated… you/we/they need to figure a way to save, and preferably link the images… faaaaaaaaaaaaaak… I was just trying to copy ONE thread, and the images linked are not the same file name in the text link…

WTF!!!

or maybe I was just high!!!

2 Likes
5

I think i got a list of all images with sizes and its around 30GB I think later on I will try to put everything in github as I think Github repo size limit is 100GB total…

6 Likes
6

thanks for this! I want to spend some time on this try and extract @b264 Q&A sets into something usable for an Alexa skill :wink:

5 Likes
7

I did a run a while back and it is way over the 30gb.

8

Did u included all img sizes or just single? Because if u include 1x, 1.5x and 3x it’s should be like 3x of size :slight_smile:

P.S. I only included the ones uploaded into the forum not linked ones.

1 Like
9

There are total 78,854 upload://****.** tags in posts with avg img size 0.5MB it’s should be around 38.5GB

1 Like
10

Interesting, but whats the purpose of this again? :thinking:

11

No idea when old forum is going down as Enertion is sinking ship :slight_smile: If they don’t pay anymore all data will disappear from internet :slight_smile:

1 Like
12

Gotcha.

13

That is indeed possible that the program included all those 3. It was just some freeware I was testing out.

1 Like
14

I tried this with httrack but it crashed. Great that you did it!

15

Awesome work @Kug3lis

Curious if your question has answered itself recently? Cheers!

3 Likes
16

builders is up right now i see, sorry to bump this thread its good to know such backup exists :smiling_face_with_three_hearts:

1 Like
17

So is GitHub the new Internet Archive? I heard TIA got hacked.