Backing up demos with ipfs - good idea or shit?

category: general [glöplog]
First impression from quickly browsing URL's: Lots of stuff that should be fixable :)

Is there any chance to get this doc with prod ID's included? (Or even better, the full prod URL so lazy me can click straight into the prod from Excel :))
added on the 2016-12-18 23:52:37 by havoc havoc
Thanks, that'll work :)
added on the 2016-12-19 00:30:13 by havoc havoc
There's a fair amount of files that can be changed to scene.org, too, but I guess you're already on top of those? I understand that e.g. “intro.zip” probably is a false positive, but there's stuff like “i_want_to_evolve_by_primitive_windows.zip” that's quite unlikely to be anything else :-)
added on the 2016-12-19 10:53:11 by Sesse Sesse
In cardboard, the first port of call in case of a deadlink is always the scene.org search button and that has served hundreds if not thousands of fixes already. I'm not sure if we should steer towards mandatory hosting at scene.org though, some folks actually seem to enjoy running their own servers or archives and I think that's something we should want to support. I do, however, think/hope that scene.org will/should aim to mirror/host a lot more than it currently does- e.g. the amigascne mirror is there, and some old C64 ftp's, that's great, so why not mirror Lotek's archive as well. And that 60meg zip with sizetros. And that Hungarian page which has all the Enterprise demos known to mankind. And and and. LET'S MAKE THE SCENE.ORG GREAT AGAIN :P
added on the 2016-12-19 13:57:33 by havoc havoc
Yes, that's what I assumed you were already on top of them :-)

I'm a bit worried about CSDB (it hosts a bunch of stuff, appears to have no mirror and are seemingly not amenable to crawling), but supposedly they have backups.
added on the 2016-12-19 14:46:06 by Sesse Sesse
Also, if you want to be a mirror of ftp.gathering.org (234GB, grows a bit every Easter :-) ), do let me know. I have backups, and most of it is already dual-uploaded to scene.org, but getting the bus factor down is always nice.
added on the 2016-12-19 16:59:25 by Sesse Sesse
I don´t know if you got the news already...
...Dropbox will shut down the "public"-folder for free users in March 2017 !

So be prepared for massive amounts of broken links coming in! ;)

Sesse: maybe you should concentrate on backing up all those dropbox-links safely first!
Thanx for the action btw...supergood for the whole scene! :)
hardy: No worries, everything was done mirroring the first night, so no need to prioritize. (Everything that was actually available, that is. Everything else is retried on a weekly basis. Apart from that, it's just a matter of picking up new URLs.)

FWIW, current status of all Dropbox URLs in Pouët:

136 OK
5 File Not Found
5 Bandwidth Error / Too Many Requests (basically that the user is over serving quota, might get fixed on next crawl)
2 Restricted (no idea, I suppose it means they removed permissions)
added on the 2016-12-19 23:48:07 by Sesse Sesse
Thats way less dropbox-links than i thought there would be! ;)
All fine then! Good job! :)
I ain't no Sesse but at least I tried ;)
added on the 2016-12-20 00:21:52 by havoc havoc
Hah, but you had six of the 12 missing prods! Perhaps you want to submit some corrections :-)

FWIW, the Dropbox prods you have that I don't have are:

Code: http://dl.dropbox.com/u/13017436/npli-tv_noise_symbian3.zip | 404 Not Found http://dl.dropbox.com/u/20952875/Releases/FlipFlopCubes.zip | 460 Restricted http://dl.dropbox.com/u/33189328/chip16.zip | 429 Bandwidth Error http://dl.dropbox.com/u/40173931/sokoban%204k.zip | 460 Restricted http://dl.dropboxusercontent.com/u/33189328/CGAdots.rar | 429 Bandwidth Error https://www.dropbox.com/s/q2584wxu1wkov0u/laby.zip | 429 Too Many Requests
added on the 2016-12-20 00:27:01 by Sesse Sesse
All fixed :)

Could I convince you to do an analysis of that 60mb ZIP file with size intros? I already fixed a whole bunch of deadlinks with the contents of it but progress was slow because navigating the folder structure was a bit of a bitch. (Don't have the file on my laptop but I'll be glad to dig it out over the holidays :))
added on the 2016-12-20 01:10:20 by havoc havoc
If you can dig out the file and tell me exactly what kind of analysis it is you want…
added on the 2016-12-20 01:22:28 by Sesse Sesse
Are you talking of Hardcode maybe?
Filename comparison between the archive contents and currently missing files- I'm guessing that's how you narrowed down the 6 files above(?). The archive follows a consistent format with platforms and size categories as directory names so analysing that is also a theoretical option but I don't see the need for that right now (maybe I'll be less confident if it turns out I missed a couple hundred of prods instead of the maybe couple dozen I expect ;))
added on the 2016-12-20 01:52:51 by havoc havoc
With 12 missing prods, it was easy just looking for them in turn. So manual work there.
added on the 2016-12-20 09:46:06 by Sesse Sesse
found a broken link universe intro in that hardcode archive atleast! searching for more :) thanks for the protip, didnt know about hardcode :)
added on the 2016-12-20 20:32:51 by psenough psenough
more people should know about hardcode.zip
If it's Hardcode, it's going to be hard to use it as a replacement for a broken Pouët link, since it contains unpacked intros, not the original .zip/.rar/whatever. You could do a repack, but it would seem like a last resort.
added on the 2016-12-20 23:35:26 by Sesse Sesse
well, considering i cant find the universe intros anywhere else at all, repacking them doesn't put me down much
added on the 2016-12-21 03:11:39 by psenough psenough
Integrate Pouet's submit feature with scene.org upload to both prevent dying links and ease the submission. Please.
added on the 2017-01-11 13:10:03 by rutra80 rutra80
Ok so I added a prod with broken link so I uploaded it to scene.org ftp incoming directory and... now what?
added on the 2017-01-13 20:39:16 by rutra80 rutra80
rutra80: did you read the welcome-informations at the ftp? if so and the thingie is in a correct directory (or you made one) you have to wait until it got proceeded (added to the directory for the public). can take a few hours up to a few days. then you can grab the link and change the link here at pouet. scene.org is no FAST solution :)
I did read it but it's not very helpful. How do I "grab" the link?
added on the 2017-01-13 20:45:19 by rutra80 rutra80