pouët.net

Lossless demo kkapturing

category: general [glöplog]
So I've been recently interested on capturing my demos, but with lossless video this time and just wanted to share the results here for those people that are archiving demos.

I've googled a bit the issue and this pdf is the best comparison I've found (also suggested by dominator, thx thx!). I also checked wurstcaptures guide but didn't helped much in this case.

So far I've only captured r08028

And the best compression was using Lagarith using YV12 color space - 1024x768 @ 60fps = 5gb

The cool thing is that it also plays fast (on windows media player, vlc doesn't support the format (yet)), specially using YV12 color space.

Another cool thing is that you can encode it directly with kkapture using the ".AVI (DirectShow, *unstable*)" option. Otherwise Virtualdub does the job too.

HDD are quite cheap and big these days so I can just have them lossless on a HD. 5gb x 64 demos = 320gb, not a hard price to pay for having all of them in 1:1 quality.

Well, that's all... hopefully this wasn't something everyone already knew...
added on the 2009-07-03 01:56:30 by mrdoob mrdoob
lagarith is pretty awesome on multicore machines since it scales properly, which most other lossless codecs don't.

a small niggle is that YV12 isn't really lossless, but it's a no-brainer if you're capturing video to encode with a lossy codec afterwards since most codecs include the color downsampling step anyway. an exception would be if you plan to resize before encoding, in that case it's better to stay with rgb for the first pass.

i used lagarith with YV12 in 1920x1080 60fps for the scene.org awards captures this year. at that resolution and framerate, basically anything is painful, but lagarith did pretty well. lack of widespread support in non-vfw/dshow tools is a problem right now, but that's only gonna improve over time.
added on the 2009-07-03 02:17:42 by ryg ryg
If you capture demos using DOSBox, just keep the zmbv-encoded files it spits out. It compresses pretty well at low color depths and old-demo-like content.
added on the 2009-07-03 09:24:28 by raer raer
@trace: if you've got the hardware to run the demos, then why capture them for personal archiving? they'll take up way less space archiving them as executables.
hardware doesn't last forever.
i think it would be a good idea to start building an archive of lossless videocaptures of demos.
added on the 2009-07-03 14:39:47 by nosfe nosfe
Nosfe has leading.
added on the 2009-07-03 15:01:51 by gloom gloom
You can't run the exe if you're not on the right OS too. Or the right platform (I'd love proper videos of a lot of oldschool stuff).

How is playback for HD lossless captures these days? Are hdds and the bus fast enough for playback at 1080p60?

Also, yes: an online archive of lossless demos would rule. It'd also be very hdd + bandwidth hungry unfortunately. I guess it would become a real archive though: something you refer to only if you really need to, because you just wouldn't want to download many GBs just for a quick watch.
added on the 2009-07-03 15:03:47 by psonice psonice
@hooverphonique: what nosfe said.

My motivation was the fact that I've captured some of my demos in many formats that get obsolete in 1-2 years. Whenever a new video format gets default I can use the lossless videos as start point (without having to capture the demo again).

On top of what nosfe said, I've been using linux/ubuntu for 2 years already. I barely use Windows now, so I though I better started archiving in video the demos before it gets more complicated. Just look at what the mindcandy guys had to do.

Regarding the online archive, is that something that the scene.org guys can start to consider?

Have you guys heard of bandcamp.com? It's a website for musicians. What I liked from it is that you upload the audio in .flac, and then the website will create different versions of the file for the people to download.

Although on bandcamp you can also download the .flac, I think in this case isn't really needed. So the bandwidth won't be that much (or not as much as it could be), as there will only be upload of huge files, people that want to download/watch the demo will get a h264/theora back from the server.

Maybe could be something for demoscene.tv to consider instead?
added on the 2009-07-03 15:24:48 by mrdoob mrdoob
Very good idea. Stuff that would be important (to me at least..):

- 1080p (preferably 60fps) supported. I know that's pretty heavy, but a few years back 640x480 was considered heavy too, and now it's the bare minimum.
- The original files are preserved, and available for download. Of course you don't want people downloading the 10gb file when the 100mb mp4 is good enough, but it should at least be available on request (e.g. if you're doing a demo dvd, it makes sense).
- It's properly backed up!
added on the 2009-07-03 15:41:17 by psonice psonice
Trace: feel free to start adding the content, that's what the archive is for. :) When it comes to actively doing the capturing, that's probably not going to happen any time soon.
added on the 2009-07-03 15:45:03 by gloom gloom
gloom:

So you're saying that scene.org is up for hosting the files on the ftp?

In that case, how should it be sorted? on the same folder?

/pub/parties/2003/breakpoint03/demo/3s_r08028.zip - 9mb
/pub/parties/2003/breakpoint03/demo/3s_r08028.avi - 5gb

I didn't meant that scene.org should do the capturing, capturing should be crowdsourced. We just need one place to upload the files to.

Random people is capturing demos these days, but they are uploading to random sites with random file formats, I'm sure those people won't mind doing captures to lossless hq and uploading to scene.org instead. And then themselves or someone else recompress to mp4 to upload to youtube.
added on the 2009-07-03 16:14:13 by mrdoob mrdoob
I don't know what the sorting should be like, but if not like you suggest, then perhaps a symlink at least to the higher res version in a dedicated directory (or just some other way to find the leet files). Someone with more insight into the archiving functions of Scene.org would have to take a look at the math of course, but yeah, I'd say it's an interesting idea.

With regards to the crowdsourcing - totally. It would just have to have some sort of easy entrypoint for people who want to upload such files. This would probably include checking for duplicates in some way, as well as provide a list of desired codec and resolution settings. If one is to archive, it's better to do it right than to do it fast.
added on the 2009-07-03 16:41:40 by gloom gloom
If somebody intends to do the "import the lossless version and re-encode it"/"auto-upload it to youtube"/"etc" website, the files should all be in one folder with symlinks next to the actual demos. That way a regular scan of the folder is possible.
added on the 2009-07-03 16:44:29 by psonice psonice
I'd also like to congratulate you on the incredibly leet topic number - kudos :)
added on the 2009-07-03 16:46:05 by gloom gloom
hmm, what kind of diskspace is available for this?

i don't have complete vidcaps for all scene.org awards 2008 nominees anymore (didn't have the space), but i do have a large number, probably around 200gb or so of quality lossless material i just need to enqueue in my ftp client :)
added on the 2009-07-03 18:14:51 by ryg ryg
What's so leet about 6581?
added on the 2009-07-03 18:16:26 by mrdoob mrdoob
Ut-oh, I sense newskool nescience! (no offense :))
I should google more often.

Anyway, gloom, if there are any news from scene.org side and/or guidance of how we should proceed, let us know.
added on the 2009-07-03 20:08:40 by mrdoob mrdoob
And, specially, if you find out how much space is available ;)
added on the 2009-07-03 20:09:11 by mrdoob mrdoob
...now if I only hadn't deleted all the raw videos of the captures I have done to make space for pr0n... ;)
added on the 2009-07-03 22:47:15 by raer raer
*BUMP*
added on the 2009-07-28 14:56:21 by mrdoob mrdoob
i'd be willing to help doing some captures if there's a designated space where to upload. is scene.org really ready to take that much? (for example the fullhd vidcaps of cognoscere and cannapaceus are about 35gigs each, and that's on 25fps)

also, maybe some decision on the exact codec and such,
1080p@60fps should be fine?

i also think that the fullhd caps dont need to necessarily be available for public download, unless there's really enough bandwith, but on request for people who are doing demodvds/demo screenings/other projects that they need them for.

auto-uploading to youtube/other videosites might be a very nice feature indeed.
added on the 2009-07-28 19:06:31 by nosfe nosfe
one thing that's a bit crap with vidcaps though: they ruin the aesthetic that the creators had in mind, since you can rewind/fast-forward through it. I watched moralhardcandy so many times just for that one particularly brilliant part of an effect, which would be sorely ruined by watching it on video.

oh and it's a little absurd to spend many gigs of diskspace on a 4k :o) - in a world of infinite disk space and infinite transfer speeds, perhaps.
added on the 2009-07-28 20:39:38 by farfar farfar
nosfe, scene.org at this point is discussing upgrading disk space not in the next weeks..
added on the 2009-07-28 20:42:49 by _-_-__ _-_-__

login