Anyone into 360 n stitching?

category: code [glöplog]
Howdy people.

I'm working on a docu/art project where two separately shot 180° images will be combined into a single full 360° field of view.

Those will include corresponding indoor and outdoor locations on two sides of Ukraine frontline as well as synchronized performance between two theatres of the cities of Dnipro and Donetsk.

I have just started researching the technical side of all this and will probably be using 220° or 250° lens to capture -- and there are lots of questions on how to go about stitching and space for creativity.

I am looking for someone to involve in post-production (as well as some preparatory considerations) and Pouet is obviously my first call ;)

Besides challenge and fame, there's some money involved too.
added on the 2017-05-21 00:53:19 by raver raver
how are you planning to manage sound?
added on the 2017-05-21 01:53:25 by gman gman
Only have the basic idea of mixing it accordingly to the viewing angle.
added on the 2017-05-21 05:27:18 by raver raver
I'm definitely not your guy but wow that is very cool. Hope it works out awesome!

Feel free to share work-in-progress material here :D
added on the 2017-05-21 13:35:26 by skrebbel skrebbel
Hey Skrebbel, thanks for your interest ;)

Maybe anyone you know who might be into this? Would be really good to find someone from the scene rather than some random geek..
added on the 2017-05-21 16:11:06 by raver raver
hey raver, what a surprise to see this post here! =)
have you tried posting in the obvious demoscene groups on FB? some of them have a bigger outreach than pouet by now, i think. if you're not in there, i can add you.
hope you're enjoying dnipro, sorry for not being able to be there too (end-of-semester stress @ uni right now).
added on the 2017-05-30 18:41:40 by dipswitch dipswitch
Oh no, FB taking over pouet? I always had this feeling that demosceners hate FB :D

No, haven't tried yet -- will do though, and if you can recommend some most active ones, great!
added on the 2017-06-01 13:48:27 by raver raver
added on the 2017-07-09 18:46:51 by raver raver
Would be interesting to see the result.
Too bad I´m not much into photography, though, but have you tried http://wanted.scene.org/ already?
added on the 2017-07-09 21:23:10 by T$ T$
Hi raver! Long time no see. I just wanted to drop a line that the project sounds really great! IMHO spend the money you have on a camera that will do auto stitching for you. You just need to do a little search. They're getting cheaper and cheaper.
added on the 2017-07-09 21:38:44 by bonzaj bonzaj
Bonzaj, mate -- good to hear from you!

There's no point for me to use any of the readymade 360 solutions as I am shooting the two fields separately. I can cover 220° in 6K with the camera/lens combo that I already have.

Stitching in itself is also not difficult at all, most of the process is automated and you can just step in and adjust where you see fit. The thing here is, I need this to be done creatively which quite possible will require development of custom software.

Also, from what I know, most of the multi-lens cameras or preconfigured rigs still doesn't do the stitching, they just come with specific software or a profile for Kolor Autopano for that purpose. Only extremely expensive ones for live streaming applications will do realtime stitching in camera.
added on the 2017-10-09 02:08:36 by raver raver
NVIDIA released some real-time stitching toolkit in their VRWorks SDK - https://developer.nvidia.com/vrworks/vrworks-360video . Note the extremely high hardware requirements - for live stereo stitching they ask for dual 1080tis... for mono you might be OK with real-world hardware though.
added on the 2017-10-10 09:36:46 by smash smash
Smash, are you into this kind of thing?
added on the 2017-10-11 01:23:37 by raver raver
not exactly :) we do a lot of 360 video in Notch (www.notch.one), but the focus is on rendering 3D content, and processing already-stitched feeds. we don't do any stitching ourselves.
added on the 2017-10-11 10:14:00 by smash smash
I see yeah, that's an interesting company/service!

Bit on the edge here as the filming will start next week and the work-in-progress presentation is mid-November -- so many aspects of this to take care of and still unsure about technical solution.
added on the 2017-10-11 16:00:18 by raver raver
How exactly would you stitch them if they are shot from two differents scenes with arbitrary poses ? :/
added on the 2017-10-12 00:46:44 by Buanderie Buanderie
Not 100% arbitrary as the stitching aspect will be thought of at the time of shooting, to an extent. Still, you can stitch anything :) And there are many ways to do it creatively, e.g. using masks, different kind of blending, etc
added on the 2017-10-12 14:51:17 by raver raver
Like these two:
added on the 2018-01-10 18:44:45 by raver raver
Pretty cool :)

Wonder whether the steep brightness change on one side could be fixed.
added on the 2018-01-11 22:58:22 by T$ T$
Everything can be fixed, it just depends on how much resources (time/money) are to be poured into it.. This is a quick hack and for now it will stay at that as I need more/better footage to warrant going any further.

I couldn't get to Donetsk myself as I am hopelessly blacklisted with the People Republics' -- so I hired a fixer and one Italian photographer with accreditation, handed them the kit and detailed instructions at the border, then having to rely on what they'd get, which ultimately wasn't all that good or enough.

Still undecided as to if I want to set up another shoot -- quite possibly will just proceed to the final phase.

added on the 2018-01-12 01:00:29 by raver raver
The distortion always kills it.
added on the 2018-01-12 19:30:19 by EvilOne EvilOne