Nau-Zee-auN:
on 3D video sampling?

Video sampling is the playing of recycled video clips, triggered by either a sequencer or a midi controller (i.e. keyboard, drum interface, etc.). The first midi controllable video sampler was made by the band Emergency Broadcast Network.

Here's one sample of what they did with it.

Now take Video Sampling and add 3D. I'm sure you've seen 3D movies where you wear special glasses that filter out imagery intended for each eye before. This is the same idea except that each eye sees a different perspective from a different clip every time a drum is struck or a key is pressed.

How can we sample 3D video? We couldn't reasonably use standard 2D television and movies to generate 3D video samples, so we had to shoot 3D video ourselves. For the first performance 8 hours of twin camera footage was shot, kept in sync and meticulously edited to create 3D video samples.

Why are there no samples of this online? For the same reason that you don't see color 3D movies online. Your monitor is not typically able to break down the left and right eye information into overlapping polarized images. We could make a black and while 3D example using red and green or red and blue glasses but it's not exactly the same experience.

How to do it:

You will need

  • 2 video samplers (software or hardware)
  • 2 matching DLP video projectors (2000 lumen or greater brightness)
  • 1 silver projection screen
  • 1 dual projector stand
  • 2 matching video cameras
  • 1 stereo camera bar
  • 1 tripod
  • 1 pair of linear polarized filters for the projectors
  • enough linear polarized 3D glasses for your audience and band members
  • video editing software
  • audio sampler(s) (software or hardware)


Part 1: Planning.

What do you want to do? What do you want to use? What would you like to sample? Where do you want to go to shoot?

Part 2: Shooting stereo footage to sample from.

Mount your 2 cameras on the stereo camera bar and mount the bar on the tripod. Use external mics where needed and mark which tape is recording for which eye. I recommend using an audible sync point that can be a count down and a hand clap in front of the camera in order to make sure that editing begins at the same point for each eye. Shoot your footage and mark what everything is.

As this is to create music I recommend taking into consideration getting as high quality an audio recording as you can on at least one of the cameras.

Part 3: Editing samples.

You can use any video editing software that you like but we used Adobe Premier. I used a naming convention that ended in L or R for which eye footage was shot for began with an indicator of the source tape and the sample's beginning time code (with 00:00:00:00 being the sync point).

Be sure that your final export of the video samples has correction for alignment and rotation or else you will cause eye strain for your audience and yourselves.

Part 4: Testing and practice.

Select a few test samples and load them into your video and audio samplers. Chain your midi cables together so that your controller triggers the video for each eye and the associated audio sample simultaneously.

Once you have this working, hook up and align your video projectors and linear polarized projector film. Test the 3D clips while wearing the glasses and shooting at your silver screen. Note: if you do not use a silver screen, it is likely that the surface you project on will depolarize the projections before they bounce back to your 3D glasses. We learned this the hard way.

Part 5: Take it to the stage.

If everything works as planned, refine your act and when you're happy with it book a live show.

back



more photos at http://www.myspace.com/nauzeeaun