Performance Video – Testers and tryouts
I have given up on the idea on creating a 3D mask for the project as my maya on my laptop kept on crashing. So it failed quite a bit.
This would be the final thing I’ll be using for the projection. As I use after effects to equality spread them out so I can use Madmapper to map which videos I would like to project onto the wall. 
These are little bit I’ve added to the after effect projections.
These are video would I’ve sync with audio.
This would be the “Happy” dream
And this would be the “Nightmare”
This an image which I’ve took to to show the project which I projected to the wall.
This anther image of the projection which I’ve created that I did a mesh on changing the shape.
this would be a test projections on boxes which I’ve done
Performance video – 3D mapping designs & audio
Since I finally chosen my idea of what kind of stuff I want to do. I’ve going to 3D map on the theme, Dreams. Considering on what to project it on. I plan to project it on a white mask.
Considering how it would work, I’ll be using mad mapper to map out the mask so when the video is projected, it would be projected on the mask. Also I’ll be 3D maya creating the mask to create an intense feeling of it looking at you.
Videos that I got are videos which I’ve randomly recorded. I want to present that videos as a dream. It’s random and you never know what’s happening but you just see continuously images that you’ve see and visited.
Also I’ll creating simple designs on after effects to sync with the audio that I’ll be making.
Audio wise, I’ll be using garageband to create the song that would have the beginning of the song beautifully then it turns emotional turning the video to speeding up.
Performance video – ideas/concept/research/how to do this
It took me a long while to think of ideas for this project as I haven’t thought of any ideas in a long while.
Continuing thinking ideas and there’s one that I’ve thought of which is using body tracking to create sounds or create a visual image.
This would be an example of the visualised images of body tracking or LED tracking.
This one would be body tracking making sounds or maybe I’m wrong it’s just simply he’s very sync with the audio because he’s practiced for ages?
Both of the ideas also make me think that they need body tracking and made me think to use the xbox kinect for the whole body tracking.
There’s another idea that I thought of when looking at video of projections. Which are 3D projections mapping.
Not only thinking of just using building to create this, maybe use like other objects such as shoes or other stuff.
Another example of someone creating it with just using boxes.
Or using something more complex and complicated like this 3D mapping sculpture.
After checking out this video, I check out creators of this complex projection. Their projections made me think more and more about this idea and I thought it would be interesting to do.
http://sober-industries.com/?page_id=134
I love their ideas on creating large sculptures to project one. As I know that if I do this similar idea, I wouldn’t be able to do such a large projection.
———————————————————————————————————————————————
There’s only two ideas that I thought of as I was time consuming doing nothing and thinking how would I work this out.
The first idea of the body tracking would most likely to use on coding which I am not great fan. Tried to research on what programs that I can use. Programs that I thought of using would be MAXMSP or Processing or VVVV.
Researching on forums on how would I can create this. There’s been stuff about Kinect in MAXMSP, creating a jitter patches. Which can link on creating images in body movement?
http://jmpelletier.com/freenect/
Thinking of how would this work and what sort of stuff I would to project. Thinking it would be something very simple designs with simple letters or shapes. Also maybe asking a friend to help me to perform something which would be detected by the body movement, so it would be projected.
I’ve came across this video which made me thought about the idea.
But the more and more I research there has been programs such as OpenGL to create stuff like this. To be honest, I’ve tried to understand it but it really too complicated for my brain to understand.
~~
The other idea which I was talking about creating a 3D mapping projection. Thinking that projecting on building and boxes would be boring. Thinking of using something complex shape like a mask or something.
This is about madmapper software which you can map literally anything.
Understand that it can be linked to Modul8 which would be quite useful of linking both together to create a projection which would be an interesting performance video.
http://www.modul8.ch/index.php?c=tut
Tutorials on how to use modul8, plan to do testers on how to use it. I’ll be literally use different sort of videos that I’ve recorded.
—————————————————————————————————————————–
This is what I’ve plan to do:
– Book a VJing laptop which has Mad Mapper
– Book a projector
I plan to try out tutorials on different sort of stuff that I could project. There’s some that I’ve seen which caught my interest.
There are videos on Music Visualization, video projection using modul8 and Mad Mapper.
Things I could project my video on:
– Onigami
– Complex objects
– Furnitures
What kind of stuff I can project:
– Dreams
– Animals & Life
– Nature
– Surrounding
Thinking about music wise for this project would consider for each of them would be:
> Dreams : considering about what you’ve have in dreams. Good dreams and nightmares. Different sort of tone of sound. May use the instrument such as piano to create different depth. Also maybe I could create some kind of voice audio to create intense feeling.
> Animals & life : thinking about the audio for this, it would be too similar to nature, surrounding audio. So I’m thinking I should combine all three together.
yeah, that’s what I’ve planned
Future cinema – production
Too much problems. Too many. I shall talk about the production plan what we tried to did and then pinpoints all the problems we had after.
As first got the crew there ready to shoot and ready to plan. Got everything including the camera and microphone.
This is the floor plan that I drew out on illustrator of how we put out the equipments on the room.
As you can see where we putted the two microphone around the room. Considering the way of how to make the 3d surrounding. As stewart told us that he would edit the sounds even though he wasn’t there in all in the production but he was only there for the test shoot.
As we got the equipments to film, There was problems for the Frostex audio recorder as it doesn’t work properly which delay for many of us as we needed to get home. Which made it literally a long night.
Future cinema – pre production 2
After many discussing and finding out what kind of narrative we’re going to have. Joe written one out. It’s brillant. Also Thank to Zack’s friend Ellen, she would be also acting.
Ellen: Thanks for coming…
Joe: It’s a game of snooker. I think I at least owe you that.
Ellen: But still, you didn’t have to come. For a while I didn’t think you would what with… anyway. I’m glad you’re here.
Joe moves in to break. Ellen perches on the table next to him, blocking his shot; as he moves around her, she grabs his tie, trying to pull him in closer.
Joe: Ellen please; I’m just here for the game.
Ellen: So am I… It may just be that I have a different game in mind.
Joe: Look, we broke this off. I’m sorry, but that’s the way it is, the way it has to be.
Ellen: Why?
Joe: Because it’s wrong! Because I’m married!
Ellen: Aren’t we all? Besides, it never seemed to bother you before…
Joe: I can’t excuse what I did before, nothing can. But I’m a different person now, and I’d hoped that you were too.
Ellen says nothing, sulking. Joe finally breaks, whilst Ellen slowly starts to move to the new music playing gently in the background.
Joe: I should’ve guessed… our song.
Ellen: I’m surprised you remember.
(Pause)
Ellen: Right or wrong… you must admit we had fun.
Joe says nothing, but moves in a little closer. Spotting her chance, Ellen places her head on his chest, and pulls his hand up for a dance. They share a small moment together, both lost in the memories that they shared, dancing more by instinct than by choice. When the dance leads brings them closer together, Joe recoils, ashamed and angry at himself for this moment of weakness. In a desperate attempt to win back the advantage, Ellen lays back on the table, trying to pull Joe down with her.
Joe: NO! I can’t do this. Not again. I’m sorry Ellen, but what we had… what you were to me… we just can’t have it anymore. And if this is all I am to you, then maybe I shouldn’t have come.
As he turns to leave, Ellen lets out a cry of frustration; seeing him about to leave for the last time, she grabs her snooker cue, and breaks it over his shoulder. Stunned, he falls to the ground, where she continues to beat him, crying as she does so.
Dazed and confused, Joe slowly drags himself into consciousness. As he becomes more aware of his surroundings, he realises that Ellen is stood not far from him, watching him closely.
Joe: Ellen… Ellen? What the hell!
Ellen giggles, clearly enjoying herself.
Ellen: C’mon baby, I thought you liked being tied up?
Joe desperately tries to break free of his bonds, but to no avail. Seeing him struggle, Ellen rushes to him, running her fingers through his hair.
Ellen: Shhhh, shh, I’m not going to hurt you… well, anymore than I have already, but that was just foreplay.Joe: Please, you don’t have to do this.
Ellen: I know, but a girl has to have her fun!
From the script. It seems so interesting… I just can’t wait to see what’s would be shown
Future cinema – pre production
As we kind of got the hang of how would it be made. Time to plan this out. We all thought how would the narrative would be and such. Considering the camera shot would be come and how would it work.
We all know that 360 camera will create an 360º so we can’t really do any camera shots but instead we have design the idea of creating what kind of narrative. At first we all looked at different sort of videos.
Looking at this one, it’s quite interesting. If the tracking the camera works, it would be like the camera person who is recording this is tracking the actor moving about in the film. So it kind of make the audience feel that they are also in the film.
There was another video that we thought was very interesting which is a interrogation scene.
Understanding that it would be interesting how it would be in 360º and everywhere you’ll look would be like intense interrogation which makes it quite fun to watch. Also considering the atmosphere. It would be quite interesting of how it would work out.
Another video what catch our eyes was the poker scene in Casino Royal.
Imagine your in the centre of the table and all round you is the people playing poker which are dealing with cards and you can check out every single characters on the scene. Using the head tracking device, you can pick who you want to look at on the table. Clever ‘eh?
But as we messed about with the camera before in Joe’s factory where there is a snooker table. We thought it would be brillant to use and as trying out the camera and the movements of the balls around the camera. It looked great.
We’ve plan the production schedule of the work and considering how we would plan this. Image below is what we are planning to do.
Considering the influence of each of the video, we’re given the scripted ideas to Joe as we all thought he would be the best out of all of us of creating a script.
Now for the technical side of it. Considering the 3D sound when you listen to it. We asked advice on equipments and what sort of thing we should us. So we got offer to use Frostex audio recorder with two microphone. I’ve used the Frostex before so it wasn’t any problem on using it. The microphones that we got offered was the ME66. So we’ll be using them.
Future Cinema – how to do this
We had an discussing of how would this work. As I said before in my pervious post that we’ll be using headtracking video glasses. We got this idea by watching a video based on head tracking.
This gave us great idea of how would it works. Considering how we would do this as everyone likes the idea but there’s no firm information how would the background would work. For example how would the coding for this would work. No one in our group understands this as no one doesn’t have any experience in coding. So I took up the challenge of trying it out of how to create a 360º video and making it work in tracking. By at this moment, we don’t have the glasses but we’re trying to get Phil to get them.
Now for the research of what I’ve did. I check out videos and websites sites of how does tracking works and how I can do it an easier way to make myself life easier as I don’t know a thing about coding.
Before hand, we made a plan incase the video glasses headset doesn’t come in on time, we’re going to use iPad.
An example of the head tacking on iPhone which I thought it’s similar to the one I checked before. The link above ^ JohnnyLee one based on using the wii controller.
I checked on the research on what JohnnyLee’s information bar said about being a link to try out on creating this. But sadly, there one a link that didn’t work. Which was the tutorial.
http://johnnylee.net/projects/wii/
Which made me guess what I was suppose to do. But I also didn’t have a Wii remote to do this.
I then had to find an alternative way to do this. I thought maybe trying it with a playstation move controller or a webcam. There’s already been example of tracking on gaming.
By understanding there has been tested out on using playstation eye which I thought it may be interesting as there’s already been ideas of creating this.
Just looking through them made me think about how would this work, if we create the tracking with the program “TrackIR” would this help on creating out rotation on the video glasses?
Another video to explain what exactly is “TrackIR” making me understand a bit more about it.
——>
Anyways…
Another website that I came across on finding how would to create this is this gaming website of using webcams.
Like I want to say that my brain is completely stupid and cannot work this out but I have tried to but I only got an macbook to use.
I understand, I can’t really do this because I cannot really understand much of this also we have to wait for the video glasses to come to see how would it work.
But we got an idea of what type of video glasses we wanted. We researched online for an suitable one we can use.
The one which was suitable was called the Vuzix Wrap 1200VR.
http://www.mtbs3d.com/index.php?option=com_content&view=article&id=12669&Itemid=77
This link will have more information.
Just to summon it up why we need this one because this video glasses has the functions of what we need for this project. It has head tracking which is the main point of this project and here are the specs for it.
————————————————————————————————————————————————————————————————————————————–
We also researched on what type of cameras we should use. We looked at 360 cameras which would be suitable to use. There’s one camera which I thought it was amusing which is the panorama camera which is shaped as a ball.
I thought this was interesting but as we all wanted is a camera that records video and we found one which was suitable. Sony MHS-PM5KP 360 camera. Phil had one of these cameras, so we all took it out for a test drive.
This would be the converted to a long panoramic version which Georgie kindly enough to fixed.
This is another example how would the character would see in the middle of the panoramic video. Thanks for Stewart for this example.
—————————————————————————————————————————————–
I thought as we don’t have the information on how the head tracking would work, I instead research on making a 360º video and how we’re going to make it work by moving about. at first there are examples of an 360º images that you can move about which makes it interesting to look at.
http://www.paris-26-gigapixels.com/index-en.html
I found it interesting as I understand how we wanted it to work. I thought the software flash would be the right program for use to us. But like I said before no-one is great at coding.
From checking so many video online and checking for an easier example that I can use and follow. Eventually I found a site which they make these sort of stuff and even have a instructions of how to make stuff like that.
The website is www.krpano.com
It’s pretty to understand. I even made my own interactive panorama with photos I made. But sadly the program is copyright quite a but and I can’t figure out another alternative way around this. As this is not my best side of work… coding… again…
There’s an example from the site of the krpano of the video. http://krpano.com/video/video.html
Followed the instructions I made something like this
I used the instructions which was to use the codes they had which is:
<krpano>
<image>
<sphere url="pano.jpg" />
</image>
</krpano>
To create a basic panorama image which you can navigate. This picture was taken in my room. I used BBEdit software to edit the XML to make this work. I finally understood what I was suppose to do… onthe basic levels.
Then I tried it again but with the tested video which we had recorded using the Sony MHS-PM5KP 360 camera but using different code they had.
<krpano>
<plugin name="video" url="videoplayer.swf" videourl="video.flv" />
<image>
<sphere url="plugin:video" />
</image>
</krpano>
As you can see what I’ve been trying to do.
As adding sounds to the video, we’ll be using speakers surrounding the viewer so they can hear the 3D sounds while navigating the video on the glasses.
Please wear headphones and close your eyes for a great effect when listening to this.
This is virtual barber shop which is pretty awesome in a way how you hear the surrounding when you listen to it. We plan to record the sounds and editing to create this kind of effect. Using the gaming seats that we thought of but as we are students, we can’t afford to do this but instead we plan to use stereo speakers To provide the 3d sounds.
Future Cinema – ideas/concept development
Been a while since I’ve been on this site but like yeah back to the terms. I’m not used to using a blog. Anyways, 2nd year now and got a project called Future Cinema. This project understanding what is Future Cinema and what can it developed to and what sort of way. There been a discussion about the idea of “Future Cinema” Would it change from what we have now. From my point of view, I think cinema wouldn’t develop too much, showing the images below show an old looking cinema in the 1962 and an image of cinema today.
Nothing actually changed from the past to the present. The idea meaning having a projector haven’t changed at all. But! there is a change of the idea of interactive with the audience which makes it very interesting. There been a idea of “Future Cinema” which is a active interaction with the audience but still sticking the idea of projecting a video to the audience.
Considering the idea of cinema, this video “Future Cinema” is an event of how people get interactive with the film and how they still use the concept of using a projector in front of an audience and letting them see the film. There has been many ideas of how making audience interact with the film or the event. It’s more or less about putting a project in front of a audience and letting them watching it. So, does this mean that putting a projector at home means cinema? This makes life so confusing.
There’s another video that they actually interact with the audience in the cinema.
I think it’s interesting how they let the audience choose the ending of the film by telling the actors where to go and stuff. This more or less makes the of our group of an interactive one. Even though everyone on our group thought the idea of cinema wouldn’t change much.
Thinking about the ideas of what we all have, they are all different.
—————————————————————————————————————————————–
JOE’S IDEA
His idea was augmented reality. He showed us his idea from like from a app that he has check out on his iTouch which was called Powered By String. An Augmented Reality app. On their site, they have images that you can print off and interact with it though iTouch/iPad/iPhone. It’s pretty interesting how they make it so 3D like through device & interact with it.
http://poweredbystring.com/showcase
Examples of the app, if you got an iTouch. Check it out. It’s free.
A still image of a quick example of Augmented Reality. Seeing though an iPhone.
After checking out this idea. I checked a bit more research of Augmented Reality and how would we develop the idea if we chosen this idea.
Skip to 2:37 if you don’t want to see the animation any more.
This is an idea of creating a narrative using Augmented Reality, it’s a pretty little animation just using objects. Not only using a piece of picture with an image or a code. Understanding that the narrative doesn’t have to be long and complicated.
A bit more research on the Augment reality on actually trying to create a video from using a piece of paper with a AR code.
This is another great example if trying to create an video clip. This made us all think that from this idea, you can create a video clip from a piece of AR code and adding audio too.
Also thought about the idea of Future cinema being a game, so creating an idea of interactivity to a video/game.
This is an example of a Augmented Reality gaming.
Thinking how awesome it look by interacting with it by playing a game even though from another perspective it’s just a large image.
Anyways, this image is an example of what kind of idea that Joe got for us, which I drew out on Adobe Illustrator.
Interacting with the movement of the characters on the iPads by touching them. Or maybe by interacting with them, make them change the story mode or turn it into a game.
YEN’S IDEA
My idea was about what kind of genre you want to watch. I didn’t think it would work but I like to drop a message of my idea contributed towards the group. By using the xbox kinect, it would be whole body recognition of what they are wearing and by what they are wearing. the computer system would automatic recognized what genre they should show. For example, wearing a cowboy hat means they should show an western film or having a heart t-shirt means a romantic film etc.
First, I thought of this idea because I was at that moment watching xbox kinect hacks.
Of course I tried to do some research of quick idea of how it would work.
Another research of idea of augmented reality of the creating marker sensor tracking. Sticking AR pictures on your body to interact with it. Maybe it’s another even of making films coming alive?
STEWART’S IDEA
His idea is was about creating an hologram video. This made us research a bit just to be on the safe side if this idea can be made. There was one video that I’ve came across which was a hologram in a music concert in Japan.
This was so interesting as I thought we would need a lot of equipments to create something something life size as that or it’s may be a illusion of being an hologram when it can be a super ultra thin screen which is see through or a projector? Well, I’m guessing.
But there’s another video of just using curved mirror to create a sort of hologram.
Considering the idea of how we would project the video to create a hologram, we didn’t get into too depth into this.
GEORGIE’S IDEA
Her idea was about creating a 360º cinema that the audience and experience from all different perspective. Just by standing in the middle, you’ve the freedom to look around.
By using projectors, it would projected the 360 video which we are going to record by recording a 360 camera or something simliar to it.
This is the sort of idea what Georgie wanted to create and but as we understand that there is already the idea of the 360º cinema, we kind of gave up but as a group, we developed the idea even more. By we thought of the idea of using video goggles and instead of projections. If we use projections, it would take up quite space and also there would some problems in booking the projectors as there are many people in class who would be also using the projectors as well.
So in the end, alternative we’ll be using the video goggles.
Post production techniques, final piece
Watching this makes me feel that the text is quite fast as next time if I have a change to do it again, I would make it slow pasted. Considering the look and outcome, I’m quite satisfied with it as After Effects just been a complete bum to me.
The reason why the the person who i recorded is not a ballerina because literally the whole university is busy. I got replies and I emailed them back but there was no reply after that. I even went to ask the AUCB dance club and Pavillon Enterprise. But everyone is busy doing projects and performances. No luck in that.
Yen Deng 