creativebloq   Feature Article

Example using PopVideo Converter 3 masked videos, to create a compositing Sci-Fi project on iClone6

I wanted to show the possibilities of iClone 6 when creating a sci-fi set mixing 3D props and billboards with video textures. The new Reallusion popVideo 3 software allows one to mask HD video footage filmed using green screen backgrounds, creating a keyed high definition video format than can be used as the texture in iClone 3D props. It allows one to mix real footage in virtual sets without further compositing operations.

In addition, iClone also allows rendering video sequences with the transparent background that can be used later in a new project such as billboard textures, in order to create crowds, vegetation walls or any other compositing layer.

All these video textured billboards, can be placed in the 3D set as any other prop. It’s very convenient, as they get fully affected by the lights of the project, (colour, intensity, etc.), receiving the shadows of the other props in the scene and projecting their own shadows as well.

Also, if the scene has a camera travelling, the parallax effect is automatically created in the final render, as the billboards are actually placed in the set.

 

To show all these features, I have created a sequence that combines a heavy change in the ambient light, starting with an orange sky that turns to purple at the end, with a travelling camera zooming through a multilayer scene. In the foreground, I have included a masked green screen shot, of my partner Izara and myself, which has been made using popVideo Converter, and has been integrated into a 3D balcony that faces a futuristic city. All the other characters scattered over the city platforms and the dense vegetation on the beach are billboards as well, but created from iClone itself in auxiliary projects.

You’ll see how iClone automatically manages the shadows and the changing lights, integrating the billboards in the scene without further editing. I hope you’ll like it.

01. Creating the background

 

Image01.jpg
Wall texturized with the video that will do the function of Background.

To create the background video I just dragged and dropped the video file from its folder to the main iClone screen, while keeping the Ctrl key pressed. It will automatically create a wall with the video file as a diffuse map. I modified the material settings, ‘Self Illumination’ to 100 and its shadow properties to ‘No Shadows’ in order to avoid the background being affected by the lights and the shadows of the other props of the set.

You can also set a video as background in iClone, but if you are planning to make camera travelling, I recommend you use the wall instead, as it provides a better parallax effect with the rest of the objects of the set. (The video background just fits the screen, and is not affected by the angles or movements of the camera).

02. Loading and refining the city buildings

Image02.png
Using the material’s editor of iClone to change the aspect of the imported models.

I used the beautiful models supplied by Herminio Nieves “http://tf3dm.com/3d-models/herminio-nieves” for the City complex. I loaded the models on Reallusion 3DXchange, refined them and modified their textures, playing with the “diffuse”, “blend” and “glow” maps until I was happy with their aspect.

03. Loading and refining the flying ships

Image03.png
Using the material’s editor of iClone to change the aspect of the imported ships

In the same way, I downloaded the ships from Turbosquid “http://www.turbosquid.com” and imported them to iClone through 3Dxchange. I also changed their materials, using the “Reflection” map to obtain a metallic aspect in some parts. I almost never use the real “reflection” property of the material, because it slows the rendering time .

04. Creating the animations of the groups of people

 

Image04.png
Secondary iClone project with the animated characters

 

I wanted to include several groups of people acting on the city platforms, but adding all the actors and their behaviour in the scene would have consumed a lot of processor resources. To avoid that, I made animated textures with the alpha channel that I used after over simple planes placed in the main project.

I created two secondary iClone projects. One with a group of actors talking, and another with a couple walking and stopping after a while. Then I rendered them from iClone in popVideo format.

05. Checking the transparent background of the ‘popvideo’ Render

 

Image05.png
Aspect of the popvideo rendered on iClone once loaded on PopVideo Converter 3

 

iClone can render directly in popVideo format. It doesn’t need further manipulations, but I loaded the file on PopVideo Converter, just to show you the is the aspect of the obtained clip. As you can see, the background has been completely removed…

06. Creating the animations for the jungle elements

 

Image06.png
iClone Project with the ‘iTree’ 3D models animated with wind effects

 

I created three more popVideos from three more iClone secondary projects, showing animated vegetation walls. I used some of the iTrees included in the Reallusion Botanic Pack. Those are very realistic plants and trees that can be affected by wind effects. As I planned to use a big number of them, I decided to create popVideo textures as well to reduce the number of polygons in the main project.

07. Creating the auxiliary animations

 

Image07.png
Seashore shot that I will use as animated texture, cropping just the waves

 

I also created an animated fog cloud using the particle effects of Hitfilm 3 Pro and rendered it as a sequence of ‘png’ images with alpha channel. I loaded this sequence on popVideo converter and generated another transparent popVideo file, that I used in the main project as a texture in a wall that simulated a mist effect.

Finally, I made the last popVideo with a clip of a seashore. (This one didn’t require alpha channel), That I used to create the seashore of the main project.

08. Loading my green screen recording on popVideo Converter 3

 

Image08.png
Original footage loaded on Pop Video Converter 3

 

I filmed my partner Izara and myself over a homemade green screen background. We used a cheap Canon PowerShot SX530 HS that records at a simulated full HD 1920×1080 pixels at 30 fps. The better  the quality of the image, the better masking results you get, so I sharpened and enhanced the original video footage before loading it on PopVideo Converter.

Considering that iClone will have their own defined lights, illuminating the set, it’s highly recommended to film the shot as neutral as possible in light terms, avoiding hard shadows or heavy light influences. A cloudy outdoor environment, for example, gives the perfect conditions.

09. Creating the automatic chroma key mask of my footage with popVideo Converter

 

Image09.png
Aspect of the video after the green areas have been automatically removed

Aspect of the video after the green areas have been automatically removed

 

PopVideo Converter masks the selected background colour and allows to play with several sliders in order to avoid the ‘spill’ effect. The mask settings are very useful to expand or shrink the automatic key and create a subtle blur effect that helps to integrate the  masked video in the final scene.

10. Painting the non-green areas that have to be also masked

 

Image10.png
Use of the ‘paint’ tool that allows one to manually mask the desired areas of the shot

 

Although you can clip the area to be exported, popVideo also allows you to ‘paint’ over the areas that are not covered with the key colour, in order to create a complete masked shot.

11. Rendering the masked sequence as popVideo file

 

Image11.png
Aspect of the shot completely masked

 

Once completely masked, I exported the desired sequence in popVideo file format, that keeps the alpha channel and the original quality reducing the size of the video file.

12. Adding the elements of the main iClone project

 

Image12.png
iClone Project with all the models and panels loaded and placed

 

I created a camera in the iClone City main project and placed the city blocks on the scene. I repeated several times the same item, rotating the copies and obtaining the appearance of a more complex set. Then I created several walls and used the vegetation popvideo files on them as the diffuse texture while the opacity maps are automatically created using the embedded alpha channel. It allowed me to create a dense jungle animated by the wind using very few polygons.

I also added a floor where I applied the clipped popVideo texture with the sea waves arriving at the shore. It has no transparent background and allowed me to hide the sea that actually was in the original background footage.

13. Adding the popVideo files of the people and the jungle vegetation

 

Image13.png
Aspect of the popVideo files once loaded on iClone’s project

 

The next step was to add the walls texturized with popVideos showing the groups of acting people. I did it in the same way as with the vegetation walls, and once again, it allowed me to include a lot of virtual actors on the project, adding just a small number of polygons.

14. Adding the popVideo file of the mist

 

Image14.png
popVideo file wall used to create a mist atmospheric effect in the final render

 

Just in front of the camera’s last position, I placed a big wall texturized with the fog popvideo. In the image below, you can see a closer look from the camera view, but still showing the ‘tricks’ used in the project.

15. Creating the motions for the flying ships

 

Image15.png
Use of paths to animate the flying ships on the scene

 

All the billboards used on the background are actually animated by their popvideo textures, so I only had to move the 3D spaceship models included in the project as well as the camera in order to create the travelling effect. In all the cases, the easiest way is to create paths and link the objects to them.

iClone has the ‘Follow Path’ feature that forces the object to follow the path in one defined axis. So, rotating the keys of the path, the object linked to it, turns itself on its way through the path, to match the inclination fixed by the keys. That’s really convenient when playing with flying objects.

16. Setting the changing lights – beginning of the scene

 

Image16.png
Setting the colours of the scene lights for the first frame of the animation

 

As I mentioned, the light of the background video changes dramatically during the duration of the clip, so I adapted the environmental lights to match the background colours.

Besides the ambient light, the project has two directional lights defined. A main key light, and a secondary rim light that helps to manage the shadowed areas. I left a very dark ambient light with just Red:27 Green:11 and Blue:3 values, and focused on the directional lights.

I went to the first frame and set the light values, picking over the background image. For the main light, I chose a part of the image with an intense orange colour that gave me these values, R:216 G:124 B:40. Meanwhile, I set the Rim light values to R:236 G:291 B:147 also picking in a brighter area of the background image.

17. Setting the changing lights – end of the scene

 

Image17.png
Setting the colours of the scene lights for the last frame of the animation

 

I then moved to the last frame and repeated the process for both directional lights. I also reduced the multiplier of the main light from 1.20 to 0.80 to create the dimming effect of the evening light.

18. Checking how the changing light affects to the elements of the scene

 

Image18.png
Aspect of the first and the last frames of the Animation as the light conditions change in order to match with the background image

 

iClone automatically calculates the light values between the two keys, creating a soft transition from the initial orange tone to the final purple. That light affects all the elements in the scene, including the billboards, which are automatically integrated to the global light conditions.

 

19. Creating the foreground elements of the scene

 

Image19.png
Camera attached to its path and foreground elements that the camera is going to move through

 

In order to obtain a more dramatic effect in the camera travelling, and to show all the possibilities of the popvideo masked textures, I added some foreground elements in the camera path, including a wall texturized with my green screen video footage previously masked. I placed some potted plants just to show how their shadows drop over the billboard, while it also projected its own shadow over the railing.

20. Final tunings

 

Image20.png
Particle effect attached to the ship’s nose to simulate the spray effect as it files through the mist

 

Finally, after checking the animation, I decided to add a couple of modifications. First, I added a particle effect attached to the nose of the closer ship, in order to simulate the spray generated while it travels across the foggy cloud.

Also, to make the fog movement more dramatic, I augmented the size of its wall in the last frame. So, as it was getting bigger through the animation, it gave the impression that the clouds were moving faster and expanding.

And that’s all! This is the final compositing sequence… No further manipulation is necessary to completely integrate the real footage on iClone’s projects. Although, if you have video editing software, you can always filter the whole rendered clip to add dramatic visual effects…

 

Learn more about iClone

Create transparent videos with popVideo 3

 

ABOUT THE AUTHOR 

Adolf Navarro

A software programmer who also used to work with design and 3D software. Now writing graphic novels and making animated series with iClone.

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s