VTubers are represented by a 3D CG avatar created by motion capture technology, and the number of VTubers are increasing every year, with more than 8,000 VTubers now in Japan.  

The TV Tokyo show “Watanuki-san-chino” is a unique program in which VTubers play roles as actors. It is about the daily life of three sisters, the Watanukis, who live in Tokyo and three popular VTubers played the sisters. Even though there are no live action scenes, the program is categorized as sitcom series of VTubers and not as animation.    

The producer of this series, Kimitaka Goka, TV Tokyo said: “I have been producing many drama series and movies of live action. It was when I was devising a plan to do something crazy which no one ever done that I found about VTubers. There were 6,000 VTubers at that time already, so I thought I could find someone interesting.” He continued: “Unlike animation which involves drawing and painting, and voice over by actors, a VTuber can really act by moving and saying quotes at studios. I thought it would be interesting to make something narrative with them.”    

For the first program, the workflow for the production was still experimental. To help build that workflow, Goka asked Kei Akatsu of Tokyo’s helo Inc. for technical help. “We only had a month to prepare for shooting, so we had to gather equipment right away. As this project has no precedent, we first spoke to Blackmagic Design about what kind of equipment could be used for recording this project, and we tested and decided to use HyperDeck, Teranex AV and Video Assist to our studio,” said Akatsu who is also a producer of the series.    

“There were about 1,000 shots for one episode. To manage such massive footage, we needed to record with timecode. Also the finishing project had to be 4K, so the equipment had to be 4K supported,” said Koki Nagaoka, an assistant producer from helo inc.    

For shooting the series, three VTubers acted at a motion capture studio, with 3D CG real time rendering and four camera simultaneous shooting proceeded using the Unity game engine. Blackmagic Design’s HyperDeck Studio 12G and Teranex AV were used for recording, while camera outputs from the Unity PC were sent to the Teranex AV to convert frame rate and embed the ambient sound of the studio. Then the video embedded ambient sound and was sent to the HyperDeck 12G for recording onto SSD. Also, another output feed from Teranex AV was sent to a Video Assist for preview.    

“We used the Video Assist to preview all four camera feeds at once, which was for the director to check if all the cameras were positioned at right places,” said Nagaoka. “Our studio was small so we had to work all of the gear from a single desk. As Blackmagic products are compact, they can fit in such situations well.”    

For the grading of the series, DaVinci Resolve Studio was used. “The original 3D CG itself has a lifeless feeling, and we didn’t have time to set up lighting precisely so the look was very flat. It didn’t suit the feeling of the story as it was, so we graded the footage to amber and added more shading to create a warm look using Resolve. If we tried to do the similar color and lighting adjustment in Unity, it would take so much time and processing power. Grading with DaVinci Resolve, we could obtain the look we aimed for within the limited production time,” Nagaoka concluded.    

Press Photography  

Product photos of the HyperDeck 12G, Teranex AV, Video Assist, DaVinci Resolve Studio and all other Blackmagic Design products are available at www.blackmagicdesign.com/media/images    

About Blackmagic Design  

Blackmagic Design creates the world’s highest quality video editing products, digital film cameras, color correctors, video converters, video monitoring, routers, live production switchers, disk recorders, waveform monitors and real time film scanners for the feature film, post production and television broadcast industries. Blackmagic Design’s DeckLink capture cards launched a revolution in quality and affordability in post production, while the company’s Emmyâ„¢ award winning DaVinci color correction products have dominated the television and film industry since 1984. Blackmagic Design continues ground breaking innovations including 6G-SDI and 12G-SDI products and stereoscopic 3D and Ultra HD workflows. Founded by world leading post production editors and engineers, Blackmagic Design has offices in the USA, UK, Japan, Singapore and Australia. For more information, please go to www.blackmagicdesign.com.