MARINA DEL REY, LA – Experts from Live Nation, the composer of Survios Raw Data VR game, and Silicon Beach startups discussed music for VR at our Digital LA – VR Music panel at the new Upload LA offices in Marina del Rey.
Speakers shared insights on four areas of VR and music: spatial sound in VR, composing music in VR, music VR startups, and bands creating 360 music videos or livestreaming their concerts in VR.
10 Keys to VR Music
1. Support artists and bands who want to try VR 360 / livestream. Live Nation works with more than 200 major artists to help bands which are interested in VR to experiment, and to identify bands which would be a good fit for VR and approach them, said Jeff Nicholas, Live Nation, Director of VR Creative and Production. Live Nation has worked with Laguna Beach based NextVR on VR live streaming concerts.
2. Livestream concerts need several VR cameras. It’s important to have enough 5-10 VR camera rigs at concerts so users can jump around to various points, including front row, on stage, in the crowd, backstage. People like to “teleport” around to view an event from multiple angles. Avoid just one camera, and make sure it’s as close to the stage or on-stage if possible, and does not block view of the artists.
A 360 video can glide between different cameras with no cuts too. Specular Theory has won numerous awards including best live-action 360 music video in 2015 for The Donnies The Amys “Runaround” video. It was one of the first to successfully move between different shots with no cuts in one continuous long shot.
“VR is a new platform and has the potential to change everything about the way we consume, create, perform, share, learn, and even teach music,” said Ryan Pulliam, Specular Theory, Co-Founder. In 2016, Specular Theory was chosen by Dolby to create their signature piece for Dolby Atmos to showcase the effective use of spatial sound and importance of ambisonic sound in live-action VR.
3. Get Brands on Board. Several brands are eager to try VR, and will sponsor VR experiences. For example Citibank sponsors the Live Nation – NextVR livestream concert series, giving Citi Cardmembers special access via its site. It’s better to work with brands who realize VR concerts are a marketing and PR tool right now, rather than purely revenue generating. If a brand’s first question is: What are the KPIs (key performance indicators) and ROI for VR concerts, then don’t work with them, because the volume of VR users is not there yet as we are in the very early stages.
4. Use Spatial VR: Use VR spatial sound packages currently available to add spatial sound to VR. In spatial sound, you can control sound’s 360 location, distance, and loudness from the user. When the user is looking at something that is making noise in VR, that source can get louder while other sources get softer. Spatial sound is also used to help direct the user’s attention to a visual cue necessary for storytelling.
New VR sound tools are being released with short product cycle times, as music engineers are constantly improving spatial sound tech.
Audio research and development has as low as three to six month cycle times for new VR sound products, said Linda Gedemer, Sound Source VR, VR Audio Evangelist.
photo by @PeterSoby
5. Composing for VR experiences can be similar to composing for games or film, or can start to be done with VR in mind. Jeremy Tisser, composer for Survios Raw Data, said that composing for the popular VR game was similar for composing a game, with different theme songs for levels, characters, and cinematic cuts. The difference in VR: overlaying sound effects in space, or having different spatial themes of objects, people levels can start to influencer the composing.
6. Show VCs your VR. Startups in VR should show potential VCs and investors their VR experiences to make sure they “get it” and know what’s cutting edge or differentiating about it compared to other VR experiences. In addition to your VR startup pitch deck, have your VR experience ready to go to show investors in the meeting. Note that many investors tend to invest in VR platforms over content itself.
What’s coming: VR and Music
7. Social VR and Music. IRL concerts with friends is part of the concert-going experience at Coachella, etc, but currently most VR concerts are solitary. Being able to experience a livestream concert with other friends via social VR is key. Facebook Spaces could go that route, or companies like AltSpace VR could develop avatar-concerts. Social and Music could be key together.
8. Composing in VR – just like Tiltbrush lets you draw shapes and colors in VR, a VR composition tool could let you paint sounds of string, brass, winds, percussion in 360 space. Tools have not yet been developed, but could be.
9. Location-based VR is also increasing, said Ryan Pullman of Specular Theory, which opens up avenues for location based music VR experiences. “We are really passionate about music and VR and creating original IP for music-based LBE games and experiences,” Pullmans sad. Specular Theory’s first title ‘Trident Rhythm’ featuring location-based VR will be released soon.
10. More VR viewpoints. Smaller, cheaper VR cameras and better stitching and sound will pave the way for more dynamic livestream concert experiences. For example at Coachella, you could jump around to several VR cameras around multiple stages. Or there could be an international VR music festival with multiple concerts in cities worldwide, which you can instantly jump to via VR.
Thanks to the new Upload VR for hosting our event.
The new Upload VR offices just opened in LA. Upload CEO Taylor Freeman said that while the Bay Area has created many VR platforms, it was important to open an office in LA to focus on VR content. Upload LA’s 40,000 sq ft offices includes event space, a VR classroom, demo areas, kitchen area, and co-working open space and private offices for VR startups that apply and are approved into the community. Taylor also said he has a music background, so he was excited to host this event bringing focusing on VR music.
Thanks to our speakers:
– Jeff Nicholas, Live Nation, Director of VR Creative and Production. Jeff oversees the development and execution of all of Live Nation’s live and episodic VR content initiatives. Prior to his work with Live Nation, he spearheaded VR experiences with CBS, WEVR, Oculus, Ford, Mike Shinoda, Budweiser, and many others. He has directed and produced music videos, commercials, digital and experiential campaigns for clients including Rihanna, Dreamworks, Justin Timberlake, Bud Light Platinum, Shakira, Apple Music, Jason Mraz, Beats By Dr Dre, Linkin Park, AKQA, Black Rebel Motorcycle Club, Sony, Foo Fighters, Nixon Watches, Beastie Boys, and many more.
– Jeremy Nathan Tisser, Composer is the composer of the score of Survios’ hit VR game Raw Data. He has strengthened projects in film, television and video games with his scores, and enjoys the musical challenges that VR presents. His other credits include Jurassic World, Pixar in Concert and dozens more. @jeremytisser
– Joel Douek, ECCO VR, Co-Founder. Joel’s recent music projects include launching ECCO’s musical VR experience with Within & Lytro at Tribeca Film Festival, completing the VR music video for Facebook launched at F8, and creating the spatial sound for the first ever VR CGI music video. His other projects have included Live Nation, JauntVR, NBC, IMAX and Hulu Originals. He has scored more than 80 documentaries, as well as film, TV shows, and commercials. He has numerous BAFTA and EMMY-winning productions. @EccoVR
– Aaron Lemke, TheWaveVR, Co-Founder and Chief Creative Officer. TheWaveVR is a recently funded VR music startup building a musical metaverse, where musicians and fans can create, perform and attend shows together in VR. @theWaveVR
– Linda Gedemer, Sound Source VR, VR Audio Evangelist. Source Sound VR is a worldwide leader in VR sound services for cinematic, game-based, and live broadcast virtual reality experiences. Linda holds an undergraduate degree in Music Engineering / Electrical Engineering (Univ. of Miami), graduate degree in Acoustics (Rensselaer) and a PhD in Audio and Acoustical Engineering (Univ. of Salford, UK). Basically, she’s a total audio nerd with interests in acoustic modelling, binaural room scanning, psychoacoustics and of course, all things VR. She plays bassoon (never in public).
– Peter Martin, Valis Studios, CEO. Peter has directed several high-profile msic projects, including Run the Jewels “Crown” music video with WEVR, released on NYTVR, Ray Lamontagne’s “Hey, No Pressure” video for Jaunt VR. He directed the 2016 Sports Illustrated Swimsuit Issue which was released by Time Inc on a bespoke Swim VR app sponsored by Lexus. Most recently Peter created his first room scale VR project for the Smithsonian with Intel, Framestore, XRez and 8i.
– Ryan Pulliam, Specular Theory, Co-Founder. Specular Theory has won numerous awards including best live-action 360 music video in 2015 for The Donnies The Amys “Runaround” video (one of the first to successfully move between different shots with no cuts in one continuous long shot). In 2016 Specular Theory was chosen by Dolby to create their signature piece for Dolby Atmos to showcase the effective use of spatial sound and importance of ambisonic sound in live-action VR. In addition to their music video work for clients including Sony and Interscope, Specular Theory is now creating original IP for music-based LBE games and VR Arcades.
– Lars Perkins, Red Pill VR, COO, Breakthrough VR Music Visualization in development. @RedPillVR
– Moderator: Kevin Winston, Digital LA, CEO and Founder