Äventyret

Three reasons why virtual reality won’t be Facebook’s next social platform

The question is: Which technology is best suited for social — AR or VR? After all, no matter how great VR gets, its unlikely you’ll ever be walking down the street with your VR goggles on any time soon. Unless, of course, they find a way to fuse the best of both worlds — AR and VR.

You already know: Facebook bought Oculus VR, makers of the Oculus Rift virtual reality goggles. Mark Zuckerberg says he’s buying Oculus VR because the next platform after mobile for being social is going to be virtual reality:

After games, we’re going to make Oculus a platform for many other experiences. Imagine enjoying a court side seat at a game, studying in a classroom of students and teachers all over the world or consulting with a doctor face-to-face — just by putting on goggles in your home.

This is really a new communication platform. By feeling truly present, you can share unbounded spaces and experiences with the people in your life. Imagine sharing not just moments with your friends online, but entire experiences and adventures.


Minecraft’s Markus “Notch” Persson also thinks there is a future for social in VR:

I think social could become one of the biggest applications of VR. Being able to sit in a virtual living room and see your friend’s avatar? Business meetings? Virtual cinemas where you feel like you’re actually watching the movie with your friend who is seven time zones away?

But I don’t want to work with social, I want to work with games.

So he’s canceled a planned collaboration with Oculus VR, because he doesn’t trust Facebook as a game platform:

Felix Salmon sees the acquisition as part of an ongoing quest to build a conglomerate, Warren Buffet-style, so that Facebook can build a diverse portfolio of top-notch tech companies while it is flush with cash and before its hegemony as a social platform inevitably fades.

Another view that hasn’t escaped the pundits is that the acquisition does indeed presuppose synergies between social and VR in much the same way Google Glass banks on synergies between social and augmented reality (AR). From this perspective, buying Oculus VR becomes somewhat of a defensive play by Facebook.

The question is: Which technology is best suited for social — AR or VR?

We too have been enthusiastic about the Oculus Rift as a gaming innovation (though less so about Facebook as a social platform). But what about using Oculus Rift as an immersive social experience?

dsc3691_dxo-960x584

We’ve had an Oculus Rift developer kit since it first came out, and have even managed to pair it with a prototype of a Kickstarted 360-degree video camera, the Sphericam. We wanted to know what it feels like to watch 360-degree video immersively with VR goggles. Does the view change in a natural way when you turn your head? Will this soon become a compelling way to experience another location “by feeling truly present,” as Zuckerberg put it? Are we at the cusp of immersive telepresence?

In a word, No.

360-degree content needs to be taken from a single focal point, to avoid stitching errors from parallax effects. As a result 360-degree video looks oddly flat from within the Oculus Rift. You are inside a sphere, looking at its surface, onto which a video is being played. This can be new and interesting, but it is not compelling. You are not “truly present”, whether or not this is a live feed, or prerecorded.

This is because a 360-degree video feed does not contain any depth perception. Within the Rift, each eye is fed a slightly transposed view of the same image projected onto the inside of the sphere, but that sphere is the same for both eyes.

A 3D view of the real world requires two aligned cameras, one for each eye. In a conventional 3D film, you don’t get to choose your direction of view — it is always the camera’s. To make truly immersive real-world content for a VR goggle, you’d need to be able to provide 360-degree 3D video that mimics your head movements.

It’s clear from these early efforts that innovators face huge challenges as they try to use virtual reality to make telepresence immersive enough to be social.

That’s why quite possibly VR is not the holy grail of social. Let’s count the ways:

1. You can’t video chat with VR goggles on

With AR solutions such as Google Glass you are visible and accessible to others. With today’s VR goggles, you aren’t. Never bet against technology, but I think it is unlikely that there will soon be a device that can give the user a fully immersive experience without also obstructing her face — probably not until we jack the video feed directly into the brain’s visual cortex. This means that VR is geared towards the consumption of social information in an immersive context, not the display of such information, because nobody can see you cry or wink when you’ve got your VR goggles on. You might as well be wearing a burqa. (And so much for “consulting with a doctor face-to-face”, as Zuckerberg puts it.)

2. Virtual worlds can’t do social as well as real worlds

VR is eminently suited for the social exploration of digitally constructed environments — the very first VR games for Oculus Rift were notably multiplayer. Collaborative fantasy worlds like World of Warcraft and Minecraft are good for teaching social skills such as sharing and cooperation, and Second Life allows for much odder consensual efforts.

If VR has a holy grail, it is the holodeck: I cannot wait until VR technology starts getting precise input from position and motion detection tools, so that my goggles can transform my livingroom into a dungeon or spaceship, to be explored via physical movement together with others.

But in all these cases, players are represented by avatars. That’s not a problem when there is questing or building to be done, because these avatars will always act out your deliberate commands — you choose which emotive states to act out. This quirk leads to interesting use cases, but it also narrows down the technology’s usefulness as a mediator of genuine emotive states.

Voice chatting already does a remarkable job of mediating emotions like surprise or amusement, but we’ve had that since the telephone. Your virtual avatar won’t any time soon be mediating your true emotive state; until then, video chatting is far more effective — for business meetings, long-distance dates, and for showing off grandchildren.

3. 360-degree 3D live-action immersive video is very hard

Today, If you want to have a 360-degree 3D immersive video experience, you would need to build two front-facing cameras in a rig that can quickly mimic your head movements with minimal lag, to preserve the parallax effect that lets your brain calculate depth of field. In fact, a Swedish drone manufacturer is tantalizingly close to a proof of concept for this, done from a drone. But in a situation where you want to record 360-degree 3D video for later, or where multiple users will want to explore the same live stream, it is today impossible to simultaneously record stereo video from all possible viewing angles from the same location.

So when Zuckerberg talks about “enjoying a court side seat at a game” in a manner that lets you feel “truly present”, he’s actually asking a lot. Still, for controlled environments such as a basketball stadium, we will conceivably one day be able to blanket the court with hundreds of cameras and then use all these viewpoints to automatically reconstruct a live simulacrum of a game in 3D space, which we can explore at will, immersively. Think Microsoft Photosynth, but live. That would be awesome as sports entertainment. But is it a social innovation?

AR vs. VR:

Notwithstanding the social opprobrium being heaped on Google Glass right now, augmented reality’s focus on layering context onto the real world and providing an always-on communications channel to friends is far more likely to have an impact on our social lives than VR, if only because it has a much greater potential to become ubiquitous. After all, no matter how great VR gets, its unlikely you’ll ever be walking down the street with your VR goggles on any time soon.

Unless, of course, they find a way to fuse the best of both worlds — AR and VR.

/ Posted by Stefan Geens (Employee 2014-2017)

si
The Swedish Institute conducts public diplomacy on behalf of Sweden, promoting the exchange of culture, education and research between Sweden and the world. Äventyret is the Swedish Institute’s partner for innovation and service design. www.si.se
visitsweden
VisitSweden is the national tourism organization responsible for promoting Sweden as a travel destination globally. Äventyret conducts strategy and concept development projects for VisitSweden, including trend monitoring and business intelligence. www.visitsweden.com
samsung
Samsung is a pioneer in virtual reality hardware, building the first consumer VR headset, the Gear VR. Via our partner 360Cities, Samsung commissioned an app for the Gear VR. We developed “360Stories”, which allows photographers to create immersive stories from their panoramas. www.samsung.com
aktivbo
AktivBo provides housing and real estate companies with business management materials for the purpose of creating better housing, a better work environment and more satisfied owners. Äventyret is partner to AktivBo for digital service design for the Swedish and German markets. www.aktivbo.com
almega1
Almega is a service company organization and the largest group within the Confederation of Swedish Enterprise. Äventyret is Almega’s strategic partner for digital innovation, communication and service design. www.almega.se
boob
Boob creates sustainable pregnancy and breastfeeding clothes for mothers worldwide. Äventyret is Boob’s partner for the concept and design of digital services. Together with Boob we developed their e-commerce site www.boobdesign.com
chef_logo1
Chef creates the largest leadership magazine in the Nordic region and operates a number of successful digital media businesses. Äventyret has been Chef’s preferred digital partner since 2016. www.chef.se
lrf1
LRF Media is a Swedish publishing house, focusing on the countryside and the green sector. Äventyret has been developing strategy, concept and design for a number of LRF Media’s digital strategic investments since 2015. www.lrfmedia.se | www.land.se
onepix
Onepix is the most popular clinical image management system in Scandinavia, and is currently used in more than 7,000 treatment rooms throughout the Scandinavian region. In 2016, Äventyret produced interaction and interface designs (as well as new graphics profiles) for the new version of Onepix. www.onepix.se
qvalia-3
Qvalia helps its customers optimize their financial flows. Äventyret is Qvalia’s partner for service design; together we are building digital products and services that are revolutionizing how corporate payments work. www.qvalia.com
sami
SAMI is a financial association (non-profit) that represents practitioners who play and sing on recorded works. Members are artists and musicians. Customers are companies and businesses that play their music. Äventyret has worked on service design for SAMI since 2016. www.sami.se
sunfleet
Sunfleet is Volvo’s car sharing service in Sweden. Äventyret developed multiple iterations of a digital prototype for Sunfleet, aimed at a more efficient booking experience. www.sunfleet.com
txcn-logo
Telenor Connexion designs, develops and operates business solutions for connected products and services. Äventyret is the global partner of Telenor Connexions for digital communication. www.telenorconnexion.com
tis_logo
Tourism in Skåne (TiS) is the official marketing and development company for the region of Skåne. During 2015-2016, Äventyret worked on digitalization strategies together with TiS. www.tourisminskane.com
ukk_logo
Uppsala Konsert & Kongress (UKK) is a cultural center in Uppsala. Äventyret has been preferred digital partner to UKK since 2016. www.ukk.se