360Stories: The making of

At Äventyret, we’ve been playing with virtual reality since the first Oculus Rift prototype became available back in 2013. We recently had a chance to build an immersive panorama viewer for Samsung’s virtual reality headset, the Samsung Gear VR, which incorporates the Samsung Galaxy Note 4 to run Android apps built with Oculus’s software development kit.

Our client: 360Cities, the world’s largest repository of 360-degree panoramic images. Äventyret developed the concept, while our dev partner Prototyp wrote the code. The result was 360Stories, an app that lets photographers add voice-over narration to their immersive panoramas. We learned a lot from the process; read on for some of our take aways.

The concept:

At its core, 360Stories is a panorama-based storytelling app. You use it to download and play stories showing immersive panoramas accompanied by voice narration and ambient sounds. But the app’s real distinguishing feature is that anyone can build these stories, because 360Stories supports an open XML markup language called RPL. Just as a web browser renders pages built with HTML markup, 360Stories renders stories built with RPL markup. You can download ready-made stories from 360Cities, or you can make your own and upload them to the app.

One thing we know from previous projects developing content for immersive environments (starting with a project for Second Life back in 2007) is that you don’t want to convey information via walls of text. Reading text in a virtual environment is tedious and inefficient. Instead, it’s much better to let the user focus on exploring the environment while listening to a soundtrack of relevant information.

Technical challenges:

One challenge when developing an app for a prototype of an “Innovator Edition” of a consumer product is that you’re building something for a moving target, in terms of both software and hardware. We experienced this with the beta of the Oculus software development kit (SDK). For making games, many developers are rightly choosing to use the Unity 3D rendering engine on top of the Oculus SDK, because it provides a mature, additional layer of abstraction, shielding developers from an SDK still in flux.

But Oculus’s own SDK comes with some highly optimized built-in panorama rendering tools, and it was these that we decided to build upon, only to find half-way through the process that their core implementation changed in an update to the SDK. Still despite the extra work, the end result is a very smooth render.

Outside connectivity:

Originally, our intention was to let users find playable files anywhere on the web using a web browser. When downloaded, these files would then open in 360Stories. This wasn’t possible: Apps that work with the Gear VR are sandboxed, so they are only usable within the context of the Gear VR and the Oculus “Home” launch app/store. This isn’t a problem with apps such as games, where the content to be explored is fixed. But we wanted 360Stories to be a universal player for a special subset of web-based content—how to connect this to a sandboxed app?

Our solution was to hard-code an RSS feed containing playable content files into the 360Stories app. This way the app can get regularly updated content without us needing to update the app itself. That main RSS feed is controlled by 360Cities, but anyone can create and upload a playable file to the 360Stories app, and then play it by launching the app via Gear VR.

/ Posted by Stefan Geens (Employee 2014-2017)

The Swedish Institute conducts public diplomacy on behalf of Sweden, promoting the exchange of culture, education and research between Sweden and the world. Äventyret is the Swedish Institute’s partner for innovation and service design. www.si.se
VisitSweden is the national tourism organization responsible for promoting Sweden as a travel destination globally. Äventyret conducts strategy and concept development projects for VisitSweden, including trend monitoring and business intelligence. www.visitsweden.com
Samsung is a pioneer in virtual reality hardware, building the first consumer VR headset, the Gear VR. Via our partner 360Cities, Samsung commissioned an app for the Gear VR. We developed “360Stories”, which allows photographers to create immersive stories from their panoramas. www.samsung.com
AktivBo provides housing and real estate companies with business management materials for the purpose of creating better housing, a better work environment and more satisfied owners. Äventyret is partner to AktivBo for digital service design for the Swedish and German markets. www.aktivbo.com
Almega is a service company organization and the largest group within the Confederation of Swedish Enterprise. Äventyret is Almega’s strategic partner for digital innovation, communication and service design. www.almega.se
Boob creates sustainable pregnancy and breastfeeding clothes for mothers worldwide. Äventyret is Boob’s partner for the concept and design of digital services. Together with Boob we developed their e-commerce site www.boobdesign.com
Chef creates the largest leadership magazine in the Nordic region and operates a number of successful digital media businesses. Äventyret has been Chef’s preferred digital partner since 2016. www.chef.se
LRF Media is a Swedish publishing house, focusing on the countryside and the green sector. Äventyret has been developing strategy, concept and design for a number of LRF Media’s digital strategic investments since 2015. www.lrfmedia.se | www.land.se
Onepix is the most popular clinical image management system in Scandinavia, and is currently used in more than 7,000 treatment rooms throughout the Scandinavian region. In 2016, Äventyret produced interaction and interface designs (as well as new graphics profiles) for the new version of Onepix. www.onepix.se
Qvalia helps its customers optimize their financial flows. Äventyret is Qvalia’s partner for service design; together we are building digital products and services that are revolutionizing how corporate payments work. www.qvalia.com
SAMI is a financial association (non-profit) that represents practitioners who play and sing on recorded works. Members are artists and musicians. Customers are companies and businesses that play their music. Äventyret has worked on service design for SAMI since 2016. www.sami.se
Sunfleet is Volvo’s car sharing service in Sweden. Äventyret developed multiple iterations of a digital prototype for Sunfleet, aimed at a more efficient booking experience. www.sunfleet.com
Telenor Connexion designs, develops and operates business solutions for connected products and services. Äventyret is the global partner of Telenor Connexions for digital communication. www.telenorconnexion.com
Tourism in Skåne (TiS) is the official marketing and development company for the region of Skåne. During 2015-2016, Äventyret worked on digitalization strategies together with TiS. www.tourisminskane.com
Uppsala Konsert & Kongress (UKK) is a cultural center in Uppsala. Äventyret has been preferred digital partner to UKK since 2016. www.ukk.se