Apple Pure Vision and the Immersive Experience Opportunity
| |

Apple Pure Vision and the Immersive Experience Opportunity

Byrichard

Memorable VR experiences


AR/VR and XR have been around for years, if not decades. The most unique VR experience I was involved with was people wearing an immersive headset whilst snorkelling in a pool to experience being “weightless” whilst watching an immersive video. 


The second most interesting video 360 experience was a ZDF volcanic explosion where you could watch a volcano explode, as if you were in Pompei. You could follow the projectiles as they flew by you. You could watch the pigeons take off and fly away. 


https://www.youtube.com/watch?v=1rXyGAySHTA


The third immersive experience of note was where we sat in wheelchairs, with a VR headset on and we saw the world through the eyes of an old person in a wheel chair. We could see people “talk” to us, as if we were the main character. 


Price as a Barrier to Entry


The Pure Vision headset by Apple is exhorbitantly priced. A few years ago the Quest 3 headset cost about 340 CHF and could be used for gaming. The Apple headset costs 3700 USD. Samsung headsets in contrast cost the price of a mobile phone and a headset. 


The Affordable Options


VR headsets that are mobile friendly cost just 20-70CHF depending on the size of the phone, and the quality you desire your headset to have. Apple’s is way out of people’s acceptable price range. 


Patent Monopoly


One of the most worrying things about the Pure Vision demonstration yesterday at WWDC was the mention that they had over 5000 patents. Some might think “Youpie, that’s a lot of innovation” but I see this as monopolistic and destructive. The more they patent indiscriminately the more they will prevent innovation by others. I would own a Quest 3, if Meta didn’t own Oculus. I don’t trust Meta with Immersive experiences, and I don’t like how Apple charges exorbitant fees. 


Always Worn


From the demonstration of the Pure Vision headset it seems as though Apple wants us to immerse ourselves into XR for extended periods of time, to browse photos, videos, and work in AR. They seem to want us to edit video in augmented reality, rather than on a screen. They want us to be fully immersed, to the point that when we’re talking to someone, the display becomes transparent, rather than have us take off the headset. 


Film Watching


They demonstrated how the headset fades the background to “nice colours” or some similar kitsch. They also promoted that we can make the screen for movie watching as big as we want. When I heard this I thought “Imax VR experiences”. With 23 million pixels you could probably watch Imax quality content from the comfort of your airline seat, should you have such a desire. 


Solitary


One of the key issues I see with the Pure Vision headset is that it will isolate us from the world we are in, encouraging us to spend more and more time alone in a virtual world, rather than in the real world. I see this as great for people who live alone, but awful for family, love and other aspects of life. If you’re watching a film with a VR headset then you’re alone, unless they code in a way to be with others. 


https://www.youtube.com/watch?v=uplqiPYGOvs


Irony


It’s ironic that just as Meta gave up on VR/AR/XR apple brings out a headset that would help get people immersed. 


https://www.youtube.com/watch?v=UdDkfZlnjjo


The Mobile Office


The Apple Pure Vision headset was marketed as a remote work tool, as well as a work tool. the idea is that you organise your work space within the immersive VR goggle experience. Video editing in VR could be interesting because rather than get a large screen, you simply set up the timeline, player and program screens as you want them to be. In theory you can edit 360 videos whilst immersed in VR. They didn’t explore typing and writing, but I did get the impression that they want us to navigate through the environment either through gestures, to grow or shrink windows, or voice, to tell Siri and the VR environment what we want to see. 


https://www.youtube.com/watch?v=QlhymliR7mo


Looking Forward to the PureVision SE


Although Apple haven’t even started to sell their PureVision headsets yet I look forward to the PureVision SE alternative. This version should be more affordable and more interesting for normal people. By normal people I mean people who buy a fragile glass headset rather than an electric bike. I want the PureVision SE option to be affordable, maybe even existing mobile device friendly as we have with the Samsung Gear solutions. 


An Increased Demand for Content


The PureVision headset should come out in the beginning of 2024 which means that for the rest of the year we should be working on 360 videos and other immersive experiences. Now is the time to make sure that when the headsets come out, our content is there, for people to enjoy. YouTube videos, netflix content, amazon prime, and others should know work towards 360 video experiences, like the porn industry has already made available. 


The one drawback to porn and the PureVision goggles, is that there are plenty of cameras, and if it uses gestures, then self-gratification may not be ideal. 


And Finally


With good battery life, simplified typing and good gesture controls PureVision and similar products could replace laptops and desktops, and if not laptops and desktops, then external screens. In my experience VR is a lot of fun to experience but it does cause fatigue, and that fatigue means that we use it less than we would otherwise. 


The act of putting a VR headset on, queueing content and more is slow and clunky. If Apple has found a way to make this easier, then that will help drive adoption. The Quest 3 was already a good step forward. We have to see the leap made by PureVision. 

| | |

Thoughts on the Oculus Quest

Byrichard

During the World XR Forum I had to carry six or more Oculus Quest devices from a car to the conference centre and then help with setting up at least one of these devices. At first I thought it was like most VR headsets where the phone is the display.


In reality, the Oculus Quest is a self-contained VR headset driven via an app from the mobile phone. Once the Oculus quest and the mobile phone are paired you can play with content and use it. This is great because it no longer requires a high spec computer, it has no cables and best of all it’s affordable. At 400-500 CHF it’s affordable within most geek budgets.


The pole Vault/Barrier to entry is now just a skip and anyone can experience VR games whether on Android or iOS.


If you leave the controllers on a desk as you set up it is easy and intuitive to pick them up without taking the headset off. When you’re starting a session you can draw the outline of the room and mark where the walls are. In doing so you can set it up safely within seconds rather than minutes.


It also fits within a small box so you can carry it with you when you travel or when you’re doing things. In theory, you could hike with it and use it in a refuge. In practice, it’s better to use it where power outlets are common.


https://www.youtube.com/watch?time_continue=60&v=Di7dIhUFsbw


It’s computer gaming, without sitting at a desk. It’s Virtual Reality without the constraints of time and space.

Sea of Tranquility – Snorkeling VR by Pierre Friquet
| | |

Sea of Tranquility – Snorkeling VR by Pierre Friquet

Byrichard

During the World XR Forum this year in Crans Montana I helped Pierre Friquet with his Sea of Tranquility VR Experience. This VR experience was unique in that it required you to be either in your swimming clothes, your underwear or other.



This was a VR experience where you went from being outside where the temperature was descending to winter temperatures to what felt like a warm room when dressed but comfortable when wet.


The experience is simple. You change from your conference clothes into your swimsuit and step into the pool. You stood on a ledge with a depth of just 75 centimetres and received a short briefing. “Are you familiar with snorkelling?”, “Are you familiar with VR?”. They then stepped towards the rope and a tethered floatation belt was brought to them. They placed the belts around their hips and when ready the VR headset was placed on their head, the snorkel was placed, and then a headlight. “When you’re ready to let me know and I will start the video”.



As the video started to play those experiencing The Sea of Tranquility VR experience leaned forward and assumed a horizontal position and floated towards the deep part of the pool. From here they could look down. They went from being in a room if they looked down and started their trip towards the moon.


The audio they could hear was mission audio from Appollo 11. They could turn their head if they quickly wanted to look around but they could also turn by thrusting with their arms either left or right. Instead of a swivel chair or a wheelchair, their support was water.


I personally tried the experience once when tethered and then again when free. During this experience I wanted to swim down and so did others. Two others and I tried the experience untethered as well. The desire to dive down was strong so two of them did.


In one case I saw that a person was uncomfortable with snorkelling so I brought her back to the shallow part of the pool and she enjoyed it. Usually, this VR experience is in 1m20 of water and here people were in 2 meters of water. That’s why I brought the person who looked uncomfortable to the shallow end of the pool.



The torch that people wore on their head added to the experience. As they watched the video and moved in the water so their head turned, and as their head turn you could see that they were looking around. When two people were in the water at once it was quite entertaining.


When some people finished the experience they were so absorbed by the video and the VR experience that they needed to re-acclimatise to reality. In one case it took several minutes.


In several cases, people tried the VR experience and then went for a swim. In one case I did several laps with another person and that was one highlight of the event. It’s the third time I go as a volunteer to this event and I think that between sleeping in a bomb shelter, helping people experience VR in water and by having regular meals this is the best World XR event I have experienced to date.


As a bonus, some of us got to try two other VR experiences. One of them was floating through the ISS but the one I really liked was the scuba diving demo video. In this VR video, you are descending a slope and as you look right and left you to see fish, sharks, a wreck and more. At one point you get to the end of the slope and get to a wall. You float over the wall and then you’re in the water with three whales. As a diver, this sensation was familiar, as was looking around like this.


I really like snorkelling VR experiences and I would love to experience one with scuba equipment. Imagine being underwater, rather than floating on the surface. Imagine being able to dive down and experience the depth, as well as weightlessness.


The Insta360 Nano and Air – A climbing test
| | | | |

The Insta360 Nano and Air – A climbing test

Byrichard

The Insta 360 Nano and Air are two affordable cameras. The first is designed to work with the new iPhone shape as well as a stand alone device. The Insta360 Air works only when it is plugged into an Android device. Both are good for specific uses.

Insta360 Air

The Insta360 Air requests a firmware update the first time you want to use it. This takes a few minutes and then the device uses the phone’s gyroscopes to keep the image stable. On the Via Ferrata I climbed this weekend I used the insta360 Air and Xperia Z5compact phone to take one or two landscape pictures. In these images you can look up at the cliff, look across at the landscape or look down at how far from the ground I am. This is a nice way of giving people a feel for what it is like to practice Via Ferrata. For the use of this system, it is good to have both hands free.

[vrview img=”https://www.main-vision.com/richard/blog/wp-content/uploads/2017/06/export_1496508048682-1.jpg” width=”500″ height=”500″ ]

Use the mouse/trackpad to rotate the image

Insta360 Nano

 

The Insta360 Nano is great because it has an SD card slot. It can be used as a stand-alone device. With the tripod mount and a selfie stick interesting images and video are possible. I tested it on a Tyrolean crossing. That’s where you attach your pulley to a cable and swing across over a waterfall. With a 360 camera you look anywhere you like. Image stabilisation for Tyrolean crossings is essential. When you transition from standing on firm ground to swinging across you move a lot. With image stabilisation this is avoided.

Post production

Post production with the Nano is quick and easy. Take the SD card, read it with your laptop and share. With the Insta360 Air you’re using the phone’s microSD card. You can batch edit and export to the insta360 community sites. I want to bulk export directly to Google photo from an Android device.

Conclusion

For the price of a Ricoh Theta S, you can have two 360 cameras. The Nano is ideal for monopod use and the Air is ideal for web streaming once you find the right phone mount for a professional monopod. With image stabilisation the camera keeps the image centred where the person with a VR headset looks. Without image stabilisation Nano footage would give people motion sickness.

The World VR Forum – Year 2 – The Conferences

The World VR Forum – Year 2 – The Conferences

Byrichard

I was a volunteer at the World VR Forum again this year. I was in the conference room providing speakers with microphones before they went up on stage. As a result of this I was able to listen to many interesting speakers. They spoke about a diversity of topics of interest to various groups.

Google Earth and the HTC Vive

Dominik Käser presented Google Earth VR. He spoke about how Google had spent time thinking about how the earth sounds in different locations, from different altitudes and more. He spoke about how they thought about the sound of a dragging rock when the globe is spun slowly and a jet when it is spun faster. He also spoke about the considerations for how to move within this environment. An excellent demonstration of Google earth in VR is included with the video above. It would be a fantastic tool for journey planning.

Club Med and VR

Julien Lebreton spoke about how Club Med was thinking about and implementing Virtual reality and 360 videos in to advertising for events. 360 videos are a great way of getting people to experience what travelling to certain locations are. I am interested in how VR can be used for tourism.

 

Other discussions included the Neuroscience of VR and how the mind perceives the world in VR as well as consciousness and VR. These are interesting talks because the better people understand how the Human mind reacts to virtual reality environments the better experiences can be. To go along with this there was a speech about the Limbic chair and how it provided people with the opportunity to “walk” around in VR more naturally. The full program is at the following link.

2017 World VR Forum Program

Due to the volume of speeches of I heard and because I was busy I was unable to devote my full concentration to every speech. What I did come away with is that people are looking to fund VR content and they do want to be seen as first movers. They want to see up to a 30 fold return on investment multiple funding rounds down the line. Content creators are looking to create a large back catalogue of content so that in future when VR goes mainstream they will have something to distribute on multiple panels. China was given a strong position within this year’s world VR forum and their point of view was expressed by a diversity of speeches.

Conclusion:

During last year’s World VR Forum I tried and enjoyed almost all of the VR experiences, some of them multiple times. As a result of this I really got to grips with the breadth and diversity of opportunities that VR experiences could offer to the user. I met with most of the speakers this year and listened to their speeches. As a result of this my understanding of many topics has increased. I will look at some of these topics in more depth.

My favourite side event was the midnight swim. It’s the first time that I’ve been for a midnight swim in a heated indoor pool in Switzerland. Another moment I really enjoyed as a volunteer was the fondue dinner on the last night. The fondue and the ambiance were really good.

I’ll be back again next year. I enjoy the World VR Forum. It would be fun to go as a content creator next time.

The Theta+ Video app is available
| |

The Theta+ Video app is available

Byrichard

Yesterday the Theta+ Video app came out for Android. The Theta+ video app allows you to trim video clips and then share them to social networks. This means that you no longer need to wait until you get home to prepare content for sharing. You can do it while you sit and have a post activity hot chocolate or other drink.

[caption id="attachment_3325" align="aligncenter" width="169"]Video options Video options[/caption]

When you select the raw video it is converted to be a spherical video. When that process completes you can choose between creating a 360 degree video or a cropped one. A cropped one is a tinyworld video.

[caption id="attachment_3326" align="aligncenter" width="169"]Filters, Trim and music Filters, Trim and music[/caption]

The next menu gives you three choices, filters, trim or background music. I never bother with filters and the trim option is fiddly on the Sony Xperia Z5 compact with a 13 minute video. With a shorter video I would have found this process easier. Saving is not intuitive. First you trim the video and then you go back and save the changes. While saving you need to keep the app open.

The sharing options are to Facebook, youtube and other social networks. This varies according to which apps you have on your phone. I like that the two first options are facebook and youtube as these are the networks that I usually share to. When I tried to upload to youtube it failed twice. When I attempted to upload to Facebook it was stuck at 99 percent twice.

This is a great app to trim videos before sharing and add some music when required. What I would like to see in future versions is the ability to compile a number of 360 videos together to create edited sequences. They need to improve uploading so that it works better. At the moment of posting all attempts to share videos failed.

| | |

Playing Ingress and Pokemon Go in parallel

Byrichard

People are playing Ingress and Pokemon Go in Parallel. Both games use the same geo-located points and walk the same routes. They have the same places to farm and combat. I started playing Ingress again, but only a few minutes here and there. As I play I see new faces and new people at Ingress portals. They are no longer my age or older. They are much younger, in their teens.

Yesterday as the neighbours were having a party I decided to take advantage of the excuse to go out and play Ingress. I went to the four or five portals in my village. At the village church I saw a youth drive up to it on a scooter, farm via the Pokemon Go layer and then leave. Nothing changed on the Ingress layer. No damaged resonators, no upgrades.

I like that people can play two entirely different games at the same location. I see this as the future of geo-located games. I see this as the next wave. The physical world provides the location and then the layer (or game) provides the user interface, the virtual world we interact with. With imagination more and more layers can be added. This will provide people with choice.

The next step is smartwatches and augmented reality goggles. Those who have played Ingress intensively know where all the portals are so they can put their phone away when walking from point to point. The same is probably true of Pokemon Go players. One person wrote that he uses his smartwatch to farm when walking around. Imagine if Google Glass had come out now. If it had come out now, with the Pokemon Go craze people would buy them.

At the moment to play pokemon Go and Ingress you walk in a position, that given time, will turn us in to hunchbacks. Rather than being from manual work in a field or a coal mine it will be from walking staring at a phone. I write this with a certain sense of humour. The market for Augmented reality goggles is ripe. Device manufacturers should grab this opportunity while it lasts.

| | | | |

Watching clouds form as a 360 timelapse

Byrichard

Time-lapse videos are fun because we can see something happen faster or slower than real time. By watching this content we gain a better understanding of the world and how it works. For years I have been filming time-lapses and the results can be fun. In some cases we record time-lapses with video cameras and at other times we set an interval timer to take pictures every so many seconds. In this post you will be watching clouds form as a 360 timelapse.

I have chosen to share both the flat image and the spherical image. The reason for sharing both versions is to give you an overview of how objects move in both.

Spherical Version

With this version look to your right and you will be able to watch the clouds move through space. As they move you will see them grow thicker and then cover the sun. At this point everything gets darker. If you watch this video a few times you can watch the landscape change.

The next step would be to get a 360 camera somewhere high during a total eclipse of the sun by the moon. During such events you will see a grey mask cross over the landscape, you will see birds fly away and then everything will be dark. You can then turn around and watch totality, the corona and then the reverse process. The time is right for eclipse chasers to be at the right place to capture such an event as a 360 video.

Flat Version

With the flat version you can imagine where you would aim a standard camera. Would you try to get the clouds that are forming over the mast or would you prefer to look out towards La Dôle and watch as the large clouds form and float to block off the sun? In this image you can see from Villeneuve and Lausanne to Geneva and the Salève.

Having such a wide angle of view allows you to see everything that is going on in front of and behind the camera. The timelapse is a sequence of pictures rather than video so in future I hope to export the video in a higher resolution.

Cosmic Trip – Physical Video gaming – Throw it like a frisbee
| | | | |

Cosmic Trip – Physical Video gaming – Throw it like a frisbee

Byrichard

Physical Video Gaming

Physical video gaming is coming of age thanks to the HTC Vive and related Games. Cosmic Trip is one of these games. You can use both controllers to prepare machines that will prepare robots for mining and defence. These two sets of robots are autonomous. The more resources you mine and the more robots you have. These robots are attacked on a regular basis so defence is important. The laser robots provide some assistance. You can attack the enemy bots by throwing disks at them as if you were throwing frisbees. Most people should find this instinctive.

In the last 17 hours more than half a million people watched the video on how to play this game. The game is still in development and building up hype for when it is released properly. The creator of the video above now has eleven million subscribers on youtube. When he produces a video eleven million people are notified that there is a new video to watch.

Out of those 11 million subscribers on youtube only 1.6 million follow on twitter and a quarter of a million on Facebook. Within the next year or two I would like to see social networks such as Youtube and others expand and become niche communities where people can find content of interest without using Facebook or Twitter. I found Jack Septiceye content when I was searching for VR demos. I use youtube rather than Twitter and Facebook because I don’t want content creators and sharers to tell me how to feel or why the content is of value. I want to make that decision for myself. Youtube and social networks that allow us to browse and discover content based on niche interests are going to become increasingly important.

Screen Shot 2016-06-21 at 08.58.19

The creators of the game have just two thousand eight hundred followers on Twitter and approaching one thousand on Facebook. When youtube personalities make videos about products they provide companies with a lot of extra visibility. You reach game players, people who want to see what new technology such as the HTC Vive can do and people who like to watch gameplay videos without necessarily being game players themselves.

Niche Audiences

Twitter and Facebook have focused on broadcasting rather than niche audiences. As a result of this strategy they have lost their stickiness. This leads to people spending less and less time on their social networks. This opens up opportunities for Youtube and other content aggregation sites. The more content you watch on Youtube the more recommendations you will get based on your taste. This cuts out the middle man, in this case Facebook and Twitter. We reduce the signal to noise ratio. We increase the user’s Return on Investment.

360 timelpase videos
| | |

360 timelpase videos

Byrichard

360 timelapse videos provide us with interesting new opportunities. Imagine for example placing the camera out to see near Weymouth beach and watching as the tide comes towards the camera and then beyond it towards the city. Imagine watching as the sun rises on one side of the Leukerbad Valley and sets on the other. Imagine that BBC Natural history unit sequence of sand dunes moving across the landscape one day at a time for a year.

Timelapse with the Ricoh Theta S

Two days ago I was tempted to try a timelapse video with the Ricoh Theta S. My plan had been to take the camera up to La Barillette and film a timelapse. From this point of view you can see the whole of the Lac Léman. You can see from Geneva to Villeneuve on a good day. With a weather system like we have at the moment you can watch clouds form and dissipate. You can also see the shadows left by those clouds and more. With a standard timelapse camera you would see just a small part of the scene. With a 360 timelapse you could look out towards the Alps or around at the cars and hikers. You could look up at the mast and more.

I say that you could do this because there are high winds up there and you need a heavy tripod to keep the camera from falling and breaking one of the lenses. You also need to find something to do while the camera is working.

Yesterday morning was clement, we had clouds and blue sky so I was able to try a timelapse. I set the camera to take an image every ten seconds for an unlimited amount of time. The settings on this camera give you great flexibility with timing. You can go from every eight seconds to setting a much longer amount of time.
timelapse(2)You can set the interval to take pictures from every 8 seconds to every 60 minutes and 59 seconds.
timelapse

You can either preview the image as a spherical image or as an equirectalinear image. Once you are happy with the settings you can start capturing. In yesterday’s test I was able to get more than 600 images on a single battery charge when the camera was set to take a picture every ten seconds.

The obvious limiting factor with this camera for timelapses is battery life. As soon as the camera is plugged in to a power source it turns off and starts to charge. As a result charging and taking pictures at the same time is not possible. There is also the minor issue of having the USB charge port right next to the tripod screw. You would need to modify a plate to charge the camera at the same time. The camera lasted for about 100 minutes before the battery died.

Post production

With the Ricoh Theta S and final Cut Pro X post production is efficient. You are dealing with images with a resolution of 5,376 x 2,688 pixels. That qualifies as UHD. You can import the image sequences from your timelpases straight from FCP X cutting out the need for other apps. Once the images are imported your your event you can open a new project at full resolution. I added the UHD image sequence to the timeline, created a compound clip and then used the speed tool to adjust the duration.

I still need to do some research about how to export the edit at full resolution. As I was given an error message I decided to export the video as 1920×960. This worked flawlessly. I used the Spatial Media Metadata Injector to add the necessary image meta data and then uploaded the injected video to youtube.

I look forward to finding ideas and projects that will take advantage of what 360 timelapse videos have to offer. I feel that it provides us with an opportunity to better understand how time and light evolve in a spherical environment.