Oculus Quest 1/2 application

S.L.P. image questions, stereoscopic video livestream and recording, stereoscopic photo capture etc.
Post Reply
User avatar
Realizator
Site Admin
Posts: 900
Joined: Tue Apr 16, 2019 9:23 am
Contact:

Oculus Quest 1/2 application

Post by Realizator »

Okay, our app for Oculus Quest 1/2 is ready for mass tests.

What's this?
This app is designed for the low-latency video livestream from the StereoPi. It supports single camera mode, stereoscopic mode (SBS and TB), and able to show 2x180 stereo in VR mode. For VR mode it is better to use wide-angle cameras (with 160, 180 or 200 degrees FOV).

How to install?
Download the app archive and unzip it.
Use the SideQuest application to upload it to your Oculus Quest 1 or 2.
Right red arrow on this screenshot shows you the button for the APK installation.
sidequest.jpg
sidequest.jpg (132.27 KiB) Viewed 15415 times
Please note, SideQuest is showing the IP address of your Oculus at the header of the window (left red arrow). You might need this info on the next step.

How to get the video?
1. If you are using an SLP2 Beta Raspberry OS image, Oculus will automatically find the StereoPi in the network and start a live stream.
2. If you are using SLP1 Raspbery OS image, you need to put the IP address of your helmet to the "UDP clients" field, including port 3000, and press "save" at the bottom of the settings window.
udp-livestream-settings.jpg
udp-livestream-settings.jpg (56.48 KiB) Viewed 15415 times

On this screenshot, you can see example settings for our Oculus, which got IP address 192.168.1.224 from the router

Brief settings review

1. "Screen" mode
screen-mode-oculus-settings.png
screen-mode-oculus-settings.png (42.07 KiB) Viewed 15415 times
In this mode, you will see your video on the virtual screen. On this tab you can choose the video mode:
2D - show you the video "as is". Use it for a single camera mode, or for reviewing the alignment of your cameras
3D SBS - stereoscopic mode for the side-by-side video. Please set the appropriate mode on the StereoPi
3D TB - stereoscopic mode for the top-bottom. Please set the appropriate mode on the StereoPi
"Window position" - choose the distance to the virtual screen (near-mid-far).

2. VR mode (2x180)
vr-mode-oculus-settings.png
vr-mode-oculus-settings.png (47.06 KiB) Viewed 15415 times
In this mode, the video from each (wide-angle) camera is used as a texture for the hemisphere, and you are looking at it from the center of the sphere. Moving your head you can look around, like in the real life.
In this tab, you can set the FOV for your camera. Press one of the preset buttons, or use "+" and "-" buttons for the precise settings.

3. Network
network-settings.png
network-settings.png (43.85 KiB) Viewed 15415 times
If you are using SLP 1 - ignore these settings. For the SLP2 you can turn on/off auto-discovery mode, and choose UDP or TCP stream type.

4. App info
oculus-quest-app-info.png
oculus-quest-app-info.png (55.36 KiB) Viewed 15415 times
You can find the current version info here.

Advanced users section
We added MJPEG support too. This is an experimental feature. To play with it, you can stream your MJPEG video to the app using a command like this:

raspivid -t 0 -w 1280 -h 720 -fps 30 -3d sbs -cd MJPEG -o - | nc 192.168.1.224 3001

Port 3001 is used for MJPEG only. Please note, that MJPEG streaming has its own issues in the stereoscopic mode.

Bug reports.
If you find any issues - please let us know in this forum thread!
Eugene a.k.a. Realizator

kru64
Posts: 3
Joined: Mon Oct 07, 2019 5:05 pm

Re: Oculus Quest 1/2 application

Post by kru64 »

Everything OK.

bhammy187
Posts: 6
Joined: Sat May 11, 2019 2:25 pm

Re: Oculus Quest 1/2 application

Post by bhammy187 »

I have not had a chance to test this yet, hopefully this weekend. StereoPi v1 w/ Oculus Quest v1.
Do you have any estimate on what the latency is? For the video stream on the Quest?

User avatar
Realizator
Site Admin
Posts: 900
Joined: Tue Apr 16, 2019 9:23 am
Contact:

Re: Oculus Quest 1/2 application

Post by Realizator »

We are having exactly the same latency as with our old Android application. It depends on settings and your WiFI network, and usually is near 100 ms (vary from 80 to 120 ms).
Eugene a.k.a. Realizator

neilpstevenson
Posts: 11
Joined: Tue May 19, 2020 4:51 pm

Re: Oculus Quest 1/2 application

Post by neilpstevenson »

Does this app work with the oculus go as well as quest 1/2?
Had some success with the old app, but sounds much better

User avatar
Realizator
Site Admin
Posts: 900
Joined: Tue Apr 16, 2019 9:23 am
Contact:

Re: Oculus Quest 1/2 application

Post by Realizator »

Hi Neilpstevenson,
For the app version available for download we used the latest Oculus SDK, where GO support is already turned off. But we’ll try to compile this app with the older Unity and OVR package to run it on Go. Our early version was tested on all mobile Oculus (Go, Quest 1 and Quest 2).
Eugene a.k.a. Realizator

neilpstevenson
Posts: 11
Joined: Tue May 19, 2020 4:51 pm

Re: Oculus Quest 1/2 application

Post by neilpstevenson »

Thanks. I have the latest Go system updates, version 18.0.0.xxx, but the app complains that it needs a later update.
If you could build for this version, that would be very much appreciated

User avatar
Realizator
Site Admin
Posts: 900
Joined: Tue Apr 16, 2019 9:23 am
Contact:

Re: Oculus Quest 1/2 application

Post by Realizator »

Ok,I’ll try to compile the Go version this weekend!
Eugene a.k.a. Realizator

neilpstevenson
Posts: 11
Joined: Tue May 19, 2020 4:51 pm

Re: Oculus Quest 1/2 application

Post by neilpstevenson »

Did you managed to build a Go version?
Neil

Post Reply