๐Ÿคฟ neon-xr


Year

user-7daeab 01 July, 2026, 11:46:20

Hey! When we lock the phone, the LsL stream is interrupted. Is that normal behavior?

rob 01 July, 2026, 11:48:53

Hi @user-7daeab , when you say lock the phone, do you simply mean turning off the phone's screen? If so, then no, the LSL stream should not be interrupted.

Are you using LSL in a Unity or XR context?

user-7daeab 01 July, 2026, 11:54:58

Just turning off the screen, in our case.

We use it in XR context with Labrecorder.

rob 02 July, 2026, 08:19:54

Hi @user-486277 , the team says that this is indeed a new version of MetaOS and that it has interferred with neon-vr-recorder functionality. They will be looking into alternative solutions.

user-486277 02 July, 2026, 08:38:33

Ok thank you very much. If there is some kind of a work-around let me know.

rob 02 July, 2026, 08:38:44

We will keep you updated.

user-6671c6 08 July, 2026, 04:06:34

Hi! Could you tell me how to perform the Companion app's Offset Correction (https://docs.pupil-labs.com/neon/data-collection/offset-correction/) when using neon-xr?

rob 08 July, 2026, 08:04:35

Hi @user-6671c6 , there are two ways:

  • If you have an additional frame for Neon, then you can do it by first wearing Neon in the normal glasses frames and following the instructions at that link
  • Or, if you only have a Neon XR mount, then you can present a small gaze target and display a gaze pointer in the VR simulation. As the experimenter, start the Gaze Offset Mode in the Neon Companion app and hand the phone to the participant. Then, the participant should look at the target and press their thumb on the phone to then move the VR gaze pointer until it sits where they are looking. This process is much smoother than it sounds.
user-6671c6 08 July, 2026, 11:12:40

Thank you, that's really helpful! Since I only have the Neon XR mount, I'll go with the second method.

Just to confirm: once I complete the offset correction via Gaze Offset Mode in the Companion app, does it automatically apply to the gaze ray I receive through GazeDataProvider.GazeRay? Thanks again!

user-486277 14 July, 2026, 09:20:19

Hi Rob, the 2nd method should also work if I record the VR image as mp4 then use it as "field-cam" in the recordingfiles and then use gaze-offset Mode in Neon-Player, should`nt it? As long as Iยดve the gaze recorded at presented gaze targets or am I missing something? It would be nicer to use the VR-recorder but our studies will begin in 2 weeks and i need a Plan B ๐Ÿ™‚

rob 08 July, 2026, 11:21:10

Yes, it applies directly to the output of NeonNet, which runs on the phone, so all downstream processes obtain the offset-corrected gaze signal.

user-6671c6 08 July, 2026, 21:57:41

Thank you so much for all your help!

rob 14 July, 2026, 10:36:52

Hi @user-486277 , what would be your method for recording the VR image? If you want to use the Gaze Offset method described above (https://discord.com/channels/285728493612957698/1187405314908233768/1524325315042873455) and know where they were looking, then it might be best to do the following:

  • Save a timeseries of the participant's VR head position & orientation (the Transform in Unity), along with the VR gaze data.
  • Have a separate version of the Unity scene that can read in this saved data and playback their view. This way, you can save an accurate video with an accurate gaze overlay.

Doing this in Neon Player will be tricky, since Neon Player is not designed for working with VR data. I imagine doing a gaze offset currently in Neon Player with a VR recording will be rather inaccurate, but you can of course try it with some test data.

user-486277 14 July, 2026, 12:23:40

unfortunatley I`ve no access to the VR-software, it is a web application and its using its own engine no unity. Iยดll give it a try with recording the image via virtual desktop. I think there u can record the image not only from one eye.

rob 14 July, 2026, 12:26:15

Depending on how that software presents the VR image and how it is captured through virtual desktop, you might need a projective transformation to properly map gaze onto the captured video, or a linear offset might be sufficient. Doing a pilot test will clarify that.

user-486277 14 July, 2026, 13:19:13

Ok thank you very much

user-e96369 14 July, 2026, 17:28:38

hi everyone, I just want to confirm if the oneplus 13 with android 16 can use the Neon Companion app? Thanks for your answer

rob 14 July, 2026, 17:47:52

Hi @user-e96369 , that phone is not supported with Neon. The up-to-date list of supported phones and Android versions is here.

user-e96369 14 July, 2026, 17:50:30

Actually I can see the preview but cannot collect the data. So this is reason right?

rob 14 July, 2026, 17:52:33

That is most likely the reason. It would be advised to use a supported phone, as we rigorously test them and can provide support when you encounter issues.

user-e96369 14 July, 2026, 17:50:42

Appreciate for your reply!

user-e96369 14 July, 2026, 17:52:28

So should I have another way to receive the data if not using the smart phone

rob 14 July, 2026, 17:52:55

The phone is the recommended and standard way. Is it not possible to use the phone that came with Neon?

user-e96369 14 July, 2026, 17:53:31

I mean can I use the mac or laptop to replace using the app?

rob 14 July, 2026, 17:54:41

Ah, no, at least not easily. NeonNet, Neon's deep-learning powered gaze and eyestate estimation pipeline, runs in the Neon Companion app on the phone.

If you attach it to a laptop, then you would need to develop and program your own eyetracking system.

user-e96369 14 July, 2026, 17:55:13

Ohh got it!

user-e96369 14 July, 2026, 17:55:35

Seem the easy way is to get the pair smart phones ๐Ÿ˜ญ

user-e96369 14 July, 2026, 17:55:43

Thanks for your guidance!

user-486277 17 July, 2026, 10:03:38

I tried it today but I noticed that it is not possible to use Neon-Player and the neon xr-mount eye-data cause of missing Scene Video. Even when i add a scence Video of the VR-Image with the same length neon-player crashes. There some files missing which are build when recording wiht another frame and existing scene-camera. Is it somehow possible to ignore the mount and record everything, so that scene video is black but I get all needed files and can exchange the scene-video...I know it's a messy workaround, but I need a temporary solution ๐Ÿ™‚

rob 17 July, 2026, 10:07:17

Hi @user-486277 , let me confer with the team.

rob 17 July, 2026, 10:12:30

@user-486277 , may I ask, since the video would be black anyway, how do you plan to do an accurate Gaze Offset Correction this way? Did you have something like a target that was always at the center of the screen?

Or you were intending to always use a video with a screenshot of the VR scene?

user-486277 17 July, 2026, 14:02:53

The software developers built a small calibration sequence into the beginning of the application/recording, which the user has to look at and confirm. I wanted to use this to adjust the gaze_offset in Neon_plyer, but I don't know yet if it works.

rob 17 July, 2026, 14:17:05

The software developers built a small

End of July archive