Hey! When we lock the phone, the LsL stream is interrupted. Is that normal behavior?

Hi @user-7daeab , when you say lock the phone, do you simply mean turning off the phone's screen? If so, then no, the LSL stream should not be interrupted.

Are you using LSL in a Unity or XR context?

Just turning off the screen, in our case.

We use it in XR context with Labrecorder.

Hi @user-486277 , the team says that this is indeed a new version of MetaOS and that it has interferred with neon-vr-recorder functionality. They will be looking into alternative solutions.

Ok thank you very much. If there is some kind of a work-around let me know.

We will keep you updated.

Hi! Could you tell me how to perform the Companion app's Offset Correction (https://docs.pupil-labs.com/neon/data-collection/offset-correction/) when using neon-xr?

Hi @user-6671c6 , there are two ways:

• If you have an additional frame for Neon, then you can do it by first wearing Neon in the normal glasses frames and following the instructions at that link
• Or, if you only have a Neon XR mount, then you can present a small gaze target and display a gaze pointer in the VR simulation. As the experimenter, start the Gaze Offset Mode in the Neon Companion app and hand the phone to the participant. Then, the participant should look at the target and press their thumb on the phone to then move the VR gaze pointer until it sits where they are looking. This process is much smoother than it sounds.

Thank you, that's really helpful! Since I only have the Neon XR mount, I'll go with the second method.

Just to confirm: once I complete the offset correction via Gaze Offset Mode in the Companion app, does it automatically apply to the gaze ray I receive through GazeDataProvider.GazeRay? Thanks again!

Hi Rob, the 2nd method should also work if I record the VR image as mp4 then use it as "field-cam" in the recordingfiles and then use gaze-offset Mode in Neon-Player, should`nt it? As long as I´ve the gaze recorded at presented gaze targets or am I missing something? It would be nicer to use the VR-recorder but our studies will begin in 2 weeks and i need a Plan B 🙂

Yes, it applies directly to the output of NeonNet, which runs on the phone, so all downstream processes obtain the offset-corrected gaze signal.

Thank you so much for all your help!

Hi @user-486277 , what would be your method for recording the VR image? If you want to use the Gaze Offset method described above (https://discord.com/channels/285728493612957698/1187405314908233768/1524325315042873455) and know where they were looking, then it might be best to do the following:

• Save a timeseries of the participant's VR head position & orientation (the Transform in Unity), along with the VR gaze data.
• Have a separate version of the Unity scene that can read in this saved data and playback their view. This way, you can save an accurate video with an accurate gaze overlay.

Doing this in Neon Player will be tricky, since Neon Player is not designed for working with VR data. I imagine doing a gaze offset currently in Neon Player with a VR recording will be rather inaccurate, but you can of course try it with some test data.

unfortunatley I`ve no access to the VR-software, it is a web application and its using its own engine no unity. I´ll give it a try with recording the image via virtual desktop. I think there u can record the image not only from one eye.

Depending on how that software presents the VR image and how it is captured through virtual desktop, you might need a projective transformation to properly map gaze onto the captured video, or a linear offset might be sufficient. Doing a pilot test will clarify that.

Ok thank you very much

hi everyone, I just want to confirm if the oneplus 13 with android 16 can use the Neon Companion app? Thanks for your answer

Hi @user-e96369 , that phone is not supported with Neon. The up-to-date list of supported phones and Android versions is here.

Actually I can see the preview but cannot collect the data. So this is reason right?

That is most likely the reason. It would be advised to use a supported phone, as we rigorously test them and can provide support when you encounter issues.

Appreciate for your reply!

So should I have another way to receive the data if not using the smart phone

The phone is the recommended and standard way. Is it not possible to use the phone that came with Neon?

I mean can I use the mac or laptop to replace using the app?

Ah, no, at least not easily. NeonNet, Neon's deep-learning powered gaze and eyestate estimation pipeline, runs in the Neon Companion app on the phone.

If you attach it to a laptop, then you would need to develop and program your own eyetracking system.

Ohh got it!

Seem the easy way is to get the pair smart phones 😭

Thanks for your guidance!

I tried it today but I noticed that it is not possible to use Neon-Player and the neon xr-mount eye-data cause of missing Scene Video. Even when i add a scence Video of the VR-Image with the same length neon-player crashes. There some files missing which are build when recording wiht another frame and existing scene-camera. Is it somehow possible to ignore the mount and record everything, so that scene video is black but I get all needed files and can exchange the scene-video...I know it's a messy workaround, but I need a temporary solution 🙂

Hi @user-486277 , let me confer with the team.

@user-486277 , may I ask, since the video would be black anyway, how do you plan to do an accurate Gaze Offset Correction this way? Did you have something like a target that was always at the center of the screen?

Or you were intending to always use a video with a screenshot of the VR scene?

The software developers built a small calibration sequence into the beginning of the application/recording, which the user has to look at and confirm. I wanted to use this to adjust the gaze_offset in Neon_plyer, but I don't know yet if it works.

The software developers built a small

Hey, if I delete recordings from Neon Companion, will they be automatically deleted from Pupil Cloud as well?

Hi @user-12efb7 👋 ! No, removing recordings from the Companion Device does not delete them from Cloud and viceversa, removing them from Cloud does not remove them from the phone.

If using both, just ensure the recordings got uploaded to Cloud before deleting them.

thank you!

Hello! Is there a way to see the gaze tracking on top of a unity VR environment in the neon companion device monitor?

Hi @user-4d905c , not in the Neon Companion app or in the Neon Monitor app, but check the neon-vr-recorder tool for such a visualization.

Thank you!

hey ive been having an issue with setting up neon xr + quest. RTSP connects fine (200 OK, started playing session) but no actual gaze data ever comes through and the values just stay frozen. does anyone know why no gaze packets ever arrive? or if its something on the companion app side that's blocking it? thanks! 🙏

Hi @user-841d07 what kind of network are you using and what version of the Neon Companion app do you have installed on the phone?

hey rob, thanks for the reply. im using a hotspot from my personal phone and connecting all the other devices to that hotspot since i don't think the neon companion app would work on a school wifi. also the app version for me is 2.9.47-prod and the commspec version is v4. thanks!

hey rob, thanks for the reply. im using

He, I am facing an issue. The video on pupil cloud is not working, so i deleted it from the cloud. Now how can i upload the same video from my mobile application to the cloud? I couldn't find any way to it. You guidance will be appreciated

Hi @user-d9920d A re-upload to Pupil Cloud (i.e. after deleting a recording on the Cloud) is currently not supported. When a recording presents issues on Cloud, it's best to first get in contact with us so that we can help you.

That said, please check whether the recording might still be available among your trashed recordings. Click the three vertical dots underneath the search bar, and select Show trashed (see screenshot). If the recording is still there, please open a troubleshooting ticket or send us an email at info@pupil-labs.com with a description of the error and the recording ID (right-click on the recording > View recording information)

Thanks max for your reply, I can see the recording in the trash and will now proceed ahead as per your way

you can create a ticket at https://discord.com/channels/285728493612957698/1203979608563650650

Can you please guide me hoow can i raise the ticket for this video?

hello, I have a question regarding the Neon module in the Quest 3 headset. Right now, the module is pressing against the user and leaving marks and pressure against the skin, we were wondering if anyone has any suggestions on how to alleviate it?

Hi @user-c6d54b , if you have the version with adjustable tabs, are they set to level 3, as documented here?

they are already set to level 3