Hey! When we lock the phone, the LsL stream is interrupted. Is that normal behavior?
Hi @user-7daeab , when you say lock the phone, do you simply mean turning off the phone's screen? If so, then no, the LSL stream should not be interrupted.
Are you using LSL in a Unity or XR context?
Just turning off the screen, in our case.
We use it in XR context with Labrecorder.
Hi @user-486277 , the team says that this is indeed a new version of MetaOS and that it has interferred with neon-vr-recorder functionality. They will be looking into alternative solutions.
Ok thank you very much. If there is some kind of a work-around let me know.
We will keep you updated.
Hi! Could you tell me how to perform the Companion app's Offset Correction (https://docs.pupil-labs.com/neon/data-collection/offset-correction/) when using neon-xr?
Hi @user-6671c6 , there are two ways:
Thank you, that's really helpful! Since I only have the Neon XR mount, I'll go with the second method.
Just to confirm: once I complete the offset correction via Gaze Offset Mode in the Companion app, does it automatically apply to the gaze ray I receive through GazeDataProvider.GazeRay? Thanks again!
Hi Rob, the 2nd method should also work if I record the VR image as mp4 then use it as "field-cam" in the recordingfiles and then use gaze-offset Mode in Neon-Player, should`nt it? As long as Iยดve the gaze recorded at presented gaze targets or am I missing something? It would be nicer to use the VR-recorder but our studies will begin in 2 weeks and i need a Plan B ๐
Yes, it applies directly to the output of NeonNet, which runs on the phone, so all downstream processes obtain the offset-corrected gaze signal.
Thank you so much for all your help!
Hi @user-486277 , what would be your method for recording the VR image? If you want to use the Gaze Offset method described above (https://discord.com/channels/285728493612957698/1187405314908233768/1524325315042873455) and know where they were looking, then it might be best to do the following:
Transform in Unity), along with the VR gaze data.Doing this in Neon Player will be tricky, since Neon Player is not designed for working with VR data. I imagine doing a gaze offset currently in Neon Player with a VR recording will be rather inaccurate, but you can of course try it with some test data.
unfortunatley I`ve no access to the VR-software, it is a web application and its using its own engine no unity. Iยดll give it a try with recording the image via virtual desktop. I think there u can record the image not only from one eye.
Depending on how that software presents the VR image and how it is captured through virtual desktop, you might need a projective transformation to properly map gaze onto the captured video, or a linear offset might be sufficient. Doing a pilot test will clarify that.
Ok thank you very much
hi everyone, I just want to confirm if the oneplus 13 with android 16 can use the Neon Companion app? Thanks for your answer
Hi @user-e96369 , that phone is not supported with Neon. The up-to-date list of supported phones and Android versions is here.
Actually I can see the preview but cannot collect the data. So this is reason right?
That is most likely the reason. It would be advised to use a supported phone, as we rigorously test them and can provide support when you encounter issues.
Appreciate for your reply!
So should I have another way to receive the data if not using the smart phone
The phone is the recommended and standard way. Is it not possible to use the phone that came with Neon?
I mean can I use the mac or laptop to replace using the app?
Ah, no, at least not easily. NeonNet, Neon's deep-learning powered gaze and eyestate estimation pipeline, runs in the Neon Companion app on the phone.
If you attach it to a laptop, then you would need to develop and program your own eyetracking system.
Ohh got it!
Seem the easy way is to get the pair smart phones ๐ญ
Thanks for your guidance!
I tried it today but I noticed that it is not possible to use Neon-Player and the neon xr-mount eye-data cause of missing Scene Video. Even when i add a scence Video of the VR-Image with the same length neon-player crashes. There some files missing which are build when recording wiht another frame and existing scene-camera. Is it somehow possible to ignore the mount and record everything, so that scene video is black but I get all needed files and can exchange the scene-video...I know it's a messy workaround, but I need a temporary solution ๐
Hi @user-486277 , let me confer with the team.
@user-486277 , may I ask, since the video would be black anyway, how do you plan to do an accurate Gaze Offset Correction this way? Did you have something like a target that was always at the center of the screen?
Or you were intending to always use a video with a screenshot of the VR scene?
The software developers built a small calibration sequence into the beginning of the application/recording, which the user has to look at and confirm. I wanted to use this to adjust the gaze_offset in Neon_plyer, but I don't know yet if it works.
The software developers built a small