Hello, all. I attached the Neon on my Apple Vision Pro and trying to get gaze data. What environment do you recommand to develop? Xcode(SwiftUI) or Unity? Actually I already try to use Neon XR Unity Package(https://docs.pupil-labs.com/neon/neon-xr/neon-xr-core-package/), but it doesn't work really well...
Hi @user-737ef5 , apologies for the delay in response.
Since you are working with the Apple Vision Pro (AVP), you will probably have the most success using Xcode. But note that although the Neon XR Unity Package may not work out-of-the-box in the context of the AVP, you can still use our package as guidance. You essentially need the following:
Hello. I'm writing to seek assistance with a connection issue I'm experiencing with my NEON XR device and Unity. I have installed the NEON XR Core package in my Unity project and followed all the steps in the official documentation up to Step 7 on this page: https://docs.pupil-labs.com/neon/neon-xr/neon-xr-core-package/
However, when I run the Unity project, I'm not seeing the expected [DnsDiscovery] received response from: ... message in the console. This indicates that the Unity program is not successfully establishing a connection with the NEON device.
Here is what I have already checked: Both the NEON device and my computer are connected to the same Wi-Fi network. My Unity project is running in Play mode. I have ensured that the NEON_XR_Core prefab is in my scene.
I have two main questions: After completing Step 7 in your documentation, are there any additional configurations I need to do in Unity or on the NEON device itself to establish the connection? If I manage to record eye-tracking data, where should I look for the saved data file? I'd appreciate any guidance/ tutorial video you can provide to help me troubleshoot this issue. Thank you for your time and assistance.
Hi @user-d43541 , I've moved your message to the 🤿 neon-xr channel.
May I ask what kind of network you are using?
Hey Pupil Labs, so far I have been testing with the Anker USB Ethernet hub connected to a 2nd network card. Previously I figured out how to set this up ( https://discord.com/channels/285728493612957698/1238043619999617125/1288890519983755385 ) but it seems the behavior has changed (maybe due to a Windows update) and now I need to turn off and on network sharing each time after windows boot in order for the network connection between Companion Device and PC to establish. Questions:
-How does your usb ethernet setup look like? Have you tested with a 2nd network card? Currently our experiment pc uses ethernet connection for internet access and Windows Domain/user management.
-I have a bad feeling about continuing to use the usb ethernet hub with 2nd network card, it's already a hassle and I'm afraid behavior might change again in future. Would you recommend connecting a dedicated wifi router to the 2nd network card and use the Companion Device wirelessly? If so, is there any router you recommend?
Hi @user-ed9dfb , Windows can exhibit some inconsistent behaviour when directly connecting Neon via Ethernet cable to the PC.
The easiest way is to use a router, as you suggest. Users have reported out-of-the-box success with this router. You can plug the Ethernet cable for Neon into this router and then plug an Ethernet cable from the PC into the same router. Then, automatic device discovery should work and you don't even need a second network card. Simply plug the router into the Internet jack of your wall and both devices should also receive Internet, if necessary.
hello, on neon-xr I'm getting frequent disconnection when running the sample stream_gaze.py https://github.com/pupil-labs/pl-realtime-api/blob/main/examples/async/stream_gaze.py
INFO:aiortsp.rtsp.reader:Does not support GET_PARAMETER or OPTIONS: not sending keep alive. INFO:main:Device connection healthy ERROR:aiortsp.rtsp.reader:no RTP received for 10 seconds: closing INFO:aiortsp.rtsp.reader:connection closed, error: no data INFO:aiortsp.rtsp.reader:stopping session/playback... INFO:aiortsp.rtsp.reader:connection to RTSP server 192.168.8.127:8086 closed (error: [Errno 54] Connection reset by peer) INFO:aiortsp.rtsp.reader:connection closed, error: RTSP connection lost: [Errno 54] Connection reset by peer ERROR:aiortsp.rtsp.reader:Error on stream: RTSPConnectionError('RTSP connection lost: [Errno 54] Connection reset by peer'). Reconnecting... INFO:aiortsp.rtsp.reader:try loading stream rtsp://192.168.8.127:8086/?camera=gaze&audioenable=on INFO:aiortsp.rtsp.reader:connected!
Any idea what might be the issue here, please? Many thanks!!
Hi @user-c4e582 , may I first ask what the goal is of using this script with Neon XR? Are you running Neon XR in a Unity app on the headset?
Otherwise, are you using a University or work WiFi connection? The error that you are receiving indicates a network issue.
I'm using NeonXR on Quest3, but I can't manage to calibrate the mount. I tried installing the MRTK3 APK and building it, but neither worked. This is what I see in the PL_Calibration scene standalone
Hi @user-ef050f , the Neon XR Core Package ships with a default Quest 3 mount calibration already, so this process might not necessarily be needed in your case. You may rather want to consider a Gaze Offset Correction. If you feel regardless that you need to run a mount calibration, then you are in the correct scene and it also looks correct.
The idea is to look at the center of the target (the white ball with the black dot). When you are looking at it, hold up your hand and pinch to confirm and move to the next target. Keep going until it is finished. You can find instructions on this here.
It will be best if you disable the gaze ray from the MRTK3 Hand Menu before continuing (as well as any controller rays), since these will influence your gaze patterns.
Does that clear things up or was something specific not working?
I'm simply streaming the data using your
I am sure that this has been asked many times already but I couldn't find a FAQ section. I would like to use the Neon glasses in a Meta Quest 2 to see where someone is looking at in a 360 degree video. Is this something that could be done with the Neon XR mount? On the website (https://docs.pupil-labs.com/neon/neon-xr) it talks about building XR applications but we simply want to do eye-tracking of a 360 video. We are not using Unity or anything like that.
Hi @user-257877 , it is in principle possible to use Neon within the Quest 2, even in the glasses form-factor, although we typically recommend using a dedicated VR mount. Since Neon is modular, you can transfer the eyetracker to different frames to enable different use cases.
While we do not provide a Quest 2 mount, it is possible to build one yourself.
With respect to the 360 video, that is also possible and actually falls under the heading of "XR". No need to use Unity, although then you will want a program to do the mount calibration and convert Neon's gaze data from scene camera coordinates to the VR headset coordinates.
Let us know if you would like more details on any of these points.
Hi, I am going to purchase the inset for the Pico 4 and I have a question: - is the Pupil Neon compatible with Pico 4 Enterprise only, or also with the Pico 4 ULTRA Enterprise?
Do anyone know the answer? Maybe @user-f43a29 or @user-d407c1?
Thank you
Hi @user-97997c , apologies for the delay. I missed this message. We have not explicitly tested the Pico 4 Ultra Enterprise. We have rather tested the Pico 4 Ultra, where the mount does fit. So long as the Pico 4 Ultra Enterprise has the same shape and the same space in the facebox, then the mount will work in there, too.
Hi @user-f43a29 , no worries and thanks for the help! The external sizes are the same, I will try it out and let you know
Thanks, we will try this and I will share how it works out