Hello, We are looking to implement the following scenario:

When looking at text on paper, it is automatically translated and appears on the glasses. Among them, when looking at a specific phrase, that phrase is output through a speaker. With a swipe gesture of the hand, the content of that phrase is transferred to a smartphone.

Would it be possible to implement this with the Neon Pico 4 Add-on product (https://pupil-labs.com/products/vr-ar) Both eye tracking and pass-through are needed.. would it be better to use the Meta Quest Pro?

Hi @user-a27091 👋. Thanks for your interest in the Neon-XR Add-on! What you suggest is technically feasible. We have a couple of different ways to implement eye tracking with the Pico 4. Recommend heading over to our documentation, where you can find more details about how to work with the system. For example, we have an MRTK3 template and Unity3D libraries to get you started (links in the docs).

Hi ! I am interested in using the Neon XR for our application. I am primarily working in Unreal Engine. I saw that the NeonXR does not support UE yet.

1. But I am thinking of an alternate pipeline in which I will read the frames from the VR headset (as recorded by the camera on Neon module) and the synchronized gaze tracks and transfer these to an external Python script using the Real-time API. Then whatever data I need to send back to the UE environment, I plan to send using a UDP port connection between the script and UE. Is that possible ?
2. Additionally, is it possible to read real-time blink rate and pupil size data from Neon XR using the real-time API? Thanks a lot for the help !