Hi ! I am very new to your technology, is there a way to read data from your eye tracker in c# in real time ? Lets say x, y of an eye and pupil diameter ?

Thanks ! I want to prepare my VR game for your hardware (which will be shipped to me next month) and I was wondering if there is a way to simulate output ? To receive some fake data without using an actual headest ?

Sure, thanks

@papr Thank you ! It might help me a lot 🙂

Do you have any useful toutorials how to use your tool with Unity 3D ?

Start it from the command line, and try to connect to it as if it was a Capture instance. Unfortunately, I do not have access to a unity instance to test it right now.

Yes you can receive pupil diameter measurements in real time. But be aware of the pupillary light reflex. It affects diameter changes much more than stress or Cognitive load ever could. If you have a game it will be very difficult to not trigger it by the displayed environment.

Do you use unity in your project?

If you are using unity already, I recommend using the plugin. It provides a c# api that can be controlled in your own script

Please check the documention linked in the hmd-eyes repository.

Hi, I have pupil timestamps for pupil_positions.csv and gaze_positions.csv. Is there any way to convert those timestamps to unix time?

Hi, many thanks for the help. That did work. I also wanted to ask you, is it possible that from gaze_positions.csv (gaze_point_3d_x, gaze_point_3d_y, gaze_point_3d_z) or from pupil_positions.csv to understand if participant looked in the left or in the right of the VR view in front of them? They didn't move their head, only their eyes.

@papr how would I know if the "start_plugin" notification worked properly?

Do you mean programmatically? If it is a custom plugin, you can emit a notification. Otherwise, Capture emits a log message when a new plugin is started. You can subscribe to logs and check if the corresponding message is being emmited

Hello everyone! I am currently using the HMD eyes Unity plugins with my Pupil Core which works perfectly. However, I need to migrate the same thing to an immersive VR system with 4 Unity instances running simultaneously so whichever is presented, needs to be synchronized with RPC calls. I'm really desperate and struggling in implementing these RPC calls in the HMD plugin (for example, to synchronize the presentation of the calibration marker). Is anyone here a freelancer who provide some support with API development/modification? Thank you! And apologies if this message is not appropriate

nvm i got it

Hi, I have a question with regards to pupil player. Is there any network API or plugin in python that can be used to communicate with pupil player to load pupil data directories and export (gaze, pupil...) csv data? When I do this procedure manually for every participant takes a lot of time.

Hey all 👋

Props to whoever set up this discord - has been fun seeing some of the cool projects here.

I'm wondering if someone can point me to a digital interfacing use case for eye-tracking (e.g. non-research, non-gaming)? I have been building a web browser in unity and thought about using eye-tracking for workflows as opposed to clunky controllers or unprecise hand tracking.

Would the accuracy/precision of something like the Binocular Add-on be adequate for doing something like email in VR/AR?

Hey everyone ! I am working on a project with Hololens 2 and I would need to prototype a Hololens 2 + core device hardware, does anyone has already did that ? I thought that it could be possible to print a frame to clip on Hololens 2 and fix the cameras of the pupil core on the frame, yet if someone has already did something similar I will appreciate any help !

Yeah I am waiting for a response in MP, anyway I did a model yesterday for core device, I plan to print it next week, if it is efficient i will probably share the model so others can use it

PM*

Hi @papr , i have some issues with using your API simulator... i have your plugin in my unity game and running API with your demo eye recording but i am not able to receive any data in my unity game. It says : Pupil Version: NOT IMPLEMENTED.

Where do i start it ? In Pupil capture ? Of directly from unity ?

Seconds after connecting plugin with API i get such an error, have you ever seen it ?

Hi, I am still working on a prototype frame for Hololens 2 + Core device hardware, I made some test today with my prototype (using the Hololens + using only the left eye camera), during the eye tracking there are some weird "white strips" during the video, I guess it is created by the light of the Hololens 2 ? During this moment sometimes the sensor is loosing my pupil and the quality seems to decrease, what could I do to improve that ? I am pretty sure that I could tune something in the Pupil capture but I have no idea of what to do could you help me ? (see the recording in the following youtube video link)

https://youtu.be/IlJN2BCfdP8

hey y'all, for some reason, subscribing to "logs." or "logging." doesnt give me any log messages from pupil, anyone know what the appropriate subject should be ?

logging. is the correct one

Technically, it should work in the same way. With the difference, that there is no required subject field.

The camera is below the Hololens so it is no looking through the visor, yet I think it might be a sampling problem, maybe due to the light from the Hololens

Yeah ok I will try. So it is possible to tune the sampling rate on core device right ?

Hello, I have a small question. I'm doing eye-tracking in VR with the plugin and my scene is very simple, just a 3d model with an animation. The thing is, if the model doesn't move, the eye-tracker works perfectly, but when the animation starts and the model moves, it's like if they eye-tracker got stuck, and the black point with the yellow circle that indicates where the user is looking at gets stuck. Why is this happening?

Here is what I mean, to be clear

Quick question. I'm always surprised at how accurately the HMD estimates gaze direction after the 3D model has been fit, but before a proper calibration. My understanding is that your calibration method is used to refine the rotation of the local space that contain the eye and eye camera. Is the observation that it is a fairly good track prior to the calibration in VR just because of the relatively stable eye/camera/screen geometry? Are you able to rely upon an "average" rotation that seems to work well across individuals?

There should be no gaze estimate before a calibration, unless you have restored session settings including a previous calibration 🙂

To check, restart Capture with default settings. If the gaze signal disappears, then it is likely that the gaze was mapped by a restored calibration. If it stays, we will have to talk details as I do not have an idea top of my head where this would be coming from. 🙂

In other news, Kevin has been working since last December on replicating the real-time HMD calibration offline. We see this as an essential step to the ability to refine the gaze estimate post-hoc, as you can with the core, in pupil player. We are checking his progress by comparing gaze estimates when looking at a 9x9 point assessment grid. He has made some great progress, but is still unable to produce the same gaze estimates online and offline. He is cleaning up his code a bit now, and will share it with you soon. We hope you'll be able to help us diagnose the differences.

The key point here is that we may ask you to donate some of your time to help us out.

Giving you a heads up, because I know you're a busy guy

...the upshot is that, if this works, I imagine it would be of great value to the community.

I have had to caution several colleagues against degrading their data quality by attempting to reprocess the data collected in VR offline.

Saved them from quite a lot of wasted time and frustration.

Hi,

My name is Vicente Prado, I am a professor of psychology at the University of Valencia and I already have eyetracker glasses (pupil core), recently I have acquired a virtual reality glasses Oculus Quest 2, would it be possible to install the HTC Vive Add-On or other similar?

Best regards and thanks

ok, thanks