Hi, we're trying to run your Unity plugin on Android (with AR-Foundation plugin), we have to use Scripting-Backend IL2CPP (without it our app crashes for other reasons, it's just demanded). However, MessegePack (which you use in your plugin) doesn't support IL2CPP (only mono) and requires (according to MessagePack developer) something called pre-code generation (Ahead Of Time Compilation). We weren't able to make it work. Do you know how to work around the problem ?
Unfortunately, not. That question is best to be directed at the msgpack developers.
MessagePack works when running it on Windows in Unity Editor, but refuses to cooperate while built on Androis device
@user-0aca39 Could you elaborate on how you use Unity on Android? Do you overlay AR content on the phone or is it a AR headset that is driven by the Android app?
Everything happens on Android device, we use AR Foundation's scene to perform AR-features. On top of it we try implemented your Gaze Tracker in the same scene, which connects to Pupil Service via local network and tries to exgande eye data
What eye tracking hardware do you use?
We build apk and run it as an Android App, works pretty well tbh
(except for the messagepack issues)
Your own eye-tracker
Places inside Aryzon headset
Thank you for the clarification. 👌
Placed*
HTC Vive Add-On to be precise
Np 😉 Do you know any alternatives for MessagePack in your plugin ?
There might be other msgpack implementations but you will need some kind of msgpack decoding. It is the main serialization format for the data transfer.
@papr Thany you very much for your help, have a nice day
You too! Please let us know if you find a suitable solution!
Thank*
hi I want to use vr/ar components. Which model of HTC is more suitable? Is HTC vive pro2 suitable? Thank you
Hi @user-4bc389 The Pupil VR Add-on is compatible with HTC Vive, Vive Pro and Vive Cosmos. Our hardware is not compatible out-of-the-box with other VR headsets.
Hello, I have a quick question about hmd-eyes unity plugin. I can understand this plugin will work with pupil core but can I use this for pupil invisible as well? I want to get pupil invisible data from unity and try to implementing it (without vr connection). Is it possible? Thank you.
Hi! 👋 This would be problematic because Pupil Invisible relies on the smartphone companion app for real-time gaze estimation. Gaze is within scene camera coordinates. See this message for reference: https://discord.com/channels/285728493612957698/285728493612957698/980804590716993588
Thanks for reference!
While Richard is correct about the different gaze coordinate systems, you can remote control some of Invisible's functionality via the http API nonetheless. https://github.com/pupil-labs/realtime-network-api
Thank you so much!
Is it okay to use the diameter_3d values to calculate pupil size? (or is there other value or equation that needs to be done?)
Hi @user-886683 👋. diameter_3d
is our pupil size estimate in mm. If you haven't already, I'd recommend reading our Pupillometry best practices: https://docs.pupil-labs.com/core/best-practices/#pupillometry
https://pupil-labs.com/blog/research-digest/better-pupillometry-corneal-refraction/ I also found this article and is there a open source or plugin for this?
The employed eyeball fitting and refraction correction scheme is already implemented as part of the Pupil Capture/Player pipeline! However, the exact data filtering and processing steps done in the paper, if you wanted to reproduce that, would need to be implemented by you.
Thanks! Also, I Found the diameter_3d in multiple extracted csv files from Player. Is these values are all equal??
Note that if you run the exporter more than once, you'll get multiple 'pupil_position.csv' files in different export folders.
diameter_3d
could be different if you ran post-hoc pupil detection and tweaked the 2d detector settings, or froze the pye3d model at different times, for example.
hello I have a problem with the VRAR extension for the HTC Vive. Every time I start PupilCapture, only the right eye is detected. The left one (eye1) remains gray and without image. However the messages states that eye1 camera is detected but backlight value could not be set... Normally I could solve the problem by restarting, but since today that doesn't work anymore. I have tried it on different computers but without success. Is this problem already known and/or what could be the reason? I already thought of a loose contact... 😦 But the device is also not so old (bought in May / June this year)
Hi, could you check something for me? In Pupil Capture, open the video source menu, switch to manual camera selection, and let me know which entries are being listed in the source drop-down selector