Hi, We have an HTC Vive style eye-tracking system, which we would like to integrate into a mobile VR platform. When we made the purchase Sept. last year we based the decision on the availability of the Pupil Mobile app and testing we did that demonstrated that we could stream video from a web cam attached to our Pixel 2 XL Android device to a Linux laptop. I haven't gotten around to testing the eye-tracking cameras in depth until a few weeks ago. Unfortunately, I see that you guys have deprecated Pupil Mobile and maybe don't really want to support it at all. Anyway I will try my luck to see if we can have a productive dialog that will help my application along:

I ran into some issues getting the cameras to connect on the Pixel 2 using Android 10 (for some reason the VID:PIDs were coming up wrong), I upgraded to Android 11 and that seemed to fix that issue. However, now I can only stream from one eye camera at a time, while the other one repeatedly tries to connect and then fails - I even tried at reduced 5Hz reduced speeds with the same results. I was able to get a brand new Samsung Galaxay S21 phone to successfully stream both video feeds at the default rate 60Hz. Unfortunately, we are stuck with the Pixel 2XL for our Daydream VR app. Any help would be greatly appreciated, even if its just access to the Pupil Mobile source code, which I could not find online (hey aren't you "open source" friendly?). I am both an Android and Python developer so seeing the source might help me to fix my issue and take over maintenance of an unsupported feature.

@papr Yes both cameras work on Ubuntu Linux

So I did a little debugging using the adb wifi mode to capture the logcat output. When connecting the eye-tracker to the Pixel 2's USB port:

When selecting "Detect eye 0" in Pupil Capture and connecting (the video feed works):

When selecting "Detect eye 1" in Pupil Capture and attempting to connect (the video feed does not work):

Sorry, new to Discord. Using reply feature: both cameras work on Ubuntu Linux . Please see the logcat captures above for more info about the Pixel 2 issues. Since both video feeds work with the Galaxy S21 that I tested, I'm going to try to capture the logcat there to see if it can point to what is just noise.

Update: OK, I've honed in on some suspicious logcat events that only happen for the failing camera on the Pixel 2:

2021-02-16 13:17:33.222 11018-12026/? I/uvc_camera_base: [email removed] 60.0/0.000000)
2021-02-16 13:17:33.227 11018-11807/? D/UVCPipeline: getExposureModeInfo:err=-32
2021-02-16 13:17:33.246 11018-11807/? D/UVCPipeline: getExposurePriorityInfo:err=-32
2021-02-16 13:17:33.265 11018-11807/? D/UVCPipeline: getExposureModeInfo:err=-32
2021-02-16 13:17:33.267 11018-11807/? D/UVCPipeline: getExposurePriorityInfo:err=-32
2021-02-16 13:17:33.312 11018-12026/? E/aandusb: [12026*device.cpp:599:set_interface]:USBDEVFS_SETINTERFACE failed error -99 errno 28, intf=1/alt=6
2021-02-16 13:17:33.312 11018-12026/? E/uvc_pipeline: [12026*pipeline_uvc_source.cpp:254:do_stream]:ストリーミング開始に失敗した:-99

Google translated that Japanese as "Failed to start streaming"

A simple Google search tells me that the aandusb and uvc_pipeline author must be [email removed] Do you think it is worth contacting him about this project, which I presume he's moved on from? As I mentioned before, it works perfectly well on a Galaxy S21 running Android 11 with kernel 5.4, maybe if I can upgrade (or downgrade) the Pixel 2's kernel it might magically start working. I'd hope he would have an opinion before I go through the effort.

Hello, it looks like parameters "pupil intensity range" in detector 2D settings is very important for accuracy. Can I edit them from Unity script? And how?

Also, please be aware, that setting the ROI (region of interest) usually has a larger effect on the pupil detection in VR as it can help to exclude dark corner areas of the image from the pupil detection

how can i remove pupil labs addon from vive?

Also, it seems that there is no infrared light emitted for one of the eyes. Is there a setting for that or we should contact support?

Thank you!

Hello, we are nowadays working in a research project towards non-verbal communication in VR, where we use Pupil add-on for Vive Pro. We would like to use the picture found here (https://pupil-labs.com/_nuxt/img/htcvive_e200b.c244a79.jpg) and maybe the one here (https://pupil-labs.com/products/) of the add-on into our website. Of course we provide a clear reference to the product.

Are there any copyright issues we have to be aware of?

Thank you for your help!

Hey there, I am using the pupil add-on for Vive Pro and would like to record eye-tracking and gaze-mapping data of Steam VR applications (e.g. Altspace). So far I am struggling to find out how to display the actual image the user is seeing in the HMD onto the pupil-capture world view. I have managed to run the hmd-eye screencast demo in unity with pupil capture but due to my lack of coding knowledge don't know how to implement the steam vr view to any of the scenes or directly into the capture world view. Has anybody here ever used eye-tracking for Steam VR applications (is it possible at all?) or any idea where I might find a guideline on how to do so? Thanks for your help! 🙂