Olá, alguém aqui usa o VR da HTC VIVE e a lente de rastreamento ocular da Pupil Labs e conseguiu fazer a compatibilização entre os dois? Não estou conseguindo fazer o rastreamento ocular de um vídeo que estou mostrando no VR
Olá @user-af54c9 , espero que não haja problema em escrever em inglês.
Are you using the hmd-eyes plugin for Unity?
Hey everyone, does anyone know if I can deploy the latest hmd-eyes to HoloLens2?
Hi @user-15e3bc ! The HMD Eyes package is a Unity integration designed for our legacy Pupil Core VR Add-ons. Are you currently using one of these setups? Nothing precludes the software from being used with the HoloLens 2, given that you use the recommended versions, but while there was a HoloLens Binocular Add-on (as in the physical add-on mount), it’s not compatible with the HoloLens 2 geometry out of the box.
If you’re interested, we can provide an option without housing. This includes the eye cameras, world camera, and necessary cabling, which you can adapt for custom prototyping. But, you’d need to create a custom mount, possibly 3D printing some casing or finding a way to attach it to the HoloLens 2.
Alternatively, if you’re considering prototyping, our Neon system might be a more straightforward integration. Here’s additional guidance for mounting customisation of Neon in XR.
Thank you for your patience, in fact, I downloaded the source code, but I can't try to deploy it on hololens2. How can I display the binocular images captured by pupil correctly on hololens? I have designed my own 3d printed stand for this.
@user-15e3bc In that case, could I ask if you’re running both Pupil Capture (or Pupil Service) and Unity on the same computer? Could you let us know where the issue occurs, have you followed these steps ? Do the demo scenes work for you?
It's really frustrating because I can't get started. So this unity demo is able to be run properly on Hololens2 right? There doesn't seem to be any mention of MRTK related content here
Yes, I tried this tutorial and when I try to import the unity package it comes up with the following error
May I ask which version of Unity you are using and whether you define the API Compatibility Level and Runtime to .NET 4?
Well, the version of Unity is 2021.3.41f1c1.
The demo example scenes do not use MRTK
Oh thanks, should I switch the platform to UWP?
Allow me to clarify a few points:
The HMD Eyes package may not work with HoloLens 2 out of the box. You would need to modify certain scenes to ensure compatibility with the HoloLens framework, I mention running the examples without a headset to check whether the barebones work.
Keep in mind that the latest version of HMD Eyes was tested on Unity 2018.4, and support for the HoloLens 1 starter package was removed as of the 0.62 release, which supported Unity 2017.4 LTS.
That said, HMD Eyes primarily functions as a client of the Pupil Capture network API, using the ZMQ protocol, so it’s possible to adapt it for custom use cases if needed.
So it is. I won't consider making it run again Hololens2 for now then. I have a couple other issues, which is that when I run it again on the python side, capturing the camera data stream, it always reports an error. It says that the camera index was not found. What is the cause of this? Also, does pupil core support brightness adjustment?
🥹
Hello, I am currently experincing issues with Pupil Core for HTC Vive. Pupil Capture throws error messages saying eye1 - [ERROR] video_capture.uvc_backend: Could not connect to device! No images will be supplied. I have tried all simple debugging I believe, restarting Pupil Capture with default settings, restarting the PC, unplugging the eye tracker and checking all connections, using a different cable, and running Pupil Capture as an administrator to fix any driver issues. Please let me know how to fix this error. The eye tracker was working fine earlier this morning and now it suddenly refuses to connect. I've also tried using Pupil Service instead, which also cannot connect to the device. If anyone knows how to fix this issue, please let me know.
One detail I forgot to share is that when selecting the camera manually in Pupil Capture, it says that the device is already in use or blocked. This morning an error occurred with the PC and it bluescreened and restarted. This happened while Unity was running alongside Pupil Capture. I believe that this issue occurred after this bluescreen error, so hopefully knowing that that is most likely the cause of the issue will help diagnose the error and fix it. Please let me know if anyone has any ideas of what to do. I really need this error to be fixed.
Pupil Core VR Issues
Hi @user-15e3bc , could you open a ticket in 🛟 troubleshooting ?
Regarding camera brightness, when using Pupil Capture, you can in principle adjust that:
- For each eye camera, go to its respective window, click on the Video Source button in the menu on the right, and adjust Manual Exposure under Sensor Settings
- For the world camera, click on the Video Source button in the main menu on the right and then you have two options:
- Expand the Image Post Processing section and adjust settings there as you see fit.
- If that is not working for you, then set Auto Exposure Mode to Manual Mode and adjust the Absolute Exposure Time, although Auto Exposure is the preferred first option.
Are you looking to adjust brightness via Pupil Service while using hmd-eyes?
O, I think I found the exposure time, thank you very much!