Hi, I have a problem with Pupil Core binocular headset and Pupil Capture on Macbook Pro M1 (macOS Ventura). It seems that only one eye camera can work at a time. When I start it, only one eye camera is active. If I try to enable the second eye camera, the first one gets disconnected. This started happening recently, and before that it worked fine. Any advice? Thanks!

Hi

We're planning to buy the neon machine from India. Just had a few queries about the availability of spares and whether the glasses truly work without the need for calibration. We've worked with Tobii glasses pro 2 before and we had problems with people who didn't have perfect vision where the gaze data would be off. Will the neon be able to work around this?

Thanks Nadia

Did I connect with you on Linkedin 2 days ago

Is this a public chat platform . Is it ok to ask queries

Hey everyone. During a few of my latest recording sessions, one or more camera feeds from our Pupil Core crashed, resulting in a corrupted video file. For instance, the recording folder contains a "world.mp4.writing" file instead of the standard "world.mp4" file, and Pupil Player isn't able to open the video. Anyone has encountered a similar issue before and could tell me if recovering the file, even partially, is possible?

Hi @user-1aa180! Please share the player.log file immediately after trying to open the recording. Search on your machine, pupil_player_settings. Inside that folder is the log file.

Hello everybody!

I'm starting to get into your pupil core glasses, doing the tutorial, using the sample_recording_v2, where I encountered something that's puzzling me: gaze_positions.csv is calculated from pupil_positions.csv, correct? but pupil_positions starts with time_stamp 329353.721339 and gaze_positions starts with time_stamp 1216.218711,347 how do these correlate? Or don't they, and I just misunderstood something?

@user-480f4c hello, I see that you have an add on for Epson BT300. But I have only BT35E, could you check if your add on also work for BT35E? thanks a lot

Both eye cameras cannot work at the same time on Mac M1

It's the file named, 'player'. You can share it here or with data@pupil-labs.com if it contains information you don't wish to make public!

Hi, I have a problem with the calibration. I am working in Linux and when using the pupil core capture software the calibration does not work as the marker remains all the time in the same position without moving. I obtain the following information in the log file:

2023-07-05 13:50:21,005 - world - [INFO] calibration_choreography.base_plugin: Starting Calibration 2023-07-05 13:50:21,107 - world - [DEBUG] calibration_choreography.screen_marker_plugin: Moving screen marker to site at (0.5, 0.5) 2023-07-05 13:52:22,286 - world - [INFO] calibration_choreography.base_plugin: Stopping Calibration 2023-07-05 13:52:22,313 - world - [DEBUG] calibration_choreography.base_plugin: Calibration already stopped. 2023-07-05 13:52:22,315 - world - [DEBUG] gaze_mapping.utils: Dismissing 2.13% pupil data due to confidence < 0.80 2023-07-05 13:52:22,315 - world - [ERROR] gaze_mapping.gazer_base: Calibration Failed! 2023-07-05 13:52:22,315 - world - [ERROR] gaze_mapping.gazer_base: Not sufficient reference data available.

Any ideas on how to solve it? Thanks

The resolution is set to 1280,720 and the camera views the whole monitor that I have in front of me. The distance is just some centimeters from the monitor.

The calibration marker appears but it is always in red and it does not move

No, I haven't. What I just realized is that it says in the main page that 2 markers detected, please remove all other markers. This appears as the marker does not move, I go back to the main page and that is the message that it appears in yellow

Maybe this provides more info; if not, I will try other calibration methods

But I do not have any other marker.... 😦

2023-07-05 16:15:17,332 - eye1 - [DEBUG] pye3d.eye_model.background_helper: Dropping task! args: ('add_observation', <pye3d.observation.Observation object at 0x7f7d30c70e80>), kwargs: {}

I get this in the log file

Ok, I send it there

Hi all-I'm new to this system. Apologies if this is a common error, but I looked through the forums here and could not find anything on this. We recorded the a couple of minutes from one mac computer (osx 13.something I believe). Everything looked fine and I started to do some analyses. I then saved the whole folder for that day to google drive. Now on my work computer (osx 12.6.7), the eye movements show up in pupil player, but video does not. I also notice that none of the mp4 files in the folder play (world, eye0) in quicktime (Version 10.5 (1126.4.1)) on this computer. Any thoughts on what I can do to get the video back? These same videos do play when I load them in VLC, so I suspect it might be QuickTime that is causing a problem.

I'm now across the country from that computer. I think the best I can do would be to have a colleague try to send it over via dropbox or something. Interestingly, when I pulled over the 'world.mp4' file using a thumbdrive, I had no problem viewing it on this computer using quicktime. But I didn't pull the whole folder so I cannot try to analyze that data in Pupil Player.

Hi @user-b08155. It sounds to me like something got lost during the upload to and download from Google Drive. What browser did you use?

chrome

actually chrome on the upload, firefox on the download.

Hi. We are completely new to pupil labs. We have successfully managed to collect data and have exported raw data files into excel. The next hurdle is data analysis. How does everyone typically analyse fixation data- we would like to compare fixation for two groups? We would also like to create two heatmaps comparing both groups fixation - does anyone know how best to do this? Thanks in advance!

Hi team, we would need a longer cable to connect to the eye tracker, around 3 meters.. what kind of cable settings would you recommend to avoid any further latency? thanks

I am having an issue where the eye camera and scene camera are throttling their sample rates to match the display refresh rate of the monitor the eye windows are open on. If I move either eye window to the 120 Hz display, the rate jumps to 120 Hz. It then then falls back down to 30 Hz when moved to the 30 Hz display, while still running. We have confirmed that the data sample rate is matching. Is this how the system is designed? Can we disable this coupling?

Hey folks. I've been having issues with the 3D eye model in pupil capture. I can't for the life of me get it to consistently work. The best luck I've had is spamming the 'reset 3d model' button until the 'long term model outline' looks appropriate, and then freezing the model.

Here is a video of what I am experiencing.

Can anybody from Pupil offer me some advice? I never used to have this issue.

Morning...my Neon Companion app is crashing / won't open. I need to back-up yesterday's data and be start collecting new data imminently. Any ideas / options? Thanks. 👓 neon

Hi @user-c10c09 ! Sorry to hear you are experiencing this issues, do you see any error message? Are you using the latest version of the app? Could you hold your finger over the app icon, go to App Info > Storage > Clear Storage or Data depending on which Companion Device do you have?

After that you would have to log in into the app again, go to Settings > Data Usage > Import recordings (within the app) to restore your recordings.

That sounds fair! Let us know if you struggle at any point.

Side note, clearing the data on the app info's view should not end up in loosing your data but rather that you would have to reimport previous recordings. That said, yours is a perfect valid and safe approach, mine was more in case you could not open the app.

i am using pupil core in my research work.

i am trying to compare driving data between beginner and a pro driver. I have taken driving datas with pro diver and a beginner driver. Can you please suggest me how can I proceed forward . What can be the next step to do in my project. Please help .

Hi - need to test you now... I'm running a study using Neons and I'm getting an intermittent sensor fault. With some participants it happens in around 30-60 seconds of use, every time I start recording, and for some participants I don't get a fault at all. It's the red light flashing in front of the left eye and the phone vibrating away that there's a fault, so easily noticed. Any ideas on how to resolve? It'll be frequent with one participant and not at all with the next... Thanks,

Heat maps

Hi our cable has broken- is it possible to get a new one. I mean the one, connecting the Eye-Tracker withe the USB Cable

Hi need to test you now I m running a

Hi, we were thinking of ordering a new eye tracker and were wondering if you could provide us with details regarding the shipping duration?

Hi @user-80c70d 👋 ! Nice to hear that you are considering our products, could you contact [email removed] indicating which product you are interested and to which country would you like it to be shipped? The sales team would be able then to respond to these queries.

may I ask an additional question, are your new eye trackers able to record eye movement outside in the sunlight?

thank you a lot for the information!

[email removed] (Pupil Labs), is there a document that explains how the pupil diameters were derived and how they can be converted to more realistic dimensions?

Hi @user-4c21e5 thanks for the tip! I am also wondering if I could also use a wireless USB extender? would that work?

thank you. is there a maximum cable length limit if we intend to simply use a longer cable instead?

I have diameters in the range of 15 to 90. That does not seem realistic to me, if it is in mm. I will review the publication in the link. Thanks.

hi everyone! Could someone kindly tell me whether pupil core could connect to cell phones instead of to the computer like pupil invisible? Our experiment requires subjects to wear the eye tracker while walking around. Can core support this?

ok！got it！thank you！

Hi everyone, I am using the pupil core glasses with a double monitor display and the pupil cameras are consistently losing track of the pupils, I'm hoping someone here can help. The cause of this issue is unclear, so I'll be pretty thorough in my explanation of all of the things that are going on. Basically, whenever the pupil cameras lose sight of the pupils, the eye tracking stops and the cameras are unable to find the pupil again (even when it is fully in view) until there is movement of the eye, or it's chance when it reconnects. The issue seems to be fixed when changing from 'extending' to 'duplicating' the screen display designated as the monitor in the pupil computer app. The issue also does not appear with some people whereas it consistently happens with others. Thanks in advance! Update: We may have solved the issue, changing the maximum 2D pupil size setting to ~150 pixels in the post-hoc plugin settings prevents the loss of tracking. This also fixes the 3D measurements since the 3D measurement seems to be built off of the 2D measurement.

Hello, good morning/good afternoon/good evening, I'm having some problems with my equipment, it has a failure in the device descriptor request and then windows shuts down the usb, someone know what could I do?

Hello Meon Support Team...After setting up the device and successfully completing the first recording, the device is no longer being recognized on the Neon app. The screen prompt to plug-in remains even after I have plugged the device using the USB cables that were provided by you. I have tried rebooting the phone, reinstalling the app, but the problem persists. I would much appreciate it if you can reach out to me as soon as possible.

Hello! It's my first time using the Core and I can't get it to work. For now I'm still just trying to follow the tutorial on https://docs.pupil-labs.com/core/, but the PupilCapture software is not showing camera (or any kind of) input.

My steps: 1. I plug in the device 2. I open PupilCapture 3. I get the errors from the attached screenshot

After a while, the error messages disappear. Then I have a grey screen and a repeatedly appearing message that some devices have been found, but nothing else happens (I've also attached a video that shows this).

I work on MacOS Ventura 13.4.1 with an Intel MacBook. The USB port that I am using is working as expected with other devices (i.e. keyboard, mouse).

Any help would be greatly appreciated!

Sorry, I forgot the video that I promised. Here it is 🙂

Hi! I have a recording I made with the world camera at 1024x768 but when I try to open it in Pupil Player it says "no camera intrinsics for camera world at resolution (1280, 720)" so the world camera is all gray. The world.intrinsics file also correctly says it was 1024. Any idea where it's getting 1280 from or how I can change it? Thanks!

Hi! I am using pyuvc to read the eye cameras and the world camera of the Pupil Labs Core glasses. With the eye camera I don't have any problem to access the images but with the world camera I have problems. To access the images from the world camera I don't always get images and if I move the headset cable that is connected to the computer I get TimeoutErrors and I can't reconnect to the camera. why does this happen? it's strange because with the eye cameras I don't have any problems when I move the cable.

I tried with windows and linux

Hi @user-720765 ! The LED rings on the HTC Vive eye tracker addon are used for illuminating the eye and capturing clear images of the pupil. While the pye3d algorithm used by Pupil Labs is glint-free, it still requires good illumination to accurately detect and track the pupil. The LED rings provide the necessary infrared illumination for the algorithm to work effectively.

Hi @user-e91538 @user-e91538 👋 ! The issue you're experiencing with the world camera of the Pupil Core could be related to the cable connection or the camera itself. Here are a few possible reasons for the problem:

1. Cable Connection or Quality: The cable connecting to the computer may be loose or damaged. If using a 3rd party cable, it may be of lower quality or not designed to handle the data transfer required by the world camera. This could lead to intermittent connectivity issues. Try using a different cable or a higher-quality cable to see if it resolves the problem. The connector of the world camera to the cable tree might be damaged, is there any visible damage?

2. Camera Hardware: There could be an issue with the world camera hardware itself. It's possible that the camera is faulty or damaged, which is causing the intermittent image access and TimeoutErrors.

In any case, please contact us at info@pupil-labs.com for further debugging steps.

hi, can anyone help with this? :) thanks

sure

actually it's quite big, hope you can download it

https://kuleuven-my.sharepoint.com/:f:/g/personal/lyan_porto_kuleuven_be/Emq4-QyrQrJMhuYkrozHE9cBLvsh4SRYDYHy7ishMdqsqw?e=MuNZ3s if it helps

Hello! Regarding the Surface Tracker, is there any integration for LSL (Lab Streaming Layer)? In essence, does data from surface detection get streamed via LSL plugin or do I have to make a new plugin? If so, any help / insight to the matter would be really helpful.

Hi! I'm trying to open my recordings in the pupil player on my mac. For some reason pupil player closes after trying to load the file. I tried re-installing it but that did not fix the problem.

Hi! I am trying to integrate my own camera with Pupil Lab's code. I found the original camera parameters set in the 'camera_models.py' file and added my own camera name and parameters. Then, I made modifications to the 'default_capture_settings' and other parameters in 'eye.py'. However, I found that it cannot run, and it still connects to my Pupil Core for operation. What should I do next? Please help me!

Pupil Capture no longer recognizes my cameras. It says they are disconnected when they're not. Smetimes after 5+ minutes they suddenly come on line. Using MacOS Big Sur on a macbook. what the heck?

FYI I'm conencting directly to a thunderbolt port. Pupil Capture used to recognize the cameras instantly.

I opened Pupil Capture from the Applications folder and pasted the suggested command into Terminal

@user-cdcab0 yes the command to run with administrative rights - thank you for responding

When you say they sometimes come online after 5+ minutes, do you have the software running that entire time? Or you just have your headset plugged in and, after a few minutes, try launching the software and it works?

@user-cdcab0 I have the software running. Pupil Capture says USB not connected - my macbook does not have a usb port so I use the thunderbolt port, which used to work

Hello,

I am doing a psychophysics experiment using MATLAB and I want to record eye tracking with Pupil Core. I want to send triggers from MATLAB to the Pupil Core with the timestamps of the moments where certain stimuli are presented. I read a couple of discussions on this topic online but as a newbie, I got really confused.

The MATLAB computer that I am using does not have Internet access right now, but the Pupil Core computer does. My first question is do I really have to have Internet access to both computers to send event triggers? Is there a way that I can manage this via a LAN cable between the two computers?

If yes, can you walk me through the steps I need to do for this? (I basically want to be able to successfully use “send_annotations.m” function in my setup)

I would much appreciate any help!! 🙂

When I download videos from pupil labs cloud workspace, the download folders do not contain the following files: gaze ps1.raw, gaze ps1.tim, PI world v1 ps1time, PI world v1 ps1.mp4, extimu ps1.raw, extimu ps1.time, and info.json. I am using pupil invisible glasses.

However, these files were in my downloads from pupil labs cloud in April. Can any help me figure out how to download these files? I need them to run analysis in iMotions.

From the software's perspective, USB and Thunderbolt are the same thing. Anyway, what you're experiencing is definitely abnormal, and I suspect it's the result of some hardware issue. Do you use any other devices on that port? If so, do you have any problems with them? If the port works fine otherwise, it may be a problem with your headset

Neither computer needs internet access for that to work, but you do need network access between them (e.g., on the same LAN or WiFi). If you look at pupil_remote_control.m in the matlab folder of the pupil-helpers repo, you'll see a line that defines an enpoint:

endpoint =  'tcp://127.0.0.1:50020';

That 127.0.0.1 is an IP address - in this case it refers to the same machine running the matlab code. To connect to a different machine, you'd replace 127.0.0.1 with the IP address of the computer running Pupil Capture. As long as the computers can talk to each other over the network (even without internet access), it will work.

Hi there, I noticed in the gaze_position.csv file that gaze_normal_0 has repeated data for two rows. The same is true for gaze_normal_1 but the repetitions are just offset by one from the other eye. Is this expected? If so, why? Thank you very much in advance for your help!

Yes, other people have reported that the matlab-zmq package is not compatible with Matlab 2021b and newer. You'll find some discussion and potential alternatives here: https://discord.com/channels/285728493612957698/446977689690177536/1121708316876341259 and here: https://discord.com/channels/285728493612957698/446977689690177536/1123432094526361753

It worked, thank you!

No problem. It sounds like your build environment may not be configured correctly. Do you have ZMQ 4.0.x installed? Did you modify config.m so that it points to your ZMQ installation?

Hello, I was struggling (for a while) to get my pupil camera (Microsoft HD-6000) to work with Capture. After following "https://github.com/pupil-labs/pyuvc/blob/master/WINDOWS_USER.md", I was able to see the camera in the manual drop down list in Capture, but I kept getting the error "the selected camera is already in use or blocked". I ended up figuring out that for some reason my mouse (Logitech MX Master) was interfering with the connection. With the mouse dongle plugged in, only certain ports would detect the camera. With the mouse dongle unplugged, the camera is detected every time and on any port. Once Capture has connected to the camera, I can re-insert my dongle and use as normal. Just wanted to share my findings to help anyone else having issue.

No, you shouldn't need internet access to compile if you have everything installed already.

config.m should point to your ZMQ 4.0.4 installation. There's a sample config_win.m that you should examine. Can you double-check that your config.m looks similar to config_win.m? Is the error that you're seeing from when you run make.m?

No problem! There's a lot of little details with this sort of thing, so it's always nice to have an extra set of eyes around. Let me know how it goes and if I can help further 🙂

Nothing jumps out at me looking at your code. What version of Pupil Capture are you running? Can you double check to ensure that the Annotation Capture plugin is enabled?

Thank you for your reply! I didn't notice this feature before, but I couldn't get it to work. I tried connecting three USB cameras and checked the 'Enable Manual Camera Selection' option. In the dropdown list of cameras, all camera names were displayed as 'unknown @ Local USB.' When I clicked on any camera, it showed the message 'the selected camera is already in use or blocked.' However, I can access these cameras using the built-in Windows camera application. What could be the issue? Is there something that needs to be set?

hi！I still have some problems about this question. Is there any way to solve this problem? I still do not understand why the pupils aren't visible for some angles. And why does core don not have this problem? thx

Although reinstalling software can sometimes fix issues, it generally makes does not matter what your network configuration is when you install it - only when you run it. This is true for our software as well.

Taking a second look at your snippet, I do notice that the value you have for label is numeric, but it should be text like the topic value. Unfortunately, I don't have Matlab, so I'm unable to test whether this is causing the freeze or not, but it should certainly be changed.

I'm not sure what to say about the LP_IP_ADAPTER_ADDRESSES error. It seems to be an error caused by an external library we're using and not in the Pupil code directly. I haven't been able to find much info that would help troubleshoot it.

Ah, ok makes sense. You currently have:

currentTime = zmq.core.recv(socket);

But I think you need to specify the buffer length. IIRC, floats in the standard python implementation are always 64-bit, so you need to read 8 bytes:

currentTime_bytes = zmq.core.recv(socket, 8);

I suspect that will give you an array of bytes, which you may be able to use as-is if you don't need to actually interpret the value in Matlab other than just sending it back.

But you might need to convert it first (if you need to use the value within Matlab, you definitely will). It looks like Matlab's equivalent data type would be double, and I think the conversion would look like this

currentTime = typecast(currentTime_bytes, 'double')

thanks for your reply! Is there any case of using pupil core with a single board computers? Sadly I do not have any experience with this technique.🥹

Nice work! It's interesting though... that type conversion feels completely wrong to me, but it wouldn't be the first time Matlab surprised me in a way like that. If you inspect or print currentTimeNum in Matlab, does the value match what you expect?

I am still confused . If you use the single board computer to collect data. Does core need another device to supply power ? Or one single board computer is enough?

And could core use pupil cloud to save data?

Thank you for your help. I have two cameras now working properly. However, one of the cameras displays an upside-down image. Ideally, I could rotate the camera to correct this, but rotating the camera would make it difficult to fix securely. Is there a way to set the camera to vertically flip the image?

Hi Pupil Labs team, I have a question about the eye videos recording.

For the participants' anonymity, we are required to not record the eye videos during our experiment. I found that the Pupil Capture software offers this possibility. However, I would like to enquire about the quality of the data in this case. Does the disabled eye video recording impact the tracking signal or the subsequent analysis in the Pupil Player ? Thank you for your help ! 🙂

Hello I would like to ask whether setting ROI in pupil labs eye cameras has any impact on eye tracking quality instead of leaving the borders in the corner of the window.

@user-888ccf yes, it does especially with mascara, I would recommend setting an ROI that covers the range of motion of the pupil..

Hi @user-6586ca! Hmm. That's an interesting question 🤔. It is technically possible to record gaze data in its raw form, i.e. the raw coordinates, without the need to also record the eye videos. Conceptually, not recording the eye videos should have no impact on the quality of your data. However, you won't be able to do any post-hoc processing. But before we get into the details, it might be best if you describe your experimental setup and exactly what kind of data and outcome metrics you need!

Where I can find to download pupil_capture.exe ?

Thanks for the answer! I'm aiming for real-time usage. It should't be that hard to modify the existing plugin to send data to LSL, should it? I'm quite experienced in programming, so I'm asking beforehand to avoid any surprises.