Hi, I wonder if I can access to a pupil invisible through realtime api, within a docker project using ubuntu, currently I successfully install the package within the docker project, but still cannot detect the device (device = discover_one_device(max_search_duration_seconds=10)). Btw I used mac under the same network, and could detect the device. I checked the api documentation, I suppose I kind of need to configure the project so that MDNS and UDP is allowed??

Hi there, I see that in the description and evaluation of pupil invisible paper, the pupil invisible glasses "deliver unbiased gaze estimates with less than about 4◦ of random spread over most of the field of view".

Is it possible to derive a radius/buffer that accounts for this 4 degrees of spread given the gaze data, and if so how should we go about doing this? Also, would it be accurate to say that it's possible that the true gaze may lie somewhere within this buffer?

Hello, I am having trouble running the Reference Image Mapper (and Face Mapper as well) on Pupil Cloud. I believe other users also faced similar issues in the recent weeks?

I tried to start running them both from the new (cloud.pupil-labs.com) and old (old.cloud.pupil-labs.com) pages without any luck. The progress bar visible on the old page is always stuck at "0% Done". I tried to wait 30–60 minutes, and hard refresh the page several times, without any changes. I also tried to run brief samples in a new project (like 2 X 2-minutes recordings), again without any luck...

Hello I am having trouble running the

Hello, I would like to ask 2 questions:

1. is there any roadmap for offset correct in the cloud? Sometimes we can only catch offsets post-hoc, when we are back in ght lab. If/As more people are using the cloud for preprocessing including AOI detection, it would make sense to enable such a feature. For example in our project we have to take our analysis of line using the pupil player + plugins, for this reason, although the cloud analytics are otherwise sufficient for our purpose.

2. in the offset correct in the pupil player, is the offset constant across the scene camera space or is it spherical/angular, so smaller in the centre and wider on the periphery? I wonder if i can take the processed data and apply the offset correction when i do the analysis downstream (e.g. in R)

Thanks!

Hi there, I have a question regarding the Pupil Player Software. I used it in a recent video to analyse my Pupil Invisible recordings. I was interested in two things: The scene video and the pupils of my participant. When I downloaded the respective file from the Pupil Cloud and tried to open it in the Pupil Player yesterday, all I got was a grey screen. I already recognized that you modified the layout of the Pupil Cloud and the downloaded folder contained less files. Can I still use the Pupil Player and if not, what is my alternative? Thanks!

Thanks for the additional info. That's interesting! The export format has not changed in theory, so I wonder what is going on. When you say "did not work" you mean the scene video is gray, or do you also see other symptoms? Which files are missing? And could we maybe inspect one of the recordings? It would suffice if you let us know the recording ID (available e.g. in the info.invisible.json file) and state your explicit permission for us to access the data.

Dear Pupil Labs: when i am trying to upload the video to the cloud, it is not working with error code:zmq_msg_recov errno4 in the phone. i tried to link with different wifi, it is not working. how should i slove the problem of uploading the video? thanks

Hi @marc. I have to questions which are really important for my recent study. 1. When I plot "fixation x [normalized]" and "fixation y [normalized]" I don't understand why the fixations are distributed in the way you can see. Which is the main gaze axis and what are the boundaries (e.g. -1,+1 in x and y)? As far as I know the origin of the coordinate system is in the upper left corner with x to the right and y downward. But in all my cases it looks totally different with many negative values. Please help me understand how I can analyze the graphs. 2. When I move between frames in Pupil Cloud with the arrow keys I always jump in 5s steps, but I need a much finer transition. Why isn't it possible to change the frame steps? Please advise haw I should do this. Thanks a lot.

Hello,

I’m using a Pupil Invisible in a driving study and seeking help integrating GPS data into the output stream. I know the companion device has GPS capability, but after some initial looking, I don’t see an option in the app to engage this metric. I could collect the GPS data externally, but that brings sync issues with the Invisible’s frame rate. Has anyone tried this and could offer any suggestions for integration? Wondering what the best approach would be going forward.

I’d appreciate all answers!

Hey Pupil, we received a few error messages while recording, but our RAs were only able to take the attached picture. The other error messages mentioned something about a "sensor malfunction".

Could you provide some details on what might cause these issues and how to quickly resolve them in the future?

Hi @marc,

[email removed] (Pupil Labs), what do negative gaze positions mean please?

Hi everyone, I'm currently trying out the project from the alpha lab using densepose (https://docs.pupil-labs.com/alpha-lab/dense-pose/). When using it we get in output a video and different csvs. One of them: densepose.csv is the same as gaze.csv but we a supplementary column indicating gazed body parts. However in this column, there are sometimes multiple different body parts + 'background' indicated for a single nanosecond. I can't find anywhere if it's the body parts ordered by certainty for this specific nanoseconds or something else. Could someone enlighten me on that point?

[email removed] (Pupil Labs), is there a document that explains how the pupil diameters were derived and how it can be converted to more realistic dimensions?

[email removed] (Pupil Labs), how can I overlay the heatmap with a section of the video recording from PupilCloud. Do I have to distort the heatmap so that the corners of the png match the corners of the trapezoid, or do I have to put the heatmap on the whole image section?

Hi @user-a15383! The heatmap you can download from Pupil Cloud is always rectangular and corresponds to the rectangle you get when undistorting the trapezoid of the surface into a rectangle.

the image background in the heatmap is such an undistorted crop from the scene video. This is essentially a homography transformation. Let me know if you need further input on how to get this done!

Dear Pupil Labs Team, we are currently running a study in Berlin, in which we want to measure the perception of participants while walking through the city. We use the Pupil Invisible to record eye tracking data. Unfortunately, some of recordings, after being uploaded in the cloud are just grey. This is very confusing as the camera seems to be recording and we didn’t receive error messages. I attached an screenshot so you can see what I’m referring to. Do you what might be reasons for this? Moreover, some times the recording just stopped without notifying us. Instead of a recording that was supposed to last almost 2 hours, we now have only 20 minutes… We are also using the LSL relay, as we want to synchronize eye tracking with other physiological data. Can this be a problem as well, so that the recording is less stable? Can you give me any information about what the reliability while walking through the city should be like?

Best regards Anton Voss TU Berlin

Yess sure its not just the first seconds of the recording, which are grey. I also can not play the recordings on the companion. An ID of one of the affected videos is: cb918757-a2bf-41ea-87f4-fcb6c9f670b8

Same for recording: 0e3b68ee-3872-4c6c-9474-6602e1ef1563

And for this recording after 46mins: 5b556c54-d111-4c9c-8695-47c7f9ae9a67

I have another different question: I have 12 different phones and for each of them when I want to change the wearer from the app, it's endlessly showing a screen 'syncing wearers'. I found a post about this from 2020 but solutions didn't work. My phones are connected to internet, restarting them didn't work. Do you have any idea?

It worked thank you @marc !

Hi, i have been experiencing some trouble lately, on the phone i am unable to get any feed when i put the glasses on. i am unable to know if the recording is happing or not. when the device is not worn then the video feed is seen. can i get some help.

Where exactly can I lower the sampling rate? Did not find this option on the app ...

Okk no worries. This is the same as "eye video transcoding" I assume?

Hi, @user-480f4c thank you for prompt reply. so my problem starts when I connect the device with the phone, the app starts to flicker a bit. and then normalizes. after that when I preview the feed (with out wearing the glasses), I have a clear view of what the device is seeing but when I wear the device and then preview the feed, I am getting a black screen on the feed. there is no feed and I am unable to understand if I should do the recording or not. I have been using the feed to calibrate each different user but without the feed I afraid to use the device. Hope this is elaborate. Please let me know.

@user-480f4c Sure will do. thank you so much 🙌

hi Marc, hello everyone 🙂

I took a look at the recording exports, under https://docs.pupil-labs.com/export-formats/recording-data/invisible/ When you're talking about recording exports, this isn't just hitting export on a recording in the companion app, or is it?

it's something you do via the cloud?

Hi @user-1391e7! To add onto the response, exporting your data through Pupil Cloud is the recommended path. After uploading a recording to Pupil Cloud additional data streams are added to the recording such as blinks and fixations. These are not available when accessing the data directly from the phone.

It is however possible to read the raw sensor data from the phone. This requires opening the binary files using e.g. Python though and is not super straight forward.

thanks! Yes, I've played around with that a little. currently using the realtime-api to run an online version of an I-DT fixation algorithm. now just looking to compare a little, see how far off the mark I am 😉

is there information on what thresholds you set for the calculations on the cloud?

like say.. 1° of visual angle, minimum duration of 100ms? both higher?

Hi @user-1391e7 ! You might not be able to fully compare them, the fixation algorithm employed in the Cloud does use the scene camera optic flow to compensate for VOR and head movements, you can read more about it here https://docs.google.com/document/d/1dTL1VS83F-W1AZfbG-EogYwq2PFk463HqwGgshK3yJE/export?format=pdf

This fixation algorithm, is currently being peer reviewed and once the process is over, we plan to make it publicly available, so that you can directly implement it with the realtime API. So please stay tuned! 😉

gotcha! thanks for the link!

how are blinks handled in this case? right now, I noticed that gaze data comes in anyways, even if my eyes are closed. would that be a separate detection that runs concurrently to fixation detection, get filtered or would the input for the fixation algorithm change in dependence of a blink detection?

I noticed the jump as well. had some cracked ideas on how to detect that jump, but it's not identical for every user. and like you said, the jump itself finishes a fixation in any case. but when we're looking at the saccades more closely, rather than the fixations, then I eventually have to (with some degree of accuracy or certainty) discern between what was caused by a blink and what was a real saccade

one more minor thing, just for clarification: with respect to the logged gaze values, as well as the ones sent via realtime api:

both have the offset I've set via the companion app applied, right? or would the log be the absolute raw data so to speak and I'd have to reapply the offset recorded in info.json? I could see either way make sense, in a way, but I'm guessing they're logged with the offset applied.

also thank you for the many answers, you've been most helpful!

Hi@marc, Pupil Cloud has a wonderful update! In previous versions, I could download raw data in Pupil cloud for processing in Pupil player. I was wondering in knowing if I can still get this type of data from the pupil cloud now or if I can only get it via USB.

That's so cool and very helpful! Thanks!

while in the cloud, with my workspace open, whenever a new recording is currently uploading ~~or is being processed~~ (just the upload), I seem to be unable use playback of other recordings that are uploaded and have finished processing. Is this intended behaviour?

I do see the recording get loaded for a second or so in the player, with the thumbnails in place and the first frame loaded and then it disappears, the play button becomes greyed out

might it be a browser or operating system issue? Windows 10 with Firefox & Chrome

Hi @user-1391e7 ! Would you mind doing a hard refresh on the page? Did that solved it? Also could you send us a screenshot or screen recording of such behaviour at info@pupil-labs.com

Once recordings are processed, you should be available to play and work with them, independently of whether there are other recordings being upload.

refreshing doesn't change the behavior, it always happens if I'm trying to look at a video that is old, is finished, was processed, while I also see another video is being uploaded

it's like the little upload progress visualisation kills the loaded video (different recording than the one being uploaded)

I have no recordings left at the moment to upload, but I'll just make another real quick. just need it to be long enough so the upload progress stays for a little while

done, hope that helps

if it's not just my system somehow, I'm guessing it's just caused by this little upload progress circle. where the update of that visualisation somehow unloads the video or doesn't allow me to play the already processed video at the same time as another one is being uploaded and visible

thanks @user-1391e7 , we would look into it

found a temporary workaround as well, so it doesn't hinder me in the end. I just need to add the videos I want to watch to a project, switch to project view (then the video being uploaded isn't in the list) and it works

Hi, I'm struggling with pupil player (using Invisible). There doesn't seem to be a world cam movie. There seemed to be a new update. Any idea what might be happening?

Hello everyone!) our team experiencing some trouble with data analysis via PupilCloud. I’ve got a few questions. Firstly, we put several recordings in one project, let’s say it’s 12 videos. But after making the enrichment and downloading files - there’s lack of recording IDs. It seems like the fixation file contains data for only 6 recordings? We don’t understand why is this happening? And second question is about timestamps. It’s a UTC timestamp, but in what units do the time and the fixation duration measure, seconds or milliseconds? I hope my explanation is clear) Can I get some help, please?

inside the files of the download (e.g. fixations.csv), you should be able to find the recording ID as one of the columns. in the same files, you can see the measurement units in the header-line. so for fixation duration, we have "duration [ms]", meaning milliseconds. for the timestamps, we have - for example - "end timestamp [ns]", meaning epoch timestamp in nanoseconds

https://docs.pupil-labs.com/export-formats/recording-data/invisible/

Hi Pupil Labs team! I have a quick question. We are going to perform a measurement campaign next week where we will use the Pupil Labs Invisible device. We will record quite some data each day, and we don't have the possibility to upload all of it over the internet. However, we only get one shot for doing the measurements, and therefore, I'd like to back-up the data over USB. When connecting the phone to a laptop, I cannot see the folder where the recordings are stored, however. Where can I find this? nB I know it is possible to make exports of each recording and transfer these over USB, but can I do without loss of data? We would like to compute gaze and fixation data afterwards, which I know can only be done (for now) upon uploading in the cloud.

@user-dc2c1d hi, anuj here. we have a scheduled pick up of the "invisible" your team through Fed-ex. there has been an update on that. kindly check your mail and let me know

Local transfers are mainly used for those who want access to the raw data via Pupil Player, our desktop app. But you don't get access to the enrichments in Cloud that way.

When I download videos from pupil labs cloud workspace, the download folders do not contain the following files: gaze ps1.raw, gaze ps1.tim, PI world v1 ps1time, PI world v1 ps1.mp4, extimu ps1.raw, extimu ps1.time, and info.json. I am using pupil invisible glasses.

However, these files were in my downloads from pupil labs cloud in April. Can any help me figure out how to download these files? I need them to run analysis in iMotions.

I found the solution from help posted in a previous post. Thanks.

Hey Pupil Labs team! I'm reaching out for assistance with some issues I'm encountering in the Pupil Cloud workspace. I keep receiving an error message that says "Precondition failed: If-Unmodified-Header Too Old." This error appears when I attempt to delete files or enrichments, move certain video files into a project, or create a reference image mapper enrichment. I'm using Microsoft Edge as my browser. I've tried using alternative browsers like Chrome, which allows me to perform some tasks, but I still encounter "internal server errors" when attempting to move certain videos into a project or create an enrichment. All our videos were recorded using the Pupil Invisible glasses and uploaded using the companion device and they play back with no issues. They are all max 10 mins long and have been recorded over the last couple of months. Any help or guidance you can provide would be greatly appreciated.

I trust you are well. We encountered an issue during a recent experiment and I'm hoping to tap into your collective knowledge for possible solutions.

During the experiment, we had 12 invisible devices and their respective companion devices activated simultaneously using the asynchronous API. We've been sending periodic messages to these devices. These companion devices, enclosed in a silicon case (designed for air flow) and worn around the neck, have ample storage space and were fully charged prior to the performance.

However, approximately 30 minutes into recording, one of the invisible glasses began to flash red and the companion devices vibrated. Of note is that both devices were notably hot to the touch at this point.

Any thoughts or suggestions on this would be highly appreciated.

Best Regards,

@user-dc2c1d hi anuj here, we had a query regarding the dispatch of the invisble. we have mailed the details. kIndly have a look and let us know.

Hello, I am trying to associate gaze with each frame of the video. I am using pupil invisible and I directly got the data from the phone without using Pupil Cloud. I extract frame of the world.mp4 using ffmpeg, and got the gaze data by dragging the folder into the Pupil Player and clicking the export button. However I found that for some videos, there is a slight difference in the frame number (about 20 frames). For example, the 20-th frame by ffmpeg corresponds to the 0-th frame by Pupil Player. Is there any idea of how and why this happens?

For example, the left image is the 1221-th frame by Pupil Player (you can see it from the bottom) and the right image 1221-th frame by ffmpeg. Due to the slight time difference, if I put the gaze of the 1221-th frame to the ffmpeg extracted frame, it is not at the correct position.

Thanks @nmt ! I was trying to use only some clips in the whole video, so I tried to generate those clips by first extracting frames and then creating the clips using the corresponding frames. I will first try vsync 0 to see whether this can resolve my issue!

Then you can run the 'World Video Exporter' plugin. Very easy to do.

Further instructions here: https://docs.pupil-labs.com/core/software/pupil-player/#world-video-exporter

Hello, my question is: Is it necessary to use the cloud or is it possible to bypass it?

Thank xou. I´ll try it.

And the player is just online. theres no desktop version?

FFMPEG plotting gaze