One more question, is there a way to enable OTG at all times? It seems to turn off after 10 minutes when not in use. Seems like something that could be easy to miss despite the warning. Thanks!
Hey @user-c6717a! Unfortunately OTG can not be enabled all the time. This is a limitation in OnePlus' versions of Android we can not disable. It is also impossible to have the app enable OTG programmatically. It has to be enabled manually by the user. I agree that this creates a risk of forgetting this when you start a recording. We tried to mitigate this as much as possible with the OTG warning and the sensor connection visualisations.
I still can not give you an estimated release date for the white paper. We are actively working on it with priority, but have partially been slowed down due to the COVID-19 outbreak. It will still take at least several weeks for sure.
Regarding your recording, it sounds like it was corrupted, which can typically only happen due to a faulty finish of the recording process, e.g. because the app crashed or the phone ran out of battery. Do you remember if you successfully finished the recording by hitting the red squared stop button, followed by "save"? Could you share the recording with us at [email removed] such that we can take a closer look at what went wrong here?
Thank you @marc! For the recording, It might have been that the battery went below 5%, but I know the phone didn’t die, so I thought I had saved it after the file stopped automatically. I thought that feature was supposed to allow you to properly save the file? Anyways, I was testing it with the battery fairly low (excited to try it out!), so I’ll keep an eye out. We will be using this in an experiment, so just want to understand all of the failure modes 🙂 I know the file is fairly big. Will those go through to that data email? Is there a particular file I would share?
@user-c6717a If the phone's battery drops below 5%, it will stop the recording and an LED in the glasses starts flashing within the field of view of the wearer. You would still have to confirm saving the recording to finish the process ( @user-0f7b55 @user-8f5305 right?). Could you zip the folder and upload that to some cloud drive, to which you can send us a link?
Yeah I think I saw the red light flashing on that recording and I think I hit save, but not 100% sure. I know I didn't hit discard. I'll upload the data a bit later today. Thanks!
Also, is there a way to adjust the calibration of the fixation after the recording is done? It looks like it was off to the right much of the time during a recent recording (although it seemed to become more accurate after I readjusted the glasses). I love the functionality being able to adjust that before hand, but it would be good to be able to fix it after the fact if we tell the participant to look at specific places during specific points in an experiment. It might even be helpful to be able to adjust for shorter segments of a recording where it seems off from a 'calibration' point. So far, I'm really impressed by what y'all have created with the Pupil Invisible. It seems to completely solve my problem of eye tracking outside in the bright California sun!!!
@user-c6717a Very happy to hear that you have success with PI in the California sun! 🙂 For some subjects it can happen that you get a noticeable constant offset in the prediction. The offset correction was added to tackle this problem. In theory this offset should be mostly constant across different slippage states of the glasses and lighting conditions, but there is some additional error for sure. Thank you for the feedback regarding this! I agree that it would be super helpful to be able to do this post-recording as well! We plan to add this as a feature to Pupil Cloud, such that you can add offset corrections to recordings online. There are a few other analysis features that take priority over this, but this will come in the not too distant future!
Awesome. Thanks and will keep you updated on our study's progress!
Hi, I'm trying to detect surfaces using Surface Tracking Plugin. Could anyone tell me which size is the best for detect markers? I use 3x3 cm as a screenshot, but it is not good for detect markers. Sometime the plugin can detect, sometime cannot.
I'm using lates pupil player (1.23.0) 😦
Hi @user-bea039, the markers seem indeed a bit too small. The best size depends on many factors, such as how far away you are from them, what resolution you are recording in and if you are moving your head (thereby introducing movement blur). We recommend you try different sizes to find a size that works stable for your setup.
@user-c5fb8b Thank you for your quick reply! I got it, I try bigger markers.
@user-bea039 also you might get better detection by including a larger white boundary around the marker.
@user-bea039 did you use the marker sheets from our website?
to me it appears the white boundary is smaller in your setup that on our example sheets
@user-c5fb8b Yes, I downloaded Apriltags tag36h11 0-23
marker sheets and print it out A4 paper.
I use this marker sheet. https://docs.pupil-labs.com/assets/img/apriltags_tag36h11_0-23.37196546.jpg
@user-bea039 ok this should have enough white space around the markers. Be aware not to cut away the white space when cutting out the markers. Otherwise you just have to try a bigger size 🙂
@user-c5fb8b OK, I make another makers with white space. Thanks a lot!
Hello, everyone! I have been greatly enjoying my experience using Pupil Invisible glasses so far! I was wondering if there is a way to extend the battery life of the companion device using some sort of external battery pack that would allow the glasses to also be connected. The phone does charge quickly, however, so extended recording sessions are still easy to do!
Hi @user-6952ca ! I am glad to hear you had a good experience so far! It is unfortunately not possible to connect an external battery pack. What you can do is to hot swap the Companion device to one with a full battery. This requires a brief interruption, but since there is no setup it would just take a couple seconds.
@marc Gotcha, thanks! Also, is it possible to grab recorded data from the phone directly without having to upload it to Pupil Cloud?
@user-6952ca Yes, you can download the recordings via USB to a computer similarly to how you would download e.g. regular photos or videos. It's the same data that you would download from the cloud. Let me know if you need more detailed instructions on how to do that!
Hi all, my new pupil invisible is no longer connecting to the the eye cameras and I can’t see an eye tracking fixation point. The world camera seems to be connecting. I’ve tried restarting the phone, uninstalling and reinstalling the app. Any ideas on how to fix this? Thanks!
@user-c6717a did you by any chance update the OS on OnePlus6 device?
I did not update the device.
OTG is enabled, correct?
OTG is enabled
@user-c6717a could you please send an email to info@pupil-labs.com with your order id and screenshot of what you see in the homsecreen of Pupil Invisible Compaion App when you press the info
button so we can see what sensors are being shown as connected? And we can continue this conversation via email.
Will do. Thank you for the quick reply!
Thanks @user-c6717a email received. We will be back in touch later today.
Hi, I tried to detect surfaces by Surface Tracking Plugin and finally I did it! Thanks a lot.
I have a question that is there any solution to fit a rectangle of surface to a real surface such as a display? An image from a camera of pupil invisible is distorted so defined surface cannot fit to the display.
I want to define the computer's display as a surface.
Hi @user-bea039, what exactly do you want to achieve? Undistorting the whole image is an expensive task, so Pupil Player does not do this. Instead we e.g. take the distortion into account when applying the common operations for the surface tracker, such as mapping gaze to the surface or calculating heatmaps.
@user-c5fb8b I want to calculate where a gaze position corresponds to a screen coordinate.
@user-bea039 the surface tracker will output normalized surface coordinates for the gaze points on the surface, i.e. x/y values between 0 and 1. When you multiply these with your screen size, you will get gaze data in pixel coordinates of your screen surface. Please have a look at the docs about the normalized surface coordinates: https://docs.pupil-labs.com/core/terminology/#surface-aoi-coordinate-system
The internal calculation of the normalized surface coordinates takes into account the screen distortion, even though the visualization of the surface (rectangle drawn on video) does not.
@user-c5fb8b Oh, that's sounds great! I'll check it. Thank you!
@user-c5fb8b how do I retrieve the camera matrix of Scene Camera?
@user-627fd4 that depends from where you want to access it. You can start by copying our prerecorded intrinsics. Would that be sufficient for you?
@user-627fd4 that depends from where you want to access it. You can start by copying our prerecorded intrinsics. Would that be sufficient for you? @papr may I know where I can find the pre-recorded intrinsics?
@user-627fd4 https://github.com/pupil-labs/pupil/blob/master/pupil_src/shared_modules/camera_models.py#L130-L149
thanks!
I am in the process of selecting an eye-tracker for research purposes (gaze data on screens and real life situations). The invisible is probably the best suited platform. It doesn't require calibrating. But what are the gaze accuracy and presicion for this platform?
Hi @user-e8f45a! We are still in the process of writing a white paper that evaluates the gaze accuracy of Pupil Invisible in detail and I can't give you exact numbers yet. The accuracy is in the order of a couple of degrees. In lab conditions the accuracy of Pupil Core is certainly higher that the accuracy of Pupil Core. But in more challenging real-world condition Pupil Invisible quickly starts to outperform traditional eye trackers. For screen-based studies the conditions are often very controlled and the accuracy demands rather high (e.g. for reading studies). If Pupil Invisible is still applicable here depends on you specific application. For real-life situations it is well suited.
@papr is there a way that I can also fetch the camera position ?
The camera position in 3d space
I have certain ideas to do so but if pupil offers this feature directly, it might save time
@user-627fd4 We offer a feature like that based on markers placed in the environment within our analysis software Pupil Player
. You can find documentation on it here:
https://docs.pupil-labs.com/core/software/pupil-player/#head-pose-tracking
Thank you
I am trying to build the Pupil Labs Invisible source code, but I am getting a GLEW error when running: 'python -m pip install -r requirements.txt' on Windows.
The error that I am getting whilst building
Hi @user-e28285 I believe you're working on running Pupil Core from source. As there is nothing that one needs to build/compile for Pupil Invisible. Please repost your discussion in software-dev to get feedback.
@wrp All right thank you. I am trying to build the Pupil Invisible monitor but after following the README I received this error, I shall repost this in the software-dev
Thanks for the clarification @user-e28285 best to continue this discussion in software-dev
Hi, I have a request for pupil invisible companion app that auto save feature when pupil invisible is disconnected. Movie and other files are lost when pupil invisible is disconnected before save button pressed :(. I think a form factor and wearability is very good and improvement of companion app makes pupil invisible much great! This is just a feedback, thank you 🙂
Thank you for the feedback @user-bea039 - videos should be saved on disconnect during a recording.
However, the behavior you describe is a physical disconnect of the hardware (e.g. unplugging USB-C from Pupil Invisible Companion device) after pressing stop but before pressing save, is this correct?
@wrp I mean before pressing stop and pressing save. I lost my recorded data accidentally I pull a cable that tight a phone and pupil invisible last month, before pressing stop and save button 😦
Thanks for the feedback @user-bea039 - Pupil Invisible should be robust to disconnects - e.g. should continue recording even if the cable disconnects. I will discuss this with our team and try to reproduce the behavior internally.
@wrp Thank you!