Hi, I just got a "cloud sync error". The data is not getting stored on the cloud. The phone is connected to the WiFi, and it is working. Will I lose the recorded data? Or will the files get uploaded in some time ? Help!

@user-df9629 Is this happening for a specific recording? Can you press the context menu on that recording and tap "Upload" ?

You will not lose any data unless you delete that recording from the phone

Hey @user-0f7b55, I did click on upload. It shows a red exclaimation mark. Upon clicking on metadata, it says "cloud sync error". I took another recording. Same issue.

did you try log out from the settings and log-in again?

On the companion app ? No

Let me try that.

Yes, please do.

That helped

The prior recordings are getting uploaded and I took a new one as well which is also in queue to upload.

Thank you, @user-0f7b55

Sure!

@user-df9629 would you mind sharing the PI Companion App version you are using?

@user-0f7b55, sure. The version I am using is 0.7.1-prod

Hello, I have a question. I got PI and OnePlus 6. The phone said an update is available. Can I update it?

Here is a detail of the update.

@user-bea039 you can, but we don't recommend it. Android 8 runs a bit more stable compared to android 9.

@mpk thanks. I don’t update.

Anyone success to connect PI from Pupil Capture with PI Preview plugin? I can't link to PI, because the plugin shows no items at pull down menu.

@user-bea039 you can preview video streams from Pupil Invisible in Pupil Capture if desired. You can do so by selecting in the backend manager in Pupil Capture: - Manger = Pupil Mobile - Remote host = OnePlus6 (your companion device name) - Source = PI world v1 | PI right v1 | PI left v1 (world, right eye, left eye)

@user-bea039 perhaps you would like to use Pupil Invisible Monitor instead though: https://github.com/pupil-labs/pupil-invisible-monitor/releases/tag/1.1 ? What are you looking to achieve?

@wrp Here is my pupil capture's settings. I can't find any remote hosts.

and this is pupil mobile status. I think that the reason of this issue may occurred pupil mobile and pupil capture uses different commspec (pupil mobile uses v3, pupil capture uses v4).

I downloaded latest version of pupil capture(1.18.2) and pupil mobile(v1.2.3).

I tried to use pupil invisible monitor, however PI monitor doesn't work for me. The window shows gray background and "R" button and there are no buttons to connect PI. My wifi router is AirMac Extreme and no devices connected without PI and my computer.

Here is my environment.

@user-bea039 I see that you are using Pupil Mobile and not Pupil Invisible Companion. Use Pupil Invisible Companion App with Pupil Invisible glasses Use Pupil Mobile with Pupil Core headsets

What hardware are you using? Pupil Core or Pupil Invisible?

@wrp Thank you for your reply. I'm using Pupil Invisible. I tried to use Pupil Invisible Companion App with Pupil Invisible glasses and Pupil Invisible Monitor, however Pupil Invisible Monitor doesn't work 😦

Still gray window, like this.

@user-bea039 are you able to record and preview in the Pupil Invisible companion app? Can you share a photo of that?

Once this works, the next step is to make sure that UDP transport does not get blocked in your wifi.

The PI device will only show up in monitor when the glasses are connected and running on the companion phone.

@mpk Yes, I can record and preview in the Pupil Invisible Companion App.

The phone and my computer which runs Pupil Invisible Monitor app are connected same wifi network. I send udp packet to the phone from iTerm, then the phone received the packet. (I use nc command and this app https://play.google.com/store/apps/details?id=jp.gr.java_conf.tcp_udp_testtool&hl=ja). Thus, my wifi router doesn't block udp packet.

then it 'should' work. I m dont know other reasons that would make it fail. You should see a button come up at the bottom of the PI monitor app that you click to enable view the realtime video and gaze from your PI device.

I m running the same version of PI monitor on my mac and cant reproduce your issue. Maybe its udp multicast thats blocked?

@papr any idea how we could debug this?

I ran Pupil Invisible Monitor from code, the app doesn't show R button 😦 .

@user-bea039 a quick google suggests that there are some mulitcast issues with Airport Extreme routers. I would check the networks options.

no need for the 'R' button we have removed it.

@user-bea039 Can you confirm that you should see debug messages if you run from source?

@papr of course! here are debug messages.

pupil-invisible-monitor on  master [?] via 🐍 v2.7.16
❯ pupil_invisible_monitor
2019-11-07 22:02:56 [INFO] Using NDSI protocol v4
2019-11-07 22:02:56 [DEBUG] Starting network...
2019-11-07 22:02:56.559 Python[17840:2504856] ApplePersistenceIgnoreState: Existing state will not be touched. New state will be written to (null)
2019-11-07 22:03:39 [DEBUG] Stopping network...

@user-bea039 Could you edit line 32 in __main__.py? Just add a # in front of it. Afterwards, you should see a lot more debug messages when you start the application.

The message Stopping network is shown when I stop the app as ctrl+C

Also, are you running Python 2.7.16? I was not aware the app was supporting this 😄

@papr I'm using Python 3.7.4 🙃

Using python 3.7.4, like this python3 -m pupil_invisible_monitor.

That is great, thank you.

I am not 100% sure but it looks like Pyre (the network discovery library) is choosing the wrong network interface. Could you open the "Network Utility" application and share a screenshot of the Info tab after selecting wifi as interface?

Is this ok?

ok, this confirms it. Pyre is choosing the wrong interface. Could you make sure the network interface order is not misconfigured on your mac? You can check it in the Network system settings.

Wifi usually comes after ethernet but your ethernet is not connected right?

No, ethernet is not connected.

Is Wifi second?

Wifi is first

Ok, thank you, this looks correct.

I found that the Pupil Invisible Monitor successfully connect to the phone from debug messages. 172.27.254.68 is an IP address of the phone. However, there are no buttons on the Pupil Invisible Monitor. So, I think that the button's position may be wrong.

2019-11-07 22:24:32 [DEBUG] Checking out interface lo0.
2019-11-07 22:24:32 [DEBUG] Interface lo0 is a loopback device.
2019-11-07 22:24:32 [DEBUG] Checking out interface en5.
2019-11-07 22:24:32 [DEBUG] No data_2 found for interface en5.
2019-11-07 22:24:32 [DEBUG] Checking out interface ham0.
2019-11-07 22:24:32 [DEBUG] Finished scanning interfaces.
2019-11-07 22:24:32 [DEBUG] Address: 25.54.53.196
2019-11-07 22:24:32 [DEBUG] Network: 25.0.0.0
2019-11-07 22:24:32 [DEBUG] Broadcast: 25.255.255.255
2019-11-07 22:24:32 [DEBUG] Interface name: ham0
2019-11-07 22:24:32 [DEBUG] Set up a broadcast beacon to 25.255.255.255:5670
2019-11-07 22:24:33.056 Python[18652:2537052] ApplePersistenceIgnoreState: Existing state will not be touched. New state will be written to (null)
2019-11-07 22:24:33 [DEBUG] Connecting to peer 8675cafd-0677-8117-067a-ab4de7ebe43b on endpoint tcp://172.27.254.68:49152
2019-11-07 22:24:33 [DEBUG] 2e8a12 send HELLO to peer=notset sequence=1

Is there any chance to resolve this issue by fix UI layout?

Oh, the messages shows just connecting to the phone.

Interesting. You should see more messages confirming the connection though.

e.g. 2019-11-07 14:16:02 [DEBUG] <Host PI DC 3>.add_sensor(video)

There are no messages like add_sensor.

only like this.

I think the issue is that the udp broadcast is able to find the phone but the selected interface is not able to communicate to via tcp to the ip address.

I think there is a short term work around and a long term solution:

Work around: look into disabling the all wrong interfaces manually until the correct inteface is choosen.

solution: We will look into the possibility to pass a specified interface to the application to avoid these issues in the future.

Is the app trying to communicate using the interface ham0?

2019-11-07 22:30:50 [DEBUG] Checking out interface ham0.
2019-11-07 22:30:50 [DEBUG] Finished scanning interfaces.
2019-11-07 22:30:50 [DEBUG] Address: 25.54.53.196
2019-11-07 22:30:50 [DEBUG] Network: 25.0.0.0
2019-11-07 22:30:50 [DEBUG] Broadcast: 25.255.255.255
2019-11-07 22:30:50 [DEBUG] Interface name: ham0
2019-11-07 22:30:50 [DEBUG] Set up a broadcast beacon to 25.255.255.255:5670

correct

oh

I remove ham0 and I successfully connect to the PI!!

Thanks a lot!! @mpk @papr

LogMeIn, that is a vpn client software, offers ham0 interface, so I uninstall LogMeIn client from my computer.

Great!

Interesting that it is not listed in the system preferences. Very sneaky!

(side note - VPN and remote desktop tools - like TeamViewer - often modify network settings)

(I use LogMeIn to connect my machine learning machine. So sneaky... Hidden trap.)

Hi! I am glad the issue was solved but just for knowledge:

You can also create a hotspot from the MacBook and connect the phone to it directly. It worked for me a couple weeks ago.

@user-bea039 , @wrp , @papr .

I have done that with Pupil Monitor only^. I just noticed the Pupil Preview.

📣 We are excited to announce Pupil Invisible Companion App v0.7.2 release. 📣

One of the main new features of this release is an improved gaze offset correction. This feature enables you to adjust the gaze offset of a wearer from within the real-time preview. For a guided experience (tutorial) go to the active wearer profile and click Adjust. Alternatively, you can enter the offset correction mode in live preview with a long press.

The offset parameters will be saved with the wearer. The offset will be applied to any new gaze data you record or stream.

Make sure to update Pupil Invisible Companion App in the Google Play Store.

We look forward to your feedback 😎

Excellent!!! 😎 🤩

@wrp , THANK YOU so much for the gaze offset in the info.json. I highly appreciate it.

And tutorial for adding gaze offset is pretty smooth too!

Feedback on the update: It is AWESOME!

I noticed some extra files being written out after the update: "gaze_right ps1.time" and "gaze_right ps1.raw". The length of these files is same as gaze ps1.time and gaze ps1.raw respectively. However, the gaze_right ps1.raw consists of only zeros and the two time files are not the same either. I don't know what information are the extra files supposed to contain. Just thought of letting you know of what I noticed.

Hello! The lab I work in is thinking of buying Pupil Invisible for research purposes, and I was curios how easy can we get the data Invisible is providing. Is there an easy way to export all the information from both eye and scene cameras, gyroscope, and accelerometer and then analyze those without using your software? Are there any limitations on what can be exported to some other software such as Matlab? Thanks

Hey @user-e05b9e , we have bought Pupil Invisible in our lab for research purposes as well. It is very easy to access scene, eyes, gaze and imu data once recorded. I do all the analysis in python and don't need additional software. You can check out the recording format (https://docs.pupil-labs.com/developer/invisible/#recording-format) for understanding the files being exported. I can't comment on the matlab part since I haven't tried it but I think it would work.

Thanks @user-df9629

Hi, just unpacked our invisible glasses. They are very cool. How do we get the pupil dilation data please?

Hi @user-326cfb pupillometry data is not yet calculated with Pupil Invisible. This is a feature that we are working on and will be able to share via a software update in the upcoming months.

Thanks, please would you make me a beta tester for this, thanks!

Pupil dilation was THE main reason that we bought the glasses.

@user-326cfb we will be sure to let you know as soon as this is available.

I'm considering buying the Invisible. One of the things that is holding me back is that Cloud does not currently support surfaces. It takes quite a while for Player to completely map each relevant fixation point onto a surface (about 15 minutes for a 5 minute video). It seems that data can be exported before that time, but upon inspection it has large gaps throughout the data set. The automatic data analysis was one of the winning features of Invisible for me, but I really need the ability to define surfaces as well. As I understand it, the only way to create surfaces from an Invisible video is to download the video from Cloud, upload it into Player, and then make edits there. However if this is the case I may as well just stick with the Core. Is surface definition going to be supported by Cloud? If so, when can we expect it?

I have the very same question regarding surface mapping in the cloud and it's currently the sticking point for me on whether or not to get the Invisible

@user-a21e3c @user-83ceb7 we are actively working on new features for Pupil Cloud. We will be releasing new features on a rolling basis, and are aiming to have a big set of new features ready in Q1 2020 for cloud, which will address your needs/requirements.

Excellent! Looking forward to it

Hi, is there anyone who can teach me how to analysis the recordings over PC?

Hi everyone! I'm currently using Pupil Labs for an experiment where we require participants to look down on a computer screen. I'm wondering if there is a way to avoid disturbance from eyelashes during the process? Thank you!

@user-c629df are you using Pupil Core or Pupil Invisible? Edit: just saw you posted to both 👁 core and this channel. Please do not double post. I am assuming this is Core related so I will respond there.

Hi everyone, I,m curently using Pupil Labs to control robot arm, can i get gaze date from Pupil Invisible and pass gaze coordinate to my robot arm

@user-a98526 yes, you can get gaze coordinates from Pupil Invisible over the network. Please see: https://docs.pupil-labs.com/developer/invisible/#network-api for documetation and example(s).

Hey everyone, I am having trouble logging into the compaion app on the OnePlus 6 Companion Device. Previously I logged out of a colleagues account. I am trying to use a account I made 30 Minutes ago, or so. Is there somethin I can do? Thanks in advance. 🙂

ok, it seems you need to have an updated version installed to re-login?! anyway it works 🙂

Hi I’m having a problem with the Pupil Invisible Desktop App which I’ve downloaded but when I try to run it then it keeps coming up the following problem

@papr or @user-c5fb8b please could you take a look at ☝️ today?

@wrp Thank you very much

@user-057596 This issue appears when minimizing the application. We will release an update for Windows today.

@user-057596 The release has been updated. This is the direct download link to the fixed bundle: https://github.com/pupil-labs/pupil-invisible-monitor/releases/download/1.2/pupil_invisible_monitor_windows_x64_1.2-15-gdb43d87.7z

Thank you so much papr. I will try this later today.😁

hello there, I'm new here and I'm about to acquire a pupil invisible

has someone here used it for research, I'm looking forward the workflow of the invisible

and know how to operate it, end to end, if someone could help me please

Hi I tried the new update for the Pupil Invisible Desktop App but unfortunately this doesn’t seem to be working either and all that is appearing is as follows: Cheers Gary

Hi @user-057596 looks like we received an email with this information from you (or your colleagues) as well. I will post the response from my email here as well for complete coverage:

Pupil Invisible Monitor will show a gray screen until it detects a Pupil Invisible Companion device on the same WiFi network. When Pupil Invisible Companion is on the same network, you will see an 'on' button appear in the bottom of the Pupil Invisible Monitor window. Click on and you should see scene video with gaze overlay.

If you do not see a scene video and gaze overlay Pupil Invisible Monitor. Please restarting Pupil Invisible Monitor App and Force Stop Pupil Invisible Companion App on Android to force a restart (you can force stop by long pressing the app icon then clicking app info from context menu then force stop button in the app info view).

Please give this a try and let us know if that solves the issue

@user-81a601 I or my team would be happy to schedule a time to meet with you for a demo via video/screensharing. Please follow up via sales@pupil-labs.com so that we can set up a time.

Hello to you all! Our company is new to eyetracking and the Pupil Invisible, but still we've managed to get everything set up alright, now just waitintg for the hardware. Great to see such an active and helpful community when browsing through the discussions here. Looking forward to working with Pupil.

Hi @user-ea78b7 👋 welcome to the community 👋

Question: You said you "managed to get everything set up", but do not yet have Pupil Invisible hardware. Out of curiosity, would you be able to share what exactly were you setting up prior to receiving Pupil Invisible?

HI @wrp, and thanks! I've installed all the necessary software (and, I think, even more than necessary, as I've also installed Capture, Player and Service) to one of our workstations. Invisible Monitor shows a grey screen and is waiting for a device, so I've got that going. I'm quite good with Python so when I have some time I'll see if I can understand what is going on here. I was rather overwhelmed by all the dependencies but I think these were mainly for the Capture, Player and Service-Software, which, afaik, are mainly for Core hardware.

Hi @user-ea78b7 thanks for sharing 😸 In the most typical use case with Pupil Invisible you will only need what comes with Pupil Invisible. You can also install Pupil Player for post-hoc visualization and analysis and Pupil Invisible Monitor for real-time streaming/preview.

As you correctly note, you will not need Pupil Capture or Pupil Service (unless you are curious about the software and just want to poke around 😸 )

Re "overwhelmed by all the dependencies": You should just be able to download the application bundles from https://github.com/pupil-labs/pupil/releases/latest or https://github.com/pupil-labs/pupil-invisible-monitor/releases/latest - and do not need to deal with dependencies.

I hope this provides a bit of clarification. If you have other questions, just let us know!

Haha, okay, wow, I've installed all this manually - including a 15GB package of Visual Studio + packages. 😄 Anyways, it was a learning experience, too, so I'm not bummed out at all. Good to know that Player will serve a purpose, too. The Monitor is direly needed for our purposes, as we will most of the time have clients during our usability tests who will be eager to see first-person video.

I apologize if this wasn't clear - this must have been quite a time-sink. How can we improve on communicating where to get application bundles?

@user-ea78b7 re Pupil Invisible Monitor - we would highly recommend that you use a dedicated WiFi router to minimize latency.

@wrp I'm trying to re-trace how I've come to the conclusion that I had to install Pupil via the "time-sink"-method (you are right, this took an afternoon of my time) right now. Now that I try it seems so obvious that I should have just downloaded everything from /pupil. Thing is, even though I can program in Python, R and a little bit of Java, I've never been in computer engineering or software engineering and, therefore, don't know about the processes involved with github let alone specific terms. I think my mistake was that I first took a look at /pupil/docs/dependencies-windows.md and, to me, that looked like the installation guide. What I'd found there wasn't too far out there, so I went on with it.

@user-ea78b7 thank you for the feedback, it's very helpful. We will try to make it more clear how to get the apps on the website and in docs (and maybe add a few warning/info sections before people dive into the 🐰 🕳️ ).

@wrp One more thing that I notice now: In github under /pupil, the heading "Installing Dependencies" did not look like it belonged exclusively to the heading "Developers". So, had I just cllicked on "Download the latest apps!" under heading "Users" and went from there I would've been good in around half an hour? 😄

download the latest apps, you would be good in the time it takes to download the apps 😸

@wrp Oh wow, better not tell my supervisor :x

@wrp So yeah, what maybe would have helped would be, at the start of windows-depencies.md just a reminder like: "If you're not looking to develop for Pupil, just install the apps from /pupil" and add a link there.

Noted, thanks for all the feedback!

@wrp You're welcome, thanks for listening!

Now to the reason why I've come here in the first place: We are looking to control the Invisible Companion App remotely, so we can let our participants wear the Invisible, put the phone in their pockets and then not touch it until the end of the session to make the eyetracking as inobtrusive as possible. Is there currently any way to do this? Afaik the Invisible Monitor does nothing more than grabbing world-video and real-time gaze data and display it.

@user-ea78b7 You are right, currently the Pupil Monitor app can be used to view the scene camera feed of one or multiple Pupil Invisible devices along with the real-time gaze estimates. The ability to start/stop recordings remotely through Pupil Monitor is on the roadmap, but not available yet. You could however simply start the recordings before putting the phones into your participants pockets, and then never touch them again until the end of the session. With a full battery the maximum recording time is close to 2 hours, so for many setups it is not a problem to start the recording early.

@marc Hi Marc, thanks for the reply. What does "on the roadmap" mean? Are we talking weeks, months or years? I know the Invisible is quite young still. Our goal would be to minimize data-post-processing by only recording parts where we actually need eyetracking. This would also increase the lifespan of the recording device. Is there any third-party program to remotely control an Android phone which we could use for our purposes? Would it be possible for me to write a simple code sending the respective commands to the Companion App?

@user-ea78b7 That makes sense! We expect to add this feature before the end of the year. The limitation is mostly on the side of the Android app, so it would not be possible to write a custom script in Python. I don't think there is a way to control the app from within another 3ed party app like that either.

@marc I've written a Java-server before that sends messages into the network to be retrieved by an Android-apps socket. Would this be feasible? I guess not because right now the Companion only sends and does not look for commands, correct?

@user-ea78b7 Exactly, that is the part that is still missing, and which we are looking to add!

@marc Well, okay then. Thanks for your help. "before the end of the year" means end of 2019?

Yes 😄

Hi I’ve done as instructed with both a Pupil Invisible Companion and Pupil Invisible Monitor on the same network which is the university’s eduroam system and the Monitor didn’t detect the Companion device with the Pupil Invisible Monitor screen staying gray. As instructed I shut down Monitor and carried out a forced stop on the Companion App but still Monitor didn’t detect the Companion device. In case there was a problem of connecting using the universities eduroam internet system I created a hotspot between the Companion device and the laptop and carried out all of the above but still couldn’t get the Monitor to connect to the Companion. Gary

@user-057596 Hi, unfortunately I have bad news regarding the eduroams networks. For security reasons, they are often setup such that any connection between devices is refused.

I have noticed a similar issue with phone hotspots. I would recommend to use a dedicated wifi router with a dedicated network for both, Companion device and the device running Pupil Monitor.

Thanks papr for that advice. I wondered if there might be a problem and this is an issue as we use the eduroam system in the hospitals and anatomy teaching facilities where we are eyetracking for medical training. I’m going try it again when I get back home this evening to see if it works on household system to rule out any problems with the Monitor App.

Hello, I have a question about scene camera's video. I want to get the video in 29.97 fps, however, the frame rate of the video is 23.85. Is it possible to encode the video in specific fps?

@user-bea039 The scene camera has a variable framerate. Depending on the brightness of the scene, the auto-exposure algorithm will increase the exposure time of the camera. This can in turn decrease the framerate. Thus if you want to get real 30 FPS, you need to record your videos in a bright enough environment. If you simply want to artificially post-process to have a desired framerate by interpolation, you could probably use a tool like ffmpeg to do that.

@marc thank you!

@user-bea039 You are welcome!

Hello you all! We're experiencing problems with the Pupil Player trying to load in the demo files. See attached screenshot.

This is only on one computer, it's working fine on two other machines which are running the same OS and other software. No Python environment installed on one of these two, either

Any help would be much appreciated.