core


user-d811b9 02 July, 2017, 21:59:58

hi,In the fixation.csv file, the duration of fixation is second?

mpk 03 July, 2017, 06:48:09

@mattiaparentela#1655 yes. time units are seconds.

user-d811b9 03 July, 2017, 06:49:29

@mpk thanks. You recommend me to leave the min-duration of fixation to 0.15s ?

mpk 03 July, 2017, 06:53:30

@user-d811b9 I would recommend it. However you may want to change it depending on what literature you follow.

user-d811b9 03 July, 2017, 06:54:38

Thanks!

user-d811b9 03 July, 2017, 07:44:41

@mpk I found on literature review that fixation duration can be established equal to 200-400 ms. therefore I have to reduce this value . The question is , how can do this ? ( or better I can reach this precision ?

mpk 03 July, 2017, 08:23:21

there should be a settable field in the detector.

papr 03 July, 2017, 08:26:05

200ms == 0.2s, the slider works with 0.05s precision. Set it to 0.2 and filter all fixations with durations longer than 0.4 in your post-processing step. This way you keep the fixations that you are interested in

user-d811b9 03 July, 2017, 08:56:05

Thanks

user-64e12b 03 July, 2017, 09:56:35

Hey guys. I'm using pupil for Oculus Rift, For some reason since yesterday it seems like there is no infrared lighting in one of the eyes

user-64e12b 03 July, 2017, 09:57:00

I can see an image in the eye, but when its covered, like when putting on the device, one of the eyes goes completly black

user-64e12b 03 July, 2017, 09:57:27

Is there some way towards finding the exact problem?

mpk 03 July, 2017, 10:28:32

hi! sounds like the IR leds are not active. Can you check if the cable fromthe ring to the camera is ok?

user-a633bf 03 July, 2017, 22:04:47

Hey guys! I'm wondering if the pupil headset has a serial number, and where can I find it

papr 03 July, 2017, 22:07:08

@user-a633bf hey,it does not. We suggest to use the order ID as identification.

user-a633bf 03 July, 2017, 22:07:52

ok, thanks (:

user-64e12b 04 July, 2017, 11:30:24

@mpk, yeah that was the problem, must have gotten disconnected somehow. reattached and works fine 😃 ty

mpk 04 July, 2017, 11:30:35

Great to hear!

user-d811b9 05 July, 2017, 15:00:42

Hi guys, when open pupil player on ubuntu the CPU work ever at 100%. Is it normal ? But the main problem is also that only one of four work ever at 100%

papr 05 July, 2017, 15:03:17

@user-d811b9 Yes, it is. Currently a lot of plugins do their calculation in the main thread (e.g. fixation detector). We will introduce a new way to do computation in the background. If all plugins adapt this new interface the processing load will be spread to all cores evenly.

user-d811b9 05 July, 2017, 15:05:00

@papr thanks!

user-8c0069 05 July, 2017, 15:19:29

Hello, I tried to run Capture and Service on Windows 7 SP1 64-bit (i5-6600T, 8Go RAM), and something (either the world view GUI, one of the eye views, or all) crashes almost every time after a minute or more. And it uses 100% of the CPU all the time. Is it only related to the fact that I am running it on Windows 7, or is it abnormal ? Any solution ? I can move my setup to Windows 10, but it would same me a lot of time if I could run it on Windows 7. Thanks!

papr 05 July, 2017, 15:20:59

@user-8c0069 I am sorry but we do not support Windows 7. You will need to upgrade to Windows 10.

papr 05 July, 2017, 15:22:43

My guess is that you will save more time by upgrading and asking again if the issue persists than searching for the issue on Windows 7.

papr 05 July, 2017, 15:24:13

Btw, it is always helpful to save the log files and the terminal output, independent on which platform you are on.

user-41f1bf 05 July, 2017, 15:27:08

Save and share

user-41f1bf 05 July, 2017, 15:27:17

🙃

user-8c0069 05 July, 2017, 16:19:55

@papr Yes, I know you only support Windows 10, it is just that I have read some comments here and on the Google Group saying that it could work on Windows 7, so I was thinking some of you may have met the same problem...

Yes, I should have started with a log, sorry.

user-8c0069 05 July, 2017, 16:27:14

So this is the most frequent issue : after a couple of minutes, one of the view crashes. For this one, after about a minute, I added surface markers in the field of view of the world camera, it crashed shortly after :

user-8c0069 05 July, 2017, 16:29:56

Crash_after_a_couple_minutes.txt

user-8c0069 05 July, 2017, 16:31:08

Everytime : "Capture failed to provide frames. Attempting to reinit."

user-8c0069 05 July, 2017, 16:33:59

This message also appears always when I try to launch screen markers calibration (for world, eye0 and eye1). It crashes instantly after pressing the "C" button. However, no problem with manual markers or natural markers...

user-8c0069 05 July, 2017, 16:36:13

Thanks if you can help me...or tell me that this is only due to Windows 7 incompatibility.

user-2ae698 06 July, 2017, 08:33:50

Hi

I have a (hopefully) small problem with pupil capture. When I plug my pupil headset into the USB port of my computer, capture is not able to detect the cameras. It displays two unkown USB sources but both sources throw the error "The selected camera is already in use or blocked". I am running Ubuntu 16.04 64-bit and both cameras can be access without problems using gucvview. Any ideas what the problem could be? Thanks!

mpk 06 July, 2017, 08:40:04

@user-2ae698 please make sure your user is part of the group 'plugdev' alternativly you can run capture as sudo. We highly recommend the first option though.

user-2ae698 06 July, 2017, 08:47:20

@mpk Thanks a lot, that did the trick.

user-a2dcc3 08 July, 2017, 01:37:21

Hello all, I have a question, how does the player handle a world video that is longer than the recorded data? Specifically I'm using the HMD trackers, so data is recorded in "fake capture" mode. I tried it with a one minute video on 20 second gaze data and it seemed to visualize gaze points throughout the whole video.

user-a2dcc3 08 July, 2017, 01:41:06

The reason I ask is I wanted to try and record a screen capture of something in VR while recording eye tracking data, and then use that as the world video in the Pupil Player. I realize the FOV of the screen capture and display won't be a 1:1 to match up but would like to visualize the results of this. Naturally the screen capture video and gaze data would have to be aligned as well, which I could do with trimming once I know the time that gaze recording started in the world video.

user-d811b9 08 July, 2017, 09:57:25

Hi, in player application I have found the manual gaze correction plugin. The value of x and y correction modify the position in height and width of my gaze , but the unit is referred to ?

papr 08 July, 2017, 10:33:23

@user-d811b9 It modifies the gaze positions' norm positions

papr 08 July, 2017, 10:34:25

But this plugin is not a great tool to correct your recorded gaze data. It will be replaced with the natural feature based offline calibration.

mpk 08 July, 2017, 10:35:09

The unit is video width, height.

papr 08 July, 2017, 10:36:52

@mpk It is not

user-d811b9 08 July, 2017, 10:38:36

@papr have the bundle version . I have to copy this plugin ?

mpk 08 July, 2017, 10:39:00

@papr I think your quoted code and statement do not agree :-).

papr 08 July, 2017, 10:39:00

@user-d811b9 No, the bundle includes all plugins

papr 08 July, 2017, 10:39:24

@mpk I am confused.

mpk 08 July, 2017, 10:39:52

Since we are modyfining the norm pos the units are video width and height.

user-d811b9 08 July, 2017, 10:40:02

@papr these are my plugins

user-d811b9 08 July, 2017, 10:40:08

In the player application

mpk 08 July, 2017, 10:40:20

0 ,0 is bottom left of the video frame, 1,1 is top right. That makes the unit screen size.

mpk 08 July, 2017, 10:41:26

@user-d811b9 please use gaze correction for now. @papr is referring to new code in the master branch.

papr 08 July, 2017, 10:41:31

Ah, now I understand my confusion. I mistook your statement for pixels.

mpk 08 July, 2017, 10:42:08

@user-d811b9 original question was only about the units of manual gaze correction. Thus my answer.

papr 08 July, 2017, 10:42:31

@user-d811b9 And yes, the new plugin is not available in the bundle yet. I thought you were referring to the manual gaze correction

user-d811b9 08 July, 2017, 10:43:15

@papr @mpk thanks

mpk 08 July, 2017, 10:44:00

I hope we were able to help!

user-d811b9 08 July, 2017, 10:45:22

when this plugin, that seem to be very goo,d, will be available for bundle version ?

mpk 08 July, 2017, 10:45:46

We hope with the next release. There are some issues we need to solve first.

mpk 08 July, 2017, 10:46:09

The idea is that you can recalibrate sections in Player to correct the gaze mapping.

user-d811b9 08 July, 2017, 10:48:42

@mpk GREAT !!!It is possibile before my degree in october ? 😬

mpk 08 July, 2017, 10:49:01

Yes. I think we should be able to do this next week.

user-d811b9 08 July, 2017, 10:49:49

very very good!! thanks for all @mpk

user-ef7690 10 July, 2017, 06:56:52

Hi all, I'm running a Unity Application with the HTC Vive add-on and i'd like to capture the what the user is looking at only the capture doesnt capture the rendered HTC Vive image, any tips?

user-ef7690 10 July, 2017, 07:43:24

nothing out-of-the-box that taps into the rendered display of the vive?

mpk 10 July, 2017, 07:47:34

@user-ef7690 nothing out-of-the box for that. We recommend using the unit plugin and its screen recorder funtction.

user-7c81c5 10 July, 2017, 08:03:52

Hi all, may I ask you a question. How can I get gaze position from pupil remote?

mpk 10 July, 2017, 08:06:04

@user-7c81c5 you will need to run this script: https://github.com/pupil-labs/pupil-helpers/blob/master/pupil_remote/filter_messages.py

user-7c81c5 10 July, 2017, 08:09:45

I ran that script, but I didn't find gaze position from that

wrp 10 July, 2017, 08:11:01

@user-7c81c5 did you un-comment Line 24: https://github.com/pupil-labs/pupil-helpers/blob/master/pupil_remote/filter_messages.py#L24

user-7c81c5 10 July, 2017, 08:11:11

Yes

wrp 10 July, 2017, 08:11:46

Is the port correctly specified and matching what you see in Pupil Capture's Pupil Remote plugin?

user-7c81c5 10 July, 2017, 08:11:55

Yes port is correct

user-7c81c5 10 July, 2017, 08:12:27

I got message from pupil remote but there are no gaze position in that

user-7c81c5 10 July, 2017, 08:14:13

I got only timestamp, topic , norm_pos, confidence , base_data

papr 10 July, 2017, 08:15:34

That is the gaze data object.

papr 10 July, 2017, 08:15:59

Norm pos is the normalized 2d gaze position

user-7c81c5 10 July, 2017, 08:17:36

Oh I see

user-7c81c5 10 July, 2017, 08:17:38

thank you 😄

wrp 10 July, 2017, 08:18:42

@papr - could you make an issue in pupil-docs to add a sample gaze message to message format in the docs: https://docs.pupil-labs.com/#message-format

user-7c81c5 10 July, 2017, 08:19:24

Ok ! That fine

papr 10 July, 2017, 08:21:26

We already have an example for both, pupil and gaze positions: https://docs.pupil-labs.com/master/#pupil-datum-format

user-7c81c5 10 July, 2017, 08:22:55

Another question, gaze position is based on two eye tracking or one eye tracking ?

papr 10 July, 2017, 08:24:18

This is decided dynamically by the gaze mapper depending on how much data is available.

papr 10 July, 2017, 08:24:49

The gaze datum contains the key base_data which includes the pupil positions on which the datum is based on

mpk 10 July, 2017, 08:24:57

@user-7c81c5 if you use a binocular calibration the data from both eyes is merged into one gaze position.

mpk 10 July, 2017, 08:25:28

should only data from one eye be available the gaze mapper will use only one eye as @papr suggested.

wrp 10 July, 2017, 08:25:47

Yes - thanks @papr for the link (forgot that we merged that already 😄 )

user-7c81c5 10 July, 2017, 08:26:29

Thank you 😄

user-c77dda 10 July, 2017, 10:12:05

hi all! I have a version of the pupil eye-tracker with the stereo world camera, however one of the world images is inverted vertically. Is there any easy way to fix it? Sure, I can invert it in my own application, where I use the eye-tracker, but I'd rather prefer a global solution

mpk 10 July, 2017, 10:16:15

@user-c77dda since we cannot make a custom camera for just this one use case, we do indeed have a flipped camera. We always just flip the image display or the actual image. I hope that is ok!

user-c77dda 10 July, 2017, 10:17:44

ok I see. Do you happen to have any samples of using the camera and/or rectifying the stereo?

mpk 10 July, 2017, 11:20:52

@user-c77dda since we dont do any stereo vision in Pupil I would recommend checking out how the opencv project does this.

user-ed537d 10 July, 2017, 18:26:47

is there any way to track head position with the pupil headset?

papr 10 July, 2017, 18:52:14

Yes, if you have a fixed surface that you track. You can use reverse homography to calculate the head movement.

user-1ada9f 11 July, 2017, 06:08:51

eye0 - [WARNING] video_capture.uvc_backend: Capture failed to provide frames. Attempting to reinit.

user-1ada9f 11 July, 2017, 06:09:03

Do anyone know how to fix this ?

user-1ada9f 11 July, 2017, 06:09:11

It repeats again and agian

user-f0de5d 11 July, 2017, 08:16:51

hey ~ i took off the eyetracker the other day and the nosepad broke off :( i'd like to try and glue it - are there any recommendations regarding the glue / material of the device?

Chat image

wrp 11 July, 2017, 10:09:01

Hi @user-f0de5d I would suggest that you send us an email at sales@pupil-labs.com and reference the order ID related to this headset and we can set up a repair. Repairing with glue could work as a very short term fix, but long term fix would be for us to make a repair.

user-8e3dd6 12 July, 2017, 13:13:44

I am having problems installing the drivers in my windows 10 pc, I do it the way it says in the get started part but the drivers dont appear in windows devices but when i look for them in system>aplications they seem to be installed. Any idea why this happens?

user-8e3dd6 12 July, 2017, 13:14:21

It wont be a problem if the program would recognise the glasses but it doesn't

wrp 12 July, 2017, 14:10:03

@user-8e3dd6 could you please let us know what hardware you are using?

wrp 12 July, 2017, 14:10:15

Do you have a DIY setup or hardware provided by Pupil Labs?

user-8e3dd6 12 July, 2017, 14:12:09

I have the Pupil Headset

wrp 12 July, 2017, 14:13:04

@user-8e3dd6 could you let me know the configuration. E.g. world camera high speed + 120hz eye camera binocular?

wrp 12 July, 2017, 14:16:49

If you are using a Pupil headset, after installing drivers you should see the devices under Device Manager>libusbK

user-7f5dd1 13 July, 2017, 07:35:10

@wrp The problem I got is that i follow these steps

Chat image

user-7f5dd1 13 July, 2017, 07:36:03

And when i go to device manager it doesnt appear libusbK

user-7f5dd1 13 July, 2017, 07:36:55

Chat image

user-7f5dd1 13 July, 2017, 07:44:25

But when I look for them in System>Programs they seem yo be installed pupil Cam0, cam1,cam2

Chat image

user-7f5dd1 13 July, 2017, 07:44:40

Any idea on how to make it works?

user-7f5dd1 13 July, 2017, 08:12:40

I've tried to desinstall them, reset and try again and just happens the same

user-72b0ef 13 July, 2017, 08:17:24

Hey! Currently I am using HMD Calibration (using Pupil with Unity with Virtual Reality HTC Vive), but I was wondering how HMD 3D calibration would be different from the normal HMD Calibration. Would it be better to use HMD 3D Calibration? If so, do I need to change the way my calibration are oriented or does HMD 3D calibration not need me to change the markers?

user-72b0ef 13 July, 2017, 08:26:45

Also another question, I am using Dual monocular calibration, is this different from binocular calibration? Our application in Unity is pretty far already in development and we have already done many great things with Pupil, but we think we can try to optimize our calibrations / the way we process data from Pupil. I cant seem to find the binocular calibration plugin anywhere

user-72b0ef 13 July, 2017, 08:31:50

For people who are interested in what we have done already, see this reference image. We made a supermarket in 3D and collect eye data to map this in heatmaps within Unity

user-7f5dd1 13 July, 2017, 08:38:57

I downloaded the source code and pupil_v9012_ winsows_x64.zip and extract them anyways. Execute the capture_pupil and this error shows up and no image

Chat image

wrp 13 July, 2017, 08:41:11

@user-7f5dd1 I can do TeamViewer remote setup to try and help you install drivers

wrp 13 July, 2017, 08:41:27

please email info@pupil-labs.com to arrange a time

user-7f5dd1 13 July, 2017, 08:42:12

Okey

user-7f5dd1 13 July, 2017, 08:42:22

Thank you so much!

wrp 13 July, 2017, 08:42:57

@user-7f5dd1 - welcome, let's see if we can resolve this quickly 😄

user-d7b89d 13 July, 2017, 12:15:06

Hi, I habe the problem of randomly loosing connection to world and eye cameras (2 of them) on my glasses. Suddenly the connection breaks and no device is detected (it happens in the middle of a recording). I am on Windows using the drivers provided. The setup worked for 3 weeks with dayly use and not problems. I did not change anything (it is a labotory computer, neither hard- or software was changed) Do you have any hint what may cause that?

mpk 13 July, 2017, 12:15:45

all three cameras at once?

user-d7b89d 13 July, 2017, 12:34:38

yes all three at onece

user-d7b89d 13 July, 2017, 12:35:04

once

mpk 13 July, 2017, 12:35:36

My guess is the USB cable. Can you try a different one?

user-d7b89d 13 July, 2017, 12:37:58

we although thought about a loose connection

user-d7b89d 13 July, 2017, 12:39:19

I'll try eventhough it is only 3 weeks old

mpk 13 July, 2017, 12:40:54

An alternative is that you send the headset back to us. We have a look and replace all components required (for free of course). This is quite fast. But nothing beats replacing a fautly cable in terms of speed :-).

user-d7b89d 13 July, 2017, 12:42:25

Thanks for the offer. We'll have look, it should be no problem as we have two of your headset --> two kables

user-d7b89d 13 July, 2017, 12:42:45

If it does not help I'll send you an email with further details

wrp 13 July, 2017, 12:48:18

@user-7f5dd1 - I am pleased that we were able to quickly resolve the driver installation. A note for other users on Windows 10. Windows often likes to install drivers for devices automatically when the device is connected. You can either stop Windows from doing this for Pupil hardware when the devices are connected and then install drivers. OR if Windows does install drivers for cameras automatically, you will need to uninstall drivers that Windows installs before installing libusbK drivers.

wrp 13 July, 2017, 12:49:38

I will update the docs with this information about driver installation for Windows users

user-d7b89d 13 July, 2017, 13:59:20

@mpk - it seems the kable really broke... Kind of embarassed that I did not think of the easy faults

user-f79453 13 July, 2017, 14:04:16

hey guys!

user-72b0ef 13 July, 2017, 14:09:42

@user-f79453 sup

user-f79453 13 July, 2017, 14:11:39

i was gonna ask what the cheapest way to build one myself would be, and if there was a file I could 3d print myself, but then I saw the docs on the pupil website and how the shapeways cost supports the program and decided against it

user-72b0ef 13 July, 2017, 14:12:00

Rip 😄

user-f79453 13 July, 2017, 14:12:04

hahahah

user-f79453 13 July, 2017, 14:12:29

but any other suggestions would be great

user-f79453 13 July, 2017, 14:12:42

the diy BOM has a HD-6000 as an eye cam

user-f79453 13 July, 2017, 14:15:11

but as far as I can tell that only goes upto 30fps

user-f79453 13 July, 2017, 14:15:44

i'm planning on using it to eyetrack people watching movies/films/etc

wrp 13 July, 2017, 14:16:04

Hi @user-72b0ef I see your question and will get to it a bit later - apologies for the delay

user-f79453 13 July, 2017, 14:16:06

is that enough for my application

user-f79453 13 July, 2017, 14:16:14

?

wrp 13 July, 2017, 14:16:39

@user-f79453 you can try the 30hz route

wrp 13 July, 2017, 14:17:32

@user-f79453 please see https://docs.pupil-labs.com/master/#diy

user-f79453 13 July, 2017, 14:20:51

@wrp hey! is this all current? do i need more than this? sorry I found you guys through an old hackaday article

wrp 13 July, 2017, 14:29:36

@user-f79453 we have not updated the DIY BOM in a while, but if you find all parts it will work. There are many [email removed] that are using DIY setups. Many uvc compliant cameras will work with the software

user-f79453 13 July, 2017, 14:31:01

oh okay cool

user-f79453 13 July, 2017, 15:42:40

is there a subforum somewhere specifically catering to the DIY builds?

papr 13 July, 2017, 15:45:10

No, I do not think so

wrp 13 July, 2017, 15:56:42

@user-f79453 there is no official sub-forum for people to discuss DIY builds, but you are welcome to discuss DIY builds here as well

wrp 13 July, 2017, 15:57:25

If there is enough demand for this kind of channel, we can certainly make one - but a critical mass of at least something like 10 people would be needed to demonstrate the need for a separate channel IMO

wrp 13 July, 2017, 15:57:55

@user-72b0ef Have you looked at and/or tried the new unity3d plugin - this incorporates the 3d calibration procedure - https://github.com/pupil-labs/hmd-eyes/tree/master/unity_pupil_plugin

user-f79453 13 July, 2017, 16:06:56

okay cool!

user-f79453 13 July, 2017, 16:10:30

any slim chance someone here happen to be from Pakistan too?

user-d811b9 13 July, 2017, 22:15:23

Hi guys , in case of I installed the bundle version of pupil on ubuntu 16.04LTS , is it necessary to install the linux dependencies ??

papr 14 July, 2017, 04:52:07

No, it should run out of the box. I assume something is not working, if you had to ask?

wrp 14 July, 2017, 05:44:53

@user-d811b9 as @papr noted, if you are running a bundle (on any OS) all you need to do is run the executable. Are you encountering any difficulties?

user-d811b9 14 July, 2017, 07:08:17

@wrp no difficulties . Some times when close or open the camera from the application , I see a yellow messages related to a corrupt jpeg data

user-d811b9 14 July, 2017, 07:08:38

But seem to be warning

wrp 14 July, 2017, 07:09:11

@user-d811b9 yellow messages are warnings and not errors. You may see warnings from time to time, this is normal

user-d811b9 14 July, 2017, 07:10:25

Good! Thanks @wrp

wrp 14 July, 2017, 07:22:00

@user-d811b9 welcome 😸

user-72b0ef 14 July, 2017, 07:57:53

@wrp no worries and thanks for your reply anyway! I know we have tried the plugin atleast once (also to look at code and calibration), but I see there are some updated files which I will definitely check out! It could be very possible that we already implemented 3D calibration within our application, but we just didnt know it :)))) Anyway, thanks again, I will take a look at it today and will come back to you.

mpk 14 July, 2017, 10:21:21

@user-176502 I m glad to hear that it was a trivialy solved problem!

user-ed537d 15 July, 2017, 03:02:44

has anyone tried determining based off the pupil values that are streamed the degree to which someone is payting attention? I'm sort of confused by the pupil diameter literature etc

user-b68544 17 July, 2017, 08:17:26

Hi all, I'm new here. So please bear with me if this had been asked and answered. Anyone else has problem with Pupil glasses causing EMI interferences to an EEG headset (Emotiv Epoc+)? I'm looking at EMI shielding the wires. Not sure if I need to shield the eye and world cameras too. Any help will be much appreciated in advance!

user-b68544 17 July, 2017, 08:27:47

Also, anyone else has issues with UV from the sun? How do you get around that (other than staying indoors)?

user-72b0ef 17 July, 2017, 09:19:44

@user-d811b9 I think that you want the fixation of a certain user? A fixation usually happens when a user looked atleast 0.2 - 0.8ms or something (dont know exact) to a certain object / point

user-72b0ef 17 July, 2017, 09:20:06

@user-ed537d I think that you want the fixation of a certain user? A fixation usually happens when a user looked atleast 0.2 - 0.8ms or something (dont know exact) to a certain object / point

user-72b0ef 17 July, 2017, 09:20:19

@user-d811b9 sorry, wrong tag :X

user-72b0ef 17 July, 2017, 09:22:02

@user-ed537d Pupil already has a fixation plugin which also lets you change the fixation distance and the fixation time. I havent yet read the stream of data this plugin sends, but it shouldnt be too hard to figure out of you try some things yourself ^^

user-d7b89d 17 July, 2017, 11:09:50

I question regarding compability, did someone think about adding third party eyetracking data import? e.g using Player to analyze SMI data

papr 17 July, 2017, 11:27:11

@user-d7b89d is there a open format specification for the smi data format?

user-d7b89d 17 July, 2017, 11:40:30

I did not find anything. Nevertheless raw eyetracking data as well as videos can be exported which gives you (in my understanding) everything you need?

papr 17 July, 2017, 11:49:54

Could you send us an example export such that we can have a look at it?

user-d7b89d 17 July, 2017, 11:52:36

of course, I can. Which mail adress would you like?

papr 17 July, 2017, 11:53:22

pp@pupil-labs.com

user-d7b89d 17 July, 2017, 11:53:55

thank you, you'll get the mail soon

papr 17 July, 2017, 11:54:06

Thanks

papr 17 July, 2017, 13:41:21

@user-d7b89d I received your example recording. May I ask what type of analysis you want to do with Pupil Player that you cannot do with the SMI software?

user-d7b89d 17 July, 2017, 13:41:53

On the one hand marker detection, on the other hand adjust fiaxtion parameter

papr 17 July, 2017, 13:42:38

So, do I understand it correctly, that you use an SMI eye tracker but our surface tracking system?

user-d7b89d 17 July, 2017, 13:43:54

we bought two of your systems but had to do two experiments with the old smi system because we had to implement your system first. We included your markers in the old smi setup to be able to use marker detection.

user-d7b89d 17 July, 2017, 13:44:43

at this point we are looking for a way to include the marker detection, the easiest would be to be able to import the data in player

user-d7b89d 17 July, 2017, 13:45:02

in the current study we already use the pupil glases including markers

papr 17 July, 2017, 13:53:10

ok, I understand

papr 17 July, 2017, 13:53:40

I think the best thing would be to write a conversion script and to convert the videos manually

papr 17 July, 2017, 13:54:39

Do you have documentation on what the fields in the ...Samples.txt fiel mean?

user-d7b89d 17 July, 2017, 13:54:56

yes I do

papr 17 July, 2017, 13:55:19

Could you send me this as well such that I can look into how to convert the fields?

user-d7b89d 17 July, 2017, 13:57:49

should be in your inbox

papr 17 July, 2017, 14:01:09

Yes, thanks. The biggest challenge will be to extract the correct video frame timestamps and to convert them into our format. Although, I cannot promise you anything since this is a free time project for now.

user-d7b89d 17 July, 2017, 14:10:59

thank you very much, if you need anything let me know.

papr 17 July, 2017, 14:41:35

👍

user-72b0ef 17 July, 2017, 15:38:15

quick question, with binocular eye setup (using 2 camera's), the camera images in Pupil seem to be flipped (on the X and Y axis), is there a way to fix this? I pressed the button for flipping the image, but it only flips it in the Y axis and not on the X axis

user-72b0ef 17 July, 2017, 15:38:45

All of the data seem to be sent correctly to unity

mpk 17 July, 2017, 19:12:24

@2SQRS#4078 the button flips x and y but only for display. Calibration takes care of the transformation for us.

user-ed537d 17 July, 2017, 23:01:59

@user-72b0ef yeah the issue isn't so much fixation as much as it is that the subject starts to fall asleep and wasn't actually performing the requested task.

user-ed537d 17 July, 2017, 23:02:54

I just used confidence levels and saw that the times where the video showed the subjects eyes closign the confidence levels dropped and when i plotted each trial over time in fact you see that confidence levels on >50% showed a lower than 80/90% confidence

user-ed537d 17 July, 2017, 23:03:05

i'll definitely take a look at the fixation detector tho!

user-1486c3 19 July, 2017, 10:07:45

Hi, I recently saw that during a recording session, the capture has a good fix on the pupil, but it switches between 3d models without any noticeable reason. I was wondering, is there a way to lock somehow the model that I think fits the video? would it help with the heuristics of the eye tracking?

papr 19 July, 2017, 10:10:31

@user-1486c3 Try reducing the model sensitivity in the Pupil Detector 3D menu in the eye windows.

user-fe23df 19 July, 2017, 13:47:30

@user-d7b89d are you using SMI? Can I talk to you in private messages? I have a few questions I would like to ask 😄

user-1486c3 19 July, 2017, 13:53:46

@papr should i do it after a good model was found? i mean, does it reduce the threshold for change of model, or does it restrain the model to some parameters' value?

user-d7b89d 19 July, 2017, 13:55:09

@user-fe23df I used it for a few studies but changed to Pupil now. Of course you can, hope I can help

user-b9cbde 19 July, 2017, 23:14:04

core what is the 'theta' and 'phi' data received by streaming gaze data over internet?

papr 20 July, 2017, 06:08:19

@user-b9cbde these are the polar coordinates of the detected pupil ellipse center on the 3d eye model. You can use them alternatively to the Pupil normal.

user-5d12b0 20 July, 2017, 17:24:58

Hello. We just received the HTC Vive eye tracker add-on. We've been trying unsuccessfully to use it on either a Windows 10 machine or Ubuntu 16.04.2 (Release: 4.11.5-041105-lowlatency) machine. On Windows, the cameras originally show up in device manager under "Imaging Devices", but pupil-capture does not recognize them ("unknown device"). We replaced the native drivers with libusbK drivers using zadig. Now pupil-capture recognizes the cameras (PupilCam1 ID0/1) but no images are shown. We get [INFO] video_capture.uvc_backend: Found device. Pupil Cam1 ID1. On Ubuntu, pupil_capture gives [ERROR] video_capture.uvc_backend: Init failed. Capture is started in ghost mode. No images will be supplied.

user-5d12b0 20 July, 2017, 17:25:16

Missed one of the Windows warning messages in the previous post: [WARNING] video_capture.uvc_backend: Capture failed to provide frames. Attempting to reinit.

user-5d12b0 20 July, 2017, 17:37:49

Just tried on MacOS Sierra and Pupil capture worked first try, but it kept pausing and losing frames about once every 3 seconds.

user-5d12b0 20 July, 2017, 17:55:33

On Linux, I can get a videostream using guvcview, but pupil_capture still gives the ghost mode error. If I select one of the 2 'unknown' devices in the "Activate source" list, I get [ERROR] video_capture.uvc_backend: The selected camera is already in use or blocked.

papr 20 July, 2017, 17:56:10

@user-5d12b0 You need to add your user to the plugdev group and restart your computer

mpk 20 July, 2017, 17:56:22

Please make sure you user is member of the group plugdev.

mpk 20 July, 2017, 17:56:48

Jinx!

mpk 20 July, 2017, 17:57:32

On windows you will need to make sure our driver is used on the device

user-5d12b0 20 July, 2017, 17:57:52

Thanks @papr and @mpk. I'll be right back, because I'm typing from the linux box I need to restart. While I wait, how do I get "your driver"?

mpk 20 July, 2017, 17:58:01

The error in Mac we would need more info.

mpk 20 July, 2017, 17:58:37

Check the release notes on GitHub these is a link to the relevant section on docs.pupil-labs.com

user-5d12b0 20 July, 2017, 18:05:06

Now working in Linux. Now chastising grad student for not finding the Windows drivers.

mpk 20 July, 2017, 18:05:53

:-)

user-5d12b0 20 July, 2017, 18:26:27

Thank you for your help. We are up and running. We'll try to get the HMD calibration going on our own.

wrp 21 July, 2017, 05:45:10

@user-5d12b0 thanks for the update - happy to hear that you got set up

user-7c13d9 21 July, 2017, 23:30:09

Hi all: considering buying into the Pupil labs system. Are there plugins / buit-in functionality that identify blinks, saccades, pursuit movements, fixations, etc.?

papr 21 July, 2017, 23:59:41

Blinks, and fixations, yes. Pursuit movement : not yet

user-7c13d9 22 July, 2017, 01:11:57

@papr Thanks for the quick reply!

papr 22 July, 2017, 01:15:17

No problem

user-aad767 22 July, 2017, 16:52:28

Quick question, my python script simply stops and wait forever on topic,msg = self.sub_socket.recv_multipart()

user-aad767 22 July, 2017, 16:52:53

Pupillabs capture is running and the service is on at tcp://127.0.0.1

user-aad767 22 July, 2017, 16:53:17

Any ideas/comments/suggestion/advise?

user-1ada9f 24 July, 2017, 06:13:13

Can norm_pos be out of [0,1] range ?

papr 24 July, 2017, 06:13:31

Yes

papr 24 July, 2017, 06:15:57

This happens for e.g gaze data when it is not mappable to the world frame, i.e it is not within the frame

user-1ada9f 24 July, 2017, 06:16:46

When this happen. What should I do ? Should I do the calibration again ??

papr 24 July, 2017, 06:17:32

If this happens often, this is a symptom of a bad Pupil detection

papr 24 July, 2017, 06:21:28

Generally it is OK for these out-of-bounds values to be there. They are meaningless for analysis though, i.e. you will need to filter them after exporting. It is generally recommended to filter by confidence as well, since this is the first indicator for a Datum's quality

user-1ada9f 24 July, 2017, 06:26:45

@papr Thank you

papr 24 July, 2017, 06:27:04

Sure thing :)

user-05da2f 24 July, 2017, 10:21:33

Hello 😃 I am wondering if you guys could help me figure out why the "composite parent" device is not visible.

papr 24 July, 2017, 10:26:19

Hey @user-05da2f which operating system are you using?

user-05da2f 24 July, 2017, 10:26:32

@papr Windows 10 x64

user-05da2f 24 July, 2017, 10:28:13

The funny thing is that this is a system where the composite device was visible in the past and now we can't get it to appear...

papr 24 July, 2017, 10:30:48

Are you referring to the cameras not being listed in Pupil capture or the cameras not bring listed in the windows device manager?

user-05da2f 24 July, 2017, 10:31:06

@papr the cameras are listed in the windows device manager

papr 24 July, 2017, 10:31:39

If I am not mistaken, there should be a new category libusbk

user-05da2f 24 July, 2017, 10:31:51

there is, and the cameras are listed

user-05da2f 24 July, 2017, 10:32:32

@papr but we only get input from the left eye. I have a colleague here who told me that this is a driver issue and that in the past when he had this issue the problem was that the driver was not installed on the composite parent or something...

papr 24 July, 2017, 10:35:21

Yeah, the driver situation is tricky on windows. Please have a look at the driver section over at https://docs.pupil-labs.com/master/#windows-driver-setup

user-05da2f 24 July, 2017, 10:51:29

@papr I have already followed the instructions to the letter but unfortunately I only get left eye in Unity. My colleague has an older driver version in windows 10 and he gets both eyes

user-05da2f 24 July, 2017, 10:52:08

With old drivers (composite parent visible)

Chat image

user-05da2f 24 July, 2017, 10:52:43

Using new driver installer (composite parent no longer listed there...dunno if it's relevant) 🤔

Chat image

user-05da2f 24 July, 2017, 10:54:36

ignore the arrows and notice the libusbK devices tree. With the old drivers it said (Composite Parent) and with the new ones it does not.

user-05da2f 24 July, 2017, 10:55:00

I'm not sure if this is the correct place to get support for this problem. If it is not please tell me whom I should contact for support. @papr

papr 24 July, 2017, 11:34:32

It is the correct place, but I am not an expert in this field. @wrp is the person for such detailed questions.

user-05da2f 24 July, 2017, 12:29:14

@papr Any idea when @wrp will be available?

wrp 25 July, 2017, 02:21:28

Hi @user-05da2f I am online now

wrp 25 July, 2017, 02:21:51

composite parent is not relevant

wrp 25 July, 2017, 02:22:14

Please show hidden devices and uninstall any instances of auto-installed drivers within the Imaging devices category

wrp 25 July, 2017, 02:22:17

for Pupil Cameras

wrp 25 July, 2017, 02:22:43

You can send us an email at info@pupil-labs.com if you are still having trouble and I can help you via remote session if necessary

wrp 25 July, 2017, 03:43:03

BTW - a note to the community using Windows 10 - updates for Windows 10 will remove libusbK drivers. If you perform a Windows update you will need to re-install drivers. Please install drivers before plugging in the Pupil headset.

user-1ada9f 25 July, 2017, 07:28:24

I get gaze data, but base data have only a pupil data. But I do two eye tracking. Why doesn't it give me two pupils data?

papr 25 July, 2017, 07:30:54

@user-1ada9f can you check if the pupil datum's eyeid field is always the same or if it is alternating between 0 and 1

user-1ada9f 25 July, 2017, 07:31:43

sometime it is 1 sometime it is 0

papr 25 July, 2017, 07:33:02

ok, this means that binocular gaze mapper is not able to correlate the pupil data

papr 25 July, 2017, 07:33:10

could you re-run the calibration procedure?

user-1ada9f 25 July, 2017, 07:34:11

it happened in process of getting pupil data for hmd calibration (python version)

user-1ada9f 25 July, 2017, 07:36:59

when I do calibration the pupil data should be gotten from gaze subscription, isn't it ?

papr 25 July, 2017, 07:38:00

The pupil datum stream always works as long as there is at least one eye window open

user-1ada9f 25 July, 2017, 07:38:57

I open two eye windows for each eye.

papr 25 July, 2017, 07:50:43

The pupil data in the gaze datums is only the pupil data the gaze is based on.

papr 25 July, 2017, 07:51:25

Can you confirm that you never get gaze data with two pupil base datums?

user-1ada9f 25 July, 2017, 07:54:10

Yes

papr 25 July, 2017, 07:57:27

when I do calibration the pupil data should be gotten from gaze subscription, isn't it ?

Not necessarly. If you want pupil data, always subscribe to the pupil topic. If you want gaze data, use the gaze topic.

papr 25 July, 2017, 07:57:50

it happened in process of getting pupil data for hmd calibration (python version)

There is no valid gaze data before calibration. The gaze mapper needs to calibrated first before it sends sensible data. Subscribe to the pupil topic to get all pupil positions. These can be used for the calibration

user-1ada9f 25 July, 2017, 08:10:49

@papr Thankyou now i get it !

papr 25 July, 2017, 08:17:05

👍

user-1ada9f 25 July, 2017, 08:30:45

Are there any way to get pupil data at specific timestamp ?

papr 25 July, 2017, 08:40:47

Subscribe to all pupil data and check the timestamp field of each

papr 25 July, 2017, 08:41:54

This is difficult to do anyway since the timestamp precision is very high. There is no guarantee that ther eis a pupil datum for the timestamp 1234.567891234

papr 25 July, 2017, 08:42:16

What is your use case?

user-05da2f 25 July, 2017, 09:51:29

Is anyone else aware that the download link to the pupil labs apps is being flagged as malware?

Chat image

wrp 25 July, 2017, 09:51:55

@user-05da2f I was not aware of this

wrp 25 July, 2017, 09:52:00

let me try to re-create this issue

wrp 25 July, 2017, 09:52:47

Yes, I also see this page

wrp 25 July, 2017, 09:52:49

this is new...

user-05da2f 25 July, 2017, 09:53:02

now I'm afraid to open the files 😦

user-05da2f 25 July, 2017, 09:53:03

^_^

papr 25 July, 2017, 09:53:21

I can reproduce it as well

wrp 25 July, 2017, 09:53:43

This is not so nice... nothing changed with the bundles - I can assure you that there is no malware in there

wrp 25 July, 2017, 09:54:01

perhaps github changed their servers for these files

papr 25 July, 2017, 09:55:33

A quick search showed that other people are having the same issue with their own repositories

user-05da2f 25 July, 2017, 09:58:50

@wrp I just read your reply for the Windows drivers. So every single time windows does an update I have to reinstall the libusbk drivers?

wrp 25 July, 2017, 09:59:04

@user-05da2f unfortunately, yes

wrp 25 July, 2017, 09:59:29

we will work to improve the driver installation process - but for now this is the state of driver installation on Windows

user-05da2f 25 July, 2017, 10:00:24

And I have to remove the imaging devices?

Chat image

user-05da2f 25 July, 2017, 10:00:31

@wrp

papr 25 July, 2017, 10:00:47

Not all of them

papr 25 July, 2017, 10:01:22

You need to enable the hidden devices and remove those that are Pupil cams

user-05da2f 25 July, 2017, 10:01:33

aah! ok I see. thanks.

wrp 25 July, 2017, 10:01:53

Thanks for responding @papr -

user-05da2f 25 July, 2017, 10:02:38

There were indeed two pupil labs devices under imaging, I removed them.

Chat image

wrp 25 July, 2017, 10:02:54

Wow - that's a lot of extra devices

wrp 25 July, 2017, 10:03:15

@user-05da2f I would recommend uninstalling all Pupil Cam1 devices

user-05da2f 25 July, 2017, 10:03:19

@wrp I assume windows creates one for every different usb port you plug it in?

wrp 25 July, 2017, 10:03:24

and then re-install

wrp 25 July, 2017, 10:04:04

@user-05da2f - unplug headset, uninstall all drivers for Pupil Cam1, restart the computer, reinstall drivers, plug headset back in

wrp 25 July, 2017, 10:04:23

@user-05da2f All these extra zombie drivers may be from multiple installations

user-05da2f 25 July, 2017, 10:04:28

will do thank you very much for the support 😅

wrp 25 July, 2017, 10:04:52

Please be careful to install drivers prior to connecting the Pupil headset on Windows 10

wrp 25 July, 2017, 10:05:19

Windows likes to try to auto-install drivers for the devices

wrp 25 July, 2017, 10:05:29

So install drivers before connecting Pupil to your machine if possible

user-05da2f 25 July, 2017, 10:18:48

@wrp since you're here any chance you can help me get the unity plugin running?

user-05da2f 25 July, 2017, 10:19:04

Chat image

user-05da2f 25 July, 2017, 10:19:37

I followed your instructions to the letter. Then I load the unity plugin, configure the location of pupil_service 0.9.12 , select autorun

wrp 25 July, 2017, 10:19:45

@user-05da2f can you migrate this to vr-ar and @ mention @user-5ca684

user-05da2f 25 July, 2017, 10:38:20

@wrp hmd-eyes aside, Despite this "clean" driver installation procedure that we just did, my app still does not receive input from the right eye. Whereas in the past by using zadiag and some other driver installation hacks it worked...

wrp 25 July, 2017, 10:39:33

@user-05da2f - have you tested the headset on another system (macOS or Linux for example?)

user-05da2f 25 July, 2017, 10:40:07

@wrp I am testing on MacOS right now.

wrp 25 July, 2017, 10:40:34

and do you see both camera feeds on macos?

user-05da2f 25 July, 2017, 10:40:50

@wrp I see both camera feeds on Windows too using pupil_capture

user-05da2f 25 July, 2017, 10:41:11

@wrp it's just that through unity I cannot talk to the service and get both eyes.

user-05da2f 25 July, 2017, 10:41:22

@wrp but that could be anything actually, not the drivers problem

user-05da2f 25 July, 2017, 10:41:43

@wrp which is why I was trying to run hmd_eyes to see if it's my software problem or something else

wrp 25 July, 2017, 10:43:07

OK - thanks for the feedback. This seems like an hmd-eyes issue then

user-05da2f 25 July, 2017, 10:43:14

yes, most likely.

wrp 25 July, 2017, 11:30:22

@user-05da2f @papr I contacted github regarding the releases issue and received this reply:

Thanks for the report!

We've received a few reports of users encountering this warning, and have opened an internal issue for our team to investigate.

I can't offer an ETA on a fix, but will let you know as soon as we have any news to share.
papr 25 July, 2017, 14:21:08

@user-05da2f The above issue has been fixed.

user-05da2f 25 July, 2017, 14:26:24

@papr thanks!

user-72b0ef 26 July, 2017, 09:51:05

Hello, me again! So, I just had my product owner coming by and tested our whole setup in front of him. Now it appears that my eyes are being tracked extremely well, so calibration and data was very useful and accurate. Now we tried the setup on different people, but apparantly we have some pupil tracking issues when it comes down to other people. I have tried selecting a different ROI and pupil intensity ranges, but still at some angles the pupil cameras dont detect some people's eyes that well.... There are so many variables I can change within pupil_capture that I do not know what the best settings are. Is there some sort of "best practices" for the settings as far as the pupil cams go? Like, what is the best resolution for the pupil cameras to detect pupils, 1920 x 1080 or a lower resolution? What pupil intensity range is the best one? I am using a HTC Vive setup with binocular cams and our data must be very accurate, because our research is based on different people (over 50). The pupil cams seem to detect my eyes better than other people's pupils, I have dark brown eyes, while people with lighter eye colors seem to be an issue for the cams to detect.

papr 26 July, 2017, 09:53:16

Hey @user-72b0ef We recommend lower resolutions for the eye cameras since it allows you to capture eye images at 120 Hz and requires less computation

user-72b0ef 26 July, 2017, 09:53:59

@papr Yes, I figured that one out myself also 😄 good thing you can confirm it 😃

papr 26 July, 2017, 09:54:06

It is important that the cameras are focused well. Black blobs, eg. make up, are known to create false-positive pupil detections.

papr 26 July, 2017, 09:55:38

In the eye window you can change the mode to algorithm. In the bottom left you see three circles. The green one needs to be between the two red ones

papr 26 July, 2017, 09:56:17

the two red circles represent the pupil min and max parameters in the Pupil Detector 2d menu

user-72b0ef 26 July, 2017, 09:57:14

@papr Yes, thank you, but I already know all about this hehe. It is just that some people's pupils dont get detected at an angle...

user-72b0ef 26 July, 2017, 09:57:42

or sometimes when they look directly into the camera, they wont get detected at all

user-72b0ef 26 July, 2017, 09:58:01

very strange, if you'd like, I can maybe send some pictures?

papr 26 July, 2017, 09:58:22

Yes, please do so for both: normal mode and algorthm mode

user-72b0ef 26 July, 2017, 09:58:48

you want me to send them via an email address or....?

papr 26 July, 2017, 09:59:07

You can send them in a PM on discord

user-ed537d 26 July, 2017, 19:17:31

@wrp committed the mouse_control.py fixes in pupil helpers

user-ed537d 26 July, 2017, 19:17:34

sorry it took so long

user-ed537d 26 July, 2017, 21:20:44

just updated my pupil folder and now get this

user-ed537d 26 July, 2017, 21:20:45

~/pupil/pupil_src$ python3 main.py MainProcess - [INFO] os_utils: Disabling idle sleep not supported on this OS version. Process world: Traceback (most recent call last): File "/usr/lib/python3.5/multiprocessing/process.py", line 249, in _bootstrap self.run() File "/usr/lib/python3.5/multiprocessing/process.py", line 93, in run self._target(self._args, *self._kwargs) File "/home/nps/pupil/pupil_src/launchables/world.py", line 76, in world assert pyglui_version >= '1.3' AssertionError

papr 26 July, 2017, 21:23:32

It means that you need to update your pyglui installation

papr 26 July, 2017, 21:23:39

It means that you need to update your pyglui installation

user-ed537d 26 July, 2017, 21:27:10

sweet it worked

user-ed537d 26 July, 2017, 21:28:09

wait pyre is to old

user-ed537d 26 July, 2017, 21:28:12

how do i update all packages

user-ed537d 26 July, 2017, 21:28:16

do i just still use the install function?

papr 26 July, 2017, 21:32:58

Not sure. Just update them one by one. This way you know what changed if something breaks

user-ed537d 26 July, 2017, 21:33:16

yeah

mpk 27 July, 2017, 07:03:12

Also make sure you use the HTC Vive depth adjuster. It allows you to aims the cameras.

wrp 27 July, 2017, 07:04:13

@mpk it looks like your response is aimed at @user-72b0ef (just to help clarify for others who are reading)

mpk 27 July, 2017, 07:05:06

Yes. I'm only my phone and the app did not recognize the user handle

mpk 27 July, 2017, 07:05:12

Thanks for adding that!

wrp 27 July, 2017, 07:05:34

You're welcome 😃

user-72b0ef 27 July, 2017, 08:06:47

@mpk Alright, I'll make sure to check that out, however I think this is not the issue, since my eyes are tracked properly, but it seemed to be different for each person

user-72b0ef 27 July, 2017, 08:07:38

@wrp Thanks btw for your consultancy earlier yesterday, I have tweaked the contrast / brightness / gamma and stuff, going to run some tests today \o

user-05da2f 27 July, 2017, 09:37:33

@wrp if driver installation makes the devices show up under imaging devices how can I remedy this?

wrp 27 July, 2017, 09:54:08

@user-05da2f I am not sure I completely understand your issue.

wrp 27 July, 2017, 09:54:24

If you use our driver installer, then you should see drivers under libusbK

wrp 27 July, 2017, 09:55:09

If you just plug in the cameras to a Windows 10 machine, and let Windows 10 do it's "magic", then drivers will be installed automatically and will likely list our cameras as "Imaging Devices"

wrp 27 July, 2017, 09:55:39

You will need to uninstall drivers for Pupil Cam under the Imaging Devices tab in Device Manager and re-install drivers

wrp 27 July, 2017, 09:55:45

did I understand your question correctly?

wrp 27 July, 2017, 09:56:08

(also make sure to show hidden devices to make sure you see and can uninstall everything accordingly)

user-05da2f 27 July, 2017, 09:57:36

@wrp it works now but driver installation is a mess. I bet next time I restart or connect to a different port things will be different :/

papr 27 July, 2017, 09:58:15

@user-05da2f Welcome to Windows.

wrp 27 July, 2017, 09:59:02

@user-05da2f - we will work to improve the driver installer. Restarting or "connecting to a different port" will not affect your driver installation

wrp 27 July, 2017, 09:59:33

Windows updates however, will wipe out the drivers unfortunatel

wrp 27 July, 2017, 09:59:36

unfortunately**

user-05da2f 27 July, 2017, 10:00:09

@papr to be fair. I have other devices that don't get this when an update is installed.

wrp 27 July, 2017, 10:01:27

@user-05da2f yes, this is true and is a fair assessment

wrp 27 July, 2017, 10:01:49

Our Windows support is farily recent, so we are working on improving it at the moment

wrp 27 July, 2017, 10:02:14

Driver issues are a "non issue" on macOS and Linux - only issue on Windows 😿

user-05da2f 27 July, 2017, 10:02:51

Anyway. Hang in there guys 😃

mpk 27 July, 2017, 10:02:53

@user-05da2f a bit more detail here: We are using usb cameras that support the generic uvc standart. This is nice because you can use the cameras with any software. However when running them at high speed though one usb bus we use special drivers.

mpk 27 July, 2017, 10:03:25

Windows will install generic drivers for all compatible devices and whipe our drivers on update.

mpk 27 July, 2017, 10:03:55

The solution is to loose the generic interface but we like to keep for its benefits.

mpk 27 July, 2017, 10:04:46

There are most likely ways of telling windows not to overwrite our drivers. But we are relativly new to windows land.

mpk 27 July, 2017, 10:05:08

For now it means making sure that the drivers are installed and reinstalling when the cameras show up as unknow device

user-4c03e2 27 July, 2017, 14:34:09

Hello, I am wondering how to track objects in Pupil Player using QR codes. Thank you! Sara

papr 27 July, 2017, 14:35:58

@user-4c03e2 our surface tracker does not recognize qr codes. It uses specialized markers. More on https://docs.pupil-labs.com/#surface-tracking

user-4c03e2 27 July, 2017, 14:53:06

Yes thank you, that helps! Mainly I have 2 more specific questions: 1: It seems as though pupil player is only picking up on the marker that I have placed on a small moving object some of the time. Is there a way to get it more accurate? 2: I am wondering if I can get some kind of quantitative output from the surface tracker plugin that tells me when each object is being fixated on and where it is located throughout the recording? Thanks again!

mpk 27 July, 2017, 14:53:42

@user-4c03e2 can you share a video of that? I think that will result in better feedback!

mpk 27 July, 2017, 14:54:41

quantitative output is given in form of heatmaps and exported reports in .csv format.

user-4c03e2 27 July, 2017, 14:58:32

In theory, sure! But I don't know that I can upload a video because of the file size. I'm attaching screenshots of 2 consecutive frames from the video. In one of the frames, the program is detecting the surface. In the next frame, it has lost it. This pattern of detecting and then losing the marker is pretty consistent throughout the playback. Thanks!

Chat image

user-4c03e2 27 July, 2017, 14:58:47

Chat image

mpk 27 July, 2017, 14:59:18

great! Ok the issue is that you are missing a white boarder around the marker. Please add a boarder of 1/5 of the marker size and you should be all set.

user-4c03e2 27 July, 2017, 14:59:40

Ok, thanks.

user-4c03e2 27 July, 2017, 17:10:49

That helped a lot, thanks! Now, I'm just wondering about the output in the Exports file. Is there a way to get where each object is located, frame by frame? Thanks again!

papr 27 July, 2017, 17:11:50

Each entry has a timestamp. These are the frames' timestamps that they belong to

papr 27 July, 2017, 17:12:56

world_timestamps.npy contains timestamps for eahc frame

user-4c03e2 27 July, 2017, 17:13:35

my computer will not open this file. What application do I need to open it?

papr 27 July, 2017, 17:14:17

It is a numpy file. You can load it within a python script

papr 27 July, 2017, 17:15:44

Usually it is not required to know the frame indices since all data (but pupil positions) have a world frame timestamp. Therefore, you can use the timestamps directly to correlate your data

papr 27 July, 2017, 17:16:55

May I ask, how you plan to analyze your data? Or are you just exploring how everything works?

user-4c03e2 27 July, 2017, 17:24:23

Well, there are things I'll need. One is to know where each object was located throughout an interaction between 2 people, regardless of where each person is looking. The other is to know which object the person wearing the eye tracker is focused on during the session.

papr 27 July, 2017, 17:28:14

Using timestamps seems more fitting than frame indices then. The fixation detector will yield fixations for each surface btw

papr 27 July, 2017, 17:30:47

You can give surfaces names and define them with two or more markers. You will get less noise if the markers are spread out as far as possible. Motion blur is a problem though since it decreases detection rates for surface markers as well as calibration markers

papr 27 July, 2017, 17:31:09

Recording with higher framerates is therefore recommended

user-4c03e2 27 July, 2017, 17:31:45

Ok thanks! How do I give surfaces names? I looked for this in pupil player but couldn't find it.

papr 27 July, 2017, 17:32:23

In the surface tracker menu, each surface has a submenu. it has a text field to change each's name

user-4c03e2 27 July, 2017, 18:34:00

Thanks papr..I'll pick up working on this tomorrow!

user-ed537d 27 July, 2017, 22:15:27

i don't know if anyone has had a chance to try out the matlab pupil code i wrote @wrp @mpk were you able to test it out?

user-ed537d 27 July, 2017, 22:15:43

someone messaged me from the google group and asked for a link

wrp 28 July, 2017, 00:38:02

@user-ed537d I did not test yet. I personally am not a Matlab user. I would love to merge your code into pupil helpers so that other people can use it, but would like to have someone test as well. Can you make a PR for your code so that it is more visible in the pupil-helpers repo?

user-006924 28 July, 2017, 12:29:51

Hi everyone, has anybody successfully used pupil mobile with any phone other than nexus?

papr 28 July, 2017, 12:32:27

I was able to use a monocular headset successfully on a One Plus 3

papr 28 July, 2017, 12:32:51

Unfortunately it does not work to run 3 cameras in parallel

mpk 28 July, 2017, 12:33:35

@user-006924 I think people are also using the HUAWEI P9

user-006924 28 July, 2017, 12:34:55

Thanks ,I have a monocular setup myself minus the nexus phones : )

user-006924 28 July, 2017, 14:37:54

Can using a fish eye lens camera instead of either world or eye cameras mess with the mapping happening between the pupil and scene polynomials?

mpk 28 July, 2017, 14:41:22

In 2d mode that should be fine. 3d mode can get confused. We are adding new distortion models soon

user-ed537d 28 July, 2017, 21:08:46

@wrp sent

wrp 31 July, 2017, 09:27:05

Thanks @user-ed537d - I see the PR

user-78dc8f 31 July, 2017, 14:03:38

Hi all. I just downloaded the new release of pupil capture and I can't open it on my mac. I saw someone else posted about this issue on the download site. Have there been any fixes?

papr 31 July, 2017, 14:04:04

Not yet but we are working on it

user-d811b9 31 July, 2017, 14:24:10

Will be added a guide to explain as work the new feature. ?

user-78dc8f 31 July, 2017, 14:37:17

is there a previous version you would recommend going with for now?

user-41f1bf 31 July, 2017, 14:39:10

0.9.10 should work for linux

user-41f1bf 31 July, 2017, 14:39:34

0.9.10 should work for linux

user-78dc8f 31 July, 2017, 14:40:41

we're running mac os

user-41f1bf 31 July, 2017, 14:41:01

0.9.10 should work for linux

papr 31 July, 2017, 14:44:05

0.9.12

mpk 31 July, 2017, 14:56:12

0.9.13 should work for linux as well.

mpk 31 July, 2017, 14:56:21

0.9.12 should work for mac

user-78dc8f 31 July, 2017, 15:31:57

Got 0.9.12 installed. Trying to connect to android phones running pupil mobile. I've confirmed the connection to my router and mobile appears to be working correctly. However, pupil capture won't show the input from the phones. Can anyone help me debug?

user-78dc8f 31 July, 2017, 15:32:14

I have pupil mobile set up under 'capture selection'

user-78dc8f 31 July, 2017, 15:32:24

but it says no hosts found

mpk 31 July, 2017, 15:33:03

Make sure that your network allows upd connections. This is used to discover the devices in the network.

mpk 31 July, 2017, 15:33:39

are you running a small wifi or part of a bigger institutional network?

user-78dc8f 31 July, 2017, 15:33:52

it's a dedicated router not connected to the internet

user-78dc8f 31 July, 2017, 15:34:06

how do I check if it allows upd connections?

mpk 31 July, 2017, 15:34:08

ok.

mpk 31 July, 2017, 15:34:29

what os are you running?

user-78dc8f 31 July, 2017, 15:34:44

mac os 10.9.5

mpk 31 July, 2017, 15:34:49

ok. same as me.

user-78dc8f 31 July, 2017, 15:36:15

any thoughts on how to detect pupil mobile?

mpk 31 July, 2017, 15:40:53

They should just show up.

mpk 31 July, 2017, 15:41:49

make sure the app is running on the phone.

user-78dc8f 31 July, 2017, 15:44:35

restarting to see if that helps

user-78dc8f 31 July, 2017, 15:45:31

phones should be on 'transcode to h.264', correct?

mpk 31 July, 2017, 15:45:57

for the world camera yes. the eye I leave with mjpeg.

mpk 31 July, 2017, 15:46:13

Are you setting this from the android app or Pupil Capture?

user-78dc8f 31 July, 2017, 15:47:10

android app

user-78dc8f 31 July, 2017, 15:48:24

damn. restarted. still nothing in pupil capture. all my networks are connected, but not seeing any remote hosts

mpk 31 July, 2017, 15:48:46

ok.

user-78dc8f 31 July, 2017, 15:48:48

i'm seeing 'pupil mobile commspec v3' greyed out

user-78dc8f 31 July, 2017, 15:49:03

but it says 'no remote hosts found'

mpk 31 July, 2017, 15:49:40

the version v3 is the current. This is correct. I have the same and the latest version of Pupil mobile of my nexus 5x here.

mpk 31 July, 2017, 15:49:57

Both are connected to the same wifi. that is created by my router.

mpk 31 July, 2017, 15:50:22

All devices have ip from the routers dhcp server.

user-78dc8f 31 July, 2017, 15:50:58

yes. I can see an ip address on each android, so they appear to be connected.

user-78dc8f 31 July, 2017, 15:51:15

also seeing an ip address on my mac

user-78dc8f 31 July, 2017, 15:52:12

all ip addresses match up

user-78dc8f 31 July, 2017, 15:53:23

just did a ping from the terminal window. received data back, so I know the devices are talking

mpk 31 July, 2017, 15:53:32

ok.

mpk 31 July, 2017, 15:53:38

then it must be udp.

mpk 31 July, 2017, 15:55:27

I m note sure what router you are using. Maybe your mac is also set to block upd?

mpk 31 July, 2017, 15:56:20

we (the zre discovery protocol) uses port 5670

user-78dc8f 31 July, 2017, 15:56:36

it's an asus rtn66u router

user-78dc8f 31 July, 2017, 15:57:20

the mac was working before. Not sure what happened. any idea how to check if the mac is blocking upd?

mpk 31 July, 2017, 15:57:36

you had pupil mobile connections working before?

user-78dc8f 31 July, 2017, 15:57:48

yes.

mpk 31 July, 2017, 15:57:51

ah ok.

mpk 31 July, 2017, 15:57:59

What version of Pupil mobile are you running?

user-78dc8f 31 July, 2017, 15:58:11

just updated today

user-78dc8f 31 July, 2017, 15:58:25

it's been glitchy, so i thought the upgrade might help

user-78dc8f 31 July, 2017, 15:58:47

app verion 0.13.0

mpk 31 July, 2017, 15:58:47

I run the same version .

mpk 31 July, 2017, 15:59:31

if this ran before on your machine and same router but no longer I m a bit puzzeled.

user-78dc8f 31 July, 2017, 15:59:44

me too 😃

user-78dc8f 31 July, 2017, 16:02:44

huzzah! Turned the firewall settings off. Now it works

user-78dc8f 31 July, 2017, 16:02:55

so i think you were right--it was blocking the connection

mpk 31 July, 2017, 16:03:48

I m glad it got resolved. You can set for FW to allow Port 5670 UDP then you should be able to turn it back on.

mpk 31 July, 2017, 16:04:25

I alsor recommend using the eye cameras at qvga when runnning Pupil mobile. It helps with bandwidth.

user-78dc8f 31 July, 2017, 16:05:14

actually, can you confirm a few things with our setup?

mpk 31 July, 2017, 16:05:23

sure.

user-78dc8f 31 July, 2017, 16:05:51

so we have two trackers running. one just has the head cam. The other has both eye and head cam.

user-78dc8f 31 July, 2017, 16:06:00

we want to sync them

mpk 31 July, 2017, 16:06:04

Ah ok.

mpk 31 July, 2017, 16:06:17

make sure that time_sync is turned on.

mpk 31 July, 2017, 16:06:33

This will make sure that the timestamps are all using the same clock.

mpk 31 July, 2017, 16:07:13

Do you use two macs or one mac running two instances of Pupil capture?

user-78dc8f 31 July, 2017, 16:07:23

one mac

mpk 31 July, 2017, 16:07:47

Then you can run two instances of Pupil Capture. One for each headset.

mpk 31 July, 2017, 16:08:32

turn on Pupil sync and Pupil groups.

mpk 31 July, 2017, 16:08:56

Now you have a few options.

mpk 31 July, 2017, 16:09:02

stream and record locally.

mpk 31 July, 2017, 16:09:14

or record on the android device.

user-78dc8f 31 July, 2017, 16:09:52

we have been recording on the android device as our backup system. but we intended to stream data to the laptop. How should we optimize that?

user-78dc8f 31 July, 2017, 16:11:45

weird. i'm just seeing the pupil labs with the head cam.

user-78dc8f 31 July, 2017, 16:12:09

there we go. fixed

mpk 31 July, 2017, 16:13:15

once you have time sync active you can record on the android device locally and transver the recordings afterwards.

mpk 31 July, 2017, 16:13:46

we use AIRDROID app to transfer files. But you can use anything you like.

user-78dc8f 31 July, 2017, 16:14:05

can we also record locally on the mac?

user-78dc8f 31 July, 2017, 16:14:31

or should we not do that?

mpk 31 July, 2017, 16:14:38

The video files have a .time file that contains timestamps for each frame. You can use these to align the video streams.

mpk 31 July, 2017, 16:14:49

We do this for eye and world in player already.

mpk 31 July, 2017, 16:15:08

If you want to align more streams you will have a write a small script that does that.

mpk 31 July, 2017, 16:16:17

I have to go now but lets continue this discussion. I think we should make a small script that shows how to do that. Or even a player plugin that merges two video streams.

user-78dc8f 31 July, 2017, 16:16:52

ok. One quick question: if I wanted to launch another capture on my mac, how do I do that?

mpk 31 July, 2017, 16:18:53

open terminal and type /Applications/Pupil\ Capture.app/Contents/MacOS/pupil_capture

mpk 31 July, 2017, 16:19:13

open a new terminal window and do the same again for the second instance.

user-78dc8f 31 July, 2017, 16:20:21

thx. I'll reach out again tomorrow morning after I arrive. Maybe we can optimize a bit more. cheers!

mpk 31 July, 2017, 16:44:20

@everyone I just made two demo videos for offline calibration and tracking: Check them out and make corrections in the CC if you want 😃

user-d811b9 31 July, 2017, 18:18:09

@mpk I have a question about offline calibration . In my analysis I have to recorder how gaze change during a driving simulation . In some case , the movement of test driver or better the headset , distort the gaze mapping . I think that using the offline calibration I can solve this problem , but the question is , how ?

mpk 31 July, 2017, 18:20:37

can you share a sample recording?

user-d811b9 31 July, 2017, 18:22:44

Can I do a video with my phone or I have to send the file create by player ?

mpk 31 July, 2017, 18:23:07

best to share a full recording via google drive or the like.

user-d811b9 31 July, 2017, 18:24:38

Ok can I share the full recording . You have a email ?

user-d811b9 31 July, 2017, 18:25:45

This is a big file , 1.9Gb

user-d811b9 31 July, 2017, 18:38:41

@mpk I sent you a video from my phone because to download the folder on google driver is expensive in term of time

user-d811b9 31 July, 2017, 18:46:01

Before the start of simulation I ask to see three element on road, but when the simulation started the gaze position is switched on top of road , probably the headset has moved. The previously question, how can solve this with the offline calibration

End of July archive