🥽 core-xr


wrp 03 March, 2017, 07:48:25

@everyone - eye tracking add-ons are now available for Microsoft HoloLens and The Epson BT-300: Checkout our post: https://pupil-labs.com/blog/2017-03/hololens-and-bt300-eye-tracking-add-ons/

user-2cdde0 07 March, 2017, 10:25:14

Hi there! I have a couple of questions about the hmd-eyes calibration for the HTC Vive. I've been trying to get the calibration to work but I've ran into a couple of issue. Firstly, what actually is the procedure? I see the white and back concentric circle in the centre, then it moves to the top, top left, left and so on. Secondly, when the targets rotate around the field of view, I can barely see them, in fact I can only the targets on horizontal and vertical planes if I view them in my peripheral, and the targets on the diagonal I know are present due to a slight white blurring in the extremes of my vision in the direction of the target. And help would be most appreciated 😃

user-612f00 07 March, 2017, 13:55:31

Hello everyone. I have problem with the calibration in the hmd-eyes unity integration when using the new 0.9 capture software. The eyetracking seems fine on the capture side (better than in v0.8), but the calibration process is broken when triggered from the unity side (i only get seemingly incorrect tracking for one eye). i get the following error in the capture side when i finish the calibration process.

user-612f00 07 March, 2017, 13:55:33

world - [INFO] calibration_routines.hmd_calibration: Stopping Calibration world - [WARNING] calibration_routines.hmd_calibration: No matched ref<->pupil data collected for id0 world - [WARNING] calibration_routines.hmd_calibration: No matched ref<->pupil data collected for id1 world - [ERROR] calibration_routines.hmd_calibration: Calibration failed for both eyes. No data found

mpk 07 March, 2017, 14:01:34

Thanks for the report. We will investigate!

user-dfa26d 10 March, 2017, 13:36:27

Hi guys

user-dfa26d 10 March, 2017, 13:37:33

As you know we're interested in buying the Hololens eyetracking add-on

user-dfa26d 10 March, 2017, 13:38:03

We want to use the Hololens world camera alongside

user-dfa26d 10 March, 2017, 13:39:53

I've done some reading, and as far as I understand we'll be able to use the Hololens' camera if we can provide images using one of the available backends (https://github.com/pupil-labs/pupil/tree/master/pupil_src/shared_modules/video_capture)

user-dfa26d 10 March, 2017, 13:40:42

The NDSI backend looks most suitable, so I had a look in the repository and found this example which provides images using this backend: https://github.com/pupil-labs/pyndsi/blob/master/examples/uvc-ndsi-bridge-host.py

user-dfa26d 10 March, 2017, 13:41:23

My idea is now to re-implement something very similar to that example, but publishes images from the Hololens rather than from a UVC device

user-dfa26d 10 March, 2017, 13:41:52

Obviously I will need to use C# instead of Python as the Hololens only supports C#

user-dfa26d 10 March, 2017, 13:42:03

Do you guys think it's a good way to go forward?

user-dfa26d 10 March, 2017, 13:42:32

I'm nearly done in re-implementing the example

papr 10 March, 2017, 13:46:02

Hey @user-dfa26d

papr 10 March, 2017, 13:47:49

The example is really more like a test host and is not very cleanly implemented. It might be out of date as well. :/ But I think that generally it is a great use case for ndsi :)

user-dfa26d 10 March, 2017, 13:49:02

Okay .. glad to hear ndsi sounds like the right way to go forward

user-dfa26d 10 March, 2017, 13:49:27

Do you think you could update the example according to the latest changes?

papr 10 March, 2017, 13:50:18

I can have a look at it in the next days. The real reference should be the protocol definition though.

user-dfa26d 10 March, 2017, 13:52:10

Sure, sure .. but going from an example is lots easier than going from the real reference (at least to me 😉 )

papr 10 March, 2017, 13:53:10

Yeah I understand that. I will ping you here when I made sure that the example is up to date

user-dfa26d 10 March, 2017, 13:54:06

Great, thanks a lot!

user-dfa26d 10 March, 2017, 14:35:56

BTW, where would the best place be to share the C# project as soon as it's finished? Guess this might be interesting for others as well

papr 10 March, 2017, 14:37:59

Either as a pull request to the hmd-eyes repository or in an own repository

user-41f1bf 10 March, 2017, 15:56:23

Interesting. What do you mean by "edge detection"? Some sort of pigmentation?

user-41f1bf 10 March, 2017, 15:56:51

Or agglutination?

papr 10 March, 2017, 15:58:17

I am sorry. These posts were not supposed to be posted here. I am sorry.

user-41f1bf 10 March, 2017, 15:59:21

I had a feeling about it. :-D

mpk 10 March, 2017, 20:55:36

@user-612f00 we fixed your bug. Please try version v0.9.2

papr 11 March, 2017, 10:38:07

@user-dfa26d I updated the host script to Pyhton 3 (commit: https://github.com/papr/pyndsi/commit/64c1545b1f18234ae5b318ad5b2e633587f284e0) but did not have to change anything protocol related. This means that you should be good with translating the old one

user-612f00 11 March, 2017, 16:50:27

thanks a lot im gonna try as soon as i can tomorrow

user-612f00 12 March, 2017, 11:51:56

Okay its working again. Thanks so much!

mpk 12 March, 2017, 15:40:21

Great to hear that @user-612f00

user-dfa26d 13 March, 2017, 09:02:23

Great thanks a lot @papr!

user-d82dd4 16 March, 2017, 08:47:46

Hey people

user-d82dd4 16 March, 2017, 08:48:06

Hope you are all well today

wrp 16 March, 2017, 08:48:10

Hello @user-d82dd4 - greetings 👋

user-d82dd4 16 March, 2017, 08:48:49

So i actually have a question about Pupil Unity intergration

user-d82dd4 16 March, 2017, 08:49:19

as when i try to use it in the Calibration unity scene i only get input from one eye

user-d82dd4 16 March, 2017, 08:50:20

has anyone had a similar experience? I will say however that the software on this computer is not exactly recommended, Windows7 and Unity 5.3

wrp 16 March, 2017, 08:50:55

@mpk - this was recently resolved was it not?

user-d82dd4 16 March, 2017, 08:54:00

I think I also need to take a closer look at the SDK though, as I dont think its being used atm because Unity hasnt been giving me this fabled "+" symbol mentioned in the readme on github

wrp 16 March, 2017, 08:54:59

@user-d82dd4 - are you running Pupil Capture or Pupil Service on Window7?

user-d82dd4 16 March, 2017, 08:55:12

Ive been running Capture

wrp 16 March, 2017, 08:55:30

Interesting - and it is working on Windows 7?

user-d82dd4 16 March, 2017, 08:55:39

yeah, quite well actually

user-d82dd4 16 March, 2017, 08:56:04

it was mentioned in the driver download that it was made for Windows 10, but i figured why not and just went for it

wrp 16 March, 2017, 08:56:16

I did not think/expect for it to work on Win7. We bundled on Win 10 and didn't think backwards compatability would be so friendly

user-d82dd4 16 March, 2017, 08:56:44

in Capture it actually works just fine, both eyes are being detected and its all quite accurate with the little FOV camera on top

user-d82dd4 16 March, 2017, 08:57:23

heh, well what do ya know, in capture it works well

wrp 16 March, 2017, 08:57:34

that's good to know.

wrp 16 March, 2017, 08:58:00

Regarding the other issue - I believe that this issue was raised previously and was resolved in the current master branch of Pupil Capture. But I want to double check on that with @mpk

user-d82dd4 16 March, 2017, 08:58:59

aah alright, so should i just download that version real quick then i guess

user-d82dd4 16 March, 2017, 08:59:24

And see what happens

wrp 16 March, 2017, 08:59:44

@user-d82dd4 - please wait a few minutes for @mpk to chime in here

user-d82dd4 16 March, 2017, 08:59:57

Sure, no problem!

user-d82dd4 16 March, 2017, 14:29:11

have any suggestions come to mind about the Unity Pupil thing where it only detects one eye?

mpk 16 March, 2017, 16:31:05

please use the latest version v0.9.2!

mpk 16 March, 2017, 16:31:11

also please run calibration. If should show both eyes!

End of March archive