software-dev


user-78c370 10 November, 2022, 16:11:28

Hello. Currently I'm using mac and try to run Pupil from Source, and get this error "Could not build wheels for av". Here is the log file. May I ask how this issue caused? Thanks!

Error.txt

papr 10 November, 2022, 16:18:14

Please use the develop branch. It is also recommended to build a virtual environment with the intel86 python version

papr 10 November, 2022, 16:18:31

Then there are wheels for all dependencies

user-78c370 10 November, 2022, 16:19:00

Thanks for noticing! Currently using Conda for virtual environment

papr 11 November, 2022, 08:13:40

Check out this article on how to setup x86 environments with conda on mac OS https://towardsdatascience.com/python-conda-environments-for-both-arm64-and-x86-64-on-m1-apple-silicon-147b943ffa55

user-78c370 11 November, 2022, 08:14:08

Thank you so much!!

user-78c370 11 November, 2022, 08:14:36

I made it work yesterday! The frame rate seems locked at 30fps

papr 11 November, 2022, 08:14:51

For which camera?

user-78c370 11 November, 2022, 08:15:03

HD-6000

papr 11 November, 2022, 08:15:29

Yes, that is an older model with a maximum framerate of 30 fps

user-78c370 11 November, 2022, 08:15:49

Haven’t removed the case yet. Just a initial test.

papr 11 November, 2022, 08:16:37

Just out of interest, are you building the DIY version?

user-78c370 11 November, 2022, 08:16:07

Oki

user-78c370 11 November, 2022, 08:18:41

Yeah, still looking for another hd-6000 haha. Btw, I also saw some camera module OV9281 online. Maybe it’s perfect for this use case too

user-5b6152 20 November, 2022, 12:32:37

Hello, I'm using Pupil Invisible to detect the blinks and I would like to export the frames of the video "world" when the eyes are closed. So I installed Blink Detector (https://github.com/pupil-labs/pupil/blob/master/pupil_src/shared_modules/blink_detection.py) on Pupil Player. And it seems that the plug-in doesn't work with the blinks.csv file. And I've found the plugin Post hoc blink detection, but I don't know if it allow me to export the images of the world video during the blink https://gist.github.com/papr/40ba7d99f572bc0fe388a81aa2f87424.

papr 21 November, 2022, 08:44:32

Hi! Pupil Player does not support blink detection for Pupil Invisible recordings. It is based on pupil confidence which cannot be calculated for this type of recordings. You can download blink data from Pupil Cloud though!

user-5b6152 20 November, 2022, 12:35:17

Never the less, even the Post hoc blink dectection allow me to do this. I've problem to make it works correctly. I've ERROR message : player - [WARNING] plugin: Failed to load 'batch_exporter'. Reason: 'No module named 'exporter'' player - [WARNING] plugin: Failed to load 'extract_blinks'. Reason: 'No module named 'pandas'' But I've already installed exporter and pandas on my computer...

user-5b6152 20 November, 2022, 12:39:22

Does anyone have an idea to solve those problems ? I'm not devlopper and I don't know python, so that's part of the problem. But if any of you have a teacher soul and the patience to help me it could be nice.

user-b14f98 21 November, 2022, 20:22:33

Hey @papr , I believe that pye3d uses optimization (ceres solver) to fit the 3D eye model. Can you point me to where this happens in the pye3d package?

papr 21 November, 2022, 22:15:55

That was only the case for the old 3d detector. Pye3d performs a closed-form optimization.

user-b14f98 21 November, 2022, 20:22:48

...and is the optimization of reprojection error?

user-b14f98 21 November, 2022, 20:23:57

For some context, we've now played enough with the entire pipeline to develop the strong opinion that this is the step that's contributing the majority of error. Not the binocular model fit.

papr 21 November, 2022, 22:16:37

By binocular model fit you are referring to the gaze calibration?

user-b14f98 21 November, 2022, 20:24:08

Not pupil detection.

papr 21 November, 2022, 22:17:05

By that you are referring to the 2d detection?

user-b14f98 21 November, 2022, 20:24:28

(although that may be a related issue, our models aren't improving things)

papr 21 November, 2022, 22:28:37

That's the closed Form optimization

user-b14f98 21 November, 2022, 22:28:48

Thank you, Pablo!

user-b14f98 21 November, 2022, 22:28:54

One more idea to drop ...

user-b14f98 21 November, 2022, 22:30:22

We've found that the precision of the final gaze estimate is relatively poor when the model is not frozen. The high-frequency sample-to-sample updating seems to be the issue. We could play with the paramters and calm it, perhaps, but my first inclination is that the updates should not be applied directly to the 3D eye pose center.

papr 21 November, 2022, 22:33:55

The short term model only affects the gaze direction, not the sphere center

user-b14f98 21 November, 2022, 22:30:44

Instead, I would consider applying them to an attractor towards which the eyeball center accelerates.

user-b14f98 21 November, 2022, 22:32:09

perhaps in a PD-controller-like fashion. This is just one of many possible ways to low-pass filter those updates.

user-50567f 29 November, 2022, 00:50:53

Hello, is it possible to plot x,y coordinate on the screen from norm_pos_x and norm_pos_y?

papr 29 November, 2022, 07:27:54

Ho, not directly, since norm_pos_x/y are in scene camera coordinates by default, not in screen coordinates. What you need is https://docs.pupil-labs.com/core/software/pupil-capture/#surface-tracking

user-f8c051 29 November, 2022, 09:20:53

hey @papr thanks for your quick response on github. I just installed C-Make version 3.25 (via snap) and still unable to build pyuvc 😦

user-f8c051 29 November, 2022, 09:22:39

I think the current error is:|

`CMake Error at CMakeLists.txt:103 (target_link_libraries): Target "uvc_bindings" links to:

  PLLibUVC::uvc

but the target was not found.  Possible reasons include:

`

papr 29 November, 2022, 09:22:54

Let's move this discussion into #1039477832440631366

user-50567f 29 November, 2022, 21:04:36

I have POV view as well from the main camera of pupil capture. Can I use that overlay dots on the screenshot showing where the subject was looking at?

papr 29 November, 2022, 21:09:54

Where is the difference between POV and main camera for you?

papr 29 November, 2022, 21:11:51

The issue is that pov/main camera are not static in relation to the screenshot. But gaze is estimated in the former, not the latter. You need an additional mapping step. And this is what surface tracking does for you.

user-50567f 29 November, 2022, 21:10:51

By POV I mean this!

Chat image

user-50567f 29 November, 2022, 21:12:30

I see. So technically speaking there is no workaround for what I want to do?

papr 29 November, 2022, 21:12:52

There is, but you need to use the surface tracking.

End of November archive