💻 software-dev


user-4c21e5 01 August, 2023, 05:42:42

Okay thanks for confirming. Yes, that makes sense. Good luck with your project!

user-e91538 01 August, 2023, 07:12:10

Many thanks for your explanation and wishes, @user-4c21e5 🙂

user-8619fb 09 August, 2023, 19:20:53

Would anyone have any suggestion on a good filter to add on top of the real-time data achieved by the camera headset to clean out the data completely and not affect the speed drastically?

user-cdcab0 09 August, 2023, 20:30:39

Can you elaborate a little on what you mean by "clean out the data completely"?

user-591935 12 August, 2023, 16:14:51

Hi, I'm planning to use this wonderful open source pupil labs to make a project about a pair of robotic eyes mimic my eye movement. Can you recommend a video tutorial for noobs? :)))

user-4c21e5 14 August, 2023, 09:23:00

Hey @user-591935 👋. We don't have a full-blown video tutorial for noobs. But we do have a lot of documentation w. video snippets scattered here and there. Could you elaborate a bit more on your project, e.g. what equipment you have, what's the protocol going to look like etc. And we can try to point you in the right direction!

user-e1f92a 14 August, 2023, 10:03:08

Thank you

user-cdcab0 14 August, 2023, 10:56:07

Hi, @user-e1f92a - it looks like you're running from source - we recommend that you run a release version instead. If you need to run from source, you probably need to check the version of Python is installed in that virtual environment

user-e1f92a 14 August, 2023, 11:24:36

@user-cdcab0 Python Version is 3.7.16 : )

user-cdcab0 14 August, 2023, 11:26:08

Are you able to run the release version?

user-e1f92a 14 August, 2023, 12:00:40

@user-cdcab0 Do I have to download the release version again?

user-cdcab0 14 August, 2023, 12:14:46

It looks like you're running from source. The official releases for Windows are bundled up with an installer. You can download it here: https://pupil-labs.com/products/core/

user-e1f92a 14 August, 2023, 12:20:50

Thank you : )

user-8619fb 15 August, 2023, 20:41:47

Hey Dom, Basically remove outliers and artifacts in the data. When you have a saccade, the gaze point moves from one fixation to another. During that motion, sometimes the datapoint may glitch due to a false reading and looking at from a visual standpoint, you have a nice clean straight line movement then a sudden jump then back to nice smooth movement. That sudden jump is what I would like to filter out.

user-cdcab0 15 August, 2023, 21:35:22

I don't personally have experience with that, but maybe someone else here can point you to a filter they've had good success with in that context. Otherwise you might be able to find something useful in the various publications that have made use of Pupil Labs products in the past. Have a look here: https://pupil-labs.com/publications/

user-2f2524 16 August, 2023, 19:24:30

Hello group! Has anyone here had success in inserting the video feed of the Neon into a webpage? For live streaming?

user-4c21e5 17 August, 2023, 12:16:15

Hey! Do you mean streaming over an internet connection, or just over a local network? The monitor app can handle the latter: https://docs.pupil-labs.com/neon/getting-started/understand-the-ecosystem/#neon-monitor

user-2f2524 17 August, 2023, 18:58:26

Neil, great to hear! I will put this to the test. Second to that is to embed the http://neon.local:8080/ inside another webpage or a unity3d app. This is where we are getting stuck...

user-cdcab0 17 August, 2023, 20:25:56

Embedding that page in an iframe works fine on the local network

Chat image

user-cdcab0 17 August, 2023, 20:31:28

To embed the video in a Unity app, you'll need a C# library to digest the RTSP video feed. IIRC, @user-8e415a was trying to use SharpRTSP (https://github.com/ngraziano/SharpRTSP) for this purpose, though I'm not sure how that's going for them

user-8e415a 17 August, 2023, 20:45:50

I managed to get SharpRTSP into Unity, and it let me create a .h264 file from the video, but not display it in the app.

user-cdcab0 17 August, 2023, 20:48:53

Ah, I see SharpRTSP only handles transport. So @user-2f2524, you'd need something else to decode the frames before being able to render them to the screen. Thanks, @user-8e415a!

user-2f2524 19 August, 2023, 01:20:51

@user-8e415a @user-cdcab0 thanks guys! Will work on it!

user-cdcab0 19 August, 2023, 10:38:34

Let us know how you get along 🙂

user-e91538 20 August, 2023, 19:14:40

Hello! I have a question about Pupil Capture softwear functions. I want to use Pupil Core at night, but I don't have experience the softwear night settings. Could you help me, which settings are the most optimal at night?

user-cdcab0 20 August, 2023, 22:40:03

Hi, @user-e91538 👋🏽 - the pupil cameras have IR illuminators, so they'll work just fine in a dark environment, but for the scene camera you'll probably want to adjust the exposure settings and potentially some of the post-processing settings settings as well to improve the image.

user-854e02 21 August, 2023, 12:07:13

@user-cdcab0 I have tried to set up the companion phone as a hotspot and my python application code in my windows was not able to find the device from either through you simple api example or the async api example.

user-cdcab0 21 August, 2023, 12:08:55

Are you using Neon?

user-854e02 21 August, 2023, 12:09:05

Yes

user-cdcab0 21 August, 2023, 12:10:56

In the app at the top-left, there's a button that reads "Stream" - click on that. If appears to be loading, then you probably won't be able to connect until its done. If it isn't spinning and you see a QR code, but still can't connect, then you will probably have to connect using the IP address listed on that screen instead of autodiscovery

user-854e02 21 August, 2023, 12:16:48

I clicked the "Stream" button, what does that do? Do I need to attempt to search for the device from my python code at same time? The loading has taken a while? Am I supposed to get a QR code and IP address when the spinning is finished?

user-cdcab0 21 August, 2023, 12:20:56

Essentially it starts a service that announces to other devices on the network that it is available. It usually happens right away though. You might try force-stopping the app and restarting it.

To do that, long-press on the app icon and select "App Info". Then select "Force Stop".

user-854e02 21 August, 2023, 12:24:35

Ok, just to clarify, I have setup the companion phone as a hotspot, and my computer is connected to the hotspot to both access the glass but also to access the Internet provided by the mobile network on the phone. Well, I have forced stop the app and start it again, but it's still pending.

user-cdcab0 21 August, 2023, 12:31:14

If you go to the device settings (pull down the notification drawer, click on the nut icon), then select "About Device", then "Status", do you see an IP address there?

user-854e02 21 August, 2023, 12:52:58

Yes, there's an IP on that menu and I used that to connect phone but poped up the following error

Chat image

user-cdcab0 21 August, 2023, 20:49:44

port should probably be numeric instead of a string, but that's probably not the issue. Let me check with colleagues for any advice

user-cdcab0 22 August, 2023, 06:59:16

Hey, @user-854e02 - so we don't actually recommend that you use the companion device as a hotspot while recording/streaming, as it requires resources that will likely effect the performance of your recording and/or stream.

Having said that, this will technically work, but you will need to find the companion device's local IP address. Since it's not displaying in the usual places, you can get it from the PC that's connected. Open a terminal and use the following command: * Windows: ipconfig * Linux: ip route * Mac: route -n get default

You're looking for the default gateway IP. It will probably look something like 192.168.xxx.xxx. Again though, we don't actually recommend this for performance reasons

user-854e02 22 August, 2023, 07:29:41

Ok, the primiary reason that I want to use it as hotspot is because the realtime is quite lagging, regardless if I use the simple api or asychronous api. My code is based on Scene camera video with overlayed eyes video and gaze circle example in the simple api and Scene Camera Video With Overlayed Gaze in the asyc api. The lagging is probably 2-3 seconds by rough esitmation.

user-cdcab0 22 August, 2023, 07:36:10

That's definitely atypical. On my network (with a dated and somewhat cheap wifi router), there's almost no perceivable lag. Maybe tens of milliseconds. Can you share your code?

user-854e02 22 August, 2023, 07:38:48

I run the raw code, apart from hardcoded the ip on line 27-28. This is the example of Scene Camera Video With Overlayed Gaze from the asyc api.

Chat image

user-854e02 22 August, 2023, 07:50:38

Tried this code, there's 15 seconds lag. I connected it to the companion phone via the phone's hotspot but it is simiar if I connected it to the company's wifi network. And I can see the lag in the async code just increase.

SceneOverlayedGaze.py

user-cdcab0 22 August, 2023, 07:52:59

Interesting. Do the frames render at regular speed - just delayed? Or is it in slow-motion?

user-854e02 22 August, 2023, 07:56:56

There both error like "unable to create requested sockete pair" and bad pixels. It's primarily delay.

Chat image Chat image

user-cdcab0 22 August, 2023, 07:58:38

Tell me about the PC. What kind of specs? Is there anything running in the background that might be eating up resources?

user-854e02 22 August, 2023, 09:35:51

Memeory was eaten up a bit

Chat image Chat image Chat image

user-cdcab0 22 August, 2023, 09:40:01

Very capable hardware. I'm pretty confident that whatever is eating up 40% of your CPU and 95% of your RAM is the problem

user-854e02 04 September, 2023, 14:35:59

Thanks, I am rerunning your example, but receive this error message, do you know what does that indicate?

Chat image

user-7d4a32 28 August, 2023, 13:37:35

Hi, can someone help me understand this error? I'm trying to load an old data file.

Chat image

user-7d4a32 28 August, 2023, 13:38:36

What does it mean?

user-d407c1 28 August, 2023, 13:41:34

Hi Elie! how old is the recording? Do you know with which version of Pupil Capture was it recorded?

user-7d4a32 28 August, 2023, 13:42:16

It was roughly recorded in August 2021

user-7d4a32 28 August, 2023, 13:42:45

I dont remember which Pupil Capture version it was ,is there a way to find out in the files?

user-7d4a32 28 August, 2023, 13:43:27

Oh, actually I see now in info.player: { "duration_s": 1014.73128, "meta_version": "2.3", "min_player_version": "2.0", "recording_name": "2020_08_31", "recording_software_name": "Pupil Capture", "recording_software_version": "2.3.0", "recording_uuid": "3b84686a-a572-4c9e-9613-8b6246fe8e58", "start_time_synced_s": 6444.819551, "start_time_system_s": 1598888559.9532158, "system_info": "User: user, Platform: Windows, Machine: pc, Release: 10, Version: 10.0.19041" }

user-d407c1 28 August, 2023, 13:54:29

The reason why I asked that is because the recording format had changed, especially if you attempt to load a recording made with the 1.X era.

The error that you get seems to be related. Which version of Pupil Player are you using?

user-7d4a32 28 August, 2023, 13:55:38

I see. Thanks for the suggestion. I was using the latest version - but as per ur suggestion I downloaded v2.3 via this link https://github.com/pupil-labs/pupil/releases . I tried uploading the data to it and I still got the same error.

user-d407c1 28 August, 2023, 13:59:09

Thanks for trying that. Could you share the recording with [email removed] To do so, please upload it to the cloud provider of your choice (Drive, Dropbox, ...) and invite that email address. We will have a look and let you know if we find what could have happened there.

user-7d4a32 28 August, 2023, 14:00:12

You mean upload the entire folder?

user-d407c1 28 August, 2023, 14:03:43

yes! we might need to check if there is a corrupted file

user-7d4a32 28 August, 2023, 14:09:00

I did that, thanks.

user-7d4a32 28 August, 2023, 16:14:08

If you find anything can you DM me? on Discord

user-d407c1 29 August, 2023, 05:48:45

Sure! I will do so!

End of August archive