One possible explanation is that the laptop's CPU resources are being maxed out when streaming the data. You can check this with a resource monitor.

Hi @user-c10c09! I wasn't responding to your message 😅

Perfik - thanks Neil!

That is great to hear @user-f6ec36! To have a better idea of Neon's performance and accuracy, I encourage you to have a look at Neon's website, where we have posted videos of different use cases (e.g., climbing, biking, playing tennis or piano among others): https://pupil-labs.com/products/neon/technology.

Yes, you can see the full list of exported data in our documentation https://docs.pupil-labs.com/export-formats/recording-data/neon/

The link I sent you in my previous message provides you with overview of the csv files you can obtain and the associated metrics, e.g., the gaze.csv (https://docs.pupil-labs.com/export-formats/recording-data/neon/#gaze-csv) provides you with the gaze x,y coordinates among others, the fixations.csv (https://docs.pupil-labs.com/export-formats/recording-data/neon/#fixations-csv) provides you with the fixation data etc. If you want a more high-level overview of the data streams provided by Neon, please check out this link: https://docs.pupil-labs.com/neon/basic-concepts/data-streams/

Nadia unable to download the CSV files - its only directing me to the page. Can I download please .

The current order fulfilment time for Neon is around 4 weeks.

Hi @user-f6ec36 👋 ! Apologies for the delayed response. Shipping to India should take extra 3-5 days.

Is your laptop connected to the network in the same way the PC is (wifi, ethernet, etc)?

Def today!

Hi @user-f6ec36! Apologies for the delay. We will make sure you will have the email with this information today. Thank you for your understanding!

Hi @user-f6ec36! Could you please clarify? I am not sure I understand your question. Are you referring to the "I can see clearly now" frame that is designed to hold prescription lenses?

See also this page in the docs with info on both swapping frames and designing your own frame! https://docs.pupil-labs.com/neon/glasses-and-companion/hardware-handling/frames/

Just for confirmation, here is again the link that brings you to the page with the zip folders that you can download: https://drive.google.com/drive/folders/1Jg-IyTe4nvJdY9tdYHos6VEqc8XEFkDT Can you please confirm that you can access the folders?

@user-f6ec36 which browser are you using? If you are using Safari, please have a look at this link if you keep having problems with downloading the data: https://docs.pupil-labs.com/invisible/troubleshooting/#my-enrichment-download-contains-only-an-info-json-file-and-nothing-else

Hey @user-ccf2f6 👋 ! Which version of the Neon App are you using? Please upgrade to the Neon Companion App version 2.6.30-prod.

In low-light conditions, camera sensors need a longer exposure time in order to capture a good image. The effect of this is motion blur. You can mitigate the blur by setting a manual exposure to a relatively low value, but this comes at the cost of having darker images. It's a bit of a balancing act in low-light, and essentially impossible to get the best of both worlds.

A colleague points out to me that, with auto-exposure still enabled, you may find improved results by tweaking the backlight compensation value instead

The new member has to be logged in to accept the invitation. If they are not logged in already when clicking the accept link, they will land at a login form.

No, the invitee needs to be logged into their own account, not into the inviters account!

Hi @user-a5c587 👋 ! What kind of metadata are you looking for? Is the data in the info.json sufficient? https://docs.pupil-labs.com/export-formats/recording-data/neon/#info-json

Hi @user-25fb27 👋 ! In the latest version of the Neon Companion App you have the option in the Settings to change the Gaze data rate. The highest is 200 Hz.

Hi @user-f77049 👋 ! I know how excited we all are about robust pupillometry with Neon, and I understand your anticipation. Unfortunately, we will need a little more time, and the feature won't be ready until later in the third quarter(Q3). We apologise for any inconvenience and disappointment this may cause you.

I can assure you that our team is working tirelessly to ensure that we deliver a product that lives up to your expectations.

Once it's ready we will make an announcement here and in our social media so you don't miss it! Have a nice day!

How can I schedule that in?

Hi @user-7ee596 👋 ! Currently, only Workspaces are shareable with collaborators. Sharing individual Projects within a workspace is currently not on the roadmap.

Hi @user-ff2367 👋 ! Welcome to the community 🙂 Regarding your question, VR/AR prototyping is possible with Neon + our ‘Bare Metal’ kit, but note that this is not a turnkey solution. There are currently two main considerations:

1. Mounting - The Neon module can be fitted in a VR/AR headset using the "Bare Metal" kit. However, ad-hoc mounts will need to be prototyped to install it. We offer access to the geometries (https://github.com/pupil-labs/neon-geometry) of the nest + module to assist users in this process.
2. Software - We are currently working on software integration for Neon in VR/AR, but do not have a concrete time to completion/release date. If you purchase Neon now, you would need to work on how to align the Neon gaze estimates into your VR space coordinates system.

Hi @user-e0a71c ! Try unplugging Neon, force closing the app and reconnecting it, the update would restart.

Hi @user-80c70d! While the Just act natural frame is like a regular pair of glasses, the Better safe than sorry (BSTS) frame acts as protective glasses.

The safety ratings we are going for with BSTS are ANSI Z87.1 and CE EN166, which include things like blunt impact and liquid splashing protection. The certification process is still ongoing.

This safety rating is relevant in some settings, e.g. on some factory floors you need to wear such glasses.

Note that ALL our frames are tested for electrical safety and photobiological safety.

Thanks for sharing the recording @user-48526c. I have some follow-up questions/points.

• In your first message, you mentioned that "After setting up the device and successfully completing the first recording, the device is no longer being recognized on the Neon app. The screen prompt to plug-in remains even after I have plugged the device using the USB cables that were provided by you." When you connect the glasses to the phone you should see some pop-up windows prompting you to allow Neon companion to access Neon Scene Camera v1, Neon Sensor Module v1. You should hit OK or click on the tickbox to always open Neon companion when the glasses are connected.

• Having done that, could you please check if you can 1) preview the scene camera by clicking on the camera symbol on the bottom right part of the app and 2) start a recording?

@user-48526c , I'm gonna be following up with an email with debugging steps! Thank you for your understanding and patience! 🙂

Hi @user-07e923 👋 ! Thanks for reaching out. Regarding your questions, please see my points below:

1) We have not seen a reduction in scene camera quality when the phone is overheating. Would you be able to share a recording with us showing such decrease in quality? 2) Regarding app performance, during overheating, the gaze data rate might drop if the gaze rate is set to 200 Hz. 3) There is no automatic backlight compensation - you can only manually adjust it in the app settings.

Hi again @user-07e923 - I'm following up to provide a more detailed reply to your first question. The quality of the scene camera does not drop as a function of recording duration, overheating or any other factor. What can indeed happen though is that the colours of the scene camera might appear as washed out for some recordings if the ambient lighting changes and the parameters you set in the Neon App remain the same. This is what seems to have happened in your recordings as well. To explain a bit better what can happen, consider the following scenario:

You make two recordings in the same setup (e.g., room with sunlight) and with the same settings in the Neon App. The only difference is that the first recording is made at 3pm and the second one at 9pm. The recordings made at 3pm will look fine, but the recordings made later in the evening might have washed out colours because as the sun is going down, the room is getting darker, and therefore the scene camera is overexposed and washed out.

The good news are that this can be easily fixed by adjusting some of the Neon App parameters. We recommend either adding more ambient light in the room, changing to manual exposure to optimise for the scene camera exposure or changing the Backlight Compensation in the App settings.

Hope this helps!

Hello, the duration in info.json is time from user pressing record button , to the time user pressing stop button (in UI it's the same button). That is not related to the actual video duration. First it is not necessary to have neon connected to start recording. The hardware will start automatically streaming and recording if it is connected to an app that is already in a recording. Second, the time each sensor starts varies, so it can be expected that in general video duration is less than the info.json duration even if hardware is always connected.

Hi @user-057596 👋 ! The Marker Mapper enrichment can be only applied to recordings that include visible markers. As long as the recordings in your project have visible markers, the enrichment will be applied. The .csv file you will download after applying the Marker Mapper enrichment will include data from all recordings within your project that had visible markers (ie recordings where the enrichment was applied successfully). I hope this helps!

Thanks for reporting it 📬 ! We will investigate what happened. To facilitate that, could you answer some additional questions?

• Were you able to see what kind of error you got on the screen of your phone?
• Is the recording uploaded to Cloud? Could you please also let us know your glasses' serial number? Many thanks for considering my request. 🙏

Hi @user-44c93c! If you want to run Neon with Capture, you'll need to run from source : https://github.com/pupil-labs/pupil/tree/neon-support. You can read more about that here: https://docs.pupil-labs.com/neon/how-tos/data-collection/using-capture/#use-the-neon-module-with-pupil-capture Note that the solution is only working on Mac and Linux currently

Hi, Yes you can add you own lens into "Just act natural". I would recommend removing the Neon module before you add the lenses, its easy to do so and we can give extra guidance if needed.

At current the "All fun and Games" frame does not have the required lens groove, we will change that soon however, if you indicate this during your order we will hold it back until the new revision is ready.

Finally, we also have "I can see clearly now" a frame that comes with snap in lenses.

The eye cameras can be accessed via the realine api: https://github.com/pupil-labs/realtime-python-api

But at current this is not implemented in the monitor app. You can however use this example script that shows eye and scene video. https://github.com/pupil-labs/realtime-python-api/blob/main/examples/simple/stream_scene_eyes_and_gaze.py

Im not sure I understand the question. Do you want to stream a camera feed that is not coming from the Neon Module?

Thanks Moritz. We are having much more success with the realtime API python client. Appreciate the help.

Hi @user-d569ee 👋 ! It's great to hear that you are interested in Neon for building an application with eye tracking data. May I ask why you'd like to build a companion app from scratch rather than using the one provided?

Yes, Neon can be connected to other devices (Linux, MacOS), but it won't be using NeonNet (the neural network to estimate gaze), likewise if you do build your own Companion App, you would loose this capability, which is doing the heavy-lifting of estimating gaze.

If it is sensitive and you would not like to discuss the reasoning here, feel free to send us an email to info@pupil-labs.com

I ll add a bit to this. If you already want to use an android phone, use can just use the neon companion device. It will run the neon companion app. From there you can install you own custom app on the same device and have the two apps communicate via the real-time network protocol. This is based on rstp and rest.

We will support individual additional phones in the future once the OnePlus 10 Pro becomes less available. A lot of work is necessary to get the app adequately compatible with each model, and additionally not every model fulfills the hardware/software requirements to run the Companion app. Thus, we will not be able to increase the range of supported phones to more than 1-2 currently available models. We can not yet say which phone will be added to the pool next.

I didn't know that. Good to hear. Thanks!

Hey @user-839466 👋 ! Please have a look at our documentation on blinks where you can also find our blink detector whitepaper https://docs.pupil-labs.com/neon/basic-concepts/data-streams/#blinks

Hi @user-328c63 👋 ! What is your Android Operating System version? Is it Android 11, 12, or 13? You can locate this information in your phone's General Settings, specifically under the About Device section. I ask this because not all Android versions are compatible, please read more here. https://docs.pupil-labs.com/neon/glasses-and-companion/companion-device/#android-os - That said, the fact that the download stops half way through might point to network issues.

Hi @user-328c63 👋 ! Apologies for the delayed response. The OnePlus 10Pro comes with Android version 12 which displays the settings slightly differently. For Android 11 and lower the settings appear as you said: System > Date & Time > Use network-provided time. The equivalent for Android 12 is Date & Time - "Set time automatically". You can find this information here as well: https://source.android.com/docs/core/connect/time I hope this helps!

Hi @user-d76d7c! I am assuming those gray frames are at the beginning of the recording? The Neon module contains a range of sensors including the scene camera, eye cameras, IMU etc. When you hit the record button all those sensors are first initialized and then start recording. Some sensors take longer to initialize than others. The scene camera usually takes the longest to initialize, so for the first couple of seconds of a recording there are not scene camera frames yet. When playing the recording back in Pupil Cloud gray frames are shown instead, where the already existing gaze data is shown on.

Both gaze data and scene video frames are timestamped indicating when they have been generated. Since the framerate of the gaze data is 200 Hz and the scene video is only 30 Hz, some gaze samples will be generated at the beginning of a scene video frame, while others are generated towards the end. You need to compare the respective timestamps to check this in detail.

Hi @user-839466 👋 ! Thanks for reaching out! Regarding your questions:

1) The diameter of the circle indicates the fixation duration - the larger the blue circle, the larger the duration of this fixation 2) To download the fixation data, you can right-click on the recording and download the timeseries data. This will trigger a download of a folder that will contain a fixations.csv file among others. The data included in this csv file is listed here in detail: https://docs.pupil-labs.com/export-formats/recording-data/neon/#fixations-csv 3) Fixations can happen in points very close in space which might cause that 2 fixation circles will slightly overlap. This is dependent on the gaze behaviour of the user, the task, etc. For a better visualization, you could consider a) the Gaze overlay enrichment that allows you to modify tha parameters (eg size, shape) of the gaze estimation circle (the red circle) (see here: https://docs.pupil-labs.com/enrichments/gaze-overlay/) and b) our scanpath tutorial that allows you to change the size of the fixation circle (see here https://docs.pupil-labs.com/alpha-lab/scanpath-rim/)

Hi @user-39737f 👋 ! It is currently not possible to move recordings between workspaces. You can find more information about Workspaces & Projects here: https://docs.pupil-labs.com/neon/basic-concepts/projects-and-workspaces/#frequently-asked-questions

Hi again @user-328c63 🙂 Sorry to hear that you have been experiencing issues with your recordings. Could you please share the ID of one of the affected recordings? You can send them via DM on Discord to me! You can find the ID by right-clicking onto the recording and selecting View recording information. Could you please also share the version of the Neon App that you are using (you can find that in the Neon App in Settings > About Neon companion)?

Hi, I just wanted to ask if you are doing anything other than just recording, you failure rate is aabnormally high. Did you get errors during the recording?