May I know if i buy the NEON (new product of Pupil), is that includes the analysis software? or should I write codes to do the eyetracking recording analysis? Thank you!
Hi @user-4f391e ! All our software is free. More specifically, Neon comes with a companion device and companion app for recording, streaming, and storing the data. The companion device is included in the price and the companion app is freely available in Google Play Store. You also get a free Pupil Cloud account that you can use to upload, manage, view, enrich and analyze your recordings.
Hi, When will the single eye gaze estimation and pupillometry be available for the Neon glasses?
Hey @user-9c530c! Check out the latest timeline here: https://feedback.pupil-labs.com/neon/p/pupillometry-eye-state-estimation
Hello! I'm interested in acquiring Neon. When can we expect it to become available?
Hi @user-8b1248👋 Neon is just starting to ship with "Just act natural" frames! So if you get an order in we should be able to ship within a few weeks. We're clearing all the pre-orders first, then will get to the new orders. Send us an email sales@pupil-labs.com
Thank you for the info, @wrp! Can you please tell me what comes in the box with Neon?
Not in the box but included/free - Neon Companion app - Neon Monitor app - Pupil Cloud access (data storage and enrichment)
@wrp Thanks so much! Where can I get an estimate of the importation taxes to the United States?
We can ship with taxes prepaid by us/our shipper for 75 EUR to anywhere in the US
@wrp Great to hear! Is 75 EUR the total cost of the taxes to import Neon to the USA or is that just the fee you charge to pre-pay the taxes?
Includes shipping and import taxes.
@wrp Thanks again for the help
Hi, does this new device use the same 200 Hz 192x192 pixel IR eye camera used in the other Pupil Labs devices?
Hi, @user-fcb949 , yes, Neon's IR eye cameras resolution is 192 x [email removed] Hz
Hi! I am interested in such features: Blink Frequency, Perclos, Blink Opening/Closing Amplitude and Speed. Will any of these be available in Pupil Cloud for the model Neon?
Hi @user-0c203f! The blink detection algorithm is similar to the one for Pupil Invisible. It detects the onset and offset of blink events in time. From this you can calculate the blink frequency and also the blink duration. Values concerned with the degree of openness of the eye are not available.
Hey, we have just received our neon frames and wanted to start with some demo recordings (thank you for the fast shipping!). We need to use LSL and could not find a neon-related repository on your github. Is there already some beta LSL relay we could work with? Update: We recorded data using the invisible lsl relay, but we cannot load the data into the pupil player for offline processing (it says the player is too old). Is there a new version of the player that is able to load files from the neon models?
Hi @user-e0a71c 👋.
Glad to hear you've received and started testing Neon!
The LSL relay is built on our real-time API (https://pupil-labs.github.io/realtime-network-api/), and it should currently enable gaze relaying over the LSL framework. It's great to know it's working for you.
Post-processing of Neon recordings is available in Pupil Cloud. You can enable cloud uploads in the Neon app settings. For more information, see the docs: https://docs.pupil-labs.com/neon/#neon-cloud-documentation
Neon recordings made with the Neon App are not compatible with Pupil Player. We currently don't have functionality for desktop playback or data export. However, we are developing a script to enable raw data + video with gaze overlay export from raw Neon recordings grabbed off the phone. We haven’t a set release date just yet. Later in the year, we also plan to have a simple desktop app with similar functionality.
Hey @nmt thank you very much for your timely reply and help with our issues. I added the raw data export enrichment to one of our test recordings, but I receive an error message code 500 when I want to start the download. Would the raw data export be the appropriate way to get access to fixation and blink detection timings calculated in the cloud? We would need these data to use it as locking time points for our EEG analyses (EEG data will also be recorded using LSL synchronization).
No problem! The Cloud Team are currently looking into the error. Thanks for reporting! We'll ping you when it's resolved. Yes, the raw data enrichment will get you your fixations + blinks. Check out the docs for a comprehensive overview of data made available: https://docs.pupil-labs.com/neon/reference/export-formats/
Hi! We have a Pupil Neon device and want to access the IMU data. However, none of our recordings seems to contain the data so we are wondering if one needs to enable the IMU data in the companion app (if yes, we do not find where) or if it is not exported for other reasons. We both exported the data from the phone and imported it via USB, and downloaded it from the Cloud in Pupil Player format.
Hi @user-6c1e7f ! Would you mind letting us Know what version of the app are you using? Would you mind to share also the recording ID here or by email to [email removed] can you share the recording folder by email, so we can take a look?
@user-6c1e7f you probably have an old version of the app, would you mind downloading the latest version from https://play.google.com/store/apps/details?id=com.pupillabs.neoncomp
That was the trick, the data was there after updating
Fixations
@user-e0a71c, it should be working now - please retry!
Hey @nmt , thank you for the quick bug fix, the download works now (when using Chrome, Safari somehow only downloads the info.json). One more question: I cannot find any detected blinks, the csv-file only has a header column. Is there anything I need to calibrate or run before being able to export blinks? Also, in the recording only the fixations are showing.
Hi @user-e0a71c !
Safari downloads are a known issue, the browser consider some zipped files as unsafe, you can read about it here https://docs.pupil-labs.com/neon/troubleshooting/#my-enrichment-download-contains-only-an-info-json-file-and-nothing-else
Regarding fixations and blinks, these are not yet fully supported for Neon in Cloud. Please check our roadmap: https://pupil-labs.canny.io/pupil-cloud/p/pupil-cloud-support-for-neon
Thank you for the clarification @user-d407c1. I'll check back in April then.
dear, when i would order a neon or invisible today, what are the estimated delivery times to Belgium?
We have a pretty large order list but we should be able to ship mid April if you order now-ish..
Hi @user-6ba258! Please reach out to sales@pupil-labs.com in this regard 🙂
Hi there, can anyone please tell me when the Neon Bare Metal will be available? Or if it is possible to remove the hardware from the Core?
Hi @user-ffa59a! The Neon Bare Metal is expected to be ready in Q2 this year. I am not sure I understand your second question about removing the hardware from the Core. Could you please clarify?
Hi Nadia, thank you from your response. I’m sorry for the confusion. I meant is it possible to remove the electronic hardware from the standard frame.
Note that while removing the module is perfectly possible, removing the nest portion from an existing frame to obtain a makeshift Bare Metal instance is not recommended. The way the nest is fixated in the frames makes it very difficult to remove without breaking it.
Yes, Neon has a modular design. This means that you can remove the Neon module from the standard frame and put it to a different one. For the full list of frames we offer, you can check our website: https://pupil-labs.com/products/neon/
Thank you Marc this what I was trying to figure out. I will wait for the bare metal to become available
I have synced with the team regarding the expected release date and we will probably be able to release it already in the next couple of weeks!
Amazing thank you. Has the price for the bare metal been announced yet?
Yes, it will be 350 EUR for just the frame and 5800 EUR for the full bundle including the Neon module and a Companion phone.
Thank you, is there a way to get an academic quote for this once the bare metal is available?
Your welcome! EDU discounts are available for purchases of the full bundle, but not for frames only.
Hi, I'm trying to make sense of IMU data from the Neon device. Following here (https://chat-archive.pupil-labs.com/logs/invisible/2020/06/) I loaded the IMU data in Python as follows:
DTYPE = np.dtype(
[
("accel_x", "<f4"),
("accel_y", "<f4"),
("accel_z", "<f4"),
("gyro_x", "<f4"),
("gyro_y", "<f4"),
("gyro_z", "<f4"),
]
)
path_raw="/path/to/extimu ps1.raw"
raw = np.fromfile(path_raw, dtype=DTYPE).view(np.recarray)
path_ts = "/path/to/extimu ps1.time"
ts = np.fromfile(path_ts, dtype="<u8")
I have two questions: (i) How can we access the magnetometer data? (ii) imu.proto says there is RotVecData, rather than magnetometer data. How should I make sense of RotVecData and access that? Plus, is there another way of accessing the IMU data? Thanks!
Hi @user-299825! The IMUs of Pupil Invisible and Neon are different and do not share the same raw output format. The easiest way to solve this would be to pipe the recordings through Pupil Cloud if that is an option, which would allow you to download the data in plain CSV format.
Alternatively you could refer to the following code example on how to convert the data to CSV manually: https://gist.github.com/marc-tonsen/d9237b17d1685889bff771b0bc239506
Hi Marc, thanks a lot! Your code works well for me and is very helpful. Now I'm curious how I can load the gaze x-y coordinates in Python. Again I found a similar discord discussion here (https://chat-archive.pupil-labs.com/logs/invisible/2021/01/) but again it is from Pupil Invisible. Just wanted to confirm if there's an equivalent way of importing the gaze_200hz.raw file.
Hi. I just downloaded companion app today and the IMU data was not there. I see this was an issue before. But my version is very new. What could be happening? Also, can you access real-time IMU data? I see realtime API has gaze data.
Hi @user-b55ba6! How exactly are you trying to access the IMU data and what are you seeing? Are you e.g. downloading the CSV data from Pupil Cloud? Is the IMU file missing or empty?
The current version of the app and API do not allow streaming of IMU data, but this is currently in development and will most likely be included in the next release, which should be out pretty soon.
I download an empty csv file with only the column titles. Is there an approximate idea of when the new release might come? (just an idea)
Alright, thanks for the info! We are still facing a couple issues with the IMU in Neon. There is one known issue that can leads to an empty imu.csv file downloaded from cloud although IMU data actually exists. I suspect this is what we are seeing here.
The issue is caused by an error during recording which leads to a shift of the timestamps associated with the IMU data. Pupil Cloud handles this issue by serving an empty file. We are currently working on a fix for this in the app, which will hopefully also be included in the next release.
If you download the recording using the Raw Android Data option you should see a files in binary format called extimu ps1.raw and extimu ps1.time. Those files should not be empty (i.e. should at least contain a couple of kilobytes of data). You should be able to recover the data manually using the following script:
https://gist.github.com/marc-tonsen/d9237b17d1685889bff771b0bc239506
Note however that the recovered timestamps are expected to suffer from a shift at some point. If the IMU ever falls into this shifted mode it can be reset by reconnecting the Neon device.
Sorry for the inconvenience here, we are actively working on solving those issues. We expect both the fix to this issue and the ability to stream IMU data via the real-time API to become available in April.
imu.csv file in the exported zip