🥽 core-xr


user-97f0f6 12 December, 2022, 06:10:52

Hi, I request a consult regarding eye segmentation

user-d407c1 12 December, 2022, 07:38:46

Hi @user-97f0f6 If you are interested in having a research consultancy, please visit our webpage at https://pupil-labs.com/products/support/ to learn more and to schedule a consultation.

user-4dc2c6 21 December, 2022, 04:40:50

For HTC vive adds-on, We are using it to design a VR-set with this adds-on to detect the position of pupil, where we don't have the world camera so can't do the calibration. In this case, the accuracy from the adds-on is still good enough, right? We can base on the confidence to know how accurate the data is. Am I understanding this right?

papr 27 December, 2022, 09:02:54

Hi, in the VR use-case, you would need to perform a "HMD Calibration". That means that the VR application displays reference points to the subject and sends these to Pupil Capture. The HMD-eyes project provides a Unity plugin that implements this procedure. https://github.com/pupil-labs/hmd-eyes/

Without a calibration, you only get pupil data, monocular data within the independent eye cameras' coordinate systems.

user-4dc2c6 21 December, 2022, 04:55:24

And If we want collect the gaze data, do I have to have a world camera?

user-8779ef 28 December, 2022, 16:22:21

Folks, I'm computing optic flow on a world vid, and I would like the output to match the format of the original world vid so that I can rename it world.mp4 and view it in pupil player. I am using pyAV. Can you help me ID the proper encoding settings?

https://github.com/gabrielDiaz-performlab/RAFT/blob/d2a223f71c83feac2c21c952928b0671fdf6038b/flow_source.py#L45

Relevant code:

''' container_out = av.open(os.path.join(self.video_out_path, video_out_name), mode="w")

stream = container_out.add_stream("libx264", rate=average_fps) stream.options["crf"] = "0"

for frame in container_in.decode(video=0):

 #  Here is where the optic flow is calculated.  This is pseudocode.  The full code is visible in the repo above.  It's concise.
frameout = compute_optic_flow(frame)

 for packet in stream.encode(frameout):
      container_out.mux(packet)

'''

papr 28 December, 2022, 16:26:50

Hi! Are you able to view the generated file with ffplay or VLC?

papr 28 December, 2022, 16:28:27

Have you tried renaming and adding it to Player already? If so, what is the issue that you are encountering?

user-8779ef 28 December, 2022, 16:33:44

I should add that, ideally, the encoding/decoding process would be lossless.

user-8779ef 28 December, 2022, 16:38:31

This will take some time - I've been processing small chunks of the video before.

user-8779ef 28 December, 2022, 16:47:17

Thanks 🙂

End of December archive