Hi, I request a consult regarding eye segmentation
Hi @user-97f0f6 If you are interested in having a research consultancy, please visit our webpage at https://pupil-labs.com/products/support/ to learn more and to schedule a consultation.
For HTC vive adds-on, We are using it to design a VR-set with this adds-on to detect the position of pupil, where we don't have the world camera so can't do the calibration. In this case, the accuracy from the adds-on is still good enough, right? We can base on the confidence to know how accurate the data is. Am I understanding this right?
Hi, in the VR use-case, you would need to perform a "HMD Calibration". That means that the VR application displays reference points to the subject and sends these to Pupil Capture. The HMD-eyes project provides a Unity plugin that implements this procedure. https://github.com/pupil-labs/hmd-eyes/
Without a calibration, you only get pupil data, monocular data within the independent eye cameras' coordinate systems.
And If we want collect the gaze data, do I have to have a world camera?
Folks, I'm computing optic flow on a world vid, and I would like the output to match the format of the original world vid so that I can rename it world.mp4 and view it in pupil player. I am using pyAV. Can you help me ID the proper encoding settings?
Relevant code:
''' container_out = av.open(os.path.join(self.video_out_path, video_out_name), mode="w")
stream = container_out.add_stream("libx264", rate=average_fps) stream.options["crf"] = "0"
for frame in container_in.decode(video=0):
# Here is where the optic flow is calculated. This is pseudocode. The full code is visible in the repo above. It's concise.
frameout = compute_optic_flow(frame)
for packet in stream.encode(frameout):
container_out.mux(packet)
'''
Hi! Are you able to view the generated file with ffplay
or VLC?
Have you tried renaming and adding it to Player already? If so, what is the issue that you are encountering?
I should add that, ideally, the encoding/decoding process would be lossless.
This will take some time - I've been processing small chunks of the video before.
Thanks 🙂