Disclosed herein are system, method, and computer program product embodiments, and/or combinations and sub-combinations thereof, for adjusting a content of a visual stimulus. In some embodiments, an orientation or a location of a face of a user relative to a display is determined. The content of the visual stimulus is then adjusted to compensate for a misalignment between the orientation or the location of the face of the user and the display. The adjusting comprises maintaining an attribute of the visual stimulus as perceived along a line of sight of the user.
Disclosed herein are system, method, and computer program product embodiments, and/or combinations and sub-combinations thereof, for adjusting a content of a visual stimulus. In some embodiments, an orientation or a location of a face of a user relative to a display is determined. The content of the visual stimulus is then adjusted to compensate for a misalignment between the orientation or the location of the face of the user and the display. The adjusting comprises maintaining an attribute of the visual stimulus as perceived along a line of sight of the user.
Disclosed are systems and methods for extracting high resolution oculometric parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius) at a first resolution. A deconvolution process is performed on the video stream to improve accuracy or resolution of the oculometric parameters, based on stimulus information of a video stimulus displayed on a client device associated with the user, environment data of an environment in which the user is located, device data of the client device, etc. The oculometric parameters are then processed using a prediction model that is trained based on high resolution oculometric parameters obtained using eye tracking devices to predict oculometric parameters at a resolution greater than the first resolution.
G06N 3/04 - Architecture, e.g. interconnection topology
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/16 - Devices for psychotechnicsTesting reaction times
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06N 3/084 - Backpropagation, e.g. using gradient descent
Disclosed are system, method, and computer program product embodiments for determining a digital marker indicative of a neurological condition. An embodiment operates by detecting a region of interest in an image frame of a face of a user. The region of interest includes an eye of the user and the image frame is obtained from a video stream. The embodiment then generates a point spread function (PSF) based on acquired data and a portion of the image frame specified by the region of interest, performs deconvolution on the portion of the image frame specified by the region of interest using the PSF, determines a set of oculometric parameters of the eye of the user using the deconvolved image, and determines one or more digital markers of the user based on the set of oculometric parameters. The one or more digital markers are indicative of a neurological condition of the user.
G06V 40/18 - Eye characteristics, e.g. of the iris
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/02 - Subjective types, i.e. testing apparatus requiring the active assistance of the patient
A61B 3/032 - Devices for presenting test symbols or characters, e.g. test chart projectors
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/18 - Arrangement of plural eye-testing or -examining apparatus
A61B 5/16 - Devices for psychotechnicsTesting reaction times
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
G06F 3/05 - Digital input using the sampling of an analogue quantity at regular intervals of time
G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
G06V 40/18 - Eye characteristics, e.g. of the iris
G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
13.
ESTIMATING A DELAY FROM A MONITOR OUTPUT TO A SENSOR
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
Disclosed herein are system, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for tracking a point of gaze of a subject in a manner that incorporates automatic eye tracking calibration. In an embodiment, video is obtained of the subject viewing content presented by a display. The video is analyzed to determine a series of time points at which a gaze of the subject is dwelling on a visual target and, for each time point in the series, a set of eye feature values. A location of a stimulus presented by the display is also obtained for each time point in the series. This information is utilized to determine a mapping that maps a set of eye feature values to a point of gaze. The mapping is used to map a set of eye features obtained by analyzing the video to the point of gaze of the subject.
Disclosed herein are system, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for tracking a point of gaze of a subject in a manner that incorporates automatic eye tracking calibration. In an embodiment, video is obtained of the subject viewing content presented by a display. The video is analyzed to determine a series of time points at which a gaze of the subject is dwelling on a visual target and, for each time point in the series, a set of eye feature values. A location of a stimulus presented by the display is also obtained for each time point in the series. This information is utilized to determine a mapping that maps a set of eye feature values to a point of gaze. The mapping is used to map a set of eye features obtained by analyzing the video to the point of gaze of the subject.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/02 - Subjective types, i.e. testing apparatus requiring the active assistance of the patient
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/18 - Arrangement of plural eye-testing or -examining apparatus
G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
A61B 3/032 - Devices for presenting test symbols or characters, e.g. test chart projectors
A61B 5/16 - Devices for psychotechnicsTesting reaction times
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
G06F 3/05 - Digital input using the sampling of an analogue quantity at regular intervals of time
G06V 40/18 - Eye characteristics, e.g. of the iris
16.
Estimating a delay from a monitor output to a sensor
Disclosed herein are system, method, and computer program product embodiments, and/or combinations and sub-combinations thereof, for determining a time delay for synchronizing one or more parameters. In an embodiment, a plurality of frames is presented on a display device. A brightness level is modulated in one or more frames of the plurality of frames. A plurality of image frames of a face of a user is received. The plurality of image frames are obtained from a video stream recorded by an image sensor during the presentation of the plurality of frames on the display device. The plurality of image frames are processed to determine the time delay between when the modulating the brightness level is performed in the one or more frames and when the modulating the brightness level in the one or more frames is reported by the image sensor.
G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
H04N 23/74 - Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
17.
ESTIMATING A DELAY FROM A MONITOR OUTPUT TO A SENSOR
Disclosed herein are system, method, and computer program product embodiments, and/or combinations and sub-combinations thereof, for determining a time delay for synchronizing one or more parameters. In an embodiment, a plurality of frames is presented on a display device. A brightness level is modulated in one or more frames of the plurality of frames. A plurality of image frames of a face of a user is received. The plurality of image frames are obtained from a video stream recorded by an image sensor during the presentation of the plurality of frames on the display device. The plurality of image frames are processed to determine the time delay between when the modulating the brightness level is performed in the one or more frames and when the modulating the brightness level in the one or more frames is reported by the image sensor.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
18.
Determining digital markers indicative of a neurological condition using eye movement parameters
Disclosed are system, method, and computer program product embodiments for determining a digital marker. An embodiment operates by determining one or more oculometric parameters associated with an eye of a user using a video stream. The video stream comprises at least one image of a face of the user. The embodiment then determines a pupillary response function of brightness or a gaze response function by performing a deconvolution process based on at least the one or more oculometric parameters. The pupillary response function of brightness or the gaze response function is indicative of a response of the eye of the user to an external factor. The embodiment determines one or more digital markers of the user based on the pupillary response function of brightness or the gaze response function. The one or more digital markers are indicative of a neurological condition or a mental health condition of the user.
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/11 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for measuring interpupillary distance or diameter of pupils
A61B 5/16 - Devices for psychotechnicsTesting reaction times
G06V 40/18 - Eye characteristics, e.g. of the iris
19.
Determining digital markers indicative of a neurological condition
Disclosed are system, method, and computer program product embodiments for determining a digital marker indicative of a neurological condition. An embodiment operates by detecting a region of interest in an image frame of a face of a user. The region of interest includes an eye of the user and the image frame is obtained from a video stream. The embodiment then generates a point spread function (PSF) based on acquired data and a portion of the image frame specified by the region of interest, performs deconvolution on the portion of the image frame specified by the region of interest using the PSF, determines a set of oculometric parameters of the eye of the user using the deconvolved image, and determines one or more digital markers of the user based on the set of oculometric parameters. The one or more digital markers are indicative of a neurological condition of the user.
G06V 40/18 - Eye characteristics, e.g. of the iris
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
Disclosed are systems and methods for extracting high resolution oculometric parameters and eye movement parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius). The oculometric parameters are generated at a first temporal resolution. The oculometric parameters are up sampled to increase the temporal resolution to a second temporal resolution. The oculometric parameters are then processed to generate various eye movement parameters such as blink parameter, pupil response parameter, saccade parameter, anti-saccade parameter, fixation parameter, or smooth pursuit parameter. The oculometric parameters are synchronized with a video stimulus presented on a user device prior to generating the eye movement parameters.
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/11 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for measuring interpupillary distance or diameter of pupils
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/14 - Arrangements specially adapted for eye photography
Disclosed are systems and methods for extracting high resolution oculometric parameters and eye movement parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius). The oculometric parameters are generated at a first temporal resolution. The oculometric parameters are up sampled to increase the temporal resolution to a second temporal resolution. The oculometric parameters are then processed to generate various eye movement parameters such as blink parameter, pupil response parameter, saccade parameter, anti-saccade parameter, fixation parameter, or smooth pursuit parameter. The oculometric parameters are synchronized with a video stimulus presented on a user device prior to generating the eye movement parameters.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/11 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for measuring interpupillary distance or diameter of pupils
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/14 - Arrangements specially adapted for eye photography
Disclosed are systems and methods for extracting high resolution oculometric parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius) at a first resolution. A deconvolution process is performed on the video stream to improve accuracy or resolution of the oculometric parameters, based on stimulus information of a video stimulus displayed on a client device associated with the user, environment data of an environment in which the user is located, device data of the client device, etc. The oculometric parameters are then processed using a prediction model that is trained based on high resolution oculometric parameters obtained using eye tracking devices to predict oculometric parameters at a resolution greater than the first resolution.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
23.
Synchronizing eye movement parameters for a delay from a monitor output to a sensor
Disclosed are systems and methods for extracting high resolution oculometric parameters and eye movement parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius). The oculometric parameters are generated at a first temporal resolution. The oculometric parameters are up sampled to increase the temporal resolution to a second temporal resolution. The oculometric parameters are then processed to generate various eye movement parameters such as blink parameter, pupil response parameter, saccade parameter, anti-saccade parameter, fixation parameter, or smooth pursuit parameter. The oculometric parameters are synchronized with a video stimulus presented on a user device prior to generating the eye movement parameters.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/16 - Devices for psychotechnicsTesting reaction times
Disclosed are systems and methods for extracting high resolution oculometric parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius) at a first resolution. A deconvolution process is performed on the video stream to improve accuracy or resolution of the oculometric parameters, based on stimulus information of a video stimulus displayed on a client device associated with the user, environment data of an environment in which the user is located, device data of the client device, etc. The oculometric parameters are then processed using a prediction model that is trained based on high resolution oculometric parameters obtained using eye tracking devices to predict oculometric parameters at a resolution greater than the first resolution.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
Disclosed are systems and methods for extracting high resolution oculometric parameters. A video stream having a video of a face of a user is processed to obtain a set of oculometric parameters, such as eyelid data, iris data (e.g., iris translation, iris radius and iris rotation), and pupil data (e.g., pupil center and pupil radius) at a first resolution. A deconvolution process is performed on the video stream to improve accuracy or resolution of the oculometric parameters, based on stimulus information of a video stimulus displayed on a client device associated with the user, environment data of an environment in which the user is located, device data of the client device, etc. The oculometric parameters are then processed using a prediction model that is trained based on high resolution oculometric parameters obtained using eye tracking devices to predict oculometric parameters at a resolution greater than the first resolution.
G06V 40/18 - Eye characteristics, e.g. of the iris
A61B 3/00 - Apparatus for testing the eyesInstruments for examining the eyes
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06N 3/04 - Architecture, e.g. interconnection topology
G06N 3/084 - Backpropagation, e.g. using gradient descent
patents
