For a given position of a given eye, a mapping between a plurality of viewing-direction vectors originating therefrom and corresponding display locations on a display is generated. A mesh representing input content for the given position of the given eye is generated. For each vertex of the mesh, a reprojected vertex position is determined based on its position relative to a reference, a pose of the reference when the input content was generated, and a predicted pose of the reference at or proximate to a display time. A corresponding viewing-direction vector originating from the given eye and passing through the reprojected vertex position is determined. A distortion-corrected display location on the display is determined by applying the mapping to the corresponding viewing-direction vector. Vertices of the mesh are rasterized onto an image buffer for the given eye, using respective distortion-corrected display locations of the vertices.
A system includes a display having a plurality of zones whose luminance is individually controllable, at least one temperature sensor configured to sense at least one of a temperature of the display and a temperature of an ambient environment surrounding the display, and at least one processor. The at least one processor is configured to identify graphical elements to be presented in a sequence of images, determine for each graphical element an importance level and a corresponding set of zones within the display, determine for each zone a minimum luminance level and a maximum luminance level based on at least one graphical element and its importance level, monitor a power usage of the display, and estimate a thermal load based on the power usage and at least one sensed temperature. When the thermal load exceeds a current thermal budget, luminance levels of zones for lowest-importance graphical elements are adjusted.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Application software; Apparatus for the processing of images; Apparatus providing night vision; Artificial intelligence and machine learning software; Artificial intelligence software; Artificial intelligence software for vehicles; Augmented reality computer hardware; Augmented reality software; Augmented reality software for creating maps; Augmented reality software for use in mobile devices for integrating electronic data with real world environments; Car automatic driving control devices; Central processing units for processing information, data, sound or images; Communication, networking and social networking software; Computer applications for automotive control; Computer programmes for image processing; Computer programs to operate vehicles; Databases; Downloadable and recorded content; Downloadable and recorded media content; Driver assistance systems for motor vehicles; Hardware for electronic driving assistance systems; Head-up display apparatus for vehicles; Head-up displays; Heads-up displays [HUD] for motor vehicles; Information technology and audio-visual, multimedia and photographic equipment; Integrated electronic driver assistance systems for land vehicles; Interactive software based on artificial intelligence; Navigation, guidance, tracking, targeting and map making equipment; Navigation software; Navigational instruments; Object detecting sensors; On board electronic systems for providing driving assistance; On board electronic systems for providing parking assistance; Operating systems; Optical apparatus and instruments, enhancers and correctors; Optical lenses; Optical sensors; Range sensors; Safety, security, protection and signalling devices; Scientific research and laboratory apparatus, educational apparatus and simulators; Sensors; Sensors, detectors and monitoring equipment; Simulators for driving or control of vehicles; Software; Software for electronic driving assistance systems; Software for monitoring, analysing, controlling and running physical world operations; System and system support software, and firmware; Vehicle control assistance software; Vehicle control software; Virtual and augmented reality software; Virtual reality hardware; Virtual reality headsets; Virtual reality software; Web application and server software. Cartography services; Computer hardware design; Computer hardware development; Configuring computer hardware using software; Design and development of computer peripherals; Design and development of data processing systems; Design and development of navigation systems; Design and development of virtual reality software; Design of computer hardware; Design of optical and microoptical components; Design of optical components; Design of vehicles and vehicle parts and components; Design of virtual reality software; Design services; Design services for vehicles; Development of computer hardware; Development of computer systems; Development of interactive multimedia software; Development of operating system software; Development of virtual reality software; Engineering services; Furnishing design services for the interiors of automobiles; Hardware design; Hosting services, software as a service, and rental of software; Image processing software design; Image processing software development; IT consultancy, advisory and information services; IT security, protection and restoration; IT services; Optical laboratories; Platform as a service [PaaS]; Rental of computer hardware and facilities; Science and technology services; Software as a service [SaaS]; Software design and development; Software development; Software development, programming and implementation; Technical research in the field of computer vision; Testing, authentication and quality control.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Application software; Apparatus for the processing of images; Apparatus providing night vision; Artificial intelligence and machine learning software; Artificial intelligence software; Artificial intelligence software for vehicles; Augmented reality computer hardware; Augmented reality software; Augmented reality software for creating maps; Augmented reality software for use in mobile devices for integrating electronic data with real world environments; Car automatic driving control devices; Central processing units for processing information, data, sound or images; Communication, networking and social networking software; Computer applications for automotive control; Computer programmes for image processing; Computer programs to operate vehicles; Databases; Downloadable and recorded content; Downloadable and recorded media content; Driver assistance systems for motor vehicles; Hardware for electronic driving assistance systems; Head-up display apparatus for vehicles; Head-up displays; Heads-up displays [HUD] for motor vehicles; Information technology and audio-visual, multimedia and photographic equipment; Integrated electronic driver assistance systems for land vehicles; Interactive software based on artificial intelligence; Navigation, guidance, tracking, targeting and map making equipment; Navigation software; Navigational instruments; Object detecting sensors; On board electronic systems for providing driving assistance; On board electronic systems for providing parking assistance; Operating systems; Optical apparatus and instruments, enhancers and correctors; Optical lenses; Optical sensors; Range sensors; Safety, security, protection and signalling devices; Scientific research and laboratory apparatus, educational apparatus and simulators; Sensors; Sensors, detectors and monitoring equipment; Simulators for driving or control of vehicles; Software; Software for electronic driving assistance systems; Software for monitoring, analysing, controlling and running physical world operations; System and system support software, and firmware; Vehicle control assistance software; Vehicle control software; Virtual and augmented reality software; Virtual reality hardware; Virtual reality headsets; Virtual reality software; Web application and server software. Cartography services; Computer hardware design; Computer hardware development; Configuring computer hardware using software; Design and development of computer peripherals; Design and development of data processing systems; Design and development of navigation systems; Design and development of virtual reality software; Design of computer hardware; Design of optical and microoptical components; Design of optical components; Design of vehicles and vehicle parts and components; Design of virtual reality software; Design services; Design services for vehicles; Development of computer hardware; Development of computer systems; Development of interactive multimedia software; Development of operating system software; Development of virtual reality software; Engineering services; Furnishing design services for the interiors of automobiles; Hardware design; Hosting services, software as a service, and rental of software; Image processing software design; Image processing software development; IT consultancy, advisory and information services; IT security, protection and restoration; IT services; Optical laboratories; Platform as a service [PaaS]; Rental of computer hardware and facilities; Science and technology services; Software as a service [SaaS]; Software design and development; Software development; Software development, programming and implementation; Technical research in the field of computer vision; Testing, authentication and quality control.
A relative position of an interpupillary midpoint between a first eye and a second eye of a user with respect to an image plane of an image-replicating display is determined. An image to be displayed is generated or retrieved based on the relative position of the interpupillary midpoint with respect to the image plane. This image corresponds to a perspective projection having a view origin at the interpupillary midpoint and aligned with an optical axis of the image-replicating display. The image is displayed via the image-replicating display, which is configured to emit light rays forming a spatially-invariant angular light field from each of a plurality of positions on an exit aperture of the image-replicating display.
A display device includes a laser light source(s), an active panel including a liquid crystal (LC) layer, and light guide(s). The light guide(s) include a light outlet including a plurality of exit portions, to send the light rays towards the active panel. The light guide(s) are controllable to sequentially guide light rays emitted by the laser light source(s) towards different exit portions of the light outlet. A pixel (or a group of pixels) of an image is displayed, by: (i) determining a corresponding exit portion of the light outlet, (ii) controlling the laser light source(s) to emit the light rays; (iii) controlling the light guide(s) to guide the light rays towards the corresponding exit portion from which the light rays exit towards a corresponding LC cell (or a corresponding group of LC cells) of the LC layer; and (iv) controlling the corresponding LC cell to modulate an intensity of the light rays passing therethrough.
A system for controlling temperature of a display system includes a display and an optical substrate configured for autostereoscopic viewing, the system having a heat transfer element arranged at least in relation to an optical substrate. The heat transfer element is visually imperceptible when the system is in use. A heat exchanger is thermally coupled to the heat transfer element. The first temperature sensor is configured to measure the first temperature of the display system at the first region. The processor is configured to receive the first temperature from the first temperature sensor and detect when the first temperature lies outside a predefined operating temperature range of the display system and control the heat exchanger to bring the first temperature within the predefined operating temperature range via an exchange of thermal energy between the heat exchanger and the heat transfer element upon the detection.
A hardware apparatus receives a first image and a second image for a first eye and a second eye of at least one user, and metadata indicating, relative locations of light-emitting cells that can be employed to emit light toward the first eye and the second eye with respect to multiscopic cells in a multiscopic display. The hardware apparatus operates in a streaming manner to: determine, based on the metadata and calibration parameters specific to the multiscopic display, which light-emitting cells are to be employed to emit light toward the first eye and which light-emitting cells are to be employed to emit light toward the second eye; obtain emission values for the determined light-emitting cells based on the first image and the second image; and outputs the output image comprising emission values for the light-emitting cells.
H04N 13/125 - Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues for crosstalk reduction
H04N 13/178 - Metadata, e.g. disparity information
A display device includes a backlight unit that is controllable to switch between lights of different colours, and an active panel including a liquid crystal (LC) layer, a linear polarizer, and a drive circuit. Sub-images of an image are displayed by employing temporal multiplexing. Different sets of drive signals are generated for respective sub-images, based on a predefined sequence in which the sub-images are to be displayed. For each sub-image, a set of drive signals is generated to individually control LC cells of the LC layer, based on intensity values of pixels in the sub-image. The LC cells are controlled individually, via the drive circuit, using the different sets of drive signals according to the predefined sequence, whilst controlling the backlight unit to switch between lights of different colours according to the predefined sequence in which the sub-images are to be displayed.
G09G 3/34 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source
10.
NARROWBAND DISPLAY DEVICE WITH NARROWBAND REFLECTIVE OPTICAL COMBINER
A display device includes a light-emitting unit having red light sources, green light sources and blue light sources that are employed to respectively emit red light, green light and blue light of certain wavelengths. A semi-reflective surface of an optical combiner has a multi-band reflective coating that is configured to selectively reflect the red light, the green light and the blue light of these certain wavelengths. An image is displayed via the display device for producing a synthetic light field. The optical combiner is employed to selectively reflect the synthetic light field towards eyes of user(s), whilst optically combining a real-world light field with the synthetic light field.
A relative location of each eye of user(s) with respect to an optical combiner is determined. A position and an orientation of a first region of a light-emitting component of a light field display unit is determined. A first region of a given light field image (LFI) is generated, wherein the first region of the light-emitting component displays the first region of the given LFI. A second region of the given LFI is generated, wherein the second region of the light-emitting component displays the second region of the given LFI. When the given LFI is displayed, wherein a first part of a synthetic light field corresponding to the first region of the given LFI is directed towards the user(s), whilst a second part of the synthetic light field corresponding to the second region of the given LFI is directed towards the optical combiner.
A defective sub-region of a display area of a multiscopic display is identified based on a comparison between an actual captured image of the display area and an expected image of the display area that is expected to be captured during display of a first multiscopic image. When it is determined that the defective sub-region overlaps at least partially with a sub-region of the display area to be used to present a virtual object, another sub-region of the display area that does not overlap with the defective sub-region is identified. The virtual object is relocated within a second multiscopic image to use the another sub-region for presenting the virtual object. The second multiscopic image is then displayed after the relocation of the virtual object.
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
An augmented reality system includes a tracker, a transparent display arranged on an optical path of a real-world light field from a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the transparent display using the tracker, generate or retrieve an image to be displayed based on the determined positions, and determine a corresponding portion of the transparent display from which light rays of a given graphical element are to be directed toward a given eye. The processor is further configured to capture at least one real-world image, determine a colour and luminance of a portion of the real-world light field, calculate colour and luminance differences, adjust at least one graphical parameter based on the differences, and display the image via the transparent display.
G02B 27/14 - Beam splitting or combining systems operating by reflection only
H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
A liquid crystal display (LCD) device includes a backlight unit configured to produce collimated light. A relative location of a head or eyes of at least one user with respect to an image plane of the LCD device is determined. A plurality of images are displayed via the LCD device, to sequentially produce sets of collimated light beams. An active optical element, arranged on an optical path of the LCD device, is controlled based on a relative location of a head or a given eye of an individual one of the at least one user with respect to the image plane of the LCD device, to direct a respective one of the sets of collimated light beams towards the head or the given eye of the individual one of the at least one user.
A relative location of each eye of user(s) is determined with respect to an image plane of a three-dimensional (3D) heads-up display (HUD), and a relative location of a head or each eye of the user(s) is determined with respect to an image plane of a non-transparent display, by utilising tracking means. A first light field image to be displayed via the 3D HUD is generated for producing a part of a synthetic light field. An image to be displayed via the non-transparent display is generated for producing another part of the synthetic light field. The first light field image and the image are simultaneously displayed via the 3D HUD and the non-transparent display, respectively, to produce the synthetic light field.
For a given region of a liquid crystal display (LCD) device and a given viewing direction, colour values of an imaginary light ray that originates from at least one virtual object along the given viewing direction and that is to be presented by the given region of the LCD device are determined. This LCD device includes a backlight unit that is configured to produce collimated light rays. A drive signal is generated and sent to control the given region of the LCD device to emit light rays having the colour values of the imaginary light ray. A corresponding portion of an active optical element arranged on an optical path of the backlight unit is controlled, to direct the light rays along the given viewing direction. The aforesaid steps are repeated for respective ones of different viewing directions, by employing temporal multiplexing.
G03H 1/00 - Holographic processes or apparatus using light, infrared, or ultraviolet waves for obtaining holograms or for obtaining an image from themDetails peculiar thereto
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G03H 1/02 - Holographic processes or apparatus using light, infrared, or ultraviolet waves for obtaining holograms or for obtaining an image from themDetails peculiar thereto Details
G03H 1/04 - Processes or apparatus for producing holograms
17.
Systems and methods for context-aware visibility improvements in low-visibility conditions
A system for improving visibility in low-visibility conditions, being implemented in vehicle, including visible-light camera(s); depth camera(s); display unit; optical combiner; and processor(s). Processor configured to: obtain information indicative of relative position of head or eyes of user(s); control visible-light and depth camera(s) to capture, contemporaneously, visible-light and depth images, of region of real-world environment in front of vehicle. For given visible-light image (GVLI), processor identifies in corresponding depth image, image segment(s) that represents object(s) present in region of real-world environment. Processor identifies corresponding image segment(s) in GVLI whose visual information is any one of: occluded, degraded; and generates image by digitally superimposing virtual element(s) on corresponding image segment(s) of GVLI; and displays image via display unit to produce synthetic light field (SLF), optical combiner reflects SLF towards eyes of user(s).
B60R 1/24 - Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
G01C 21/36 - Input/output arrangements for on-board computers
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06V 10/25 - Determination of region of interest [ROI] or a volume of interest [VOI]
G06V 10/60 - Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
G06V 20/58 - Recognition of moving objects or obstacles, e.g. vehicles or pedestriansRecognition of traffic objects, e.g. traffic signs, traffic lights or roads
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
H04N 23/13 - Cameras or camera modules comprising electronic image sensorsControl thereof for generating image signals from different wavelengths with multiple sensors
18.
Apparatus, system and method for controlling temperature of backlight unit of display system
An apparatus for controlling temperature of backlight unit of display system includes: hollow heat transfer element arranged between optical element(s) of backlight unit and printed circuit board of backlight unit when apparatus is in use, wherein a first heat transfer fluid circulates within hollow space of hollow heat transfer element when apparatus is in use, to thermally couple hollow heat transfer element with at least one of: light-emitting elements arranged on printed circuit board, printed circuit board; and heat exchanger thermally coupled to hollow heat transfer element when apparatus is in use, wherein heat exchanger controls temperature of backlight unit to lie within a predefined operating temperature range, by exchange of thermal energy between heat exchanger and hollow heat transfer element via first heat transfer fluid.
G02F 1/00 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulatingNon-linear optics
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
H05K 7/20 - Modifications to facilitate cooling, ventilating, or heating
A system includes a windshield and processor(s). The windshield has a first substrate and a second substrate that are optically transparent, and a liquid crystal (LC) layer encased between the first substrate and the second substrate. A surface of at least one of: the first substrate and the second substrate that is in contact with the LC layer has at least one optical feature that pertains to at least one optical property. The at least one optical property includes at least one of: optical power, diffraction, refraction, transmittance, reflectance, polarization. The processor(s) are configured to selectively adjust a refractive index of an LC material in at least a given portion of the LC layer, to modulate the at least one optical property in a corresponding portion of the windshield.
Rear-view image(s) of a region of a surrounding environment that is behind a vehicle, is/are captured, by utilising rear-view camera(s). An image to be displayed via the heads-up display, is generated, wherein when generating the image, processor(s) is/are configured to generate an image segment of the image by utilising the rear-view image(s) of said region of the surrounding environment. The image is displayed via the heads-up display for producing a synthetic light field augmenting a real-world light field incoming via a windshield of the vehicle.
A system implemented in a vehicle. The system includes: a heads-up display (HUD); temperature sensors corresponding to regions of the HUD; a temperature controlling unit; and processor(s) configured to: determine, using the temperature sensors, temperatures of the regions; detect when the temperatures lie outside a predefined operating temperature range of the HUD; and when it is detected that the temperatures lie outside the predefined operating temperature range, determine a priority order, based on at least one of: the temperatures of the regions, an importance level that is pre-assigned to given virtual content that is to be presented via a given region of the HUD; and control the temperatures according to the priority order, by using the temperature controlling unit, to bring the temperatures within the predefined operating temperature range.
A system including: a multiscopic display; camera(s) that is/are positioned such that a display area of the multiscopic display lies at least partially within a field of view of the camera(s); and processor(s) configured to: display an image via the multiscopic display, whilst capturing image(s) of the display area using the camera(s); rectify the captured image(s) of the display area, to represent the display area only; generate a frequency-domain representation of the displayed image and a frequency-domain representation of the captured image(s) of the display area after rectifying; and determine a correct value of parameter(s) of a multiscopic optical element of the multiscopic display, based on the frequency-domain representation of the displayed image and the frequency-domain representation of the captured image(s) of the display area.
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
23.
On-the-fly automated calibration of multiscopic displays
An optical location of each eye of user(s) relative to a display area of a multiscopic display is determined using a tracker. An optical location of camera(s) relative to the display area is determined or retrieved. An initial estimated value of parameter(s) of a multiscopic optical element of the multiscopic display is selected. A multiscopic image to be displayed via the multiscopic display, is generated, based on the initial estimated value of the parameter(s) and the optical location of each eye of the user(s). The multiscopic image is displayed via the multiscopic display, whilst image(s) of the display area is/are captured using the camera(s). A refined estimated value of the parameter(s), is determined, based on the captured image(s), the multiscopic image, the initial estimated value of the parameter(s), and the optical location of the camera(s).
A system includes a tracker, a display, an optical combiner, at least one camera, and at least one processor. The optical combiner is arranged on an optical path of the display and on an optical path of a real-world light field of a real-world environment, and includes a semi-reflective surface. The camera is arranged facing the semi-reflective surface. The at least one processor is configured to determine relative positions of eyes of at least one user with respect to the semi-reflective surface, generate or retrieve an image, determine a portion of the semi-reflective surface from which light rays of a graphical element identified as important are to be reflected toward a given eye, detect when a luminance of a portion of the real-world light field exceeds a threshold luminance, identify a non-occupied region of the image, modify the image to reposition the graphical element, and display the image.
Light field images are displayed via a light field display unit to produce a synthetic light field presenting at least one virtual object to a given user. When it is detected that a difference between a focus depth at which the given user is gazing and a given optical depth at which the at least one virtual object is being presented is more than a predefined threshold difference, at least one of: dimming, blurring, is performed on a virtual image to be presented to a non-dominant eye of the given user. A current light field image is generated by utilising this virtual image and another virtual image to be presented to a dominant eye. The current light field image is displayed via the light field display unit to produce a current synthetic light field presenting the at least one virtual object.
A first image and a second image to be directed toward a first eye and a second eye, respectively, are generated or retrieved. For a given first segment of the first image presenting at least a part of a virtual object, an amount of crosstalk toward the first eye is determined based on at least the second image. A given second segment of the second image that also presents at least said part of the virtual object is determined. Intensity values of pixels in the given second segment of the second image are adjusted, based on the amount of crosstalk determined for the given first segment of the first image. An autostereoscopic image is then generated using the first image and the second image, and displayed via an autostereoscopic display.
H04N 13/125 - Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues for crosstalk reduction
H04N 13/302 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
A multiscopic display includes an array of light-emitting cells and a multiscopic optical element including a plurality of multiscopic cells. For a given multiscopic cell, distinct sets of light-emitting cells whose emitted light is directed toward respective eyes of at least one user are identified, and at least one additional set of light-emitting cells that does not emit light directed toward any of the eyes, is separated by a distance smaller than a first predefined threshold from a single distinct set of light-emitting cells, and is separated by a distance greater than a second predefined threshold from other distinct sets of light-emitting cells is determined. Pixel values are retrieved corresponding to the distinct sets and the at least one additional set from images to be presented to the respective eyes, and are used to generate an output image for display via the multiscopic display.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G02B 30/27 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
At least one monocular camera is installed in a vehicle in addition to in-cabin camera(s). Images captured by the in-cabin camera(s) at a first frame rate are processed to determine first positions of facial landmark features of a user and first poses of the user's face. Images captured by the at least one monocular camera at a second frame rate, higher than the first frame rate, are processed to identify facial landmark features of the user in the second images. Second positions of the facial landmark features are determined at the second frame rate, by correlating the facial landmark features identified in the second images with the first positions of the facial landmark features determined from the first images. Second poses of the user's face are determined at the second frame rate based on the second positions of the facial landmark features and the first poses of the user's face.
A graphical element is rasterized onto a set of light-emitting elements based on perceived shapes, perceived angular sizes and relative perceived positions of the light-emitting elements from a perspective of a given eye. Colour values, computed for the light-emitting elements based on the rasterization of the graphical element, are stored along with cadence information indicating a reference cadence of a reference light-emitting element in the set with respect to a multiscopic cell. When a cadence of a corresponding light-emitting element in another set matches the reference cadence within a predefined similarity threshold, the stored colour values are reused for light-emitting elements of the another set to display the graphical element to the given eye.
H04N 13/371 - Image reproducers using viewer tracking for tracking viewers with different interocular distancesImage reproducers using viewer tracking for tracking rotational head movements around the vertical axis
H04N 13/111 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
H04N 13/15 - Processing image signals for colour aspects of image signals
H04N 13/189 - Recording image signalsReproducing recorded image signals
Images of a user's face are captured at a plurality of time instants. Tracking parameters are determined, tracking parameters include: a pose of the user's head, positions of eyeballs, and at least one of: relative positions of irises with respect to boundaries of the eyeballs, relative positions of irises with respect to corners, shapes of the user's eyes. Uncalibrated gaze vectors of the user's eyes are estimated. A set of uncalibrated gaze vectors is generated. The uncalibrated gaze vectors of the set are stored along with corresponding time instants and tracking parameters. A first subset of uncalibrated gaze vectors whose direction matches with a predefined forward axis of vision, is selected. For the uncalibrated gaze vectors, corresponding tracking parameters are fetched. A maximum distance between the irises is determined. The maximum distance is considered as an interpupillary distance.
A61B 3/11 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for measuring interpupillary distance or diameter of pupils
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06T 7/55 - Depth or shape recovery from multiple images
G06V 40/18 - Eye characteristics, e.g. of the iris
31.
Parallax barrier with dynamic light steering based on relative location of viewer
A light field image is displayed via a light field display unit to produce a synthetic light field. A first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell of the light field display unit, based on a relative location of a first eye and a second eye with respect to an image plane of the light field display unit, respectively. A given first portion and a given second portion of an active optical element that lie respectively on optical paths of the given first photo-emitting cell and the given second photo-emitting cell are controlled, to direct light corresponding to the given first photo-emitting cell and light corresponding to the given second photo-emitting cell along the first viewing direction and the second viewing direction, respectively.
G02B 30/30 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving parallax barriers
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04N 13/31 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
32.
Adaptive visibility enhancement in augmented reality
A system including a tracker, a display, an optical combiner arranged on an optical path of the display and of a real-world light field of a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the optical combiner using the tracker, generate or retrieve an image to be displayed based on the relative position of each eye of the at least one user with respect to the optical combiner, and determine a corresponding portion of the optical combiner for a given region of the image. The processor is further configured to capture at least one real-world image, calculate a colour difference and a luminance difference, adjust the graphical element based on the differences, and display the image while optically combining it with the real-world light field.
A display device includes a backlight unit that is controllable to switch between lights of different colours having specific wavelengths, and an active panel including a liquid crystal (LC) layer. A multi-band reflective coating on an optical combiner is configured to selectively reflect the lights having the specific wavelengths. Different sets of drive signals are generated for different sub-images of an image. LC cells of the LC layer are controlled individually using the different sets of drive signals according to a predefined sequence in which the sub-images are to be displayed, whilst controlling the backlight unit to switch between lights of different colours according to the predefined sequence, thereby producing a synthetic light field corresponding to the image. The optical combiner is employed to selectively reflect the synthetic light field towards eyes of user(s), whilst optically combining a real-world light field with the synthetic light field.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G09G 3/34 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
34.
CALIBRATING OPTICAL COMBINER USING STRUCTURED LIGHT
Disclosed is a system implemented in an enclosed space. The system includes light source(s); tracking camera(s); an optical combiner arranged on an optical path of a light field display unit and on an optical path of a real-world light field of a real-world environment; and processor(s) configured to: control the tracking camera(s) to capture image(s) of the enclosed space, whilst controlling the light source(s) to project light pattern(s) onto a semi-reflective surface of the optical combiner; detect, in the image(s), a reflection of at least a part of the light pattern(s) off surface(s) in the enclosed space, and determine a shape of said reflection; and determine a curvature of the optical combiner, based on shapes of at least said part of the light pattern(s) and the reflection.
H04N 13/00 - Stereoscopic video systemsMulti-view video systemsDetails thereof
H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
H04N 13/302 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
A 3D bounding volume within which a graphical element is to be rasterized for a given eye is determined. A set of light-emitting elements from which light is directed toward the given eye along a direction intersecting the 3D bounding volume is identified. For each light-emitting element in the set, its perceived shape and angular size from a perspective of the given eye is determined. The graphical element is rasterized onto the set of light-emitting elements based at least on relative perceived positions of the light-emitting elements from the perspective of the given eye, and their perceived shape and their perceived angular size. A colour value is computed for each light-emitting element in the set based on the rasterization of the graphical element. A synthetic light field is then produced displaying the graphical element, using computed colour values for the light-emitting elements in the set.
G06T 19/00 - Manipulating 3D models or images for computer graphics
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
A first set of reference images is captured using tracking camera(s). Features are extracted from the first set. A first set of features that pertain to at least non-adjustable part(s) of an enclosed space is selected. Positions of the features of the first set are determined. Latest image(s) is/are captured using the tracking camera(s). Features are extracted from the latest image(s). A second set of features that pertain to at least the non-adjustable part(s) and that match with at least a subset of the first set of features, is selected. Positions of the features of the second set are determined. A difference in a position of a given feature of the second set and a position of a corresponding feature of the first set is determined. The tracking camera(s) is/are calibrated.
A display device includes laser light sources of different colours and at least one light guide. The at least one light guide includes a light outlet including a plurality of exit portions, and is controllable to sequentially guide light rays emitted by the laser light sources towards different exit portions of the light outlet. A pixel of an image is displayed by: (i) determining a corresponding exit portion, based on a pixel location of the pixel in the image; (ii) controlling the laser light sources to emit light rays having a colour and an intensity representative of the pixel, based on intensity values of different colour components of the pixel; and (iii) controlling the at least one light guide to guide said light rays towards the corresponding exit portion from which the light rays exit.
A first future pose (FFP) is predicted using first tracking data. An image is generated based on the FFP, the image with stripes, each stripe having scanlines. A second future pose (SFP) is predicted using second tracking data. The image is reprojected by performing, from a first stripe to a last stripe: determining a start pose for a given stripe; reprojecting starting scanline(s) of the given stripe, from the FFP to the start pose, whilst predicting an end pose for the given stripe; reprojecting intermediate scanline(s) of the given stripe from the FFP to an interpolated pose; and reprojecting ending scanline(s) of the given stripe from the FFP to the end pose, wherein a start pose for the first stripe is the SFP, and wherein the end pose for the given stripe is served as a start pose for its next stripe. Stripes of a reprojected image are sent to a display.
Information indicative of a relative location of a first eye and a second eye of an individual one of user(s) with respect to a multiscopic optical element is obtained. A first image and a second image are generated or retrieved. For a given multiscopic cell and a given horizontal scanline, first photo-emitting cell(s) and second photo-emitting cell(s) are selected from amongst photo-emitting cells lying on the given horizontal scanline and on whose optical path the given multiscopic cell lies. Then, intensity values for the first photo-emitting cell(s) and the second photo-emitting cell(s) are retrieved. Information indicating the intensity values for the first photo-emitting cell(s) and the second photo-emitting cell(s), and metainformation indicating locations of such photo-emitting cells are included in an input signal being sent to a display driver. Drive signals are generated. Display is driven to present the first image and the second image.
A first virtual image and a second virtual image are obtained, based on a relative location of a first eye and a second eye of at least one user with respect to an optical element. An image is generated, based on the first virtual image, the second virtual image, the relative location of the first eye and the second eye with respect to the optical element, and a relative location of the optical element with respect to a first display region and a second display region of a display unit. The image is displayed via the display unit. The optical element, being made of a birefringent material or a metamaterial, re-directs light emanating from the second display region to bend towards the first eye and the second eye, whilst allowing light emanating from the first display region to be incident upon the first eye and the second eye without bending.
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
H04N 13/122 - Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
H04N 13/346 - Image reproducers using prisms or semi-transparent mirrors
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
A backlight unit for a liquid crystal display device is disclosed. The backlight unit includes an array of light-emitting elements and a plurality of cavity reflectors, wherein a given cavity reflector partially surrounds a corresponding light-emitting element of said array. The backlight unit further includes a collimator arranged on an optical path of the array of light-emitting elements, a first drive circuit that is employed to individually control the light-emitting elements of said array, and a controller. The controller is configured to generate or receive drive signals for controlling the light-emitting elements of said array, and send the drive signals to the first drive circuit.
H04N 13/315 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
Tracking means are utilised to determine a relative location of a first eye and of a second eye of user(s) with respect to an optical combiner. An input for a light field display unit is generated, based on the relative location of the first eye and of the second eye. The input is employed at the light field display unit to produce a synthetic light field, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye, respectively, whilst optically combining the first part and the second part of the synthetic light field with a real-world light field of a real-world environment.
A light field image is displayed via a light field display unit to produce a synthetic light field. A light-steering optical device is controlled, based on a relative location of a first eye and a second eye of user(s) with respect to an imaginary image plane, to direct light emanating from a first set of photo-emitting cells towards the first eye and light emanating from a second set of photo-emitting cells of the light-emitting surface towards the second eye. When controlling the light-steering optical device, a first viewing direction and a second viewing direction are determined for a given first photo-emitting cell and a given second photo-emitting cell, respectively. Light emanating from the given first photo-emitting cell and from the given second photo-emitting cell is directed along the first viewing direction and the second viewing direction, respectively.
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
G02B 30/28 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays involving active lenticular arrays
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
H04N 13/368 - Image reproducers using viewer tracking for two or more viewers
Tracking means is utilised to determine a relative location of eyes of at least one user with respect to an optical combiner. The optical combiner is arranged on an optical path of a display unit and on an optical path of real-world light emanating from a real-world environment. A display image is generated, based on a curvature of a light-emitting surface of the display unit, a relative location of the optical combiner with respect to the display unit, and the relative location of the eyes of the at least one user with respect to the optical combiner. The display image is displayed via the display unit. The optical combiner is employed to reflect light emanating from the light-emitting surface of the display unit towards the eyes of the at least one user, whilst optically combining said light with the real-world light.
Information indicative of a relative location of a first eye and of a second eye of an individual one of user(s) is obtained. A light field image is generated or retrieved. The light field image is displayed via a liquid crystal display device for presenting virtual object(s). All the aforementioned steps are repeated for a given time period. During the given time period, it is detected when the first eye and/or the second eye lies outside a current viewing zone of a display system. When it happens, a given first region of a backlight unit (BLU) is determined to emit a first set of collimated light rays for presenting the virtual object(s) to the first eye, and a given second region of the BLU is determined to emit a second set of collimated light rays for presenting the virtual object(s) to the second eye. A corresponding first portion and a corresponding second portion of controllable light diffuser(s) are selectively activated to horizontally diffuse the first set and the second set, whilst directing towards the first eye and the second eye, respectively.
G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
46.
Augmenting reality with multiscopic see-through display
A first virtual image and a second virtual image represent virtual object(s) from a perspective of a first eye and a second eye of user(s). A union of first image segment(s) in the first virtual image and second image segment(s) in the second virtual image that represent the virtual object(s) is determined. A given portion of a transparent display whereat said union is to be presented is determined. A light field image is displayed via the transparent display, whilst controlling a controllable parallax barrier arranged on an optical path of the transparent display. The step of controlling the controllable parallax barrier comprises activating a given portion of the controllable parallax barrier that corresponds to the given portion of the transparent display.
H04N 13/315 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant
H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Information indicative of a relative location of a first eye and of a second eye of an individual one of user(s) is obtained. A light field image is generated or retrieved. The light field image is displayed via a liquid crystal display device for presenting virtual object(s). All the aforementioned steps are repeated for a given time period. During the given time period, it is detected when the first eye and/or the second eye lies outside a current viewing zone of a display system. When it happens, a given first region of a controllable backlight unit (CBLU) is determined for presenting the virtual object(s) to the first eye, and a given second region of the CBLU is determined for presenting the virtual object(s) to the second eye. The given first region and the given second region are selectively controlled to produce and direct any one of: diffused light rays, a combination of collimated light rays and the diffused light rays, towards the first eye and the second eye, respectively.
H04N 13/351 - Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
G02F 1/13 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulatingNon-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
48.
Hybrid motion stabilisation for augmented reality displays
When a relative position of a given eye with respect to an optical combiner changes by more than a predefined threshold at least a predefined number of times over a predefined time period, then for a subsequent time period, a three-dimensional (3D) view frustum corresponding to the given eye is updated, in response to the changes in the relative position of the given eye. A spatial anchor is maintained at a predefined position within the 3D view frustum. Corresponding positions for a graphical element are determined in images to be presented to the given eye, based on the predefined position of the spatial anchor within the 3D view frustum. The images are generated for presenting the graphical element to the given eye, positioning the graphical element at the corresponding positions.
A backlight unit for a liquid crystal display device includes an array of light-emitting elements. Each element includes a light source configured to emit light laterally relative to an optical axis of the backlight unit. A collimator is arranged on an optical path of emitted light rays in at least one direction to collimate the light rays. A first prism is positioned after the collimator to reflect a portion of the collimated light rays with one polarization orientation along the optical axis and transmit another portion with the opposite polarization orientation. A half-wave plate, arranged after the first prism, rotates the polarization of the transmitted light. A second prism, positioned after the half-wave plate, reflects the rotated light along the optical axis.
A system includes a tracker, an autostereoscopic display, and at least one processor. The at least one processor is configured to track an eye position of a given eye of a given user relative to an image plane of the autostereoscopic display, using the tracker. The at least one processor is further configured to detect when the eye position of given eye is no longer trackable by the tracker. When the eye position is no longer trackable, the at least one processor is configured to generate or retrieve an image for display to the given eye, increment a tracking counter, map a value of the tracking counter to a transition level, and perform at least one of modifying pixel intensity values of the image based on the transition level to fade out the image, or interpolating a virtual depth in the image based on transition level, and display the image.
An autostereoscopic display includes a light-emitting panel and a lenticular array in which a focal length of a lenticular lens is different from its thickness. For an intersection of a given row of light-emitting cells and a given lenticular lens, a given viewing direction from a given eye toward said intersection is determined. From light-emitting cells arranged on the given row and on whose optical path the given lenticular lens lies, a set of light-emitting cells whose light travels toward the given eye is determined. Corresponding regions on a curved surface of the given lenticular lens through which light from individual light-emitting cells of the set pass toward the given eye are identified and mapped to respective pixel locations in an image to be presented. Pixel values of pixels located at these pixel locations in the image are retrieved and used to generate an output image for display.
H04N 13/305 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
52.
Calibrating heads-up display using infrared-responsive markers
A system includes an infrared (IR) light source(s); IR camera(s); an optical combiner, wherein a set of IR-responsive markers are located in at least one of: (i) within the optical combiner, (ii) on a semi-reflective surface of the optical combiner; and processor(s) configured to: control the IR camera(s) to capture IR image(s) of the optical combiner, whilst controlling the IR light source(s) to emit IR light towards the optical combiner; detect at least a subset of the set of IR-responsive markers in the IR image(s); for a given IR-responsive marker detected in the IR image(s), determine a deformation in a shape of the given IR-responsive marker with respect to a reference shape; and determine a curvature of the optical combiner, based on respective deformations in shapes of IR-responsive markers in at least said subset.
A method includes obtaining information indicative of a relative location of each eye of at least one user with respect to an image plane of an augmented-reality display, generating or retrieving at least one image to be displayed based on the obtained information, identifying a plurality of graphical elements to be presented by the at least one image, detecting a potential overlap between at least two of the plurality of graphical elements from a perspective of a given eye of the at least one user, identifying distinct sets of allowed operations for respective graphical elements, determining a corresponding cost for each allowed operation, selecting at least one operation based on the allowed operations and their corresponding costs, applying the selected operation to at least one graphical element to modify the at least one image, and displaying the at least one image at the augmented-reality display.
Disclosed is a system implemented in an enclosed space. The system includes light source(s); tracking camera(s); an optical combiner arranged on an optical path of a light field display unit and on an optical path of a real-world light field of a real-world environment; and processor(s) configured to: control the tracking camera(s) to capture image(s) of the enclosed space, whilst controlling the light source(s) to project light pattern(s) onto a semi-reflective surface of the optical combiner; detect, in the image(s), a reflection of at least a part of the light pattern(s) off surface(s) in the enclosed space, and determine a shape of said reflection; and determine a curvature of the optical combiner, based on shapes of at least said part of the light pattern(s) and the reflection.
H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
H04N 13/302 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
An image is generated, based on a relative location of a head or eyes of a user with respect to a waveguide. An input is generated, based on a relative location of the head or the eyes with respect to an optical combiner. The image is displayed via a display of a waveguide display unit, while the input is employed at a light field display unit, to produce a synthetic light field. An optical combiner is employed to reflect a part of the synthetic light field emanating from the light field display unit towards the eyes of the user, while optically combining the part of the synthetic light field with a real-world light field. The part of the synthetic light field and the real-world light field are optically combined with another part of the synthetic light field emanating from the waveguide display unit.
An autostereoscopic display includes a pixel array and a multiscopic optical element. The pixel array includes a plurality of pixel rows, each of the plurality of pixel rows being aligned along an X-axis of the autostereoscopic display. The multiscopic optical element comprises a plurality of multiscopic cells (108) and lies on an XY plane of the autostereoscopic display. Each of the plurality of multiscopic cells has a longitudinal axis (P-Q) aligned along a Y-axis of the autostereoscopic display. In a given set of consecutive pixel rows, a starting position of a given pixel row is horizontally offset relative to a starting position of a preceding pixel row. The horizontal offset is represented along the X-axis.
H04N 13/305 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
H04N 13/366 - Image reproducers using viewer tracking
An optical location of camera(s) relative to a display area of a multiscopic display is detected or retrieved. Another optical location is selected, the another optical location being offset from the optical location of the camera(s) by a given angular interpupillary distance. An estimated pitch of a multiscopic optical element is selected. A first image and a second image are obtained, wherein the first image has first colour(s), and the second image has second colour(s) being different from the first colour(s). A multiscopic image is generated, based on the estimated pitch. The multiscopic image is displayed, whilst capturing image(s) of the display area. A correct pitch of the multiscopic optical element is determined, based on an interference pattern represented in the image(s).
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
A display device includes a light-emitting panel comprising a plurality of pixels, wherein a given pixel comprises sub-pixels of at least two different colours (R, G, B, W) that are arranged sequentially along a first direction (A-B, H-I, M-N, K-L, Y-Z, U-V). The display device further includes a lenticular array arranged on an optical path of the light-emitting panel, the lenticular array including a plurality of lenticular lenses, wherein a longitudinal axis (X-Y) of a given lenticular lens aligns with the first direction. A processor is configured to generate drive signals for the plurality of pixels, based on a light field image to be displayed and to drive the plurality of pixels using the drive signals to display the light field image.
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G02B 30/27 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
59.
Eye position based spatial anchors for heads-up displays
A relative position of a given eye of user(s) is determined with respect to a semi-reflective surface of an optical combiner, using a tracker. A given reflection region is identified on the semi-reflective surface from which light emitted by a light-emitting surface (122, 606) of an autostereoscopic display is reflected toward the given eye. A given three-dimensional (3D) view frustum corresponding to the given eye is determined. For a given virtual depth at which graphical element(s) is/are to be presented, a frustum cross-section of the given 3D view frustum is determined at the given virtual depth relative to the given eye. Spatial anchor(s) is/are positioned at predefined position(s) on the frustum cross-section. A position for the graphical element(s) on the frustum cross-section is determined relative to the spatial anchor(s). A given image for presenting the graphical element(s) to the given eye, is determined, the graphical element(s) being positioned at the determined position.
A light field image is generated, based on a relative location of a first eye and of a second eye of a user with respect to an optical combiner. The light field image is displayed to produce a synthetic light field presenting virtual content, wherein the optical combiner reflects a first part and a second part of the synthetic light field towards first eye and second eye, respectively, whilst optically combining the first and second parts with a real-world light field. These steps are repeated for a given time period, during which it is detected when the user has made a head movement, whilst fixating on a portion of the virtual content. Upon detection, a current relative location is corrected, a current light field image is generated and displayed to produce a current synthetic light field.
For a given region of a light-emitting surface of a display unit, an iterative search is performed to find a corresponding reflection portion of a semi-reflective surface of an optical combiner where light rays emanating from the given region are incident and from which the light rays reflect towards a given eye, based on a curvature of the semi-reflective surface, a relative location of the semi-reflective surface with respect to the light-emitting surface, and the relative location of the given eye with respect to the semi-reflective surface. A viewing direction from the given eye towards the corresponding reflection portion is determined. A corresponding pixel location in the input image is determined based on the viewing direction. For the corresponding pixel location in the input image, colour values of a corresponding pixel in the input image are fetched and utilised to display colour at the given region of the light-emitting surface.
Tracking means is utilised to estimate potential positions of a head of a user sitting on a seat of a vehicle. A three-dimensional (3D) volume where the user's head is likely to be present is determined, based on a current setting of adjustable seat parameter(s), the adjustable seat parameter(s) being detected by sensor(s). It is detected whether at least one of the plurality of potential positions of the head lies outside the 3D volume. When it is detected that at least one of the plurality of potential positions of the head lies outside the 3D volume, the at least one of the plurality of potential positions is considered as an outlier, and a correct position of the user's head is determined as one of the plurality of potential positions of the head that lies within the 3D volume.
For a region of an image, a portion of a semi-reflective surface of an optical combiner from which light rays of the given region are reflected towards eyes of a user during display via a display unit is determined. For this portion of the semi-reflective surface, a secondary reflection intensity of light rays of another region of the image that undergo secondary reflection from a portion of another surface of the optical combiner is determined. A minimum intensity level of pixels in the image is increased. Intensity values of pixels in said region of the image are adjusted based on the secondary reflection intensity. The image is displayed via the display unit, thereby producing a synthetic light field. The optical combiner reflects the synthetic light field towards the eyes, whilst optically combining the synthetic light field with a real-world light field.
Tracking means is utilised to track a position and an orientation of a head of user(s) sitting inside a vehicle. A vehicular acceleration signal is determined for a first time period, based on at least one of: an acceleration, an orientation of the vehicle sensed by sensor(s) during the first time period. Transformation(s) is/are applied to the vehicular acceleration signal to generate a head acceleration signal for a second time period, wherein the head acceleration signal is indicative of a change in at least one of: an acceleration, the orientation of the head. An expected head movement of the user(s) is determined, based on the head acceleration signal. The position and the orientation of the head being tracked by utilising the tracking means are refined, based on the expected head movement.
A display device includes a first liquid crystal (LC) layer and a second LC layer arranged between a backlight unit and a linear polarizer, and a multiscopic optical element arranged between the first LC layer and the second LC layer. Drive signals for LC cells of the first LC layer and the second LC layer are generated, based on corresponding images to be presented to each eye of each individual user, a relative location of each eye with respect to an image plane of the display device, and relative positions of the LC cells of the first LC layer and the second LC layer with respect to multiscopic cells of the multiscopic optical element. The LC cells are controlled using the drive signals, to adjust a polarization of light passing therethrough, for producing a synthetic light field presenting the corresponding images to each eye of each individual user.
G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
G02F 1/1347 - Arrangement of liquid crystal layers or cells in which the final condition of one light beam is achieved by the addition of the effects of two or more layers or cells
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
66.
Augmenting reality using multiscopic display having adaptive crosstalk compensation
For a given region of a given virtual image to be presented to a given eye of user(s), intensity values of pixels in a corresponding portion of a real-world image and an amount of crosstalk due to other virtual image(s) are determined. A minimum intensity level of pixels in the given region of the given virtual image are increased, based on the intensity values of the pixels in the corresponding portion of the real-world image. First intensity values of the pixels in the given region of the given virtual image are adjusted, based on the amount of crosstalk determined for the given region of the given virtual image. A light field image is generated by utilising the given virtual image and the other virtual image(s). The light field image is displayed via a light field display unit for producing a synthetic light field.
An optical combiner is employed to reflect a first part and a second part of a synthetic light field towards a first eye and a second eye of user(s), respectively, whilst optically combining the first part and the second part with a real-world light field. Portion(s) of the optical combiner from which a part of the synthetic light field is reflecting towards a given eye of a given user is determined, based on a relative location of the given eye with respect to the optical combiner. Portion(s) of active optical device(s) that corresponds to the portion(s) of the optical combiner are activated, to decrease transmittance of the real-world light field passing through the portion(s) of the optical combiner towards the given eye, and/or to increase reflectance of the synthetic light field being reflected by the portion(s) of the optical combiner towards the given eye.
A first virtual image and a second virtual image are obtained, based on a relative location of a first eye and a second eye of user(s) with respect to an image plane of a display device. The display device includes a backlight, a first polarizer and a second polarizer, a first liquid crystal (LC) layer and a second LC layer arranged between the first polarizer and the second polarizer and having a gap. Drive signals are generated, based on the first virtual image, the second virtual image, and the relative location of the first eye and the second eye. The first LC layer and the second LC layer are controlled using the drive signals, to adjust a polarization of light passing therethrough, for producing a synthetic light field presenting the first virtual image and the second virtual image to the first eye and the second eye, respectively.
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
G02F 1/13 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulatingNon-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
