Abstract

A method of performing intra prediction for encoding or decoding uses multiple layers of reference samples. The layers are formed into reference arrays that are used by a function, such as a weighted combination, to form a final prediction. The prediction is used in encoding or decoding a block of video data. The weights can be determined in a number of ways, and for a given prediction mode, the same weights, or different weights can be used for all pixels in a target block. If the weights are varied, they can depend on the distance of the target pixel from reference arrays.

IPC Classes  ?

• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/96 - Tree coding, e.g. quad-tree coding

Abstract

Systems and methods are disclosed for encoding and for decoding of video data, including predicting a video block of the video data using decoder-side intra mode derivation (DIMD). The disclosed predicting techniques include selecting candidate intra prediction modes based on intra prediction modes used by neighboring video blocks. Techniques disclosed further include determining respective costs of using the selected candidate intra prediction modes to predict samples in a template region adjacent to the video block, deriving an intra prediction mode from the selected candidate intra prediction modes having the lowest cost, and predicting samples in the video block using the derived intra prediction mode.

IPC Classes  ?

• H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A method for coding/decoding a large field of view video into a bitstream in an immersive rendering system is disclosed. At least one picture of said large field of view video is represented as a surface, said surface being projected onto at least one 2D picture using a projection function. For at least one current block of said at least one 2D picture, at least one item of information representative of a modification of a 2D spatial neighborhood is determined according to said projection function. A group of neighboring blocks using said at least on item of information representative of a modification is determined and at least one part of encoding/decoding of said current block is performed using said determined group of neighboring blocks.

IPC Classes  ?

• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

Apparatuses and methods are disclosed including techniques for calibrating a light field display having projector cells. Each of the of projector cells contains light emitting elements and a beam-steering element, and is configured such that an outgoing light from at least one of the light emitting elements exits the projector cell after passing through the beam-steering element in a first direction. Techniques disclosed include projecting a tracking beam onto a calibration spot on a viewer of the light field display; detecting, by at least one of light sensing elements (distributed relative to the light emitting elements), an incoming light of the tracking beam reflected from the calibration spot, where the incoming light enters the projector cell passes through the beam-steering element in a second direction opposite to the first direction; and adjusting the steering of the beam-steering element based on the detection of the incoming light.

IPC Classes  ?

• H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
• G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
• H04N 13/00 - Stereoscopic video systemsMulti-view video systemsDetails thereof
• H04N 13/317 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using slanted parallax optics
• H04N 13/368 - Image reproducers using viewer tracking for two or more viewers
• H04N 13/373 - Image reproducers using viewer tracking for tracking forward-backward translational head movements, i.e. longitudinal movements

Abstract

Apparatuses and methods are disclosed including techniques for optimizing the transmission of dynamic point clouds to a client. The disclosed techniques include obtaining a reference point cloud representing a first point cloud in a time sequence of point clouds; receiving a series of representations of changes to the reference point cloud, where each representation specifies an area of the reference point cloud and a change to be applied to the specified area, each such change comprises at least one of a 3D transformation, a set of points to be added to the reference point cloud, and a set of points to be removed from the reference point cloud; and successively applying the representations to the reference point cloud to generate a point cloud representing a second point cloud in the time sequence of point clouds.

IPC Classes  ?

• G06T 7/33 - Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
• G06T 7/38 - Registration of image sequences
• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

Encoding or decoding picture information can involve determining a coding mode associated with a current coding unit including picture information; determining, based on the coding mode, a first precision level associated with a first portion of a motion vector information associated with the current coding unit, and a second precision level associated with a second portion of the motion vector information; obtaining a motion vector associated with the current coding unit based on the motion vector information and the first and second precision levels; and encoding or decoding at least a portion of the picture information included in the current coding unit based on the coding mode and the motion vector.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/513 - Processing of motion vectors

Abstract

A method and a system for providing an answer to a query from a user, for example about video content. The system receives a query, generates a video clip that corresponds to the question, and provides the video clip for presentation to the user. The question can for example be about an event in a TV series or a film, or about an activity recorded by a video surveillance system.

IPC Classes  ?

• H04N 21/4722 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content for requesting additional data associated with the content
• H04N 21/431 - Generation of visual interfacesContent or additional data rendering
• H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs

Abstract

Methods and apparatuses for encoding or decoding an image or a video based on neural network are provided. In an embodiment, an image is encoded by obtaining a first latent representation of the image in a first latent space, for instance from a Generative Adversarial Network. A second latent representation of the image in a second latent is obtained from the first latent representation and encoded. In an embodiment, the second latent space is obtained from an unfolding of the first latent space based on at least one constraint. In an embodiment, the second latent space is obtained using a neural network. The methods or apparatuses can be used for image editing and/or image or video coding.

IPC Classes  ?

• H04N 19/60 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
• H04N 19/124 - Quantisation
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
• H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
• H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding

Abstract

A method and device for reducing power consumption of display devices proposes to reduce the total amount of light emitted in a perceptually indistinguishable manner based on the on the human visual sensitivity at the position of a pixel. The visibility of the processing can be made to remain provably below threshold, whereas other techniques may not be able to provide such proof. This is achieved by determining a minimum detectable modulation or a corresponding just-noticeable difference based on frequency intensity information for a pixel representative of how much there is of a set of frequencies at the pixel and a contrast sensitivity function representative of a model of human vision that predicts which contrasts at which frequencies are visible to the human eye. Pixel values may be reduced based on this minimum detectable modulation or just-noticeable difference. The contrast sensitivity function may be given by Barten's model and the frequency intensity information may be based on a hierarchical map built using a discrete wavelet transform or a continuous wavelet transform.

IPC Classes  ?

• G09G 5/10 - Intensity circuits
• G09G 3/3208 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]

Abstract

Described are methods and apparatuses for encoding/decoding a picture comprising predicting at least one block, wherein the predicting comprises performing motion compensation and local illumination compensation based on a reference block, the local illumination compensation including applying a linear model based on sums of absolute differences of neighboring reconstructed samples and corresponding reference samples of the reference block, wherein the neighboring reconstructed samples and corresponding reference samples of the reference block are co-located according to an L-shape substantially adjacent to the block to be predicted, the L-shape comprising a row of pixels located to the top side of the predicted block and a column of pixels located to the left side of the predicted block, the co-location being determined according a motion vector of the predicted block.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters

Abstract

Encoding or decoding video information can involve, for example, partitioning a coding unit of the video information using a partitioning based on a modification of a constraint on partitioning that is associated with a pipeline configuration for reconstruction of the coding unit, where the modification is based on an information dependency between two or more pipeline units associated with the pipeline configuration, and encoding or decoding the video information based on the partitioning.

IPC Classes  ?

• H04N 19/436 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/124 - Quantisation
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Methods and apparatus are provided for unified significance map coding. An apparatus includes a video encoder (400) for encoding transform coefficients for at least a portion of a picture. The transform coefficients are obtained using a plurality of transforms. One or more context sharing maps are generated for the transform coefficients based on a unified rule. The one or more context sharing maps are for providing at least one context that is shared among at least some of the transform coefficients obtained from at least two different ones of the plurality of transforms.

IPC Classes  ?

• H03M 7/40 - Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
• H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCTSelection of sub-band transforms of varying structure or type
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/18 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
• H04N 19/64 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by ordering of coefficients or of bits for transmission
• H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

In example embodiments, an apparatus includes a waveguide having an in-coupler an out-coupler. The waveguide has a first surface and an opposite second surface, and the waveguide provides at least one optical path from the in-coupler to the out-coupler. The in-coupler comprises a first diffraction grating with a first grating vector on the first surface and a second diffraction grating with a second grating vector on the second surface. At least one of the first and second grating vectors is not oriented along any of the optical paths from the in-coupler to the out-coupler. The second grating may alter the polarization state of in-coupled light and/or change the direction of the in-coupled light to aid in preventing the light from being out-coupled by the first diffraction grating.

IPC Classes  ?

• F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
• G02B 27/01 - Head-up displays
• G02B 27/42 - Diffraction optics
• G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,

Abstract

A first interface of a device receives content from a further device, at least one hardware processor analyses the content to find active elements that will be visible on a screen when displayed, generates a page by overlaying a first part of the content that will be visible on the screen when displayed with graphic elements respectively corresponding to found active elements, sends the page to a third interface for display on the screen and activates a corresponding active element upon reception, via a second interface from a user input device, of a command comprising an identifier displayed in a graphic element. In case the identifier corresponds to a graphic element associated with a group comprising a plurality of active elements, graphic elements corresponding to each active element in the group are overlaid over the first image.

IPC Classes  ?

• H04N 21/4722 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content for requesting additional data associated with the content
• G06F 3/04817 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G06F 3/0483 - Interaction with page-structured environments, e.g. book metaphor
• G06F 16/954 - Navigation, e.g. using categorised browsing
• G06F 16/955 - Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
• H04N 21/422 - Input-only peripherals, e.g. global positioning system [GPS]
• H04N 21/431 - Generation of visual interfacesContent or additional data rendering
• H04N 21/435 - Processing of additional data, e.g. decrypting of additional data or reconstructing software from modules extracted from the transport stream
• H04N 21/462 - Content or additional data management e.g. creating a master electronic program guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
• H04N 21/472 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content
• H04N 21/478 - Supplemental services, e.g. displaying phone caller identification or shopping application
• H04N 21/4782 - Web browsing

Abstract

During an adaptive streaming session of video content, an access latency is obtained by a client device (100A) running the adaptive streaming session in order to adapt the quality of the requested video content when necessary.

IPC Classes  ?

• H04L 65/613 - Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
• H04L 43/0864 - Round trip delays
• H04L 43/10 - Active monitoring, e.g. heartbeat, ping or trace-route
• H04L 65/80 - Responding to QoS

Abstract

The general aspects extend motion modes, such as merge with motion vector difference, and symmetrical motion vector difference, to motion models beyond a simple translational model, for example in combination with merge and alternative temporal motion vector prediction modes. Embodiments extend the use of MMVD and SMVD motion vector coding tools to all the motion model derivation methods and temporal prediction methods that are supported in proposed video standards, so as to increase the overall compression performance. Particular embodiments describe combining MMVD or SMVD with the affine motion model, the ATMVP motion model, the planar motion model, the regressive motion field, the triangle-partition-based motion model, the GBI temporal prediction method, the LIC temporal prediction method and the Multi-hypothesis prediction method.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/109 - Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/577 - Motion compensation with bidirectional frame interpolation, i.e. using B-pictures

Abstract

Some embodiments of an example apparatus may include a display, a first controllable diffuser overlaying the display, the first controllable diffuser being selectively operable to diffuse light in a first diffusion direction, and a second controllable diffuser overlaying the display, the second controllable diffuser being selectively operable to diffuse light in a second diffusion direction substantially perpendicular to the first diffusion direction. In some embodiments, an example method may include emitting a light beam from a light emitting device; linearly polarizing the light beam; passing the light beam through LC and birefringent materials; and applying a voltage to alter polarization of the LC material, from a first state causing the light to diffuse in a first direction upon passing through the birefringent material, to a second state causing the light beam to diffuse in a second direction upon passing through the birefringent material.

IPC Classes  ?

• H04N 13/307 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using fly-eye lenses, e.g. arrangements of circular lenses
• G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
• H04N 13/315 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant

Abstract

A method performed by a first electronic device includes receiving from a second electronic device an indication of an occurrence of one or more trigger conditions for content capture of multimedia content displayed on the first device, starting capture of the multimedia content in response to the trigger condition indication, collecting information from a third device, wherein the information from the third device is response information that is related to the multimedia content displayed on the first device, augmenting the captured multimedia content with the collected information from the third device for simultaneous display, and displaying the augmented multimedia content.

IPC Classes  ?

• H04N 21/433 - Content storage operation, e.g. storage operation in response to a pause request or caching operations
• H04N 21/431 - Generation of visual interfacesContent or additional data rendering
• H04N 21/442 - Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed or the storage space available from the internal hard disk
• H04N 21/8547 - Content authoring involving timestamps for synchronizing content

Abstract

At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, parameters for a local illumination compensation LIC of a current block being encoded/decoded in a picture are determined based on spatially neighboring reconstructed samples and corresponding spatially neighboring reconstructed samples of at least one spatial reference block, wherein the at least one spatial reference block is a spatially neighboring block of the current block in the picture. For example, a flag enables/disables the spatial LIC for the current block. For example, the spatial LIC is applied to any of an Inter/Intra/IBC prediction. For example, multiple spatial reference blocks are used in determining the spatial LIC parameters. For example, spatially neighboring reconstructed samples of multiple lines are used in determining the spatial/temporal LIC parameters.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• G06T 5/20 - Image enhancement or restoration using local operators
• G06T 5/94 - Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding

Abstract

According to an embodiment, a direction pointed by a controlling device with a first orientation may be obtained from a first image of a user handing the controlling device with the first orientation. For example, an initial indication of an initial pointed position may be displayed on a display device based on the direction. For example, angular information may be obtained. The angular information may be representative of a difference between the first orientation and a second orientation of the controlling device pointing to the pointed position. For example, an indication of a pointed position may be determined (e.g., for display) based on the initial pointed position and on the received angular information.

IPC Classes  ?

• G06F 3/0346 - Pointing devices displaced or positioned by the userAccessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 11/60 - Editing figures and textCombining figures or text

Abstract

A reconstruction method comprising: obtaining (811) a region predictor for a current region of a picture based on a spatial prediction: obtaining (812) an information representative of a partitioning of the current region into sub-regions: reconstructing (813) at least one residual sub-region based on an intra prediction residual and an intra prediction mode and obtaining a reconstructed residual region from the at least one reconstructed residual sub-region, wherein all reference samples external to the current region used for reconstructing the at least one sub-region are set to zero before reconstructing the at least one residual sub-region: and, reconstructing (814) the current region based on the reconstructed residual region and on the region predictor by adding a final predictor obtained from the region predictor and the reconstructed residual region.

IPC Classes  ?

• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Abstract

A controllable device provides through a first communication interface to a controller device, data location information indicating where user interface data can be obtained, the data location information can comprise an address of the controllable device and at least one hardware processor configured to provide, upon request from the controller device via a second communication interface, the user interface data enabling rendering of a user interface, reception of user input via the user interface and sending to the controllable device of a message corresponding to a command received through the user interface and to implement the command based on the message.

IPC Classes  ?

• H04N 21/422 - Input-only peripherals, e.g. global positioning system [GPS]
• H04N 21/41 - Structure of clientStructure of client peripherals
• H04N 21/436 - Interfacing a local distribution network, e.g. communicating with another STB or inside the home

Abstract

A method for reconstructing a picture block is disclosed, wherein the block is predicted using local illumination compensation. The parameters of local illumination compensation are determined according to a selection of reconstructed samples located to the left and above of the current block. In the case where some of them are unavailable, they may be replaced using different techniques.

IPC Classes  ?

• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters

Abstract

A method and apparatus for performing intra prediction for encoding or decoding adds multiple prediction modes to those of prior intra prediction schemes. A horizontal mode, a vertical mode, and a diagonal mode are added. Reference pixels for each of the added modes can come from multiple pixel positions away from a block to be encoded or decoded. Reference pixels to the left and above a block are reconstructed from those already coded. Reference pixels from right of, and below, a block are estimated or extrapolated and can be based on other pixels around the block. An index can be sent in a bitstream indicating which prediction was used.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

A device receives a question, which can be related to an event, from a user through a user interface, and at least one hardware processor generates a first summary of at least one dialogue of the event; and output a result obtained by processing the summary, the question and possible answers to the question.

IPC Classes  ?

• H04N 21/475 - End-user interface for inputting end-user data, e.g. PIN [Personal Identification Number] or preference data
• H04N 21/8549 - Creating video summaries, e.g. movie trailer

Abstract

A method performed by a viewing device includes receiving a request for an operation to be performed by the viewing device. The request includes trigger criteria for performing the operation. The viewing device receives content from a content provider including content related metadata. A detection is made of a condition that the trigger criteria for the operation to be performed has been met. As a result, the viewing device performs the requested operation. The detection made be accomplished by the viewing device or by a service provider.

IPC Classes  ?

• H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• H04N 21/422 - Input-only peripherals, e.g. global positioning system [GPS]
• H04N 21/472 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content

Abstract

Methods, apparatuses, systems, etc., directed to adapting user input in cloud gaming are disclosed herein. In an embodiment, a consumption rate of a game running on a game server may be obtained (e.g., by a client device). For example, the consumption rate may be associated with at least one input device (e.g., of the client device). For example, a consumption rate may be representative of a rate at which the game server may process user inputs of the (e.g., associated) input device. For example, the input rate (e.g., at which the user inputs may be transmitted to the game server) may be adapted by synchronizing the input rate to the consumption rate.

IPC Classes  ?

• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• A63F 13/358 - Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients

Abstract

A decoding method for decoding a block of an image is disclosed that comprises: determining a split mode for said block in a set of split modes; splitting said block into at least two sub-blocks responsive to said split mode; decoding each of the at least two sub-blocks; wherein said set of split modes comprises at least one split mode for asymmetrically splitting said block into the at least two sub-blocks.

IPC Classes  ?

• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

In one embodiment of the disclosure, a diffraction grating structure is proposed comprising several grating lines. The diffraction grating structure is associated with a propagation layer, and the diffraction grating structure is made of a material that has a refractive index being equal to n2(λ). The diffraction grating structure is remarkable in that it comprises T grating lines per μm, with T=(n2(λ)+1)/2λ, where λ is a wavelength defined from an incident electromagnetic wave.

IPC Classes  ?

• G02B 5/18 - Diffracting gratings
• F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
• H01L 31/0232 - Optical elements or arrangements associated with the device
• H10K 50/858 - Arrangements for extracting light from the devices comprising refractive means, e.g. lenses

Abstract

A method and device for audio steering from a loudspeaker line array of a display device toward a user direction is disclosed. Data corresponding to a viewer gesture is obtained from at least one sensor of a display device. A distance and an angle between the viewer and a plurality of loudspeakers coupled to the display is determined based on the obtained data. Phase shifting is applied to an audio signal powering the plurality of loudspeakers based on the determined distance and angle to audio steer toward the user direction.

IPC Classes  ?

• H04S 1/00 - Two-channel systems
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

In example embodiments, a waveguide display apparatus includes a waveguide comprising a substrate, a plurality of diffractive grating elements on the waveguide, and at least two coating layers on the waveguide between the substrate and the diffractive grating elements. The grating elements may be elements of a diffractive in-coupler. Some embodiments include three coating layers, with a middle layer having a refractive index greater than that of the substrate, the middle layer being between two layers having a refractive index lower than that of the substrate. Some embodiments further include a fourth coating layer.

IPC Classes  ?

• G02B 27/01 - Head-up displays
• F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems

Abstract

A method and an apparatus for editing at least two sequences of pictures are provided. Editing the sequences comprises modifying at least one picture of one of the at least two sequences, based on a user input, and updating at least one picture of at least one other sequence of the at least two sequences, with the modification.

IPC Classes  ?

• G06T 11/60 - Editing figures and textCombining figures or text
• G06T 3/00 - Geometric image transformations in the plane of the image
• G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
• G06T 17/00 - 3D modelling for computer graphics
• G06V 10/56 - Extraction of image or video features relating to colour
• H04N 1/60 - Colour correction or control

Abstract

Apparatuses and methods for encoding or decoding picture information that involve determining a scaling factor to scale a chroma prediction residual associated with chroma information included in the picture information; scaling the chroma prediction residual based on the scaling factor to provide a scaled chroma prediction residual; and encoding or decoding at least a portion of the picture information based on the scaled chroma prediction residual.

IPC Classes  ?

• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A method includes decoding a first portion of video data consisting of an information set consisting of information representative of a plurality of candidate sets of sample adaptive offset filter parameters. A set of sample adaptive offset parameters comprises information representative of an offset to be added to a sample value of a current block. A first syntax element representing an index that identifies a first candidate set of the plurality of candidate sets of sample adaptive offset filter parameters is decoded from the video data for the current block. The current block is decoded from a second portion of the video data different from the first portion. The decoded current block is filtered with the first candidate set identified by the index. The first portion is signaled with syntax elements at a level of a block of a group of blocks comprising the current block decoded first in decoding order.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

A method and an apparatus for deep prediction refinement are disclosed. A first motion-compensated region for a block of a picture and a second region for said block are obtained. A prediction for said block is determined using a Neural Network that uses said first motion-compensated region and said second region.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A method and an apparatus for processing a 3D scene are presented. Techniques are disclosed for determining light source locations, including tracking a current viewpoint of a camera capturing object(s) in a 3D scene and determining a reference viewpoint relative to the current viewpoint of the camera. According to aspects, a light source location is determined by obtaining a registered map of real cast shadows of the object(s) from an input image captured by the camera, registered with respect to the reference viewpoint. Then, for candidates of light sources, obtaining respective maps of virtual shadows of the object(s) created with respect to the reference viewpoint, and determining the location of the light source based on the candidates of light sources with respective maps of virtual shadows that match the registered map of real cast shadows.

IPC Classes  ?

• G06T 15/50 - Lighting effects
• G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
• G06T 7/20 - Analysis of motion

Abstract

Apparatuses and methods are disclosed for encoding and decoding video data. Techniques are disclosed for encoding a video block, including dividing the video block into coding units and grouping the coding units into at least one group, the grouping comprises associating an indication with each of the coding units that indicates whether a shared coding information is to be used in the encoding of the respective coding unit. Techniques are also disclosed for decoding the video block, including obtaining from a bitstream the coding units and their respective indications. For a coding unit that is associated with an indication that the shared coding information is to be used, the decoding is performed based on the shared coding information; otherwise, the decoding is performed based on coding information parsed from the bitstream.

IPC Classes  ?

• H04N 19/436 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
• H04N 19/124 - Quantisation

Abstract

A user may want to share segments of content, such as video sequences of news reporting or sports events received from a service provider, SR, or content provider, CP, with the members of his social network using the user's social networking application. Therefore, a method is provided for sharing content that may include receiving a content segment by a Transmitter/Receiver Device, TRD. The TRD may transmit, to the SP/CP, a request for sharing the currently received content segment. The SP/CP may receive the request from the TRD and may prepare the content segment for sharing, for example by uploading it to a replay platform. The TRD may receive, from the SP/CP an indication that the content segment has been stored on the replay platform, including a locator to the content segment. The TRD may publish the locator in the user's social network application.

IPC Classes  ?

• H04N 21/472 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content
• H04N 21/845 - Structuring of content, e.g. decomposing content into time segments

Abstract

A method for controlling a display of a frame representing a state of a game in a network-based gaining application comprising: sending (301A) an information representative of a user action to a server; receiving (305B) at least one frame representing a predicted state of the game predicted from the user action; obtaining an information allowing determining if said at least one frame corresponds to the user action; and; if the at least one frame corresponds to said user action, determining when displaying one of the at least one frame in function of a time at which this user action was performed and of said information.

IPC Classes  ?

• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Abstract

A video coding system performs motion prediction based on epipolar geometry. A first camera corresponds to a current frame, a second camera corresponds to a reference frame and epipolar geometry is used to determine motion parameters allowing to perform a prediction between the reference frame and the current frame.

IPC Classes  ?

• H04N 19/517 - Processing of motion vectors by encoding
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Example embodiments include an optical system comprising a waveguide substrate. A diffractive coupler is associated with the waveguide substrate, the diffractive coupler comprising at least two diffraction gratings. Each of the diffraction gratings includes a first layer of grating elements and a second layer of grating elements, the first and second layers of grating elements being arranged in different planes. The first and second layers of grating elements each have a grating period associated with the respective diffraction grating, and the grating elements of the second layer have a lateral offset with respect to the grating elements of the first layer.

IPC Classes  ?

• F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
• G02B 27/01 - Head-up displays
• G02B 27/44 - Grating systemsZone plate systems
• G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
• G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
• G02B 5/18 - Diffracting gratings
• G02B 27/42 - Diffraction optics

Abstract

A method for reducing a latency in a gaming application comprising: obtaining (305B) a first frame, said first frame being representative of a first action performed by a user in the gaming application; obtaining (500) information representative of a second action performed by the user in the gaming application, said second action following the first action; and, predicting (500) a second frame corresponding to the second action from data comprising at least the first frame and the information representative of a second action using a neural network.

IPC Classes  ?

• A63F 13/358 - Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• A63F 13/67 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
• G06N 3/08 - Learning methods

Abstract

Systems and methods are described for mirroring content from a 2D display device to a 3D display device. Techniques are provided that include receiving information identifying a virtual 3D object and a first scale information, where the virtual 3D object is displayed on a 2D display device to a user using the first scale information. A second scale is then determined based on the first scale information, and a 3D representation of the virtual 3D object is displayed on a 3D display device using the second scale. Provided techniques further include receiving information identifying a first orientation information, where the virtual 3D object is further displayed using the first orientation information. A second orientation based on the first orientation information and based on a received user's location relative to the 3D display device is determined, and the 3D representation is further displayed using the second orientation.

IPC Classes  ?

• G06T 19/00 - Manipulating 3D models or images for computer graphics
• G06T 7/70 - Determining position or orientation of objects or cameras
• H04N 13/302 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• H04N 13/366 - Image reproducers using viewer tracking
• G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
• G06F 3/14 - Digital output to display device

Abstract

Asymmetric binary trees are used in combination with coding tools such as transform unit tiling, affine motion compensation, decoder side motion vector refinement, and bidirectional optical flow. In another embodiment asymmetric binary trees is used in combination with subblock temporal motion vector prediction. Embodiments enable tiling of coding blocks into subblocks in accordance with coding tools such as used in Versatile Video Coding.

IPC Classes  ?

• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/96 - Tree coding, e.g. quad-tree coding

Abstract

A method for video decoding is disclosed. A directional intra prediction mode is decoded for a block of a picture, the directional intra prediction mode having a direction. Based on the directional intra prediction mode, a first predictor and a second predictor for a sample in the current block are accessed, the first and second predictors being on a line at least approximating the direction. A sample value of the sample is predicted by interpolation using the first and second predictors, responsive to a difference between the second and first predictors, wherein the difference is scaled by at least a ratio that is based on a location of the sample in the block, and wherein a denominator of the ratio is a power of two regardless of the location of the sample. The sample of the block is reconstructed based on the predicted sample value.

IPC Classes  ?

• H04N 19/00 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Abstract

Video content frequently seen in gaming content and having a higher probability of being coded in transform skip mode is coded separately from remaining portions of a video coding block before being combined with regular coded portions. This enables more efficient coding of video by reducing the switching between regular coding modes and transform skip modes. The regular coded portion and the transform skip coded portion are combined in an encoder. At a corresponding decoder, inverse operations occur, such that the transform skipped residual portions are decoded and the regularly coded portions are decoded before the portions are combined for a resultant decoded video block.

IPC Classes  ?

• H04N 19/60 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/124 - Quantisation
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Methods are described herein for signaling information regarding different viewpoints in a multi-viewpoint omnidirectional media presentation. Techniques disclosed include receiving, from a server, information identifying groups of viewpoints, including information identifying a first group of viewpoints and a second group of viewpoints. And further receiving, from the server, information identifying one or more omnidirectional videos captured from respective viewpoints belonging to the first group and information identifying one or more omnidirectional videos captured from respective viewpoints belonging to the second group. Based on the received information identifying groups of viewpoints, the disclosed techniques include transitioning from a first omnidirectional video of the one or more omnidirectional videos captured from respective viewpoints belonging to the first group to a second omnidirectional video of the one or more omnidirectional videos captured from respective viewpoints belonging to the second group.

IPC Classes  ?

• H04N 13/178 - Metadata, e.g. disparity information
• H04N 13/183 - On-screen display [OSD] information, e.g. subtitles or menus

Abstract

Systems and methods are disclosed for video encoding and video decoding using decoder-side intra mode derivation (DIMD). Techniques are provided to code and to decode a video block of a video frame into a bitstream, including determining costs of using respective candidate intra prediction modes to predict samples in a template region adjacent to the video block, deriving an intra prediction mode based on candidates of the candidate intra prediction modes and their respective costs, and predicting samples in the current video block using the derived intra prediction mode. The provided techniques further include determining the costs in multiple stages. In an initial stage, the costs of using respective intra prediction modes from an initial set of candidate modes are determined. Then, in at least one subsequent stage, the costs of using respective intra prediction modes from a subsequent set of candidate modes are determined, where the subsequent set of candidate modes is selected based on the candidate mode in the previous stage having the lowest cost.

IPC Classes  ?

• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
• H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A method of controlling energy consumed by a multimedia streaming application executed in a multimedia streaming system, the method comprising: receiving (358), at an end-user device, a message including information representative of energy consumed by at least one node of the multimedia streaming system when applying at least one process on content having a first profile delivered by the multimedia streaming application prior to delivering the content having the first profile to the end-user device; and requesting (359), at the end-user device, content having a second profile based on the received information representative of the energy consumed by the at least one node.

IPC Classes  ?

• H04N 21/443 - OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 21/437 - Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server

Abstract

A method and an apparatus for decoding at least one part of at least one image is disclosed. The method comprises decoding at least one update parameter and modifying a deep neural network-based decoder based on said decoded update parameter. The method further comprises decoding at least one part of at least one image using at least said modified decoder.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

The purpose of the invention is a method for activating a mobile device in a network comprising at least one display device being coupled to a sensor. This method is characterised by the fact that it comprises: detecting the mobile device via the sensor coupled to the display device; displaying a device representative of the detected mobile device, called a virtual device, on the display device such that the position of the virtual device on the display screen is linked to the position of the mobile device in the capture field of the sensor; activating the mobile device in the network when a determined action is applied by the user to the mobile device. Another purpose of the invention is a display device and a system implementing the method.

IPC Classes  ?

• G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• H04L 67/02 - Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
• H04L 41/0806 - Configuration setting for initial configuration or provisioning, e.g. plug-and-play
• H04W 8/00 - Network data management
• G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06F 3/0346 - Pointing devices displaced or positioned by the userAccessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• H04L 67/51 - Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes for a current block are obtained. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights for a plurality of sub-blocks of the current block, wherein the combination with the corresponding weights comprising an inter prediction mode and an intra prediction mode.

IPC Classes  ?

• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A streaming device may request and download multi-layer video segments based on a number of factors including the artistic interest associated with the video segments and/or the status of a buffer area managed by the streaming device. The multi-layer segments may be coded using scalable coding techniques or a combination of scalable coding and simulcast coding techniques by which each of the video segments may be coded into one or more representations of different qualities and/or bitrates. When requesting the multi-layer segments, the streaming device may ensure that the fullness of the buffer area falls between a buffer underflow threshold and a backfilling threshold under various network conditions. The streaming device may estimate the available network bandwidth in order to facilitate the scheduling decisions. The streaming device may consider the artistic interest associated with the video segments during scheduling and may give priority to those segments with higher artistic interest.

IPC Classes  ?

• H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
• H04N 21/845 - Structuring of content, e.g. decomposing content into time segments

Abstract

Methods and apparatus are provided for unified significance map coding. An apparatus includes a video encoder (400) for encoding transform coefficients for at least a portion of a picture. The transform coefficients are obtained using a plurality of transforms. One or more context sharing maps are generated for the transform coefficients based on a unified rule. The one or more context sharing maps are for providing at least one context that is shared among at least some of the transform coefficients obtained from at least two different ones of the plurality of transforms.

IPC Classes  ?

• H03M 7/40 - Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
• H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCTSelection of sub-band transforms of varying structure or type
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/18 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
• H04N 19/64 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by ordering of coefficients or of bits for transmission
• H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

A method of performing intra prediction for encoding or decoding uses multiple layers of reference samples. The layers are formed into reference arrays that are used by a function, such as a weighted combination, to form a final prediction. The prediction is used in encoding or decoding a block of video data. The weights can be determined in a number of ways, and for a given prediction mode, the same weights, or different weights can be used for all pixels in a target block. If the weights are varied, they can depend on the distance of the target pixel from reference arrays.

IPC Classes  ?

• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/96 - Tree coding, e.g. quad-tree coding

Abstract

At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, an intra prediction of an image block and side information are determined using at least one neural network from a context comprising pixels surrounding the image block. The side information allows a decoder to determine the intra prediction and is signaled for the decoding.

IPC Classes  ?

• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

According to embodiments, an enhancement layer segment may be requested in addition to a base layer segment for a same video. The enhancement layer may be requested, in a low priority, so that the base layer may be delivered in priority. If the enhancement layer can be obtained by a deadline, a subsequent base layer segment may be requested at a higher quality (e.g., at a bitrate lower than or equal to the sum of the bitrates of the previously requested base layer and enhancement layer segments). If, for example, at a playback time, the enhancement layer segment is not obtained, it may be determined that the quality cannot be increased and subsequent requests for enhancement layer segments may be cancelled (e.g., not transmitted). According to embodiments, probing may repeat (e.g., any of immediately, regularly, periodically, . . . ) to detect available bandwidth variations.

IPC Classes  ?

• H04N 7/173 - Analogue secrecy systemsAnalogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
• H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• H04N 21/239 - Interfacing the upstream path of the transmission network, e.g. prioritizing client requests
• H04N 21/2662 - Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• H04N 21/4402 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
• H04N 21/845 - Structuring of content, e.g. decomposing content into time segments

Abstract

At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes are obtained for a current block. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights, wherein the combination with the corresponding weights comprising at least two inter prediction modes, or an inter prediction mode and an intra prediction mode. Both triangle prediction and multi-hypothesis prediction are allowed to be indicated in one or more lists of possible motion vector candidates, such as, e.g., in advanced motion vector prediction (AMVP) mode.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/107 - Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Selection of a content presentation can involve obtaining a message representative of a plurality of terms including a first term and a second term, wherein the first term indicates a first capability required for a first content presentation and the second term indicates a second capability required for a second content presentation; and enabling selection of a content presentation from among at least the first and second content presentations available based on a content signal, wherein the selection is based on the message.

IPC Classes  ?

• H04N 21/4402 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
• H04N 21/45 - Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies or resolving scheduling conflicts
• H04N 21/482 - End-user interface for program selection

Abstract

Systems and methods described herein provide for monitoring of video streaming events. Techniques disclosed include rendering a first omnidirectional video associated with a first viewpoint. In response to a request to access an omnidirectional video associated with another viewpoint, a time of the request and information identifying the other viewpoint is recorded. Techniques disclosed also include identifying a time of switching into rendering of a second omnidirectional video associated with a second viewpoint, and reporting a viewpoint switching latency, representing a difference between the identified switching time and a recorded request time associated with information identifying the second viewpoint.

IPC Classes  ?

• H04N 7/00 - Television systems
• H04N 17/04 - Diagnosis, testing or measuring for television systems or their details for receivers
• H04N 13/106 - Processing image signals
• H04N 13/194 - Transmission of image signals
• H04N 13/282 - Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• H04N 21/218 - Source of audio or video content, e.g. local disk arrays
• H04N 21/442 - Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed or the storage space available from the internal hard disk
• H04N 21/81 - Monomedia components thereof

Abstract

Apparatus, methods and systems associated with electronic devices can involve determining a plurality of available services providing content, wherein each service has an associated content format; determining an order of the plurality of available services, based on the content format of each service and a sequence of switching between the plurality of available services, to reduce a transition time when switching, based on the sequence, from a first one of the plurality of available services to a second one of the plurality of services different from the first one; generating, based on the order, a list of the plurality of available services representing a program guide, wherein the first and second services are adjacent in the program guide; and enabling, based on the program guide, switching from the first service to the second service.

IPC Classes  ?

• H04N 21/482 - End-user interface for program selection
• H04N 21/438 - Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
• H04N 21/45 - Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies or resolving scheduling conflicts

Abstract

For a bi-prediction block, the initial motion field can be refined using a DNN. In one implementation, the initial motion field is integer rounded to obtain initial prediction blocks. Based on the initial prediction, the DNN can generate motion refinement information, which is scaled and added to the sub-pel residual motion from the initial motion field to generate a refined motion field. The scaling factor can take a default value, or be based on the motion asymmetry. While the initial motion field is usually block based on sub-block based, the refined motion field is pixel based or sub-block based and can be at an arbitrary accuracy. The same refinement process is performed at both the encoder and decoder, and thus the motion refinement information need not to be signaled. Whether the refinement is enabled can be determined based on the initial motion, the block activities and the block size.

IPC Classes  ?

• H04N 19/51 - Motion estimation or motion compensation

Abstract

A user interface device including memory configured to store instructions and at least one hardware processor configured to execute the instructions to obtain, from at least one sensor, sensor data corresponding to a user gesture, determine a user interface gesture that matches the sensor data, obtain parameters for the determined interface gesture, and upon obtaining the parameters for the determined interface gesture, use the sensor data and the parameters for the determined interface gesture to estimate the user gesture in a user interface. Also provided is a method.

IPC Classes  ?

• G06V 40/20 - Movements or behaviour, e.g. gesture recognition
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

Methods and apparatus for implementing Discrete Trigonometric transforms are based on maximum transform size. In one embodiment, matrix-based intra prediction is enabled for coding unit sizes up to a specified size, regardless of the maximum transform size. In another embodiment, low-frequency non-separable transforms are used to improve coding gain. Syntax in a bitstream can be used to indicate a coding tool that is used.

IPC Classes  ?

• H04N 19/625 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A coding tool set enablement scheme allows one or more coding tools to be used in the encoding or decoding of video data based on one or more characteristics related to the video. In one embodiment, some coding tools are enabled for block sizes below a particular threshold. In another embodiment, a group of coding tools are enabled based on one flag for blocks having a particular characteristic. In another embodiment, these flags are included in a bitstream with the video. In another embodiment, at least one of the flags are inferred to enable some coding tools.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/46 - Embedding additional information in the video signal during the compression process

Abstract

A video coding system is provided that performs intra prediction in a mode using a neural network for block of only a set of specific block sizes. The signaling of this mode is designed to be efficient in terms of rate-distortion under this constraint. Different transformations of the context of a block and the neural network prediction of this block are introduced in order to use one single neural network for predicting blocks of several sizes, as well as the corresponding signaling. The neural network-based prediction mode considers both luminance blocks and chrominance blocks. The video coding system comprises encoder and decoder apparatuses, encoding, decoding and signal generation methods and a signal carrying information corresponding to the described coding mode.

IPC Classes  ?

• H04N 19/88 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/46 - Embedding additional information in the video signal during the compression process

Abstract

A system for user interaction comprising a display including a screen for displaying images, at least one hardware processor for receiving input from at least one sensor detecting at least a position of a user's fingertip in front of the display, the fingertip belonging to a finger extended in a direction of the screen, wherein the at least one hardware processor is configured to determine, from the input from the at least one sensor, an aim of the finger, display on the screen, on condition that the fingertip is in a first zone, at a position corresponding to the aim, an indicator, and select an object displayed in an image on the screen, the object located at the position on the screen corresponding to the aim, on condition that the fingertip is in a second zone, the second zone being closer to the screen than the first zone.

IPC Classes  ?

• G06F 17/00 - Digital computing or data processing equipment or methods, specially adapted for specific functions
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06F 3/04842 - Selection of displayed objects or displayed text elements
• G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The disclosure relates to a method for compression including codebook-based quantization of a data set and corresponding decompression method, signal; bitstream, and encoder and/or decoder device.

IPC Classes  ?

• H04N 19/124 - Quantisation
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/94 - Vector quantisation
• H04N 19/46 - Embedding additional information in the video signal during the compression process

Abstract

Systems and methods are described for providing viewers of streamed video content with the option to view alternative video content in which alternative tone maps are applied to respective regions of interest. In some embodiments, the streamed video content is divided into slices, and alternative tone maps are applied to respective regions of interest within the slices. When a server receives a request from a client for alternative tone mappings of different regions, slices with the appropriate mapping may be assembled on demand and delivered to the client in a single video stream. Tone mappings may be used, for example, to highlight particular objects, such as players in a sporting event captured in the streamed video content.

IPC Classes  ?

• H04N 19/20 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
• H04N 19/115 - Selection of the code volume for a coding unit prior to coding
• H04N 19/162 - User input
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• H04N 21/4728 - End-user interface for requesting content, additional data or servicesEnd-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content for selecting a ROI [Region Of Interest], e.g. for requesting a higher resolution version of a selected region

Abstract

The disclosure relates, according to a first aspect, to a method for compressing data including encoding at least one information representative of a use, during the compression, of a compressed sparse format. The disclosure relates, according to a second aspect, to a method for decompressing input data comprising obtaining information representative of zero or non-zero values in at least a part of the input data, and using only the non-zero values of the zero or non-zero values for a further processing of the part of the input data, based on the representative information. Corresponding devices, system, non-transitory program product, computer storage medium and signal are also disclosed.

IPC Classes  ?

• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream

Abstract

There is provided intra predicting of an image block using at least one neural network from a context comprising pixel surrounding said image block. Said intra predicting also uses an information to distinguish the missing pixels from the available pixels in the context. There are also provided encoding/decoding methods and apparatus, a device, a non-transitory computer readable medium and a computer program product.

IPC Classes  ?

• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

An iterative training of neural networks for video coding and decoding using intra prediction is provided that finds a tradeoff between an extreme genericity and an extreme specialization to a codec for the trained neural networks. At the first iteration, the set of neural networks is trained following a partitioning approach. Then, for several iterations, the set of neural networks is inserted into the codec, and pairs of a block and its context are extracted from the partitioning of images via the codec with a single additional neural network-based mode then, the neural networks are retrained on these pairs. This way, from the second iteration, the neural networks learn an intra prediction diverging from that in the codec while still being valuable for the codec in terms of rate-distortion performance.

IPC Classes  ?

• G06N 3/08 - Learning methods
• H04N 19/436 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/192 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• G06N 3/04 - Architecture, e.g. interconnection topology

Abstract

Systems and methods are described for displaying 360-degree video using a viewing direction and/or a viewpoint position that is determined based on a user-selected level of automation. If full automation is selected by the user, the viewing direction and/or viewport position is determined by a defined viewing path. If partial automation is selected, the viewing direction and/or viewport position is determined by user input in combination with the defined viewing path. For example, a high-pass-filtered version of the user input may be added to the defined viewing path to obtain a partially-automated viewing direction and/or viewpoint position. Example systems and methods may be implemented using a head-mounted display

IPC Classes  ?

• H04N 21/81 - Monomedia components thereof
• G06F 16/787 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
• G02B 27/01 - Head-up displays
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06T 19/00 - Manipulating 3D models or images for computer graphics
• H04N 21/2668 - Creating a channel for a dedicated end-user group, e.g. by inserting targeted commercials into a video stream based on end-user profiles
• H04N 21/6587 - Control parameters, e.g. trick play commands or viewpoint selection

Abstract

In one implementation, a picture is partitioned into multiple blocks, with uniform or different block sizes. Each block is compressed by an auto-encoder, which may comprise a deep neural network and entropy encoder. The compressed block may be reconstructed or decoded with another deep neural network. Quantization may be used in the encoder side, and de-quantization at the decoder side. When the block is encoded, neighboring blocks may be used as causal information. Latent information can also be used as input to a layer at the encoder or decoder. Vertical and horizontal position information can further be used to encode and decode the image block. A secondary network can be applied to the position information before it is used as input to a layer of the neural network at the encoder or decoder. To reduce blocking artifact, the block may be extended before being input to the encoder.

IPC Classes  ?

• H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a plurality of frames is provided to a motion estimator to produce an output comprising estimated motion information. The estimated motion information is provided to an auto-encoder or an auto-decoder to produce an output comprising reconstructed motion field. The reconstructed motion field and one or more decoded frames of the plurality of frames are provided to a deep neural network to produce an output comprising refined bi-directional motion field. The video is encoded or decoded based on the refined bi-directional motion field.

IPC Classes  ?

• H04N 19/436 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
• H04N 19/543 - Motion estimation other than block-based using regions
• H04N 19/573 - Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Abstract

Described herein are systems, methods, and instrumentalities associated with video coding. The signaling of certain syntax elements may be moved from a slice header to a picture header and/or a layer access unit delimiter (AUD). The dependency between AUD and one or more parameter sets may be explored. Syntax elements may be signaled to enable wrap-around motion compensation for certain sub-picture(s) and specify wrap-around motion compensation offsets for the sub-picture(s).

IPC Classes  ?

• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Encoding or decoding picture information can involve determining a coding mode associated with a current coding unit including picture information; determining, based on the coding mode, a first precision level associated with a first portion of a motion vector information associated with the current coding unit, and a second precision level associated with a second portion of the motion vector information; obtaining a motion vector associated with the current coding unit based on the motion vector information and the first and second precision levels; and encoding or decoding at least a portion of the picture information included in the current coding unit based on the coding mode and the motion vector.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/513 - Processing of motion vectors

Abstract

A method for coding/decoding a large field of view video into a bitstream in an immersive rendering system is disclosed. At least one picture of said large field of view video is represented as a surface, said surface being projected onto at least one 2D picture using a projection function. For at least one current block of said at least one 2D picture, at least one item of information representative of a modification of a 2D spatial neighborhood is determined according to said projection function. A group of neighboring blocks using said at least on item of information representative of a modification is determined and at least one part of encoding/decoding of said current block is performed using said determined group of neighboring blocks.

IPC Classes  ?

• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

Encoding or decoding picture information can involve determining a first scaling factor varying with a first granularity to scale a chroma prediction residual associated with chroma information included in the picture information; determining a second scaling factor varying with a second granularity finer than the first granularity; scaling the chroma prediction residual based on a combination of the first scaling factor and the second scaling factor to provide a scaled chroma prediction residual with the second granularity; and encoding or decoding at least a portion of the picture information based on the scaled chroma prediction residual.

IPC Classes  ?

• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A streaming device may request and download multi-layer video segments based on a number of factors including the artistic interest associated with the video segments and/or the status of a buffer area managed by the streaming device. The multi-layer segments may be coded using scalable coding techniques or a combination of scalable coding and simulcast coding techniques by which each of the video segments may be coded into one or more representations of different qualities and/or bitrates. When requesting the multi-layer segments, the streaming device may ensure that the fullness of the buffer area falls between a buffer underflow threshold and a backfilling threshold under various network conditions. The streaming device may estimate the available network bandwidth in order to facilitate the scheduling decisions. The streaming device may consider the artistic interest associated with the video segments during scheduling and may give priority to those segments with higher artistic interest.

IPC Classes  ?

• H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
• H04N 21/845 - Structuring of content, e.g. decomposing content into time segments

Abstract

Systems, methods, and instrumentalities are disclosed that relate to the processing of a media container file associated with 3D video data. The media container file may indicate that certain video-based point cloud compression (V-PCC) component tracks may be played together as a playout group. These V-PCG component tracks may represent respective encoded versions of one or more V-PCC components, and a video decoding device may play the tracks together in response to determining that the tracks belong to the same playout track group. The video decoding device may also determine from the media container file that certain PCC component tracks include tile groups that correspond to different objects in a point cloud or different parts of a same object in the point cloud. The video decoding device may decode these tile groups independently from each other so that a subset of the objects or parts of the point cloud may be accessed without also accessing the rest of the objects or parts.

IPC Classes  ?

• H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
• H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
• H04N 21/854 - Content authoring

Abstract

Cross plane filtering may be used for enhanced chroma coding. An indication of a cross-plane filter associated with a current picture may be received. The current picture may include an intra-coded video block and a plurality of reference samples. The plurality of reference samples may be used to predict the intra-coded video block. A luma sample region may be determined in the current picture. The luma sample region may determined to enhance a corresponding chroma sample in the current picture. The cross-plane filter may be applied to a plurality of luma samples in the luma sample region to determine an offset. The cross-plane filter may be a high pass filter. The offset may be applied to the corresponding chroma sample to determine an enhanced chroma sample.

IPC Classes  ?

• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• H04N 19/467 - Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
• H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction

Abstract

At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, one or more chroma residual scaling parameters are determined based one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters. The video is encoded or decoded based on the determined one or more chroma residual scaling parameters.

IPC Classes  ?

• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/65 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
• H04N 19/36 - Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability

Abstract

To encode a picture, a coding tree unit (CTU) in the picture is partitioned by a quadtree structure, and the quadtree leaf nodes can be further partitioned by a multi-type tree (MTT) structure. To increase the set of reachable coding tree nodes and leaves, we propose to increase the maximum allowed MTT hierarchy depth to be twice the difference between the CTU size and the minimum allowed size for a CU. The maximum allowed MTT hierarchy depth can be specified for all QT levels in order to provide more flexibility in the split tree. Alternatively, only two levels of maximum allowed MTT depth are signaled: one when QT splits are allowed, and another one when no more QT splits are allowed. In addition, an upper bound can be set for the minimum allowed coding block size, based on the coding tree unit size or the maximum allowed transform size.

IPC Classes  ?

• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/96 - Tree coding, e.g. quad-tree coding

Abstract

Some embodiments of an apparatus may include: a tracking module configured to track viewer movement adjustments; and a light field image display structure configured to display a light field image using the viewer movement adjustments. Some embodiments of a method may include: projecting a beam spot on a viewer of a light field display; determining an estimated location of the beam spot reflected off the viewer; detecting an actual location of the beam spot reflected off the viewer; and determining image correction parameters based on a comparison of the estimated location and the actual location of the beam spot reflected off the viewer.

IPC Classes  ?

• H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
• G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
• H04N 13/317 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using slanted parallax optics
• H04N 13/368 - Image reproducers using viewer tracking for two or more viewers
• H04N 13/373 - Image reproducers using viewer tracking for tracking forward-backward translational head movements, i.e. longitudinal movements
• H04N 13/00 - Stereoscopic video systemsMulti-view video systemsDetails thereof

Abstract

An example disclosed method includes (i) transmitting a first point cloud to a client, wherein the first point cloud corresponds to a reference point cloud, (ii) receiving a second point cloud, and (iii) hierarchically determining changes in the second point cloud from the reference point cloud, wherein hierarchically determining the changes includes (a) identifying first areas in the second point cloud that have changed from the reference point cloud, and (b) for a first area having a highest priority, determining a first rigid 3D transformation that approximates a first change from the reference point cloud, and if the first rigid 3D transformation cannot be determined, further determining first points to be used to modify the reference point cloud, wherein the first points are representative of the first change.

IPC Classes  ?

• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• G06T 7/33 - Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
• G06T 7/38 - Registration of image sequences

Abstract

Systems and methods are described for providing a 3D display, such as a light-field display. In some embodiments, a display device includes a light-emitting layer comprising an addressable array of light-emitting elements. An optical layer overlays the light-emitting layer. The optical layer includes a plurality of distributed lenses. In some embodiments, the distributed lenses include non-contiguous lens regions. In some embodiments, distributed lens regions with different optical centers are interlaced with one another. A spatial light modulator is operative to provide control over which lens regions transmit light from the light-emitting layer outside the display device. In some embodiments, the use of interlaced and/or non-contiguous distributed lenses provides improved display resolution with a reduction in diffraction effects.

IPC Classes  ?

• H04N 13/305 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
• H04N 13/366 - Image reproducers using viewer tracking

Abstract

Embodiments include 3D display devices and methods of operation. In an example device, a light-emitting layer is provided with an addressable array of light-emitting elements. An optical layer overlays the light-emitting layer. The optical layer includes an array of lenses operative to substantially collimate light from the light-emitting layer. To suppress stay light, an angular filter layer is provided along an optical path from the light-emitting layer to an exterior of the display. The angular filter is operative to substantially block light having an incident angle greater than a threshold angle and to substantially transmit light having an incident angle less than a threshold angle. The angular filter may be a thin-film interference bandpass filter. Different regions of the angular filter may be tuned for different wavelengths of light.

IPC Classes  ?

• G02B 5/28 - Interference filters
• G02B 27/30 - Collimators
• G02B 27/42 - Diffraction optics
• G02B 27/46 - Systems using spatial filters
• G02B 30/27 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays
• H04N 13/305 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses

Abstract

Methods and apparatuses for video coding and decoding are provided. The method includes deriving one or more illumination compensation parameters based on neighboring samples of a sub-block of a block and neighboring samples of a motion-compensated reference sub-block; deriving a prediction sub-block by applying on the motion-compensated reference sub-block an illumination compensation using the one or more derived illumination compensation parameters. A computer-readable storage medium and a computer program product are also described.

IPC Classes  ?

• H04N 19/513 - Processing of motion vectors
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Cross-plane filtering may be used to restore blurred edges and/or textures in one or both chroma planes using information from a corresponding luma plane. Adaptive cross-plane filters may be implemented. Cross-plane filter coefficients may be quantized and/or signaled such that overhead in a bitstream minimizes performance degradation. Cross-plane filtering may be applied to select regions of a video image (e.g., to edge areas). Cross-plane filters may be implemented in single-layer video coding systems and/or multi-layer video coding systems.

IPC Classes  ?

• H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Some embodiments of an example apparatus may include a display, a first controllable diffuser overlaying the display, the first controllable diffuser being selectively operable to diffuse light in a first diffusion direction, and a second controllable diffuser overlaying the display, the second controllable diffuser being selectively operable to diffuse light in a second diffusion direction substantially perpendicular to the first diffusion direction. In some embodiments, an example method may include emitting a light beam from a light emitting device; linearly polarizing the light beam; passing the light beam through LC and birefringent materials; and applying a voltage to alter polarization of the LC material, from a first state causing the light to diffuse in a first direction upon passing through the birefringent material, to a second state causing the light beam to diffuse in a second direction upon passing through the birefringent material.

IPC Classes  ?

• H04N 13/307 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using fly-eye lenses, e.g. arrangements of circular lenses
• G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
• H04N 13/315 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant

Abstract

Different implementations are described, particularly implementations for video encoding and decoding based on linear weighted intra prediction, also called matrix based intra prediction, are presented. Accordingly, the encoding or decoding comprises obtaining intra predicted samples of a block from a selected weight matrix and associated bias and from a set of neighboring reference samples; wherein any coefficient of the selected weight matrix is a power of two. According to relaxed version, not all but only a part of the coefficients of the selected weight matrix is a power of two. Advantageously, such arrangement allows to reduce the amount of memory for storing data and to reduce the complexity of the intra prediction samples computation.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

According to an embodiment, a first device may receive from a second device a message comprising an authentication element and credentials associating the second device with a user identifier. The first device may obtain a set of features based on data captured by a sensor of the first device when a user is near the sensor. The first device may associate the second device with the first device on a condition that is it determined by the first device that the authentication element is verified based on a verification element, that the credentials correspond to initial credentials associating the second device with the user identifier, and that the set of features matches an initial set of features, wherein the verification element, the initial credentials and the initial set of features may have been initially associated together in the first device.

IPC Classes  ?

• H04N 21/258 - Client or end-user data management, e.g. managing client capabilities, user preferences or demographics or processing of multiple end-users preferences to derive collaborative data
• H04N 21/4415 - Acquiring end-user identification using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
• H04N 21/422 - Input-only peripherals, e.g. global positioning system [GPS]
• H04N 21/442 - Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed or the storage space available from the internal hard disk
• H04N 21/4223 - Cameras

Abstract

In situations where a receiver, rendering a content, switches from a first transport stream carrying that content to a second transport stream carrying that same content, artefacts may occur on the rendered content while transitioning between both transport streams. Considering transport stream data of a transport stream signal may be available at a nominal frequency higher than a frequency corresponding to the transport stream bitrate, there may be some periods of time during which no data is present in the transport stream signal. A salient idea is to switch from the first transport stream signal to the second transport stream signal in such periods during which there is no transport stream valid data in the first transport stream signal, allowing to minimize the risks of perceptible defects in the rendered content throughout the switching.

IPC Classes  ?

• H04N 21/438 - Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
• H04N 21/426 - Internal components of the client

Abstract

Different implementations are described, particularly implementations for video encoding and decoding based on linear weighted intra prediction, also called matrix based intra prediction, are presented. Accordingly, for a block being encoded or decoded in linear weighted intra prediction, obtaining intra predicted samples from at least two matrix-vector products between at least two selected weight matrices of reduced size and a set of neighboring reference samples. Advantageously, such arrangement allows to reduce the amount of memory for storing data and to reduce the complexity of the intra prediction samples computation.

IPC Classes  ?

• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Methods and apparatuses of providing and receiving audio content are described. The method of providing audio content includes receiving a first audio content from a first user, processing the first audio content based on a first viewing direction for the first user facing at least one section of an audiovisual content and on a second viewing direction for a second user facing at least one section of the audiovisual content, and providing the processed first audio content. The audiovisual content may be an immersive reality content. A computer-readable storage medium, computer program and a non-transitory article of manufacture are described.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control
• G06F 3/16 - Sound inputSound output

Abstract

Some embodiments of an example method disclosed herein may include receiving point cloud data representing one or more three-dimensional objects; receiving a viewpoint of the point cloud data; selecting a selected object from the one or more three-dimensional objects using the viewpoint; retrieving a neural network model for the selected object; generating a level of detail data for the selected object using the neural network model; and replacing, within the point cloud data, points corresponding to the selected object with the level of detail data.

IPC Classes  ?

• G06T 15/20 - Perspective computation
• H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• G02B 27/01 - Head-up displays
• G06N 3/08 - Learning methods
• G06T 19/00 - Manipulating 3D models or images for computer graphics

Abstract

A light-emitting layer of an apparatus includes an addressable array of light-emitting elements including a first light-emitting element and a periodic optical layer overlaying the light-emitting layer. The periodic optical layer includes at least a first periodic optical feature having a first optical power and a second periodic optical feature having a different optical power. A first controllable light-steering layer is disposed between the light-emitting layer and the periodic optical layer. The first controllable light-steering layer is switchable between directing light from the first light-emitting element through the first periodic optical feature and directing light from the first light-emitting element through the second periodic optical feature.

IPC Classes  ?

• G02B 30/10 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images using integral imaging methods
• G02B 30/50 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
• G02B 30/27 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays
• G02F 1/29 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulatingNon-linear optics for the control of the position or the direction of light beams, i.e. deflection
• G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
• G02B 3/00 - Simple or compound lenses
• G02B 30/29 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving lenticular arrays characterised by the geometry of the lenticular array, e.g. slanted arrays, irregular arrays or arrays of varying shape or size
• G02B 30/33 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type involving directional light or back-light sources
• G02B 30/26 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the autostereoscopic type

Abstract

Methods and apparatus are provided for unified significance map coding. An apparatus includes a video encoder (400) for encoding transform coefficients for at least a portion of a picture. The transform coefficients are obtained using a plurality of transforms. One or more context sharing maps are generated for the transform coefficients based on a unified rule. The one or more context sharing maps are for providing at least one context that is shared among at least some of the transform coefficients obtained from at least two different ones of the plurality of transforms.

IPC Classes  ?

• H03M 7/40 - Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCTSelection of sub-band transforms of varying structure or type
• H04N 19/18 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
• H04N 19/64 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by ordering of coefficients or of bits for transmission

Abstract

The disclosure relates to a method, implemented in an electronic device adapted to be configured in a mono user mode, where the electronic device is controlled by input elements obtained from a single tracked user, and in a multi-user mode where the electronic device is controlled by input elements obtained from a group or one or more tracked users, the method comprising: —tracking actions of one or more user (s) selected amongst candidate users according to a current mode of the electronic device, and to selection requests of the candidate users, the selection requests being captured by at least one sensor coupled to said electronic device; —determining at least one input element adapted for controlling the electronic device according to the tracked actions. It also relates to corresponding device, electronic assembly, system, computer readable program product and storage medium.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer