Methods and systems for optimising the quality of visual data. Specifically, methods and systems for preserving visual information during compression and decompression. An example method for optimising visual data includes using a pre-processing neural network to optimise visual data prior to encoding the visual data in visual data processing; and using a post-processing neural network to enhance visual data following decoding visual data in visual data processing.
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
H04N 19/17 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
The present disclosure relates to encoding visual data comprising a plurality of layers using one or more hierarchical algorithms. According to an aspect, there is provided a method of encoding visual data using a plurality of layers wherein each layer encodes a different representation, and wherein one or more of the plurality of layers comprises one or more hierarchical algorithms, the method comprising the steps of: extracting one or more samples within each of the plurality of layers; and processing within each layer the one or more samples extracted in the layer; wherein in at least one of the plurality of layers the step of processing comprises applying the one or more hierarchical algorithms to the samples extracted in the layer in relation to any inter-layer prediction; and wherein the step of processing reduces a predetermined mathematical distortion between samples of a first layer and samples of a second layer.
H04N 19/87 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
H04N 19/149 - Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
H04N 19/31 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/103 - Selection of coding mode or of prediction mode
Generating texture maps for use in rendering visual output. According to a first aspect, there is provided a method for generating textures for use in rendering visual output, the method comprising the steps of: generating, using a first hierarchical algorithm, a first texture from one or more sets of initialisation data; and selectively refining the first texture, using one or more further hierarchical algorithms, to generate one or more further textures from at least a section of the first texture and one or more sets of further initialisation data; wherein at least a section of each of the one or more further textures differs from the first texture.
The present disclosure relates to the use of hierarchical algorithms to temporally interpolate enhanced reference pictures for use in video encoding and decoding. According to a first aspect, there is provided a method of generating enhanced reference pictures in a video encoding and/or decoding process, the method comprising: receiving one or more known reference elements of video data from a reference picture buffer; generating, using one or more hierarchical algorithms, one or more additional reference elements of video data from the one or more known reference elements of video data; and outputting the one or more additional reference elements of video data; wherein the generating the one or more additional reference elements of video data from the one or more known reference elements of video data comprises the use of temporal interpolation.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/31 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
H04N 19/587 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
Systems and methods for developing improved-fidelity visual data using fidelity data and using a hierarchical algorithm are provided. An example method includes receiving at least a plurality of neighbouring sections of visual data, selecting a plurality of input sections from the received plurality of neighbouring sections of visual data, extracting features from the plurality of input sections of visual data, and producing the improved-fidelity visual data by applying the fidelity data to the extracted features.
A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/36 - Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/142 - Detection of scene cut or scene change
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/31 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
G06N 3/04 - Architecture, e.g. interconnection topology
G06K 9/62 - Methods or arrangements for recognition using electronic means
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
G06K 9/46 - Extraction of features or characteristics of the image
H04N 19/87 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/36 - Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/142 - Detection of scene cut or scene change
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/31 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
G06N 3/04 - Architecture, e.g. interconnection topology
G06K 9/62 - Methods or arrangements for recognition using electronic means
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
G06K 9/46 - Extraction of features or characteristics of the image
H04N 19/87 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
The present invention relates to generating texture maps for use in rendering visual output. According to a first aspect, there is provided a method for generating textures for use in rendering visual output, the method comprising the steps of: generating, using a first hierarchical algorithm, a first texture from one or more sets of initialisation data; and selectively refining the first texture, using one or more further hierarchical algorithms, to generate one or more further textures from at least a section of the first texture and one or more sets of further initialisation data; wherein at least a section of each of the one or more further textures differs from the first texture.
The present invention relates to a method for developing visual data using source data, target data, and a hierarchical algorithm. According to a first aspect, there is provided a method for developing visual data from source data, target data and using a hierarchical algorithm, the method comprising the steps of: determining an alignment between the target data and the source data; and producing the visual data by transferring one or more features of the source data onto one or more features of the target data; wherein, the visual data is produced after the step of determining the alignment between the target data and the source data; and wherein the visual data is produced using the hierarchical algorithm.
The present invention relates to a method for encoding visual data comprising a plurality of layers using one or more hierarchical algorithms. According to an aspect of the invention, there is provided a method of encoding visual data using a plurality of layers wherein each layer encodes a different representation, and wherein one or more of the plurality of layers comprises one or more hierarchical algorithms, the method comprising the steps of: extracting one or more samples within each of the plurality of layers; and processing within each layer the one or more samples extracted in the layer; wherein in at least one of the plurality of layers the step of processing comprises applying the one or more hierarchical algorithms to the samples extracted in the layer in relation to any inter-layer prediction; and wherein the step of processing reduces a predetermined mathematical distortion between samples of a first layer and samples of a second layer.
H04N 19/149 - Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
H04N 19/103 - Selection of coding mode or of prediction mode
H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
H04N 19/31 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
The present invention relates to a method for analysing input data, prior to encoding, using one or more hierarchical algorithms. According to a first aspect, there is provided a method for producing output data using one or more input data and one or more hierarchical algorithms, comprising the steps of applying the hierarchical algorithm to the one or more input data; and producing output data to be used by an encoder; wherein one of the one or more input data is uncompressed; and wherein the output data is used to modify a decision making process associated with the encoder.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
H04N 19/149 - Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
H04N 19/103 - Selection of coding mode or of prediction mode
H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
The present invention relates to the use of machine learning to improve motion estimation in video encoding. According to a first aspect, there is provided a method for estimating the motion between pictures of video data using a hierarchical algorithm, the method comprising steps of: receiving one or more input pictures of video data; identifying, using a hierarchical algorithm, one or more reference elements in one or more reference pictures of video data that are similar to one or more input elements in the one or more input pictures of video data; determining an estimated motion vector relating the identified one or more reference elements to the one or more input elements; and outputting an estimated motion vector.
The present invention relates to an enhanced in-loop filter for an encoding or decoding process. According to an aspect of the invention, there is provided method of post filtering video data in an encoding and/or decoding process using hierarchical algorithms, the method comprising steps of: receiving one or more input pictures of video data; transforming, using one or more hierarchical algorithms, the one or more input pictures of video data to one or more pictures of transformed video data; and outputting the one or more transformed pictures of video data; wherein the transformed pictures of video data are enhanced for use within the encoding and/or decoding loop and wherein the method is performed in-loop within the encoding and/or decoding process.
H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
The present invention relates to the use of hierarchical algorithms to temporally interpolate enhanced reference pictures for use in video encoding and decoding. According to a first aspect, there is provided a method of generating enhanced reference pictures in a video encoding and/or decoding process, the method comprising the steps of: receiving one or more known reference elements of video data from a reference picture buffer; generating, using one or more hierarchical algorithms, one or more additional reference elements of video data from the one or more known reference elements of video data; and outputting the one or more additional reference elements of video data; wherein the step of generating the one or more additional reference elements of video data from the one or more known reference elements of video data comprises the use of temporal interpolation.
H04N 19/587 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
The present invention relates to a method for processing input visual data using a generated algorithm based upon input visual data and the output of a calculated energy function. According to a first aspect of the invention, there is provided a method for enhancing input visual data using an algorithm, the method comprising the steps of: evaluating gradients of the output of an energy function with respect to the input visual data; using the gradient output to enhance the input visual data; and outputting the enhanced visual data.
A method for developing improved-fidelity visual data using fidelity data and using a hierarchical algorithm, the method comprising the steps of: receiving at least a plurality of neighbouring sections of visual data; selecting a plurality of input sections from the received plurality of neighbouring sections of visual data; extracting features from the plurality of input sections of visual data; and producing the improved-fidelity visual data by applying the fidelity data to the extracted features.
A method for training an algorithm to process at least a section of received visual data using a training dataset and reference dataset. The method comprises an iterative method with each iteration comprising the steps of: generating a set of training data using the algorithm; comparing one or more characteristics of the training data to one or more characteristics of at least a section of the reference dataset; and modifying one or more parameters of the algorithm to optimise processed visual data based on the comparison between the characteristic of the training data and the characteristic of the reference dataset. The algorithm may output the processed visual data with the same content as the at least a section of received visual data. Some aspects and/or embodiments provide for improved super-resolution of lower quality images, with a view to producing super-resolution images which have improved characteristics (e.g. less blur, less undesired smoothing) compared to other super-resolution techniques.
The present invention relates to methods and systems to optimise the quality of visual data. Specifically, the present invention relates to methods and systems to preserve visual information during compression and decompression. Certain aspects and/or embodiments seek to provide a method for optimising visual data, the method comprising the steps of using a pre-processing hierarchical algorithm to optimise visual data prior to encoding the visual data in visual data processing; and using a post-processing hierarchical algorithm to enhance visual data following decoding visual data in visual data processing.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/17 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
The present invention relates to a method for training a plurality of visual processing algorithms for processing visual data. Thee method comprising the steps of using a pre-processing hierarchical algorithm to process the visual data prior to encoding the visual data in visual data processing, and using a post-processing hierarchical algorithm to further process the visual data following decoding visual data in visual data processing. The steps of steps of encoding and decoding are performed with respect to a predetermined visual data codec and in some embodiments may be content specific.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/142 - Detection of scene cut or scene change
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/19 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprising the steps of: reducing the quality of one or more sections of higher-quality visual data to one or more sections of lower-quality visual data; developing at least one hierarchical algorithm operable to increase the quality of the one or more sections of lower quality visual data using the one or more sections of higher-quality visual data to enhance the developed at least one hierarchical algorithm. The developed at least one hierarchical algorithm corresponds to the one or more sections of lower quality visual data; transmitting the one or more sections of lower-quality visual data to the second node. The at least one of the developed at least one hierarchical algorithms that corresponds to the one or more sections of lower-quality visual data transmitted to the second node are communicated to the second node. The second node is able to substantially reproduce the one or more sections of higher-quality visual data from the transmitted one or more sections of lower-quality visual data using the developed at least hierarchical algorithm that corresponds to the one or more sections of lower-quality visual data.
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower- quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower- quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
24.
VISUAL PROCESSING USING TEMPORAL AND SPATIAL INTERPOLATION
A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprising receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.
H04N 19/46 - Embedding additional information in the video signal during the compression process
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.
H04N 19/46 - Embedding additional information in the video signal during the compression process
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/142 - Detection of scene cut or scene change
27.
ENHANCING VISUAL DATA USING AND AUGMENTING MODEL LIBRARIES
A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprises developing at least one modified hierarchical algorithm from a known hierarchical algorithm operable to substantially recreate at least one section of higher-quality visual data. References to one or more known hierarchical algorithms from which the modified hierarchical algorithms were developed are transmitted to the second node along with one or more modifications to the one or more known hierarchical algorithms operable to reproduce the one or more modified hierarchical algorithms from the known hierarchical algorithms. The second node is able to recreate substantially the higher-quality video using the modified hierarchical algorithm.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower- quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher- quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.
H04N 19/46 - Embedding additional information in the video signal during the compression process
G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
H04N 19/142 - Detection of scene cut or scene change
A method for developing an enhancement model for visual data, the method comprising the steps of: receiving one or more sections of higher-quality visual data and one or more sections of lower-quality visual data corresponding to the one or more sections of higher-quality data. A hierarchical algorithm is then developed, wherein the hierarchical algorithm is operable to substantially reproduce the one or more sections of higher- quality visual data from the corresponding one or more sections of lower-quality visual data. The developed hierarchical algorithm is then stored in a library of developed hierarchical algorithms.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
patents
