Abstract

A computer-implemented method for processing 3D audio, the method comprising: there is provided a computer-implemented method for processing 3D audio, the method comprising: obtaining a first ambisonic signal representing a sound; and upmixing the first ambisonic signal to derive a second ambisonic signal representing the sound; wherein the second ambisonic signal is a higher quality representation of the sound than the first ambisonic signal. This reduces the storage and processing requirements of providing high quality 3D audio.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• G10L 19/008 - Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• H04S 5/00 - Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation

Abstract

Disclosed herein is a computer-implemented method for generating reverb on an audio signal in a video game environment during gameplay. The method comprises receiving data from a virtual camera arranged in the video game environment during gameplay. The method also comprises processing the virtual camera data to determine one or more features of the video game environment that influence the reverb on an audio signal within the video game environment. The method further comprises generating reverb on an audio signal based on the one or more features of the video game environment.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/5252 - Changing parameters of virtual cameras using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game

Abstract

A computer-implemented method for outputting a sound effect during video game gameplay is disclosed. The method comprises the steps of: determining a sound effect to be output; retrieving a source sound and a sound-editing operator from a memory device, wherein the sound-editing operator comprises an edit that, when applied to the source sound, generates the sound effect to be output; applying the sound-editing operator to the source sound to generate the sound effect to be output; and outputting the sound effect.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• G11B 27/031 - Electronic editing of digitised analogue information signals, e.g. audio or video signals

Abstract

A computer-implemented method for generating an animation for a gameplay event during gameplay, the method comprising: determining a gameplay event during gameplay; determining an audio signal, wherein the audio signal corresponds to the gameplay event; determining an audio property of the audio signal; generating an animation for the gameplay event based on the determined audio property of the audio signal; and outputting the audio signal and generated animation. This generates animations for gameplay events with a reduced usage of processing and memory resources.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/57 - Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game

Abstract

A computer-implemented method of generating a sound effect for a video game. The method comprises: receiving a first sound effect file comprising one or more sound effect features; receiving a first animation representing an action in the video game; determining, based on the received animation, one or more constraints to be applied to the or each sound effect features; adjusting the or each sound effect feature so as to produce corresponding adjusted sound effect features satisfying the determined constraints; and generating a second sound effect file comprising the adjusted sound effect features.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/55 - Controlling game characters or game objects based on the game progress

Abstract

A computer-implemented method for generating a rendered image of a three-dimensional object. A meta-storage component is used, that contains at least two pre-constructed grids of three-dimensional data grid points corresponding to features of three-dimensional visual representations of a plurality objects or scenes. A selection code is received, that represents the shape and appearance of the three-dimensional object. An instantiation of the three- dimensional object is constructed, using a selector component, by querying the meta storage component using the selection code to retrieve at least one combination of at least two pre- constructed grids of three-dimensional data grid points from the meta-storage component. A rendered image of the three-dimensional object is then generated using the instantiation of the three-dimensional object.

IPC Classes  ?

• G06T 15/20 - Perspective computation
• G06T 17/00 - 3D modelling for computer graphics

Abstract

Data representing a 3D object to be rendered is obtained, the data comprising: a mesh structure defining 3D co-ordinates for each of a plurality of object vertices; and a feature vector encoding visual characteristics for at least one object surface defined by the plurality of object vertices. Motion information indicative of motion of the object in a scene is received. Based on the motion information, the mesh structure is deformed by adjusting the co-ordinates for one or more of the plurality of object vertices. The deformed mesh structure is processed using a graphics pipeline comprising a vertex shader and a fragment shader to generate a rendered image of the scene. The fragment shader comprises an artificial neural network trained to output pixel colour values for the at least one object surface on the basis of the visual characteristics encoded in the feature vector.

IPC Classes  ?

• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• G06T 15/04 - Texture mapping
• G06T 17/20 - Wire-frame description, e.g. polygonalisation or tessellation

Abstract

Data representing a 3D object to be rendered is obtained at a user device, the data comprising: a mesh structure defining 3D co-ordinates for each of a plurality of object vertices; and a feature vector encoding visual characteristics for an object surface defined by the plurality of object vertices. An artificial neural network, ANN, is selected from a plurality of ANNs stored on the user device, each of the plurality of ANNs being configured to output pixel colour values for the object surface based on at least some of the visual characteristics encoded in the feature vector, wherein different ANNs have different numbers of layers and/or different numbers of parameters, wherein the selection is based on a resource characteristic of the user device. The mesh structure is processed using the selected ANN to generate a rendered image of the three-dimensional object.

IPC Classes  ?

• G06T 17/20 - Wire-frame description, e.g. polygonalisation or tessellation
• G06T 15/04 - Texture mapping
• G06T 15/20 - Perspective computation

Abstract

A computer-implemented method for decorrelating a set of simulated audio signals in a virtual environment is disclosed. The method comprises the steps of: obtaining a first set of decorrelation filters; evaluating the first set of decorrelation filters to determine a similarity metric representing the similarity between the first set of decorrelation filters; if the similarity metric is above a predetermined threshold, regenerating the set of decorrelation filters so as to reduce the similarity metric; and applying the regenerated set of decorrelation filters to the simulated audio signals.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control
• H04S 3/00 - Systems employing more than two channels, e.g. quadraphonic

Abstract

A method for compensating for a crash event during display of a virtual environment on a virtual reality, VR, headset, the method comprising: receiving virtual display content representing a virtual environment, tracking the orientation of the VR headset, rendering and displaying virtual display content according to the orientation of the VR headset during normal operation, prior to a crash event; rendering future virtual display content associated with a plurality of possible orientations of the VR headset; detecting a crash event, preventing further rendering of virtual display content; and displaying a virtual display sequence based on the rendered future virtual display content after the crash event to prevent a sudden stop in the display of the virtual environment.

IPC Classes  ?

• G06F 11/07 - Responding to the occurrence of a fault, e.g. fault tolerance
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06T 15/00 - 3D [Three Dimensional] image rendering

Abstract

A computer-implemented method for generating haptic feedback to accompany an audio signal, the method comprising: detecting a predetermined audio signal in one or more monitored audio channels (11); and in response to detecting the predetermined audio signal, triggering a haptic feedback signal in a haptic feedback channel (42), wherein the haptic feedback channel is synchronized with the one or more monitored audio channels.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06F 3/16 - Sound inputSound output

Abstract

A method and system is provided which trains a neural network which can be used to provide a player presence in a computer generated gaming environment.

IPC Classes  ?

• A63F 13/67 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use

Abstract

A computer-implemented method for generating an acoustic environment model for a video game level is provided. The method comprises: obtaining graphical data for visually rendering a gameplay environment of the video game level, the graphical data comprising a three-dimensional geometrical model for the gameplay environment, and generating, based on the graphical data, an acoustic environment model corresponding to the gameplay environment and adapted for the simulating of gameplay sounds therein.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall

Abstract

The invention includes a computer-implemented method of determining a required length of a scene comprising a speaking character, wherein the scene is localized in multiple spoken languages, the method comprising: obtaining a script for the speaking character in a first language; automatically translating the script into one or more second languages; performing text-to-speech processing to generate a localized audio sample for the script in each of the first language and the one or more second languages; determining a duration of the localized audio sample in each of the first language and the one or more second languages; and determining a maximum spoken duration of the script as the maximum of the respective durations of the localized audio sample in each of the first language and the one or more second languages.

IPC Classes  ?

• G10L 13/08 - Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• G06F 40/58 - Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• G06T 13/20 - 3D [Three Dimensional] animation
• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Abstract

A method of adjusting an in-game audio output of a video gaming system, where the video gaming system comprises loudspeakers for outputting the in-game audio output and a user device comprising a microphone, the user device configured to be worn on an ear of the user, the method comprising: outputting a calibration signal, the calibration signal comprising an audio signal; receiving the calibration signal with the microphone of the user device; determining the location of the user device relative to the loudspeakers based on the received calibration signal; adjusting the in-game audio output based on the determined location of the user device.

IPC Classes  ?

• A63F 13/25 - Output arrangements for video game devices
• G06F 3/16 - Sound inputSound output

Abstract

A computer-implemented method of producing a video game environment. The method comprises receiving a representation of the video game environment, identifying a first object in the video game environment, and identifying, based on a graphical representation of the first object, one or more properties of the first object suitable for selecting a sound effect to be applied to the first object. A sound effect is applied to the first object in the video game environment based on the one or more identified properties.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/52 - Controlling the output signals based on the game progress involving aspects of the displayed game scene
• A63F 13/5372 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen for tagging characters, objects or locations in the game scene, e.g. displaying a circle under the character controlled by the player

Abstract

A method of adjusting an in-game audio output of a video gaming system, where the video gaming system comprises loudspeakers for outputting the in-game audio output and a user device comprising a microphone, the method comprising: outputting a calibration signal with the loudspeakers on a continual basis during use of the video gaming system, the calibration signal comprising an audio signal; receiving the calibration signal with the microphone of the user device and repeatedly determining the location of the user device relative to the loudspeakers based on the received calibration signal to monitor a varying location of the user during use of the video gaming system; repeatedly adjusting the in-game audio output based on the determined location of the user device during use of the video gaming system.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control

Abstract

A method of generating audio output by a video gaming system is provided, the method comprising: obtaining one or more properties of an audio output device connected to the video gaming system; generating an adapted audio output for the audio output device by selecting, according to selection criteria, a subset of the audio components based on the obtained properties of the audio output device; and outputting only the selected audio components.

IPC Classes  ?

• G06F 3/16 - Sound inputSound output
• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/87 - Communicating with other players during game play, e.g. by e-mail or chat
• H04R 3/04 - Circuits for transducers for correcting frequency response

Abstract

A system for designing and generating a haptic output, the system comprising: a user device for editing and generating a haptic control signal, the user device comprising a hand-operated input device for receiving user inputs to set one or more parameters of a haptic control signal and a processor configured to generate the haptic control signal based on the set parameters; and a haptic actuator device configured to provide a haptic output to the user via a contact surface according to the haptic control signal, wherein the haptic actuator device is arranged such that the contact surface is maintained in contact with the user's hand during use, while permitting movement of the user's hand to operate the input device.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

A method for rendering 3D audio is provided. The method includes: obtaining a to-be-output audio signal, wherein the to-be-output audio signal comprises one or more audio layers; selecting a to-be-filtered audio layer from the one or more audio layers; selecting a rendering Head-Related Transfer Function, HRTF, from a database of HRTFs; applying the rendering HRTF to the to-be-filtered audio layer to generate a filtered audio layer, such that the to-be-output audio signal comprises the filtered audio layer and is a 3D audio signal. In this way, 3D effects are only applied to specific audio layers of an audio signal, thereby efficiently rendering 3D audio without unnecessarily impacting the timbre of the audio signal.

IPC Classes  ?

• H04R 5/04 - Circuit arrangements
• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control

Abstract

A computer-implemented method of generating a sound effect, comprising: obtaining a plurality of sounds; determining a common effect characteristic of the plurality of obtained sounds; obtaining a base sound; and generating the sound effect by applying the common effect characteristic to the base sound.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• G10H 1/00 - Details of electrophonic musical instruments

Abstract

A method for adjusting the audio output of a video gaming system during gameplay, the method comprising: measuring the usage of a processing unit of the video gaming system during gameplay, wherein the video gaming system is configured to output an audio stream comprising a plurality of audio components, the processing unit configured to process an audio data file to output each audio component; adjusting an output quality of one or more audio components of the audio stream in response to the measured usage of the processing unit. The method allows for dynamic adjustment of the audio output quality based on the capacity of the processing unit.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06F 3/16 - Sound inputSound output

Abstract

The invention provides a computer-implemented method of reducing latency in a cloud gaming system, the cloud gaming system comprising a local user device and a connected remote server, the method comprising: receiving a user input at the user device, wherein the user input initiates a gameplay event, the gameplay event comprising a visual output and one or both of an audio output and a haptic output, each to be outputted locally at the local user device; processing graphical data remotely at a processing unit of the server to provide the visual output of the gameplay event; and processing one or both of audio data and haptic data locally at a processing unit of the user device to provide the one or both of the audio output and the haptic output of the gameplay event respectively.

IPC Classes  ?

• A63F 13/358 - Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback
• A63F 13/335 - Interconnection arrangements between game servers and game devicesInterconnection arrangements between game devicesInterconnection arrangements between game servers using wide area network [WAN] connections using Internet
• A63F 13/50 - Controlling the output signals based on the game progress

Abstract

An image generation system operable to generate updated views of an object in a scene, the system comprising an input obtaining unit configured to obtain one or more user inputs for controlling the pose of the object, an object pose modification unit configured to determine an updated pose of the object in accordance with the obtained user inputs, a hand pose determination unit configured to determine a pose for each of the hands associated with the object in accordance with the obtained user inputs, wherein the determining comprises generating a corresponding representation of the hands with the respective determined poses based upon two or more reference views of the hands, the reference views corresponding to different respective poses of the hands, a grab pose determination unit configured to determine a grab pose for each of the hands, the grab pose comprising a pose for fingers of each of the hands determined in dependence upon the updated object pose and a corresponding hand pose, and a rendering unit configured to generate one or more images of the object and associated hands in dependence upon the determined poses of the object, hands, and fingers.

IPC Classes  ?

• G06T 11/00 - 2D [Two Dimensional] image generation
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands

Abstract

The invention provides a computer-implemented method of determining and generating diegetic audio originating from a virtual event in a virtual gaming environment, the virtual gaming environment comprising a user avatar and a virtual fluid medium, and the virtual event comprising a first virtual object moving in the virtual fluid medium, the method comprising the steps of: obtaining bulk properties and the virtual domain of the virtual fluid medium; obtaining physical properties and kinematic properties of a first virtual object moving in the virtual domain of the virtual fluid medium; obtaining a physics model based on the bulk properties, the virtual domain, the physical properties, and the kinematic properties; obtaining outputs from the physics model; determining the diegetic audio originating from the virtual event based on the outputs from the physics model; and generating the diegetic audio originating from the virtual event.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall

Abstract

A computer-implemented system and method of providing a personalized experience to players of applications delivering a virtual environment, such as a virtual game world. A cloud-deployed machine learning (ML) model implements a player state service to gather data from input devices and historical data, such as past game-play, to infer physiological and behavioral data (a player state vector) which may be used to represent the current cognitive state of the player.

IPC Classes  ?

• A63F 13/67 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
• A63F 13/22 - Setup operations, e.g. calibration, key configuration or button assignment
• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories

Abstract

A computer-implemented method of transmitting video data. A sequence of video frames is received. A warp operation for a first frame and a reference frame of the sequence of video frames is determined, wherein the warp operation defines a transformation of the reference frame to give an approximation of the first frame. One or more regions of interest of the first frame are identified. Encoded image data from the image data of the one of more regions of interest of the first frame is generated using an image encoder. The warp operation and the encoded image data are transmitted.

IPC Classes  ?

• H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
• G06N 3/0464 - Convolutional networks [CNN, ConvNet]
• G06N 3/084 - Backpropagation, e.g. using gradient descent
• H04N 19/154 - Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
• H04N 19/60 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Abstract

Disclosed herein is a method and system for generating an adjustment in a visual aspect of a computer-implemented interactive environment. The method and system conserve the resources of the computing resource implementing the environment and still enable visual representations of users, such as avatars, to be generated.

IPC Classes  ?

• A63F 13/52 - Controlling the output signals based on the game progress involving aspects of the displayed game scene
• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• G06T 19/00 - Manipulating 3D models or images for computer graphics

Abstract

A method of dataset generation is described. The method comprises steps including receiving user image data and generating personalised training data based on the received user image data. Generating personalised training data comprises generating a computational model based at least in part on the received user data and generating the personalised training data based on the computational model.

IPC Classes  ?

• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting
• G06T 17/20 - Wire-frame description, e.g. polygonalisation or tessellation
• G06V 10/776 - ValidationPerformance evaluation
• G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions

Abstract

A system and computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user; receiving input data from a plurality of input sources, wherein the plurality of input sources includes an imaging source configured to provide images of the user's face, wherein each of the plurality of input sources has an active state and an inactive state, and input data is only received from an input source in the active state; processing the input data; updating the base model in response to the processed input data to update at least one property of the virtual avatar and rendering the updated base model to display the virtual avatar on a display screen.

IPC Classes  ?

• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells

Abstract

There is described a computer-implemented method for involuntary user command compensation on an input device, the method comprising; receiving a user command from at least one input source of an input device; determining whether the user command is an involuntary user command; if it is determined that the user command is an involuntary user command, applying a compensation action to the user command; and issuing a compensated user command output based on the compensation action. There is also described a computer program product and a system.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06N 20/00 - Machine learning

Abstract

A computer-implemented system and method for real-time customization of a virtual avatar, comprising providing a virtual avatar associated with a user, receiving an image of the user and at least a portion of their surroundings, applying a facial detection algorithm to detect the user's face in the image, extracting a region of interest from the image, the region of interest including the user's face, providing the region of interest to a data model, processing the region of interest, by the data model, and using feature recognition to determine whether the region of interest comprises a feature from a set of predefined features. In response to determining that the region of interest comprises a feature from a set of predefined features, the appearance of the virtual avatar is updated.

IPC Classes  ?

• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• G06T 13/20 - 3D [Three Dimensional] animation
• G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions

Abstract

A method of point cloud generation comprises generating, by a processor, a first point cloud comprising a first set of generated data points; calculating, by the processor, a loss function representative of the quality of the first point cloud, the loss function comprising a smoothness term obtained by constructing vectors between neighbouring data points in the point cloud, performing vector multiplication between neighbouring pairs of vectors, and outputting a smoothness term based on the result of the vector multiplication; and generating, by the processor, a second point cloud comprising a second set of generated data points based at least in part on the calculated loss function of the first point cloud.

IPC Classes  ?

• G06T 7/00 - Image analysis
• G06T 17/00 - 3D modelling for computer graphics

Abstract

There is described a computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising; providing a virtual avatar associated with a user, wherein the virtual avatar is associated with a plurality of poses and a plurality of animations; receiving input data associated with the user from at least one input source; processing the input data, the input data comprising images of the user and/or audio data captured from the user; determining a user mannerism from the processed input data; and updating at least one of the plurality of poses and/or animations of the virtual avatar, or creating a new pose and/or animation, to apply the user mannerism to the virtual avatar. There is also described a computing device configured to carry out the computer-implemented method.

IPC Classes  ?

• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
• G06V 40/20 - Movements or behaviour, e.g. gesture recognition

Abstract

A computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user profile corresponding to a user; receiving input data from at least one of a plurality of multimedia input sources; processing the input data; determining a baseline avatar and a dynamic avatar using the processed input data; generating an output avatar based on the determined baseline avatar and the determined dynamic avatar; updating the base model by adding the generated output avatar to the base model; and rendering the updated base model to display the virtual avatar on a display screen.

IPC Classes  ?

• G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
• G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
• H04L 67/306 - User profiles

Abstract

An audio personalisation method for generating a personalised Head-Related Transfer Function, HRTF, the method comprising the steps of: obtaining a base HRTF model comprising a first set of parameters; outputting a sound from a virtual sound source according to the base HRTF model, the virtual sound source having an intended virtual position; receiving at least one user indication corresponding to a user virtual position of the virtual sound source, wherein the intended virtual position is different to the user virtual position; updating the first set of parameters to a second set of parameters based on the at least one indication from the user so as to update the user virtual location; and generating a personalised HRTF model comprising the second set of parameters, wherein the difference between the intended virtual position and the user virtual position according to the personalised HRTF model is less than the difference between the intended virtual position and the user virtual position according to the base HRTF model.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control

Abstract

A computer implemented method for autonomous anomalous device behaviour detection. Including receiving behaviour data, wherein the behaviour data is indicative of a user's inputs to an electronic device. A behaviour pattern label and an indication to the likelihood of an anomaly occurring are determined based on the received behaviour data, wherein the behaviour pattern label belongs to behaviour pattern label hierarchy.

IPC Classes  ?

• H04L 9/40 - Network security protocols
• G06N 3/08 - Learning methods

Abstract

A computer-implemented method for identifying proprietary content in composite media comprising a plurality of media components, the method comprising: identifying a first media component of the composite media as proprietary content; identifying a second media component of the composite media as a context indicator; and determining a context for the proprietary content based on the context indicator.

IPC Classes  ?

• G06F 21/10 - Protecting distributed programs or content, e.g. vending or licensing of copyrighted material

Abstract

There is provided a computer-implemented method for anti-aliasing an image frame in an image stream. The method comprises providing an input to a data model, the data model being configured to perform anti-aliasing on a present frame which is displayed after a previous frame in the image stream. The input comprises: an anti-aliased image of the previous frame; an aliased image of the present frame; an ID map of the previous frame; an ID map of the present frame; and a velocity map based on changes between the previous frame and the present frame. The data model processes the received inputs to correlate image portions of the previous frame and image portions of the present frame based on the inputs and performing anti-aliasing on the present frame based at least in part on the correlated image portions. An anti-aliased image of the present frame is received as an output of the data model.

IPC Classes  ?

• G06T 11/40 - Filling a planar surface by adding surface attributes, e.g. colour or texture
• G06T 7/207 - Analysis of motion for motion estimation over a hierarchy of resolutions
• G06T 7/254 - Analysis of motion involving subtraction of images
• G06T 11/00 - 2D [Two Dimensional] image generation

Abstract

A method and system for improving a resolution of an image frame is described. The image frame is part of a data stream. The data stream may be a video game, for example. The method comprising the following steps. Sending an encoded version of the image frame from a server to a client device via a first communication channel between the server and the client device. Detecting a reduced bandwidth of the first communication channel. In response to detecting the reduced bandwidth, determining data to be sent to the client device via a second communication channel. The second communication channel is separate to the first communication channel and the data relates to the image frame. The determined data is sent via the second communication channel.

IPC Classes  ?

• G06T 5/50 - Image enhancement or restoration using two or more images, e.g. averaging or subtraction
• H04L 45/00 - Routing or path finding of packets in data switching networks
• H04L 65/80 - Responding to QoS

Abstract

A method for identifying a cutscene in gameplay footage, the method comprising: receiving a first video signal and a second video signal each comprising a plurality of images; creating a first video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the first video signal; creating a second video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the second video signal; comparing the first video fingerprint with the second video fingerprint; and identifying a cutscene when at least a portion of the first video fingerprint has at least a threshold level of similarity with at least a portion of the second video fingerprint.

IPC Classes  ?

• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• G06F 17/17 - Function evaluation by approximation methods, e.g. interpolation or extrapolation, smoothing or least mean square method
• G06V 20/40 - ScenesScene-specific elements in video content
• H04L 9/32 - Arrangements for secret or secure communicationsNetwork security protocols including means for verifying the identity or authority of a user of the system

Abstract

A controller for a multimedia entertainment system is provided. The controller comprises a weighted component connected to the controller, wherein the weighted component is rotationally movable relative to the controller. The controller is configured to rotate the weighted component from a start position to an end position to shift the centre of mass of the controller in response to a trigger event; wherein the weighted component stops moving at the end position. This movement of the weighted component provides directional haptic feedback to a user of the controller.

IPC Classes  ?

• A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback
• A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

Image data of a first image in a sequence of images is processed using an artificial neural network (ANN) to generate output image data indicative of an alignment of the first image with a second image in the sequence. The ANN is trained using outputs of an alignment pipeline configured to perform alignment of images. The alignment pipeline is configured to determine flow vectors representing optical flow between images, and perform an image transformation using the flow vectors to align the images. The ANN is trained to emulate a result derivable using the alignment pipeline.

IPC Classes  ?

• G06T 5/50 - Image enhancement or restoration using two or more images, e.g. averaging or subtraction
• G06T 3/00 - Geometric image transformations in the plane of the image

Abstract

Image data representing one or more images at a first resolution is received at a first artificial neural network (ANN). The image data is processed using the first ANN to generate upscaled image data representing the one or more images at a second, higher resolution. The first ANN is trained to perform image upscaling and is trained using first training image data representing one or more training images at the first resolution, the first training image data being at a first level of quality. The first ANN is also trained using features of a second ANN, wherein the second ANN is trained to perform image upscaling and is trained using second training image data representing one or more training images at the first resolution, the second training image data being at a second level of quality, higher than the first level of quality.

IPC Classes  ?

• G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting
• G06T 5/00 - Image enhancement or restoration

Abstract

A system for generating a personalised Head-Related Transfer Function, HRTF, for a user, the system comprising: a sound source at a first position; a user device comprising: a left microphone arranged to be at a left ear of the user, when the user device is worn; a right microphone arranged to be at a right ear of the user, when the user device is worn; and a controller configured to: prompt the user to move to series of different second positions; control the sound source to emit a predetermined sound signal when the user is at each second position; obtain a detected sound signal from each of the left and right microphones when the user is at each second position; generate a personalised HRTF based on the predetermined sound signal and the detected sound signal for each microphone and each second position.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control
• H04R 5/027 - Spatial or constructional arrangements of microphones, e.g. in dummy heads
• G06T 19/00 - Manipulating 3D models or images for computer graphics

Abstract

A computer-implemented method includes identifying a gaming device in a real-world environment, the gaming device providing a user experience to a user in a mixed-reality setting, identifying an object in the real-world environment in proximity to the gaming device, and initiating an activity relating to the object based on a virtual part of the mixed-reality setting.

IPC Classes  ?

• G06T 19/00 - Manipulating 3D models or images for computer graphics
• G06V 10/20 - Image preprocessing
• G06T 7/70 - Determining position or orientation of objects or cameras
• G02B 27/01 - Head-up displays
• G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks

Abstract

A computer-implemented method includes selecting a virtual object to be positioned in a mixed-reality environment, the virtual object having one or more conditions relating to the positioning of the virtual object, scanning a real-world part of the mixed-reality environment, determining a location to position the virtual object based on the scan, wherein the location satisfies the one or more conditions, scaling the virtual object based on the location, and positioning the virtual object in the mixed-reality environment at the determined location.

IPC Classes  ?

• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• G06T 19/00 - Manipulating 3D models or images for computer graphics

Abstract

An audio personalisation method for simulating perception of a vertical displacement of a sound source, the method comprising the steps of: obtaining an input head related transfer function, HRTF, associated with a user; determining an intended vertical displacement for the sound source; selecting at least one frequency region in the input HRTF; and adjusting the amplitude of the selected frequency region(s) to simulate the intended vertical displacement for the sound source. This provides improvements to the generation and/or manipulation of HRTFs to allow adjustment of the perceived location of a sound source.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control

Goods & Services

Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; providing online entertainment; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; online journals, namely, blogs featuring articles about video games and video game development. Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting and providing technical advice and information for video game software and computer game software problems.

Abstract

A computer-implemented method for representing virtual objects outside of a display screen, comprising: receiving data defining a virtual environment that comprises a plurality of virtual objects, each virtual object having a virtual location within the virtual environment, displaying, on a display screen, a portion of the virtual environment that is within a field of view controlled by a user determining if at least one virtual object of a subset of the virtual objects is outside of the field of view but at least partially within a virtual display area adjacent the display screen. In response to determining that a virtual object of the subset of the virtual objects is at least partially within the virtual display area, the method comprises converting the virtual location of the virtual object into a real-world location, and displaying a virtual element representing the virtual object at the real-world location using a mixed-reality display device.

IPC Classes  ?

• G06T 19/00 - Manipulating 3D models or images for computer graphics
• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

A computer-implemented method for detecting a display screen using an extended reality display device, comprising receiving, at the extended reality display device, an image, or data defining an image, corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points, monitoring a display screen that is displaying the video stream, detecting at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen, and determining, based on the detected specified feature points, the physical boundaries of the display screen.

IPC Classes  ?

• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 10/44 - Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersectionsConnectivity analysis, e.g. of connected components
• G06V 20/40 - ScenesScene-specific elements in video content
• G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods

Abstract

A method and system are provided which enable an object, known or unknown, to be augmented with additional visual elements. This may provide a more immersive experience, for example, when gaming or viewing content.

IPC Classes  ?

• G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
• G06T 11/00 - 2D [Two Dimensional] image generation
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• A63F 13/52 - Controlling the output signals based on the game progress involving aspects of the displayed game scene
• A63F 13/5372 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen for tagging characters, objects or locations in the game scene, e.g. displaying a circle under the character controlled by the player

Abstract

There is provided a method of sending a content stream, comprising retrieving a sender framework associated with the at least one attribute, wherein the sender framework defines an arrangement of the plurality of tracks to be included in an output content stream. The output content stream is defined according to the sender framework. There is also provided a method of outputting a content stream on a user device, comprising receiving a content stream as defined by a sender framework, retrieving a user framework associated with the user electronic device, wherein the user framework defines at least one predetermined setting or instruction to be applied to the content stream, and applying the user framework to the content stream to update the content stream. The method may also include providing viewer engagement information and updating the sender framework in response to the viewer engagement information received.

IPC Classes  ?

• H04N 21/24 - Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth or upstream requests
• H04N 21/233 - Processing of audio elementary streams
• H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs

Goods & Services

Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; online journals, namely, blogs featuring articles about video games and video game development Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting in the nature of diagnosing computer hardware and software problems, and providing technical advice and information for video game software and computer game software problems

Goods & Services

(1) Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. (1) Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; providing online entertainment; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; online journals, namely, blogs featuring articles about video games and video game development. (2) Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting and providing technical advice and information for video game software and computer game software problems.

Goods & Services

Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; providing online entertainment; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; providing online, non-downloadable electronic publications in the nature of blogs in the fields of video games and video game development. Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting and providing technical advice and information for video game software and computer game software problems.

Abstract

A method for configuring a start-up display screen of a multimedia entertainment system, the method comprising: storing time related reference usage data of each application from a plurality of applications configured to run on the multimedia entertainment system; comparing the reference usage data of each application with a current system start up time to identify at least one identified application based on the reference data; and configuring the start-up display screen based on said identified at least one application.

IPC Classes  ?

• H04N 21/443 - OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• H04N 21/47 - End-user applications

Abstract

A computer-implemented method for image upscaling at a client device is provided. The method comprising: receiving, from a server device, an image which is one of a plurality of images forming an image stream, wherein the image comprises a plurality of image portions; determining a first group of one or more image portions from the plurality of image portions to apply a first image upscaling process to from a plurality of available image upscaling processes; selecting the first group of image portions based on the determination; and applying the first image upscaling process to the first group of image portions. The upscaling process may be an image upscaling process such as super resolution.

IPC Classes  ?

• G06T 3/40 - Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A method of generating an image of a scene from a target viewpoint is provided. The method comprises capturing a plurality of multi-plane images of a virtual scene, and determining for each multi-plane image, whether a frontmost clipping plane pair defined for that multi-plane image intersects a virtual object in the virtual scene. Responsive to a positive determination for a respective clipping plane pair, the corresponding image data in the corresponding image plane is identified and assigned an identifier, thus generating a modified version of the corresponding multi-plane image. Camera information is obtained for the one or more virtual cameras that captured the multi-plane images and the target virtual camera. An output image is then generated by combining at least one of the modified multi-plane images with another of the multi-plane images in accordance with the obtained camera information. A corresponding system is also provided.

IPC Classes  ?

• G06T 15/20 - Perspective computation
• G06T 15/30 - Clipping
• G06T 15/06 - Ray-tracing
• G06T 15/50 - Lighting effects

Abstract

A method of processing a time-varying signal in a signal processing system. Data representative of one or more first time samples of the time-varying signal is received at an artificial neural network, ANN. The received data is processed using the ANN to generate predicted data representative of a second time sample of the time-varying signal, the second time sample being later than the one or more first time samples. The ANN is trained to predict data representative of time samples of time-varying signals based on data representative of earlier time samples of the time-varying signals. The signal processing system processes the predicted data representative of the second time sample in place of a third time sample of the time-varying signal, the third time sample being earlier than the second time sample.

IPC Classes  ?

• H04L 43/0852 - Delays
• G06N 3/04 - Architecture, e.g. interconnection topology

Abstract

A method for generating feedback in a multimedia entertainment system, the method comprising: obtaining an output stream to be output by the multimedia entertainment system; performing feature analysis to identify a feature in the output stream; determining a feedback based on the identified feature; controlling a main audiovisual display to output the output stream; and controlling a peripheral device to output the determined feedback.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback

Abstract

A computer-implemented system and method of providing a positioning system for a virtual environment hosted on a platform to enable sharing of content, comprising assigning each location in the virtual environment a unique location ID, receiving a request to retrieve a unique location ID and sharing the unique location ID with an application or an electronic device, wherein each unique location ID is a data string having a standardized format across different platforms comprising a platform identifier, a title identifier, a level identifier and a position identifier.

IPC Classes  ?

• A63F 13/55 - Controlling game characters or game objects based on the game progress

Abstract

A system comprising: an event detection unit, configured to detect a significant event associated with a video game environment and to selectively output an indication of a detected event; and a separation unit configured to perform source separation on music in playback in dependence upon the indication from the event detection unit, and an audio output unit configured to output for playback audio derived from the result of source separation by the separation unit.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/424 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• A63F 13/215 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
• G06F 3/16 - Sound inputSound output

Abstract

The invention provides techniques for intelligently positioning speech in a virtual environment. Factors such as user preferences, the location of virtual environment audio and/or visual events, avatar location, and others can be taken into account when selecting a suitable location for the speech. The virtual environment can be a game environment, a meeting environment, an augmented reality environment, a virtual reality environment, and the like. The invention can be implemented by an audio processing unit which may be part of a game console.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall

Abstract

A method for obtaining a position of a peripheral device for an audiovisual entertainment system, the method comprising: controlling an audio source to output an audio signal at a first time; determining a second time at which the audio signal arrives at an audio detector, wherein the peripheral device comprises at least one of the audio source and audio detector; and estimating a position of the peripheral device based on an acoustic time-of-flight between the first time and the second time.

IPC Classes  ?

• G06F 3/033 - Pointing devices displaced or positioned by the userAccessories therefor
• A63F 13/215 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
• G01S 5/30 - Determining absolute distances from a plurality of spaced points of known location
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

A system configured to track the location of one or more peripherals operated by a user, the system comprising a tracking unit configured to determine a location of the one or more peripherals in dependence upon images captured by a camera associated with an HMD worn by the user, a generation unit configured to generate, in response to a determination by the tracking unit that one or more of the peripherals is not visible in the images, an array of home points behind the user, the home points being locations defined in dependence upon constraints upon the user's motion, an estimation unit configured to estimate the respective locations of non-visible peripherals in dependence upon the output of one or more inertial measurement units associated with each peripheral, and a selection unit configured to select a home point, from amongst the array of home points, for each of the non-visible peripherals, wherein the tracking unit is configured to generate a location for each non-visible peripheral such that the location converges towards the selected home point.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06F 3/0346 - Pointing devices displaced or positioned by the userAccessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A data processing apparatus comprises receiving circuitry to receive tracking data indicative of at least one of a tracked position and orientation of a head-mountable display (HMD), image processing circuitry to generate a sequence of images frames for display in dependence upon the tracking data, detection circuitry to detect an image feature in a first image frame and to detect a corresponding image feature in a second image frame, and correlation circuitry to: calculate a difference between the image feature in the first image frame and the corresponding image feature in the second image frame; generate difference data indicative of a difference between a viewpoint for the first image frame and a viewpoint for the second image frame in dependence upon the difference between the image feature in the first image frame and the corresponding image feature in the second image frame; and generate output data in dependence upon a difference between the difference data and the tracking data associated with the first and second image frames.

IPC Classes  ?

• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• G06T 7/246 - Analysis of motion using feature-based methods, e.g. the tracking of corners or segments

Abstract

A method of point tracking comprises the steps of receiving successive input image frames from a sequence of input image frames comprising an object to track; for each input frame, detecting a plurality of feature points; mapping a 3D morphable model to the plurality of feature points; performing optical flow tracking of flow points between successive input frames; and correcting optical flow tracking for at least a first flow point position responsive to the mapped 3D morphable model.

IPC Classes  ?

• G06T 7/246 - Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
• G06T 17/20 - Wire-frame description, e.g. polygonalisation or tessellation
• G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

Methods and apparatus provide for generating an image by way of acquiring information relating to at least one of a position and a rotation of a camera. The image is generated for display on a display unit. A rate at which the image is generated is at a first frequency, which is lower than a second frequency corresponding to a frame rate of the display unit.

IPC Classes  ?

• G02B 27/01 - Head-up displays
• G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
• A63F 13/25 - Output arrangements for video game devices

Abstract

A computer-implemented method of processing image data using a model of the human visual system. The model comprises a first artificial neural network system trained to generate the first output data using one or more differentiable functions configured to model the generation of signals from images by the human eye, and a second artificial neural network system trained to generate the second output data using one or more differentiable functions configured to model the processing of signals from the human eye by the human visual cortex. The method comprises receiving image data representing one or more images, processing the received image data using the first artificial neural network system to generate first output data, processing the first output data using a second artificial neural network system to generate second output data. Model output data is determined from the second output data, and output for use in an image processing process.

IPC Classes  ?

• G06V 10/44 - Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersectionsConnectivity analysis, e.g. of connected components
• G06N 3/04 - Architecture, e.g. interconnection topology
• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting

Abstract

The present disclosure relates to a computer-implemented method for completing an image, the method comprising the steps of dividing data of an image to be completed into a plurality of image portions. The method entails applying a first filling process to fill a first image portion comprising a first hole, the first hole associated with a first quantity and/or a first quality; and applying a second filling process to fill a second image portion comprising a second hole, the second hole associated with a second quantity different to the first quantity and/or a second quality different to the first quality, the second process being different to first process. The method then includes combining the filled first and second image portions to complete the image.

IPC Classes  ?

• G06T 5/00 - Image enhancement or restoration
• G06T 5/30 - Erosion or dilatation, e.g. thinning
• G06T 7/00 - Image analysis
• G06T 7/60 - Analysis of geometric attributes

Abstract

A method of processing image data is provided. Pixel data for a first image is preprocessed to identify a subset of the pixel data corresponding to a region of interest depicting a scene element. The subset of the pixel data is processed at a first encoder to generate a first data structure representative of the region of interest, the first data structure identifying the scene element depicted in the region of interest. The subset of pixel data is also processed at a second encoder to generate a second data structure representative of the region of interest, the second data structure comprising values for visual characteristics associated with the scene element. The first and second data structures are outputted for use by a decoder to generate a second image approximating the region of interest of the first image.

IPC Classes  ?

• G06V 10/25 - Determination of region of interest [ROI] or a volume of interest [VOI]
• G06V 10/75 - Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video featuresCoarse-fine approaches, e.g. multi-scale approachesImage or video pattern matchingProximity measures in feature spaces using context analysisSelection of dictionaries
• G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
• G06N 3/08 - Learning methods
• G06N 3/04 - Architecture, e.g. interconnection topology

Abstract

The present invention balances productions costs with ensuring necessary tracking precision. This position input system comprises: an attachment (110) that has a plurality of light-emitting parts (81) which are for detecting the position of the attachment, and an engaging part (89); and a controller (100) that includes an engagement-receiving part (79) to which the engaging part of the attachment can be attached, and a device which is for detecting the position of the controller.

IPC Classes  ?

• G06F 3/0346 - Pointing devices displaced or positioned by the userAccessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Generating audio assets by receiving a plurality of input audio assets, converting each input audio asset into an input graphical representation, generating an input multi-channel image by stacking each input graphical representation in a separate channel of the image, feeding the input multi-channel image into a generative model to train the generative model and generate one or more output multi-channel images, each output multi-channel image including an output graphical representation, extracting the output graphical representations from each output multi-channel image and converting each output graphical representation into an output audio asset.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• A63F 13/60 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• G06T 11/00 - 2D [Two Dimensional] image generation
• G10L 21/14 - Transforming into visible information by displaying frequency domain information
• G10L 21/18 - Details of the transformation process
• G10L 25/18 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
• G10L 25/30 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique using neural networks

Abstract

A method of generating audio assets, comprising the steps of: receiving an input multi-layered audio asset comprising a plurality of audio layers, generating an input multi-channel image, wherein each channel of the input multi-channel image comprises an input image representative of one of the audio layers, training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output image representative of an output audio layer, and generating an output multi-layered audio asset based on a combination of output audio layers derived from the output images.

IPC Classes  ?

• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• G10L 25/18 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
• G10L 21/14 - Transforming into visible information by displaying frequency domain information
• G10L 21/18 - Details of the transformation process
• G10L 25/30 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique using neural networks
• H04S 3/00 - Systems employing more than two channels, e.g. quadraphonic
• G06T 11/00 - 2D [Two Dimensional] image generation
• A63F 13/60 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor

Abstract

A method of generating audio assets, comprising the steps of: receiving an input audio asset having a first duration, generating an input image representative of the input audio asset, training a generative model on the input image and implementing the trained generative model to generate an output image representative of an output audio asset having a second duration different to the first duration, and generating the output audio asset based on the output image.

IPC Classes  ?

• G10H 1/00 - Details of electrophonic musical instruments
• A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall

Goods & Services

Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software. Clothing; footwear; headgear; t-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. Digital media streaming services; streaming of audio material on the Internet, via televisions, mobile phones and games consoles; streaming of video material on the Internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices. Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the Internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the Internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation). Computer services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technical information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; interactive entertainment services in the nature of online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, game play logic, and animations; interactive entertainment services in the nature of online, non-downloadable game engine software used to create digital works of art; video game entertainment services in the nature of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting video and computer games or parts of video or computer games created by others on a computer service for a global network.

Abstract

A system for generating a transfer function indicating audio transmission characteristics of an input device associated with a processing device, the system comprising a parameter determining unit configured to determine one or more parameters of the input device, wherein the parameters include a location of a microphone associated with the input device and a location of one or more respective input and/or output elements associated with the input device, an audio characteristic determining unit configured to determine one or more characteristics of audio transmission between respective input and/or output elements and the microphone, wherein the characteristics include one or more of an attenuation, resonance, and/or change in frequency profile of audio associated with the respective input and/or output element, and a transfer function generating unit configured to generate a transfer function in dependence upon the determined audio characteristics.

IPC Classes  ?

• G10L 21/0208 - Noise filtering
• G10K 11/178 - Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effectsMasking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
• A63F 13/215 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone

Goods & Services

Computer game software; computer software for video games or for games machines; video game cartridges; video game programs; video game software; electronic devices for the wireless receipt, storage and transmission of data and messages; downloadable electronic publications; sound and video recordings featuring music, entertainment and games; electronic game software for mobile phones; application development tool programs for personal and handheld computers; downloadable application software; downloadable audio and video recordings and media. Digital media streaming services; streaming of audio material on the internet, via televisions, mobile phones and games consoles; streaming of video material on the internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices; all of the aforesaid services being for or in relation to computer game software and video game software and the online hosting of content, video and sound files regarding characters, themes, levels, storylines from a computer game or video game. Electronic games services provided by means of the Internet; provision of non-downloadable games on the Internet; arranging of games; organizing of games; education; entertainment services; entertainment services provided online and/or via a computer database for matching users for the transfer or sharing of computer games, music, video and audio recordings via communications networks; organizing, staging and the provision of on-line tournaments; entertainment by means of wireless television broadcasts; provision of on-line information in the field of computer games entertainment, featuring game player information, including information regarding a player's identity and the player's preferences via a customized website; the provision of on-line electronic publications; entertainment services provided online and via a computer database for the transfer or sharing of computer games, music, video and audio recordings via communications networks; electronic game services provided by means of the internet allowing players to share live game footage with other players for the purposes of either allowing them to take control of the game or to allow multiplayer game player; information relating to all of the aforementioned; all of the aforesaid services being for or in relation to computer game software and video game software and the online hosting of content, video and sound files regarding characters, themes, levels, storylines from a computer game or video game. Hosting on-line web facilities for interactive game play; computer services in the nature of hosting customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting a website featuring video and computer games or parts of video or computer games created by others; all of the aforesaid services being for or in relation to computer game software and video game software and the online hosting of content, video and sound files regarding characters, themes, levels, storylines from a computer game or video game.

Goods & Services

Computer games software; computer games; video game software; computer software for video games or for games machines; computer programs for video and computer games; electronic game software for mobile phones. On-line gaming services; providing on-line computer games; publishing of computer and video games and computer and video games software; providing on-line information in the field of computer gaming entertainment; providing games by cellular telephone communication; providing games by or for use on cellular telephone.

Goods & Services

Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software. Clothing; footwear; headgear; T-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. Digital media streaming services; streaming of audio material on the internet, via televisions, mobile phones and games consoles; streaming of video material on the internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices. Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services in the nature of entertainment. Computer programming; computer system design; computer design and development; provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technological information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; providing online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing online, non-downloadable game engine software used to create digital works of art; providing online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of hosting customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting a website featuring video and computer games or parts of video or computer games created by others.

Abstract

Disclosed herein is a method and system for generating an adjustment in a visual aspect of a computer-implemented interactive environment. The method and system conserve the resources of the computing resource implementing the environment and still enable visual representations of users, such as avatars, to be generated.

IPC Classes  ?

• A63F 13/655 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
• A63F 13/34 - Interconnection arrangements between game servers and game devicesInterconnection arrangements between game devicesInterconnection arrangements between game servers using peer-to-peer connections
• A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• A63F 13/424 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• A63F 13/323 - Interconnection arrangements between game servers and game devicesInterconnection arrangements between game devicesInterconnection arrangements between game servers using local area network [LAN] connections between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines

Abstract

A system and computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user; receiving input data from a plurality of input sources, wherein the plurality of input sources includes an imaging source configured to provide images of the user's face, wherein each of the plurality of input sources has an active state and an inactive state, and input data is only received from an input source in the active state; processing the input data; updating the base model in response to the processed input data to update at least one property of the virtual avatar and rendering the updated base model to display the virtual avatar on a display screen.

IPC Classes  ?

• A63F 13/655 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
• A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
• A63F 13/215 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
• A63F 13/424 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
• A63F 13/92 - Video game devices specially adapted to be hand-held while playing

Abstract

A method of point cloud generation comprises generating, by a processor, a first point cloud comprising a first set of generated data points; calculating, by the processor, a loss function representative of the quality of the first point cloud, the loss function comprising a smoothness term obtained by constructing vectors between neighbouring data points in the point cloud, performing vector multiplication between neighbouring pairs of vectors, and outputting a smoothness term based on the result of the vector multiplication; and generating, by the processor, a second point cloud comprising a second set of generated data points based at least in part on the calculated loss function of the first point cloud.

IPC Classes  ?

• G06T 17/00 - 3D modelling for computer graphics

Abstract

An optical communication system including a hub optical transceiver, a power splitter, and a plurality of spoke transceivers. The hub optical transceiver is configured for receiving a spectrum of wavelengths. The power splitter is coupled to the hub optical transceiver, and operates as a passive device that is configured to replicate the spectrum of wavelengths and output a plurality of replicated spectrum of wavelengths, and each replicated spectrum of wavelengths has a corresponding power that is a fraction of a total power received from the hub optical transceiver. The plurality of spoke transceivers is coupled to the power splitter and each of the plurality of spoke transceivers is configured to receive a corresponding one of the plurality of replicated spectrum of wavelengths, wherein each spoke transceiver is tunable to select a band of wavelengths that set a bandwidth for the each spoke transceiver.

IPC Classes  ?

• H04J 14/02 - Wavelength-division multiplex systems
• H04Q 11/00 - Selecting arrangements for multiplex systems

Abstract

A method of processing, prior to encoding using an external encoder, image data using an artificial neural network is provided. The external encoder is operable in a plurality of encoding modes. At the neural network, image data representing one or more images is received. The image data is processed using the neural network to generate output data indicative of an encoding mode selected from the plurality of encoding modes of the external encoder. The neural network trained to select using image data an encoding mode of the plurality of encoding modes of the external encoder using one or more differentiable functions configured to emulate an encoding process. The generated output data is outputted from the neural network to the external encoder to enable the external encoder to encode the image data using the selected encoding mode.

IPC Classes  ?

• H04N 19/107 - Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
• H04N 19/124 - Quantisation
• H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Abstract

Certain aspects of the present disclosure provide techniques for preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The weights of the preprocessing network are trained to optimize a combination of at least one quality score indicative of the quality of the output pixel representation and a rate score indicative of the bits required by the external encoder to encode the output pixel representation.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• H04N 19/124 - Quantisation
• H04N 19/65 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04L 65/65 - Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• H04L 67/02 - Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Goods & Services

Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software. Digital media streaming services; streaming of audio material on the internet, via televisions, mobile phones and games consoles; streaming of video material on the internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices; communication by online blogs; providing online chat rooms for social networking. Interactive entertainment; entertainment services; video entertainment services; online entertainment services; online interactive entertainment; provision of live entertainment; video game entertainment services; arranging and conducting award ceremonies; arranging and conducting competitions; arranging and conducting of games; arranging of competitions via the Internet; art exhibition services; organisation of artistic competitions; organisation of competitions and awards; organisation of e-sports competitions; organisation of esports events. Computer programming; computer system design; computer design and development; provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technical information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; providing online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing online, non-downloadable game engine software used to create digital works of art; providing online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of hosting customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting a website featuring video and computer games or parts of video or computer games created by others.

Goods & Services

Application software; entertainment software; computer game software; interactive entertainment software; video game software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software; interactive games software for mobile phones and tablet computers; electronic games software; interactive games software allowing users to alternate gameplay between computers, games consoles, smartphones, smart televisions and electronic devices; interactive games software allowing users to share and switch gameplay between users on different devices. Digital media streaming services; streaming of interactive games; streaming of interactive games via computers, televisions, mobile phones, games consoles and electronic devices; streaming of multimedia content on the internet, via computers, televisions, mobile phones, games consoles and electronic devices; streaming of interactive games and multimedia material via third party devices. Interactive entertainment services; electronic game services and competitions provided by means of the internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment provided via the internet; interactive computer game services; online gaming services; entertainment services provided online and/or via a computer database for matching users for the transfer or sharing of computer games, music, video and audio recordings via communications networks; organizing, staging and the provision of on-line tournaments; eSports services; entertainment by means of wireless television broadcasts; provision of customized web pages for featuring game player information, including information regarding a player's identity and the player's preferences (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); the provision of on-line electronic publications; entertainment services provided online and via a computer database for the transfer or sharing of computer games, music, video and audio recordings via communications networks; electronic game services provided by means of the internet allowing players to share live game footage with other players for the purposes of either allowing them to take control of the game or to allow multiplayer game players; organisation of competitions and awards; sporting and cultural activities; online distribution of interactive entertainment, music, images or videos; interactive entertainment publishing services; information relating to all of the aforementioned. Computer services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); provision of technical support in the field of interactive games software and interactive entertainment software; designing of computer games programs and video games programs; designing of interactive games software; developing of computer games programs and video games programs; testing of computer games programs and video games programs; technical information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; hosting on-line web facilities for interactive game play; computer services in the nature of customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); hosting interactive games, computer games and video games or parts of interactive games, computer games and video games on a computer service for a global network; information and advisory services relating to the aforesaid services; research in the field of climate change; providing scientific information in the field of climate change; providing scientific information in the fields of climate change and global warming.

Goods & Services

(1) Computer games software; computer games; video games software; computer software for video games or for games machines; computer programs for video and computer games; video discs, discs, tapes, cassettes, compact discs; CD-ROMs, DVDs, data bearing record carriers for computers; software for playing video, computer and on-line games; software for enabling video, computer and on-line games to be run on multiple platforms; electronic game software for mobile phones; application development tool programs for personal and handheld computers; downloadable application software; downloadable audio and video recordings and media; sound and/or video recordings featuring music and entertainment, television programs, motion pictures, news, sports, games, cultural events, and entertainment-related programs of all kinds; controllers and peripherals for computer games; electronic publications (downloadable) provided on-line from databases or the Internet; video games enhancers; parts and fittings for all the aforesaid goods. (1) Entertainment provided via the Internet; on-line gaming services; providing on-line computer games, multi-player matching services, and on-line entertainment in the nature of tournaments, fantasy sports leagues, gameshows; providing temporary use of online non-downloadable games played via a global computer network; education and entertainment services; provision of interactive entertainment services; publishing of computer and video games and computer and video games software; providing on-line information in the field of computer gaming entertainment; providing games by cellular telephone communication; providing games by or for use on cellular telephones; providing on-line electronic publications (not downloadable).

Goods & Services

Downloadable computer games software; computer games in the nature of computer game cartridges and discs; downloadable video game software; downloadable computer software for video games and for games machines; recorded computer programs for video and computer games; downloadable electronic game software for mobile phones Online gaming services, namely, providing online video games; online gaming services in the nature of computer game tournaments; online gaming services, namely, providing temporary use of non-downloadable video game software; providing online computer games; multimedia publishing of computer and video games and computer and video games software; providing online information in the field of computer gaming entertainment; providing online video games accessible by mobile phone; providing online games designed for play on mobile phones

Goods & Services

(1) Computer games software; computer games; video game software; computer software for video games or for games machines; computer programs for video and computer games; electronic game software for mobile phones. (1) On-line gaming services; providing on-line computer games; publishing of computer and video games and computer and video games software; providing on-line information in the field of computer gaming entertainment; providing games by cellular telephone communication; providing games by or for use on cellular telephone.

Abstract

An audio personalisation method for a first user comprises testing a first user on a calibration test, the calibration test comprising requiring a user to match a test sound to a test location, either by controlling the position of the presented sound or controlling the position of the presented location, for a sequence of test matches, each test sound being presented at a position using a default head related transfer function 'HRTF', receiving an estimate of each matching location from the first user, and calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals; identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and using an HRTF, previously obtained for the identified reference individual, for the first user.

IPC Classes  ?

• H04S 7/00 - Indicating arrangementsControl arrangements, e.g. balance control

Goods & Services

(1) Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software. (2) Clothing; footwear; headgear; t-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. (1) Digital media streaming services; streaming of audio material on the Internet, via televisions, mobile phones and games consoles; streaming of video material on the Internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices. (2) Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the Internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the Internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation). (3) Computer services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technical information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; interactive entertainment services in the nature of online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, game play logic, and animations; interactive entertainment services in the nature of online, non-downloadable game engine software used to create digital works of art; video game entertainment services in the nature of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting video and computer games or parts of video or computer games created by others on a computer service for a global network.

Goods & Services

Digital media streaming services, namely, electronic transmission and streaming of digital content for others via global and local computer networks; streaming of audio material on the Internet via televisions, mobile phones and games consoles; streaming of video material on the Internet via computers, televisions, mobile phones and games consoles; streaming of audio and video material on the Internet via third party devices Video disks and video tapes with recorded animated cartoons; cinematographic films featuring animated cartoons; audio visual recordings featuring animated cartoons; exposed cinematographic films; downloadable computer graphics; digital music downloadable from the internet; downloadable educational electronic books, manuals, and newsletters in the field of video games and animated cartoons; downloadable image files containing animated cartoons and 2D and 3D graphics and art; downloadable computer game software; downloadable electronic publications in the nature of magazines, brochures, informational sheets, and manuals in the fields of video games and animated cartoons; virtual reality models being downloadable virtual reality game software; downloadable communication software for providing access to the Internet and for connecting computer network users; downloadable interactive computer game software enabling exchange of information; downloadable computer software for editing audio files; downloadable computer graphics software; media and publishing software, namely, downloadable desktop publishing software; downloadable computer software for designing graphic images; downloadable game development software; downloadable music-composition software; downloadable software for processing images, graphics and text; Downloadable software for creating 3D animation; downloadable software for developing 3D computer graphics; Downloadable software for creating animation; Recorded computer application software for playing games and viewing gaming videos; downloadable game related software applications in the nature of downloadable computer software platforms for game development; downloadable educational software featuring instruction in animation and video games; downloadable entertainment computer game software; downloadable interactive multimedia software for playing games; recorded computer software for creation and assembly of 2D and 3D graphics and art, music, special effects, and animations; recorded game software for creating music, music videos, videos, and audiovisual productions; recorded computer game software; downloadable interactive game software; recorded virtual reality game software; downloadable virtual reality game software; downloadable augmented reality game software; recorded augmented reality game software Clothing, namely, sweaters, sweatshirts, pants, tops, bottoms; footwear; headwear; t-shirts; long sleeved shirts; clothing jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers in the nature of coveralls; hoodies; clothing jerseys; polo shirts; pajamas; one-piece garments for infants and toddlers; cosplay costumes; masquerade costumes; costumes for use in the amusement industry; swimwear Animation production services; creating animated cartoons being animation production services; presentation of live show performances; arranging of visual and musical entertainment, namely, arranging and conducting of concerts; art gallery services in the nature of conducting workshops and classes in the field of animation provided on-line via a telecommunications link; entertainment services, namely, art gallery services in the nature of production of custom animation for others provided on-line via a telecommunications link; audio-visual display presentation of live musical performances; entertainment services in the nature of conducting live performances in the field of performing arts, namely, live theatre; electronic games services provided by means of the Internet; organization of electronic game competitions via the Internet; electronic games services, namely, provision of on-line computer games; entertainment services, namely, provision of online non-downloadable animated cartoons for others; entertainment services, namely, video production services, film production services, audiovisual production services, music production services, virtual reality video production services, and augmented reality video production services; entertainment services, namely, organizing and arranging exhibitions for entertainment purposes; entertainment services in the nature of providing a website featuring entertainment information in the fields of video games ; entertainment services in the nature of providing non-downloadable electronic publications in the nature of blogs in the fields of video games, video game creation, game development software, virtual reality software, augmented reality software, and game engine software; entertainment information provided via the Internet; interactive entertainment services, namely, providing temporary use of non-downloadable interactive games; provision of information relating to live entertainment; online entertainment services in the nature of providing temporary use of online, non-downloadable computer games; fan club services, namely, providing fan clubs computer programming; computer system design; computer software design and development; provision of technical support services, namely, troubleshooting of computer software problems in the field of computer games; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to computer game design, development, and testing; providing technical information in the fields of computer game software, computer game hardware and on-line computer game design, development, and testing; design and development of multimedia products; design of audio-visual creative works being graphic design services; designing of video games for others; graphic arts design; Software as a service (SAAS) services featuring software for playing video games; Platform as a service (PAAS) services featuring computer software platforms for the design, development, testing, and playing of computer games; Platform as a service (PAAS) services featuring software platforms for playing electronic video games; providing temporary use of online, non-downloadable game engine software for creating and assembling 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing temporary use of online, non-downloadable game engine software for creating digital works of art; providing temporary use of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for others for organizing and conducting interactive game play amongst users; computer services in the nature of hosting a customized, interactive website featuring gameplay information, namely, information regarding a player's identity and the player's preferences on the internet; Hosting an online website featuring video and computer games and parts of video and computer games created by others

Goods & Services

(1) Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software. (2) Clothing; footwear; headgear; T-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. (1) Digital media streaming services; streaming of audio material on the internet, via televisions, mobile phones and games consoles; streaming of video material on the internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices. (2) Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services in the nature of entertainment. (3) Computer programming; computer system design; computer design and development; provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technological information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; providing online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing online, non-downloadable game engine software used to create digital works of art; providing online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of hosting customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting a website featuring video and computer games or parts of video or computer games created by others.

Goods & Services

Digital media streaming services, namely, electronic transmission and streaming of digital content for others via global and local computer networks; streaming of audio material on the Internet via televisions, mobile phones and games consoles; streaming of video material on the Internet via computers, televisions, mobile phones and games consoles; streaming of audio and video material on the Internet via third party devices Video disks and video tapes with recorded animated cartoons; cinematographic films featuring animated cartoons; audio and visual recordings featuring animated cartoons; exposed cinematographic films; downloadable computer graphics; digital music files downloadable from the internet; downloadable educational electronic books, manuals, and newsletters in the field of video games and animated cartoons; downloadable image files containing animated cartoons and 2D and 3D graphics and art; downloadable computer game software; downloadable electronic publications in the nature of magazines, brochures, informational sheets, and manuals in the fields of video games and animated cartoons; virtual reality models being downloadable virtual reality game software; downloadable communication software for providing access to the Internet and for connecting computer network users; downloadable interactive computer game software enabling exchange of information; downloadable computer software for editing audio files; downloadable computer graphics software; media and publishing software, namely, downloadable desktop publishing software; downloadable computer software for designing graphic images; downloadable game development software; downloadable music-composition software; downloadable software for processing images, graphics and text; downloadable 3D computer animation software for creating digital animation and special effects of images; Recorded computer application software for playing games and viewing gaming videos; downloadable game related software applications in the nature of downloadable computer software platforms for game development; downloadable educational software featuring instruction in animation and video games; downloadable entertainment computer game software; downloadable interactive multimedia software for playing games; recorded computer software for creation and assembly of 2D and 3D graphics and art, music, special effects, and animations; recorded game software for creating music, music videos, videos, and audiovisual productions; computer game software, downloadable; computer game software, recorded; downloadable interactive game software; recorded virtual reality game software; downloadable augmented reality game software; recorded augmented reality game software Clothing, namely, tops, shirts, sweaters, sweatshirts, skirts, bottoms, pants, dresses; footwear; headwear; t-shirts; clothing jackets; socks; jeans; trousers; underwear; shorts; jumpers in the nature of sweaters; hoodies; clothing jerseys; polo shirts; pajamas; one-piece garments for children; cosplay costumes; masquerade costumes; costumes for use in the amusement industry; swimwear Animation production services; creating animated cartoons being animation production services; presentation of live show performances; arranging of visual and musical entertainment, namely, arranging and conducting of concerts; educational services, namely, art gallery services in the nature of conducting workshops and classes in the field of animation provided on-line via a telecommunications link; entertainment services, namely, art gallery services in the nature of production of custom animation for others provided on-line via a telecommunications link; audiovisual display presentation of live musical performances; conducting of performing arts entertainment, namely, theatre productions; electronic games services provided by means of the Internet; organization of electronic game competitions via the Internet; electronic games services, namely, provision of online computer games; entertainment services, namely, provision of online non-downloadable animated cartoons; entertainment services, namely, video production services, film production services, audiovisual production services, music production services, virtual reality video production services, and augmented reality video production services; entertainment services, namely, organizing and arranging exhibitions for entertainment purposes; entertainment services in the nature of providing a website featuring entertainment information in the fields of video games; entertainment services in the nature of providing non-downloadable electronic publications in the nature of blogs in the fields of video games, video game creation, game development software, virtual reality software, augmented reality software, and game engine software; entertainment information provided via the Internet; interactive entertainment services, namely, providing temporary use of non-downloadable interactive games; provision of information relating to live entertainment; online entertainment services in the nature of providing temporary use of online, non-downloadable computer games; fan club services, namely providing fan clubs Computer services, namely, computer programming, computer software design and development, computer system design; provision of technical support services, namely, troubleshooting of computer software problems in the field of computer games; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to computer game design, development, and testing; providing technical information in the fields of computer game software, computer game hardware and on-line computer game design, development, and testing; design and development of multimedia products; design of audio-visual creative works, namely, designing of video games for others; graphic arts design; Software as a service (SAAS) services featuring software for playing video games; Platform as a service (PAAS) services featuring computer software platforms for the design, development, testing, and playing of computer games; providing temporary use of online, non-downloadable game engine software for creating and assembling 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing temporary use of online, non-downloadable game engine software for creating digital works of art; providing temporary use of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for others for organizing and conducting interactive game play amongst users; computer services in the nature of hosting a customized, interactive website featuring gameplay information, namely, information regarding a player's identity and the player's preferences on the internet; Application service provider (ASP), namely, hosting computer software applications of others, namely, video and computer games and parts of video and computer games created by others on a computer server for a global computer network

Abstract

A graphics processing unit (GPU) is configured to receive metadata specifying an active sample configuration for a particular region of a display device among a plurality of regions of the display device and receive pixel data for one or more pixels in the particular region. The pixel data specifies the same number of color samples for each pixel. For each pixel in the particular region, the GPU invokes a pixel shader only for color samples specified to be active samples by the configuration.

IPC Classes  ?

• G06T 15/00 - 3D [Three Dimensional] image rendering
• G06T 1/20 - Processor architecturesProcessor configuration, e.g. pipelining
• G06T 1/60 - Memory management
• G06T 11/00 - 2D [Two Dimensional] image generation
• G06T 15/04 - Texture mapping
• G06T 15/20 - Perspective computation
• G06T 15/80 - Shading
• G06T 3/00 - Geometric image transformations in the plane of the image

Abstract

A method of generating an image of a scene from a target viewpoint is provided. The method comprises capturing a plurality of multi-plane images of a virtual scene, and determining for each multi-plane image, whether a frontmost clipping plane pair defined for that multi-plane image intersects a virtual object in the virtual scene. Responsive to a positive determination for a respective clipping plane pair, the corresponding image data in the corresponding image plane is identified and assigned an identifier, thus generating a modified version of the corresponding multi-plane image. Camera information is obtained for the one or more virtual cameras that captured the multi-plane images and the target virtual camera. An output image is then generated by combining at least one of the modified multi-plane images with another of the multi-plane images in accordance with the obtained camera information. A corresponding system is also provided.

IPC Classes  ?

• G06T 15/20 - Perspective computation

Abstract

An information processing apparatus acquires, using an image obtained by capturing a device including a light-emitting marker with exposure times shorter than a time corresponding to one frame, information regarding a position and a posture of the device. The light-emitting marker is caused to emit light for light emission times equal to or shorter than the exposure times. The information processing apparatus causes the light-emitting marker to emit light in a predetermined flashing pattern, and identifies the exposure times on a time axis of the device on the basis of whether or not the image appears in the captured image, to thereby synchronize the exposure and the light emission.

IPC Classes  ?

• H04N 23/73 - Circuitry for compensating brightness variation in the scene by influencing the exposure time
• G06T 7/70 - Determining position or orientation of objects or cameras
• H04N 23/56 - Cameras or camera modules comprising electronic image sensorsControl thereof provided with illuminating means