Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Schembri, Danjeli
Abrégé
A computer-implemented method for processing 3D audio, the method comprising: there is provided a computer-implemented method for processing 3D audio, the method comprising: obtaining a first ambisonic signal representing a sound; and upmixing the first ambisonic signal to derive a second ambisonic signal representing the sound; wherein the second ambisonic signal is a higher quality representation of the sound than the first ambisonic signal. This reduces the storage and processing requirements of providing high quality 3D audio.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
G10L 19/008 - Codage ou décodage du signal audio multi-canal utilisant la corrélation inter-canaux pour réduire la redondance, p. ex. stéréo combinée, codage d’intensité ou matriçage
H04S 5/00 - Systèmes pseudo-stéréophoniques, p. ex. dans lesquels les signaux d'un canal supplémentaire sont dérivés du signal monophonique par déphasage, retardement ou réverbération
2.
Computer-Implemented Method For Generating Reverb In A Video Game Environment
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Cockram, Philip
Armstrong, Calum
Schembri, Danjeli
Abrégé
Disclosed herein is a computer-implemented method for generating reverb on an audio signal in a video game environment during gameplay. The method comprises receiving data from a virtual camera arranged in the video game environment during gameplay. The method also comprises processing the virtual camera data to determine one or more features of the video game environment that influence the reverb on an audio signal within the video game environment. The method further comprises generating reverb on an audio signal based on the one or more features of the video game environment.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/5252 - Changement des paramètres des caméras virtuelles utilisant plusieurs caméras virtuelles simultanément ou séquentiellement, p. ex. en commutant automatiquement entre caméras virtuelles fixes lorsqu’un personnage change de pièce ou l’affichage de la vue d’un rétroviseur dans un jeu de conduite automobile
3.
Method For Outputting Sound Effects During Video Game Gameplay
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Ward-Foxton, Nick
Walker, Andrew William
Armstrong, Calum
Tolonen, Juuso
Abrégé
A computer-implemented method for outputting a sound effect during video game gameplay is disclosed. The method comprises the steps of: determining a sound effect to be output; retrieving a source sound and a sound-editing operator from a memory device, wherein the sound-editing operator comprises an edit that, when applied to the source sound, generates the sound effect to be output; applying the sound-editing operator to the source sound to generate the sound effect to be output; and outputting the sound effect.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
G11B 27/031 - Montage électronique de signaux d'information analogiques numérisés, p. ex. de signaux audio, vidéo
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Michailidis, Lazaros
Abrégé
A computer-implemented method for generating an animation for a gameplay event during gameplay, the method comprising: determining a gameplay event during gameplay; determining an audio signal, wherein the audio signal corresponds to the gameplay event; determining an audio property of the audio signal; generating an animation for the gameplay event based on the determined audio property of the audio signal; and outputting the audio signal and generated animation. This generates animations for gameplay events with a reduced usage of processing and memory resources.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/57 - Simulations de propriétés, de comportement ou de déplacement d’objets dans le jeu, p. ex. calcul de l’effort supporté par un pneu dans un jeu de course automobile
5.
Method Of Generating A Sound Effect For A Video Game
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Barn, Lewis
Buchanan, Christopher
Abrégé
A computer-implemented method of generating a sound effect for a video game. The method comprises: receiving a first sound effect file comprising one or more sound effect features; receiving a first animation representing an action in the video game; determining, based on the received animation, one or more constraints to be applied to the or each sound effect features; adjusting the or each sound effect feature so as to produce corresponding adjusted sound effect features satisfying the determined constraints; and generating a second sound effect file comprising the adjusted sound effect features.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/55 - Commande des personnages ou des objets du jeu en fonction de la progression du jeu
6.
GENERATING A RENDERED IMAGE OF A THREE-DIMENSIONAL OBJECT
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Andreopoulos, Ioannis
Treder, Matthias Sebastian
Lutz, Sebastian Alexander
Chowdhury, Pinaki Nath
Lim, Jia-Jie
Abrégé
A computer-implemented method for generating a rendered image of a three-dimensional object. A meta-storage component is used, that contains at least two pre-constructed grids of three-dimensional data grid points corresponding to features of three-dimensional visual representations of a plurality objects or scenes. A selection code is received, that represents the shape and appearance of the three-dimensional object. An instantiation of the three- dimensional object is constructed, using a selector component, by querying the meta storage component using the selection code to retrieve at least one combination of at least two pre- constructed grids of three-dimensional data grid points from the meta-storage component. A rendered image of the three-dimensional object is then generated using the instantiation of the three-dimensional object.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Andreopoulos, Ioannis
Treder, Matthias Sebastian
Lutz, Sebastian Alexander
Chowdhury, Pinaki Nath
Lim, Jia-Jie
Abrégé
Data representing a 3D object to be rendered is obtained, the data comprising: a mesh structure defining 3D co-ordinates for each of a plurality of object vertices; and a feature vector encoding visual characteristics for at least one object surface defined by the plurality of object vertices. Motion information indicative of motion of the object in a scene is received. Based on the motion information, the mesh structure is deformed by adjusting the co-ordinates for one or more of the plurality of object vertices. The deformed mesh structure is processed using a graphics pipeline comprising a vertex shader and a fragment shader to generate a rendered image of the scene. The fragment shader comprises an artificial neural network trained to output pixel colour values for the at least one object surface on the basis of the visual characteristics encoded in the feature vector.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Andreopoulos, Ioannis
Treder, Matthias Sebastian
Lutz, Sebastian Alexander
Chowdhury, Pinaki Nath
Lim, Jia-Jie
Abrégé
Data representing a 3D object to be rendered is obtained at a user device, the data comprising: a mesh structure defining 3D co-ordinates for each of a plurality of object vertices; and a feature vector encoding visual characteristics for an object surface defined by the plurality of object vertices. An artificial neural network, ANN, is selected from a plurality of ANNs stored on the user device, each of the plurality of ANNs being configured to output pixel colour values for the object surface based on at least some of the visual characteristics encoded in the feature vector, wherein different ANNs have different numbers of layers and/or different numbers of parameters, wherein the selection is based on a resource characteristic of the user device. The mesh structure is processed using the selected ANN to generate a rendered image of the three-dimensional object.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Sony Interactive Entertainment LLC. (USA)
Inventeur(s)
Jones, Michael Lee
Buchanan, Christopher
Schembri, Danjeli
Buffoni, Louis-Xavier
Lee, Allen
Abrégé
A computer-implemented method for decorrelating a set of simulated audio signals in a virtual environment is disclosed. The method comprises the steps of: obtaining a first set of decorrelation filters; evaluating the first set of decorrelation filters to determine a similarity metric representing the similarity between the first set of decorrelation filters; if the similarity metric is above a predetermined threshold, regenerating the set of decorrelation filters so as to reduce the similarity metric; and applying the regenerated set of decorrelation filters to the simulated audio signals.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Thresh, Lewis
Buchanan, Christopher
Abrégé
A method for compensating for a crash event during display of a virtual environment on a virtual reality, VR, headset, the method comprising: receiving virtual display content representing a virtual environment, tracking the orientation of the VR headset, rendering and displaying virtual display content according to the orientation of the VR headset during normal operation, prior to a crash event; rendering future virtual display content associated with a plurality of possible orientations of the VR headset; detecting a crash event, preventing further rendering of virtual display content; and displaying a virtual display sequence based on the rendered future virtual display content after the crash event to prevent a sudden stop in the display of the virtual environment.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Panesar, Pritpal Singh
Ryan, Nicholas Anthony Edward
Abrégé
A computer-implemented method for generating haptic feedback to accompany an audio signal, the method comprising: detecting a predetermined audio signal in one or more monitored audio channels (11); and in response to detecting the predetermined audio signal, triggering a haptic feedback signal in a haptic feedback channel (42), wherein the haptic feedback channel is synchronized with the one or more monitored audio channels.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Henderson, Christopher William
Abrégé
A method and system is provided which trains a neural network which can be used to provide a player presence in a computer generated gaming environment.
A63F 13/67 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu en s’adaptant à ou par apprentissage des actions de joueurs, p. ex. modification du niveau de compétences ou stockage de séquences de combats réussies en vue de leur réutilisation
13.
Method For Generating An Acoustic Environment Model
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Couthier, Loic
Smith, Alexei
Ward-Foxton, Nick
Suganuma, Atsushi
Buchanan, Christopher
Thresh, Lewis
Eder, Michael
Barn, Lewis
Abrégé
A computer-implemented method for generating an acoustic environment model for a video game level is provided. The method comprises: obtaining graphical data for visually rendering a gameplay environment of the video game level, the graphical data comprising a three-dimensional geometrical model for the gameplay environment, and generating, based on the graphical data, an acoustic environment model corresponding to the gameplay environment and adapted for the simulating of gameplay sounds therein.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Stemple, Lloyd
Tolonen, Juuso
Abrégé
The invention includes a computer-implemented method of determining a required length of a scene comprising a speaking character, wherein the scene is localized in multiple spoken languages, the method comprising: obtaining a script for the speaking character in a first language; automatically translating the script into one or more second languages; performing text-to-speech processing to generate a localized audio sample for the script in each of the first language and the one or more second languages; determining a duration of the localized audio sample in each of the first language and the one or more second languages; and determining a maximum spoken duration of the script as the maximum of the respective durations of the localized audio sample in each of the first language and the one or more second languages.
G10L 13/08 - Analyse de texte ou génération de paramètres pour la synthèse de la parole à partir de texte, p. ex. conversion graphème-phonème, génération de prosodie ou détermination de l'intonation ou de l'accent tonique
G06F 40/58 - Utilisation de traduction automatisée, p. ex. pour recherches multilingues, pour fournir aux dispositifs clients une traduction effectuée par le serveur ou pour la traduction en temps réel
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Thresh, Lewis
Buchanan, Christopher
Tan, Bee Lay
Eder, Michael
Abrégé
A method of adjusting an in-game audio output of a video gaming system, where the video gaming system comprises loudspeakers for outputting the in-game audio output and a user device comprising a microphone, the user device configured to be worn on an ear of the user, the method comprising: outputting a calibration signal, the calibration signal comprising an audio signal; receiving the calibration signal with the microphone of the user device; determining the location of the user device relative to the loudspeakers based on the received calibration signal; adjusting the in-game audio output based on the determined location of the user device.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Barn, Lewis
Thresh, Lewis
Eder, Michael
Abrégé
A computer-implemented method of producing a video game environment. The method comprises receiving a representation of the video game environment, identifying a first object in the video game environment, and identifying, based on a graphical representation of the first object, one or more properties of the first object suitable for selecting a sound effect to be applied to the first object. A sound effect is applied to the first object in the video game environment based on the one or more identified properties.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/52 - Commande des signaux de sortie en fonction de la progression du jeu incluant des aspects de la scène de jeu affichée
A63F 13/5372 - Commande des signaux de sortie en fonction de la progression du jeu incluant des informations visuelles supplémentaires fournies à la scène de jeu, p. ex. en surimpression pour simuler un affichage tête haute [HUD] ou pour afficher une visée laser dans un jeu de tir utilisant des indicateurs, p. ex. en montrant l’état physique d’un personnage de jeu sur l’écran pour marquer les personnages, les objets ou les lieux dans la scène de jeu, p. ex. en affichant un cercle autour du personnage commandé par le joueur
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Eder, Michael
Buchanan, Christopher
Barn, Lewis
Abrégé
A method of adjusting an in-game audio output of a video gaming system, where the video gaming system comprises loudspeakers for outputting the in-game audio output and a user device comprising a microphone, the method comprising: outputting a calibration signal with the loudspeakers on a continual basis during use of the video gaming system, the calibration signal comprising an audio signal; receiving the calibration signal with the microphone of the user device and repeatedly determining the location of the user device relative to the loudspeakers based on the received calibration signal to monitor a varying location of the user during use of the video gaming system; repeatedly adjusting the in-game audio output based on the determined location of the user device during use of the video gaming system.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
H04S 7/00 - Dispositions pour l'indicationDispositions pour la commande, p. ex. pour la commande de l'équilibrage
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Murphy, Alan
Cockram, Phillip
Abrégé
A method of generating audio output by a video gaming system is provided, the method comprising: obtaining one or more properties of an audio output device connected to the video gaming system; generating an adapted audio output for the audio output device by selecting, according to selection criteria, a subset of the audio components based on the obtained properties of the audio output device; and outputting only the selected audio components.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/87 - Communiquer avec d’autres joueurs, p. ex. par courrier électronique ou messagerie instantanée
H04R 3/04 - Circuits pour transducteurs pour corriger la fréquence de réponse
19.
System And Device For Designing And Generating A Haptic Output
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Barn, Lewis
Buchanan, Christopher
Tan, Bee Lay
Abrégé
A system for designing and generating a haptic output, the system comprising: a user device for editing and generating a haptic control signal, the user device comprising a hand-operated input device for receiving user inputs to set one or more parameters of a haptic control signal and a processor configured to generate the haptic control signal based on the set parameters; and a haptic actuator device configured to provide a haptic output to the user via a contact surface according to the haptic control signal, wherein the haptic actuator device is arranged such that the contact surface is maintained in contact with the user's hand during use, while permitting movement of the user's hand to operate the input device.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Schembri, Danjeli
Abrégé
A method for rendering 3D audio is provided. The method includes: obtaining a to-be-output audio signal, wherein the to-be-output audio signal comprises one or more audio layers; selecting a to-be-filtered audio layer from the one or more audio layers; selecting a rendering Head-Related Transfer Function, HRTF, from a database of HRTFs; applying the rendering HRTF to the to-be-filtered audio layer to generate a filtered audio layer, such that the to-be-output audio signal comprises the filtered audio layer and is a 3D audio signal. In this way, 3D effects are only applied to specific audio layers of an audio signal, thereby efficiently rendering 3D audio without unnecessarily impacting the timbre of the audio signal.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Schembri, Danjeli
Eder, Michael
Cockram, Philip
Thresh, Lewis
Thwaites, Joseph
Barn, Lewis
Buchanan, Christopher
Abrégé
A computer-implemented method of generating a sound effect, comprising: obtaining a plurality of sounds; determining a common effect characteristic of the plurality of obtained sounds; obtaining a base sound; and generating the sound effect by applying the common effect characteristic to the base sound.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
G10H 1/00 - Éléments d'instruments de musique électrophoniques
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Thresh, Lewis
Barn, Lewis
Eder, Michael
Schembri, Danjeli
Panesar, Pritpal Singh
Costantini, Giacomo
Abrégé
A method for adjusting the audio output of a video gaming system during gameplay, the method comprising: measuring the usage of a processing unit of the video gaming system during gameplay, wherein the video gaming system is configured to output an audio stream comprising a plurality of audio components, the processing unit configured to process an audio data file to output each audio component; adjusting an output quality of one or more audio components of the audio stream in response to the measured usage of the processing unit. The method allows for dynamic adjustment of the audio output quality based on the capacity of the processing unit.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Hume, Oliver
Cockram, Philip
Abrégé
The invention provides a computer-implemented method of reducing latency in a cloud gaming system, the cloud gaming system comprising a local user device and a connected remote server, the method comprising: receiving a user input at the user device, wherein the user input initiates a gameplay event, the gameplay event comprising a visual output and one or both of an audio output and a haptic output, each to be outputted locally at the local user device; processing graphical data remotely at a processing unit of the server to provide the visual output of the gameplay event; and processing one or both of audio data and haptic data locally at a processing unit of the user device to provide the one or both of the audio output and the haptic output of the gameplay event respectively.
A63F 13/358 - Adaptation du déroulement du jeu en fonction de la charge du réseau ou du serveur, p. ex. pour diminuer la latence due aux différents débits de connexion entre clients
A63F 13/285 - Génération de signaux de retour tactiles via le dispositif d’entrée du jeu, p. ex. retour de force
A63F 13/335 - Dispositions d’interconnexion entre des serveurs et des dispositifs de jeuDispositions d’interconnexion entre des dispositifs de jeuDispositions d’interconnexion entre des serveurs de jeu utilisant des connexions de réseau étendu [WAN] utilisant l’Internet
A63F 13/50 - Commande des signaux de sortie en fonction de la progression du jeu
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Bevan, Matteo
Nguyen, Phuong Anh
Abrégé
An image generation system operable to generate updated views of an object in a scene, the system comprising an input obtaining unit configured to obtain one or more user inputs for controlling the pose of the object, an object pose modification unit configured to determine an updated pose of the object in accordance with the obtained user inputs, a hand pose determination unit configured to determine a pose for each of the hands associated with the object in accordance with the obtained user inputs, wherein the determining comprises generating a corresponding representation of the hands with the respective determined poses based upon two or more reference views of the hands, the reference views corresponding to different respective poses of the hands, a grab pose determination unit configured to determine a grab pose for each of the hands, the grab pose comprising a pose for fingers of each of the hands determined in dependence upon the updated object pose and a corresponding hand pose, and a rendering unit configured to generate one or more images of the object and associated hands in dependence upon the determined poses of the object, hands, and fingers.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Cockram, Philip
Abrégé
The invention provides a computer-implemented method of determining and generating diegetic audio originating from a virtual event in a virtual gaming environment, the virtual gaming environment comprising a user avatar and a virtual fluid medium, and the virtual event comprising a first virtual object moving in the virtual fluid medium, the method comprising the steps of: obtaining bulk properties and the virtual domain of the virtual fluid medium; obtaining physical properties and kinematic properties of a first virtual object moving in the virtual domain of the virtual fluid medium; obtaining a physics model based on the bulk properties, the virtual domain, the physical properties, and the kinematic properties; obtaining outputs from the physics model; determining the diegetic audio originating from the virtual event based on the outputs from the physics model; and generating the diegetic audio originating from the virtual event.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Amadori, Pierluigi Vito
Abrégé
A computer-implemented system and method of providing a personalized experience to players of applications delivering a virtual environment, such as a virtual game world. A cloud-deployed machine learning (ML) model implements a player state service to gather data from input devices and historical data, such as past game-play, to infer physiological and behavioral data (a player state vector) which may be used to represent the current cognitive state of the player.
A63F 13/67 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu en s’adaptant à ou par apprentissage des actions de joueurs, p. ex. modification du niveau de compétences ou stockage de séquences de combats réussies en vue de leur réutilisation
A63F 13/211 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types utilisant des capteurs d’inertie, p. ex. des accéléromètres ou des gyroscopes
A63F 13/22 - Opérations de configuration, p. ex. le calibrage, la configuration des touches ou l’affectation des boutons
A63F 13/355 - Réalisation d’opérations pour le compte de clients ayant des capacités de traitement restreintes, p. ex. serveurs transformant une scène de jeu qui évolue en flux vidéo codé à transmettre à un téléphone portable ou à un client léger
A63F 13/79 - Aspects de sécurité ou de gestion du jeu incluant des données sur les joueurs, p. ex. leurs identités, leurs comptes, leurs préférences ou leurs historiques de jeu
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Andreopoulos, Ioannis
Zisimopoulos, Odysseas
Lim, Jia-Jie
Soltanayev, Shakarim
Lechat, Alexis
Abrégé
A computer-implemented method of transmitting video data. A sequence of video frames is received. A warp operation for a first frame and a reference frame of the sequence of video frames is determined, wherein the warp operation defines a transformation of the reference frame to give an approximation of the first frame. One or more regions of interest of the first frame are identified. Encoded image data from the image data of the one of more regions of interest of the first frame is generated using an image encoder. The warp operation and the encoded image data are transmitted.
H04N 19/86 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le pré-traitement ou le post-traitement spécialement adaptés pour la compression vidéo mettant en œuvre la diminution des artéfacts de codage, p. ex. d'artéfacts de blocs
G06N 3/084 - Rétropropagation, p. ex. suivant l’algorithme du gradient
H04N 19/154 - Qualité visuelle après décodage mesurée ou estimée de façon subjective, p. ex. mesure de la distorsion
H04N 19/167 - Position dans une image vidéo, p. ex. région d'intérêt [ROI]
H04N 19/172 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le codage adaptatif caractérisés par l’unité de codage, c.-à-d. la partie structurelle ou sémantique du signal vidéo étant l’objet ou le sujet du codage adaptatif l’unité étant une zone de l'image, p. ex. un objet la zone étant une image, une trame ou un champ
H04N 19/184 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le codage adaptatif caractérisés par l’unité de codage, c.-à-d. la partie structurelle ou sémantique du signal vidéo étant l’objet ou le sujet du codage adaptatif l’unité étant des bits, p. ex. de flux vidéo compressé
H04N 19/42 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques caractérisés par les détails de mise en œuvre ou le matériel spécialement adapté à la compression ou à la décompression vidéo, p. ex. la mise en œuvre de logiciels spécialisés
H04N 19/60 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant un codage par transformée
H04N 19/80 - Détails des opérations de filtrage spécialement adaptées à la compression vidéo, p. ex. pour l'interpolation de pixels
28.
COMPUTER-IMPLEMENTED METHOD AND SYSTEM FOR GENERATING VISUAL ADJUSTMENT IN A COMPUTER-IMPLEMENTED INTERACTIVE ENTERTAINMENT ENVIRONMENT
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Kavallierou, Michael Adam
Visciglia, Aron Giuseppe
Stemple, Lloyd Preston
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
Disclosed herein is a method and system for generating an adjustment in a visual aspect of a computer-implemented interactive environment. The method and system conserve the resources of the computing resource implementing the environment and still enable visual representations of users, such as avatars, to be generated.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Sony Interactive Entertainment LLC (USA)
Inventeur(s)
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Kawamura, Daisuke
Bhat, Ramanath
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
A method of dataset generation is described. The method comprises steps including receiving user image data and generating personalised training data based on the received user image data. Generating personalised training data comprises generating a computational model based at least in part on the received user data and generating the personalised training data based on the computational model.
G06V 10/774 - Génération d'ensembles de motifs de formationTraitement des caractéristiques d’images ou de vidéos dans les espaces de caractéristiquesDispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant l’intégration et la réduction de données, p. ex. analyse en composantes principales [PCA] ou analyse en composantes indépendantes [ ICA] ou cartes auto-organisatrices [SOM]Séparation aveugle de source méthodes de Bootstrap, p. ex. "bagging” ou “boosting”
G06T 17/20 - Description filaire, p. ex. polygonalisation ou tessellation
G06V 10/776 - ValidationÉvaluation des performances
G06V 40/16 - Visages humains, p. ex. parties du visage, croquis ou expressions
30.
COMPUTER-IMPLEMENTED METHOD FOR CONTROLLING A VIRTUAL AVATAR
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Sivo, Cesare
Abrégé
A system and computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user; receiving input data from a plurality of input sources, wherein the plurality of input sources includes an imaging source configured to provide images of the user's face, wherein each of the plurality of input sources has an active state and an inactive state, and input data is only received from an input source in the active state; processing the input data; updating the base model in response to the processed input data to update at least one property of the virtual avatar and rendering the updated base model to display the virtual avatar on a display screen.
G06T 13/40 - Animation tridimensionnelle [3D] de personnages, p. ex. d’êtres humains, d’animaux ou d’êtres virtuels
A63F 13/213 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de photo-détection, p. ex. des caméras, des photodiodes ou des cellules infrarouges
31.
SYSTEM AND METHOD FOR INVOLUNTARY USER COMMAND COMPENSATION ON AN INPUT DEVICE
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Amadori, Pierluigi Vito
Abrégé
There is described a computer-implemented method for involuntary user command compensation on an input device, the method comprising; receiving a user command from at least one input source of an input device; determining whether the user command is an involuntary user command; if it is determined that the user command is an involuntary user command, applying a compensation action to the user command; and issuing a compensated user command output based on the compensation action. There is also described a computer program product and a system.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Sony Interactive Entertainment LLC (USA)
Inventeur(s)
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Kawamura, Daisuke
Bhat, Ramanath
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
A computer-implemented system and method for real-time customization of a virtual avatar, comprising providing a virtual avatar associated with a user, receiving an image of the user and at least a portion of their surroundings, applying a facial detection algorithm to detect the user's face in the image, extracting a region of interest from the image, the region of interest including the user's face, providing the region of interest to a data model, processing the region of interest, by the data model, and using feature recognition to determine whether the region of interest comprises a feature from a set of predefined features. In response to determining that the region of interest comprises a feature from a set of predefined features, the appearance of the virtual avatar is updated.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
University of York (Royaume‑Uni)
Inventeur(s)
Bradley, Timothy
Barreiro, Marina Villanueva
Hume, Oliver
Spick, Ryan
Walker, James
Abrégé
A method of point cloud generation comprises generating, by a processor, a first point cloud comprising a first set of generated data points; calculating, by the processor, a loss function representative of the quality of the first point cloud, the loss function comprising a smoothness term obtained by constructing vectors between neighbouring data points in the point cloud, performing vector multiplication between neighbouring pairs of vectors, and outputting a smoothness term based on the result of the vector multiplication; and generating, by the processor, a second point cloud comprising a second set of generated data points based at least in part on the calculated loss function of the first point cloud.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Sony Interactive Entertainment LLC (USA)
Inventeur(s)
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Kawamura, Daisuke
Bhat, Ramanath
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
There is described a computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising; providing a virtual avatar associated with a user, wherein the virtual avatar is associated with a plurality of poses and a plurality of animations; receiving input data associated with the user from at least one input source; processing the input data, the input data comprising images of the user and/or audio data captured from the user; determining a user mannerism from the processed input data; and updating at least one of the plurality of poses and/or animations of the virtual avatar, or creating a new pose and/or animation, to apply the user mannerism to the virtual avatar. There is also described a computing device configured to carry out the computer-implemented method.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Sony Interactive Entertainment LLC (USA)
Inventeur(s)
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Kawamura, Daisuke
Bhat, Udupi Ramanath
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
A computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user profile corresponding to a user; receiving input data from at least one of a plurality of multimedia input sources; processing the input data; determining a baseline avatar and a dynamic avatar using the processed input data; generating an output avatar based on the determined baseline avatar and the determined dynamic avatar; updating the base model by adding the generated output avatar to the base model; and rendering the updated base model to display the virtual avatar on a display screen.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Schembri, Danjeli
Jones, Mike
Buchanan, Christopher
Karshenas, Nima
Abrégé
An audio personalisation method for generating a personalised Head-Related Transfer Function, HRTF, the method comprising the steps of: obtaining a base HRTF model comprising a first set of parameters; outputting a sound from a virtual sound source according to the base HRTF model, the virtual sound source having an intended virtual position; receiving at least one user indication corresponding to a user virtual position of the virtual sound source, wherein the intended virtual position is different to the user virtual position; updating the first set of parameters to a second set of parameters based on the at least one indication from the user so as to update the user virtual location; and generating a personalised HRTF model comprising the second set of parameters, wherein the difference between the intended virtual position and the user virtual position according to the personalised HRTF model is less than the difference between the intended virtual position and the user virtual position according to the base HRTF model.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Murphy, Alan Suganuma
Amadori, Pierluigi Vito
Abrégé
A computer implemented method for autonomous anomalous device behaviour detection. Including receiving behaviour data, wherein the behaviour data is indicative of a user's inputs to an electronic device. A behaviour pattern label and an indication to the likelihood of an anomaly occurring are determined based on the received behaviour data, wherein the behaviour pattern label belongs to behaviour pattern label hierarchy.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Childs, Codie Marie
Abrégé
A computer-implemented method for identifying proprietary content in composite media comprising a plurality of media components, the method comprising: identifying a first media component of the composite media as proprietary content; identifying a second media component of the composite media as a context indicator; and determining a context for the proprietary content based on the context indicator.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Cerrato, Maurizio
Monti, Maria Chiara
Leonardi, Rosario
Bernabei, Daniele
Abrégé
There is provided a computer-implemented method for anti-aliasing an image frame in an image stream. The method comprises providing an input to a data model, the data model being configured to perform anti-aliasing on a present frame which is displayed after a previous frame in the image stream. The input comprises: an anti-aliased image of the previous frame; an aliased image of the present frame; an ID map of the previous frame; an ID map of the present frame; and a velocity map based on changes between the previous frame and the present frame. The data model processes the received inputs to correlate image portions of the previous frame and image portions of the present frame based on the inputs and performing anti-aliasing on the present frame based at least in part on the correlated image portions. An anti-aliased image of the present frame is received as an output of the data model.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Bigos, Andrew James
Motilla, Daniel Montero
Abrégé
A method and system for improving a resolution of an image frame is described. The image frame is part of a data stream. The data stream may be a video game, for example. The method comprising the following steps. Sending an encoded version of the image frame from a server to a client device via a first communication channel between the server and the client device. Detecting a reduced bandwidth of the first communication channel. In response to detecting the reduced bandwidth, determining data to be sent to the client device via a second communication channel. The second communication channel is separate to the first communication channel and the data relates to the image frame. The determined data is sent via the second communication channel.
G06T 5/50 - Amélioration ou restauration d'image utilisant plusieurs images, p. ex. moyenne ou soustraction
H04L 45/00 - Routage ou recherche de routes de paquets dans les réseaux de commutation de données
H04L 65/80 - Dispositions, protocoles ou services dans les réseaux de communication de paquets de données pour prendre en charge les applications en temps réel en répondant à la qualité des services [QoS]
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Brislin, Simon Andrew St John
Ryan, Nicholas Anthony Edward
Abrégé
A method for identifying a cutscene in gameplay footage, the method comprising: receiving a first video signal and a second video signal each comprising a plurality of images; creating a first video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the first video signal; creating a second video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the second video signal; comparing the first video fingerprint with the second video fingerprint; and identifying a cutscene when at least a portion of the first video fingerprint has at least a threshold level of similarity with at least a portion of the second video fingerprint.
A63F 13/355 - Réalisation d’opérations pour le compte de clients ayant des capacités de traitement restreintes, p. ex. serveurs transformant une scène de jeu qui évolue en flux vidéo codé à transmettre à un téléphone portable ou à un client léger
G06F 17/17 - Évaluation de fonctions par des procédés d'approximation, p. ex. par interpolation ou extrapolation, par lissage ou par le procédé des moindres carrés
G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
H04L 9/32 - Dispositions pour les communications secrètes ou protégéesProtocoles réseaux de sécurité comprenant des moyens pour vérifier l'identité ou l'autorisation d'un utilisateur du système
42.
Haptic Module and Controller Having Rotational Weight Distribution
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Hume, Oliver
Karshenas, Nima
Abrégé
A controller for a multimedia entertainment system is provided. The controller comprises a weighted component connected to the controller, wherein the weighted component is rotationally movable relative to the controller. The controller is configured to rotate the weighted component from a start position to an end position to shift the centre of mass of the controller in response to a trigger event; wherein the weighted component stops moving at the end position. This movement of the weighted component provides directional haptic feedback to a user of the controller.
A63F 13/285 - Génération de signaux de retour tactiles via le dispositif d’entrée du jeu, p. ex. retour de force
A63F 13/211 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types utilisant des capteurs d’inertie, p. ex. des accéléromètres ou des gyroscopes
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Bhunia, Ayan
Khan, Muhammad Umar Karim
Chadha, Aaron
Andreopoulos, Ioannis
Abrégé
Image data of a first image in a sequence of images is processed using an artificial neural network (ANN) to generate output image data indicative of an alignment of the first image with a second image in the sequence. The ANN is trained using outputs of an alignment pipeline configured to perform alignment of images. The alignment pipeline is configured to determine flow vectors representing optical flow between images, and perform an image transformation using the flow vectors to align the images. The ANN is trained to emulate a result derivable using the alignment pipeline.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Khan, Muhammad Umar Karim
Bhunia, Ayan
Chadha, Aaron
Andreopoulos, Ioannis
Abrégé
Image data representing one or more images at a first resolution is received at a first artificial neural network (ANN). The image data is processed using the first ANN to generate upscaled image data representing the one or more images at a second, higher resolution. The first ANN is trained to perform image upscaling and is trained using first training image data representing one or more training images at the first resolution, the first training image data being at a first level of quality. The first ANN is also trained using features of a second ANN, wherein the second ANN is trained to perform image upscaling and is trained using second training image data representing one or more training images at the first resolution, the second training image data being at a second level of quality, higher than the first level of quality.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Cockram, Philip
Abrégé
A system for generating a personalised Head-Related Transfer Function, HRTF, for a user, the system comprising: a sound source at a first position; a user device comprising: a left microphone arranged to be at a left ear of the user, when the user device is worn; a right microphone arranged to be at a right ear of the user, when the user device is worn; and a controller configured to: prompt the user to move to series of different second positions; control the sound source to emit a predetermined sound signal when the user is at each second position; obtain a detected sound signal from each of the left and right microphones when the user is at each second position; generate a personalised HRTF based on the predetermined sound signal and the detected sound signal for each microphone and each second position.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Abrégé
A computer-implemented method includes identifying a gaming device in a real-world environment, the gaming device providing a user experience to a user in a mixed-reality setting, identifying an object in the real-world environment in proximity to the gaming device, and initiating an activity relating to the object based on a virtual part of the mixed-reality setting.
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Abrégé
A computer-implemented method includes selecting a virtual object to be positioned in a mixed-reality environment, the virtual object having one or more conditions relating to the positioning of the virtual object, scanning a real-world part of the mixed-reality environment, determining a location to position the virtual object based on the scan, wherein the location satisfies the one or more conditions, scaling the virtual object based on the location, and positioning the virtual object in the mixed-reality environment at the determined location.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Abrégé
An audio personalisation method for simulating perception of a vertical displacement of a sound source, the method comprising the steps of: obtaining an input head related transfer function, HRTF, associated with a user; determining an intended vertical displacement for the sound source; selecting at least one frequency region in the input HRTF; and adjusting the amplitude of the selected frequency region(s) to simulate the intended vertical displacement for the sound source. This provides improvements to the generation and/or manipulation of HRTFs to allow adjustment of the perceived location of a sound source.
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Recorded video game software; downloadable video game
software; video game software; recorded computer game
software; downloadable computer game software; computer game
software; recorded virtual reality game software;
downloadable virtual reality game software; virtual reality
game software; augmented reality game software; video game
software downloadable to mobile phones, tablet computers,
and other electronic mobile devices; multimedia and
interactive software; downloadable digital media, namely,
downloadable images, downloadable artwork, downloadable text
files, downloadable audio files, downloadable video files,
and downloadable game software; downloadable and recorded
software tools for facilitating the development and
operation of computer games and video games; downloadable
and recorded game engine software for computer and video
game development and operation. Entertainment services, namely, providing temporary use of
non-downloadable video games and computer games;
entertainment services, namely, providing online video games
and computer games; providing online entertainment;
entertainment services, namely, providing information
relating to video games and computer games via computer
networks and global communication networks; entertainment
services, namely, providing virtual environments in which
users can interact for recreational, leisure, or
entertainment purposes; providing a web-based system and
on-line portal for customers to participate in on-line
gaming, operation and coordination of game tournaments,
leagues and tours for recreational computer game playing
purposes; online journals, namely, blogs featuring articles
about video games and video game development. Design and development of video game software, computer game
software, virtual reality game software, and augmented
reality game software; design and development of software in
the field of mobile applications featuring video games or
for use with video games; video game and computer game
development services; providing temporary use of online
non-downloadable game software; providing online
non-downloadable software tools for facilitating the
development and operation of video games and computer games;
technical support services, namely, troubleshooting and
providing technical advice and information for video game
software and computer game software problems.
50.
REPRESENTING VIRTUAL OBJECTS OUTSIDE OF A DISPLAY SCREEN
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Abrégé
A computer-implemented method for representing virtual objects outside of a display screen, comprising: receiving data defining a virtual environment that comprises a plurality of virtual objects, each virtual object having a virtual location within the virtual environment, displaying, on a display screen, a portion of the virtual environment that is within a field of view controlled by a user determining if at least one virtual object of a subset of the virtual objects is outside of the field of view but at least partially within a virtual display area adjacent the display screen. In response to determining that a virtual object of the subset of the virtual objects is at least partially within the virtual display area, the method comprises converting the virtual location of the virtual object into a real-world location, and displaying a virtual element representing the virtual object at the real-world location using a mixed-reality display device.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Abrégé
A computer-implemented method for detecting a display screen using an extended reality display device, comprising receiving, at the extended reality display device, an image, or data defining an image, corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points, monitoring a display screen that is displaying the video stream, detecting at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen, and determining, based on the detected specified feature points, the physical boundaries of the display screen.
G06V 20/20 - ScènesÉléments spécifiques à la scène dans les scènes de réalité augmentée
G06V 10/44 - Extraction de caractéristiques locales par analyse des parties du motif, p. ex. par détection d’arêtes, de contours, de boucles, d’angles, de barres ou d’intersectionsAnalyse de connectivité, p. ex. de composantes connectées
G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
G06T 7/73 - Détermination de la position ou de l'orientation des objets ou des caméras utilisant des procédés basés sur les caractéristiques
52.
COMPUTER IMPLEMENTED METHOD AND SYSTEM FOR PROVIDING AN AUGMENTED REALITY ENTERTAINMENT ENVIRONMENT
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Abrégé
A method and system are provided which enable an object, known or unknown, to be augmented with additional visual elements. This may provide a more immersive experience, for example, when gaming or viewing content.
G06V 20/20 - ScènesÉléments spécifiques à la scène dans les scènes de réalité augmentée
A63F 13/52 - Commande des signaux de sortie en fonction de la progression du jeu incluant des aspects de la scène de jeu affichée
A63F 13/5372 - Commande des signaux de sortie en fonction de la progression du jeu incluant des informations visuelles supplémentaires fournies à la scène de jeu, p. ex. en surimpression pour simuler un affichage tête haute [HUD] ou pour afficher une visée laser dans un jeu de tir utilisant des indicateurs, p. ex. en montrant l’état physique d’un personnage de jeu sur l’écran pour marquer les personnages, les objets ou les lieux dans la scène de jeu, p. ex. en affichant un cercle autour du personnage commandé par le joueur
53.
SYSTEMS AND METHODS FOR CONTROLLING CONTENT STREAMS
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Walker, Andrew William
Downey, Richard Thomas
George, Martin Selby
Murphy, Alan Suganuma
Abrégé
There is provided a method of sending a content stream, comprising retrieving a sender framework associated with the at least one attribute, wherein the sender framework defines an arrangement of the plurality of tracks to be included in an output content stream. The output content stream is defined according to the sender framework. There is also provided a method of outputting a content stream on a user device, comprising receiving a content stream as defined by a sender framework, retrieving a user framework associated with the user electronic device, wherein the user framework defines at least one predetermined setting or instruction to be applied to the content stream, and applying the user framework to the content stream to update the content stream. The method may also include providing viewer engagement information and updating the sender framework in response to the viewer engagement information received.
H04N 21/24 - Surveillance de procédés ou de ressources, p. ex. surveillance de la charge du serveur, de la bande passante disponible ou des requêtes effectuées sur la voie montante
H04N 21/233 - Traitement de flux audio élémentaires
H04N 21/234 - Traitement de flux vidéo élémentaires, p. ex. raccordement de flux vidéo ou transformation de graphes de scènes du flux vidéo codé
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment
services, namely, providing online video games and computer games; entertainment services, namely, providing information
relating to video games and computer games via computer networks and global communication networks; entertainment services,
namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a
web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game
tournaments, leagues and tours for recreational computer game playing purposes; online journals, namely, blogs featuring articles
about video games and video game development Design and development of video game software, computer game software, virtual reality game software, and augmented reality
game software; design and development of software in the field of mobile applications featuring video games or for use with video
games; video game and computer game development services; providing temporary use of online non-downloadable game
software; providing online non-downloadable software tools for facilitating the development and operation of video games and
computer games; technical support services, namely, troubleshooting in the nature of diagnosing computer hardware and
software problems, and providing technical advice and information for video game software and computer game software
problems
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
(1) Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. (1) Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; providing online entertainment; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; online journals, namely, blogs featuring articles about video games and video game development.
(2) Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting and providing technical advice and information for video game software and computer game software problems.
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Recorded video game software; downloadable video game software; video game software; recorded computer game software; downloadable computer game software; computer game software; recorded virtual reality game software; downloadable virtual reality game software; virtual reality game software; augmented reality game software; video game software downloadable to mobile phones, tablet computers, and other electronic mobile devices; multimedia and interactive software; downloadable digital media, namely, downloadable images, downloadable artwork, downloadable text files, downloadable audio files, downloadable video files, and downloadable game software; downloadable and recorded software tools for facilitating the development and operation of computer games and video games; downloadable and recorded game engine software for computer and video game development and operation. Entertainment services, namely, providing temporary use of non-downloadable video games and computer games; entertainment services, namely, providing online video games and computer games; providing online entertainment; entertainment services, namely, providing information relating to video games and computer games via computer networks and global communication networks; entertainment services, namely, providing virtual environments in which users can interact for recreational, leisure, or entertainment purposes; providing a web-based system and on-line portal for customers to participate in on-line gaming, operation and coordination of game tournaments, leagues and tours for recreational computer game playing purposes; providing online, non-downloadable electronic publications in the nature of blogs in the fields of video games and video game development. Design and development of video game software, computer game software, virtual reality game software, and augmented reality game software; design and development of software in the field of mobile applications featuring video games or for use with video games; video game and computer game development services; providing temporary use of online non-downloadable game software; providing online non-downloadable software tools for facilitating the development and operation of video games and computer games; technical support services, namely, troubleshooting and providing technical advice and information for video game software and computer game software problems.
57.
Method for Configuring a Multimedia Entertainment System
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Sanders, Ashley
Everitt, Geoffrey
Nedelcu, Radu-Andrei
Abrégé
A method for configuring a start-up display screen of a multimedia entertainment system, the method comprising: storing time related reference usage data of each application from a plurality of applications configured to run on the multimedia entertainment system; comparing the reference usage data of each application with a current system start up time to identify at least one identified application based on the reference data; and configuring the start-up display screen based on said identified at least one application.
H04N 21/443 - Procédés de système d'exploitation, p. ex. démarrage d'un boîtier décodeur STB, implémentation d'une machine virtuelle Java dans un boîtier décodeur STB ou gestion d'énergie dans un boîtier décodeur STB
H04N 21/47 - Applications pour utilisateurs finaux
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Motilla, Daniel Montero
Bigos, Andrew James
Abrégé
A computer-implemented method for image upscaling at a client device is provided. The method comprising: receiving, from a server device, an image which is one of a plurality of images forming an image stream, wherein the image comprises a plurality of image portions; determining a first group of one or more image portions from the plurality of image portions to apply a first image upscaling process to from a plurality of available image upscaling processes; selecting the first group of image portions based on the determination; and applying the first image upscaling process to the first group of image portions. The upscaling process may be an image upscaling process such as super resolution.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Bigos, Andrew James
Abrégé
A method of generating an image of a scene from a target viewpoint is provided. The method comprises capturing a plurality of multi-plane images of a virtual scene, and determining for each multi-plane image, whether a frontmost clipping plane pair defined for that multi-plane image intersects a virtual object in the virtual scene. Responsive to a positive determination for a respective clipping plane pair, the corresponding image data in the corresponding image plane is identified and assigned an identifier, thus generating a modified version of the corresponding multi-plane image. Camera information is obtained for the one or more virtual cameras that captured the multi-plane images and the target virtual camera. An output image is then generated by combining at least one of the modified multi-plane images with another of the multi-plane images in accordance with the obtained camera information. A corresponding system is also provided.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Chadha, Aaron
Andreopoulos, Ioannis
Treder, Matthias
Lim, Jia-Jie
Abrégé
A method of processing a time-varying signal in a signal processing system. Data representative of one or more first time samples of the time-varying signal is received at an artificial neural network, ANN. The received data is processed using the ANN to generate predicted data representative of a second time sample of the time-varying signal, the second time sample being later than the one or more first time samples. The ANN is trained to predict data representative of time samples of time-varying signals based on data representative of earlier time samples of the time-varying signals. The signal processing system processes the predicted data representative of the second time sample in place of a third time sample of the time-varying signal, the third time sample being earlier than the second time sample.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Booth, John
Jenabzadeh, Mandana
Murphy, Alan Suganuma
Abrégé
A method for generating feedback in a multimedia entertainment system, the method comprising: obtaining an output stream to be output by the multimedia entertainment system; performing feature analysis to identify a feature in the output stream; determining a feedback based on the identified feature; controlling a main audiovisual display to output the output stream; and controlling a peripheral device to output the determined feedback.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Kocdemir, Sahin Serdar
Abrégé
A computer-implemented system and method of providing a positioning system for a virtual environment hosted on a platform to enable sharing of content, comprising assigning each location in the virtual environment a unique location ID, receiving a request to retrieve a unique location ID and sharing the unique location ID with an application or an electronic device, wherein each unique location ID is a data string having a standardized format across different platforms comprising a platform identifier, a title identifier, a level identifier and a position identifier.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Thwaites, Joe
Abrégé
A system comprising: an event detection unit, configured to detect a significant event associated with a video game environment and to selectively output an indication of a detected event; and a separation unit configured to perform source separation on music in playback in dependence upon the indication from the event detection unit, and an audio output unit configured to output for playback audio derived from the result of source separation by the separation unit.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/424 - Traitement des signaux de commande d’entrée des dispositifs de jeu vidéo, p. ex. les signaux générés par le joueur ou dérivés de l’environnement par mappage des signaux d’entrée en commandes de jeu, p. ex. mappage du déplacement d’un stylet sur un écran tactile en angle de braquage d’un véhicule virtuel incluant des signaux d’entrée acoustiques, p. ex. en utilisant les résultats d’extraction de hauteur tonale ou de rythme ou de reconnaissance vocale
A63F 13/215 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de détection des signaux acoustiques, p. ex. utilisant un microphone
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Buchanan, Christopher
Schembri, Danjeli
Abrégé
The invention provides techniques for intelligently positioning speech in a virtual environment. Factors such as user preferences, the location of virtual environment audio and/or visual events, avatar location, and others can be taken into account when selecting a suitable location for the speech. The virtual environment can be a game environment, a meeting environment, an augmented reality environment, a virtual reality environment, and the like. The invention can be implemented by an audio processing unit which may be part of a game console.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
65.
Method for obtaining a position of a peripheral device
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Welton, Paul
Abrégé
A method for obtaining a position of a peripheral device for an audiovisual entertainment system, the method comprising: controlling an audio source to output an audio signal at a first time; determining a second time at which the audio signal arrives at an audio detector, wherein the peripheral device comprises at least one of the audio source and audio detector; and estimating a position of the peripheral device based on an acoustic time-of-flight between the first time and the second time.
G06F 3/033 - Dispositifs de pointage déplacés ou positionnés par l'utilisateurLeurs accessoires
A63F 13/215 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de détection des signaux acoustiques, p. ex. utilisant un microphone
G01S 5/30 - Détermination de distances absolues à partir de plusieurs points espacés d'emplacement connu
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Raghoebardajal, Sharwin Winesh
Pilgrim, Simon
Tattersall, Steven
Rubio, Jose
Abrégé
A system configured to track the location of one or more peripherals operated by a user, the system comprising a tracking unit configured to determine a location of the one or more peripherals in dependence upon images captured by a camera associated with an HMD worn by the user, a generation unit configured to generate, in response to a determination by the tracking unit that one or more of the peripherals is not visible in the images, an array of home points behind the user, the home points being locations defined in dependence upon constraints upon the user's motion, an estimation unit configured to estimate the respective locations of non-visible peripherals in dependence upon the output of one or more inertial measurement units associated with each peripheral, and a selection unit configured to select a home point, from amongst the array of home points, for each of the non-visible peripherals, wherein the tracking unit is configured to generate a location for each non-visible peripheral such that the location converges towards the selected home point.
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G06F 3/0346 - Dispositifs de pointage déplacés ou positionnés par l'utilisateurLeurs accessoires avec détection de l’orientation ou du mouvement libre du dispositif dans un espace en trois dimensions [3D], p. ex. souris 3D, dispositifs de pointage à six degrés de liberté [6-DOF] utilisant des capteurs gyroscopiques, accéléromètres ou d’inclinaison
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Raghoebardajal, Sharwin Winesh
Rubio, Jose
Tattersall, Steven
Abrégé
A data processing apparatus comprises receiving circuitry to receive tracking data indicative of at least one of a tracked position and orientation of a head-mountable display (HMD), image processing circuitry to generate a sequence of images frames for display in dependence upon the tracking data, detection circuitry to detect an image feature in a first image frame and to detect a corresponding image feature in a second image frame, and correlation circuitry to: calculate a difference between the image feature in the first image frame and the corresponding image feature in the second image frame; generate difference data indicative of a difference between a viewpoint for the first image frame and a viewpoint for the second image frame in dependence upon the difference between the image feature in the first image frame and the corresponding image feature in the second image frame; and generate output data in dependence upon a difference between the difference data and the tracking data associated with the first and second image frames.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Raghoebardajal, Sharwin Winesh
Rubio, Jose
Tattersall, Steven
Abrégé
A method of point tracking comprises the steps of receiving successive input image frames from a sequence of input image frames comprising an object to track; for each input frame, detecting a plurality of feature points; mapping a 3D morphable model to the plurality of feature points; performing optical flow tracking of flow points between successive input frames; and correcting optical flow tracking for at least a first flow point position responsive to the mapped 3D morphable model.
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Oto, Tomohiro
Benson, Simon Mark
Bickerstaff, Ian Henry
Abrégé
Methods and apparatus provide for generating an image by way of acquiring information relating to at least one of a position and a rotation of a camera. The image is generated for display on a display unit. A rate at which the image is generated is at a first frequency, which is lower than a second frequency corresponding to a frame rate of the display unit.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Chadha, Aaron
Andreopoulos, Ioannis
Treder, Matthias
Abrégé
A computer-implemented method of processing image data using a model of the human visual system. The model comprises a first artificial neural network system trained to generate the first output data using one or more differentiable functions configured to model the generation of signals from images by the human eye, and a second artificial neural network system trained to generate the second output data using one or more differentiable functions configured to model the processing of signals from the human eye by the human visual cortex. The method comprises receiving image data representing one or more images, processing the received image data using the first artificial neural network system to generate first output data, processing the first output data using a second artificial neural network system to generate second output data. Model output data is determined from the second output data, and output for use in an image processing process.
G06V 10/44 - Extraction de caractéristiques locales par analyse des parties du motif, p. ex. par détection d’arêtes, de contours, de boucles, d’angles, de barres ou d’intersectionsAnalyse de connectivité, p. ex. de composantes connectées
G06N 3/04 - Architecture, p. ex. topologie d'interconnexion
G06V 10/774 - Génération d'ensembles de motifs de formationTraitement des caractéristiques d’images ou de vidéos dans les espaces de caractéristiquesDispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant l’intégration et la réduction de données, p. ex. analyse en composantes principales [PCA] ou analyse en composantes indépendantes [ ICA] ou cartes auto-organisatrices [SOM]Séparation aveugle de source méthodes de Bootstrap, p. ex. "bagging” ou “boosting”
71.
COMPUTER-IMPLEMENTED METHOD FOR COMPLETING AN IMAGE
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Bigos, Andrew James
Goldman, Daniel
Craciun, Cristian
Abrégé
The present disclosure relates to a computer-implemented method for completing an image, the method comprising the steps of dividing data of an image to be completed into a plurality of image portions. The method entails applying a first filling process to fill a first image portion comprising a first hole, the first hole associated with a first quantity and/or a first quality; and applying a second filling process to fill a second image portion comprising a second hole, the second hole associated with a second quantity different to the first quantity and/or a second quality different to the first quality, the second process being different to first process. The method then includes combining the filled first and second image portions to complete the image.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Treder, Matthias
Chadha, Aaron
Fadeev, Ilya
Andreopoulos, Ioannis
Abrégé
A method of processing image data is provided. Pixel data for a first image is preprocessed to identify a subset of the pixel data corresponding to a region of interest depicting a scene element. The subset of the pixel data is processed at a first encoder to generate a first data structure representative of the region of interest, the first data structure identifying the scene element depicted in the region of interest. The subset of pixel data is also processed at a second encoder to generate a second data structure representative of the region of interest, the second data structure comprising values for visual characteristics associated with the scene element. The first and second data structures are outputted for use by a decoder to generate a second image approximating the region of interest of the first image.
G06V 10/25 - Détermination d’une région d’intérêt [ROI] ou d’un volume d’intérêt [VOI]
G06V 10/75 - Organisation de procédés de l’appariement, p. ex. comparaisons simultanées ou séquentielles des caractéristiques d’images ou de vidéosApproches-approximative-fine, p. ex. approches multi-échellesAppariement de motifs d’image ou de vidéoMesures de proximité dans les espaces de caractéristiques utilisant l’analyse de contexteSélection des dictionnaires
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
SONY INTERACTIVE ENTERTAINMENT EUROPE LTD (Royaume‑Uni)
Inventeur(s)
Minamino, Takanori
Nishikawa, Kenzo
Raghoebardajal, Winesh Sharwin
Igarashi, Takeshi
Abrégé
The present invention balances productions costs with ensuring necessary tracking precision. This position input system comprises: an attachment (110) that has a plurality of light-emitting parts (81) which are for detecting the position of the attachment, and an engaging part (89); and a controller (100) that includes an engagement-receiving part (79) to which the engaging part of the attachment can be attached, and a device which is for detecting the position of the controller.
G06F 3/0346 - Dispositifs de pointage déplacés ou positionnés par l'utilisateurLeurs accessoires avec détection de l’orientation ou du mouvement libre du dispositif dans un espace en trois dimensions [3D], p. ex. souris 3D, dispositifs de pointage à six degrés de liberté [6-DOF] utilisant des capteurs gyroscopiques, accéléromètres ou d’inclinaison
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Rios, Adrian Barahona
Abrégé
Generating audio assets by receiving a plurality of input audio assets, converting each input audio asset into an input graphical representation, generating an input multi-channel image by stacking each input graphical representation in a separate channel of the image, feeding the input multi-channel image into a generative model to train the generative model and generate one or more output multi-channel images, each output multi-channel image including an output graphical representation, extracting the output graphical representations from each output multi-channel image and converting each output graphical representation into an output audio asset.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
A63F 13/60 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu
G10L 25/18 - Techniques d'analyse de la parole ou de la voix qui ne se limitent pas à un seul des groupes caractérisées par le type de paramètres extraits les paramètres extraits étant l’information spectrale de chaque sous-bande
G10L 25/30 - Techniques d'analyse de la parole ou de la voix qui ne se limitent pas à un seul des groupes caractérisées par la technique d’analyse utilisant des réseaux neuronaux
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Rios, Adrian Barahona
Abrégé
A method of generating audio assets, comprising the steps of: receiving an input multi-layered audio asset comprising a plurality of audio layers, generating an input multi-channel image, wherein each channel of the input multi-channel image comprises an input image representative of one of the audio layers, training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output image representative of an output audio layer, and generating an output multi-layered audio asset based on a combination of output audio layers derived from the output images.
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
G10L 25/18 - Techniques d'analyse de la parole ou de la voix qui ne se limitent pas à un seul des groupes caractérisées par le type de paramètres extraits les paramètres extraits étant l’information spectrale de chaque sous-bande
G10L 21/14 - Transformation en information visible en affichant l’information du domaine fréquentiel
G10L 25/30 - Techniques d'analyse de la parole ou de la voix qui ne se limitent pas à un seul des groupes caractérisées par la technique d’analyse utilisant des réseaux neuronaux
H04S 3/00 - Systèmes utilisant plus de deux canaux, p. ex. systèmes quadriphoniques
A63F 13/60 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu
Sony Interactive Entertainment Europe Limited (Royaume‑Uni)
Inventeur(s)
Rios, Adrian Barahona
Abrégé
A method of generating audio assets, comprising the steps of: receiving an input audio asset having a first duration, generating an input image representative of the input audio asset, training a generative model on the input image and implementing the trained generative model to generate an output image representative of an output audio asset having a second duration different to the first duration, and generating the output audio asset based on the output image.
G10H 1/00 - Éléments d'instruments de musique électrophoniques
A63F 13/54 - Commande des signaux de sortie en fonction de la progression du jeu incluant des signaux acoustiques, p. ex. pour simuler le bruit d’un moteur en fonction des tours par minute [RPM] dans un jeu de conduite ou la réverbération contre un mur virtuel
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Animated cartoons; animated cartoons in the form of
cinematographic films; audio visual recordings;
cinematographic films; downloadable computer graphics;
downloadable digital music; downloadable educational media;
downloadable image files; downloadable media; electronic
publications, downloadable; multi-media recordings; virtual
reality models; communication software; community software;
interactive computer software enabling exchange of
information; audio editing software; computer graphics
software; media and publishing software; graphic art
software; media development software; music-composition
software; software for processing images, graphics and text;
3D animation software; 3D computer graphics software;
animation software; application software; educational
software; entertainment software; computer game software,
downloadable; computer game software, recorded; interactive
entertainment software; virtual reality game software;
virtual reality software; augmented reality game software;
augmented reality software. Clothing; footwear; headgear; t-shirts; long sleeved tops;
jackets; socks; jeans; trousers; underwear; shorts; shirts;
jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies;
costumes; swimwear. Digital media streaming services; streaming of audio
material on the Internet, via televisions, mobile phones and
games consoles; streaming of video material on the Internet,
via computers, televisions, mobile phones and games
consoles; streaming of audio and video material via third
party devices. Animation production services; creating animated cartoons;
arranging and presenting of live performances; arranging of
visual and musical entertainment; art gallery services
provided on-line via a telecommunications link; audio-visual
display presentations; conducting of ceremonies for
entertainment purposes; conducting of performing arts
entertainment; electronic game services and competitions
provided by means of the Internet; electronic games
services, including provision of computer games on-line or
by means of a global computer network; entertainment,
education and instruction services; entertainment provided
via the Internet; interactive entertainment services;
interactive computer game services; live entertainment;
on-line gaming services; fan club services (term considered
too vague by the International Bureau - Rule 13 (2) (b) of
the Regulation). Computer services (term considered too vague by the
International Bureau - Rule 13 (2) (b) of the Regulation);
provision of technical support in the field of computer
games software; designing of computer games programs and
video games programs; developing of computer games programs
and video games programs; testing of computer games programs
and video games programs; information and advisory services
relating to the aforesaid services; technical information
and support in the fields of computer game software,
computer game hardware and on-line computer games; design
and development of multimedia products; design of
audio-visual creative works; design of games; graphic arts
design; software as a service [SaaS]; platforms for gaming
as software as a service [SaaS]; platform as a service
[PaaS]; software as a service [SaaS] featuring software
platforms for electronic gaming; interactive entertainment
services in the nature of online, non-downloadable game
engine software used to create and assemble 2D and 3D
graphics and art, music, special effects, game play logic,
and animations; interactive entertainment services in the
nature of online, non-downloadable game engine software used
to create digital works of art; video game entertainment
services in the nature of online, non-downloadable game
engine software for video game development and operation;
hosting on-line web facilities for interactive game play;
computer services in the nature of customised web pages for
featuring game player information, including information
regarding a player's identity and the player's preferences;
hosting video and computer games or parts of video or
computer games created by others on a computer service for a
global network.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Armstrong, Calum
Jones, Michael Lee
Abrégé
A system for generating a transfer function indicating audio transmission characteristics of an input device associated with a processing device, the system comprising a parameter determining unit configured to determine one or more parameters of the input device, wherein the parameters include a location of a microphone associated with the input device and a location of one or more respective input and/or output elements associated with the input device, an audio characteristic determining unit configured to determine one or more characteristics of audio transmission between respective input and/or output elements and the microphone, wherein the characteristics include one or more of an attenuation, resonance, and/or change in frequency profile of audio associated with the respective input and/or output element, and a transfer function generating unit configured to generate a transfer function in dependence upon the determined audio characteristics.
G10K 11/178 - Procédés ou dispositifs de protection contre le bruit ou les autres ondes acoustiques ou pour amortir ceux-ci, en général utilisant des effets d'interférenceMasquage du son par régénération électro-acoustique en opposition de phase des ondes acoustiques originales
A63F 13/215 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de détection des signaux acoustiques, p. ex. utilisant un microphone
09 - Appareils et instruments scientifiques et électriques
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Computer game software; computer software for video games or
for games machines; video game cartridges; video game
programs; video game software; electronic devices for the
wireless receipt, storage and transmission of data and
messages; downloadable electronic publications; sound and
video recordings featuring music, entertainment and games;
electronic game software for mobile phones; application
development tool programs for personal and handheld
computers; downloadable application software; downloadable
audio and video recordings and media. Digital media streaming services; streaming of audio
material on the internet, via televisions, mobile phones and
games consoles; streaming of video material on the internet,
via computers, televisions, mobile phones and games
consoles; streaming of audio and video material via third
party devices; all of the aforesaid services being for or in
relation to computer game software and video game software
and the online hosting of content, video and sound files
regarding characters, themes, levels, storylines from a
computer game or video game. Electronic games services provided by means of the Internet;
provision of non-downloadable games on the Internet;
arranging of games; organizing of games; education;
entertainment services; entertainment services provided
online and/or via a computer database for matching users for
the transfer or sharing of computer games, music, video and
audio recordings via communications networks; organizing,
staging and the provision of on-line tournaments;
entertainment by means of wireless television broadcasts;
provision of on-line information in the field of computer
games entertainment, featuring game player information,
including information regarding a player's identity and the
player's preferences via a customized website; the provision
of on-line electronic publications; entertainment services
provided online and via a computer database for the transfer
or sharing of computer games, music, video and audio
recordings via communications networks; electronic game
services provided by means of the internet allowing players
to share live game footage with other players for the
purposes of either allowing them to take control of the game
or to allow multiplayer game player; information relating to
all of the aforementioned; all of the aforesaid services
being for or in relation to computer game software and video
game software and the online hosting of content, video and
sound files regarding characters, themes, levels, storylines
from a computer game or video game. Hosting on-line web facilities for interactive game play;
computer services in the nature of hosting customised web
pages for featuring game player information, including
information regarding a player's identity and the player's
preferences; hosting a website featuring video and computer
games or parts of video or computer games created by others;
all of the aforesaid services being for or in relation to
computer game software and video game software and the
online hosting of content, video and sound files regarding
characters, themes, levels, storylines from a computer game
or video game.
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
Produits et services
Computer games software; computer games; video game
software; computer software for video games or for games
machines; computer programs for video and computer games;
electronic game software for mobile phones. On-line gaming services; providing on-line computer games;
publishing of computer and video games and computer and
video games software; providing on-line information in the
field of computer gaming entertainment; providing games by
cellular telephone communication; providing games by or for
use on cellular telephone.
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Animated cartoons; animated cartoons in the form of
cinematographic films; audio visual recordings;
cinematographic films; downloadable computer graphics;
downloadable digital music; downloadable educational media;
downloadable image files; downloadable media; electronic
publications, downloadable; multi-media recordings; virtual
reality models; communication software; community software;
interactive computer software enabling exchange of
information; audio editing software; computer graphics
software; media and publishing software; graphic art
software; media development software; music-composition
software; software for processing images, graphics and text;
3D animation software; 3D computer graphics software;
animation software; application software; educational
software; entertainment software; computer game software,
downloadable; computer game software, recorded; interactive
entertainment software; virtual reality game software;
virtual reality software; augmented reality game software;
augmented reality software. Clothing; footwear; headgear; T-shirts; long sleeved tops;
jackets; socks; jeans; trousers; underwear; shorts; shirts;
jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies;
costumes; swimwear. Digital media streaming services; streaming of audio
material on the internet, via televisions, mobile phones and
games consoles; streaming of video material on the internet,
via computers, televisions, mobile phones and games
consoles; streaming of audio and video material via third
party devices. Animation production services; creating animated cartoons;
arranging and presenting of live performances; arranging of
visual and musical entertainment; art gallery services
provided on-line via a telecommunications link; audio-visual
display presentations; conducting of ceremonies for
entertainment purposes; conducting of performing arts
entertainment; electronic game services and competitions
provided by means of the internet; electronic games
services, including provision of computer games on-line or
by means of a global computer network; entertainment,
education and instruction services; entertainment provided
via the internet; interactive entertainment services;
interactive computer game services; live entertainment;
on-line gaming services; fan club services in the nature of
entertainment. Computer programming; computer system design; computer
design and development; provision of technical support in
the field of computer games software; designing of computer
games programs and video games programs; developing of
computer games programs and video games programs; testing of
computer games programs and video games programs;
information and advisory services relating to the aforesaid
services; technological information and support in the
fields of computer game software, computer game hardware and
on-line computer games; design and development of multimedia
products; design of audio-visual creative works; design of
games; graphic arts design; software as a service [SaaS];
platforms for gaming as software as a service [SaaS];
platform as a service [PaaS]; software as a service [SaaS]
featuring software platforms for electronic gaming;
providing online, non-downloadable game engine software used
to create and assemble 2D and 3D graphics and art, music,
special effects, gameplay logic, and animations; providing
online, non-downloadable game engine software used to create
digital works of art; providing online, non-downloadable
game engine software for video game development and
operation; hosting on-line web facilities for interactive
game play; computer services in the nature of hosting
customised web pages for featuring game player information,
including information regarding a player's identity and the
player's preferences; hosting a website featuring video and
computer games or parts of video or computer games created
by others.
82.
COMPUTER-IMPLEMENTED METHOD AND SYSTEM FOR GENERATING VISUAL ADJUSTMENT IN A COMPUTER-IMPLEMENTED INTERACTIVE ENTERTAINMENT ENVIRONMENT
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Kavallierou, Mike
Visciglia, Aron Giuseppe
Stemple, Lloyd Preston
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Abrégé
Disclosed herein is a method and system for generating an adjustment in a visual aspect of a computer-implemented interactive environment. The method and system conserve the resources of the computing resource implementing the environment and still enable visual representations of users, such as avatars, to be generated.
A63F 13/655 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu automatiquement par des dispositifs ou des serveurs de jeu, à partir de données provenant du monde réel, p. ex. les mesures en direct dans les compétitions de course réelles par importation de photos, p. ex. du joueur
A63F 13/34 - Dispositions d’interconnexion entre des serveurs et des dispositifs de jeuDispositions d’interconnexion entre des dispositifs de jeuDispositions d’interconnexion entre des serveurs de jeu utilisant des connexions pair à pair
A63F 13/355 - Réalisation d’opérations pour le compte de clients ayant des capacités de traitement restreintes, p. ex. serveurs transformant une scène de jeu qui évolue en flux vidéo codé à transmettre à un téléphone portable ou à un client léger
A63F 13/424 - Traitement des signaux de commande d’entrée des dispositifs de jeu vidéo, p. ex. les signaux générés par le joueur ou dérivés de l’environnement par mappage des signaux d’entrée en commandes de jeu, p. ex. mappage du déplacement d’un stylet sur un écran tactile en angle de braquage d’un véhicule virtuel incluant des signaux d’entrée acoustiques, p. ex. en utilisant les résultats d’extraction de hauteur tonale ou de rythme ou de reconnaissance vocale
A63F 13/323 - Dispositions d’interconnexion entre des serveurs et des dispositifs de jeuDispositions d’interconnexion entre des dispositifs de jeuDispositions d’interconnexion entre des serveurs de jeu utilisant des connexions de réseau local [LAN] entre des dispositifs de jeu ayant des caractéristiques matérielles différentes, p. ex. des dispositifs de jeu portatifs connectables à des consoles de jeu ou à des machines de salles de jeux
83.
COMPUTER-IMPLEMENTED METHOD FOR CONTROLLING A VIRTUAL AVATAR
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Leyton, Pedro Federico Quijada
Uberti, David Erwan Damien
Stemple, Lloyd Preston
Visciglia, Aron Giuseppe
Sivo, Cesare
Abrégé
A system and computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user; receiving input data from a plurality of input sources, wherein the plurality of input sources includes an imaging source configured to provide images of the user's face, wherein each of the plurality of input sources has an active state and an inactive state, and input data is only received from an input source in the active state; processing the input data; updating the base model in response to the processed input data to update at least one property of the virtual avatar and rendering the updated base model to display the virtual avatar on a display screen.
A63F 13/655 - Création ou modification du contenu du jeu avant ou pendant l’exécution du programme de jeu, p. ex. au moyen d’outils spécialement adaptés au développement du jeu ou d’un éditeur de niveau intégré au jeu automatiquement par des dispositifs ou des serveurs de jeu, à partir de données provenant du monde réel, p. ex. les mesures en direct dans les compétitions de course réelles par importation de photos, p. ex. du joueur
A63F 13/213 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de photo-détection, p. ex. des caméras, des photodiodes ou des cellules infrarouges
A63F 13/215 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types comprenant des moyens de détection des signaux acoustiques, p. ex. utilisant un microphone
A63F 13/424 - Traitement des signaux de commande d’entrée des dispositifs de jeu vidéo, p. ex. les signaux générés par le joueur ou dérivés de l’environnement par mappage des signaux d’entrée en commandes de jeu, p. ex. mappage du déplacement d’un stylet sur un écran tactile en angle de braquage d’un véhicule virtuel incluant des signaux d’entrée acoustiques, p. ex. en utilisant les résultats d’extraction de hauteur tonale ou de rythme ou de reconnaissance vocale
A63F 13/428 - Traitement des signaux de commande d’entrée des dispositifs de jeu vidéo, p. ex. les signaux générés par le joueur ou dérivés de l’environnement par mappage des signaux d’entrée en commandes de jeu, p. ex. mappage du déplacement d’un stylet sur un écran tactile en angle de braquage d’un véhicule virtuel incluant des signaux d’entrée de mouvement ou de position, p. ex. des signaux représentant la rotation de la manette d’entrée ou les mouvements des bras du joueur détectés par des accéléromètres ou des gyroscopes
A63F 13/79 - Aspects de sécurité ou de gestion du jeu incluant des données sur les joueurs, p. ex. leurs identités, leurs comptes, leurs préférences ou leurs historiques de jeu
A63F 13/92 - Dispositifs de jeu vidéo spécialement adaptés à une prise manuelle pendant le jeu
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
UNIVERSITY OF YORK (Royaume‑Uni)
Inventeur(s)
Bradley, Timothy
Barreiro, Marina Villanueva
Hume, Oliver
Spick, Ryan
Walker, James
Abrégé
A method of point cloud generation comprises generating, by a processor, a first point cloud comprising a first set of generated data points; calculating, by the processor, a loss function representative of the quality of the first point cloud, the loss function comprising a smoothness term obtained by constructing vectors between neighbouring data points in the point cloud, performing vector multiplication between neighbouring pairs of vectors, and outputting a smoothness term based on the result of the vector multiplication; and generating, by the processor, a second point cloud comprising a second set of generated data points based at least in part on the calculated loss function of the first point cloud.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Haylock, Robert David
Caruana, Aaron Jason
Abrégé
An optical communication system including a hub optical transceiver, a power splitter, and a plurality of spoke transceivers. The hub optical transceiver is configured for receiving a spectrum of wavelengths. The power splitter is coupled to the hub optical transceiver, and operates as a passive device that is configured to replicate the spectrum of wavelengths and output a plurality of replicated spectrum of wavelengths, and each replicated spectrum of wavelengths has a corresponding power that is a fraction of a total power received from the hub optical transceiver. The plurality of spoke transceivers is coupled to the power splitter and each of the plurality of spoke transceivers is configured to receive a corresponding one of the plurality of replicated spectrum of wavelengths, wherein each spoke transceiver is tunable to select a band of wavelengths that set a bandwidth for the each spoke transceiver.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Chadha, Aaron
Andreopoulos, Ioannis
Abrégé
A method of processing, prior to encoding using an external encoder, image data using an artificial neural network is provided. The external encoder is operable in a plurality of encoding modes. At the neural network, image data representing one or more images is received. The image data is processed using the neural network to generate output data indicative of an encoding mode selected from the plurality of encoding modes of the external encoder. The neural network trained to select using image data an encoding mode of the plurality of encoding modes of the external encoder using one or more differentiable functions configured to emulate an encoding process. The generated output data is outputted from the neural network to the external encoder to enable the external encoder to encode the image data using the selected encoding mode.
H04N 19/42 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques caractérisés par les détails de mise en œuvre ou le matériel spécialement adapté à la compression ou à la décompression vidéo, p. ex. la mise en œuvre de logiciels spécialisés
H04N 19/85 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le pré-traitement ou le post-traitement spécialement adaptés pour la compression vidéo
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Andreopoulos, Ioannis
Chadha, Aaron
Abrégé
Certain aspects of the present disclosure provide techniques for preprocessing, prior to encoding with an external encoder, image data using a preprocessing network comprising a set of inter-connected weights is provided. At the preprocessing network, image data from one or more images is received. The image data is processed using the preprocessing network to generate an output pixel representation for encoding with the external encoder. The weights of the preprocessing network are trained to optimize a combination of at least one quality score indicative of the quality of the output pixel representation and a rate score indicative of the bits required by the external encoder to encode the output pixel representation.
H04N 19/85 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le pré-traitement ou le post-traitement spécialement adaptés pour la compression vidéo
H04N 19/80 - Détails des opérations de filtrage spécialement adaptées à la compression vidéo, p. ex. pour l'interpolation de pixels
H04N 19/65 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant la tolérance aux erreurs
H04N 19/176 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le codage adaptatif caractérisés par l’unité de codage, c.-à-d. la partie structurelle ou sémantique du signal vidéo étant l’objet ou le sujet du codage adaptatif l’unité étant une zone de l'image, p. ex. un objet la zone étant un bloc, p. ex. un macrobloc
H04L 65/65 - Protocoles de diffusion en flux de paquets multimédias, p. ex. protocole de transport en temps réel [RTP] ou protocole de commande en temps réel [RTCP]
H04L 67/02 - Protocoles basés sur la technologie du Web, p. ex. protocole de transfert hypertexte [HTTP]
09 - Appareils et instruments scientifiques et électriques
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Animated cartoons; animated cartoons in the form of
cinematographic films; audio visual recordings;
cinematographic films; downloadable computer graphics;
downloadable digital music; downloadable educational media;
downloadable image files; downloadable media; electronic
publications, downloadable; multi-media recordings; virtual
reality models; communication software; community software;
interactive computer software enabling exchange of
information; audio editing software; computer graphics
software; media and publishing software; graphic art
software; media development software; music-composition
software; software for processing images, graphics and text;
3D animation software; 3D computer graphics software;
animation software; application software; educational
software; entertainment software; computer game software,
downloadable; computer game software, recorded; interactive
entertainment software; virtual reality game software;
virtual reality software; augmented reality game software;
augmented reality software. Digital media streaming services; streaming of audio
material on the internet, via televisions, mobile phones and
games consoles; streaming of video material on the internet,
via computers, televisions, mobile phones and games
consoles; streaming of audio and video material via third
party devices; communication by online blogs; providing
online chat rooms for social networking. Interactive entertainment; entertainment services; video
entertainment services; online entertainment services;
online interactive entertainment; provision of live
entertainment; video game entertainment services; arranging
and conducting award ceremonies; arranging and conducting
competitions; arranging and conducting of games; arranging
of competitions via the Internet; art exhibition services;
organisation of artistic competitions; organisation of
competitions and awards; organisation of e-sports
competitions; organisation of esports events. Computer programming; computer system design; computer
design and development; provision of technical support in
the field of computer games software; designing of computer
games programs and video games programs; developing of
computer games programs and video games programs; testing of
computer games programs and video games programs;
information and advisory services relating to the aforesaid
services; technical information and support in the fields of
computer game software, computer game hardware and on-line
computer games; design and development of multimedia
products; design of audio-visual creative works; design of
games; graphic arts design; software as a service [SaaS];
platforms for gaming as software as a service [SaaS];
platform as a service [PaaS]; software as a service [SaaS]
featuring software platforms for electronic gaming;
providing online, non-downloadable game engine software used
to create and assemble 2D and 3D graphics and art, music,
special effects, gameplay logic, and animations; providing
online, non-downloadable game engine software used to create
digital works of art; providing online, non-downloadable
game engine software for video game development and
operation; hosting on-line web facilities for interactive
game play; computer services in the nature of hosting
customised web pages for featuring game player information,
including information regarding a player's identity and the
player's preferences; hosting a website featuring video and
computer games or parts of video or computer games created
by others.
09 - Appareils et instruments scientifiques et électriques
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Application software; entertainment software; computer game
software; interactive entertainment software; video game
software; virtual reality game software; virtual reality
software; augmented reality game software; augmented reality
software; interactive games software for mobile phones and
tablet computers; electronic games software; interactive
games software allowing users to alternate gameplay between
computers, games consoles, smartphones, smart televisions
and electronic devices; interactive games software allowing
users to share and switch gameplay between users on
different devices. Digital media streaming services; streaming of interactive
games; streaming of interactive games via computers,
televisions, mobile phones, games consoles and electronic
devices; streaming of multimedia content on the internet,
via computers, televisions, mobile phones, games consoles
and electronic devices; streaming of interactive games and
multimedia material via third party devices. Interactive entertainment services; electronic game services
and competitions provided by means of the internet;
electronic games services, including provision of computer
games on-line or by means of a global computer network;
entertainment provided via the internet; interactive
computer game services; online gaming services;
entertainment services provided online and/or via a computer
database for matching users for the transfer or sharing of
computer games, music, video and audio recordings via
communications networks; organizing, staging and the
provision of on-line tournaments; eSports services;
entertainment by means of wireless television broadcasts;
provision of customized web pages for featuring game player
information, including information regarding a player's
identity and the player's preferences (term considered too
vague by the International Bureau - Rule 13 (2) (b) of the
Regulation); the provision of on-line electronic
publications; entertainment services provided online and via
a computer database for the transfer or sharing of computer
games, music, video and audio recordings via communications
networks; electronic game services provided by means of the
internet allowing players to share live game footage with
other players for the purposes of either allowing them to
take control of the game or to allow multiplayer game
players; organisation of competitions and awards; sporting
and cultural activities; online distribution of interactive
entertainment, music, images or videos; interactive
entertainment publishing services; information relating to
all of the aforementioned. Computer services (term considered too vague by the
International Bureau - Rule 13 (2) (b) of the Regulation);
provision of technical support in the field of interactive
games software and interactive entertainment software;
designing of computer games programs and video games
programs; designing of interactive games software;
developing of computer games programs and video games
programs; testing of computer games programs and video games
programs; technical information and support in the fields of
computer game software, computer game hardware and on-line
computer games; design and development of multimedia
products; design of audio-visual creative works; design of
games; graphic arts design; software as a service [SaaS];
platforms for gaming as software as a service [SaaS];
platform as a service [PaaS]; software as a service [SaaS]
featuring software platforms for electronic gaming; hosting
on-line web facilities for interactive game play; computer
services in the nature of customised web pages for featuring
game player information, including information regarding a
player's identity and the player's preferences (term
considered too vague by the International Bureau - Rule 13
(2) (b) of the Regulation); hosting interactive games,
computer games and video games or parts of interactive
games, computer games and video games on a computer service
for a global network; information and advisory services
relating to the aforesaid services; research in the field of
climate change; providing scientific information in the
field of climate change; providing scientific information in
the fields of climate change and global warming.
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
Produits et services
(1) Computer games software; computer games; video games software; computer software for video games or for games machines; computer programs for video and computer games; video discs, discs, tapes, cassettes, compact discs; CD-ROMs, DVDs, data bearing record carriers for computers; software for playing video, computer and on-line games; software for enabling video, computer and on-line games to be run on multiple platforms; electronic game software for mobile phones; application development tool programs for personal and handheld computers; downloadable application software; downloadable audio and video recordings and media; sound and/or video recordings featuring music and entertainment, television programs, motion pictures, news, sports, games, cultural events, and entertainment-related programs of all kinds; controllers and peripherals for computer games; electronic publications (downloadable) provided on-line from databases or the Internet; video games enhancers; parts and fittings for all the aforesaid goods. (1) Entertainment provided via the Internet; on-line gaming services; providing on-line computer games, multi-player matching services, and on-line entertainment in the nature of tournaments, fantasy sports leagues, gameshows; providing temporary use of online non-downloadable games played via a global computer network; education and entertainment services; provision of interactive entertainment services; publishing of computer and video games and computer and video games software; providing on-line information in the field of computer gaming entertainment; providing games by cellular telephone communication; providing games by or for use on cellular telephones; providing on-line electronic publications (not downloadable).
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
Produits et services
Downloadable computer games software; computer games in the nature of computer game cartridges and discs; downloadable video game software; downloadable computer software for video games and for games machines; recorded computer programs for video and computer games; downloadable electronic game software for mobile phones Online gaming services, namely, providing online video games; online gaming services in the nature of computer game tournaments; online gaming services, namely, providing temporary use of non-downloadable video game software; providing online computer games; multimedia publishing of computer and video games and computer and video games software; providing online information in the field of computer gaming entertainment; providing online video games accessible by mobile phone; providing online games designed for play on mobile phones
09 - Appareils et instruments scientifiques et électriques
41 - Éducation, divertissements, activités sportives et culturelles
Produits et services
(1) Computer games software; computer games; video game software; computer software for video games or for games machines; computer programs for video and computer games; electronic game software for mobile phones. (1) On-line gaming services; providing on-line computer games; publishing of computer and video games and computer and video games software; providing on-line information in the field of computer gaming entertainment; providing games by cellular telephone communication; providing games by or for use on cellular telephone.
93.
METHOD FOR FINDING A BEST SUITED HRTF IN A HRTF DATABASE
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Barreiro, Marina Villanueva
Armstrong, Calum
Schembri, Danjeli
Abrégé
An audio personalisation method for a first user comprises testing a first user on a calibration test, the calibration test comprising requiring a user to match a test sound to a test location, either by controlling the position of the presented sound or controlling the position of the presented location, for a sequence of test matches, each test sound being presented at a position using a default head related transfer function 'HRTF', receiving an estimate of each matching location from the first user, and calculating a respective error for each estimate, to generate a sequence of location estimate errors for the first user; and comparing at least some of the location estimate errors for the first user with estimate errors of the same locations previously generated for at least a subset of a corpus of reference individuals; identifying a reference individual with the closest match of compared location estimation errors to those of the first user; and using an HRTF, previously obtained for the identified reference individual, for the first user.
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
(1) Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software.
(2) Clothing; footwear; headgear; t-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. (1) Digital media streaming services; streaming of audio material on the Internet, via televisions, mobile phones and games consoles; streaming of video material on the Internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices.
(2) Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the Internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the Internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation).
(3) Computer services (term considered too vague by the International Bureau - Rule 13 (2) (b) of the Regulation); provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technical information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; interactive entertainment services in the nature of online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, game play logic, and animations; interactive entertainment services in the nature of online, non-downloadable game engine software used to create digital works of art; video game entertainment services in the nature of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting video and computer games or parts of video or computer games created by others on a computer service for a global network.
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Digital media streaming services, namely, electronic transmission and streaming of digital content for others via global and local computer networks; streaming of audio material on the Internet via televisions, mobile phones and games consoles; streaming of video material on the Internet via computers, televisions, mobile phones and games consoles; streaming of audio and video material on the Internet via third party devices Video disks and video tapes with recorded animated cartoons; cinematographic films featuring animated cartoons; audio visual recordings featuring animated cartoons; exposed cinematographic films; downloadable computer graphics; digital music downloadable from the internet; downloadable educational electronic books, manuals, and newsletters in the field of video games and animated cartoons; downloadable image files containing animated cartoons and 2D and 3D graphics and art; downloadable computer game software; downloadable electronic publications in the nature of magazines, brochures, informational sheets, and manuals in the fields of video games and animated cartoons; virtual reality models being downloadable virtual reality game software; downloadable communication software for providing access to the Internet and for connecting computer network users; downloadable interactive computer game software enabling exchange of information; downloadable computer software for editing audio files; downloadable computer graphics software; media and publishing software, namely, downloadable desktop publishing software; downloadable computer software for designing graphic images; downloadable game development software; downloadable music-composition software; downloadable software for processing images, graphics and text; Downloadable software for creating 3D animation; downloadable software for developing 3D computer graphics; Downloadable software for creating animation; Recorded computer application software for playing games and viewing gaming videos; downloadable game related software applications in the nature of downloadable computer software platforms for game development; downloadable educational software featuring instruction in animation and video games; downloadable entertainment computer game software; downloadable interactive multimedia software for playing games; recorded computer software for creation and assembly of 2D and 3D graphics and art, music, special effects, and animations; recorded game software for creating music, music videos, videos, and audiovisual productions; recorded computer game software; downloadable interactive game software; recorded virtual reality game software; downloadable virtual reality game software; downloadable augmented reality game software; recorded augmented reality game software Clothing, namely, sweaters, sweatshirts, pants, tops, bottoms; footwear; headwear; t-shirts; long sleeved shirts; clothing jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers in the nature of coveralls; hoodies; clothing jerseys; polo shirts; pajamas; one-piece garments for infants and toddlers; cosplay costumes; masquerade costumes; costumes for use in the amusement industry; swimwear Animation production services; creating animated cartoons being animation production services; presentation of live show performances; arranging of visual and musical entertainment, namely, arranging and conducting of concerts; art gallery services in the nature of conducting workshops and classes in the field of animation provided on-line via a telecommunications link; entertainment services, namely, art gallery services in the nature of production of custom animation for others provided on-line via a telecommunications link; audio-visual display presentation of live musical performances; entertainment services in the nature of conducting live performances in the field of performing arts, namely, live theatre; electronic games services provided by means of the Internet; organization of electronic game competitions via the Internet; electronic games services, namely, provision of on-line computer games; entertainment services, namely, provision of online non-downloadable animated cartoons for others; entertainment services, namely, video production services, film production services, audiovisual production services, music production services, virtual reality video production services, and augmented reality video production services; entertainment services, namely, organizing and arranging exhibitions for entertainment purposes; entertainment services in the nature of providing a website featuring entertainment information in the fields of video games ; entertainment services in the nature of providing non-downloadable electronic publications in the nature of blogs in the fields of video games, video game creation, game development software, virtual reality software, augmented reality software, and game engine software; entertainment information provided via the Internet; interactive entertainment services, namely, providing temporary use of non-downloadable interactive games; provision of information relating to live entertainment; online entertainment services in the nature of providing temporary use of online, non-downloadable computer games; fan club services, namely, providing fan clubs computer programming; computer system design; computer software design and development; provision of technical support services, namely, troubleshooting of computer software problems in the field of computer games; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to computer game design, development, and testing; providing technical information in the fields of computer game software, computer game hardware and on-line computer game design, development, and testing; design and development of multimedia products; design of audio-visual creative works being graphic design services; designing of video games for others; graphic arts design; Software as a service (SAAS) services featuring software for playing video games; Platform as a service (PAAS) services featuring computer software platforms for the design, development, testing, and playing of computer games; Platform as a service (PAAS) services featuring software platforms for playing electronic video games; providing temporary use of online, non-downloadable game engine software for creating and assembling 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing temporary use of online, non-downloadable game engine software for creating digital works of art; providing temporary use of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for others for organizing and conducting interactive game play amongst users; computer services in the nature of hosting a customized, interactive website featuring gameplay information, namely, information regarding a player's identity and the player's preferences on the internet; Hosting an online website featuring video and computer games and parts of video and computer games created by others
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
38 - Services de télécommunications
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
(1) Animated cartoons; animated cartoons in the form of cinematographic films; audio visual recordings; cinematographic films; downloadable computer graphics; downloadable digital music; downloadable educational media; downloadable image files; downloadable media; electronic publications, downloadable; multi-media recordings; virtual reality models; communication software; community software; interactive computer software enabling exchange of information; audio editing software; computer graphics software; media and publishing software; graphic art software; media development software; music-composition software; software for processing images, graphics and text; 3D animation software; 3D computer graphics software; animation software; application software; educational software; entertainment software; computer game software, downloadable; computer game software, recorded; interactive entertainment software; virtual reality game software; virtual reality software; augmented reality game software; augmented reality software.
(2) Clothing; footwear; headgear; T-shirts; long sleeved tops; jackets; socks; jeans; trousers; underwear; shorts; shirts; jumpers; hoodies; jerseys; polo shirts; pyjamas; onesies; costumes; swimwear. (1) Digital media streaming services; streaming of audio material on the internet, via televisions, mobile phones and games consoles; streaming of video material on the internet, via computers, televisions, mobile phones and games consoles; streaming of audio and video material via third party devices.
(2) Animation production services; creating animated cartoons; arranging and presenting of live performances; arranging of visual and musical entertainment; art gallery services provided on-line via a telecommunications link; audio-visual display presentations; conducting of ceremonies for entertainment purposes; conducting of performing arts entertainment; electronic game services and competitions provided by means of the internet; electronic games services, including provision of computer games on-line or by means of a global computer network; entertainment, education and instruction services; entertainment provided via the internet; interactive entertainment services; interactive computer game services; live entertainment; on-line gaming services; fan club services in the nature of entertainment.
(3) Computer programming; computer system design; computer design and development; provision of technical support in the field of computer games software; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to the aforesaid services; technological information and support in the fields of computer game software, computer game hardware and on-line computer games; design and development of multimedia products; design of audio-visual creative works; design of games; graphic arts design; software as a service [SaaS]; platforms for gaming as software as a service [SaaS]; platform as a service [PaaS]; software as a service [SaaS] featuring software platforms for electronic gaming; providing online, non-downloadable game engine software used to create and assemble 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing online, non-downloadable game engine software used to create digital works of art; providing online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for interactive game play; computer services in the nature of hosting customised web pages for featuring game player information, including information regarding a player's identity and the player's preferences; hosting a website featuring video and computer games or parts of video or computer games created by others.
09 - Appareils et instruments scientifiques et électriques
25 - Vêtements; chaussures; chapellerie
41 - Éducation, divertissements, activités sportives et culturelles
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Digital media streaming services, namely, electronic transmission and streaming of digital content for others via global and local computer networks; streaming of audio material on the Internet via televisions, mobile phones and games consoles; streaming of video material on the Internet via computers, televisions, mobile phones and games consoles; streaming of audio and video material on the Internet via third party devices Video disks and video tapes with recorded animated cartoons; cinematographic films featuring animated cartoons; audio and visual recordings featuring animated cartoons; exposed cinematographic films; downloadable computer graphics; digital music files downloadable from the internet; downloadable educational electronic books, manuals, and newsletters in the field of video games and animated cartoons; downloadable image files containing animated cartoons and 2D and 3D graphics and art; downloadable computer game software; downloadable electronic publications in the nature of magazines, brochures, informational sheets, and manuals in the fields of video games and animated cartoons; virtual reality models being downloadable virtual reality game software; downloadable communication software for providing access to the Internet and for connecting computer network users; downloadable interactive computer game software enabling exchange of information; downloadable computer software for editing audio files; downloadable computer graphics software; media and publishing software, namely, downloadable desktop publishing software; downloadable computer software for designing graphic images; downloadable game development software; downloadable music-composition software; downloadable software for processing images, graphics and text; downloadable 3D computer animation software for creating digital animation and special effects of images; Recorded computer application software for playing games and viewing gaming videos; downloadable game related software applications in the nature of downloadable computer software platforms for game development; downloadable educational software featuring instruction in animation and video games; downloadable entertainment computer game software; downloadable interactive multimedia software for playing games; recorded computer software for creation and assembly of 2D and 3D graphics and art, music, special effects, and animations; recorded game software for creating music, music videos, videos, and audiovisual productions; computer game software, downloadable; computer game software, recorded; downloadable interactive game software; recorded virtual reality game software; downloadable augmented reality game software; recorded augmented reality game software Clothing, namely, tops, shirts, sweaters, sweatshirts, skirts, bottoms, pants, dresses; footwear; headwear; t-shirts; clothing jackets; socks; jeans; trousers; underwear; shorts; jumpers in the nature of sweaters; hoodies; clothing jerseys; polo shirts; pajamas; one-piece garments for children; cosplay costumes; masquerade costumes; costumes for use in the amusement industry; swimwear Animation production services; creating animated cartoons being animation production services; presentation of live show performances; arranging of visual and musical entertainment, namely, arranging and conducting of concerts; educational services, namely, art gallery services in the nature of conducting workshops and classes in the field of animation provided on-line via a telecommunications link; entertainment services, namely, art gallery services in the nature of production of custom animation for others provided on-line via a telecommunications link; audiovisual display presentation of live musical performances; conducting of performing arts entertainment, namely, theatre productions; electronic games services provided by means of the Internet; organization of electronic game competitions via the Internet; electronic games services, namely, provision of online computer games; entertainment services, namely, provision of online non-downloadable animated cartoons; entertainment services, namely, video production services, film production services, audiovisual production services, music production services, virtual reality video production services, and augmented reality video production services; entertainment services, namely, organizing and arranging exhibitions for entertainment purposes; entertainment services in the nature of providing a website featuring entertainment information in the fields of video games; entertainment services in the nature of providing non-downloadable electronic publications in the nature of blogs in the fields of video games, video game creation, game development software, virtual reality software, augmented reality software, and game engine software; entertainment information provided via the Internet; interactive entertainment services, namely, providing temporary use of non-downloadable interactive games; provision of information relating to live entertainment; online entertainment services in the nature of providing temporary use of online, non-downloadable computer games; fan club services, namely providing fan clubs Computer services, namely, computer programming, computer software design and development, computer system design; provision of technical support services, namely, troubleshooting of computer software problems in the field of computer games; designing of computer games programs and video games programs; developing of computer games programs and video games programs; testing of computer games programs and video games programs; information and advisory services relating to computer game design, development, and testing; providing technical information in the fields of computer game software, computer game hardware and on-line computer game design, development, and testing; design and development of multimedia products; design of audio-visual creative works, namely, designing of video games for others; graphic arts design; Software as a service (SAAS) services featuring software for playing video games; Platform as a service (PAAS) services featuring computer software platforms for the design, development, testing, and playing of computer games; providing temporary use of online, non-downloadable game engine software for creating and assembling 2D and 3D graphics and art, music, special effects, gameplay logic, and animations; providing temporary use of online, non-downloadable game engine software for creating digital works of art; providing temporary use of online, non-downloadable game engine software for video game development and operation; hosting on-line web facilities for others for organizing and conducting interactive game play amongst users; computer services in the nature of hosting a customized, interactive website featuring gameplay information, namely, information regarding a player's identity and the player's preferences on the internet; Application service provider (ASP), namely, hosting computer software applications of others, namely, video and computer games and parts of video and computer games created by others on a computer server for a global computer network
98.
Varying effective resolution by screen location by changing active color sample count within multiple render targets
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
SONY INTERACTIVE ENTERTAINMENT LLC (USA)
Inventeur(s)
Berghoff, Tobias
Abrégé
A graphics processing unit (GPU) is configured to receive metadata specifying an active sample configuration for a particular region of a display device among a plurality of regions of the display device and receive pixel data for one or more pixels in the particular region. The pixel data specifies the same number of color samples for each pixel. For each pixel in the particular region, the GPU invokes a pixel shader only for color samples specified to be active samples by the configuration.
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (Royaume‑Uni)
Inventeur(s)
Bigos, Andrew James
Abrégé
A method of generating an image of a scene from a target viewpoint is provided. The method comprises capturing a plurality of multi-plane images of a virtual scene, and determining for each multi-plane image, whether a frontmost clipping plane pair defined for that multi-plane image intersects a virtual object in the virtual scene. Responsive to a positive determination for a respective clipping plane pair, the corresponding image data in the corresponding image plane is identified and assigned an identifier, thus generating a modified version of the corresponding multi-plane image. Camera information is obtained for the one or more virtual cameras that captured the multi-plane images and the target virtual camera. An output image is then generated by combining at least one of the modified multi-plane images with another of the multi-plane images in accordance with the obtained camera information. A corresponding system is also provided.
Information processing apparatus, information processing system, device for position and posture acquisition, and device information acquisition method
Sony Interactive Entertainment Europe LTD. (Royaume‑Uni)
Inventeur(s)
Tsuru, Daisuke
Nishikawa, Kenzo
Raghoebardajal, Winesh Sharwin
Abrégé
An information processing apparatus acquires, using an image obtained by capturing a device including a light-emitting marker with exposure times shorter than a time corresponding to one frame, information regarding a position and a posture of the device. The light-emitting marker is caused to emit light for light emission times equal to or shorter than the exposure times. The information processing apparatus causes the light-emitting marker to emit light in a predetermined flashing pattern, and identifies the exposure times on a time axis of the device on the basis of whether or not the image appears in the captured image, to thereby synchronize the exposure and the light emission.