A system is described that permits identified musical phrases or themes to be synchronized and linked into changing real-world events. The achieved synchronization includes a seamless musical transition—achieved using a timing offset, such as relative advancement of an significant musical “onset,” that is inserted to align with a pre-existing but identified music signature, beat or timebase—between potentially disparate pre-identified musical phrases having different emotive themes defined by their respective time signatures, intensities, keys, musical rhythms and/or musical phrasing. The system operates to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing audio themes within the context of what is occurring in the surrounding physical environment, e.g. during different phases of a cardio workout in a step class the music rate and intensity increase during sprint periods and decrease during recovery periods.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
G06F 16/61 - IndexationStructures de données à cet effetStructures de stockage
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
A media-content augmentation system includes a processing system that receives input data in the form of temporally-varying events data. The processing system resolves the input into one or more categorized contextual themes, correlates the themes with metadata associated with at least one reference media file, and then splices or fades together selected parts of the media file, thus generating as an output, a media product in which transitions between its contextual themes are aligned with selected temporal events in the input data. The temporarily-varying events take the form of a beginning and an end in the case of a sustained feature, or a specific point in time for a hit point. A method aligns sections in digital media files with temporally-varying events data to compose a media product. The system augments a sensory experience of a user by dynamically changing and then playing selected media files within the context of the categorized themes input to the processing system.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
G06F 16/61 - IndexationStructures de données à cet effetStructures de stockage
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
G10H 7/00 - Instruments dans lesquels les sons sont synthétisés à partir d'une mémoire de données, p. ex. orgues à calculateur
A63B 71/06 - Dispositifs indicateurs ou de marque pour jeux ou joueurs
3.
METHOD OF TRAINING A NEURAL NETWORK TO REFLECT EMOTIONAL PERCEPTION, RELATED SYSTEM AND METHOD FOR CATEGORIZING AND FINDING ASSOCIATED CONTENT AND RELATED DIGITAL MEDIA FILE EMBEDDED WITH A MULTI-DIMENSIONAL PROPERTY VECTOR
A property vector representing extractable measurable properties, such as musical properties, of a file is mapped to semantic properties for the file. This is achieved by using artificial neural networks "ANNs" in which weights and biases are trained to align a distance dissimilarity measure in property space for pairwise comparative files back towards a corresponding semantic distance dissimilarity measure in semantic space for those same files. The result is that, once optimised, the ANNs can process any file, parsed with those properties, to identify other files sharing common traits reflective of emotional- perception, thereby rendering a more liable and true-to-life result of similarity/dissimilarity. This contrasts with simply training a neural network to consider extractable measurable properties that, in isolation, do not provide a reliable contextual relationship into the real-world.
Due to discrepancies in musical timing signatures, the invention assesses whether a recorded displacement, expressed in terms of beats and fractions, between exit and entry points for a potential musical splice or cut, corresponds to permit a seamless music splicing of different musical sections. Assessment is achieved by establishing a third time base of pulses having a length dependent upon a lowest common multiple of fractions within respective bars for different sections, with the bars of the respective sections then partitioned into an equal number of fixed length pulses. A coefficient aligns different time signatures; it is a ratio between pulses within the different sections. The coefficient identifies corresponding locations of a cut point, related to a suitable anacrusis, in terms of respectively an aligned bar, beat, quaver and fraction in differing time signatures. The coefficient ensures that the time anacrusis in one time signature is interchangeable with others.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
G06F 16/61 - IndexationStructures de données à cet effetStructures de stockage
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
The invention, as shown by the system in FIG. 2, relates to a client-side content tracking system of media files, e.g. digital music files. Audio tracking—or indeed multimedia tracking—is shifted to a client-side perspective, with the client tasked with establishing use of a selected source audio track by tracking—and then reporting uplink to the server—at least one of: entry and exit points associated with playing of at least one of said musical sections in the identified source audio track, and how the identified source audio track was used, performed or manipulated at the client device. Server functionality is designed, having regard to the reported tracking data and its link to a unique identifier to permit the media file (e.g. source audio track) to be selected and/or identified, to store or relay—possibly in the context of a subscription service and billing regime for content use—tracking data related to use of at least a portion of the source audio track at or by the client device. In the context of audio, reporting of use at a client device can, in turn, cause streaming of related multi-media content from a third-party database to the client device. For music, reporting of entry and end points into and out of sections of complete audio tracks can coincide with musically seamless audio transitions between sections.
A media-content augmentation system includes a database with a multiplicity of media files and associated metadata. Each media file is mapped to at least one contextual theme defined by beginning and end timings. A processing system couples to the database; and an input couples to the processing system. The input is in the form of temporally-varying events data. The processing system resolves the input into one or more categorized contextual themes, correlates the themes with metadata associated with selected media files relevant to the themes, and then splices or fades together selected media files to reflect the events as the input varies with time, thus generating as an output, a media product in which transitions between media are aligned with the temporally-varying events. The database may contain sections of digital media files. A method aligns sections in digital media files with temporally-varying events data to compose a media product.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
G06F 16/61 - IndexationStructures de données à cet effetStructures de stockage
A63B 71/06 - Dispositifs indicateurs ou de marque pour jeux ou joueurs
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
An auditory augmentation system includes a database with a multiplicity of audio sections and associated metadata for digital audio files. Each audio section is mapped to a contextual theme, each contextual theme being mapped to an audio section having an entry point and an exit point. The entry and exit points support seamless splice or fade transitions between different audio sections. A processing system couples to the database along with an input; the input is in the form of temporally-varying events data that defines a temporal input. The processing system resolves the temporal input into one or more of a plurality of categorized contextual themes, correlates the categorized contextual themes with metadata associated with selected audio sections relevant to the one or more categorized contextual themes, and splices or fades together selected audio sections, and generates, as an output, a media product in which transitions between audio sections are seamless.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
G06F 16/61 - IndexationStructures de données à cet effetStructures de stockage
A63B 71/06 - Dispositifs indicateurs ou de marque pour jeux ou joueurs
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
The invention, as shown by the system in FIG. 2, relates to a client-side content tracking system of media files, e.g. digital music files. Audio tracking—or indeed multimedia tracking—is shifted to a client-side perspective, with the client tasked with establishing use of a selected source audio track by tracking—and then reporting uplink to the server—at least one of: entry and exit points associated with playing of at least one of said musical sections in the identified source audio track, and how the identified source audio track was used, performed or manipulated at the client device. Server functionality is designed, having regard to the reported tracking data and its link to a unique identifier to permit the media file (e.g. source audio track) to be selected and/or identified, to store or relay—possibly in the context of a subscription service and billing regime for content use—tracking data related to use of at least a portion of the source audio track at or by the client device. In the context of audio, reporting of use at a client device can, in turn, cause streaming of related multi-media content from a third-party database to the client device. For music, reporting of entry and end points into and out of sections of complete audio tracks can coincide with musically seamless audio transitions between sections.
The invention, relates to a client-side content tracking system of media files. Audio tracking is shifted to a client-side perspective, with the client tasked with establishing use of a selected source audio track by tracking - and then reporting uplink to the server -at least one of: entry and exit points associated with playing of at least one musical section in the identified source audio track, and how the identified source audio track was used at the client device. Server functionality is designed, having regard to the reported tracking data and its link to a unique identifier to permit the media file to be selected, to relay tracking data related to use of at least a portion of the source audio track by the client device. Reporting of use at a client device can, in turn, cause streaming of related multi-media content from a third-party database to the client device.
A system is described that permits identified musical phrases or themes to be synchronized and linked into changing real-world events. The achieved synchronization includes a seamless musical transition¨achieved using a timing offset, such as relative advancement of an significant musical -onset". that is inserted to align vvith a pre- existing but identified music signature, beat or timebase¨between potentially disparate pre-identified musical phrases having different emotive themes defined by their respective time signatures, intensities, keys, musical rhythms and/or musical phrasing. The system operates to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing audio themes within the context of what is occurring in the surrounding physical environment, e.g. during different phases of a cardio workout in a step class the music rate and intensity increase during sprint periods and decrease during recovery periods.
A temporal input in the form of temporally-varying events data is resolved, by a processing system, into categorized contextual themes. The processing system correlates these categorized contextual themes with metadata associated with audio sections of stored digital audio files, with each audio section itself also mapped to one or more contextual themes. Each audio section is defined in terms of entry and exit points that support seamless cuts into or out of that musical section. The entry point and exit points relate to an anacrusis event for the section as expressed in terms of beats and fractions. The processing system functions to cut together selected audio sections with the time- varying temporal input to generate, as an output, a media product in which transitions are seamless and the audio is further contextually aligned with ¨ and reinforcing of - the changing temporal input.
G06F 16/68 - Recherche de données caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement
G10H 1/00 - Éléments d'instruments de musique électrophoniques
12.
SYSTEM AND METHOD FOR ONSET DETECTION IN A DIGITAL SIGNAL
Digital processing of a digital signal distinguishes evolving transient parts of frequency information from a relatively stationary part of the frequency information to produce a time domain representation of the transient parts. An amplitude envelope of the transient parts is generated and, with respect to this envelope, a power threshold is set. Localized peaks in the amplitude envelope that exceed the power threshold are detected. With respect to each localized peak, analysis works backwards in time from the localized peak to find a sampling point at which a characteristic of the digital signal before that point in time is maximally different from that same characteristic of the digital signal after that point in time. The position of the onset for the localized peak is then selected based on the sampling point that is maximally different, as shown in FIGs. 6a to 6c.
A temporal input in the form of temporally-varying events data is resolved, by a processing system, into categorized contextual themes. The processing system correlates these categorized contextual themes with metadata associated with audio sections of stored digital audio files, with each audio section itself also mapped to one or more contextual themes. Each audio section is defined in terms of entry and exit points that support seamless cuts into or out of that musical section. The entry point and exit points relate to an anacrusis event for the section as expressed in terms of beats and fractions. The processing system functions to cut together selected audio sections with the time-varying temporal input to generate, as an output, a media product in which transitions are seamless and the audio is further contextually aligned with ~ and reinforcing of - the changing temporal input.
G06F 16/68 - Recherche de données caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement
G10H 1/00 - Éléments d'instruments de musique électrophoniques
14.
Music context system, audio track structure and method of real-time synchronization of musical content
A system is described that permits identified musical phrases or themes to be synchronized and linked into changing real-world events. The achieved synchronization includes a seamless musical transition—achieved using a timing offset, such as relative advancement of an significant musical “onset”, that is inserted to align with a pre-existing but identified music signature, beat or timebase—between potentially disparate pre-identified musical phrases having different emotive themes defined by their respective time signatures, intensities, keys, musical rhythms and/or musical phrasing. The system operates to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing audio themes within the context of what is occurring in the surrounding physical environment, e.g. during different phases of a cardio workout in a step class the music rate and intensity increase during sprint periods and decrease during recovery periods.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
A63B 71/06 - Dispositifs indicateurs ou de marque pour jeux ou joueurs
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
A system is described that permits identified musical phrases or themes to be synchronized and linked into changing real-world events. The achieved synchronization includes a seamless musical transition—achieved using a timing offset, such as relative advancement of an significant musical “onset”, that is inserted to align with a pre-existing but identified music signature, beat or timebase—between potentially disparate pre-identified musical phrases having different emotive themes defined by their respective time signatures, intensities, keys, musical rhythms and/or musical phrasing. The system operates to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing audio themes within the context of what is occurring in the surrounding physical environment, e.g. during different phases of a cardio workout in a step class the music rate and intensity increase during sprint periods and decrease during recovery periods.
G11B 27/28 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande en utilisant une information détectable sur le support d'enregistrement en utilisant des signaux d'information enregistrés par le même procédé que pour l'enregistrement principal
A63B 69/00 - Appareils d'entraînement ou appareils destinés à des sports particuliers
H04N 21/845 - Structuration du contenu, p. ex. décomposition du contenu en segments temporels
G11B 20/10 - Enregistrement ou reproduction numériques
H04H 60/06 - Dispositions de programmation de services de radiodiffusion ou de services relatifs à la radiodiffusion
H04H 60/33 - Dispositions de contrôle du comportement ou des opinions des utilisateurs
H04H 60/65 - Dispositions pour des services utilisant les résultats du contrôle, de l'identification ou de la reconnaissance, couverts par les groupes ou pour utiliser les résultats côté utilisateurs
A63B 71/06 - Dispositifs indicateurs ou de marque pour jeux ou joueurs
G11B 27/00 - MontageIndexationAdressageMinutage ou synchronisationContrôleMesure de l'avancement d'une bande
G11B 27/10 - IndexationAdressageMinutage ou synchronisationMesure de l'avancement d'une bande
G10H 1/057 - Moyens pour contrôler la fréquence des sons, p. ex. attaque ou affaiblissementMoyens pour produire des effets musicaux particuliers, p. ex. vibratos ou glissandos par modulation additionnelle pendant l'exécution seulement par des circuits façonnant une enveloppe
brevets
