Abrégé

A system or process may generate a summarization of multimedia content by determining one or more salient moments therefrom. Multimedia content may be received and a plurality of frames and audio, visual, and metadata elements associated therewith are extracted from the multimedia content. A plurality of importance sub-scores may be generated for each frame of the multimedia content, each of the plurality of sub-scores being associated with a particular analytical modality. For each frame, the plurality of importance sub-scores associated therewith may be aggregated into an importance score. The frames may be ranked by importance and a plurality of top-ranked frames are identified and determined to satisfy an importance threshold. The plurality of top-ranked frames are sequentially arranged and merged into a plurality of moment candidates that are ranked for importance. A subset of top-ranked moment candidates are merged into a final summarization of the multimedia content.

Classes IPC  ?

• G06F 16/45 - GroupementClassement
• G06F 16/483 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
• G06N 20/00 - Apprentissage automatique
• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo

Abrégé

A system or process may generate a summarization of multimedia content by determining one or more salient moments therefrom. Multimedia content may be received and a plurality of frames and audio, visual, and metadata elements associated therewith are extracted from the multimedia content. A plurality of importance sub-scores may be generated for each frame of the multimedia content, each of the plurality of sub-scores being associated with a particular analytical modality. For each frame, the plurality of importance sub-scores associated therewith may be aggregated into an importance score. The frames may be ranked by importance and a plurality of top-ranked frames are identified and determined to satisfy an importance threshold. The plurality of top-ranked frames are sequentially arranged and merged into a plurality of moment candidates that are ranked for importance. A subset of top-ranked moment candidates are merged into a final summarization of the multimedia content.

Classes IPC  ?

• G06F 16/45 - GroupementClassement
• G06F 16/483 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
• G06N 20/00 - Apprentissage automatique
• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo

Abrégé

The present invention includes a system for improving the visual quality of recorded videos, especially screen recordings such as webinars. The system automatically detects the boundaries of individual tile elements on a screen recording, and then performs facial recognition in order to identify which tiles include a human face and for tracking that face even when the tiles are repositioned over the course of the video. The system uses liveness detection to determine which tiles are video tiles and which tiles are screenshare tiles and then automatically shifts the relative position of the video tiles and the screenshare tiles to create an improved aesthetic quality of the recorded videos. The system is further capable of automatically integrating a company's color branding or logos into the recorded videos.

Classes IPC  ?

• G11B 27/036 - Montage par insertion
• G06V 10/44 - Extraction de caractéristiques locales par analyse des parties du motif, p. ex. par détection d’arêtes, de contours, de boucles, d’angles, de barres ou d’intersectionsAnalyse de connectivité, p. ex. de composantes connectées
• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
• G06V 40/16 - Visages humains, p. ex. parties du visage, croquis ou expressions

Abrégé

A system or process may generate a summarization of multimedia content by determining one or more salient moments therefrom. Multimedia content may be received and a plurality of frames and audio, visual, and metadata elements associated therewith are extracted from the multimedia content. A plurality of importance sub-scores may be generated for each frame of the multimedia content, each of the plurality of sub-scores being associated with a particular analytical modality. For each frame, the plurality of importance sub-scores associated therewith may be aggregated into an importance score. The frames may be ranked by importance and a plurality of top-ranked frames are identified and determined to satisfy an importance threshold. The plurality of top-ranked frames are sequentially arranged and merged into a plurality of moment candidates that are ranked for importance. A subset of top-ranked moment candidates are merged into a final summarization of the multimedia content.

Classes IPC  ?

• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
• G06F 16/45 - GroupementClassement
• G06F 16/483 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
• G06N 20/00 - Apprentissage automatique

Abrégé

The present invention includes a system for improving the visual quality of recorded videos, especially screen recordings such as webinars. The system automatically detects the boundaries of individual tile elements on a screen recording, and then performs facial recognition in order to identify which tiles include a human face and for tracking that face even when the tiles are repositioned over the course of the video. The system uses liveness detection to determine which tiles are video tiles and which tiles are screenshare tiles and then automatically shifts the relative position of the video tiles and the screenshare tiles to create an improved aesthetic quality of the recorded videos. The system is further capable of automatically integrating a company's color branding or logos into the recorded videos.

Classes IPC  ?

• G11B 27/036 - Montage par insertion
• G06V 10/44 - Extraction de caractéristiques locales par analyse des parties du motif, p. ex. par détection d’arêtes, de contours, de boucles, d’angles, de barres ou d’intersectionsAnalyse de connectivité, p. ex. de composantes connectées
• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
• G06V 40/16 - Visages humains, p. ex. parties du visage, croquis ou expressions

Abrégé

A system or process may generate a summarization of multimedia content by determining one or more salient moments therefrom. Multimedia content may be received and a plurality of frames and audio, visual, and metadata elements associated therewith are extracted from the multimedia content. A plurality of importance sub-scores may be generated for each frame of the multimedia content, each of the plurality of sub-scores being associated with a particular analytical modality. For each frame, the plurality of importance sub-scores associated therewith may be aggregated into an importance score. The frames may be ranked by importance and a plurality of top-ranked frames are identified and determined to satisfy an importance threshold. The plurality of top-ranked frames are sequentially arranged and merged into a plurality of moment candidates that are ranked for importance. A subset of top-ranked moment candidates are merged into a final summarization of the multimedia content.

Classes IPC  ?

• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
• G06F 16/45 - GroupementClassement
• G06F 16/483 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
• G06N 20/00 - Apprentissage automatique

Abrégé

A system or process may generate a summarization of multimedia content by determining one or more salient moments therefrom. Multimedia content may be received and a plurality of frames and audio, visual, and metadata elements associated therewith are extracted from the multimedia content. A plurality of importance sub-scores may be generated for each frame of the multimedia content, each of the plurality of sub-scores being associated with a particular analytical modality. For each frame, the plurality of importance sub-scores associated therewith may be aggregated into an importance score. The frames may be ranked by importance and a plurality of top-ranked frames are identified and determined to satisfy an importance threshold. The plurality of top-ranked frames are sequentially arranged and merged into a plurality of moment candidates that are ranked for importance. A subset of top-ranked moment candidates are merged into a final summarization of the multimedia content.

Classes IPC  ?

• G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
• G06F 16/45 - GroupementClassement
• G06F 16/483 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
• G06N 20/00 - Apprentissage automatique