The present disclosure provides a wearable system for providing feedback on subvocalization. The system includes at least one processor configured to determine subvocalization data obtained via a wearable detector worn by an individual, wherein the subvocalization data corresponds to physical engagement of the individual. The at least one processor analyzes the subvocalization data to make a determination whether the physical engagement is sufficient for ascertaining a subvocalized linguistic unit. The processor then provides feedback to the individual based on the determination. The feedback may include phoneme-level or word-level guidance for improving silent speech effectiveness.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G10L 21/003 - Changing voice quality, e.g. pitch or formants
G10L 25/84 - Detection of presence or absence of voice signals for discriminating voice from noise
G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
2.
SENSING FINE SKIN MOVEMENTS WITH IMPROVED SENSITIVITY
A sensing device (20) is configured to fit on a head of a user (24) and includes an optical sensing head (28), including an emitter module (40) configured to direct coherent light toward a body surface of the user and an array (52) of sensors configured to sense a secondary speckle pattern due to reflection of the coherent light from an area of the body surface and to output a signal indicative of changes over time in the secondary speckle pattern. Objective optics (50) are configured to image the area of the body surface onto an image plane (64) between the objective optics and the array. Processing circuitry (36) is configured to process the signal to generate a speech output.
Systems, methods, and computer readable medium are disclosed for interpreting facial neuromuscular activity. The disclosed system includes an ear-mountable component with at least one sensor configured to detect neuromuscular activity and at least one first processor. The at least one first processor receives signals associated with the neuromuscular activity corresponding to subvocalization, generates a first data stream based on the received signals, and transmits the first data stream via a short-range wireless interface to a secondary component. The secondary component includes at least one second processor that wirelessly receives the first data stream, performs further processing to generate a second data stream corresponding to a human-interpretable manifestation of the subvocalization, encrypts the second data stream, and wirelessly transmits the encrypted second data stream for decryption and human-interpretable presentation to an authorized entity.
Systems, methods, and computer readable medium are disclosed for resolving detected speech ambiguities. Resolving the detected speech ambiguities includes receiving audio signals representing a plurality of words vocalized by an individual; determining an ambiguity in the audio signals; during receiving of the audio signals, operating at least one sensor directed towards a non-lip region of a head of the individual; receiving, from the at least one sensor, non-audio signals indicative of neuromuscular activity associated with the non-lip region; analyzing the non-audio signals to resolve the ambiguity through an identification of at least one phoneme corresponding to the ambiguity; and generating a hybrid output of the plurality of vocalized words, wherein the hybrid output includes a first portion derived from the audio signals and a second portion derived from the non-audio signals, the second portion including a representation of the at least one phoneme.
A wearable system for facilitating silent conversations, the wearable system comprising: a housing configured to be worn on a head of an individual; at least one sensor incorporated with the housing and configured to output signals indicative of communication-related neuromuscular activity of the individual; and at least one processor configured to: receive the signals; analyze the received signals to determine substance of at least one conversation event associated with the individual; and generate at least one electronic output corresponding to the substance.
A sensing device (20, 60) configured to fit on a head of a user (24) includes an optical sensing head (28, 68) held by the device in a location in proximity to a face of the user and includes an emitter (70) configured to direct coherent light toward multiple locations on a body surface of the user and an interferometric sensor (76) configured to sense changes in a phase of the coherent light that is reflected from the multiple locations on the body surface. Processing circuitry (36) is configured to apply the sensed changes in the phase in generating a speech output. Other sensing modalities are also disclosed.
Systems, methods, and non-transitory computer-readable media including instructions for detecting and utilizing facial skin micromovements are disclosed. In some non-limiting embodiments, the detection of the facial skin micromovements occurs using a speech detection system that may include a wearable housing, a light source (either a coherent light source or a non-coherent light source), a light detector, and at least one processor. One or more processors may be configured to analyze light reflections received from a facial region to determine the facial skin micromovements, and extract meaning from the determined facial skin micromovements. Examples of meaning that may be extracted from the determined facial skin micromovements may include words spoken by the individual (either silently spoken or vocally spoken), an identification of the individual, an emotional state of the individual, a heart rate of the individual, a respiration rate of the individual, or any other biometric, emotion, or speech-related indicator.
A sensing device (20, 60) includes a bracket (22) configured to fit an ear of a user (24) of the device. An optical sensing head (28) is held by the bracket in a location in proximity to a face of the user and senses light reflected from the face and to output a signal in response to the detected light. Processing circuitry (70, 75) processes the signal to generate a speech output.
A method for generating speech includes uploading a reference set of features that were extracted from sensed movements of one or more target regions of skin on faces of one or more reference human subjects in response to words articulated by the subjects and without contacting the one or more target regions. A test set of features is extracted a from the sensed movements of at least one of the target regions of skin on a face of a test subject in response to words articulated silently by the test subject and without contacting the one or more target regions. The extracted test set of features is compared to the reference set of features, and, based on the comparison, a speech output is generated, that includes the articulated words of the test subject.
