A system and a method for recognizing a mixed input-type sequence, wherein the mixed input-type sequence comprises at least a typeset symbol and at least a handwritten stroke, comprising: retrieving the at least one typeset symbol and the at least one handwritten stroke (ST4-ST6); extracting a set of typeset features (STF1-STF3) for the at least one retrieved typeset symbol; calculating a first set of geometric features (SGF1-SGF3) for the at least one retrieved typeset symbol and a second set of geometric features (SGF4-SGF6) for the least one retrieved handwritten stroke; generating a typeset embedding (TE1-TE3) from the extracted set of typeset features (STF1-STF3) and assigning a typeset embedding (TEc) for the at least one retrieved handwritten stroke; generating geometric embeddings (GE1-GE6) from the calculated sets of geometric features; combining the generated typeset embedding (TE1-TE3) of the at least one typeset symbol and the assigned typeset embedding (TEc) of the at least one handwritten stroke with the respective geometric embeddings; applying the combined embeddings (CE1-CE6) as an input sequence representing the mixed input-type sequence to a trained neural network (NNC); and generating a sequence (OS) of recognized symbols.
Methods and devices for creating block sections are disclosed. On a display, an initial text block section (enclosing input elements are displayed. On an input interface, user selection gestures defining selection areas enclosing input elements of the initial text block sections are detected. Enclosed input elements within the initial text block sections are selected. User dragging gestures for moving the selected input elements from the initial text block sections to locations positioned outside the initial text block sections are detected. Finally, new text block sections are created enclosing the selected input elements.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Method and devices for merging, text blocks are disclosed. Source blocks enclosing first input texts and target blocks enclosing second input texts are displayed. User selection gestures for selecting the source blocks are detected. User dragging gestures for moving the source blocks over the target blocks are detected. Switching to an insertion dropping mode including displaying a cursor in the source blocks is performed. Insertion positions in the second input texts indicated by the cursor of the source blocks according to the user dragging gestures are detected. First input texts are inserted in the second input texts at the insertion positions. Finally, the target block are resized to enclose the first input texts of the source blocks and the second input texts of the target blocks.
Device and method for processing handwriting input with stroke prediction The invention relates to a method and a computing device (DV1) for processing handwriting (HW) comprising strokes (ST) of digital ink, each stroke comprising at least one point (PT). The method comprises: registering first points (PT1) as motion events; displaying, as a first stroke portion, second points (PT1a) comprising at least part of the first points (PT1); determining an integer N1 of the most recent first points (PT1c) registered over a predetermined time window; computing a confidence score (CF) based at least on a curvature score (SC1) representative of a curvature of the N1 most recent first points (PT1c); setting, based on the confidence score (CF), an integer N2 defining a prediction window; and controlling a dynamic prediction process (15) as a function of the integer N2, comprising, if N2 ≥ 1, predicting as a stroke prediction, based on features of the N1 most recent first points (PT1c), N2 next points (PT2) that are expected to be displayed subsequently to the N1 most recent first points.
Methods and devices (DV) for rescaling text blocks to maintain readability are disclosed. In a display area (5) an initial text block enclosed in an initial container including a block handle is displayed. In an input area, a user interaction gesture over the block handle is detected. The initial container height is resized according to the user interaction gesture. An updated interline ratio is determined in response to said resizing. An updated font size is determined in response to said determining of the updated interline ratio. Finally, an updated text block including the updated interline ratio and the updated font size according to the resized container is displayed.
Notetaking in electronic documents The invention relates to a computer-implemented method and a computing device (DV1) for processing an electronic document (FL1). The method may comprise: displaying a handwritten text block (BL1) of the electronic document; detecting a user selection of a first portion (PR1) of the handwritten text block (BL1); recognizing as text content the selected first portion (PR1) of the handwritten text block and a second portion (PR2), including handwritten text other than the selected first portion, of the handwritten text block (BL1) by handwriting recognition based on said handwritten text block; and obtaining first information (IF1) related to the recognised text (TX1) of the first portion (PR1) of the handwritten text block as an output of a trained predictive model (ML1) using the recognised text (TX2) of the second portion (PR2) of the handwritten text bock as context of the recognised text (TX1) of the first portion.
The invention relates to a computer-implemented method and a computing device for analysing a content (CT1) handwritten by a user (UR1). The method comprises: obtaining the handwritten content (CT1), comprising strokes (SK1) of digital ink, and temporal timestamps (TS1) associated with the strokes; extracting handwriting features (FT1) based on the strokes (SK1) and the associated temporal timestamps (TS1); and determining an originality score (SC1) indicating a probability that the handwritten content (CT1) is an original content generated by the user (UR1) or a non-original content copied by the user (UR1), by using the handwriting features (FT1) as input to at least one predictive model (ML1) of a machine learning classifier (12), said at least one predictive model being trained based on first handwritten samples (CT0a) assumed to be originally generated without copying and second handwritten samples (CT0b) assumed to be non- originally generated by copying.
G06V 10/62 - Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extractionPattern tracking
G06V 30/18 - Extraction of features or characteristics of the image
G06V 30/226 - Character recognition characterised by the type of writing of cursive writing
G06V 30/244 - Division of the character sequences into groups prior to recognitionSelection of dictionaries using graphical properties, e.g. alphabet type or font
G06V 30/24 - Character recognition characterised by the processing or recognition method
A system and method for reconstructing an ink point sequence from an image (IM) wherein the image depicts a captured handwriting input comprising: retrieving the image including pixels of the captured handwriting input; extracting a skeleton (SK) of pixels from the retrieved image; cutting the skeleton (SK) at junction pixels (1-14) and generating a plurality of segments (SG7-SG13); generating a plurality of sub-strokes as a plurality of sequences of coordinates of the segments wherein a segment provides two sub-strokes having opposite directions; generating a plurality of sub-stroke embeddings from the plurality of respective sub-strokes; using the plurality of sub-stroke embeddings to generate a set of probabilities for each sub-stroke of a sub-stroke sequence, each probability for a given sub-stroke corresponding to another sub-stroke; reconstructing the sequence of sub-strokes by selecting the sub-strokes with the highest probabilities; inferring the ink point sequence from the reconstructed sequence of sub-strokes.
A method for recognizing gesture strokes in user input applied onto an electronic document, comprising: receiving data based on the user input, the data representing a stroke and comprising a plurality of ink points and a plurality of timestamps associated with the plurality of ink point; segmenting the plurality of ink points into a plurality of segments each corresponding to a respective sub-stroke and comprising a respective subset of the plurality of ink points; determining a scale of the electronic document; generating a plurality of feature vectors based on the plurality of segments; normalizing a subset of the feature vectors according to the scale; and applying the plurality of feature vectors to a trained stroke classifier to generate a vector of probabilities including a probability that the stroke is a non-gesture stroke and a probability that the stroke is a given gesture stroke of a set of gesture types.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
A system and method of recognizing a sequence of characters of a user handwritten input. The method comprises: retrieving data representing the user handwritten input5 comprising a sequence of ink points (Pt) of the characters; identifying consecutive ink segments (Sn) comprising respective subsets of the sequence of ink points and at least one cutting point (CPt) at an edge of each ink segment; generating a sequence of ink point feature vectors (Vt) based on the sequence of ink points; applying the sequence of ink point feature vectors (Vt) as inputs to a recurrent neural network-based, RNN,10 classifier; filtering outputs (Ht) of the RNN classifier and transferring only the outputs of the RNN classifier corresponding to the at least one cutting point to a connectionist temporal classification, CTC, output layer; and determining (S170) probabilities of each character of the pre-defined writing system occurring at each consecutive cutting point.
G06V 30/18 - Extraction of features or characteristics of the image
G06V 30/184 - Extraction of features or characteristics of the image by analysing segments intersecting the pattern
G06V 30/244 - Division of the character sequences into groups prior to recognitionSelection of dictionaries using graphical properties, e.g. alphabet type or font
G06V 30/28 - Character recognition specially adapted to the type of the alphabet, e.g. Latin alphabet
The invention concerns a method for recognizing handwriting input from handwriting strokes of digital ink, on a computing device, the computing device comprising a processor with at least two processing units configured to process data in parallel, a memory and at least one non-transitory computer readable medium for recognizing input under control of the processor, the method, comprising: receiving the handwriting strokes of digital ink; performing element extraction from said strokes to extract a plurality of elements; recognizing the plurality of elements in parallel by: sending at least two elements of the extracted plurality of elements to at least two processing units, respectively; sending successively the remaining elements of the extracted plurality of elements to the processing units as the processing units become available; compiling the plurality of recognized elements to generate the recognized handwriting input.
The invention relates to a method implemented by a first device (DV1) cooperating with a cloud (CL) of at least one server for resolving a synchronization conflict over different versions of a document object comprising at least one content file and one object descriptor file (ODF1). The method comprising obtaining a first version of the document object; performing a first synchronization phase comprising sending the first version (ODF1) of the object descriptor file, independently of the first version of the content file, to the cloud (CL); performing a second synchronization phase for resolving the conflict by re-sending the first version (ODF1) of the object descriptor file of the first device (DV1) to the cloud (CL); performing a third synchronization phase subsequent to the second synchronization phase, comprising sending the first version of the content file to the cloud (CL) for storing said first version of content file.
A computing device and method for performing a modification on digital content of a document, comprising: a display interface configured to display the digital content as a handwritten input or a typeset input; an identification module (MD2) configured to interpret the digital content as one or more objects; a mode type selection module (MD6) configured to select a mode type, wherein said mode type is pixel-mode or object-mode; an input surface (104) configured to detect a modification gesture wherein one or more boundaries of the modification gesture are intersecting with at least part of the digital content; a selection module (MD8) configured to select, at least partially, the digital content according to the selected mode type, and a modification module (MD10) configured to modify at least the selected digital content.
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
The invention relates to a device and method for editing handwritten input elements of an electronic document. The method comprises: detecting a user selection gesture (SG30) defining a selection area (385) enclosing first and second handwritten input elements (310-370); selecting an object semantic level wherein the first and second handwritten input elements are recognized as first and second objects of the selected semantic level; selecting the recognized objects by calculating first and second coverages of the enclosed parts of the first and second objects; setting a reference coverage to be equal to the highest coverage; calculating a selection threshold as a function of the reference coverage; comparing the calculated first and second coverages to the selection threshold; identifying at least one calculated coverage higher than the selection threshold; and selecting the objects with said calculated coverage; and editing the selected objects of the electronic document.
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
Devices and methods for font size setting are disclosed. According to a method, in response to a typesetting input mode action detection, a handwriting input text (300) is recognized as multiple words defining at least one text block. A word base height for each recognized word of a text block is calculated. The word base height is calculated as an average base width of the recognized word, an average base height of the recognized word, or an average of the average base width and the average base height of the recognized word, depending on the number of characters of each word. A font size of the text block is calculated then as an average of the word base heights of the words of the text block.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 40/109 - Font handlingTemporal or kinetic typography
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
16.
Completing typeset characters using handwritten strokes
A system and method for completing a character of a text of a digital document on a computing device, the computing device comprising a processor, a memory, and at least one non-transitory computer readable medium for recognizing input under control of the processor, the at least one non-transitory computer readable medium is configured to cause display (S900) of at least one typeset character of the text on a display interface of the computing device; detect a handwritten input stroke (S902) performed on the digital document in the vicinity of a typeset character; identify an first typeset character (S904) if the typeset character belongs to a list of base characters according to a language model; retrieve a predefined character version (S906) of the first typeset character from the memory; generate a hybrid character (S908) by replacing the initial typeset character by the predefined character; generate a list of character candidates (S910) with associated probabilities of recognition of the hybrid character provided by a recognition expert; select a recognized character (S912) from the character candidate list by using a language expert.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 40/109 - Font handlingTemporal or kinetic typography
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
G06V 30/226 - Character recognition characterised by the type of writing of cursive writing
17.
SYSTEMS AND METHODS FOR MACRO-MODE DOCUMENT EDITING
A system for editing digital documents on computing devices is disclosed. Each computing device comprising a processor and at least one non-transitory computer readable medium for recognizing handwriting input under control of the processor, the at least one non-transitory computer readable medium configured to cause display of, on a display interface of a computing device, digital ink in accordance with document content in a full-page mode, cause display of, on the display interface of the computing device, digital ink in accordance with document content in a macro mode selectively transition, via a transitioner, between the full-page mode and the macro mode and edit document content, in response to a user touch or gesture, when the digital ink in accordance with document content is displayed in the macro mode.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04886 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Method and devices for merging, text blocks are disclosed. Source blocks enclosing first input texts and target blocks enclosing second input texts are displayed. User selection gestures for selecting the source blocks are detected. User dragging gestures for moving the source blocks over the target blocks are detected. Switching to an insertion dropping mode including displaying a cursor in the source blocks is performed. Insertion positions in the second input texts indicated by the cursor of the source blocks according to the user dragging gestures are detected. First input texts are inserted in the second input texts at the insertion positions. Finally, the target block are resized to enclose the first input texts of the source blocks and the second input texts of the target blocks.
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
Methods and devices (DV) for rescaling text blocks to maintain readability are disclosed. In a display area (5) an initial text block enclosed in an initial container including a block handle is displayed. In an input area, a user interaction gesture over the block handle is detected. The initial container height is resized according to the user interaction gesture. An updated interline ratio is determined in response to said resizing. An updated font size is determined in response to said determining of the updated interline ratio. Finally, an updated text block including the updated interline ratio and the updated font size according to the resized container is displayed.
G06T 11/60 - Editing figures and textCombining figures or text
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computerOutput arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
Methods and devices for creating block sections are disclosed. On a display, an initial text block section (enclosing input elements are displayed. On an input interface, user selection gestures defining selection areas enclosing input elements of the initial text block sections are detected. Enclosed input elements within the initial text block sections are selected. User dragging gestures for moving the selected input elements from the initial text block sections to locations positioned outside the initial text block sections are detected. Finally, new text block sections are created enclosing the selected input elements.
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
21.
Recognizing handwritten text by combining neural networks
A method for recognizing handwritten text is disclosed. The method comprises receiving data comprising a sequence of ink points; applying the received data to a neural network-based sequence classifier trained with a Connectionist Temporal Classification (CTC) output layer using forced alignment to generate an output; generating a character hypothesis as a portion of the sequence of ink points; applying the character hypothesis to a character classifier to obtain a first probability corresponding to the probability that the character hypothesis includes the given character; processing the output of the CTC output layer to determine a second probability corresponding to the probability that the given character is observed within the character hypothesis; and combining the first probability and the second probability to obtain a combined probability corresponding to the probability that the character hypothesis includes the given character.
The invention concerns a method implemented by a device for displaying strokes of digital ink in a display area and for performing text line extraction to extract text lines from the strokes. In particular, the text line extraction may involve slicing the display area into strips, ordering for each strip the strokes into ordered lists which form collectively a first set of ordered lists, forming for each strip a second set of ordered lists by filtering out from the ordered lists of the first set strokes which are below a given size threshold, and performing a neural net analysis based on said first and second sets to determine for each stroke a respective text line to which it belongs.
G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
23.
Classifying handwritten math and text symbols using spatial syntactic rules, semantec connections, and ink-related information of strokes forming the symbols
The invention relates to a method implemented by a computing device for processing math and text in handwriting, comprising: identifying symbols by performing handwriting recognition on a plurality of strokes; classifying, as a first classification, first symbols as either a text symbol candidate or a math symbol candidate with a confidence score reaching a first threshold; classifying, as a second classification, second symbols other than first symbols as either a text symbol candidate or a math symbol candidate with a respective confidence score by applying predefined spatial syntactic rules; updating or confirming, as a third classification, a result of the second classification by establishing semantic connections between symbols and comparing the semantic connections with the result of the second classification; and recognising each symbol as either text or math based on a result of said third classification.
G06V 30/262 - Techniques for post-processing, e.g. correcting the recognition result using context analysis, e.g. lexical, syntactic or semantic context
G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
G06V 30/244 - Division of the character sequences into groups prior to recognitionSelection of dictionaries using graphical properties, e.g. alphabet type or font
The invention relates to methods and devices for managing document layout of an electronic document. In a particular embodiment, a method implemented by a computing devices comprises: displaying in an electronic document a block containing at least one item; in response to a first finger gesture of two or more fingers defining at least two selection points, determining a space line specifying an initial position from which a space is to be managed in the electronic document; in response to a second finger gesture of two or more fingers defining a movement of the selected points along a first orientation, monitoring a current position of the space line moving over time; and performing a space management based on the current position of the space line along the first orientation, comprising creating and/or reducing a space in the electronic document.
G06F 40/106 - Display of layout of documentsPreviewing
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
A method for processing lists in handwriting, comprising: initially classifying each of a plurality of text lines as a distinct text item which is not part of a list; and a classification process comprising a pattern detection in each text line for classifying each text line starting with a predetermined list symbol as a distinct list item which is part of a list; determining an item indentation of each text item with respect to a reference position and determining for each list item a text indentation representing the indentation of text comprised in said list item; and a merging step for merging, as part of a same text item, or as part of a same list item, if predefined conditions are met. A text structure data model may then be generated based on a result of the merging process.
The invention relates to a method implemented by a first device (DV1) cooperating with a cloud (CL) of at least one server for resolving a synchronization conflict over different versions of a document object comprising at least one content file and one object descriptor file (ODF1). The method comprising obtaining a first version of the document object; performing a first synchronization phase comprising sending the first version (ODF1) of the object descriptor file, independently of the first version of the content file, to the cloud (CL); performing a second synchronization phase for resolving the conflict by re-sending the first version (ODF1) of the object descriptor file of the first device (DV1) to the cloud (CL); performing a third synchronization phase subsequent to the second synchronization phase, comprising sending the first version of the content file to the cloud (CL) for storing said first version of content file.
A method for recognizing gesture strokes in user input, comprising: receiving data generated based on the user input, the data representing a stroke and comprising a plurality of ink points in a rectangular coordinate space and a plurality of timestamps associated respectively with the plurality of ink points; segmenting the plurality of ink points into a plurality of segments each corresponding to a respective sub-stroke of the stroke and comprising a respective subset of the plurality of ink points; generating a plurality of feature vectors based respectively on the plurality of segments; and applying the plurality of feature vectors as an input sequence representing the stroke to a trained stroke classifier to generate a vector of probabilities including a probability that the stroke is a non-gesture stroke and a probability that the stroke is a given gesture stroke of a set of gesture strokes.
G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
G06V 30/182 - Extraction of features or characteristics of the image by coding the contour of the pattern
G06V 30/30 - Character recognition based on the type of data
28.
GESTURE STROKE RECOGNITION IN TOUCH-BASED USER INTERFACE INPUT
A method for recognizing gesture strokes in user input applied onto an electronic document, comprising: receiving data based on the user input, the data representing a stroke and comprising a plurality of ink points and a plurality of timestamps associated with the plurality of ink points; segmenting the plurality of ink points into a plurality of segments each corresponding to a respective sub-stroke and comprising a respective subset of the plurality of ink points; determining a scale of the electronic document; generating a plurality of feature vectors based on the plurality of segments; normalizing a subset of the feature vectors according to the scale; and applying the plurality of feature vectors to a trained stroke classifier to generate a vector of probabilities including a probability that the stroke is a non-gesture stroke and a probability that the stroke is a given gesture stroke of a set of gesture types.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
A system, method and computer program product for use in managing collaboration on documents having digital ink on a network of computing devices is disclosed. Each computing device has a processor and at least one system application for processing handwriting input under control of the processor. The system application displays, on a display associated with one of the computing devices, a document having digital ink based on a journal of the document, defines the journal to have journal entries associated with at least handwriting input to the document represented by the digital ink, and communicates the journal entries of the journal with one or more of the other networked computing devices displaying the document. The handwriting input associated with the journal entries is handwriting input to the document via the input interface of any of the computing devices displaying the document based on the communicated journal entries.
A computing device and method for performing a modification on digital content of a document, comprising: a display interface configured to display the digital content as a handwritten input or a typeset input; an identification module (MD2) configured to interpret the digital content as one or more objects; a mode type selection module (MD6) configured to select a mode type, wherein said mode type is pixel-mode or object-mode; an input surface (104) configured to detect a modification gesture wherein one or more boundaries of the modification gesture are intersecting with at least part of the digital content; a selection module (MD8) configured to select, at least partially, the digital content according to the selected mode type, and a modification module (MD10) configured to modify at least the selected digital content.
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
09 - Scientific and electric apparatus and instruments
Goods & Services
Recorded and downloadable software for handwriting
recognition using interactive ink technology, namely,
software for digital note-taking, management of texts,
graphics, music scores, equations and matrices.
32.
COMPLETING TYPESET CHARACTERS USING HANDWRITTEN STROKES
A system and method for completing a character of a text of a digital document on a computing device, the computing device comprising a processor, a memory, and at least one non-transitory computer readable medium for recognizing input under control of the processor, the at least one non-transitory computer readable medium is configured to cause display (S900) of at least one typeset character of the text on a display interface of the computing device; detect a handwritten input stroke (S902) performed on the digital document in the vicinity of a typeset character; identify an first typeset character (S904) if the typeset character belongs to a list of base characters according to a language model; retrieve a predefined character version (S906) of the first typeset character from the memory; generate a hybrid character (S908) by replacing the initial typeset character by the predefined character; generate a list of character candidates (S910) with associated probabilities of recognition of the hybrid character provided by a recognition expert; select a recognized character (S912) from the character candidate list by using a language expert.
09 - Scientific and electric apparatus and instruments
Goods & Services
Recorded and downloadable software for handwriting recognition using interactive ink technology, namely, software for digital note-taking, management of texts, graphics, music scores, equations and matrices
34.
RECOGNIZING HANDWRITTEN TEXT BY COMBINING NEURAL NETWORKS
A method for recognizing handwritten text is disclosed. The method comprises receiving data comprising a sequence of ink points; applying the received data to a neural network-based sequence classifier trained with a Connectionist Temporal Classification (CTC) output layer using forced alignment to generate an output; generating a character hypothesis as a portion of the sequence of ink points; applying the character hypothesis to a character classifier to obtain a first probability corresponding to the probability that the character hypothesis includes the given character; processing the output of the CTC output layer to determine a second probability corresponding to the probability that the given character is observed within the character hypothesis; and combining the first probability and the second probability to obtain a combined probability corresponding to the probability that the character hypothesis includes the given character.
09 - Scientific and electric apparatus and instruments
Goods & Services
Software for handwriting recognition, namely, application
for digital and interactive note taking as well as
management of texts, graphics and sheet music.
09 - Scientific and electric apparatus and instruments
Goods & Services
Software for handwriting recognition, namely, application
for digital and interactive note taking as well as
management of texts, graphics and sheet music.
37.
System and method of guiding handwriting diagram input
A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04817 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
09 - Scientific and electric apparatus and instruments
Goods & Services
downloadable handwriting recognition software, namely, an application for digital and interactive note taking as well as managing text, graphics and sheet music; recorded handwriting recognition software, namely, an application for digital and interactive note taking as well as managing text, graphics and sheet music
09 - Scientific and electric apparatus and instruments
Goods & Services
downloadable handwriting recognition software, namely, an application for digital and interactive note taking as well as managing text, graphics and sheet music; recorded handwriting recognition software, namely, an application for digital and interactive note taking as well as managing text, graphics and sheet music
The invention relates to a method for processing lists in handwriting (IN), comprising: initially classifying each of a plurality of text lines (LN) as a distinct text item (TI) which is not part of a list; and a classification process comprising a pattern detection in each text line (LN) for classifying each text line starting with a predetermined list symbol (BT) as a distinct list item (LI) which is part of a list; determining an item indentation (22) of each text item (TI) with respect to a reference position (30) and determining for each list item (LI) a text indentation (24) representing the indentation of text comprised in said list item; and a merging step for merging, as part of a same text item (TI), or as part of a same list item (LI), if predefined conditions are met. A text structure data model may then be generated based on a result of the merging process, thereby defining each text line (LN) as part of either a text item (TI) or a list item (LI).
The invention relates to a method implemented by a computing device (100) for processing math and text in handwriting, comprising: identifying symbols by performing handwriting recognition on a plurality of strokes (SK); classifying, as a first classification, first symbols as either a text symbol candidate or a math symbol candidate with a confidence score reaching a first threshold; classifying, as a second classification, second symbols other than first symbols as either a text symbol candidate or a math symbol candidate with a respective confidence score by applying predefined spatial syntactic rules (RL2); updating or confirming, as a third classification, a result of the second classification by establishing semantic connections between symbols and comparing the semantic connections with the result of the second classification; and recognising each symbol as either text or math based on a result of said third classification.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/62 - Methods or arrangements for recognition using electronic means
G06K 9/72 - Methods or arrangements for recognition using electronic means using context analysis based on the provisionally recognised identity of a number of successive patterns, e.g. a word
The invention relates to methods and devices for managing document layout of an electronic document. In a particular embodiment, a method implemented by a computing devices comprises: displaying in an electronic document (20) a block (BC) containing at least one item (IT1, IT2); in response to a first finger gesture of two or more fingers defining at least two selection points (PT1, PT2), determining a space line specifying an initial position (PS1) from which a space is to be managed in the electronic document; in response to a second finger gesture of two or more fingers defining a movement (MV1) of the selected points along a first orientation (OR1), monitoring a current position (PS2) of the space line moving over time; and performing a space management based on the current position of the space line along the first orientation, comprising creating and/or reducing a space (SP1) in the electronic document.
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 40/103 - Formatting, i.e. changing of presentation of documents
G06F 40/106 - Display of layout of documentsPreviewing
A method for recognizing gesture strokes in user input applied via a touch-based user interface onto an electronic document, comprising: receiving data generated based on the user input, the data representing a stroke and comprising a plurality of ink points in a rectangular coordinate space and a plurality of timestamps associated respectively with the plurality of ink points; segmenting the plurality of ink points into a plurality of segments each corresponding to a respective sub-stroke of the stroke and comprising a respective subset of the plurality of ink points; generating a plurality of feature vectors based respectively on the plurality of segments; and applying the plurality of feature vectors as an input sequence representing the stroke to a trained stroke classifier to generate a vector of probabilities including a probability that the stroke is a non-gesture stroke and a probability that the stroke is a given gesture stroke of a set of gesture strokes.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/22 - Image acquisition using hand-held instruments
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
The invention relates to a method on a computing device comprising: displaying in a display area graphical objects, this display area comprising a structured text section with text objects and block sections with text or non-text objects; locating an initiation point from which starts a user selection gesture; determining a selection path forming a selection area; and selecting each graphical object contained within the selection area. If the initiation point is located in the structured text section, a first mode may be selected thereby allowing the selection path to be drawn in the display area to select any graphical object. If the initiation point is located within a target block section among the block sections, a second mode may be selected, thereby confining the selection path within the target block section.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
The invention relates to a method on a computing device comprising: displaying in a display area (200) graphical objects (OB1-OB11), this display area comprising a structured text section (202) with text objects (OBI, OB2) and block sections (BL) with text or non-text objects (OB5-OB11); locating an initiation point (PT1) from which starts a user selection gesture (GT1); determining a selection path (210) forming a selection area (212); and selecting each graphical object contained within the selection area (212). If the initiation point is located in the structured text section, a first mode may be selected thereby allowing the selection path to be drawn in the display area to select any graphical object. If the initiation point is located within a target block section among the block sections (BL), a second mode may be selected, thereby confining the selection path (210) within the target block section.
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
The invention concerns a method implemented by a device for displaying strokes of digital ink in a display area and for performing text line extraction to extract text lines from the strokes. In particular, the text line extraction may involve slicing the display area into strips, ordering for each strip the strokes into ordered lists which form collectively a first set of ordered lists, forming for each strip a second set of ordered lists by filtering out from the ordered lists of the first set strokes which are below a given size threshold, and performing a neural net analysis based on said first and second sets to determine for each stroke a respective text line to which it belongs.
A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of input diagram elements in interactive digital ink is performed on a display device associated with the computing device. One or more of the diagram elements are associated with one or more other of the diagram elements in accordance with a class and type of each diagram element. The diagram elements are re-displayed based on one or more interactions with the digital ink received and in accordance with the one or more associations.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06T 11/20 - Drawing from basic elements, e.g. lines or circles
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
The invention concerns a method implemented by a device for displaying strokes (ST) of digital ink in a display area and for performing text line extraction to extract text lines from the strokes (ST). In particular, the text line extraction may involve slicing the display area into strips (SP), ordering for each strip (SP) the strokes (ST) into ordered lists which form collectively a first set of ordered lists, forming for each strip (SP) a second set of ordered lists by filtering out from the ordered lists of the first set strokes which are below a given size threshold, and performing a neural net analysis based on said first and second sets to determine for each stroke a respective text line to which it belongs.
The invention concerns a method comprising: detecting strokes of digital ink input on a computing device in a free handwriting format; detecting a text block from said strokes; performing text recognition on each text line of said text block, including extracting text lines from the text block and generating model data that associate each stroke of the text block with a character, a word and a text line of the text block; normalizing each text line from the free handwriting format into a structured format to comply with a document pattern. The normalization may comprise for each text line: computing a transform function to transform said text line into the structured format; applying the transform function to the text line; and updating the model data of said text line based on the transform function.
The invention concerns a method comprising: detecting strokes of digital ink (IN) input on a computing device in a free handwriting format (FT1); detecting a text block (BL1) from said strokes; performing text recognition on each text line of said text block, including extracting text lines from the text block (BL1) and generating model data that associate each stroke of the text block with a character, a word and a text line of the text block (BL1); normalising each text line from the free handwriting format (FT1) into a structured format (FT2) to comply with a document pattern (200). The normalisation may comprise for each text line: computing a transform function to transform said text line into the structured format; applying the transform function to the text line; and updating the model data of said text line based on the transform function.
The invention relates to a method in a computing device (100) for hand-drawing elements, comprising: detecting input elements hand-drawn on an input surface (104); displaying the input elements in digital ink on a display device (102); classifying input digital ink as text or non-text and predefining blocks of input elements; selecting one or more input element according to a first selection mode triggered by a first gesture or according to a second selection mode triggered by a second gesture to select input elements within a selection area. Once selection is made, editing may be performed on the selected input elements in a different manner depending of which of the first and second selection mode is used.
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
52.
System and method for selecting and editing handwriting input elements
The invention relates to a method in a computing device for hand-drawing elements, comprising: detecting input elements hand-drawn on an input surface; displaying the input elements in digital ink on a display device; classifying input digital ink as text or non-text and predefining blocks of input elements; selecting one or more input element according to a first selection mode triggered by a first gesture or according to a second selection mode triggered by a second gesture to select input elements within a selection area. Once selection is made, editing may be performed on the selected input elements in a different manner depending of which of the first and second selection mode is used.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06V 30/142 - Image acquisition using hand-held instrumentsConstructional details of the instruments
09 - Scientific and electric apparatus and instruments
Goods & Services
Handwriting recognition software using interactive ink
technology, namely, software for digital note taking,
management of texts, graphics, music scores, equations and
matrices.
09 - Scientific and electric apparatus and instruments
Goods & Services
downloadable handwriting recognition software for converting handwriting to digital text using interactive ink technology ; downloadable handwriting calculation software for converting handwritten mathematic calculations to digital text and obtaining the result in real time
09 - Scientific and electric apparatus and instruments
Goods & Services
downloadable handwriting recognition software using interactive ink technology, namely, downloadable software for digital note taking, management of texts, graphics, music scores, equations and matrices
57.
System and method for mixed content digital ink interactivity
A system, method and computer program product for use in providing interactive ink from handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and an ink management system for recognizing the handwriting input under control of the processor. The ink management system is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with first handwriting input, allocate references to ink elements of the first digital ink, define boundaries of the first digital ink associated with the allocated references, cause placement of an editing position at a defined boundary in response to an editing gesture, cause display of, on the display interface of the computing device, first typeset ink in accordance with first typeset input at the editing position.
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computerOutput arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
A system for recognition of objects from ink elements on a computing device is provided. The computing device comprises a processor, a memory and at least one non-transitory computer readable medium for recognizing content under control of the processor. The at least one non-transitory computer readable medium is configured to determine a perimeter of an ink element stored in a memory of the computing device, determine a plurality of pen units for the ink element based on the determined ink element perimeter, determine at least one stroke representing a path through two or more of the pen units, and cause recognition of one or more objects represented by the ink element using the determined at least one stroke.
A system for recognition of objects from ink elements on a computing device is provided. The computing device comprises a processor, a memory and at least one non-transitory computer readable medium for recognizing content under control of the processor. The at least one non- transitory computer readable medium is configured to determine a perimeter of an ink element stored in a memory of the computing device, determine a plurality of pen units for the ink element based on the determined ink element perimeter, determine at least one stroke representing a path through two or more of the pen units, and cause recognition of one or more objects represented by the ink element using the determined at least one stroke.
A system and method for managing connections of diagrams elements is provided. The system and method may be configured to cause display of a plurality of input diagram elements in interactive ink on a display device, identify at least one diagram element as a connector connecting a plurality of diagram elements, determine a geometrical construct of each of the connected diagram elements, map points of connection of the at least one identified connector to the connected diagram elements onto the geometrical constructs to define mapped points, adjust the positions of the mapped points on the geometrical constructs based on one or more interactions received with the interactive ink, and cause re-display of the diagram elements in accordance with at least mapping of the adjusted mapped points on the connected diagram elements as adjusted connection points.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
61.
SYSTEM AND METHOD FOR RECOGNIZING HANDWRITTEN STROKE INPUT
A system, method and computer program product for use in recognizing content associated with handwritten stroke input to a computing device is provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing content defined by the input. The input management system is configured to detect input of a handwritten stroke with respect to the interactive key layout, characterize the detected handwritten stroke by a reference stroke by determining a sequence of reference points associated with a sequence of interactive keys of the interactive key layout, assign probability scores to candidate characters, and cause recognition of sequences of characters by applying a language model in accordance with the assigned probability scores.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
62.
System and method for recognizing handwritten stroke input
A system, method and computer program product for use in recognizing content associated with handwritten stroke input to a computing device is provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing content defined by the input. The input management system is configured to detect input of a handwritten stroke with respect to the interactive key layout, characterize the detected handwritten stroke by a reference stroke by determining a sequence of reference points associated with a sequence of interactive keys of the interactive key layout, assign probability scores to candidate characters, and cause recognition of sequences of characters by applying a language model in accordance with the assigned probability scores.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
G06F 40/274 - Converting codes to wordsGuess-ahead of partial word inputs
A system, method and computer program product for managing typesetting of digital ink structured content on computing devices. Each computing device has a processor and at least one system application for recognizing handwriting input under control of the processor. The system application determines dimensional information of at least digital ink text elements of structured content, calculates a first font size for each typeset ink text element respectively corresponding to the digital ink text elements based on at least part of the dimensional information, categorizes the typeset ink text elements into one or more categories of the structured content, determines a second font size for each typeset ink text element based on the first font size of each typeset ink text element of the respective category, and display, on a display associated with the computing device, the typeset ink text elements at the respective determined second font sizes.
A system, method and computer program product for managing typesetting of digital ink structured content on computing devices. Each computing device has a processor and at least one system application for recognizing handwriting input under control of the processor. The system application determines dimensional information of at least digital ink text elements of structured content, calculates a first font size for each typeset ink text element respectively corresponding to the digital ink text elements based on at least part of the dimensional information, categorizes the typeset ink text elements into one or more categories of the structured content, determines a second font size for each typeset ink text element based on the first font size of each typeset ink text element of the respective category, and display, on a display associated with the computing device, the typeset ink text elements at the respective determined second font sizes.
A system, method and computer program product for use in managing collaboration on documents having digital ink on a network of computing devices is disclosed. Each computing device has a processor and at least one system application for processing handwriting input under control of the processor. The system application displays, on a display associated with one of the computing devices, a document having digital ink based on a journal of the document, defines the journal to have journal entries associated with at least handwriting input to the document represented by the digital ink, and communicates the journal entries of the journal with one or more of the other networked computing devices displaying the document. The handwriting input associated with the journal entries is handwriting input to the document via the input interface of any of the computing devices displaying the document based on the communicated journal entries.
A system, method and computer program product for use in managing collaboration on documents having digital ink on a network of computing devices. Each computing device has a processor and at least one and at least one system application for processing handwriting input under control of the processor. The system application displays, on a display associated with one of the computing devices, a document having digital ink based on a journal of the document, defines the journal to have journal entries associated with at least handwriting input to the document represented by the digital ink, and communicates the journal entries of the journal with one or more of the other networked computing devices displaying the document. The handwriting input associated with the journal entries is handwriting input to the document via the input interface of any of the computing devices displaying the document based on the communicated journal entries.
A system, method and computer program product for use in beautifying superimposed handwriting on a computing device are provided. The computing device includes a processor and at least one application for processing handwriting input under control of the processor. The system application receives handwritten input as a plurality of at least partially superimposed input strokes, determines geometrical information of a plurality of characters defined by the handwriting input, determines a structuring transformation of the handwritten input in accordance with the geometrical information to align the characters in non-superimposed order, and causes display of, on a display interface of the computing device, digital ink in accordance with the structuring transformation.
A system, method and computer program product for use in providing a linguistic resource for input recognition of multiple input types on a computing device are provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The counting device has an input management system for recognizing the input. The input management system is configured to allow setting, in the computing device memory, parameters of a linguistic resource for a language model of one or more languages, and cause recognition of input to the input interface of the different input types using the linguistic resource. The resource parameters are set to optimize recognition performance characteristics of each input type while providing the linguistic resource with the pre-determined size.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
69.
System and method for input recognition linguistic resource management
A system, method and computer program product for use in providing a linguistic resource for input recognition of multiple input types on a computing device are provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing the input. The input management system is configured to allow setting, in the computing device memory, parameters of a linguistic resource for a language model of one or more languages, and cause recognition of input to the input interface of the different input types using the linguistic resource. The resource parameters are set to optimize recognition performance characteristics of each input type while providing the linguistic resource with the pre-determined size.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
G06F 40/274 - Converting codes to wordsGuess-ahead of partial word inputs
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/04886 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
A system, method, and computer program product for managing editing of content on computing devices are provided. An input field for accepting input of a first type is displayed on an interface. An interaction field for accepting input of a second type displayed in place of the input field based on detection of a first interaction with the interface is displayed on the interface, wherein the interaction field displays first content based on the first input type. A second interaction with the first content is detected based on recognition of the second type input. The first content is modified based on detected second interaction.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
A system, method, and computer program product for managing editing of content on computing devices are provided. An input field for accepting input of a first type is displayed on an interface. An interaction field for accepting input of a second type displayed in place of the input field based on detection of a first interaction with the interface is displayed on the interface, wherein the interaction field displays first content based on the first input type. A second interaction with the first content is detected based on recognition of the second type input. The first content is modified based on detected second interaction.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
72.
METHOD AND SYSTEM FOR CHARACTER INSERTION IN A CHARACTER STRING
The disclosure relates to a character input method and system, which may include a digital device including a touchscreen that has a recognition area (30) and an insertion area (28). The method and system may include hardware and/or operations for: scrolling a string (32) of characters (34) that are displayed in the recognition area (28) so as to select a position between a first character and a second character; detecting input strokes (36) that are entered manually in the insertion area (30); performing handwriting recognition to convert the detected input strokes (36) into recognised characters; inserting, at the position within the string (32) of characters, the recognised characters; and scrolling the string (32) of characters in the recognition area (28) so as to display, in the recognition area (28), the recognised characters that were inserted into the string (32) of characters (34).
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
The disclosure relates to a character input method and system, which may include a digital device including an input surface and an output surface. The method and system may include or perform operations including: displaying a character string (32) using a recognition area (28) and an insertion area (30) of the output surface; selecting a position within the character string (32); displaying, in the recognition area (28), a part of the string (32) ending with a first character (34) while masking, in the insertion area (30), a part of the string (32) starting with a second, succeeding character; detecting an input stroke (36) entered manually in the insertion area; performing handwriting recognition; inserting, at the position within the string (32) of characters (34), a recognised character(s); and scrolling the string (32) in the recognition area (28) so as to display, in the recognition area (28), the recognised character(s) that were inserted into the string (32) of characters (34).
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
The disclosure relates to a character input method and system, which may include a digital device including a touchscreen that has a recognition area and an insertion area. The method and system may include hardware and/or operations for: scrolling a string of characters that are displayed in the recognition area so as to select a position between a first character and a second character; detecting input strokes that are entered manually in the insertion area; performing handwriting recognition to convert the detected input strokes into recognised characters; inserting, at the position within the string of characters, the recognised characters; and scrolling the string of characters in the recognition area so as to display, in the recognition area, the recognised characters that were inserted into the string of characters.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
A system, method and computer program product for use in recognizing input of multiple input types on a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The computing device further comprises an input management system for recognizing the input. The input management system is configured to accept input, with respect to the interface surface, of one or more different types of input, cause recognition of the input as recognized objects regardless of the one or more input types, each recognized object being associated with a corresponding probability of recognition, and return at least one of the recognized objects as the recognized input based on the probabilities.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
76.
Method for inserting characters in a character string and the corresponding digital service
The disclosure relates to a character input method and system, which may include a digital device including an input surface and an output surface. The method and system may include or perform operations including: displaying a character string using a recognition area and an insertion area of the output surface; selecting a position within the character string; displaying, in the recognition area, a part of the string ending with a first character while masking, in the insertion area, a part of the string starting with a second, succeeding character; detecting an input stroke entered manually in the insertion area; performing handwriting recognition; inserting, at the position within the string of characters, a recognised character(s); and scrolling the string in the recognition area so as to display, in the recognition area, the recognised character(s) that were inserted into the string of characters.
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
A system, method and computer program product for use in recognizing input of multiple input types on a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The computing device further has an input management system for recognizing the input. The input management system is configured to accept input, with respect to the interface surface, of one or more different types of input, cause recognition of the input as recognized objects regardless of the one or more input types, each recognized object being associated with a corresponding probability of recognition, and return at least one of the recognized objects as the recognized input based on the probabilities.
G06F 3/04886 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 40/274 - Converting codes to wordsGuess-ahead of partial word inputs
A system, method, and computer program for recognizing an arrangement of multiple objects on computing devices. The computing device may include a processor and at least one non-transitory computer readable medium for recognizing handwriting input under control of the processor. The non-transitory computer readable medium may be configured to determine with the medium at least one geometrical relationship between a plurality of recognized elements "of the input and allocate with the medium the recognized elements having the at least one geometrical relationship therebetween to corresponding positions of an arrangement of the recognized elements. The positions of the arrangement may be cells of a two-dimensional structure of the recognized elements. The at least one geometrical relationship may be an overlap of the plurality of recognized elements in one or more directions of the arrangement.
A system, method, and computer program for recognizing an arrangement of multiple objects on computing devices. The computing device may include a processor and at least one non-transitory computer readable medium for recognizing handwriting input under control of the processor. The non-transitory computer readable medium may be configured to determine with the medium at least one geometrical relationship between a plurality of recognized elements of the input and allocate with the medium the recognized elements having the at least one geometrical relationship therebetween to corresponding positions of an arrangement of the recognized elements. The positions of the arrangement may be cells of a two-dimensional structure of the recognized elements. The at least one geometrical relationship may be an overlap of the plurality of recognized elements in one or more directions of the arrangement.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/72 - Methods or arrangements for recognition using electronic means using context analysis based on the provisionally recognised identity of a number of successive patterns, e.g. a word
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
A system, method and computer program product for use in providing interactive ink from handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and an ink management system for recognizing the handwriting input under control of the processor. The ink management system is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with first handwriting input, allocate references to ink elements of the first digital ink, map the references to corresponding recognized elements of the first handwriting input, and determine and store, in the memory of a computing device, ink objects including the references and mapped recognized elements.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/0354 - Pointing devices displaced or positioned by the userAccessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
A system, method and computer program product for use in providing interactive ink from handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface of a touch sensitive display. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and an ink management system for recognizing the handwriting input under control of the processor. The ink management system is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with first handwriting input, allocate references to ink elements of the first digital ink, map the references to corresponding recognized elements of the first handwriting input, and determine and store, in the memory of a computing device, ink objects including the references and mapped recognized elements; whereby an ink object represents a graphically separated handwritten word.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
A system, method and computer program product for use in beautifying digital ink of handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of the digital ink, determine from geometrical information of the handwriting input determined through the recognition of the handwriting input and geometrical information of an alignment structure of the display interface, a structuring transformation of the digital ink, and cause display of transformed digital ink in accordance with the structuring transformation.
A system, method and computer program product for use in beautifying digital ink of handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of the digital ink, determine from geometrical information of the handwriting input determined through the recognition of the handwriting input and geometrical information of an alignment structure of the display interface, a structuring transformation of the digital ink, and cause display of transformed digital ink in accordance with the structuring transformation.
G06T 3/00 - Geometric image transformations in the plane of the image
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
A system for editing digital documents on computing devices is provided. Each computing device comprises a processor and at least one non-transitory computer readable medium for recognizing handwriting input under control of the processor. The at least one non-transitory computer readable medium is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with document content, detect handwriting input as one or more editing gestures with respect to the document content, and cause display of, on the display interface, second digital ink in accordance with handwriting input.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
A system, method and computer program product for use in editing digital documents with handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with document content, detect handwriting input as one or more editing gestures with respect to the document content, and, cause display of, on the display interface, second digital ink in accordance with handwriting input.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0483 - Interaction with page-structured environments, e.g. book metaphor
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
A system for hand-drawing diagrams including text and non-text elements on a computing device is provided, the computing device comprising a processor and at least one non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor, the at least one non-transitory computer readable medium configured to cause display of a plurality of input diagram elements in interactive digital ink on a display device associated with the computing device, associate one or more of the diagram elements with one or more other of the diagram elements in accordance with a class and type of each diagram element, and cause re-display of the diagram elements based on one or more interactions with the digital ink received and in accordance with the one or more associations.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/22 - Image acquisition using hand-held instruments
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
89.
SYSTEM AND METHOD FOR RECOGNITION OF HANDWRITTEN DIAGRAM CONNECTORS
A system for hand-drawing connections of diagrams including text and non-text elements on a computing device, the computing device comprising a processor and at least one non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor, the at least one non-transitory computer readable medium configured to cause display of a plurality of input diagram elements in interactive ink on a display device associated with the computing device, identify at least one diagram element as a connector which connects a plurality of diagram elements, determine geometrical characteristics of the at least one identified connector, and cause re-display of the diagram elements based on one or more interactions received with the interactive ink of the at least one identified connector or one or more of the plurality of diagram elements connected thereby and in accordance with the determined geometrical characteristics.
A system for guiding hand-drawing of diagrams including text and non-text elements on a computing device is disclosed, the computing device comprising a processor and at least one non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor, the at least one non-transitory computer readable medium configured to cause display of, on an interactive display of the computing device, a guide element associated with at least one diagram element of displayed handwriting diagram input, the guide element configured with a depiction of the at least one diagram element in recognized form.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of a plurality of input diagram elements in interactive ink is performed on a display device associated with the computing device. At least one diagram element is identified as a connector which connects a plurality of diagram elements. Geometrical characteristics of the at least identified connector are determined and the diagram elements are re-displayed based on one or more interactions received with the interactive ink of the at least identified connector or one or more of the plurality of diagram elements connected thereby and in accordance with the determined geometrical characteristics.
A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of input diagram elements in interactive digital ink is performed on a display device associated with the computing device. One or more of the diagram elements are associated with one or more other of the diagram elements in accordance with a class and type of each diagram element. The diagram elements are re-displayed based on one or more interactions with the digital ink received and in accordance with the one or more associations.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 17/27 - Automatic analysis, e.g. parsing, orthograph correction
G06T 11/20 - Drawing from basic elements, e.g. lines or circles
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 40/171 - Editing, e.g. inserting or deleting by use of digital ink
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
A system, method and computer program product for use in digital note taking with handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on a display interface of a computing device, digital ink in a block layout in accordance with a layout of blocks of the handwriting input and a configuration of the computing device display interface.
G06F 17/00 - Digital computing or data processing equipment or methods, specially adapted for specific functions
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06K 9/22 - Image acquisition using hand-held instruments
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F 3/0354 - Pointing devices displaced or positioned by the userAccessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
A systems, method and computer program product for use in guiding handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on an interactive display of the computer device, a guide element contiguous with at least a portion of display of digital ink corresponding to the handwriting input. The guide element is configured to guide further handwriting input.
G06F 17/00 - Digital computing or data processing equipment or methods, specially adapted for specific functions
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
G06K 9/22 - Image acquisition using hand-held instruments
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
A system, method and computer program product for use in digital note taking with handwriting input to a computing device are provided. The computing device is connected to an input device, or an input surface. A user provides input by applying pressure to or gesturing above the input surface using a finger or an instrument. The present system and method monitors the input strokes. The computing device includes a processor controlling an application for recognizing the handwriting input. The system application causes display of, on a display interface, a guide element for handwriting input and digital ink in a block layout in accordance with a layout of blocks of the handwriting input and a configuration of the computing device display interface. The guide element is displayed based on the digital ink block content and layout and typeset ink block content and layout formed from the recognized handwriting input.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
A system and method is able to recognize a user's natural superimposed handwriting without any explicit separation between characters. The system and method is able to process single-stroke and multi-stroke characters. The system and method can also process cursive handwriting. Further, the system and method can determine the boundaries of input words either by the use of a specific user input gesture or by detecting the word boundaries based on language characteristics and properties. The system and method analyzes the handwriting input through the processes of segmentation, character recognition, and language modeling. These three processes occur concurrently through the use of dynamic programming.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
G06K 9/52 - Extraction of features or characteristics of the image by deriving mathematical or geometrical properties from the whole image
G06K 9/62 - Methods or arrangements for recognition using electronic means
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/72 - Methods or arrangements for recognition using electronic means using context analysis based on the provisionally recognised identity of a number of successive patterns, e.g. a word
A system, method and computer program product for guiding handwriting input to a computing device is provided. The computing device comprises a processor and at least one system application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on an interactive display of the computer device, a guide element contiguous with at least a portion of display of digital ink corresponding to the handwriting input. The guide element is configured to guide further handwriting input.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06K 9/22 - Image acquisition using hand-held instruments
G06F 3/023 - Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
A system, method and computer program product for digital note taking on computing devices are provided. Each computing device comprises a processor and at least one non-transitory computer readable medium for recognizing handwriting note taking input under control of the processor. The at least one non-transitory computer readable medium is configured to cause display of, on a display interface of a computing device, digital ink in a block layout in accordance with a layout of blocks of the handwriting input and a configuration of the computing device display interface.
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Methods, systems, and computer program products are provided for the recognition of input of multiple objects into a computing device, wherein the computing device has a processor and at least one application for recognizing the input under control of the processor. The application is configured to determine at least one geometrical feature of a plurality of elements of the input, and compare the determined at least one geometrical feature with at least one predetermined geometrical threshold to determine a positive or negative result. If the comparison yields a negative result, the application considers the elements as belonging to one object in the recognition of the input. If the comparison yields a positive result, the application considers the elements as belonging to multiple objects in the recognition of the input.
