The present patent application describes techniques for generating an enhanced electronic document that may include one or more graphical user interface (GUI) elements that comprise an interactive workflow. An electronic document is automatically processed to identify patterns within the content of the document that indicate individual content items, such as individual steps or instructions associated with a task described in the document, or individual input fields at which information is to be recorded. For each individual content item identified, a data object (e.g., a JSON object) is added to a file, which is ultimately embedded within the original document to create an enhanced electronic document. When the enhanced electronic document is presented via an appropriate document viewing application of a hands-free computing device, the content of the document is presented in combination with the interactive GUI elements so the end-user can interact with the content and GUI elements via audible (spoken) commands.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06V 30/414 - Extracting the geometrical structure, e.g. layout treeBlock segmentation, e.g. bounding boxes for graphics or text
The present patent application describes techniques for generating an enhanced electronic document that may include one or more graphical user interface (GUI) elements that comprise an interactive workflow. An electronic document is automatically processed to identify patterns within the content of the document that indicate individual content items, such as individual steps or instructions associated with a task described in the document, or individual input fields at which information is to be recorded. For each individual content item identified, a data object (e.g., a JSON object) is added to a file, which is ultimately embedded within the original document to create an enhanced electronic document. When the enhanced electronic document is presented via an appropriate document viewing application of a hands-free computing device, the content of the document is presented in combination with the interactive GUI elements so the end-user can interact with the content and GUI elements via audible (spoken) commands.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
The present application describes a technique for enhancing an electronic version of a maintenance manual or procedure with an interactive workflow, and presenting the enhanced electronic document using mobile computing devices that can be operated easily hands-free. The workflow primarily consists of a set of interactive checklist items that a maintenance specialist can mark complete via a spoken command. The enhanced electronic documents are additionally associated with supplemental multimedia content, presented contextually based on the currently selected and active checklist item. Furthermore, the document viewing application provides for integrated reporting functionality, enabling a maintenance specialist to capture relevant information during the maintenance procedure, for subsequent use in generating and submitting a report either electronically or via hard copy. The mobile computing devices on which the electronic documents are presented additionally provide on-site maintenance specialists with the ability to establish telepresence sessions and otherwise communicate with remote maintenance specialists.
G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
The present patent application describes techniques for generating an enhanced electronic document that may include one or more graphical user interface (GUI) elements that comprise an interactive workflow. An electronic document is automatically processed to identify patterns within the content of the document that indicate individual content items, such as individual steps or instructions associated with a task described in the document, or individual input fields at which information is to be recorded. For each individual content item identified, a data object (e.g., a JSON object) is added to a file, which is ultimately embedded within the original document to create an enhanced electronic document. When the enhanced electronic document is presented via an appropriate document viewing application of a hands-free computing device, the content of the document is presented in combination with the interactive GUI elements so the end-user can interact with the content and GUI elements via audible (spoken) commands.
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06V 30/414 - Extracting the geometrical structure, e.g. layout treeBlock segmentation, e.g. bounding boxes for graphics or text
The present application describes a technique for enhancing an electronic version of a maintenance manual or procedure with an interactive workflow, and presenting the enhanced electronic document using mobile computing devices that can be operated easily hands-free. The workflow primarily consists of a set of interactive checklist items that a maintenance specialist can mark complete via a spoken command. The enhanced electronic documents are additionally associated with supplemental multimedia content, presented contextually based on the currently selected and active checklist item. Furthermore, the document viewing application provides for integrated reporting functionality, enabling a maintenance specialist to capture relevant information during the maintenance procedure, for subsequent use in generating and submitting a report either electronically or via hard copy. The mobile computing devices on which the electronic documents are presented additionally provide on-site maintenance specialists with the ability to establish telepresence sessions and otherwise communicate with remote maintenance specialists.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0488 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F 21/36 - User authentication by graphic or iconic representation
G06F 1/16 - Constructional details or arrangements
patents