Various techniques are described herein that provide for real-time quality control during manufacturing using augmented reality. In particular, in one embodiment, techniques herein project a three-dimensional (3D) virtual shape/model onto a work-in-progress part in the real-world in order to see defects in real-time, thus allowing for mid- manufacturing corrections. The embodiments herein generally consist of first calibrating a "virtual world" to the real world, then calibrating the physical product to the virtual world, and lastly projecting information onto the physical product, such as various design information and/or quality control information.
Systems and methods herein are directed to an artificial intelligence (AI) character capable of natural verbal and visual interactions with a human. In one embodiment, an AI character system receives, in real-time, one or both of an audio user input and a visual user input of a user interacting with the AI character system. The AI character systems determines one or more avatar characteristics based on the one or both of the audio user input and the visual user input of the user. The AI character system manages interaction of an avatar with the user based on the one or more avatar characteristics.
Systems and methods herein are directed to avatar control systems. In one embodiment, interactive holographic avatar control is described. In another embodiment, remote kinetic avatar control is described. In still another embodiment, depth-based user tracking for avatar control is described. In still another embodiment, enhanced avatar kinetic movement interpolation is described. In still another embodiment, dynamic joint mapping for avatar control is described. In still another embodiment, dynamic animation population for avatar control is described.
Systems and methods herein are directed to three-dimensional image sources for an enhanced Pepper's Ghost Illusion. In one embodiment, a contoured bounce is described, allowing for contorting a bounce to different shapes, giving it enhanced three- dimensional (3D) effect. For instance, the bounce may include certain topography (raised portions), or else may actually comprise various 3D shapes (e.g., cubes, semi-spheres, etc.). In another embodiment, a multi-level image source is described, allowing for multiple image sources (e.g., projected bounces and/or panel displays) to be used and placed at different heights with respect to a transparent viewing screen, thus projecting images that appear at various depths, increasing the three-dimensional (3D) effect of the Pepper's Ghost Illusion. In addition, in one embodiment, the heights of the image sources may be adjusted (e.g., dynamically), making corresponding holographic images change their depth perspective to an audience, further enhancing the 3D effect.
Systems and methods herein are directed to foil tensioning systems for Pepper's Ghost Illusion. In one embodiment, a roller-based foil tensioning system provides for a holographic foil to be secured to a roller system on two or four sides, rolled outwards, and are then bolted in place, tightening the holographic screen material. In another embodiment, a frame-based foil tensioning system provides for the foil to be secured to a frame system on two or four sides, stretched outwards by expansion of the frame's size (e.g., by a screw jack system), and then bolted in place (while tightened). Illustratively, the foil can be secured to a tensioning system (e.g., the roller system, the expanding frame, or any frame that can be pulled apart) in a variety of manners (e.g., locking strips or snaps and a groove, loops and a rod, two rods with a foil loop, etc.).
Systems and methods herein are directed to a holographic interactive retail system. In particular, various embodiments are described where a holographic image (e.g., Pepper's Ghost Illusion) is used in a retail setting (e.g., storefront window), which, when combined with gesture control, allows people to walk up to the system and search for and buy products. For example, the customers can interact with a holographic sales clerk, and can select holographic products via gesture control. A final purchase can be made through the customer's mobile device or through a self-service kiosk, shipping the product to their house.
Systems and methods herein are directed to creating a holographic image (e.g., in line with Pepper's Ghost Illusion) with a panel display (e.g., Plasma, liquid crystal display (LCD), light-emitting diode (LED), etc.) as the light source for the holographic image. As described herein, such displays may include any size display, such as ranging from personal electronic equipment (e.g., watches, mobile phones, tablets, laptops, monitors, televisions, etc.) through to stage-sized displays for larger venues (e.g., concerts, stage shows, etc.). In addition, a diffusion layer may be provided in order to reduce or generally eliminate a "Moire effect" that occurs due to physical properties of the interaction between the panel display and transparent screen.
According to embodiments herein, depth key compositing is the process of detecting specific desired portions/objects of a digital image using mathematical functions based on depth, in order to separate those specific portions/objects for further processing. In one particular embodiment, a digital visual image is captured from a video capture device, and one or more objects are determined within the digital visual image that are within a particular depth range of the video capture device. From there, the one or more objects may be isolated from portions of the digital visual image not within the particular depth range, and the isolated objects are processed for visual display apart from the portions of the digital visual image not within the particular depth range. Also, in certain embodiments, the detected portion of the digital image (isolated objects) may be layered with another image, such as for film production, or used for holographic projection.
patents