An autonomous mobile robot receives sensor data from one or more sensors. The sensor data includes image data depicting a load coupled to a pallet and depth data indicating distance of surfaces of the load or the pallet from the one or more sensors. A first machine-learning model is applied to the image data to generate a first mask and second mask. The first mask represents the load, and the second mask represents the pallet. The first mask, the second mask, and/or the depth data are then used to determine a load orientation and load size. Based on the load orientation and load size, the robot evaluates the load's stability. If the stability is deemed safe, the robot is caused to lift the pallet.
B65G 43/02 - Control devices, e.g. for safety, warning or fault-correcting detecting dangerous physical condition of load- carriers, e.g. for interrupting the drive in the event of overheating
A system and method are described that provide for queueing robot operations in a warehouse environment based on workflow optimization instructions. In one example of the system/method of the present invention, a control system causes certain robots to queue proximate to one another to permit resources to be obtained, transported, deposited, etc. without the robots crashing into one another (or into other objects), or forming traffic jams. A robot may remain at an assigned queue position at least until another position assigned to the robot becomes available.
A system and method are described that provide for mapping features of a warehouse environment having improved workflow. In one example of the system/method of the present invention, a mapping robot is navigated through a warehouse environment, and sensors of the mapping robot collect geospatial data as part of a mapping mode. A Frontend N block of a map framework may be responsible for reading and processing the geospatial data from the sensors of the mapping robot, as well as various other functions. The data may be stored in a keyframe object at a keyframe database. A Backend block of the map framework may be useful for detecting loop constraints, building submaps, optimizing a pose graph using keyframe data from one or more trajectory blocks, and/or various other functions.
In a method for subpixel disparity calculation, image data for various images each representing a field of view of an input device is received by a processor, and the image data is applied to a machine learning model. The machine learning module uses the image data to compute an output representing calculated subpixel disparity between the various images. In an example of the method, the machine learning model is a neural network that produces accurate and reliable subpixel disparity estimation in real-time using synthetically generated data.
To load and unload a trailer, an autonomous mobile robot determines its location and the location of objects within the trailer relative to the trailer itself, rather than relative to a warehouse. The autonomous mobile robot determines its location the location of objects within the trailer relative to the trailer. The autonomous mobile robot navigates within the trailer and manipulates objects within the trailer from the trailer's reference frame. Additionally, the autonomous mobile robot uses a centerline heuristic to compute a path for itself within the trailer. A centerline heuristic evaluates nodes within the trailer based on how far away those nodes are from the centerline. If the nodes are further away from the centerline, they are assigned a higher cost. Thus, when the autonomous mobile robot computes a path, the path is more likely to stay near the centerline of the trailer rather than get closer to the sides.
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
6.
PATHFINDING USING CENTERLINE HEURISTICS FOR AN AUTONOMOUS MOBILE ROBOT
To load and unload a trailer, an autonomous mobile robot determines its location and the location of objects within the trailer relative to the trailer itself, rather than relative to a warehouse. The autonomous mobile robot determines its location the location of objects within the trailer relative to the trailer. The autonomous mobile robot navigates within the trailer and manipulates objects within the trailer from the trailer's reference frame. Additionally, the autonomous mobile robot uses a centerline heuristic to compute a path for itself within the trailer. A centerline heuristic evaluates nodes within the trailer based on how far away those nodes are from the centerline. If the nodes are further away from the centerline, they are assigned a higher cost. Thus, when the autonomous mobile robot computes a path, the path is more likely to stay near the centerline of the trailer rather than get closer to the sides.
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
An autonomous mobile robot uses a capability-aware pathfinding algorithm to traverse from a start pose to an end pose efficiently and effectively. The robot receives a start pose and an end pose, and determines a primary path from the start pose to the end pose based on a primary pathfinding algorithm. The robot may smooth the primary path using Bezier curves. The robot may identify a conflict point on the primary path where the robot cannot traverse, and may determine a secondary path from a first point before the conflict point to a second point after the conflict point. The secondary path may use a secondary pathfinding algorithm that uses motion primitives of the robot to generate the secondary path based on the motion capabilities of the robot. The robot may then traverse from the start pose to the end pose based on the primary path and the secondary path.
An autonomous mobile robot may use an improved steering system. The improved steering system may include a steering motor that is operably coupled to a motor shaft. The motor shaft may be aligned at an offset position relative to a center axis of the autonomous mobile robot. The motor shaft may be operably coupled to a front and rear steering linkage. Each steering linkage may include a pitman arm that is coupled to the motor shaft and a drag link. The drag link may be coupled to a first steering arm and a tie rod. The tie rod may also be coupled to a second steering arm. The first steering arm may be coupled to a first wheel and the second steering arm may be coupled to a second wheel.
B60K 17/35 - Arrangement or mounting of transmissions in vehicles for driving both front and rear wheels, e.g. four wheel drive vehicles having differential means for driving one set of wheels, e.g. the front, at one speed and the other set, e.g. the rear, at a different speeds including arrangements for suppressing or influencing the power transfer, e.g. viscous clutches
B62D 5/04 - Power-assisted or power-driven steering electrical, e.g. using an electric servo-motor connected to, or forming part of, the steering gear
A system and a method are disclosed that identifies a source area within a facility comprising a plurality of objects, and determines a destination area within the facility to which the plurality of objects are to be transported and unloaded. The system selects robots within the facility based a capability of the robots and/or a location of the robots within the facility. The system provides an instruction to the robots to transport the plurality of objects from the source area to the destination area. The robots are configured to autonomously select an object based on a position and location of the object within the source area, transport the selected object to a destination area along a route selected by the robot, and unload the selected object at a location within the destination area selected based on a number of objects yet to be unloaded within the destination area.
A system and a method are disclosed that identifies a source area within a facility comprising a plurality of objects, and determines a destination area within the facility to which the plurality of objects are to be transported and unloaded. The system selects robots within the facility based a capability of the robots and/or a location of the robots within the facility. The system provides an instruction to the robots to transport the plurality of objects from the source area to the destination area. The robots are configured to autonomously select an object based on a position and location of the object within the source area, transport the selected object to a destination area along a route selected by the robot, and unload the selected object at a location within the destination area selected based on a number of objects yet to be unloaded within the destination area.
B65G 1/06 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level
B65G 1/137 - Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
G05B 19/418 - Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control (DNC), flexible manufacturing systems (FMS), integrated manufacturing systems (IMS), computer integrated manufacturing (CIM)
G05D 1/00 - Control of position, course, altitude, or attitude of land, water, air, or space vehicles, e.g. automatic pilot
G05D 1/02 - Control of position or course in two dimensions
A system and a method are disclosed where an autonomous robot captures an image of an object to be transported from a source to a destination. The robot generates a bounding box within the image surrounding the object. The robot applies a machine-learned model to the image with the bounding box, the machine-learned model configured to identify an object type of the object, and to identify features of the object based on the identified object type and the image. The robot determines which of the identified features of the object are visible to the autonomous robot, and determines a three-dimensional pose of the object based on the features determined to be visible to the autonomous robot.
B65G 1/06 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
G05D 1/02 - Control of position or course in two dimensions
G05D 1/00 - Control of position, course, altitude, or attitude of land, water, air, or space vehicles, e.g. automatic pilot
B65G 1/137 - Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
A system and a method are disclosed that generate for display to a remote operator a user interface comprising a map, the map comprising visual representations of a source area, a plurality of candidate robots, and a plurality of candidate destination areas. The system receives, via the user interface, a selection of a visual representation of a candidate robot of the plurality of candidate robots, and detects a drag-and-drop gesture within the user interface of the visual representation of the candidate robot being dragged-and-dropped to a visual representation of a candidate destination area of the plurality of candidate destination areas. Responsive to detecting the drag-and-drop gesture, the system generates a mission, where the mission causes the candidate robot to autonomously transport an object from the source area to the candidate destination area.
B65G 1/06 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
G05D 1/02 - Control of position or course in two dimensions
G05D 1/00 - Control of position, course, altitude, or attitude of land, water, air, or space vehicles, e.g. automatic pilot
B65G 1/137 - Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
G06F 18/21 - Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
G05B 19/418 - Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control (DNC), flexible manufacturing systems (FMS), integrated manufacturing systems (IMS), computer integrated manufacturing (CIM)
G06F 3/04847 - Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
13.
Safety mode toggling by autonomous robots in a facility context
A system and a method are disclosed that cause a robot to traverse along a route based on a minimum distance to be maintained between the autonomous mobile robot and an obstacle corresponding to a first mode. The robot determines that the route cannot be continued without a distance between the robot and a detected obstacle becoming less than the minimum distance, and responsively determines whether the route can be continued without the distance between the robot and the detected obstacle becoming less than a second minimum distance less than the initial minimum distance, the second minimum distance corresponding to a second mode. Responsive to determining that the route can be continued without the distance between the autonomous mobile robot and the detected obstacle becoming less than the second minimum distance, the robot is configured to operate in second mode and continues traversal of the route.
B65G 1/137 - Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
B65G 1/06 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
G05D 1/02 - Control of position or course in two dimensions
G05D 1/00 - Control of position, course, altitude, or attitude of land, water, air, or space vehicles, e.g. automatic pilot
G06F 18/21 - Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
G05B 19/418 - Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control (DNC), flexible manufacturing systems (FMS), integrated manufacturing systems (IMS), computer integrated manufacturing (CIM)
G06F 3/04847 - Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
14.
Dynamic traversal protocol selection by autonomous robots in a facility context
A system and a method are disclosed where a robot operating using a first traversal protocol traverses autonomously along a first route that is defined by markers that are detectable by the robot, wherein the robot is configured to move only based on a presence and type of each marker when the robot is configured to operate based on the first traversal protocol. The robot detects, while traversing along the route, a triggering condition corresponding to a change in operation by the robot from the first traversal protocol to a second traversal protocol. Responsive to detecting the triggering condition, the robot is configured to operate in the second traversal protocol, wherein the robot, when configured to operate based on the second traversal protocol, determines a second route autonomously without regard to a presence of any of the markers.
B65G 1/06 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level
B65G 1/137 - Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
B66F 9/06 - Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
G05B 19/418 - Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control (DNC), flexible manufacturing systems (FMS), integrated manufacturing systems (IMS), computer integrated manufacturing (CIM)
G05D 1/00 - Control of position, course, altitude, or attitude of land, water, air, or space vehicles, e.g. automatic pilot
G05D 1/226 - Communication links with the remote-control arrangements
G05D 1/227 - Handing over between remote control and on-board control; Handing over between remote control arrangements
G05D 1/247 - using signals provided by artificial sources external to the vehicle, e.g. navigation beacons
G05D 1/617 - Safety or protection, e.g. defining protection zones around obstacles or avoiding hazards (arrangements for controlling the position or course of two or more vehicles for avoiding collisions therebetween G05D 1/693;arrangements for reacting to or preventing system or operator failure G05D 1/80)
G05D 1/646 - Following a predefined trajectory, e.g. a line marked on the floor or a flight path
G05D 1/69 - Coordinated control of the position or course of two or more vehicles
patents
