Ubtech Robotics Corp Ltd

Ubkang (qingdao) Technology Co., Ltd.

Ubtech North America Research and Development Center Corp

Futronics (na) Corporation

Dan Shao

Huan Tan

Dejun Guo

Zhen Xiu

Chuqiao Dong

Yang Shen

Kang-Hao Peng

Jiexin Cai

Fei Long

Aravind Sreejith

Matthew Keith Xi-Jie Pan

Human lying posture detections are disclosed. A human lying on a bed is detected by obtaining an image through a depth camera, detecting objects in the image and marking the objects in the image using 2D bounding boxes by deep learning, determining the human being in a lying posture in response to a width and a height of the 2D bounding box of the human meeting a predetermined condition, detecting one or more skin areas in the image and generating skin area 2D bounding boxes to mark each of the one or more skin areas using a skin detection algorithm, and determining the human being in the lying posture in response to the skin area 2D bounding boxes and the 2D bounding box of the bed meeting a predetermined positional relationship.

Human lying posture detection method and mobile machine using the same

Navigation of a mobility aid robot having a camera and gripping part(s) disposed toward different directions is disclosed. The mobility aid robot is navigated to approach a user by identifying a posture of the user through the camera, determining a mode of the robot according to a type of the specified task to be performed on the user and the identified posture of the user, controlling the robot to move according to a planned trajectory corresponding to the determined mode of the robot, and turning the robot upon reaching the desired pose such that the gripping part faces the user, in response to the determined mode of the robot corresponding to the specified task of an assisting type and the user at one of a standing posture and a sitting posture.

Mobility aid robot navigating method and mobility aid robot using the same

A vision-guided picking and placing method for a mobile robot that has a manipulator having a hand and a camera, includes: receiving a command instruction that instructs the mobile robot to grasp a target item among at least one object; controlling the mobile robot to move to a determined location, controlling the manipulator to reach for the at least one object, and capturing one or more images of the at least one object using the camera; extracting visual feature data from the one or more images, matching the extracted visual feature data to preset feature data of the target item to identify the target item, and determining a grasping position and a grasping vector of the target item; and controlling the manipulator and the hand to grasp the target item according to the grasping position and the grasping vector, and placing the target item to a target position.

Vision-guided picking and placing method, mobile robot and computer-readable storage medium

Carpet detection using an RGB-D camera and mobile machine movement control based thereon are disclosed. Carpets and carpet curls are detected by obtaining a RGB-D image pair including an RGB image and a depth image through an RGB-D camera, detecting carpet and carpet-curl areas in the RGB image and generating a 2D bounding box to mark each area using a deep learning model, and generating groups of carpet and carpet-curt points corresponding to each of the carpet and carpet-curl areas by matching each pixel of the RGB image within each 2D bounding box corresponding to the carpet and carpet curl areas to each pixel in the depth image.

Carpet detection method, movement control method, and mobile machine using the same

Response methods to human abnormal behaviors for a mobility aid robot having a user-facing camera are disclosed. The mobility aid robot responds to human abnormal behaviors by detecting a face of a human during the robot aiding the human to move through the camera, comparing an initial size of the face and an immediate size of the face in response to the face of the human having detected during the robot aiding the human to move, determining the human as in abnormal behavior(s) in response to the immediate size of the face being smaller than the initial size of the face, and performing response(s) corresponding to the abnormal behavior(s) in response to the human being in the abnormal behavior(s), where the response(s) include slowing down the robot.

Human abnormal behavior response method and mobility aid robot using the same

A human-object scene recognition method includes: acquiring an input RGB image and a depth image corresponding to the RGB image; detecting objects and humans in the RGB image using a segmentation classification algorithm based on a sample database; in response to detection of objects and/or humans, performing a segment detection to each of the detected objects and/or humans based on the ROB image and the depth image, and acquiring a result of the segment detection; calculating 3D hounding boxes for each of the detected objects and/or humans according to the result of the segment detection, and determining a position of each of the detected objects and/or humans according to the 3D bounding boxes.

Human-object scene recognition method, device and computer-readable storage medium

Human posture determination is disclosed. Human posture is determined by obtaining range image(s) through a range camera, detecting key points of an estimated skeleton of a human in color data of the range image(s) and calculating positions of the detected key points based on depth data of the range image(s), choosing a feature map from a set of predefined feature maps based on the detected key points among a set of predefined key points, obtaining two features of a body of the human corresponding to the chosen feature map based on the positions of the detected key points, and determining a posture of the human according to the two features in the chosen feature map.

Human posture determination method and mobile machine using the same

Collision avoidance for a mobile machine having a plurality of sensors is disclosed. The mobile machine is avoided from colliding with a collision object by fusing sensor data received from the plurality of sensors to obtain a plurality of data points corresponding to the collision object, calculating a closed-form solution of a distance between the mobile machine and each of the plurality of data points, calculating a maximum allowed velocity of the mobile machine based on the shortest distance between the mobile machine and the plurality of data points and a current velocity of the mobile machine, and controlling the mobile machine to move according to the maximum allowed velocity.

Collision avoidance method and mobile machine using the same

On-floor obstacle detection using an RGB-D camera is disclosed. An obstacle on a floor is detected by receiving an image including depth channel data and RGB channel data through the RGB-D camera, estimating a ground plane corresponding to the floor based on the depth channel data, obtaining a foreground of the image corresponding to the ground plane based on the depth channel data, performing a distribution modeling on the foreground of the image based on the RGB channel data to obtain a 2D location of the obstacle, and transforming the 2D location of the obstacle into a 3D location of the obstacle based on the depth channel data.

On-floor obstacle detection method and mobile machine using the same

A mobile robot control method includes: acquiring a first image that is captured by a camera on a robot when the robot is in a desired pose; acquiring a second image that is captured by the camera on the robot when the robot is in a current pose; extracting multiple pairs of matching feature points from the first image and the second image, and projecting the extracted feature points onto a virtual unitary sphere to obtain multiple projection feature points, wherein a center of the virtual unitary sphere is coincident with an optical center of coordinates of the camera; acquiring an invariant image feature and a rotation vector feature based on the multiple projection feature points, and controlling the robot to move until the robot is in the desired pose according to the invariant image feature and the rotation vector feature.

Growing community of inventors

San Gabriel, CA, United States of America

Dan Shao