Samsung Electronics Co., Ltd.

Other

Daniel Dongyuel Lee

Ibrahim Volkan Isler

Eric Anthony Mitchell

Daewon Lee

Dae Won Lee

Lawrence David Jackel

Xiaoran Fan

Jinwook Huh

Volkan Isler

Ziyun Wang

Sebastian Seung

Richard Howard

Ben Eisner

Colin Prepscius

Selim Engin

Yuan Chen

Bhoram Lee

Anthony Robert Bisulco

Fernando Cladera Ojeda

Galen Kailun Xing

Il Memming Park

Kanaka Rajan

Daniel Robert Kepple

Riley Simmons-Edler

Hyunjune Sebastian Seung

Sergiy Popovych

Nikhil Narsingh Chavan Dafle

Pedro Piacenza

Riley William Simmons-edler

Tarik Tosun

Minghan Wei

An apparatus for collision avoidance by surface proximity detection includes a plurality of piezoelectric elements disposed adjacent to a surface of an object, a memory storing instructions, and at least one processor configured to execute the instructions to control a first one among the piezoelectric elements to generate an acoustic wave along the surface of the object, and receive, via a second one among the piezoelectric elements, an acoustic wave signal corresponding to the generated acoustic wave. The at least one processor is further configured to execute the instructions to filter the received acoustic wave signal, using a band-pass filter for reducing noise of the received acoustic wave signal, obtain a proximity signal for proximity detection, from the filtered acoustic wave signal, using a linear time-invariant filter, and detect whether an obstacle is proximate to the surface of the object by inputting the obtained proximity signal into a neural network.

Method and apparatus for robot collision avoidance by full surface proximity detection

A system and a method for generating a trajectory of a target device from a current position to a goal position within an environment is provided. The method may include: inputting physical workspace information associated with the environment in which the target device, to a first neural network to obtain a set of weights representing a cost-to-go function that defines a cost-to-go function relating to a length of a collision-free path from one position to the goal position; configuring a second neural network based on the set of weights; identifying a next position of the target device based on the current position and a motion control input of the target; and inputting the identified next position of the target device and the goal position to the second neural network to identify the trajectory to the goal position, and the motion control input corresponding to the trajectory.

Trajectory generation of a robot using a neural network

A tactile sensing system of a robot may include: a plurality of piezoelectric elements disposed at an object, and including a transmission (TX) piezoelectric element and a reception (RX) piezoelectric element; and at least one processor configured to: control the TX piezoelectric element to generate an acoustic wave having a chirp spread spectrum (CSS) at every preset time interval, along a surface of the object; receive, via the RX piezoelectric element, an acoustic wave signal corresponding to the generated acoustic wave; select frequency bands from a plurality of frequency bands of the acoustic wave signal; and estimate a location of a touch input on the surface of the object by inputting the acoustic wave signal of the selected frequency bands into a neural network configured to provide a touch prediction score for each of a plurality of predetermined locations on the surface of the object.

Method and apparatus for estimating touch locations and touch pressures

A method of estimating an amount of liquid poured from a container includes receiving a tactile signal detected by at least one tactile sensor of an end effector holding the container containing the liquid; receiving a joint signal including an angular position, angular velocity, and torque of a joint connected to the end effector; and estimating, based on the tactile signal and the joint signal, the amount of liquid poured from the container.

Method of estimating an amount of liquid poured from a container, and an apparatus for the same

A method of predicting occupancy of unseen areas in a region of interest (ROI) includes obtaining a depth image of the ROI, the depth image being captured from a first height; generating an occupancy map based on the obtained depth image, the occupancy map comprising an array of cells corresponding to locations in the ROI; and generating an inpainted map by inputting the occupancy map into a trained inpainting network, the inpainted map comprising an array of cells corresponding to the ROI, and wherein the inpainting network is trained by comparing an output of the inpainting network, based on inputting a training depth image taken from the first height, to a ground truth map, the ground truth map being based on a combination of the training depth image and a depth image taken at a height different than the first height.

Method of predicting occupancy of unseen areas for path planning, associated device, and network training method

A detection system includes a filter and a detector. The filter receives input packets from one or more dynamic vision sensors (DVSs) deployed in an area. The filter reduces the bandwidth of the input packets to produce compressed data packets while maintaining good end-to-end detection capability. The compressed data packets are transmitted to a detector in a low bandwidth transmission. The detector may collect compressed data packets from many filters. The detector determines if an object of interest is represented in the information of the input packets. If an object of interest is present, the detector activates an alarm, sends a notification to a person associated with the area and/or stores an indication in a database.

Dynamic vision filtering for event detection

A depth image is used to obtain a three dimensional (3D) geometry of an object as an object mesh. The object mesh is obtained using an object shell representation. The object shell representation is based on a series of depth images denoting the entry and exit points on the object surface that camera rays would pass through. Given a set of entry points in the form of a masked depth image of an object, an object shell (an entry image and an exit image) is generated. Since entry and exit images contain neighborhood information given by pixel adjacency, the entry and exit images provide partial meshes of the object which are stitched together in linear time using the contours of the entry and exit images. A complete object mesh is provided in the camera coordinate frame.

Object mesh based on a depth image

A method of collision localization on a robotic device includes obtaining audio signals from a plurality of acoustic sensors spaced apart along the robotic device; identifying, based on a collision being detected, a strongest audio signal; identifying a primary onset time for an acoustic sensor producing the strongest audio signal, the primary onset time being a time at which waves propagating from the collision reach the acoustic sensor producing the strongest audio signal; generating a virtual onset time set, by shifting a calibration manifold, based on the identified primary onset time, the calibration manifold representing relative onset times from evenly spaced marker locations on the robotic device to the plurality of acoustic sensors; determining scores for the marker locations based a standard deviation of elements in the virtual onset time set; and estimating a location of the collision based on a highest score of the determined scores.

Acoustic collision detection and localization for robotic devices

An apparatus for performing continuous actions includes a memory storing instructions, and a processor configured to execute the instructions to obtain a first action of an agent, based on a current state of the agent, using a cross-entropy guided policy (CGP) neural network, and control to perform the obtained first action. The CGP neural network is trained using a cross-entropy method (CEM) policy neural network for obtaining a second action of the agent based on an input state of the agent, and the CEM policy neural network is trained using a CEM and trained separately from the training of the CGP neural network.

Apparatus for Q-learning for continuous actions with cross-entropy guided policies and method thereof

A method may include obtaining a set of events, of a set of pixels of a dynamic vision sensor, associated with an object; determining a set of voltages of the set of pixels, based on the set of events; generating a set of images, based on the set of voltages of the set of pixels; inputting the set of images into a first neural network configured to output a visual motion estimation of the object; inputting the set of images into a second neural network configured to output a confidence score of the visual motion estimation output by the first neural network; obtaining the visual motion estimation of the object and the confidence score of the visual motion estimation of the object, based on inputting the set of images into the first neural network and the second neural network; and providing the visual motion estimation of the object and the confidence score.

Jointly learning visual motion and confidence from local patches in event cameras

A method for generating a trajectory of a robot from a first configuration to a second configuration within an environment while steering away from obstacles may include obtaining physical workspace information associated with the environment in which the robot is configured to operate; obtaining, using a first neural network, a set of weights of a second neural network that is configured to generate a set of values associated with a set of configurations of the robot with respect to the second configuration; obtaining, by applying the set of weights to the second neural network, the set of values associated with the set of configurations of the robot with respect to the second configuration; and generating the trajectory of the robot from the first configuration to the second configuration within the environment, based on the set of values.

A tool control system may include: a tactile sensor configured to, when a tool holds a target object and slides the target object downward across the tool, obtain tactile sensing data from the tool; one or more memories configured to store a target velocity and computer-readable instructions; and one or more processors configured execute the computer-readable instructions to: receive the tactile sensing data from the tactile sensor; estimate a velocity of the target object based on the tactile sensing data, by using one or more neural networks that are trained based on a training image of an sample object captured while the sample object is sliding down; and generate a control parameter of the tool based on the estimated velocity and the target velocity.

Method and apparatus for manipulating a tool to control in-grasp sliding of an object held by the tool

An apparatus for reconstructing a 3D object, includes a memory storing instructions, and at least one processor configured to execute the instructions to obtain, using a first neural network, mapping function weights of a mapping function of a second neural network, based on an image feature vector corresponding to a 2D image of the 3D object, set the mapping function of the second neural network, using the obtained mapping function weights, and based on sampled points of a canonical sampling domain, obtain, using the second neural network of which the mapping function is set, 3D point coordinates and geodesic lifting coordinates of each of the sampled points in the 3D object corresponding to the 2D image, wherein the 3D point coordinates are first three dimensions of an embedding vector of a respective one of the sampled points, and the geodesic lifting coordinates are remaining dimensions of the embedding vector.

Method and apparatus for three-dimensional (3D) object and surface reconstruction

An apparatus for estimating a trajectory of a tool may include: a memory storing instructions; and a processor configured to execute the instructions to: receive a task to be performed by the tool on a target object; receive a grayscale image and a depth image of the target object; and estimate a tool trajectory for performing the task, from the grayscale image and the depth image, via a pixels-to-plans neural network that is trained based on a labeled tool trajectory that is generated from a point cloud model of the target object.

Method and apparatus for estimating tool trajectories

An apparatus for representing a three-dimensional (3D) object, the apparatus includes a memory storing instructions, and a processor configured to execute the instructions to transmit a two-dimensional (2D) image to an external device, based on the 2D image being transmitted, receive, from the external device, mapping function parameters that are obtained using a first neural network, set a mapping function of a second neural network, based on the received mapping function parameters, and based on 3D samples, obtain the 3D object corresponding to the 2D image, using the second neural network of which the mapping function is set.

Growing community of inventors

Tenafly, NJ, United States of America

Daniel Dongyuel Lee