Microsoft Technology Licensing, LLC

Emergent Machines, Inc.

Grigor Shirakyan

Michael David Revow

Mihai R Jalobeanu

Bryan Joseph Thibodeau

Giovanni Lorenzo Thione

Franco Salvetti

David D Ahn

Karthik Lakshminarayanan

Michael Paul Bieniosek

Toby Takeo Sterrett

Ian Collins

Hamed Esfahani

R C Vikram Kakumani

Terrence Lui

Michael Revow

Mihai Jalobeanu

A system and method for dynamically modifying a live image of a subject using an automated interactive system is provided. The system includes a motorized platform including at least one actuator, a control unit including a processor and a storage device, and a payload including one or more sensors and a camera. The method includes (i) collecting sensor data about at least one of the subject and an environment, (ii) moving the camera along or around at least one degree of freedom, (iii) capturing the live image of the subject in at least one position from with the camera, (iv) storing the live image of the subject in the data storage device, (v) sending instructions to physically move the payload, (vi) applying at least one environment modification rule to modify the live image of the subject, and (vii) displaying a modified live image of the subject on a display unit.

Automated interactive system and method for dynamically modifying a live image of a subject

Various technologies described herein pertain to correction of an input depth image captured by a depth sensor. The input depth image can include pixels, and the pixels can have respective depth values in the input depth image. Moreover, per-pixel correction values for the pixels can be determined utilizing depth calibration data for a non-linear error model calibrated for the depth sensor. The per-pixel correction values can be determined based on portions of the depth calibration data respectively corresponding to the pixels and the depth values. The per-pixel correction values can be applied to the depth values to generate a corrected depth image. Further, the corrected depth image can be output.

Depth sensor calibration and per-pixel correction

Various technologies described herein pertain to automatic in-situ calibration and registration of a depth sensor and a robotic arm, where the depth sensor and the robotic arm operate in a workspace. The robotic arm can include an end effector. A non-parametric technique for registration between the depth sensor and the robotic arm can be implemented. The registration technique can utilize a sparse sampling of the workspace (e.g., collected during calibration or recalibration). A point cloud can be formed over calibration points and interpolation can be performed within the point cloud to map coordinates in a sensor coordinate frame to coordinates in an arm coordinate frame. Such technique can automatically incorporate intrinsic sensor parameters into transformations between the depth sensor and the robotic arm. Accordingly, an explicit model of intrinsics or biases of the depth sensor need not be utilized.

Automatic in-situ registration and calibration of robotic arm/sensor/workspace system

Data about a physical object in a real-world environment is automatically collected and labeled. A mechanical device is used to maneuver the object into different poses within a three-dimensional workspace in the real-world environment. While the object is in each different pose an image of the object is input from one or more sensors and data specifying the pose is input from the mechanical device. The image of the object input from each of the sensors for each different pose is labeled with the data specifying the pose and with information identifying the object. A database for the object that includes these labeled images can be generated. The labeled images can also be used to train a detector and classifier to detect and recognize the object when it is in an environment that is similar to the real-world environment.

Automated collection and labeling of object data

Computer-readable media and a computing device are described for providing geotemporal search and a search interface therefor. A search interface having a location portion and a timeline portion is provided. A geographic area is selected in the location portion by adjusting the visible area of a map. A temporal window is selected in the timeline portion by adjusting sliders along a timeline to a desired start and end time. The start and end times can be in the past, present, or future. A geotemporal search is executed based on the selected geographic area and temporal window to identify search results having associated metadata indicating a relationship to the selected geographic area and temporal window. One or more search terms are optionally provided to further refine the geotemporal search.

Geotemporal search

Conflicts among programs are detected, and advice is given based on the detected conflicts. A set of conflict rules defines what constitutes a conflict, and a set of advice rules defines what advice is to be given in response to a conflict that has been detected. The conflict rules may be provided by a different party from the action rules, so the decision as to what constitutes a conflict can be made separately from the decision as to what advice should be given when a conflict is detected.

Analysis of software conflicts

Growing community of inventors

Kirkland, WA, United States of America

Grigor Shirakyan