Skydio, Inc.

Peter Benjamin Henry

Hayk Martirosyan

Abraham Galton Bachrach

Adam Parker Bry

Ryan David Kennedy

Jack Louis Zhu

Harrison Zheng

Matthew Joseph Donahoe

Brian Richman

Quentin Allen Wah Yen Delepine

Himel Mondal

Kristen Marie Holtz

Gareth Benoit Cross

Samuel Shenghung Wang

Dominic William Pattison

Teodor Tomic

Josiah Timothy VanderMey

Vladimir Nekrasov

Bradley Matthew Solliday

Nathan Leo Bucki

Yixiao Sun

Aaron Christopher Miller

Clement Godard

Shreetej Varakantam Reddy

Anh Tung Dang

Margaret Bai Wang

Maximilian Joseph Halper Krogius

A calibration of an unmanned aerial vehicle is performed without the use of a magnetometer. The unmanned aerial vehicle generates a first acceleration vector in a navigation frame of reference and a second acceleration vector in a GPS frame of reference. The unmanned aerial vehicle estimates a heading of the unmanned aerial vehicle based on the first acceleration vector and the second acceleration vector. The unmanned aerial vehicle performs a calibration based on the estimated heading of the unmanned aerial vehicle.

Motion-based calibration of an aerial device

In some examples, a computing device receives, from an unmanned aerial vehicle (UAV), a first image from a first camera on the UAV and a plurality of second images from a plurality of second cameras on the UAV. The plurality of second cameras may be positioned on the UAV for providing a plurality of different fields of view in a plurality of different directions around the UAV. Further, the first camera has a longer focal length than the second cameras. The computing device presents, on a display, a composite image including at least a portion of the first image within a merged image generated from the plurality of second images. The presented composite image enables a user to at least one of: zoom out from the at least one first image to the merged image, or zoom in from the merged image to the at least one first image.

Unmanned aerial vehicle with virtual un-zoomed imaging

A computer of an unmanned aerial vehicle (UAV) accesses, from a memory unit, a problem definition comprising cost functions associated with travel of the UAV. The computer causes movement of the UAV based on the cost functions. The computer adjusts one or more of the cost functions during a flight of the UAV. The computer causes further movement of the UAV based on the adjusted one or more of the cost functions.

Unmanned aerial vehicle operated based on cost functions

A computer stores dense maps generated by one or more aerial vehicles. The computer generates a global graph based on the dense maps and a sparse map. The computer stores a representation of one or more paths traversed by the one or more aerial vehicles within the global graph. The computer determines a path from an origin location to a destination location based on the global graph. The determined path enables an aerial vehicle to avoid objects.

Aerial vehicle path determination

Described herein are systems for roof scan using an unmanned aerial vehicle. For example, some methods include capturing, using an unmanned aerial vehicle, an overview image of a roof of a building from above the roof; presenting a suggested bounding polygon overlaid on the overview image to a user; determining a bounding polygon based on the suggested bounding polygon and user edits; based on the bounding polygon, determining a flight path including a sequence of poses of the unmanned aerial vehicle with respective fields of view at a fixed height that collectively cover the bounding polygon; fly the unmanned aerial vehicle to a sequence of scan poses with horizontal positions matching respective poses of the flight path and vertical positions determined to maintain a consistent distance above the roof; and scanning the roof from the sequence of scan poses to generate a three-dimensional map of the roof.

Roof scan using unmanned aerial vehicle

A computer accesses an input element storage and an output element storage. The computer accesses a symbolic expression for output element storage as a function of the input element storage. The computer computes, using a symbolic computation engine of the computer, a symbolic expression for the tangent space Jacobian of the output element storage with respect to an input tangent space. The computer outputs the computed expression.

Computer-implemented symbolic differentiation using first-order retraction

Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

Structure scan using unmanned aerial vehicle

An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.

Image space motion planning of an autonomous vehicle

A computer accesses a first symbolic expression for an output matrix as a function of an input matrix at a computing device comprising processing circuitry and memory. The computer computes a first Jacobian of the input matrix with respect to an input tangent space. The computer computes a second Jacobian of the output matrix with respect to the input matrix. The computer computes a third Jacobian of an output tangent space with respect to the input matrix. The computer applies symbolic matrix multiplication to the first Jacobian, the second Jacobian, and the third Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression, the second symbolic expression representing a computed tangent-space Jacobian.

Computer-implemented computation of tangent-space jacobian

Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.

Autonomous aerial navigation in low-light and no-light conditions

Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence, training, and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.

In some examples, one or more processors of an unmanned aerial vehicle (UAV), control a propulsion mechanism of the UAV to cause the UAV to navigate to a plurality of positions in relation to a scan target. Using one or more image sensors of the UAV, a first image of the scan target is captured from a first position of the plurality of positions, and a second image of the scan target is captured from a second position of the plurality of positions. A disparity is determined between the first image captured at the first position and the second image captured at the second position. A three-dimensional model corresponding to the scan target is determined based in part on the disparity determined between the first image and the second image.

Determining a three-dimensional model of a scan target

In some examples, one or more processors of an aerial vehicle access a scan plan including a sequence of poses for the aerial vehicle to assume to capture, using the one or more image sensors, images of a scan target. A next pose of the scan plan is checked for obstructions, and based at least on detection of an obstruction, the one or more processors determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point. Responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, image capture of the targeted point is performed at an oblique angle to the normal of the targeted point.

Unmanned aerial vehicle adaptable to obstructions

In some examples, an unmanned aerial vehicle (UAV) may determine a plurality of contour paths spaced apart from each other along at least one axis associated with a scan target. For instance, each contour path may be spaced away from a surface of the scan target based on a selected distance. The UAV may determine a plurality of image capture locations for each contour path. The image capture locations may indicate locations at which an image of a surface of the scan target is to be captured. The UAV may navigate along the plurality of contour paths based on a determined speed while capturing images of the surface of the scan target based on the image capture locations.

Growing community of inventors

San Francisco, CA, United States of America

Peter Benjamin Henry