X Development LLC

Google Inc.

Tidalx Ai Inc.

Adobe, Inc.

Scansoft, Inc.

Tidaix Ai Inc.

Barnaby John James

Bo Wang

Sunil Vemuri

Matthew Messana

Peter Kimball

Ulas Kirazci

David Roy Schairer

Laura Valentine Chrobak

Pravir Kumar Gupta

Neil Davé

Grace Taixi Brentano

Zhaoying Yao

Petar Aleksic

Ertan Dogrultan

Bala Venkata Sai Ravi Krishna Kolluri

Valerie Nygaard

Christopher Thornton

Steve Chen

Joel Fraser Atwater

Tatiana Kichkaylo

Evan Douglas Rapoport

Kyle James Cormany

Scott B Huffman

Randy L Swineford

Shane Washburn

Grace Calvert Young

Nitin Mangesh Shetti

Ferdinand Legros

Karen Vertierra

Yuzhao Ni

Jacques L Gagne

Matthew David Day

Julia Black Ling

Lei Zhong

Patrick Richard Wibbeler

Nicole Kobilansky

Vikram Aggarwal

Robert Stets

Vincent Yanton Mo

Scott E Petersen

Mark Spates, Iv

Jun Yang

Bogdan Caprita

Su Chen

Andrew Rossignol

Stephen Duane Dorow

Saisuresh Krishnakumaran

Nupur Garg

Ryan Heacock

Amy Lynn Baldwin

Kimberly Paterson

Ryan Patrick Sims

Neil DavÉ

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for sorting fish in aquaculture. In some implementations, one or more images are obtained of a particular fish within a population of fish. Based on the one or more images of the fish, a data element is determined. The data element can include a first value that reflects a physical characteristic of the particular fish, and a second value that reflects a condition factor of the particular fish. Based on the data element, the fish is classified as a member of a particular subpopulation of the population of fish. An actuator of an automated fish sorter is controlled based on classifying the particular fish as a member of the particular subpopulation of the population of fish.

Analysis and sorting in aquaculture

Methods, systems, and apparatus, including computer programs encoded on computer storage media for identification and re-identification of fish. In some implementations, first media representative of aquatic cargo is received. Second media based on the first media is generated, wherein a resolution of the second media is higher than a resolution of the first media. A cropped representation of the second media is generated. The cropped representation is provided to the machine learning model. In response to providing the cropped representation to the machine learning model, an embedding representing the cropped representation is generated using the machine learning model. The embedding is mapped to a high dimensional space. Data identifying the aquatic cargo is provided to a database, wherein the data identifying the aquatic cargo comprises an identifier of the aquatic cargo, the embedding, and a mapped region of the high dimensional space.

Entity identification using machine learning

A method for controlling a sensor subsystem, the method including receiving one or more metrics representing one or more characteristics of livestock, including one or more livestock objects, contained in an enclosure and monitored by one or more sensors coupled to a winch subsystem. The method further includes determining a position to move the one or more sensors based on the metrics and determining an instruction that includes information related to a movement of the one or more sensors. The method further includes sending the instruction to the winch subsystem to change the position of the one or more sensors.

Camera winch control for dynamic monitoring

A sensor positioning system, includes an actuation server for communicating with components of the sensor positioning system. The sensor positioning system additionally includes a first actuation system and a second actuation system, wherein each actuation system includes a pulley system for maneuvering an underwater sensor system. The sensor positioning system includes a dual point attachment bracket that connects through a first line to the first actuation system and connecting through a second line to the second actuation system. The underwater sensor system is affixed to the first pulley system, the second pulley system, and the dual attachment bracket through the first line and the second line.

Sensor positioning system

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that generate from a first pair and a second pair of images of livestock that are within an enclosure and that are taken at different times using a stereoscopic camera, at least two distance distributions of the aquatic livestock within the enclosure. The distance distributions can be used to determine a measure associated with an optical property of the water within the enclosure. A signal associated with the measure can be provided.

Turbidity determination using computer vision

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for visually detecting a halocline. In some implementations, a method includes moving a camera through different depths of water within a fish enclosure, capturing, at the different depths, images of fish, determining that changes in focus in the images correspond to changes in depth that the images were captured, and based on determining that the changes in focus in the images correspond to the changes in depths that the images were captured, detecting a halocline at a particular depth.

Visual detection of haloclines

Methods, systems, and apparatuses, including computer programs encoded on a computer-readable storage medium for estimating the shape, size, mass, and health of fish are described. A pair of stereo cameras may be utilized to obtain off-axis images of fish in a defined area. The images may be processed, enhanced, and combined. Object detection may be used to detect and track a fish in images. A pose estimator may be used to determine key points and features of the detected fish. Based on the key points, a model of the fish is generated that provides an estimate of the size and shape of the fish. A regression model or neural network model can be applied to the fish model to determine characteristics of the fish.

Fish biomass, shape, size, or health determination

A fish monitoring system deployed in a particular area to obtain fish images is described. Neural networks and machine-learning techniques may be implemented to periodically train fish monitoring systems and generate monitoring modes to capture high quality images of fish based on the conditions in the determined area. The camera systems may be configured according to the settings, e.g., positions, viewing angles, specified by the monitoring modes when conditions matching the monitoring modes are detected. Each monitoring mode may be associated with one or more fish activities, such as sleeping, eating, swimming alone, and one or more parameters, such as time, location, and fish type.

Fish measurement station keeping

Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

Voice to text conversion based on third-party agent content

Methods, systems, and apparatus, including computer programs encoded on computer-readable storage media, for automated camera positioning for feeding behavior monitoring. In some implementations, a system obtains an image of a scene, a spatial model that corresponds to a subfeeder, and calibration parameters of a camera, the system determines a size of the subfeeder in the image of the scene, the system selects an updated position of the camera relative to the subfeeder, the system provides the updated position of the camera relative to the subfeeder to a winch controller, and the system moves the camera to the updated position.

Automated camera positioning for feeding behavior monitoring

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for fish weight estimation based on fish tracks identified in images. In some implementations, a method includes obtaining images of fish enclosed in a fish enclosure, identifying fish tracks shown in the images of the fish, determining a quality score for each of the fish tracks, selecting a subset of the fish tracks based on the quality scores, determining a representative weight of the fish in the fish enclosure based on weights of the fish shown in the subset of the fish tracks, and outputting the representative weight for display or storage at a device connected to the one or more processors.

Image processing-based weight estimation for aquaculture

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that control devices in an aquaculture environment. One of the methods includes determining a particular objective for a robot that is operating in an aquaculture environment and determining one or more sensed conditions that are associated with the aquaculture environment. The particular objective is provided to an anti-fish-startling model evaluation engine that is configured to output actions, for a given objective, that accomplish the given objective while reducing a startling effect on nearby fish. Based on providing the particular objective to the anti-fish-startling model evaluation engine, one or more particular actions for accomplishing the particular objective are determined. The one or more particular actions are transmitted to another device.

Framework for controlling devices

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium that automatically performs actions in an aquaculture environment based on light sensed by underwater cameras. One of the methods includes obtaining images of a surface of water captured by a camera that faces upwards from a depth towards the surface of the water within an enclosure that encloses aquatic livestock. An ambient light metric is determined at the depth from the images of the surface of the water. A determination is made as to whether the camera satisfies one or more depth criteria. Based on determining that the depth of the camera satisfies the one or more depth criteria, it is determined that, based on the ambient light metric at the depth, one or more action criteria are satisfied, then initiating performance of an action to be performed for the aquatic livestock.

Underwater camera as light sensor

Growing community of inventors

Los Gatos, CA, United States of America

Barnaby John James