Nex Team Inc.

Wang Fai Ng

Keng Fai Lee

Wing Hung Chan

Qi Zhang

On Loy Sung

Ian C Smith

Long Mak

Bradford Lewis Farkas

Tin Yin Lam

Kin Ming Law

Alexander Wu

David Richard Schmierer

Ka Ho Lau

Wang Chiu Chan

Methods and systems for touchless control of a device include receiving at least one image; determining a first map, the first map including a function that generates a correspondence between data associated with the image to a feature space; determining a second map including a representation of a user in the image based on the first map; determining a third map comprising a field associated with the data in the image; determining a characteristic of the user based on one or more of the second map and the third map; and tracking the characteristic of the user to generate a historical data of the characteristic for performing the touchless control of the device.

Methods and systems for touchless control with a mobile device

Methods and systems for remote multiplayer gameplay are disclosed. An example method can include joining a multiplayer interactive physical game including first and second players competing in an activity; capturing a first game video of a first player in a first play of the multiplayer interactive physical game, using a first camera on a first mobile computing device in a first gaming area; determining a first object flow associated with the first player from the first game video, by performing an algorithm on one or more frames of the first game video to detect one or more key points of the first player; generating a first analytic based on the first object flow; receiving a second analytic associated with the second player in a second gaming area; and generating a feedback to the first player based on the first analytic or the second analytic.

Remote multiplayer interactive physical gaming with mobile computing devices

Systems and methods for motion tracking on a hardware device without a camera and/or without a sufficiently powerful hardware processor, by offloading pose processing fully or partially to a mobile device, are disclosed. Methods executable on the hardware device include receiving pose data associated with a user from the mobile device, and performing a touchless control of an application on the hardware device, based on the received pose data. Methods executable on the mobile device include capturing at least one image associated with a user, performing a pose recognition algorithm on the mobile device, based on the captured image, to generate pose data for performing a touchless control of an application on the hardware device, and transmitting the pose data to the hardware device, using the network connection. The methods and systems include embodiments where the pose recognition algorithm uses machine learning.

Methods and systems for offloading pose processing to a mobile device for motion tracking on a hardware device without a camera

Methods and systems for touchless control of a device include receiving an image from a camera and applying a machine learning technique the image to determine a first map, the first map including a function that generates a correspondence between data associated with the image to a feature space. A second map including a representation of a user in the image can be determined based on the first map. Further, a pose of the user can be determined based on the second map. The pose of the user and a portion of a body of the user can be tracked to determine a mapping between the portion of the user's body and an input feature of a device. The input feature can be modified based on the mapping to enable a touchless interaction between the user and the device.

Methods and systems for real-time generation of ball shot analytics are disclosed. The methods and systems perform steps for ball and posture detection, ball and posture flow generation, shot event identification and classification, and shot analytics generation based on identified shot events and shooter posture flow. Embodiments of the present invention use computer vision techniques to enable a resource-limited mobile device such as a smartphone to conduct the aforementioned steps. Also disclosed are benefits of the new methods, and alternative embodiments of implementation.

Methods and systems for generating sports analytics with a mobile device

Methods and systems for remote real-time or asynchronous multiplayer gameplay using mobile devices are disclosed. The methods and systems include steps of mounting mobile computing devices in gaming areas associated with users; initiating a game between the users; analyzing movements of the users, ball(s), and/or other game equipment of the game by performing a computer vision algorithm on one or more frames of an input video of the game; and providing feedback to the users, where feedback may include instructions to be performed by the users and player analytics. Embodiments of the present invention use computer vision techniques to enable a resource-limited mobile device such as a smartphone to conduct the aforementioned steps.

Methods and systems for mobile device-based touchless control can include receiving an image of a user and applying a convolutional neural network to the image to determine a feature map. Further, a key-points map and an affinity-field map can be determined based on the feature map, and the pose of the user can be determined based on the maps. The methods and system further include identifying an activation gesture of the user and determining a validity of a bounding box associated with the pose of the user, and tracking the pose of the user and a portion of a body of the user for performing the touchless control. Further, the methods and systems include determining a mapping between the portion of the user's body and a cursor position associated with an application, and moving the cursor position to enable touchless user interaction. Embodiments use computer vision techniques to enable a resource-limited mobile device to conduct the aforementioned steps.

Growing community of inventors

Hong Kong, China

Wang Fai Ng