Fmr Corp.

Hangyu Wang

James Andersen

Adam Schouela

Dong Han

Yiming Li

Yibo He

Methods and systems for automated testing of virtual reality software applications using robotic devices include a server that converts a test workflow description into a sequence of actions in a format interpretable by a robotic device. The server transmits the sequence of actions to the robotic device. For each action in the sequence of actions, the server a) receives, from the robotic device, execution data corresponding to an outcome of execution of the action by the robotic device; b) captures, from a virtual reality device, one or more of image data and vector data corresponding to a current state of a virtual reality software application; c) analyzes one or more of the image data, the vector data, and the execution data to determine whether the robotic device successfully executed the action; and d) upon determining that the robotic device successfully executed the action, repeats steps a)-d) for the next action.

Automated testing of virtual reality software applications using robotic devices

Methods and apparatuses are described for generating and manipulating 3D objects in a 3D environment of an alternative reality software application. A server retrieves a data set comprising data elements, each having one or more attributes. The server generates, for each data element, a virtual object, each virtual object positioned inside a virtual container and located in proximity to a center of the virtual container. The server attaches virtual magnets to an exterior surface of the virtual container, each magnet associated with a data filter value and an attraction value. The server determines, for each virtual object, a movement distance and a movement speed in relation to each virtual magnet based upon the data filter value and the attraction value for the virtual magnet. The server moves at least a portion of the virtual objects to a new location based upon the movement distance and movement speed.

Generating and manipulating three-dimensional (3D) objects in a 3D environment of an alternative reality software application

Methods and apparatuses are described for providing a thumb scroll user interface element in a computerized visual environment. A viewing device displays a graphical user interface within a three-dimensional space that includes surface planes each associated with a graphical thumb scroll element. A sensor device captures a location of the user's hand within the three-dimensional space and a gesture of the user's hand. A computing device detects that the location is within a defined zone around one of the graphical thumb scroll elements and activates the thumb scroll element associated with the defined zone. The computing device identifies the gesture, determines a scroll speed based upon a speed of the identified gesture, and determines a scroll direction based upon a direction of the identified gesture. The computing device changes characteristics of graphical content in the surface plane based upon at least one of: the scroll speed or the scroll direction.

Growing community of inventors

Cary, NC, United States of America

Hangyu Wang