Splunk Inc.

Cisco Technology, Inc.

Intuit, Inc.

Sammy Lee

Devin Bhushan

Jesse Chor

Glen Wong

Seunghee Han

Jamie Kuppel

Jim Jiaming Zhu

Stanislav Yazhenskikh

Derek Sykes

Caelin Thomas Jackson-King

Eugene Krivopaltsev

Sreeneel K Maddika

Grace Pariante

Andrew B Firstenberger

Bobby G Bray, Jr

Bobby G Bray

Bobby G Bray Jr

Various implementations of the present application set forth a method comprising generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, combining, based on a correlation the three-dimensional data and the two-dimensional data, the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, where the XR stream includes a digital representation of the real-world asset, and transmitting, to a remote device, the XR stream for rendering at least a portion of the digital representation of the real-world asset in a remote XR environment.

Networked remote collaboration system

Techniques are disclosed for placing content in and applying layers to an extended reality environment. An extended reality (XR) system determines an identifier that is associated with an object viewable within an extended reality environment. The XR system determines a plurality of data structures associated with the identifier, each data structure including a workspace and a dashboard. The XR system generates, using the plurality of data structures, a plurality of extended reality objects for display in the extended reality environment, each extended reality object including a dashboard from the plurality of data structures, where, in the extended reality environment, a first dashboard is visible. The XR system receives an input associated with the extended reality environment. The XR system causes, in response to the input, the second dashboard to be visible.

Techniques for placing content in and applying layers in an extended reality environment

A mobile device is fitted with an extended reality (XR) software application program executing on a processor within an XR system, and optionally a camera. Via the XR software application program, various techniques are performed for interacting with a physical object via the XR environment, in particular modifying, for example, a state or a parameter or operations of the object. In a technique, the XR software application program facilitates directing a physical computing system or device to perform certain actions associated with a physical object.

Object interaction via extended reality

A mobile device is fitted with an extended reality (XR) software application program executing on a processor within an XR system, and optionally a camera. Via the XR software application program, various techniques are performed for interacting with a physical object via the XR environment. In particular, the XR software application program generates and displays visual representations of real-time metric data received from a data intake and query system along with auxiliary data received from an asset management system. In addition, the XR software application program detects user interactions with the XR environment. In response, the XR software application generates messages directed to the asset management system. The messages include commands to update the auxiliary data associated with the physical object.

External asset database management in an extended reality environment

Various implementations of the present application set forth a method comprising generating three-dimensional data and two-dimensional data representing a physical space that includes a real-world asset, generating an extended-reality (XR) stream representing a remote collaboration session between a host device and a set of remote devices, where the XR stream includes a combination of the three-dimensional data and the two-dimensional data, a set of augmented-reality (AR) elements associated with the real-world asset, and a set of performed actions associated with a portion of the digital representation or at least one AR element, serializing the XR stream into a set of serialized chunks, transmitting the serialized chunks to the remote devices, where the remote devices recreate the XR stream in a set of remote XR environments, and transmitting the serialized chunks to a remote storage device, where a device subsequently retrieves the serialized chunks to replay the remote collaboration session.

Playback of a stored networked remote collaboration session

Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Multi-environment networked remote collaboration system

Techniques are disclosed for using tag placement to determine 3D object orientation. An extended reality (XR) system detects, in a two-dimensional image, a data marker associated with an object viewable in an XR environment. The XR system applies a first function to the data marker to generate a rectilinear data marker by transforming a quadrilateral that circumscribes the data marker into a rectangle. The XR system determines a three-dimensional orientation of the object based on transformation of the data marker to the rectilinear data marker. The XR system determines an XR object associated with the data marker. The XR system applies a second function to the XR object, where the second function uses the three-dimensional orientation of the data marker to modify an orientation of the XR object to generate a transformed XR object. The XR system causes the transformed XR object to be displayed within the two-dimensional image.

Techniques for using tag placement to determine 3D object orientation

A device is fitted with a camera and an extended reality (XR) software application program executing on a processor. Via the XR software application program, a technique is performed for automating adaptive workflows in the XR environment. In the technique, the XR software application program determines an identifier of an asset in the XR environment. The XR software application program sends to a data intake and query system a request associated with a playbook having one or more execution tasks associated with the asset. The XR software application program receives the playbook and generates an XR object associated with an execution task in the playbook. The XR software application program causes the XR object to be displayed at a location in the XR environment corresponding to a determined location, relative to the asset, of a portion of the asset with which the execution task is associated.

Automated adaptive workflows in an extended reality environment

One or more disclosed techniques comprise generating an extended reality (XR) template at a first location, where the XR template represents a virtual space in an XR environment that is associated with a real-world object at a second location, and generating a template object that represents the real-world object, wherein the template object is included in the XR template. The techniques further comprise modifying the template object to include a marker that corresponds to a real-world marker associated with the real-world object, generating a first template XR object that corresponds a first XR object to be displayed in the XR environment, where the first template XR object is positioned within the XR template relative to the marker included on the template object, and assigning the XR template to the real-world marker.

Growing community of inventors

San Jose, CA, United States of America

Sammy Lee