Adobe, Inc.

Apple Inc.

Perry A Caro

Ranjit Desai

Daniel Carl Brotsky

Joseph Pasqua

Maneli Noorkami

Joel N Kerr

Daniel H Craft

Gurjeet S Saund

Venu Madhav Duggineni

Aleksandr M Movshovich

Michael J Rockwell

T V Raman

Thiruvilwamalai Venkatraman Raman

Alexsandr M Movshovich

Alvin Li Lai

Implementations of the subject technology provide systems and methods for recording an extended reality experience in a way that allows the experience to be played back at a later time from a different viewpoint or perspective. This allows computer-generated content that was rendered for display to a user during the recording, to be re-rendered during playback at the correct time and location in the recording, but from a different perspective. In order to facilitate this type of viewer-centric playback, the recording includes a computer-generated content track that references resources for re-rendering the computer-generated content at each point in time in the recording.

Extended reality recorder

Techniques are disclosed relating to encoding recorded content for distribution to other computing devices. In some embodiments, a first computing device creates recorded content for transmission to a second computing device configured to present the recorded content. To encode the recorded content, the first computing device detects, via a network interface of the first computing device, one or more computing nodes available to encode the recorded content in one or more formats supported by the second computing device. The first computing device offloads the recorded content via the network interface to the one or more computing nodes for encoding in the one or more formats. In some embodiments, the second computing device receives a request from a user to stream content recorded by a first computing device and requests the content in a first format being encoded by a computing node assisting the first computing device.

Methods and systems for encoding and decoding data

A device for positional synchronization of virtual and physical cameras may include a processor configured to determine a first position of a physical camera relative to another electronic device in a physical environment. The processor may be configured to initiate positioning of a virtual camera in a second position within a computer-generated environment, wherein the second position relative to a representation of the person in the computer-generated environment coincides with the first position. The processor may be configured to receive an image frame captured by the physical camera and a virtual image frame generated by the virtual camera. The processor may be configured to generate a computer-generated reality image frame that includes at least a portion of the image frame composited with at least a portion of the virtual image frame.

Positional synchronization of virtual and physical cameras

One implementation forms a composited stream of computer-generated reality (CGR) content using multiple data streams related to a CGR experience to facilitate recording or streaming. A media compositor obtains a first data stream of rendered frames and a second data stream of additional data. The rendered frame content (e.g., 3D models) represents real and virtual content rendered during a CGR experience at a plurality of instants in time. The additional data of the second data stream relates to the CGR experience, for example, relating to audio, audio sources, metadata identifying detected attributes of the CGR experience, image data, data from other devices involved in the CGR experience, etc. The media compositor forms a composited stream that aligns the rendered frame content with the additional data for the plurality of instants in time, for example, by forming time-stamped, n-dimensional datasets (e.g., images) corresponding to individual instants in time.

Media compositor for computer-generated reality

Distributed encoding

Bindings are used to describe a document (and a different document) by associating content elements with layout elements, the layout elements defining layout features or placement information to be applied to the associated content elements in the document, the bindings being stored separately from both the content and layout elements.

Computer generation of documents using layout elements and content elements

Systems and apparatus, including computer program products, for tagging data assets. In one aspect, a computer program product includes instructions operable to cause a computer to establish a database of concept data elements, asset references, and associations. The concept data elements each represent a concept and have a hierarchy specified by concept hierarchy information. The asset references each include a storage location identifier for a corresponding one of a plurality of data assets. Each association defines a type of relationship, from a plurality of types of relationships, between a data asset and a concept represented by a concept data element.

Tagging data assets

Apparatus and methods of revealing the hierarchical structure of a document having content of a characteristic type of content are described. The hierarchical structure may be expressed, independently of document content type, as a tree structure of one or more nodes. A semantic representation for interpreting the tree structure may also be provided. Document description files are used to encapsulate structural and meta information associated with a document stored on a computer-readable medium. Document description files are external to native application files and have a set of required fields. Document description files point to the referenced document data using Uniform Resource Locators (URLs) and serve as virtual documents. In addition to the required fields, applications can choose to encode additional structural information in the document description files.

Describing documents and expressing document structure

Computer-implemented methods, program products and data structures for tagging data assets are disclosed. An interface which can receive location information to identify a storage location identifier for a data asset to be saved is presented to a user. The location information for the data asset to be saved and a selection identifying a concept and a relation between the concept and the data asset to be saved are received from the user through the interface. The asset reference for the data asset to be saved is stored in a tag database and an association is created in the tag database representing the relation between the data asset to be saved and the identified concept.

Apparatus and methods of revealing the hierarchical structure of a document having content of a characteristic type of content are described (). The hierarchical structure may be expressed, independently of document content type, as a tree structure of one or more nodes () A semantic representation for interpreting the tree structure may also be provided, document description files are used to encapsulate structural and meta information associated with a document stored on a computer-readable medium (). Document description files are external to native application files and have a set of required fields. Document description files point to the referenced document data using uniform resource locators (URLS) and serve as virtual documents. In addition to the required fields, applications can choose to encode additional structural information in the document description files.

Computer-implemented methods and apparatus for tagging data assets are disclosed. The disclosed methods include a method of responding to a user request that a computer program application open a data asset. The method of opening a data asset includes presenting to the user a location interface to receive data asset location information from the user to locate a desired data asset. The location interface is linked to a searchable tag database that includes concept data elements, asset references, and associations. Concept data elements each representing a concept and have a hierarchy specified by concept hierarchy information. Asset references each comprise a storage location identifier for a corresponding data asset. Each association represents a relation between a data asset and a concept. The method also includes receiving from the user a query identifying a concept and a relation. In response to the query, the tag database may be used to identify a set of data assets each having a specified relation with an identified concept. The identified set of data assets may thereafter be presented to the user. The invention also features a computer program product, tangibly stored on a computer-readable medium, for responding to a user request that a computer program application open a data asset. The program includes instructions operable to cause a computer to present a location interface to the user, instructions to receive data asset location information from the user, instructions to link the location interface to a searchable tag database of concept data elements, asset references, and associations, instructions to receive a query identifying a concept and a relation, instructions to use the tag database to identify a set of data assets each having the relation with the concept, and instructions to present information identifying the set of data assets.

Growing community of inventors

San Jose, CA, United States of America

Perry A Caro