Nvidia Corporation

International Business Machines Corporation

James Lewis Van Welzen

Jonathan B White

Prakash Yadav

Brian Dennis Falardeau

David Paul Clark

Chandrasekhar Narayanaswami

Bengt-Olaf Schneider

Stephen Holmes

Shyam Raikar

David Wilson

Charu Kalani

Robert Spencer Horton

Nathan Otterness

Amit Parikh

Jack Van Welzen

Glenn Cochran

Mark Christopher Fowler

Mark Van Horn

David Le Tacon

Kirk Steffen Haskell

Travis Muhlestein

Thomas Y Kwok

Thomas Yu-Kiu Kwok

Steve Mastrianni

Joshua Abbott

Nidhi Singh

Jeffrey David Weintraub

Cristobal Alvarez-Russell

Toshant Sharma

Jean Wang

Po-Shih Wang

In various examples, natural language processing may be performed on text generated by a game to extract one or more in-game events from the game. The system (e.g., a client device and/or server) may receive the text in the form of one or more strings generated by a game application. The system may then extract one or more in-game events from the text using natural language processing. The game may include the text in a message it sends to the system (e.g., using an Application Programming Interface (API)) and/or in a game log entry or notification. The text may be generated based at least on the game determining one or more conditions are satisfied in the gameplay (e.g., victory, points scored, milestones, eliminations, item acquisition, etc.). The text may be mapped to event templates, which may then be used to extract parameters of events therefrom.

Event information extraction from game logs using natural language processing

In examples, a device's native input interface (e.g., a soft keyboard) may be invoked using interaction areas associated with image frames from an application, such as a game. An area of an image frame(s) from a streamed game video may be designated (e.g., by the game and/or a game server) as an interaction area. When an input event associated with the interaction area is detected, an instruction may be issued to the client device to invoke a user interface (e.g., a soft keyboard) of the client device and may cause the client device to present a graphical input interface. Inputs made to the presented graphical input interface may be accessed by the game streaming client and provided to the game instance.

Automatic instantiation of native virtual interfaces for streaming applications

In various examples, applications may be executed on remote computing devices to composite and broadcast gameplay with video and audio data. Systems and methods are disclosed that distribute, between and among various computing devices, processing of tasks including rendering of gameplay, composition of various types of data, and broadcasting of composited data. The tasks may be executed on computing devices that are remote to a client device, such as a virtual machine, GPU, server, and/or other computing device in the cloud, all of which are connected through a network. Customized composited content may be generated within the system, without latency and dropped frames, by distributing tasks such as compositing and rendering of gameplay to computing devices that have high performance capability and are specialized for handling memory- and time-intensive tasks.

Cloud execution of audio/video compositing applications

In various examples, frames of a video may include a first visual object that may appear relative to a second visual object within a region of the frames. Once a relationship between the first visual object and the region is known, one or more operations may be performed on the relative region. For example, optical character recognition may be performed on the relative region where the relative region is known to contain textual information. As a result, the identification of the first visual object may serve as an anchor for determining the location of the relative region including the second visual object&#x2014;thereby increasing accuracy and efficiency of the system while reducing run-time.

Focusing regions of interest using dynamic object detection for textual information retrieval

A game summary may be produced using an event log of in-game events and corresponding game content based on game data associated with a gameplay session(s). The event log may include metadata that indicates times of in-game events and associations between in-game events and game content items that capture the in-game events. A user may interact with in-game events with temporal context, allowing for more informed selections and a better understanding of the gameplay session. Using the event log, a game summary may provide such features as a timeline to convey relative timing of in-game events, a list of in-game events, a map of a virtual environment of the game that is temporally annotated based on in-game events, game status information, and statistical and performance information. A game summary may show trends over time and/or game sessions and convey information for selected sets of players, such as teams.

Automatically generated enhanced activity and event summaries for gameplay sessions

In various examples, users may access a tool that automatically generates video montages from video clips of the user's gameplay according to parameterized recipes. As a result, a user may select&#x2014;or allow the system to select&#x2014;clips corresponding to gameplay of the user and customize one or more parameters (e.g., transitions, music, audio, graphics, etc.) of a recipe, and a video montage may be generated automatically according to a montage script output using the recipe. As such, a user may have a video montage generated with little user involvement, and without requiring any skill or expertise in video editing software. In addition, even for experienced video editors, automatic video montage generation may be a useful alternative to save the time and effort of manually curating video montages.

Automatic video montage generation

Determining relative regions of interest in images using object detection

One embodiment of the present invention sets forth a technique for broadcasting composited game content. The technique includes executing an application program to generate a first video frame of game content, and causing the first video frame to be displayed on a primary display device. The technique further includes compositing at least one graphical user interface (GUI) element with the first video frame to generate a composited frame. The technique further includes causing the composited frame to be displayed on an external display device by transmitting the composited frame to the external display device via a local display interface.

Gamecasting techniques

Methods of providing in-game virtual split screens with peer-to-peer video conferencing are described for use in online gaming, for instance. In one approach, a live video stream, a live audio stream, and a player viewpoint are sent from a first computer system for receipt by a second computer system. The first and second computer systems concurrently execute the online game. The live video stream, the in-game video stream, and locally rendered in-game content are combined to create a composite video stream, and the live audio stream, the in-game audio stream, and locally generated in-game audio are combined to create a composite audio stream. The composite video stream and the composite audio stream are operable to be presented at the second computer system in real-time.

Built-in support of in-game virtual split screens with peer-to peer-video conferencing

Aspects of performing smooth backwards playback in a DVD system are described. The aspects include reconstructing frame data for every frame in a set of frames of an original playback, the set of frames preceding a currently displayed frame. Further included is the utilization of at least seven frame buffers to store frame data during the reconstructing step. The reconstructed frame data is then displayed in reverse order of the original playback for the set of frames.

Method and system for DVD smooth rewind

Methods, systems and computer-readable medium for changing video playback speed are disclosed. Video playback speed may be changed by determining a first frame rate and a second frame rate for which a frame rate transition is to be made. An instantaneous frame rate is calculated to produce a calculated instantaneous frame rate, wherein the calculated instantaneous frame rate is between the first frame rate and the second frame rate. A timestamp of a frame is adjusted based on the calculated instantaneous frame rate to produce an adjusted timestamp. Graphical data for the frame is provided in accordance with the adjusted timestamp to enable display of the frame. Thereafter, the frame may be displayed in accordance with the adjusted timestamp.

Method and system for DVD smooth search transitions

A method for adapting power consumption of a processor based upon an application demand is provided. The method initiates with determining an application demand based upon a current processing operation. Then, a time interval associated with the application demand is determined. Next, unnecessary power consuming functions for the application demand are determined. Then, a clock frequency for the unnecessary power consuming functions is reduced for the time interval. In one embodiment, the power is terminated to the unnecessary power consuming functions. In another embodiment, the clock frequency of the processor is adjusted for at least a portion of the time interval. A program interface for adapting power consumption of a computer system, processor instructions for adapting power consumption of a computer system and a processor are included.

Method and apparatus for adaptive power consumption

Aspects of performing single frame backwards playback in a DVD system are described. The aspects include receiving a signal indicating selection of a single frame reverse function. Frame data for a preceding frame of an original playback is then reconstructed while utilizing memory sufficient to support the reconstruction. The reconstructed frame data of the preceding frame is then displayed.

Growing community of inventors

Longmont, CO, United States of America

James Lewis Van Welzen