International Business Machines Corporation

Rafael Rossi De Mello Brandao

Marcio Ferreira Moreno

Renato Fontoura De Gusmão Cerqueira

Renato Fontoura De Gusmao Cerqueira

Daniel Salles Chevitarese

Daniel Salles Civitarese

Ana Fucs

Lucas Correia Villa Real

Viviane Torres Da Silva

Vinicius Costa Villas Boas Segura

Guilherme Augusto Ferreira Lima

Juliana Jansen Ferreira

Helon Vicente Hultmann Ayala

Rodrigo Costa Mesquita Santos

Juliana Soares Jansen Ferreira

A system and a method of generating and using a multimodal knowledge representation within an artificial intelligence computing system may include prompting a selection of nodes in a graphical visualization; defining an adaptation strategy based; integrating an adaptation strategy representation with the selection of nodes to generate a multimodal knowledge representation; traversing the selection of nodes in response to a user query; performing an adaptation on the selection of nodes; and updating the knowledge representation based on user feedback to a result generated in response to the user query.

Multimodal knowledge consumption adaptation through hybrid knowledge representation

A modular node includes a semiconductor chip, including modular sensors to detect events or changes in environment, modular actuators for moving or controlling an object, a non-transitory computer readable medium storing a program, a processor executing the program configured to control module networking and setup, and a neuromorphic chip configured to receive information from the modular sensors and modular actuators, autonomously process the information received from the modular sensors and actuators, determine a validity of the information received from the modular sensors and actuators, and autonomously communicate with neighboring modular nodes for network auto-arrangement.

Smart sensing: a system and a method for distributed and fault tolerant hierarchical autonomous cognitive instrumentation

One or more processor can automatically identify, structure and retrieve spatial and/or temporal sequences of digital media content according to semantic specification. Digital media content can be received and information from digital media content can be extracted. Based on the information, a knowledge graph can be constructed or structured to include at least one of spatial and temporal representation of the digital media content. A search query can be received associated with the digital media content. Based on traversing the knowledge graph structure according to at least one of spatial and temporal criterion mapped from the search query, new digital media content can be composed which meets the search query.

Spatiotemporal sequences of content

A hybrid knowledge representation is searched for a machine learning component corresponding to a search query. The hybrid knowledge representation may be structured as nodes representing machine learning workflow components and edges (e.g., links) connecting the nodes based on relationships between the nodes. Responsive to finding the machine learning component in the hybrid knowledge representation, the machine learning component is returned. Responsive to not finding the machine learning component in the hybrid knowledge representation, the hybrid knowledge representation is searched for machine learning model fragments associated with building the machine learning component, generating a new machine learning component by combining the machine learning model fragments and returning the new machine learning component.

Machine learning engineering through hybrid knowledge representation

Document retrieval through assertion analysis on entities and document fragments is disclosed. A document is received. Logical structures and entities are extracted from the document by parsing the document. For an entity in the extracted entities, an object representing the entity is created, an assertion made in the document associated with the entity is determined, and the assertion is linked to the object representing the entity. A logical structure from the extracted logical structures and content of the logical structure containing the assertion are identified and linked to the object representing the entity.

Document retrieval through assertion analysis on entities and document fragments

A system, product, and method including automatically performing extraction of slides from multimodal content, performing object extraction from each of the slides, allowing object substitution through semantics and concepts of the objects extracted, processing audio synchronized with the slides enriched with cognitive computing, search engine, and knowledge base, to provide annotations of the slides, processing the audio synchronized with the object being presented in each slide to enhance semantics and understanding, and curating for each step with human-machine interaction to provide a learning process by the system.

System and method to extract and enrich slide presentations from multimodal content through cognitive computing

A document may be received. An ontology associated with a domain may be identified or retrieved. A set of concepts in the document may be extracted, the set represented in the ontology. A set of concepts selected from the ontology may be received. A search may be performed based on the set of selected concepts.

Document analogues through ontology matching

A system and associated processes may generate new modalities by receiving content associated with an original modality. An appropriateness of an alternative modality may be determined based on at least one of a device available to present the content, a user profile, and a contextual factor regarding an environment of a user intended to receive the content. Source content semantics associated with the content may be automatically determined, and an alternative modality based on the determined source content semantics may be generated and used to present the content to the user.

Alternative modalities generation for digital content based on presentation context

Method and apparatus for monitoring collaboration parameters and maintaining user profiles using cognitive computing techniques are provided. The method includes receiving a domain for a first collaborative session, and retrieving a plurality of trait profiles associated with potential participants. The method further includes determining a subset of trait profiles based in part on comparing each respective trait profile with the rest of the trait profiles, and providing the subset of trait profiles. Additionally, the method includes receiving an indication that the subset of trait profiles is acceptable, and a request to initiate the first collaborative session with participants corresponding to the subset of trait profiles. The method includes initializing a plurality of sensor devices, detecting a first contribution from a first participant, classifying the first contribution using cognitive computing techniques, identifying a trait profile corresponding to the first participant, and updating the identified trait profile.

Cognitive computing techniques for optimal collaboration participant selection

A method and system of dynamically adapting a streaming media content are provided. A user device determines a class of each member of its audience. Streaming media content is received. The streaming media content is monitored to dynamically determine a rating of each segment of the streaming media content. For each segment of the streaming media content, upon determining that a rating of a segment is above a class of a most restricted member of the audience, one or more portions of the segment are adapted to alter the rating of the segment to the class of the most restricted member of the audience. The segment of the media content is then presented on a user interface of the user device.

Automatic content presentation adaptation based on audience

Systems and methods are described for mapping input devices in real time. The method may include controlling a camera to capture a plurality of images, performing object recognition on the images to identify a plurality of objects, determining properties for each identified object that enable the corresponding object to provide spatial data and interaction data of a preferred input device, ranking the objects according to the determined properties, presenting the identified objects in an order corresponding to the rank that enables a user to select one of the presented objects, tracking the selected object and a human being, generating spatial data and interaction data from a result of the tracking, and providing the generated spatial data and interaction data to a computer to emulate the events of the preferred input device.

Method and system to automatically map physical objects into input devices in real time

Automatically identifying speakers in real-time through media processing with dialog understanding. A plurality of audio streams may be received, an audio stream representing a speech of a participant speaking during an online meeting. A voice characteristic of a voice corresponding to the speech of the participant in the audio stream may be determined. The plurality of audio streams may be converted into text and a natural language processing may be performed to determine content context of the dialog. The natural language processing infers a name to associate with the voice in the audio stream based on the determined content context. A data structure linking the name with the voice may be created and stored in a knowledge base. A user interface associated with the online meeting application is triggered to present the name or identity of the speaker.

Automatically identifying speakers in real-time through media processing with dialog understanding supported by AI techniques

Methods, systems, and computer program products for automatically creating narrative visualizations from audiovisual content according to pattern detection supported by cognitive computing techniques are provided herein. A computer-implemented method includes detecting patterns of organization within a provided selection of audiovisual content; matching the detected patterns of organization to pre-determined patterns of organization; applying, to one or more portions of the audiovisual content corresponding to the detected patterns of organization that match pre-determined patterns of organization, one or more visualization templates, wherein the visualization templates comprise items of additional audiovisual content, and wherein the visualization templates are associated with the pre-determined patterns of organization; and outputting to at least one user an enhanced version of the audiovisual content comprising the provided selection of audiovisual content modified in accordance with the applied visualization templates.

Method and system for automatically creating narrative visualizations from audiovisual content according to pattern detection supported by cognitive computing

Growing community of inventors

Rio de Janeiro, Brazil

Rafael Rossi De Mello Brandao