International Business Machines Corporation

Microsoft Technology Licensing, LLC

Google Inc.

Jin Shi

Pei-Yi Lin

Sharon Chen

Xin Pei Lang

Chao Yuan Huang

Chih-Yuan Lin

Kun Jing

Louis Huang

Yuan Yao Deng

Lu Chen

Dou Ma

Peng Hui Jiang

Pedro Jose Moreno Mengibar

Ignacio Lopez Moreno

Jun Su

Wei Wu

Yan Sun

Jing Yan Ma

Quan Wang

Jun Hong Zhao

Zihua Guo

Matthew Robert Scott

Richard Yuqi Yao

Mu Li

Jason William Pelecanos

Xiong Zhao

Weipeng Liu

Ting Ting Wu

Wen Juan Nie

Lu Fu

Gang Feng

Jie Jiang

Hai Dong Zhang

Fang Chu

Pung Pengyang Xu

Ping Yang

Shu-chih Chen

Hongchao Guan

Ke Huan Yin

Xiu Cheng Wu

Zhang Sheng Pan

Bin Bin Wei

Steven Elliot

Yeming Fang

Xiao Ji Tian

Tang Xue Bo

Meng Qi Chen

Gary Lin

Rui Na Liu

Ke Gong

Jun Jie J Jiang

Liu Xin Peng

Disclosed are techniques for automated locating of user interface elements during graphical user interface testing. When a graphical user interface (GUI) is received for testing, images of the GUI are inputted to a machine learning algorithm, where image processing techniques are applied to identify groups of user interface elements and their constituent elements. Multi-dimensional index values are assigned to groups and elements corresponding to their positions within the GUI. Automated testing of the user interface elements of the GUI is performed by locating the user interface elements by their index values. If an element is not found, a scrolling technique is applied to generate an expanded virtual GUI of one or more groups of user interface elements, and the machine learning algorithm refreshes the index values using the expanded virtual GUI.

Automated locating of GUI elements during testing using multidimensional indices

A method, computer system, and a computer program product for task assistance is provided. The present invention may include acquiring a request expression input by a user. The present invention may include identifying a request intent associated with a task based on the request expression. The present invention may include determining a response script corresponding to the request intent. The present invention may include executing the response script to complete the task and presenting the process of running the task in a user-interface (UI).

Script-based task assistance

According to an exemplary embodiment of the present invention, a method is provided. The method includes identifying UI controls in a GUI for display on a screen of a computing device. The method further includes determining a position relationship of the UI controls. The method further includes mapping the UI controls to keyboard areas such that a position relationship of the keyboard areas corresponds with the position relationship of the UI controls. One or more keys within the individual areas are associated with the UI controls that are mapped to the respective keyboard areas.

Mapping UI controls on screen to keys

A method, system and computer program product for container image migration service is provided. The method comprises identifying a latest version of a first customer container image stored in a container image repository. The method further comprises determining the latest version of the first customer container image is a migration image from a last version of the first customer container image; determining a set of commands in the Docker file of the last version of the first customer container image that have migrated to a corresponding set of commands in the Docker file of the migration image; identifying a latest version of a second customer container image having at least one Docker file command in common with at least one command in the set of commands; and recommending imminent migration of the second customer container image to include migration of the at least one Docker file command.

Container image migration service

A method of generating an accurate speaker representation for an audio sample includes receiving a first audio sample from a first speaker and a second audio sample from a second speaker. The method includes dividing a respective audio sample into a plurality of audio slices. The method also includes, based on the plurality of slices, generating a set of candidate acoustic embeddings where each candidate acoustic embedding includes a vector representation of acoustic features. The method further includes removing a subset of the candidate acoustic embeddings from the set of candidate acoustic embeddings. The method additionally includes generating an aggregate acoustic embedding from the remaining candidate acoustic embeddings in the set of candidate acoustic embeddings after removing the subset of the candidate acoustic embeddings.

Speaker identification accuracy

A computer-implemented method, a computer system, and a computer program product are proposed. According to the method, chat information of a chatbot is obtained in response to receiving one or more chat messages from the chatbot. Then a matching data object of a matching data model from one or more data models is determined based on the chat information. And a data value of the matching data object is obtained as a response to the one or more chat messages.

Chatbot information processing

Aspects of the present disclosure relate to recommendation and translation of symbols. In some embodiments, the method includes receiving current text data from a sender, receiving a first set of historical text data for the sender, determining emoji use preference of the sender, analyzing the current text data for context that is representable by an emoji, selecting a first emoji based the context and the first set of historical text data, receiving a second set of historical text data for a recipient of the current text data, analyzing a contextual meaning of the selected emoji based on the first set of historical text data and the second set of historical text data, determining, based on the analyzing the contextual meaning of the selected emoji, that a second emoji would more closely match the context of the current text data, and sending the second emoji to the recipient.

Recommendation and translation of symbols

An input method editor (IME) configured to provide language assistance across a plurality of applications is disclosed. In one example, the IME is adapted for use by English-as-a-second-language (ESL) users. In a specific example, language assistance may be provided by first detecting a need to suggest a substitute word to a user who is typing within an application. The detection may be based on a probability that a current word is in error. If a need is detected, a suggestion may be obtained for the word, such as from a cloud linguistic service or from a local lexicon and language-model, if network connectivity is poor. Once obtained, the suggestion may be displayed to the user in a non-intrusive manner by user interface element(s). Interaction with the user allows the user to accept or reject the suggestion, and perform other functions, such as relocating user interface elements utilized by the display.

Input method editor providing language assistance

Techniques facilitating a crowd-sourcing accessibility rendering system for non-accessible applications are provided. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise an interaction component that monitors one or more interactions between one or more entities and a defined application. The computer executable components can also comprise an analysis component that determines accessibility related information associated with the defined application based on received feedback from an entity of the one or more entities. Further, the computer executable components can comprise an adjustment component that creates a modified application based on the one or more interactions and the accessibility related information of the defined application. The defined application is a non-disability accessible application and the modified application is a disability accessible application.

Crowd sourcing accessibility rendering system for non-accessible applications

A computer-implemented method is disclosed. In the method, a start position of an item list comprising a plurality of items is determined in response to a session-in event. An end position of the item list is determined in response to a session-out event. The reviewed sub-list and unreviewed sub-list are differently displayed. The reviewed sub-list is at least a part of the item list and comprises items from the start position to the end position in the item list. The unreviewed sub-list comprises items outside the reviewed sub-list.

Recognition and display of reading progress

In one embodiment, a method for collaboratively installing a computer application includes monitoring an installation process of an application. The method also includes determining that the installation process requires remote assistance in order to continue. Also, the method includes sending a remote assistance request to remote assistance personnel at a remote site in response to the determination that the installation process requires remote assistance in order to continue. Moreover, the method includes receiving a response to the remote assistance request. The response includes remote assistance information required for installing the application provided by the remote assistance personnel at the remote site. Also, the remote assistance information and the response to the remote assistance request are invisible to an installer of the application. In addition, the method includes continuing the installation process of the application using the remote assistance information received from the remote assistance personnel at the remote site.

System, method, and computer program product for collaboratively installing a computer application

Embodiments of adjustment of a task execution plan at runtime by a task execution engine configured to receive a plan compilation task, the plan compilation task comprising a task execution plan, are provided. An aspect includes receiving a first plan compilation task by the task execution engine through a plan compilation interface. Another aspect includes modifying a task execution plan of the first plan compilation task in response to receiving a second plan compilation task by the task execution engine, the second plan compilation task comprising a task execution plan for modifying the task execution plan of the first plan compilation task. Yet another aspect includes reading a next task in the task execution plan of the first plan compilation task and initiating the next task by the task execution engine.

Adjustment of a task execution plan at runtime

According to one embodiment, a computer program product for collaboratively installing a computer application includes a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code including computer readable program code configured to: monitor an installation process of an application, send a remote assistance request in response to a determination that the installation process requires remote assistance, receive a response to the remote assistance request, and continue the installation process of the application using the remote assistance information. The response includes remote assistance information required for installing the application, and the remote assistance information is invisible to an installer of the application. In other embodiments, and a method for collaboratively installing a computer application includes operations for performing the above described processes, and a system includes modules for performing the above described processes.

Writing logs in a distributed information system are provided. The logs are related to a transaction instance. A method includes retrieving a log proxy instance from a log server. The log proxy instance includes information related to the transaction instance and information related to currently running component in the transaction instance. The method also includes writing the logs for the transaction instance based on the log proxy instance. Aspects of the present invention further provide a method of facilitating writing logs and analyzing logs. Moreover, the embodiments further provide corresponding apparatuses and system.

Writing and analyzing logs in a distributed information system

Methods, computer systems, and computer-readable storage media for determining that a user of a general search engine has intent to not only view search results in a native language on a general search engine results page, but also to have non-native language learning opportunities presented on the general search engine results page. The non-native language learning opportunities include a set of search results drawn from a non-native language document source and presented in the non-native language. Other opportunities include a non-native language dictionary definition of a received search query, a non-native language translation of the search query, and on-demand translation tools available on the general search engine results page.

Language learning opportunities and general search engines

Growing community of inventors

Beijing, China

Jin Shi