Nippon Telegraph and Telephone Corporation

Kimio Tsuchikawa

Yuki Urabe

Sayaka Yagi

Takeshi Masuda

Fumihiro Yokose

Makoto Komiyama

Akira Kataoka

Haruo Oishi

Hidetaka Koya

Shiro Ogasawara

An operation log acquisition device includes processing circuitry configured to store a determination image that is an image of a characteristic area of an operation screen that is used to perform a predetermined operation, an event occurrence area in which an event may occur when the predetermined operation is performed, operation type specifying information that specifies an operation type, and an acquisition image area that is to be acquired when the predetermined operation is performed, in association with each other, upon detecting an occurrence of the event, acquire an occurrence time of the event, an occurrence position of the event, and a captured image of the operation screen, and determine whether or not the captured image acquired includes a matching area that the determination image matches, and acquire an event occurrence area of the determination image if the captured image includes the matching area.

Operation logs acquiring device, operation logs acquiring method, and operation logs acquiring program

A user interface augmentation system includes a memory and a processor coupled to the memory. The processor is configured to perform operations including: searching a system screen for a base point UI serving as a base point for display of an additional user interface (UI) to be added to the system screen; displaying a new screen with a transparent background in such a way as to overlap the system screen; and displaying the additional UI at a position based on the base point UI on the new screen.

User interface augmentation system, user interface augmentation method, and user interface augmentation program

A display control device includes processing circuitry configured to store index setting information indicating combinations of a plurality of indexes and importance of each of the indexes, and visual variable setting information indicating a visual variable used when a value of the index of the importance is displayed for each importance on a heatmap, calculate values of the indexes collectively on a display basis on the heatmap, specify the combinations of the plurality of indexes and the importance of each of the indexes with reference to the index setting information, and determine a visual variable which is allocated to each of the indexes based on the visual variable setting information and the importance of each of the indexes specified.

Display control device, display control method, and display control program

An operation log visualization device includes processing circuitry configured to store operation logs each containing a captured image of an operation screen captured during an operation and information identifying a position of an operation location in an operation target window on the operation screen, generate images in each of which a portion corresponding to the position in the captured image is highlighted, and generate a flowchart by arranging the generated images in an order of processing of operation logs corresponding to the images.

Operation logs visualization device, operation logs visualization method and operation logs visualization program

A display control device has display setting information including setting information of a layer structure of display objects on a terminal screen and setting information of a group to which the display objects belong, display state information indicating a display state of the display object, and operation setting information defining which setting content a combination of an operation target and operation content on a screen indicate for a layer structure and a group of display objects for each combination of the operation target and the operation content. The display control device specifies the setting content to the display object based on the combination of the operation target and the operation content, the display state information, and the operation setting information when an operation on the display object occurs. The display control device generates the display state information in which the layer structure of the display objects or the group to which the display objects belong is changed, based on the display setting information and the specified setting content and displays a screen.

An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

User operation recording device and user operation recording method

A display control device acquires event data, that is, data expressed as a set of fixed units of data, and uses the acquired event data to display an image of the event data visualized according to a predetermined visualization method. Additionally, in the case of receiving an operation of attaching an electronic label to the displayed image, the display control device stores information about the electronic label, the event data, and setting information related to the image when the electronic label was attached in association with each other in storage. Also, in the case of receiving the specification of an electronic label to be restored from among the electronic labels, the display control device acquires the data of the electronic label as well as the event data and setting information associated with the electronic label from the storage, and restores the image with the electronic label attached.

Display control device and display control method for displaying images including electronic labels

A timeline display device includes processing circuitry configured to store event data for displaying a figure that represents an operation along a time axis, the event data including a start time point and an end time point of the operation, acquire a search condition that specifies an appearance pattern of the figure that is displayed, and search for data pieces of the event data that match the acquired search condition.

Timeline display device, timeline display method and timeline display program

A display control device includes a conversion unit which, upon receipt of an operation log file including operation logs that indicate the content of operations performed on windows on a terminal screen, determines data variables representing window states of the windows indicated by each of the operation logs on the basis of a window state setting for setting a window state on the terminal screen, a display control unit that sets correspondence relationships between the data variables and visual variables, generates rectangular objects corresponding to the data variables, and determines attribute values of the rectangular objects on the basis of the visual variables associated with the data variables, and a visualization unit that performs drawing on the basis of sets of the rectangular objects and the attribute values determined by the display control unit.

Growing community of inventors

Musashino, Japan

Kimio Tsuchikawa