Toshiba Tec Kabushiki Kaisha

Tetsuya Nobuoka

Masaaki Yasunaga

Akihiko Fujiwara

Yuishi Takeno

Mika Hirama

Takayuki Sawada

Norimasa Ariga

Natsuko Fujii

A system for registering an item stored in a shopping cart, includes a terminal attachable to the shopping cart and one or more cameras attached to the shopping cart and positioned to face an opening of the shopping cart through which an item is put therein by a customer. The terminal includes an interface circuit connectable to the cameras, and a processor configured to: acquire first images captured by the cameras, execute image recognition on each of the first images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the first images, select one of the first images in which an item is identified and a smaller number of feature points are identified, and determine the item in the selected first image to be registered for purchase by the customer.

System for registering an item stored in a shopping cart

According to one embodiment, an information processing device includes acquisition means, detection means, and specifying means. The acquisition means acquires image data according to a lost article to which a symbol of a user is attached and identification information according to a group to which the user belongs. The detection means performs analysis set for each item of identification information according to the group with respect to the image data according to the lost article and detects the identification information for identifying the user included in the symbol. The specifying means specifies the user from the identification information detected by the detection means.

Information processing device and control method thereof

An article recognition device includes an image interface, a distance information interface, a support unit, and a processor. The support unit supports an article at a height equal to or greater than a minimum discrimination distance of a distance sensor from a reference plane of the distance sensor and includes a member of which a distance cannot be measured by the distance sensor. The processor acquires a captured image capturing the article supported by the support unit through the image interface, acquires distance information measured by the distance sensor toward the reference plane through the distance information interface, extracts an area having a height equal to or greater than the minimum discrimination distance from the reference plane as an article area of the article from the captured image based on the distance information, and recognizes the article from an image of the article area.

Article recognition device

A management device includes a distance sensor, a sensor interface, and a processor. The distance sensor is configured to measure a distance between a predetermined position and a backmost side of a commodity line having commodities biased in an arrangement direction and supported from a foremost side of the commodity line. The sensor interface transmits and receives data to and from the distance sensor. The processor calculates a length of the commodity line based on the distance before a change in the distance and the distance after the change in the distance when the distance is changed, and determines whether the length of the commodity line matches a thickness of the commodity indicated by shelf label information. The processor calculates the increased or decreased number of commodities based on the determination.

Management device and management system

In accordance with an embodiment, an article recognition apparatus includes a first interface, a second interface, and a processor. The processor determines an article region from an image obtained by the first interface and determines a tilt of the article present in the determined article region on the basis of a distance obtained by the second interface. Further, the processor determines on the basis of the determined tilt of the article that the article is placed in the placement region in a state in which the article leans against another object.

Article recognition apparatus

A commodity management device includes a camera interface circuit connectable to a camera to capture an image of one of commodities arranged in a row along a first direction from a back plate to a front of the shelf. The device includes a sensor interface circuit connectable to a sensor measuring a distance to the commodities in the row. A processor is configured to detect a change in the distance measured by the sensor, identify the commodities based on the image, then acquire a thickness of each commodity in the row, and calculate the number of the commodities removed from the shelf based on the distance change and the thickness of the commodities.

Commodity management device and commodity management system

According to one embodiment, an article recognition device includes a storage unit, an image interface, a distance information interface, and a processor. The storage unit stores outline information indicating an outline of an article. The image interface acquires a captured image. The distance information interface acquires distance information from a distance sensor. The processor recognizes a first article from the captured image, specifies an article area in which the first article appears from the captured image based on the outline information, acquires an article area distance between a surface of the first article and the installation base on which the first article is placed, which appear in the captured image, based on the distance information, and determines whether the first article is disposed overlapping a second article based on the outline information and the article area distance.

According to one embodiment, an article recognition device includes an image interface, a distance information interface, and a processor. The image interface acquires a captured image of an article placed on an installation base. The distance information interface acquires distance information indicating a distance from the installation base and the article. The processor extracts image information for recognizing the article from the image, generates a list including the image information, deletes image information having the same height as the height of the installation base from the list based on the distance information, and recognizes the article based on the image information of the list.

An information processing apparatus performs coordinate calibration between a two-dimensional (2D) coordinate system and a three-dimensional (3D) coordinate system. The apparatus includes a 2D camera interface, a 3D camera interface, and a processor. The processor is configured to receive, from the 2D camera interface, first 2D image data of a flat plate at a first position and second 2D image data of the flat plate at a second position different from the first position, receive, from the 3D camera interface, first 3D coordinate information of the flat plate at the first position and second 3D coordinate information of the flat plate at the second position, and generate a transformation matrix for transforming a 3D coordinate value to a 2D coordinate value, based on the first and second 2D image data and the first and second 3D coordinate information.

Coordinate calibration between two dimensional coordinate system and three dimensional coordinate system

According to one embodiment, an image processing apparatus comprises a screen, a camera, a distance sensor, and a processor. The screen has one surface where an object is put. The camera photographs an image from the other surface of the screen. The distance sensor measures a distance from the one surface of the screen and generates distance information indicating the distance. The processor extracts a region of the object from the photographed image, specifies the object from the image of the region of the object, acquires an outer dimension preset to the specified object, calculates a length, from the screen, of the object put on the one surface of the screen based on the distance information, and outputs an alert when the outer dimension does not match the length of the object.

Image processing apparatus and image processing method

According to one embodiment, an article recognition apparatus includes a first interface, a second interface, and a processor. The first interface acquires an image captured by photographing a photography range including an area where articles that are recognition targets are arranged. The second interface acquires depth information from a predetermined position relative to an area corresponding to the photography range. The processor extracts image areas of all products existing in the image by using the depth information, and determines whether an unidentified area due to overlapping of a plurality of the products exists in the image, based on the image areas of the products extracted from the image.

Article recognition apparatus, settlement apparatus and article recognition method

A method for providing information related to information displayed on a signage device to a mobile device carried by a user includes displaying on a screen of the signage device one or more images, establishing a connection between a mobile device and the signage device, displaying on the screen of the signage device a mark unique to the user, after the connection has been established, moving the mark on the screen in accordance with an operation of the mobile device by the user, and transmitting, to the mobile device, information related to an image at which the mark is located.

Information providing method and system using signage device

According to one embodiment, an article recognition apparatus includes an image acquisition unit, a recognition unit, a region detection unit, a storage unit, and a determination unit. The recognition unit recognizes each of the articles. The region detection unit determines article region information. The storage unit stores article information including a reference value for the article region information. The determination unit determines that an unrecognized article exists, if the reference value for the article region information of each article which the recognition unit recognized does not match with the article region information.

Product recognition apparatus and control method for product recognition apparatus

A mobile information terminal determines whether or not access to a site which is specified by a signal is permitted when the signal transmitted from a transmission source is received, based on identification information. When it is determined that access to the site is permitted, the terminal changes a state of the identification information to a state in which access is not permitted by accessing the site. When it is determined that access to the site is not permitted, the terminal receives an instruction on access to the site while the signal is received. When the instruction on access is received, the terminal accesses the site.

Growing community of inventors

Sunto Shizuoka, Japan

Tetsuya Nobuoka