DATE

5 min read

Toward a "Robot Friendly Environment" in Retail Stores Participating in NEDO's Research and Development of Product Information Database

In collaboration with the Expert Committee on Product Information Sharing
Early Realization of Incoming Inspection, Inventory, Product Display, and Payment Using Robots

Arthur D. Little Japan, Inc., SoftBank Corp., Panasonic Connect Co., and ROBOCIP+ are participating in the research and development of a "product information database" as part of the New Energy and Industrial Technology Development Organization (NEDO)'s "Technology Development Project for Next-Generation Artificial Intelligence that Evolves Together with Humans. The R&D project will be conducted by the New Energy and Industrial Technology Development Organization (NEDO), a national research and development organization.
In this research and development project, robots will use artificial intelligence (AI) to efficiently recognize product images and build a product information database to automate incoming goods inspection, inventory, product display, and payment at retail stores. Specifically, we will work on the creation of a mechanism to share product image data for learning, which is necessary for incoming goods inspection, etc., and image data for motion support, which is necessary for robots to properly grasp products based on their shape and other product characteristics, with retailers, manufacturers, wholesalers, etc., by linking them to various basic product data such as weight. By developing a database for food products and daily necessities and establishing a mechanism for continuous updating and operation of the database, we aim to realize the use of robots as soon as possible.
In addition, with the aim of building, verifying, and evaluating practical technology development and service models based on the opinions of businesses involved in the provision and use of data, an " Expert Committee on Product Information Sharing " was established in July 2022 with the participation of various businesses, including retailers, robot solution providers, AI technology development and service providers, product manufacturers, and product information providers. Through discussions and demonstration experiments with various businesses, we aim for steady social implementation.

Outline of "Research and Development for Establishment of Product Information Database
In order to create a "robot-friendly environment "*1, research and development will be conducted to enable robots to efficiently perform image recognition of products and other tasks using artificial intelligence, and to automate incoming goods inspection and inventory, product display, and payment at retail stores. Arthur D. Little Japan, SoftBank, Panasonic Connect, and ROBOCIP+ will participate in this R&D project to build the basic technology for social implementation.

<R&D Items>
a. Clarification of specifications for product image data, etc.
b. Development of imaging and measurement devices
c. Development of software to recognize objects
d. Construction of product information database
e. Verification of the effectiveness of the product information database
f. Investigation of domestic and international trends and consideration of ongoing operation
<Period of implementation>
FY2022 - FY24
<Budget>
310 million yen (FY2022)
<Practitioners> (in alphabetical order)
Arthur D. Little Japan, Inc.
SoftBank Corp.
Panasonic Connect Co.
ROBOCIP+

For details, please see the NEDO and Ministry of Economy, Trade and Industry (METI) press release.
https://www.nedo.go.jp/news/press/AA5_101557.html&nbsp;
https://www.meti.go.jp/press/2022/10/20221005001/20221005001.html

*1 Robot-friendly environment
This means an environment that facilitates the introduction of robots. For social implementation of service robots, it is necessary to realize a "robot-friendly environment" by reforming the work flow and facility environment (cyber and physical environment). In this R&D project, a product information database will be constructed to enable robots to inspect and inventory incoming goods, display merchandise, and settle payments at retail stores, with the aim of creating stores where it is easy to introduce robots.

■Principal Roles of the Implementing Entity
Arthur D. Little Japan, Inc.: Mainly responsible for R&D items f
Providing data to the technology platform and organizing requests from users.
Support for building a product information database and business ecosystem*2 and service model for data sharing

SoftBank Corp.: Mainly in charge of R&D items d and e
Specification study of technology for sharing product information data
Development and implementation of the above technologies
Verification of effectiveness of the above technologies

Panasonic Connect Co.: Mainly in charge of R&D items a, b, and c (also partly in charge of d and e)
Examination of specifications of imaging devices
Development of image capture devices (hardware and software)
Development of product image database and evaluation of its effectiveness through demonstration experiments

ROBOCIP+: Mainly in charge of R&D items a, b, and c (also partly in charge of d and e)
Construction of a database for robot motion support and evaluation of its effectiveness through demonstration experiments
Development of software for robot motion support
Specification study of imaging (3D image) equipment

*2 Business ecosystem
The ecosystem is an industry structure that enables the realization of social systems and businesses. It includes the roles of each business entity, as well as the flow of information, commerce, and money, toward ideal technology utilization and service operation.

About the Expert Committee on Product Information Sharing
In this R&D, the Expert Committee on Product Information Sharing, as a business involved in the provision and use of product information data, will formulate opinions on the following issues and cooperate in verification experiments and the evaluation of the effectiveness of the service model.
Specifications of the product information database
Specifications for product information data sharing technology
The ideal business ecosystem and service model for the construction of product information databases and data distribution.
 
As of October 5, 2022, the following businesses are participating in the Expert Committee on Product Information Sharing, and the number of participating businesses will be expanded in the future.

Participating businesses (as of October 5, 2022)
GS1 Japan
Arthur D. Little Japan, Inc.
AEON Co.
Japan Inforex, Inc.
Seven & i Holdings Co.
SoftBank Corp.
Nomura Research Institute, Ltd.
Panasonic Connect Co.
PLANET, Inc.
United Supermarket Holdings, Inc.
ROBOCIP+
Ministry of Economy, Trade and Industry
New Energy and Industrial Technology Development Organization (NEDO)
 

5 min read

Toward a "Robot Friendly Environment" in Retail Stores Participating in NEDO's Research and Development of Product Information Database

In collaboration with the Expert Committee on Product Information Sharing
Early Realization of Incoming Inspection, Inventory, Product Display, and Payment Using Robots

DATE

Arthur D. Little Japan, Inc., SoftBank Corp., Panasonic Connect Co., and ROBOCIP+ are participating in the research and development of a "product information database" as part of the New Energy and Industrial Technology Development Organization (NEDO)'s "Technology Development Project for Next-Generation Artificial Intelligence that Evolves Together with Humans. The R&D project will be conducted by the New Energy and Industrial Technology Development Organization (NEDO), a national research and development organization.
In this research and development project, robots will use artificial intelligence (AI) to efficiently recognize product images and build a product information database to automate incoming goods inspection, inventory, product display, and payment at retail stores. Specifically, we will work on the creation of a mechanism to share product image data for learning, which is necessary for incoming goods inspection, etc., and image data for motion support, which is necessary for robots to properly grasp products based on their shape and other product characteristics, with retailers, manufacturers, wholesalers, etc., by linking them to various basic product data such as weight. By developing a database for food products and daily necessities and establishing a mechanism for continuous updating and operation of the database, we aim to realize the use of robots as soon as possible.
In addition, with the aim of building, verifying, and evaluating practical technology development and service models based on the opinions of businesses involved in the provision and use of data, an " Expert Committee on Product Information Sharing " was established in July 2022 with the participation of various businesses, including retailers, robot solution providers, AI technology development and service providers, product manufacturers, and product information providers. Through discussions and demonstration experiments with various businesses, we aim for steady social implementation.

Outline of "Research and Development for Establishment of Product Information Database
In order to create a "robot-friendly environment "*1, research and development will be conducted to enable robots to efficiently perform image recognition of products and other tasks using artificial intelligence, and to automate incoming goods inspection and inventory, product display, and payment at retail stores. Arthur D. Little Japan, SoftBank, Panasonic Connect, and ROBOCIP+ will participate in this R&D project to build the basic technology for social implementation.

<R&D Items>
a. Clarification of specifications for product image data, etc.
b. Development of imaging and measurement devices
c. Development of software to recognize objects
d. Construction of product information database
e. Verification of the effectiveness of the product information database
f. Investigation of domestic and international trends and consideration of ongoing operation
<Period of implementation>
FY2022 - FY24
<Budget>
310 million yen (FY2022)
<Practitioners> (in alphabetical order)
Arthur D. Little Japan, Inc.
SoftBank Corp.
Panasonic Connect Co.
ROBOCIP+

For details, please see the NEDO and Ministry of Economy, Trade and Industry (METI) press release.
https://www.nedo.go.jp/news/press/AA5_101557.html&nbsp;
https://www.meti.go.jp/press/2022/10/20221005001/20221005001.html

*1 Robot-friendly environment
This means an environment that facilitates the introduction of robots. For social implementation of service robots, it is necessary to realize a "robot-friendly environment" by reforming the work flow and facility environment (cyber and physical environment). In this R&D project, a product information database will be constructed to enable robots to inspect and inventory incoming goods, display merchandise, and settle payments at retail stores, with the aim of creating stores where it is easy to introduce robots.

■Principal Roles of the Implementing Entity
Arthur D. Little Japan, Inc.: Mainly responsible for R&D items f
Providing data to the technology platform and organizing requests from users.
Support for building a product information database and business ecosystem*2 and service model for data sharing

SoftBank Corp.: Mainly in charge of R&D items d and e
Specification study of technology for sharing product information data
Development and implementation of the above technologies
Verification of effectiveness of the above technologies

Panasonic Connect Co.: Mainly in charge of R&D items a, b, and c (also partly in charge of d and e)
Examination of specifications of imaging devices
Development of image capture devices (hardware and software)
Development of product image database and evaluation of its effectiveness through demonstration experiments

ROBOCIP+: Mainly in charge of R&D items a, b, and c (also partly in charge of d and e)
Construction of a database for robot motion support and evaluation of its effectiveness through demonstration experiments
Development of software for robot motion support
Specification study of imaging (3D image) equipment

*2 Business ecosystem
The ecosystem is an industry structure that enables the realization of social systems and businesses. It includes the roles of each business entity, as well as the flow of information, commerce, and money, toward ideal technology utilization and service operation.

About the Expert Committee on Product Information Sharing
In this R&D, the Expert Committee on Product Information Sharing, as a business involved in the provision and use of product information data, will formulate opinions on the following issues and cooperate in verification experiments and the evaluation of the effectiveness of the service model.
Specifications of the product information database
Specifications for product information data sharing technology
The ideal business ecosystem and service model for the construction of product information databases and data distribution.
 
As of October 5, 2022, the following businesses are participating in the Expert Committee on Product Information Sharing, and the number of participating businesses will be expanded in the future.

Participating businesses (as of October 5, 2022)
GS1 Japan
Arthur D. Little Japan, Inc.
AEON Co.
Japan Inforex, Inc.
Seven & i Holdings Co.
SoftBank Corp.
Nomura Research Institute, Ltd.
Panasonic Connect Co.
PLANET, Inc.
United Supermarket Holdings, Inc.
ROBOCIP+
Ministry of Economy, Trade and Industry
New Energy and Industrial Technology Development Organization (NEDO)