JP7127100B2 - Information processing device, office supply recommendation method, and office supply recommendation program - Google Patents

Description

The present invention relates to an information processing device, an office supplies recommendation method, and an office supplies recommendation program.

As a measure to prevent the spread of the new coronavirus, companies are encouraging employees to work from home. As a result, there is a demand to experience a comfortable working space like an office environment at home. Specifically, office supplies such as chairs that reduce the user's burden can be used at home.

JP-A-2002-245294

Conventionally, however, the user has to select the office supplies by himself/herself, and there has been a problem that it may not be possible to select the best office supplies for the room in the house. In other words, there is a problem that it is difficult to select appropriate office supplies because each household has various environmental characteristics.

In order to solve the above-described problems and achieve the object, an information processing apparatus of the present invention includes an acquisition unit that acquires image information of a room; a specifying unit that specifies the type of supplies; a selection unit that selects office supplies to be recommended from a group of office supplies corresponding to the type of office supplies specified by the specifying unit based on the image information; and an output unit for outputting information about the office supplies selected by the selection unit.

Further, an office supplies recommendation method of the present invention is an office supplies recommendation method executed by an information processing apparatus, comprising: an acquisition step of acquiring image information of a room; a specifying step of specifying the type of target office supplies; and a selecting step of selecting office supplies to be recommended from among a group of office supplies corresponding to the type of office supplies specified by the specifying unit based on the image information. and an outputting step of outputting information about the office supplies selected by the selecting step.

Further, the office supply recommendation program of the present invention comprises: an acquisition step of acquiring image information of a room; a specification step of specifying a type of office supplies to be recommended based on the image information acquired by the acquisition step; a selection step of selecting office supplies to be recommended from a group of office supplies corresponding to the type of office supplies specified in the specifying step based on the image information; The computer is caused to execute an output step of outputting.

ADVANTAGE OF THE INVENTION According to this invention, it is effective in being able to recommend the optimal office supplies for a room.

FIG. 1 is a block diagram showing a configuration example of an information processing apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of processing for recommending products to a user who is about to purchase office supplies. FIG. 3 is a diagram for explaining an example of processing when recommending products to a user who is about to buy more office supplies. FIG. 4 is a flowchart illustrating an example of the flow of processing in the information processing apparatus according to the first embodiment; FIG. 5 is a diagram showing a computer that executes a program.

Embodiments of an information processing apparatus, an office supplies recommendation method, and an office supplies recommendation program according to the present application will be described below in detail with reference to the drawings. Note that the information processing apparatus, the office supplies recommendation method, and the office supplies recommendation program according to the present application are not limited to this embodiment.

[First Embodiment]
In the following embodiments, the configuration of the information processing apparatus according to the first embodiment and the flow of processing in the information processing apparatus will be described in order, and finally the effects of the first embodiment will be described.

[Configuration of information processing device]
First, the configuration of the information processing apparatus 10 will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration example of an information processing apparatus according to the first embodiment. As shown in FIG. 1, an information processing apparatus 10 is connected to a user terminal 20 via a network 30 . The information processing device 10 is a device such as a server that recommends office supplies to a user who owns a smart phone.

Also, the user terminal 20 is, for example, a terminal device such as a smart phone, a tablet terminal, a mobile phone, or a notebook PC. It is assumed that, for example, a dedicated application for recommending office supplies is downloaded to the user terminal 20 . Note that the user terminal 20 may have some or all of the functional units of the information processing device 10 described below, and the user terminal 20 may execute some or all of the processing of the information processing device 10. good.

As shown in FIG. 1, the information processing apparatus 10 has a communication processing section 11, a control section 12 and a storage section 13. FIG. Processing of each unit of the information processing apparatus 10 will be described below.

The communication processing unit 11 controls communication regarding various information. For example, the communication processing unit 11 receives indoor image data or indoor image feature data from the user terminal 20 . The communication processing unit 11 also transmits, for example, a list of recommended office supplies to the user terminal 20 .

The storage unit 13 stores data and programs required for various processes by the control unit 12, and has a product data storage unit 13a particularly related to the present embodiment. For example, the storage unit 13 is a semiconductor memory device such as a RAM or flash memory, or a storage device such as a hard disk or an optical disk.

The product data storage unit 13a stores product data related to office supplies that may be recommended to the user. For example, the product data storage unit 13a stores an image, product name, size, color, material, manufacturer, etc. of each office product as information related to the office product. In addition, it is not limited to the case where the product data storage unit 13a stores the product data, and the product data may be stored in an external device.

The control unit 12 has an internal memory for storing programs defining various processing procedures and required data, and executes various processing using these. For example, the control unit 12 has an acquisition unit 12a, an identification unit 12b, a selection unit 12c, and an output unit 12d. Here, the control unit 12 is, for example, an electronic circuit such as a CPU or MPU or an integrated circuit such as an ASIC or FPGA.

Acquisition unit 12a acquires image information of a room. For example, the acquisition unit 12a acquires from the user terminal 20 image data of a room in which office supplies are arranged, which is photographed by the user. Note that the acquiring unit 12a may acquire, from the user terminal 20, not the image data of the indoor image itself, but the data of the feature amount of the indoor image as the image information. That is, it is possible to consider the user's privacy by preventing the acquisition unit 12a from acquiring the image data of the room itself.

The acquisition unit 12a may also acquire information about the user. For example, the user's height and weight, purchase history, search history, user's favorite color, etc. may be acquired from the user terminal 20 or the like. . Further, the acquisition unit 12a may acquire image information of not only the room in which the office supplies are arranged, but also the image information of other rooms.

The specifying unit 12b specifies the type of office supplies to be recommended based on the image information acquired by the acquiring unit 12a. For example, the specifying unit 12b analyzes the image information acquired by the acquiring unit 12a and specifies the type of office supplies included in the indoor image. Then, using the types of office supplies included in the indoor image, the specifying unit 12b determines the types of office supplies that are not included in the indoor image from among a preset office supplies list, and determines the types of office supplies that are not included in the indoor image. Specify the type of office supplies that does not exist as the type of office supplies to be recommended.

Here, when specifying office supplies not included in the indoor image, the specifying unit 12b may preferentially specify office supplies related to large furniture such as desks and chairs. As a result, the specifying unit 12b first recommends the type of office supplies related to large furniture such as desks and chairs to users who have not purchased desks, chairs, etc., but who want to purchase office supplies. It can be specified as a type of office supplies of interest. Further, the identification unit 12b may identify one or more types of office supplies to be recommended.

Note that the specifying unit 12b may perform part or all of the process of specifying the type of office supplies to be recommended by using a learned model with image information as input. For example, the specifying unit 12b inputs image information to a learning model capable of detecting an object included in the image information, acquires the detection result of the object included in the image information as an output result, and converts the acquired object into an indoor image. Identifies the type of office supplies contained. Then, the specifying unit 12b searches for types of office supplies not included in the indoor image from a preset office supplies list, and identifies the types of office supplies not included in the indoor image as office supplies to be recommended. Identify as a type.

In addition, the identification unit 12b is not limited to the case of identifying office supplies that are not included in the indoor image. You may identify office supplies that are not.

Based on the image information, the selection unit 12c selects office supplies to be recommended from among the office supplies group corresponding to the type of office supplies specified by the specifying unit 12b. For example, when the type of office supplies specified by the specifying unit 12b is related to furniture such as desks and chairs, the selecting unit 12c estimates the spatial information of the room from the image information, and based on the spatial information. to select the office supplies to be recommended.

That is, when recommending items related to furniture such as desks and chairs, the selection unit 12c selects office supplies to be recommended according to the size and color tone of the room. For example, when recommending a desk, the selection unit 12c uses an existing depth estimation technique (reference: depth estimation using deep learning https://arxiv.org/abs/1901.09402) to determine the size of the room. Then, the product data storage unit 13a is searched for a desk that has a size that matches the size of the room and that has the same color tone as the room, and the searched product is selected as office supplies to be recommended. The selection unit 12c may also refer to image information of other rooms to select office supplies with color tones including those of other rooms. In addition, the selection unit 12c may estimate the user's favorite color in consideration of the purchase history, search history, etc., and select office supplies of the estimated color. , may select office supplies sized to fit the user's physique. Various information such as the size of the room and the user's favorite color may be input by the user. Further, for example, when there are multiple types of office supplies that are not included in the indoor image, the selection unit 12c considers the selected office supplies to be recommended and selects another type of office supplies as a recommendation target. You may do so. For example, when a desk and a chair are not included in the indoor image, the selection unit 12c selects a desk to be recommended by the above-described processing, and then selects a chair whose color tone matches the selected desk, or the selected recommendation target. A chair having a size that fits the space when the desk is arranged in the room may be selected as a recommendation target.

If the type of office supplies specified by the specifying unit 12b is not related to furniture, the selecting unit 12c selects attribute information (for example, color, performance, manufacturer, etc.) of other office supplies included in the image information. series, etc.) to select office supplies to be recommended. That is, when recommending office supplies such as a PC, a keyboard, a mouse, and a mouse pad, the selection unit 12c selects the office supplies to be recommended according to the color, performance, manufacturer, series, etc. of other office supplies. do.

For example, when recommending a mouse, the selection unit 12c preferentially recommends a mouse in the same series as the keyboard already owned by the user if the product data storage unit 13a stores a mouse in the same series. is selected as the office supplies to be recommended, and if it is not stored, the product data storage unit 13a is searched for a product that is the same color as the keyboard that the user already has and is made by the same manufacturer, Select the searched products as office supplies to be recommended.

Further, for example, the selection unit 12c may select office supplies to be recommended using a trained model that receives image information as input and outputs office supplies to be recommended. That is, the selection unit 12c measures spatial information such as the depth of the room from the image using machine learning technology using deep learning, and selects office supplies suitable for the room.

The trained model is constructed by, for example, training using pairs of image information of the user's room and office supplies actually purchased, leased, or rented by the user as training data. After the output unit 12d, which will be described later, outputs information about office supplies to be recommended, the selection unit 12c feeds back the result of whether the user has purchased, leased, or rented to the learned model. You may make it update a parameter.

The output unit 12d outputs information about the office supplies selected by the selection unit 12c. For example, the output unit 12d generates a list including the office supplies selected by the selection unit 12c, and outputs the list to the user terminal 20 as information on office supplies. For example, the output unit 12d acquires information on office supplies such as product name, color, performance, manufacturer, and price from the product data storage unit 13a, generates a list based on the acquired information, and stores the information on the user terminal 20. Send to Then, for example, the user terminal 20 displays a list of recommended office supplies included in the list. Detailed information may be checked, and a transition to a web page where the designated product can be purchased, leased, or rented may be made.

Here, an example of processing for recommending products to a user who is about to purchase office supplies will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of processing for recommending products to a user who is about to purchase office supplies. In the example of FIG. 2, a user who does not have a telecommuting environment at home and who is about to purchase office supplies is planning to place a set of office supplies in order to receive product recommendations. It is assumed that an indoor image is captured by the user terminal 20 .

As illustrated in FIG. 2, the information processing apparatus 10 acquires from the user terminal 20 an indoor image of a room in which a set of office supplies is to be placed (see (1) in FIG. 2). Then, the information processing device 10 analyzes the acquired image information and identifies the type of office supplies included in the indoor image. In the example of FIG. 2, since the user has not yet purchased office supplies, the information processing apparatus 10 determines that there are no office supplies included in the indoor image.

In this case, the information processing apparatus 10 identifies "desk", which has the highest priority among the preset office supplies list, as the type of office supplies to be recommended (see (2) in FIG. 2). In the example of FIG. 2, it is assumed that a list is set in advance in which priority is set for recommendations in the order of "desk", "chair", "PC", "keyboard", "mouse", and "mouse pad". do. Note that the information processing apparatus 10 may specify not only the "desk" but also the "chair" as the type of office supplies to be recommended, or may specify the type "desk and chair set". Further, it is assumed that the above-described priority order can be appropriately set and changed by the user. Further, for example, the information processing apparatus 10 may have a wish list in which items desired by the user are set. You may make it recommend preferentially. Note that the information processing apparatus 10 may be configured so that it is possible to set whether to make a recommendation even when the image is included in the indoor image, or whether to make a recommendation only when the image is not included in the indoor image.

Subsequently, the information processing apparatus 10 selects a desk to be recommended from the product data storage unit 13a (see (3) in FIG. 2). For example, when recommending a desk, the information processing device 10 estimates the size of a room, and searches the product data storage unit 13a for a desk that has a size that matches the size of the room and that has the same color tone as the room. and select the searched product as the recommended desk. After that, the information processing apparatus 10 transmits the information of the desk to be recommended to the user terminal 20 (see (4) in FIG. 2). For example, the information processing apparatus 10 generates a list listing recommended desk images, and transmits the list to the user terminal 20 . After that, the user browses the information of the recommended desk displayed on the user terminal 20 . As a result, the information processing apparatus 10 can recommend office supplies suitable for a room in the house to a user who is about to purchase office supplies.

Next, with reference to FIG. 3, an example of processing for recommending products to a user who is going to purchase additional office supplies will be described. FIG. 3 is a diagram for explaining an example of processing when recommending products to a user who is about to buy more office supplies. In the example of FIG. 3 , a user who has a working environment at home to some extent and is about to purchase additional office supplies captures an indoor image of a room used for work at home with the user terminal 20 . It is assumed that there is

As illustrated in FIG. 2, the information processing apparatus 10 acquires an indoor image of a room used for work at home from the user terminal 20 (see (1) in FIG. 3). Then, the information processing device 10 analyzes the acquired image information and identifies the type of office supplies included in the indoor image. In the example of FIG. 3, there are already a "desk", a "chair", a "PC", a "keyboard", and a "mouse" as office supplies in the room. Identify "Desk", "Chair", "PC", "Keyboard", "Mouse". Next, the information processing apparatus 10 searches for a type of office supplies not included in the indoor image in descending order of priority in a preset office supplies list, and finds no "mouse pad". judge as a thing.

In this case, the information processing apparatus 10 identifies "mouse pad", which has the highest priority among the preset office supplies list, as the type of office supplies to be recommended (see (2) in FIG. 3). In the example of FIG. 3, it is assumed that a list is set in advance in which priority is set for recommendations in the order of "desk", "chair", "PC", "keyboard", "mouse", and "mouse pad". do.

Subsequently, the information processing apparatus 10 selects a mouse pad to be recommended from the product data storage unit 13a (see (3) in FIG. 3). For example, when recommending a mouse pad, the information processing apparatus 10 preferentially recommends a mouse pad product of the same series as the mouse already owned by the user in the product data storage unit 13a. If the mouse of the same series is selected as the office supplies to be recommended, and if it is not stored, a product that is the same color as the keyboard that the user already has and is the same manufacturer is selected from the product data storage unit 13a. Search and select the searched products as office supplies to be recommended.

After that, the information processing apparatus 10 transmits the information of the recommended mouse pad to the user terminal 20 (see (4) in FIG. 3). For example, the information processing apparatus 10 generates a list in which recommended mouse pad images are listed, and transmits the list to the user terminal 20 . After that, the user browses the information of the recommended mouse pad displayed on the user terminal 20 . As a result, the information processing apparatus 10 can recommend office supplies that are lacking in the room of the house to the user who is going to buy more office supplies.

[Processing procedure of information processing device]
Next, an example of the procedure of processing in the information processing apparatus 10 according to the first embodiment will be described with reference to FIG. FIG. 4 is a flowchart illustrating an example of the flow of processing in the information processing apparatus according to the first embodiment;

As illustrated in FIG. 4, when the acquiring unit 12a of the information processing device 10 acquires the image information of the room (Yes in step S101), the specifying unit 12b makes a recommendation based on the image information acquired by the acquiring unit 12a. The type of target office supplies is specified (step S102). For example, the specifying unit 12b analyzes the image information acquired by the acquiring unit 12a and specifies the type of office supplies included in the indoor image. Then, using the types of office supplies included in the indoor image, the specifying unit 12b determines the types of office supplies that are not included in the indoor image from among a preset office supplies list, and determines the types of office supplies that are not included in the indoor image. Specify the type of office supplies that does not exist as the type of office supplies to be recommended.

Based on the image information, the selecting unit 12c selects office supplies to be recommended from among the office supplies group corresponding to the type of office supplies specified by the specifying unit 12b (step S103). For example, when the type of office supplies specified by the specifying unit 12b is related to furniture such as desks and chairs, the selecting unit 12c estimates the spatial information of the room from the image information, and based on the spatial information. to select the office supplies to be recommended.

Subsequently, the output unit 12d outputs information about the office supplies selected by the selection unit 12c (step S104). For example, the output unit 12d generates a list including the office supplies selected by the selection unit 12c, and outputs the list to the user terminal 20 as information on office supplies.

[Effects of the first embodiment]
The information processing apparatus 10 according to the first embodiment acquires image information of a room, and identifies the type of office supplies to be recommended based on the acquired image information. Then, based on the image information, the information processing apparatus 10 selects office supplies to be recommended from among the office supplies group corresponding to the specified type of office supplies, and outputs information about the selected office supplies. Therefore, the information processing apparatus 10 can recommend the best office supplies for the room.

That is, the information processing apparatus 10 can recommend office supplies that do not overwhelm the space, office supplies that match the color tone of the room, and the like, depending on the environment such as the layout of the room. In addition, since the information processing apparatus 10 uses an indoor image captured by the user, the user can easily receive recommendations for office supplies without requiring a dedicated sensor or the like. As described above, the information processing apparatus 10 can recommend office supplies suitable for a room at home, so that anyone can easily work at home in an environment similar to that of an office, thereby improving productivity.

(system configuration, etc.)
Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured. Further, each processing function performed by each device may be implemented in whole or in part by a CPU and a program analyzed and executed by the CPU, or implemented as hardware based on wired logic.

Further, among the processes described in this embodiment, all or part of the processes described as being automatically performed can be performed manually, or the processes described as being performed manually can be performed manually. All or part of this can also be done automatically by known methods. In addition, information including processing procedures, control procedures, specific names, and various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

(program)
It is also possible to create a program in which the processing executed by the information processing apparatus 10 described in the above embodiment is described in a computer-executable language. For example, it is also possible to create a program in which the processing executed by the information processing apparatus 10 according to the embodiment is written in a computer-executable language. In this case, the same effects as those of the above embodiments can be obtained by having the computer execute the program. Further, such a program may be recorded in a computer-readable recording medium, and the program recorded in this recording medium may be read by a computer and executed to realize processing similar to that of the above embodiments.

FIG. 5 is a diagram showing a computer that executes a program. As illustrated in FIG. 5, the computer 1000 includes, for example, a memory 1010, a CPU (Central Processing Unit) 1020, a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, A network interface 1070 and these units are connected by a bus 1080 .

The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012 as illustrated in FIG. The ROM 1011 stores a boot program such as BIOS (Basic Input Output System). Hard disk drive interface 1030 is connected to hard disk drive 1090 as illustrated in FIG. Disk drive interface 1040 is connected to disk drive 1100 as illustrated in FIG. A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100 . The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120, as illustrated in FIG. Video adapter 1060 is connected to display 1130, for example, as illustrated in FIG.

Here, as illustrated in FIG. 5, the hard disk drive 1090 stores an OS 1091, application programs 1092, program modules 1093, and program data 1094, for example. That is, the above program is stored, for example, in hard disk drive 1090 as a program module in which instructions to be executed by computer 1000 are described.

Various data described in the above embodiments are stored as program data in the memory 1010 or the hard disk drive 1090, for example. Then, the CPU 1020 reads the program modules 1093 and program data 1094 stored in the memory 1010 and the hard disk drive 1090 to the RAM 1012 as necessary, and executes various processing procedures.

Note that the program module 1093 and program data 1094 related to the program are not limited to being stored in the hard disk drive 1090. For example, they may be stored in a removable storage medium and read by the CPU 1020 via a disk drive or the like. . Alternatively, the program module 1093 and program data 1094 related to the program are stored in another computer connected via a network (LAN (Local Area Network), WAN (Wide Area Network), etc.), and are stored via the network interface 1070. may be read by the CPU 1020 at the same time.

The above-described embodiments and modifications thereof are included in the scope of the invention described in the claims and their equivalents, as well as in the technology disclosed in the present application.

10 information processing device 11 communication processing unit 12 control unit 12a acquisition unit 12b identification unit 12c selection unit 12d output unit 13 storage unit 13a product data storage unit 20 user terminal 30 network

Claims (6)

an acquisition unit that acquires image information of a room;
a specifying unit that specifies the type of office supplies to be recommended based on the image information acquired by the acquiring unit;
a selecting unit for selecting office supplies to be recommended from among office supplies corresponding to the type of office supplies specified by the specifying unit based on the image information;
an output unit that outputs information about the office supplies selected by the selection unit ;
When the type of office supplies specified by the specifying unit is related to furniture, the selecting unit estimates the size of the room as the space information of the room from the image information, and determines the size of the room. an information processing apparatus , wherein the office supplies to be recommended are selected based on the degree of availability . When the type of office supplies specified by the specifying unit is not related to furniture, the selecting unit selects the office supplies to be recommended based on attribute information of other office supplies included in the image information. 2. The information processing apparatus according to claim 1, wherein a is selected. 2. The information processing according to claim 1, wherein the selection unit selects the office supplies to be recommended by using a trained model that outputs the office supplies to be recommended using the image information as an input. Device. 2. The information processing apparatus according to claim 1, wherein the output unit generates a list including the office supplies selected by the selection unit, and outputs the list as information on the office supplies. An office supplies recommendation method executed by an information processing device, comprising:
an acquisition step of acquiring image information in the room;
a specifying step of specifying a type of office supplies to be recommended based on the image information acquired by the acquiring step;
a selecting step of selecting office supplies to be recommended from among office supplies group corresponding to the type of office supplies identified in the identifying step, based on the image information;
an outputting step of outputting information about the office supplies selected by the selecting step ;
In the selecting step, when the type of office supplies specified in the specifying step is related to furniture, the size of the room is estimated as the space information of the room from the image information, and the size of the room is estimated. a method for recommending office supplies, wherein the office supplies to be recommended are selected based on the quality of the office supplies. an acquisition step of acquiring image information in the room;
a specifying step of specifying the type of office supplies to be recommended based on the image information acquired by the acquiring step;
a selection step of selecting, based on the image information, office supplies to be recommended from a group of office supplies corresponding to the type of office supplies specified in the specifying step;
causing a computer to perform an output step of outputting information about the office supplies selected by the selecting step ;
In the selecting step, if the type of office supplies specified in the specifying step is related to furniture, the size of the room is estimated as the space information of the room from the image information, and the size of the room is estimated from the image information. an office supplies recommendation program, characterized in that the office supplies to be recommended are selected on the basis of the degree to which the office supplies are recommended.

Images