JP7328773B2 - Information processing method, information processing apparatus, and information processing program - Google Patents

Description

The present disclosure relates to an information processing method, an information processing apparatus, and an information processing program for presenting information.

Conventionally, during a cleaning operation, image recognition is performed by comparing an image captured by an imaging unit with an image of a registered foreign object stored in a storage unit, and the registered foreign object stored in the storage unit is recognized. is known (see, for example, Patent Document 1). When the registered foreign object is recognized, the electric cleaning device controls the suction drive unit based on the control mode stored in the storage unit corresponding to the recognized foreign object, and the recognized foreign object is detected. An indication identifying what it is is displayed on the display screen.

Also, there is known a recommendation system that searches for and recommends similar products that do not match the search conditions, instead of searching only for products that match the search conditions (see Patent Document 2, for example).

Patent No. 5771885 JP 2008-276449 A

However, with the conventional technology described above, there is a possibility that an article suitable for the owner is not presented, and further improvement is required.

The present disclosure has been made to solve the above problems, and aims to provide an information processing method, an information processing apparatus, and an information processing program capable of presenting an article more suitable for the owner. is.

An information processing method according to an aspect of the present disclosure is an information processing method in an information processing apparatus, in which first information about an object to be sucked by a self-propelled cleaner is acquired, and based on the first information, the object to be sucked is identifying a first item composed of an object, and identifying a second item related to the first item based on second information about the first item and third information about the owner of the first item; , outputting fourth information about the identified second item.

According to the present disclosure, it is possible to present an article that is more suitable for the owner.

1 is a diagram showing a configuration of an information presentation system according to Embodiment 1 of the present disclosure; FIG. 1 is a diagram illustrating a configuration of a server device according to Embodiment 1 of the present disclosure; FIG. 4 is a diagram showing an example of user information stored in a user information storage unit in Embodiment 1. FIG. 4 is a diagram showing an example of article information stored in an article information storage unit in Embodiment 1. FIG. 4 is a flowchart for explaining the operation of the server device according to Embodiment 1 of the present disclosure; FIG. 5 is a diagram showing an example of presentation information displayed when the self-propelled cleaner starts cleaning damaged articles in the first embodiment; FIG. 4 is a diagram showing an example of presentation information displayed when a substitute product is presented in Embodiment 1; FIG. FIG. 10 is a diagram showing an example of presentation information displayed when a plurality of alternative items are presented in Embodiment 1; FIG. It is a figure which shows the structure of the 1st server apparatus and the 2nd server apparatus in Embodiment 2 of this indication.

(Findings on which this disclosure is based)
In Patent Document 1, an image of a foreign object other than an object to be cleaned is registered in advance in a storage unit. An indication is displayed on the display screen specifying what the foreign object is. From the viewpoint of avoiding malfunction or damage to the vacuum cleaner, the foreign matter includes "plastic bags", "documents", "cords", "screws" and the like. From the viewpoint of securing and avoiding stains and damages, "documents", "micro SD cards", "banknotes" and "jewels" are mentioned. In other words, in Patent Document 1, foreign matter other than the cleaning target is recognized, but the cleaning target such as a broken mug, for example, is not recognized.

Further, in Patent Document 2, the attributes and attribute levels of each product are stored in a product database, the desired level of each attribute is input, and the degree of similarity between each input desired level and each attribute level of each product is calculated. Using the obtained similarity for each attribute, the fit rate of each product to the desired product with the input desired level is calculated, and based on the calculated fit rate, one or more Similar products are displayed as recommended products. In other words, in Patent Document 2, the desired level of each attribute is input by the user, but information such as whether or not the user owns the product is not taken into consideration, so the product suitable for the user is not always recommended. Not necessarily.

In order to solve the above problems, an information processing method according to an aspect of the present disclosure is an information processing method in an information processing apparatus, which acquires first information about an object to be sucked by a self-propelled cleaner, A first article composed of the object to be sucked is specified based on the first information, and the first article is specified based on second information about the first article and third information about the owner of the first article. and outputting fourth information about the identified second item.

According to this configuration, the first item configured by the object to be sucked by the self-propelled cleaner is identified, and based on the second information about the first item and the third information about the owner of the first item, the A second item related to the one item is identified, and fourth information about the identified second item is output. Therefore, when the second item related to the first item is identified, the third information regarding the owner of the first item configured by the suction target of the self-propelled cleaner is considered. You can present an item that is suitable for

Further, in the information processing method described above, the object to be sucked is the damaged first article, the first information is information regarding the appearance of the object to be sucked, and the identification of the first article is performed by the The first article may be identified based on the appearance of the object to be sucked.

According to this configuration, it is possible to identify what the damaged first article is based on the appearance of the object to be sucked.

Further, in the information processing method described above, the information about the appearance may include an image captured by a camera provided in the self-propelled cleaner, and the image may include the suction target.

According to this configuration, the object to be sucked is imaged by the camera of the self-propelled cleaner, and the damaged first article can be specified based on the object to be sucked included in the imaged image.

In the information processing method described above, the identification of the first article may be performed by recognizing the image including the object to be sucked, and identifying the first article from the recognized image.

According to this configuration, an image including an object to be sucked is recognized, and the first article is specified from the recognized image, so that the first article can be easily specified by image recognition.

Further, in the above information processing method, the second item may be the same item as the first item.

According to this configuration, an item that is the same as the first item is identified as the second item, and the fourth information regarding the identified second item is output, so that the item that is the same as the first item is presented to the owner. be able to.

Further, in the above information processing method, the second item may be an item having the same attributes as the first item.

According to this configuration, an item having the same attributes as the first item is specified as the second item, and the fourth information regarding the specified second item is output. can be presented to

In the information processing method described above, the second item may have the same attributes as the first item and may be made of a material having higher strength than the first item.

According to this configuration, an article having the same attributes as the first article and having a higher strength than the first article is identified as the second article, and the fourth information regarding the identified second article is output. , an item having the same attributes as the first item and having a stronger material than the first item can be presented to the owner.

Further, in the above information processing method, the third information includes owned article information indicating a plurality of owned articles owned by the owner, and the identification of the second article is indicated by the owned article information. A third item different in type from the first item is specified from among the plurality of owned items, and at least one attribute is the same as the specified third item from among the plurality of items for sale. and a fourth item of the same type as the first item may be specified as the second item.

According to this configuration, there are a plurality of fourth items for sale that are different in type from the first item, have the same at least one attribute as the third item owned by the owner, and are of the same type as the first item. is specified as the second item from among the items, and the fourth information about the specified second item is output. Items that are the same can be presented to the owner.

Further, in the above information processing method, the third information includes residence information indicating the location of the residence of the owner, and the identification of the second article is performed within a predetermined range from the location of the residence indicated by the residence information. may identify the second item available for purchase at a store within.

According to this configuration, since the second article purchasable at the store within the predetermined range from the location of the owner's residence is specified, the article purchasable near the owner's residence can be presented to the owner. can.

In the information processing method described above, the output of the fourth information may include transmitting the fourth information to a display device, and the display device may display the received fourth information in a predetermined manner.

According to this configuration, the fourth information about the second article is transmitted to the display device, and the received fourth information is displayed in a predetermined manner on the display device. A second item can be presented to the owner as a substitute for the constructed first item.

In the information processing method described above, the fourth information may include an object image for ordering the second product.

According to this configuration, since the object image for ordering the second item is displayed, the second item that replaces the first item composed of the suction target of the self-propelled cleaner is ordered from the owner. can be made

In the information processing method described above, the identification of the second item may identify a plurality of second items, and the display device may display the plurality of second items in a selectable manner.

According to this configuration, a plurality of second items are identified, and the plurality of second items are displayed in a selectable manner on the display device. The owner can be made to select an item to replace the item from among a plurality of second items.

An information processing apparatus according to another aspect of the present disclosure includes an acquisition unit that acquires first information about an object to be sucked by a self-propelled cleaner; A second item identifying a second item related to the first item based on a first identifying unit identifying the item, second information about the first item, and third information about the owner of the first item A specifying unit and an output unit that outputs fourth information about the specified second article.

According to this configuration, the first item configured by the object to be sucked by the self-propelled cleaner is identified, and based on the second information about the first item and the third information about the owner of the first item, the A second item related to the one item is identified, and fourth information about the identified second item is output. Therefore, when the second item related to the first item is identified, the third information regarding the owner of the first item configured by the suction target of the self-propelled cleaner is considered. You can present an item that is suitable for

An information processing program according to another aspect of the present disclosure acquires first information about an object to be sucked by a self-propelled cleaner, and specifies a first article composed of the object to be sucked based on the first information. and identifying a second item related to the first item based on second information regarding the first item and third information regarding the owner of the first item, and identifying a fourth item related to the identified second item. Make a computer work to output information.

According to this configuration, the first item configured by the object to be sucked by the self-propelled cleaner is identified, and based on the second information about the first item and the third information about the owner of the first item, the A second item related to the one item is identified, and fourth information about the identified second item is output. Therefore, when the second item related to the first item is identified, the third information regarding the owner of the first item configured by the suction target of the self-propelled cleaner is considered. You can present an item that is suitable for

Embodiments of the present disclosure will be described below with reference to the accompanying drawings. It should be noted that the following embodiments are examples that embody the present disclosure, and do not limit the technical scope of the present disclosure.

(Embodiment 1)
FIG. 1 is a diagram showing the configuration of an information presentation system according to Embodiment 1 of the present disclosure. As shown in FIG. 1, the information presentation system includes a server device 3, a gateway (GW) 5, a first sensor 11, a self-propelled cleaner 21 and a display device 22.

Gateway 5 , first sensor 11 , self-propelled cleaner 21 and display device 22 are arranged inside house 10 . The gateway 5 is wirelessly communicatively connected to the first sensor 11 , the self-propelled cleaner 21 and the display device 22 . Also, the gateway 5 is connected to the server device 3 via the network 4 so as to be able to communicate with each other. Network 4 is, for example, the Internet.

The first sensor 11 , the self-propelled cleaner 21 and the display device 22 are connected to the server device 3 via the gateway 5 so as to be able to communicate with each other. Note that the first sensor 11 , the self-propelled cleaner 21 and the display device 22 may be directly connected to the server device 3 without going through the gateway 5 so as to be able to communicate therewith.

FIG. 2 is a diagram showing a configuration of a server device according to Embodiment 1 of the present disclosure. The server device 3 is communicably connected to a sensor group 1 including a plurality of sensors placed inside the house 10 and a device group 2 including a plurality of devices placed inside the house 10 . The sensor group 1 includes various sensors such as a first sensor 11 and a second sensor 12 . The device group 2 includes various devices such as a self-propelled cleaner 21 and a display device 22 . Note that the gateway 5 is omitted in FIG.

The first sensor 11 is, for example, a microphone device, collects sounds inside the house 10 , and transmits the sound data to the server device 3 . The second sensor 12 is, for example, an imaging device, images the inside of the house 10 , and transmits the image data to the server device 3 . Note that the sensor group 1 may include a thermal image sensor and a vibration sensor. The sensors that constitute the sensor group 1 may be installed on the walls, floors, and furniture of the house 10 , or may be mounted on any device of the device group 2 .

The self-propelled cleaner 21 performs suction cleaning while moving autonomously. The self-propelled cleaner 21 cleans the floor surface in the house 10 while autonomously moving on the floor surface. Normally, the self-propelled cleaner 21 is connected to a charging device (not shown) installed at a predetermined place in the house 10, and a cleaning start button provided on the main body of the self-propelled cleaner 21 is pressed. When pressed by the user, or when cleaning instruction information is received from the server device 3, it moves away from the charging device and starts cleaning. The self-propelled cleaner 21 includes a control section, a camera, a drive section, a cleaning section, and a communication section (not shown).

The controller controls the cleaning operation by the self-propelled cleaner 21 . The drive unit moves the self-propelled cleaner 21 . The drive unit includes drive wheels for moving the self-propelled cleaner 21 and motors that drive the drive wheels. A driving wheel is installed at the bottom of the self-propelled cleaner 21 . The cleaning unit is installed at the bottom of the self-propelled cleaner 21 and sucks the object to be sucked.

The camera captures the traveling direction of the self-propelled cleaner 21 . The communication unit transmits image data captured by the camera to the server device 3 . The communication unit also receives cleaning instruction information for starting cleaning from the server device 3 . A control part starts cleaning, when cleaning instruction|indication information is received by the communication part. In addition, the cleaning instruction information includes a damaged position where the article 6 is damaged within the house 10 . A damaged location is a location where an article 6, such as a mug and a plate, is damaged. After moving to the damaged position, the self-propelled cleaner 21 captures an image of the object to be sucked existing at the damaged position, and transmits the captured image data to the server device 3 . Then, the self-propelled cleaner 21 cleans the damaged position and returns to the charging device.

The display device 22 is arranged on the wall of a predetermined room inside the house 10 . Further, the information presentation system in Embodiment 1 may include a plurality of display devices 22 . A plurality of display devices 22 may be arranged, for example, on the wall of each room such as a living room, kitchen, bedroom, bath, toilet, and entrance. Also, the display device 22 may be an information terminal such as a smart phone or a tablet computer. The display device 22 includes a communication section, a display section, and an input section (not shown).

The communication unit receives information indicating the state of the equipment from the equipment placed in the house 10 . The communication unit also receives presentation information from the server device 3 .

The display unit is, for example, a liquid crystal display device, and displays various information. The display unit displays information about the equipment arranged in the house 10 . The display unit displays, for example, the current state of the washing machine or the current state of the air conditioner. Also, the display unit displays the presentation information received by the communication unit.

The input unit is, for example, a touch panel, and receives input operations by the user. The input unit receives an input of an operation instruction for the equipment arranged in the house 10 . The input unit receives, for example, an input of an operation instruction for an air conditioner or an input of an operation instruction for a lighting device. The communication unit transmits the operation instruction input by the input unit to the device.

The device group 2 includes, in addition to the self-propelled cleaner 21 and the display device 22, a washing machine, a lighting device, an air conditioner, an electric shutter, an electric lock, an air purifier, and the like. Devices that make up the device group 2 include, for example, home appliances, information devices, and home equipment.

The server device 3 includes a communication section 31 , a processor 32 and a memory 33 .

The communication unit 31 includes a sensor data reception unit 311 , a control information transmission unit 312 and a presentation information transmission unit 313 . The processor 32 includes a damage detection unit 321 , a damage position identification unit 322 , a device control unit 323 , a damaged article identification unit 324 , a user identification unit 325 , a substitute article identification unit 326 and a presentation information generation unit 327 . The memory 33 has a user information storage section 331 and an article information storage section 332 .

The sensor data receiving unit 311 acquires sensor data acquired by at least one of the one or more sensors installed in the house 10 . The sensor data receiving unit 311 receives sensor data from each sensor of the sensor group 1 . The sensor data includes sound data acquired by the first sensor 11 (microphone device) and image data acquired by the second sensor 12 (imaging device). The sensor data receiving unit 311 receives sound data as sensor data from the first sensor 11 and receives image data as sensor data from the second sensor 12 .

Also, the sensor data receiving unit 311 receives sensor data from each device of the device group 2 . Devices in the device group 2 also include devices equipped with sensors. A device equipped with a sensor transmits sensor data to the server device 3 . As described above, self-propelled cleaner 21 is equipped with a camera. Therefore, the sensor data receiving unit 311 receives image data from the self-propelled cleaner 21 as sensor data. Also, the display device 22 may include a microphone and a camera, and the sensor data receiving unit 311 may receive sound data and image data from the display device 22 as sensor data.

The damage detection unit 321 detects damage to articles in the house 10 based on the sensor data received by the sensor data reception unit 311 . If the sound data received from the first sensor 11 includes the characteristics of the sound generated when the article is damaged, the damage detection unit 321 detects that the article is damaged. The memory 33 may pre-store, for example, frequency components of a plurality of breaking sounds such as the sound of breaking pottery or glass. The damage detection unit 321 compares the frequency components of the sound data received from the first sensor 11 with the frequency components of a plurality of damage sounds stored in the memory 33, and if the two frequency components match, the article is damaged. Detect damage.

Note that the damage detection unit 321 detects the sound received from the first sensor 11 using a prediction model machine-learned using the sound data at the time when the article was damaged and the fact that the article was damaged as teacher data. From the data, it may be inferred that damage to the item has occurred. In this case, the prediction model is stored in the memory 33 in advance.

Further, the damage detection unit 321 may detect that the article is damaged from the image data captured by the second sensor 12 . For example, the sensor data receiving unit 311 may acquire temporally continuous image data from the second sensor 12 . The damage detection unit 321 analyzes the acquired image data, and if the image data includes a state in which an article is dropped from the hand of a person in the house 10 and the article is broken on the floor surface, the article is damaged. You can detect what you have done.

Moreover, the damage detection unit 321 may detect damage to the article using sensor data from another sensor such as a vibration sensor. Further, the damage detection unit 321 may detect damage to the article using sensor data from a plurality of sensors of the sensor group 1 .

The damaged position specifying unit 322 specifies the damaged position of the article in the house 10 . The memory 33 may pre-store, for example, a floor plan of the house 10 expressed in a two-dimensional coordinate space. Self-propelled cleaner 21 may create a floor plan by moving inside house 10 and transmit the created floor plan to server device 3 . The damage position specifying unit 322 specifies the coordinates on the floor plan of the source of the sound caused by the damage of the article as the damage position.

It should be noted that the damage location identification unit 322 can more accurately identify the source of the sound of the damage of the article by collecting the sound of the damage of the article with a plurality of microphones. Further, the damaged position specifying section 322 may specify the position where the article is damaged from the image data captured by the second sensor 12 .

Device control section 323 controls the operation of self-propelled cleaner 21 . The device control unit 323 moves the self-propelled cleaner 21 to the damaged position identified by the damaged position identifying unit 322, and cleaning instruction information for causing the self-propelled cleaner 21 to clean the damaged article at the damaged position. to generate

The control information transmission unit 312 transmits cleaning instruction information generated by the device control unit 323 to the self-propelled cleaner 21 . Upon receiving the cleaning instruction information, the self-propelled cleaner 21 moves to the damaged position, captures an image of the suction target, which is a damaged article, at the damaged position, transmits the captured image data to the server device 3, and removes the suction target. suck things. The sensor data receiving unit 311 acquires first information regarding an object to be sucked by the self-propelled cleaner 21 . For example, the first information is information about the appearance of the object to be sucked. Information about the appearance includes an image captured by a camera provided in self-propelled cleaner 21 . The image includes an object to be sucked. The sensor data receiving unit 311 receives image data of an object to be sucked transmitted from the self-propelled cleaner 21 .

The damaged article identification unit 324 identifies a damaged article (first article) composed of the suction target based on the image data (first information) including the suction target received from the self-propelled cleaner 21 . The object to be sucked is a damaged article (first article). The damaged article identifying unit 324 identifies a damaged article (first article) based on the appearance of the suction target. The damaged item identification unit 324 recognizes an image including an object to be sucked, and identifies a damaged item (first item) from the recognized image. The memory 33 may store in advance a table in which images of a plurality of articles are associated with respective names (product names) of the plurality of articles. The damaged article specifying unit 324 compares the image data of the object to be sucked with the images of a plurality of articles stored in the memory 33, and corresponds to the image of the article that partially matches the image of the object to be sucked. Identify the name of the item to which it is attached as the name of the damaged item.

The user information storage unit 331 stores user information about users.

FIG. 3 is a diagram showing an example of user information stored in a user information storage unit in the first embodiment.

As shown in FIG. 3, the user information includes a user ID for identifying the user, the user's name, the user's address, the user's date of birth, the user's blood type, the user's family structure, and the user's belongings. . The user information storage unit 331 stores user information in which the user ID, name, address, date of birth, blood type, family structure, and belongings are associated with each other.

Note that the user information shown in FIG. 3 is merely an example, and may include other information such as images of owned items. Also, all user information may be managed in one table, or may be managed in a distributed manner in a plurality of tables. For example, user IDs and belongings may be managed in different tables, and the information in each table may be associated with the user ID as a key.

The user identification unit 325 identifies the user who owns the damaged item identified by the damaged item identification unit 324 and acquires the user information of the identified user from the user information storage unit 331 . For example, if the damaged item is "Mug A-B", the user information of the user ID "0001" having "Mug A-B" among the owned items is acquired.

The article information storage unit 332 stores article information about articles.

FIG. 4 is a diagram showing an example of article information stored in an article information storage unit in the first embodiment.

As shown in FIG. 4, the article information includes the article number for identifying the article, the article name, the article type, the article category, the article color, the article size, the article weight, the article material, and the article information. Includes price, manufacturer of the item and store where the item is sold. The product information storage unit 332 stores product numbers, product names, product types, product categories, product colors, product sizes, product weights, product materials, product prices, product manufacturers and product sales. Store article information associated with stores.

Note that the item information shown in FIG. 4 is an example, and may include other information such as an image of the item. Also, all the item information may be managed in one table, or may be managed in a distributed manner in a plurality of tables.

The substitute item identification unit 326 identifies the damaged item (second Identify a substitute item (second item) related to the first item). The substitute item identification unit 326 acquires the item information of the damaged item from the item information storage unit 332 .

For example, the replacement item may be the same item as the damaged item. In this case, the substitute item identification unit 326 identifies the same item as the damaged item as the substitute item.

Also, for example, the substitute item may be an item with the same attributes as the damaged item. In this case, the substitute item identification unit 326 identifies an item having the same attributes as the damaged item as a substitute item. Attributes are, for example, the color, size, weight or material of the article. The substitute item identification unit 326 identifies an item having the same color, size, weight and material as the damaged item as a substitute item. Note that the substitute item identification unit 326 may identify an item that is identical to the damaged item in at least one of color, size, weight, and material as the substitute item.

Also, for example, the substitute item may be an item with attributes similar to those of the damaged item. In this case, the substitute item identification unit 326 identifies an item having attributes similar to those of the damaged item as a substitute item. Attributes are, for example, the color, size or weight of the item. The replacement item identifier 326 identifies items similar to at least one of the color, size and weight of the damaged item as replacement items. For example, a color similar to blue is bluish purple or the like, and a similar color is associated with each color and stored in advance. Also, an article having a size similar to the size of the damaged article is, for example, an article having a size within -1 cm to +1 cm of the width, depth and height of the damaged article. It should be noted that an article having a size similar to that of the damaged article is not limited to an article whose size is within a predetermined range as described above. It may be an article whose size is within a predetermined percentage range, such as an article whose size is within a percentage range. Further, an item of weight similar to the weight of the damaged item is, for example, an item of weight within the range of -10 grams to +10 grams of the weight of the damaged item. It should be noted that the item having a weight similar to the weight of the damaged item is not limited to an item whose size is within a predetermined range as described above, but is, for example, within a range of -10% to +10% of the weight of the damaged item. It may be an article within a predetermined ratio of sizes, such as a heavy article.

Also, for example, the substitute item may be an item that has the same attributes as the damaged item and is made of a material that is stronger than the damaged item. In this case, the substitute item identification unit 326 identifies, as a substitute item, an item that has the same attributes as the damaged item and is made of a material that is stronger than the damaged item. An attribute is, for example, the color of the item. When the material of the damaged article is ceramics, the substitute article identification unit 326 identifies a metal article having the same color as the damaged article and having higher strength than the damaged article as a substitute article.

The user information also includes owned item information indicating a plurality of owned items owned by the owner. The substitute item identification unit 326 identifies an item (third item) different in type from the damaged item from among the plurality of owned items indicated by the owned item information, and from among the plurality of items for sale, An item (fourth item) that has at least one attribute the same as the identified item and is of the same type as the damaged item may be specified as a substitute item.

The user information also includes residence information indicating the location of the owner's residence. The substitute item identification unit 326 may identify substitute items that can be purchased at stores within a predetermined range from the location of the residence indicated by the residence information.

The presentation information generation unit 327 generates presentation information (fourth information) regarding the substitute item identified by the substitute item identification unit 326 . The presentation information includes an image showing the appearance of the substitute item. The presentation information may also include an object image for ordering the substitute item along with an image showing the appearance of the substitute item.

The presentation information transmission unit 313 outputs presentation information (fourth information) regarding the substitute item identified by the substitute item identification unit 326 . That is, the presentation information transmission section 313 transmits the presentation information generated by the presentation information generation section 327 to the display device 22 . The display device 22 displays the received presentation information in a predetermined manner.

FIG. 5 is a flowchart for explaining the operation of the server device according to Embodiment 1 of the present disclosure. Note that FIG. 5 illustrates an example of detecting damage based on sound data, but detection of damage may be performed based on other sensor data such as image data as described above.

First, the sensor data receiving unit 311 receives sound data as sensor data from the first sensor 11 (step S1).

Next, the damage detection unit 321 uses the sound data received by the sensor data reception unit 311 to determine whether or not damage to an article in the house 10 has been detected (step S2). At this time, if the frequency component of the sound data received from the sensor data receiving unit 311 matches the frequency component of the pre-stored sound data indicating damage to the article, the damage detection unit 321 detects that the article has been damaged. detect. Here, if it is determined that damage to the article has not been detected (NO in step S2), the process returns to step S1.

On the other hand, if it is determined that damage to the article has been detected (YES in step S2), the damage position identification unit 322 identifies the damage position of the article within the house 10 (step S3).

Next, the device control unit 323 moves the self-propelled cleaner 21 to the damaged position identified by the damaged position identifying unit 322, and instructs the self-propelled cleaner 21 to clean the damaged article at the damaged position. Cleaning instruction information is generated (step S4).

Next, the control information transmission section 312 transmits the cleaning instruction information generated by the device control section 323 to the self-propelled cleaner 21 (step S5). The self-propelled cleaner 21 receives cleaning instruction information from the server device 3 and moves toward the damaged position included in the cleaning instruction information. When the self-propelled cleaner 21 reaches the damaged position, the camera captures an image of the object to be sucked, and transmits the captured image data to the server device 3 . The self-propelled cleaner 21 sucks the object to be sucked when image data including the object to be sucked is transmitted to the server device 3 .

Next, the sensor data receiving unit 311 receives image data including the object to be sucked from the self-propelled cleaner 21 as sensor data (step S6).

Next, the damaged article identifying unit 324 identifies a damaged article composed of the suction target based on the image data including the suction target received from the self-propelled cleaner 21 (step S7). The damaged article identification unit 324 compares the images of a plurality of articles stored in advance with the image of the suction target included in the image data, and recognizes the damaged article composed of the suction target. For example, if the object to be sucked is a fragment of a ceramic mug, the damaged article identification unit 324 recognizes an image of the article that partially matches the image of the fragment included in the image data, and corresponds to the image of the recognized article. Identify damaged items as damaged items.

Next, the user identification unit 325 identifies the user who owns the damaged item identified by the damaged item identification unit 324, and acquires the user information of the identified user from the user information storage unit 331 (step S8). The user identification unit 325 acquires user information that a damaged item exists among the owned items.

Note that the user identifying unit 325 may identify the user who owns the damaged item based on the damaged location of the item identified by the damaged location identifying unit 322 and the location information indicated by the address included in the user information. good. Specifically, the user specifying unit 325 specifies a position on the map corresponding to the damaged position specified by the damaged position specifying unit 322, and assigns a user having the specified position on the map as an owner of the damaged article. may be identified as a person.

Next, the substitute item identification unit 326 acquires item information of the damaged item from the item information storage unit 332 (step S9).

Next, the substitute item identification unit 326 identifies a substitute item related to the damaged item based on the item information regarding the damaged item and the user information regarding the owner of the identified damaged item (step S10). Here, the substitute item identification unit 326 performs first to fourth identification processes to identify substitute items related to the damaged item. In the following, using the user information shown in FIG. 3 and the item information shown in FIG. 4, an example in which "Mug A-B" owned by the user with the user ID "0001" is damaged will be described.

In the first identification process, the substitute item identification unit 326 identifies the same item as the damaged item as a substitute item. For example, the substitute item identification unit 326 identifies an item that is the same as the damaged item "Mug AB" as a substitute item.

In addition, in the second identification process, the substitute item identification unit 326 identifies an item having at least one of the multiple attributes of the damaged item being the same as a substitute item. For example, the substitute item identifying unit 326 identifies as a substitute item an item “Cup B” that is made by a different manufacturer but has the same color, material, and similar size as the damaged item.

In addition, in the third identification process, the substitute item identification unit 326 identifies an item different in type from the damaged item from among the plurality of owned items indicated by the owned item information, Among them, an item that has at least one attribute the same as the specified item and that is of the same type as the first item is specified as a substitute item. For example, the substitute item identification unit 326 identifies an item "plate A-G" that is different in type from the damaged item "mag A-B" from among the plurality of owned items indicated by the owned item information. Then, the substitute item identification unit 326 selects the item "Mug A to G" that has the same color as the identified item "plate A to G" and the same type as the damaged item from among the plurality of sales items being sold. ” as a substitute item.

In addition, in the fourth identification process, the substitute item identification unit 326 determines that at least one of the plurality of attributes of the damaged item is the same, that the material is stronger than the damaged item, and that the Items that can be purchased at stores within a predetermined range are identified as substitute items. For example, the substitute item identification unit 326 determines that the color and size of the plurality of attributes of the damaged item are the same, the material is metal with higher strength than the damaged item, and the item is within a predetermined range from the location of the owner's residence. The item "mug cup Z" that can be purchased at the store is specified as a substitute item.

Substitute item identification section 326 performs first to fourth identification processes, and outputs the substitute items identified in each of the first to fourth identification processes to presentation information generation section 327 .

It should be noted that a substitute item is not always specified in each of the first to fourth specifying processes. For example, if the sale of the damaged item has already ended and the item information of the damaged item does not exist in the item information storage unit 332, even if the first identification process is performed, the substitute item will not be identified. Therefore, the substitute item specifying section 326 may perform the first to fourth specifying processes and output the substitute item specified by any one of the first to fourth specifying processes to the presentation information generating section 327 .

Also, priority may be given to the first to fourth identification processes, and the substitute item identification unit 326 selects one substitute item identified by the identification process having the higher priority among the first to fourth identification processes. may be output to the presentation information generation unit 327 .

Further, in Embodiment 1, the substitute item specifying unit 326 performs the first to fourth specifying processes in parallel, but the present disclosure is not particularly limited to this. The substitute item identification unit 326 may sequentially perform the first to fourth identification processes until the substitute item is identified. In this case, first, the substitute item identification unit 326 performs the first identification process. Next, the presentation information generation unit 327 determines whether or not a substitute product has been specified by the first specifying process. Here, when it is determined that a substitute item has been specified by the first specifying process, the presentation information generating section 327 generates presentation information regarding the substitute item specified by the first specifying process of the substitute item specifying section 326 . On the other hand, when it is determined that the substitute item has not been identified by the first identification process, the substitute item identification unit 326 performs the second identification process. After that, the substitute item identification unit 326 sequentially performs the third and fourth identification processes until the substitute item is identified. Then, when it is determined that the substitute item has not been identified by the fourth identification process, the presentation information generating section 327 may generate presentation information indicating that there is no substitute item.

Furthermore, the identification process performed by the substitute item identification unit 326 is not limited to the first to fourth identification processes described above. The substitute item identification unit 326 may perform identification processes other than the above-described first to fourth identification processes to identify substitute items related to damaged articles.

Next, the presentation information generation unit 327 generates presentation information regarding the substitute item identified by the substitute item identification unit 326 (step S11).

Next, the presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22 (step S12). The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. The display device 22 displays presentation information while the object to be sucked is being sucked by the self-propelled cleaner 21 . Note that the display device 22 may display the presentation information when the self-propelled cleaner 21 starts sucking the object to be sucked. Further, the display device 22 may continue to display the presentation information even after the self-propelled cleaner 21 has finished sucking the object to be sucked.

In this way, the damaged article constituted by the suction target of the self-propelled cleaner 21 is specified, and the substitute article related to the damaged article is identified based on the article information about the damaged article and the user information about the owner of the damaged article. is identified, and presentation information about the identified substitute item is output. Therefore, when a substitute item related to the damaged item is specified, the user information regarding the owner of the damaged item configured by the suction target of the self-propelled cleaner 21 is taken into account, so that the replacement item is more suitable for the owner. Goods can be presented.

Presented information generated by the server device 3 and displayed on the display device 22 will now be described.

FIG. 6 is a diagram showing an example of presentation information displayed when the self-propelled cleaner starts cleaning damaged articles in the first embodiment. When generating the cleaning instruction information, the device control section 323 may generate presentation information for notifying the user that cleaning will start. In this case, the control information transmission unit 312 transmits the cleaning instruction information generated by the device control unit 323 to the self-propelled cleaner 21 and transmits the presentation information generated by the device control unit 323 to the display device 22. may

As shown in FIG. 6, the display device 22 may display presentation information 221A for notifying the user of starting cleaning. The presentation information 221A includes, for example, a sentence "Are you okay? Not injured? I'm going to clean now."

FIG. 7 is a diagram showing an example of presentation information displayed when a substitute product is presented in the first embodiment. The presentation information generating section 327 generates presentation information regarding the substitute item identified by the substitute item identifying section 326 . The presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22 . The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. In FIG. 7, the display device 22 displays presentation information 221B including an image 222 for confirming whether or not to purchase a substitute item that is the same as the damaged item.

As shown in FIG. 7, the presentation information 221B includes, for example, a sentence "Would you buy a new mug?" and an image 222 containing.

Further, in Embodiment 1, the substitute item identification unit 326 may identify a plurality of substitute items (second items). The display device 22 may display a plurality of alternative items in a selectable manner.

FIG. 8 is a diagram showing an example of presentation information displayed when a plurality of alternative items are presented in the first embodiment. The substitute item identification unit 326 identifies an item that is the same as the damaged item as the first substitute item, and identifies an item that has the same color and size as the damaged item and is made of a material with higher strength than the damaged item as the second substitute item. Then, an item that is different in color from the damaged item and has the same size as the damaged item is identified as a third substitute item. The presentation information generation unit 327 generates presentation information regarding the first to third substitute items identified by the substitute item identification unit 326 . The presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22 . The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. In FIG. 8, the display device 22 displays a first image 223 for confirming whether to purchase the first substitute item and a second image 224 for confirming whether to purchase the second substitute item. , and a third image 225 for confirming whether or not to purchase the third substitute item.

As shown in FIG. 8, the first image 223 includes, for example, an image showing the appearance of the first alternative item, the price of the first alternative item, and a button for ordering the first alternative item. The first substitute item is the same item as the damaged item.

Also, the second image 224 includes, for example, an image showing the appearance of the second alternative item, the price of the second alternative item, and a button for ordering the second alternative item. The second substitute item is an item that is the same color and size as the damaged item and is made of a material that is stronger than the damaged item. If the material of the damaged article is ceramic, the material of the second substitute article is metal.

Also, the third image 225 includes, for example, an image showing the appearance of the third alternative product, the price of the third alternative product, and a button for ordering the third alternative product. A third alternate item is an item that is a different color than the damaged item and the same size as the damaged item. In particular, the third substitute item is an item that is the same color as the item that is different in type and color from the damaged item among the plurality of items owned by the owner of the damaged item, and is the same type and size as the damaged item. is. For example, if the damaged item is a blue mug and the item different in type and color from the damaged item is a green plate, a green mug that is the same size as the damaged item is identified as the third substitute item.

Note that the first image 223, the second image 224, and the third image 225 may include evaluation information obtained by evaluating the first alternative item, the second alternative item, and the third alternative item, respectively, by another user.

Also, the presentation information 221B and 221C may include information on the store that sells the presented substitute item. Furthermore, the presentation information 221B, 221C may include an image of a state in which the substitute item is placed on the shelf.

(Embodiment 2)
The information presentation system in Embodiment 1 has one server device, but the information presentation system in Embodiment 2 has two server devices.

FIG. 9 is a diagram illustrating configurations of a first server device and a second server device according to Embodiment 2 of the present disclosure.

The information presentation system according to Embodiment 2 includes a first server device 3A, a second server device 3B, a gateway 5 (not shown), a first sensor 11, a self-propelled cleaner 21, and a display device 22. In the second embodiment, the same reference numerals are assigned to the same configurations as in the first embodiment, and the description thereof is omitted. The sensor group 1 includes various sensors such as a first sensor 11 and a second sensor 12 . The device group 2 includes various devices such as a self-propelled cleaner 21 and a display device 22 . Note that the gateway 5 is omitted in FIG.

The first server device 3A is communicably connected to the sensor group 1, the device group 2, and the second server device 3B via a network. Also, the second server device 3B is communicably connected to the device group 2 and the first server device 3A via a network.

The first server device 3A is operated by, for example, a platformer. The second server device 3B is operated by, for example, a third party.

The first server device 3A includes a communication section 31A, a processor 32A and a memory 33A.

The communication unit 31A includes a sensor data reception unit 311, a control information transmission unit 312, and a user information transmission unit 314. The processor 32</b>A includes a damage detector 321 , a damaged position identification section 322 , a device control section 323 , a damaged article identification section 324 and a user identification section 325 . The memory 33A includes a user information storage section 331. FIG.

The user information transmission unit 314 transmits damaged item information indicating the damaged item identified by the damaged item identification unit 324 and user information of the user identified by the user identification unit 325 to the second server device 3B.

The second server device 3B has a communication section 31B, a processor 32B and a memory 33B.

The communication section 31B has a presentation information transmission section 313 and a user information reception section 315 . The processor 32B includes a substitute item identification unit 326 and a presentation information generation unit 327. FIG. The memory 33B includes an article information storage section 332. FIG.

The user information receiving section 315 receives the damaged article information and the user information transmitted by the first server device 3A.

In the second embodiment, the first server device 3A transmits the damaged article information and the user information to the second server device 3B, but the present disclosure is not particularly limited to this, and the second server device 3B A request for the damaged article information and the user information may be sent to the first server device 3A, and the first server device 3A may send the damaged article information and the user information to the second server device 3B in response to the request.

Further, in the second embodiment, the information presentation system may include a plurality of second server devices 3B.

In each of the above-described embodiments, each component may be configured by dedicated hardware, or realized by executing a software program suitable for each component. Each component may be realized by reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory by a program execution unit such as a CPU or processor.

Some or all of the functions of the device according to the embodiment of the present disclosure are typically implemented as an LSI (Large Scale Integration), which is an integrated circuit. These may be made into one chip individually, or may be made into one chip so as to include part or all of them. Further, circuit integration is not limited to LSIs, and may be realized by dedicated circuits or general-purpose processors. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure connections and settings of circuit cells inside the LSI may be used.

Also, some or all of the functions of the device according to the embodiment of the present disclosure may be implemented by a processor such as a CPU executing a program.

In addition, the numbers used above are all examples for specifically describing the present disclosure, and the present disclosure is not limited to the illustrated numbers.

In addition, the order in which each step shown in the above flowchart is executed is for illustrative purposes in order to specifically describe the present disclosure, and may be an order other than the above as long as the same effect can be obtained. . Also, some of the above steps may be executed concurrently (in parallel) with other steps.

The information processing method, information processing apparatus, and information processing program according to the present disclosure can present an article more suitable for the owner, and therefore are useful as an information processing method, information processing apparatus, and information processing program for presenting information. be.

1 sensor group 2 device group 3 server device 3A first server device 3B second server device 4 network 5 gateway 6 article 10 house 11 first sensor 12 second sensor 21 self-propelled cleaner 22 display device 31, 31A, 31B communication Units 32, 32A, 32B Processors 33, 33A, 33B Memory 311 Sensor data receiving unit 312 Control information transmitting unit 313 Presentation information transmitting unit 314 User information transmitting unit 315 User information receiving unit 321 Damage detecting unit 322 Damage position specifying unit 323 Device control Part 324 Damaged article identification section 325 User identification section 326 Alternative article identification section 327 Presentation information generation section 331 User information storage section 332 Article information storage section

Claims (14)

An information processing method in an information processing device,
Acquiring first information about an object to be sucked by the self-propelled vacuum cleaner,
based on the first information, identifying a first article composed of the object to be sucked;
Identifying second information about the first item from a first storage unit that stores information about the item,
identifying third information about the owner of the first item based on the information about the owned item stored in the second storage unit and the first item;
Identifying a second item related to the first item based on the second information ;
outputting fourth information about the second item to the owner identified based on the third information ;
Information processing methods. The object to be sucked is the damaged first article,
The first information is information about the appearance of the object to be sucked,
The identification of the first item identifies the first item based on the appearance of the object to be sucked.
The information processing method according to claim 1. The information on the appearance includes an image captured by a camera provided in the self-propelled cleaner,
the image includes the object to be sucked,
3. The information processing method according to claim 2. Identifying the first item includes recognizing the image including the object to be sucked, and identifying the first item from the recognized image.
The information processing method according to claim 3. The second item is the same item as the first item,
The information processing method according to any one of claims 1 to 4. The second item is an item having the same attributes as the first item,
The information processing method according to any one of claims 1 to 4. The second article has the same attributes as the first article and is an article made of a material having higher strength than the first article,
The information processing method according to any one of claims 1 to 4. the third information includes owned article information indicating a plurality of owned articles owned by the owner;
The identification of the second article includes identifying a third article different in type from the first article from among the plurality of owned articles indicated by the owned article information, from, specifying as the second item a fourth item that has at least one attribute the same as the identified third item and is of the same type as the first item;
The information processing method according to any one of claims 1 to 7. The third information includes residence information indicating the location of the residence of the owner,
The identification of the second item identifies the second item that can be purchased at a store within a predetermined range from the location of the residence indicated by the residence information.
The information processing method according to any one of claims 1 to 8. outputting the fourth information includes transmitting the fourth information to a display device;
The display device displays the received fourth information in a predetermined manner,
The information processing method according to any one of claims 1 to 9. the fourth information includes an object image for ordering the second item;
The information processing method according to claim 10. Identifying the second item includes identifying a plurality of second items,
The display device displays the plurality of second items in a selectable manner.
The information processing method according to claim 10. an acquisition unit that acquires first information about an object to be sucked by the self-propelled cleaner;
a first identifying unit that identifies a first article composed of the object to be sucked based on the first information;
a second identifying unit that identifies second information about the first item from a first storage unit that stores information about the item;
a third identification unit that identifies third information about the owner of the first item based on the information about the owned item stored in the second storage unit and the first item;
a fourth identifying unit that identifies a second item related to the first item based on the second information ;
an output unit that outputs fourth information about the second article to the owner identified based on the third information ;
Information processing device. Acquiring first information about an object to be sucked by the self-propelled vacuum cleaner,
based on the first information, identifying a first article composed of the object to be sucked;
Identifying second information about the first item from a first storage unit that stores information about the item,
identifying third information about the owner of the first item based on the information about the owned item stored in the second storage unit and the first item;
Identifying a second item related to the first item based on the second information ;
An information processing program that causes a computer to output fourth information about the second article to the owner identified based on the third information .

Images