JP6703573B2 - Estimating apparatus, estimating method, and estimating program - Google Patents

Description

The present application relates to an estimation device, an estimation method, and an estimation program.

Conventionally, a technology has been developed to print a bar code containing car wash discount information on a promotional material such as an advertisement leaflet, etc., with the aim of narrowing down the number of people eligible for the discount without changing the special setting of the car wash service. ing.

JP, 2008-221957, A

However, there is room for improvement in the method of providing car wash discounts.

The present application has been made in view of the above circumstances, and an object thereof is to improve a discount providing method for a car wash service.

The estimation device according to the present application includes an acquisition unit and an estimation unit. The acquisition unit acquires an image generated by the imaging unit mounted on the moving body and outside the moving body. The estimation unit estimates the usability, which is the degree to which the mobile body is used, based on the image acquired by the acquisition unit.

According to one aspect of the embodiment, it is possible to improve the method of providing a discount for a car wash service.

FIG. 1 is a diagram illustrating an example of processing according to the embodiment. FIG. 2 is a diagram illustrating a configuration example of the communication system according to the embodiment. FIG. 3 is a diagram illustrating a configuration example of the terminal device according to the embodiment. FIG. 4 is a diagram showing a configuration example of the preferential treatment information DB according to the embodiment. FIG. 5 is a diagram showing a configuration example of the address conversion DB according to the embodiment. FIG. 6 is a diagram illustrating an example of the estimation process performed by the estimation unit according to the embodiment. FIG. 7 is a diagram illustrating an example of the estimation process performed by the estimation unit according to the embodiment. FIG. 8 is a flowchart showing an example of a processing procedure executed by the terminal device according to the embodiment. FIG. 9 is a flowchart showing another example of the processing procedure executed by the terminal device according to the embodiment. FIG. 10 is a flowchart showing another example of the processing procedure executed by the terminal device according to the embodiment. FIG. 11 is a flowchart showing another example of the processing procedure executed by the terminal device according to the embodiment. FIG. 12 is a diagram showing a configuration example of a car wash information DB according to another embodiment. FIG. 13 is a flowchart showing an example of a processing procedure executed by a terminal device according to another embodiment. FIG. 14 is a hardware configuration diagram illustrating an example of a computer that realizes the function of the terminal device.

Hereinafter, modes (hereinafter, referred to as “embodiments”) for carrying out the estimation device, the estimation method, and the estimation program according to the present application will be described in detail with reference to the drawings. Note that the estimation device, the estimation method, and the estimation program according to the present application are not limited by the plurality of embodiments described below. In addition, the plurality of embodiments described below can be appropriately combined within a range in which the processing content is not inconsistent. Further, in a plurality of embodiments described below, the same reference numerals are given to the same parts, and duplicated description will be omitted.

[1. Example of processing]
First, with reference to FIG. 1, an example of a process executed by the terminal device 100 exemplified as one of the estimation devices according to the present application will be described. FIG. 1 is a diagram illustrating an example of processing according to the embodiment. The terminal device 100 includes a device having an imaging function, for example, a mobile terminal such as a so-called smartphone, a tablet, a drive recorder, a car navigation system, and the like. The terminal device 100 may be a dedicated terminal that executes specific application software that provides a function for implementing the processing of the providing device according to the present application. Moreover, below, the case where the terminal device 100 illustrated as one of the estimation apparatuses which concerns on this application is mounted in the vehicle 10 illustrated as one of a moving body is demonstrated.

In the example shown in FIG. 1, the terminal device 100 is installed on the windshield 10G of the vehicle 10. The installation position of the terminal device 100 is not particularly limited as long as the outside of the vehicle 10 can be imaged, and may be installed on the dashboard or on the room mirror. The terminal device 100 according to the embodiment also has a function as a drive recorder that captures an image of the outside of the vehicle 10 by the image capturing unit 105 and records the image.

As shown in FIG. 1, the terminal device 100 acquires an image generated by the imaging unit 105 mounted on the vehicle 10 and outside the vehicle 10 (step S11). Then, the terminal device 100 estimates a feeling of use, which is the degree to which the vehicle 10 has been used, based on the acquired image (step S12).

The terminal device 100 estimates whether the vehicle 10 is in a state suitable for car washing, for example, as a feeling of use that is the degree to which the vehicle 10 has been used. If the terminal device 100 estimates that the vehicle 10 is in a state suitable for car wash, for example, the driver of the vehicle 10 receives the car wash preferential information regarding the car wash provided by the store whose car wash is a part of the business. (An example of “user”).

In this way, the terminal device 100 estimates whether the vehicle 10 is in a state suitable for car washing, for example, as a feeling of use that is the degree to which the vehicle 10 has been used, and determines that the vehicle 10 is in a state suitable for car washing. When it is estimated, the driver of the vehicle 10 can be notified of the car wash benefit information, so that the method of providing a discount for the car wash service can be improved.

[2. Configuration of communication system]
The configuration of the communication system according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating a configuration example of the communication system according to the embodiment.

As shown in FIG. 2, the communication system 1 includes a plurality of terminal devices 100, a server 20A, and a server 20B.

Each terminal device 100 is connected to the server 2020A and the server 20B via the network N. The network N is a communication network such as a LAN (Local Area Network), a WAN (Wide Area Network), a telephone network (a mobile telephone network, a fixed telephone network, etc.), a regional IP (Internet Protocol) network, and the Internet. The network N may include a wired network or a wireless network.

Each terminal device 100 is mounted on the vehicle 10. Each terminal device 100 acquires the car wash preferential information periodically distributed from the server 20A (an example of the “information distribution device”), and stores the acquired car wash preferential information. Each terminal device 100 acquires the weather forecast information regularly distributed from the server 20B and stores the acquired weather forecast information.

The server 20A stores car wash preferential information regarding car wash provided by a store whose car wash is a part of the business. The server 20A periodically delivers the car wash preferential information to each terminal device 100 via the network N. The server 20B periodically delivers the weather forecast information to each terminal device 100 via the network N. The weather forecast information may include weather forecasts for a predetermined period such as a week and the probability of precipitation, as well as information regarding the arrival of pollen, yellow sand, dust, and the like.

[3. Configuration of terminal device]
The configuration of the terminal device 100 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a configuration example of the terminal device 100 according to the embodiment.

As illustrated in FIG. 3, the terminal device 100 includes an operation unit 101, a voice acquisition unit 102, an output unit 103, a display unit 104, an imaging unit 105, a communication unit 106, a position acquisition unit 107, and a storage unit. The unit 108 and the control unit 109 are provided.

[About the operation unit 101]
The operation unit 101 is, for example, a button or a switch, and is used for various operations of the terminal device 100.

[Regarding voice acquisition unit 102 and output unit 103]
The voice acquisition unit 102 is, for example, a microphone, and is used to acquire a voice uttered by the driver while the vehicle 10 is in the vehicle. The voice acquisition unit 102 can convert the acquired voice into a voice signal and output the voice signal to the control unit 109, for example. The output unit 103 is, for example, a speaker, and is used to output various sounds and the like. The output unit 103 can output the sound signal from the control unit 109 as a sound, for example.

[About Display Unit 104]
The display unit 104 is, for example, a display and can display various information. The display unit 104 may be configured as a touch panel that realizes input by touch operation and display of various information in cooperation with the operation unit 101 described above.

[About the imaging unit 105]
The image pickup unit 105 is an image pickup unit having an optical system such as a lens and an image pickup element such as a CCD (Charge Coupled Device) image sensor and a CMOS (Complementary Metal Oxide Semiconductor) sensor. The image capturing unit 105 captures an image of the outside of the vehicle 10.

[About communication unit 106]
The communication unit 106 is, for example, a communication interface and is realized by a communication module or the like that supports a predetermined communication standard. Examples of wireless communication standards supported by the communication unit 106 include 2G, 3G, 4G, 5G, and other cellular phone communication standards and short-range wireless communication standards.

The cellular phone communication standards include, for example, LTE (Long Term Evolution), W-CDMA (registered trademark) (Wideband code Division Multiple Access), CDMA2000, PDC (Personal Digital Cellular), and GSM (registered trademark) (Global System For). Mobile communications), PHS (Personal Handy-phone System), etc. are included. The short-range wireless communication standards include WiMAX (registered trademark) (Worldwide interoperability for Microwave Access), IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (registered trademark) (Near Field Communication), It may include a WPAN (Wireless Personal Area Network) or the like.

The communication unit 106 is connected to a communication network by wire or wirelessly, and transmits/receives information to/from another device such as the server 20 via the communication network. The communication unit 106 can receive the car wash preferential information distributed from the server 20. The communication network connected to the communication unit 106 includes a LAN (Local Area Network), a WAN (Wide Area Network), a telephone network (a mobile telephone network, a fixed telephone network, etc.), a regional IP (Internet Protocol) network, the Internet, and the like.

[About position acquisition unit 107]
The position acquisition unit 107 is, for example, a GPS receiver including an antenna for receiving a signal used in a satellite positioning system such as GPS (Global Positioning System) from a satellite, and a radio wave in a predetermined frequency band from the GPS satellite. Can receive signals. The position acquisition unit 107 demodulates the received radio wave signal and sends the processed signal to the control unit 109. The terminal device 100 has a positioning function of specifying the current position of the terminal device 100 at a predetermined time interval using the processed signal acquired from the position acquisition unit 107.

[About storage unit 108]
The storage unit 108 is realized by a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or any non-transitory storage device such as a hard disk or an optical disk. The storage unit 108 stores image information 108a, preferential treatment information DB (Data Base) 108b, weather forecast information 108c, and address conversion DB (Data Base) 108d.

[Image information 108a]
The image information 108a includes image information in front of the vehicle 10 captured by the image capturing unit 105. The image information 108a is recorded by the control unit 109. The image information 108a may include image information of the interior of the vehicle 10 captured by the image capturing unit 105.

[About preferential information DB 108b]
The preferential treatment information DB 108b includes car wash special treatment information distributed from the server 20A. FIG. 4 is a diagram showing a configuration example of the preferential treatment information DB 108b according to the embodiment. As shown in FIG. 4, the preferential treatment information DB 108b is configured such that the contents of the preferential treatment information regarding car washing and the store address are associated with each other for each store.

[About weather forecast information 108c]
The weather forecast information 108c stores the weather forecast information distributed from the server 20B. The weather forecast information 108c may include information about the arrival of pollen, yellow sand, dust, and the like, in addition to the probability of precipitation.

[About the address conversion DB 108d]
The address conversion DB 108d is composed of reference information for converting the position information of the vehicle 10 calculated based on the position acquisition unit 107 into address information. FIG. 5 is a diagram showing a configuration example of the address conversion DB 108d according to the embodiment. As shown in FIG. 5, the address conversion DB 108d is configured by associating latitude information, longitude information, address information, and remark information with each other.

[Regarding the control unit 109]
The control unit 109 is a controller, and is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like that stores various programs (an example of a calculation program) stored in a storage device inside the terminal device 100. (Corresponding) is executed by using the RAM as a work area. The control unit 130 is, for example, a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 109 has an acquisition unit 109a, an estimation unit 109b, and a notification unit 109c.

[Regarding the acquisition unit 109a]
The acquisition unit 109a acquires an image outside the vehicle 10, which is an image generated by the imaging unit 105 mounted on the vehicle 10.

[About the estimation unit 109b]
The estimation unit 109b estimates the usability, which is the degree to which the vehicle 10 has been used, based on the image acquired by the acquisition unit 109a. For example, the estimation unit 109b can estimate whether or not the vehicle 10 is in a state suitable for car wash based on the image acquired by the acquisition unit 109a, that is, the image outside the vehicle 10 captured by the imaging unit 105. 6 and 7 are diagrams illustrating an example of an estimation process performed by the estimation unit 109b according to the embodiment.

As shown in FIG. 6, the estimation unit 109b can estimate whether or not the vehicle 10 is in a state suitable for car wash based on the comparison result between the images acquired by the acquisition unit 109a. For example, the estimation unit 109b can estimate whether or not the vehicle 10 is in a state suitable for car wash based on the comparison result between the images of the windshield 10G captured by the image capturing unit 105. That is, the estimation unit 109b sets a reference image from the windshield 10G captured by the image capturing unit 105, and calculates the difference between the set reference image and the image of the windshield 10G recorded after the reference image. ..

For example, assuming that images gr1, image gr2, and image gr3 are sequentially recorded as images of the windshield 10G, the first recorded image gr1 is set as the reference image. Then, the estimation unit 109b calculates the difference d1 between the image gr1 set as the reference image and the image gr2 at the timing when the image gr2 is recorded. The estimation unit 109b indirectly determines the degree of dirt of the exterior of the vehicle 10 from the state of the windshield 10G based on the calculated difference d1 and estimates whether the vehicle 10 is in a state suitable for car washing.

For example, of the area A1 and the area A2 included in the image of the windshield 10G, dust or dust adheres to the area A1 to which the wiper does not reach, until the windshield 10G is washed away by car washing, rain, or the like. , It is expected to accumulate. Therefore, it can be estimated that the exterior of the vehicle 10 becomes more dirty as the difference d1 increases. If the difference d1 exceeds the threshold, the estimation unit 109b can estimate that the vehicle 10 is in a state suitable for car washing. For example, the threshold value can be set based on a certain ratio of the area of the entire image of the windshield 10G.

The estimation unit 109b can repeatedly execute the process of estimating whether the vehicle 10 is in a suitable state for car washing at the timing when the image is recorded until it is determined that the vehicle is suitable for car washing. For example, when the image gr3 is recorded, the estimation unit 109b can estimate whether or not the vehicle 10 is suitable for car washing by calculating the difference d2 between the image gr1 and the image gr3 set as the reference image. The estimation unit 109b outputs the estimation result to the notification unit 109c.

Further, as shown in FIG. 7, the estimation unit 109b can estimate whether or not the vehicle 10 is in a state suitable for car washing, based on the distribution of the brightness value of the image acquired by the acquisition unit 109a. For example, the estimation unit 109b can estimate whether or not the vehicle 10 is in a state suitable for car washing based on the distribution of the brightness values of the image on the windshield 10G. That is, when the image gr1 is recorded as the image of the windshield 10G, the estimation unit 109b converts the image gr1 into gray scale and calculates a luminance value histogram B1 of 256 gradations, for example, to thereby measure the windshield 10G. The degree of dirt on the exterior of the vehicle 10 is indirectly determined from the state to estimate whether the vehicle 10 is in a state suitable for car washing.

For example, of the area A1 and the area A2 included in the image of the windshield 10G, the area A1 where the wiper does not reach is covered with dust or dust until the windshield G1 is washed away by car washing, rain, or the like. , It is expected to accumulate. Therefore, it is estimated that the dirtier the windshield 10G is, the smaller the brightness value of the pixel corresponding to the region A1 where the wiper does not reach in the brightness value histogram becomes. The estimation unit 109b can estimate that the exterior of the vehicle 10 is more soiled as the luminance value of the pixel corresponding to the area A1 that the wiper does not reach becomes smaller. When the number of pixels having a brightness value below a preset threshold exceeds a certain number in the brightness value histogram, the estimation unit 109b can estimate that the vehicle 10 is in a state suitable for car washing.

In addition, the brightness value distribution is such that as the windshield 10G becomes dirty, the brightness value of the pixel corresponding to the area A1 where the wiper does not reach and the brightness value of the pixel corresponding to the area A2 where the wiper reaches the peak have respective peaks. Is expected to be drawn. Therefore, when the estimation unit 109b can determine that the preset reference pattern and the distribution pattern of the luminance values of the pixels calculated from the image of the windshield 10G are similar to each other with a certain accuracy, the vehicle 10 is washed. It can also be presumed to be in a suitable state.

The estimation unit 109b can repeatedly execute the process of estimating whether the vehicle 10 is in a suitable state for car washing at the timing when the image is recorded until it is determined that the vehicle is suitable for car washing. For example, when image gr2 is recorded as an image of windshield G1, estimation unit 109b can calculate luminance value distribution B2 of image gr2. For example, when image gr3 is recorded as an image of windshield G1, image gr3 of image gr3 is recorded. The distribution B3 of brightness values can be calculated. The estimation unit 109b outputs the estimation result to the notification unit 109c.

The estimation processing executed by the estimation unit 109b includes, in addition to the above-described processing, processing by pattern matching, SVM (Support Vector Machine) and other machine learning, and DNN (Deep Neural Network), RNN (Recurrent Neural Network), and CNN. (Convolutional Neural Network) or other known techniques such as processing by a recognition model acquired by deep learning may be used.

[Notification unit 109c]
The notification unit 109c notifies the user of the vehicle 10 of the car wash preferential information regarding the car wash provided by the store whose car wash is a part of the business based on the estimation result by the estimation unit 109b. For example, when the estimation result by the estimation unit 109b indicates that the estimation unit 109b is in a state suitable for car washing, the notification unit 109c acquires the car wash preferential treatment information from the preferential treatment information DB 108b stored in the storage unit 108, and acquires the obtained car washing special treatment. The user of the vehicle 10 is notified by outputting the state to the display unit 104.

The notification unit 109c can also determine whether or not to notify the car wash preferential information, based on the weather forecast information 108c. When the estimation result by the estimation unit 109b indicates that the estimation unit 109b is in a state suitable for car washing, the notification unit 109c, based on the weather forecast information 108c, on the condition that it is a forecast that sunny weather continues for a predetermined period, You can decide to notify the car wash benefit information. That is, even if the car is washed, it is intended to consider that the effect of the car wash is immediately lost due to rainfall or the like.

The notification unit 109c can set the predetermined period based on, for example, the number of effective days of general car wash when the weather has not changed.

The notification unit 109c does not have to be particularly limited to an example in which it is a forecast that the sunny weather continues for a predetermined period of time. For example, focusing on the precipitation probability, the precipitation probability is equal to or less than the predetermined probability for a predetermined period. It may be decided to notify the car wash preferential information on the condition that

When the notification unit 109c determines not to notify the car wash preferential treatment information based on the weather forecast information 108c, the notification unit 109c can also notify the proposal regarding the car wash. For example, the notification unit 109c can notify that it is not suitable for a car wash today because it is forecast that the weather will collapse, or that it is better to wash the car after the day after tomorrow because the sunny weather continues after the day after tomorrow. The notification unit 109c can execute the proposal by voice and image.

Based on the address corresponding to the current position of the vehicle 10 and the address of the store providing the car wash preferential information, the notification unit 109c notifies the user of the vehicle 10 from the car wash preferential information recorded in the preferential information DB 108b. You can also select car wash benefit information to notify. For example, the notification unit 109c calculates the current position of the vehicle 10 based on the position information acquired by the position acquisition unit 107 when the estimation result by the estimation unit 109b indicates that the result is suitable for car washing. Subsequently, the notification unit 109c refers to the address conversion DB 108d and converts the current position of the vehicle 10 into an address. Then, the notification unit 109c selects the car wash benefit information provided by the store near the address of the current position of the vehicle 10 from the car wash benefit information recorded in the benefit information DB 108b. For example, the notification unit 109c can select, from the address of the current position of the vehicle 10, car wash preferential information of a store having an address within a preset range. The preset range is arbitrarily set based on the moving time from the current position such as within 5 minutes by moving the vehicle 10 or the moving distance from the current position such as within 3 km from the current position of the vehicle 10. it can.

The notification unit 109c determines to provide the car wash preferential information based on the weather forecast information 108c, and then determines the vehicle based on the address corresponding to the current position of the vehicle 10 and the address of the store that provides the car wash preferential information. It is also possible to select the car wash preferential information to be notified to the 10 users. For example, when the notification unit 109c determines to notify the car wash preferential information based on the weather forecast information 108c, the notification unit 109c calculates the current position of the vehicle 10 based on the position information acquired by the position acquisition unit 107. Subsequently, the notification unit 109c refers to the address conversion DB 108d and converts the current position of the vehicle 10 into an address. Then, the notification unit 109c selects the car wash benefit information provided by the store near the address of the current position of the vehicle 10 from the car wash benefit information recorded in the benefit information DB 108b. For example, the notification unit 109c can select, from the address of the current position of the vehicle 10, car wash preferential information of a store having an address within a preset range. The preset range is arbitrarily set based on the moving time from the current position such as within 5 minutes by moving the vehicle 10 or the moving distance from the current position such as within 3 km from the current position of the vehicle 10. it can.

When the notification by the notification unit 109c is performed by voice, it may be performed by voice synthesis processing. For example, the notification unit 109c generates character information corresponding to the car wash proposal according to the determination result of whether or not to notify the car wash preferential information, and converts the generated character information into a voice signal, thereby proposing the car wash. It is possible to realize a voice notification corresponding to.

[4. Processing procedure]
An example of a procedure of processing by the terminal device according to the embodiment will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of a processing procedure executed by the terminal device according to the embodiment. The process illustrated in FIG. 8 may be repeatedly executed at a predetermined timing while the terminal device 100 is starting up.

As shown in FIG. 8, the control unit 109 acquires image information captured by the image capturing unit 105 (step S101). The control unit 109 determines whether the vehicle 10 is in a state suitable for car washing based on the image information captured by the image capturing unit 105, that is, the image in front of the vehicle 10 (image of the windshield G1) (step S102). ).

As a result of the determination, when the vehicle 10 is in a state suitable for car washing (Yes in step S102), the control unit 109 notifies the user of the vehicle 10 of the car wash preferential information (step S103), and executes the process shown in FIG. finish.

As a result of the determination, the control unit 109 ends the process illustrated in FIG. 8 when the vehicle 10 is not in a state suitable for car washing (step S102, No).

Another example of the processing procedure by the terminal device 100 according to the embodiment will be described with reference to FIG. 9. FIG. 9 is a flowchart showing another example of the processing procedure executed by the terminal device 100 according to the embodiment. The processing procedure shown in FIG. 9 differs from the processing procedure shown in FIG. 8 in that the processing procedure using weather forecast information is included.

As shown in FIG. 9, the control unit 109 acquires image information captured by the image capturing unit 105 (step S201). The control unit 109 determines whether the vehicle 10 is in a state suitable for car washing based on the image information captured by the image capturing unit 105, that is, the image in front of the vehicle 10 (image of the windshield G1) (step S202). ).

As a result of the determination, the control unit 109 acquires the weather forecast information from the weather forecast information 108c (step S203) when the vehicle 10 is in a state suitable for car washing (step S202, Yes).

The control unit 109 determines whether or not the sunny weather continues for a predetermined period based on the weather forecast information (step S204).

As a result of the determination, if the sunny weather continues for a predetermined period (Yes in step S204), the control unit 109 notifies the user of the vehicle 10 of the car wash benefit information (step S205), and ends the process illustrated in FIG.

On the other hand, as a result of the determination, the control unit 109 notifies the user of the vehicle 10 of the proposal regarding the car wash (step S206) when the sunny weather does not continue for the predetermined period (step S204, No), and the process shown in FIG. 9 is performed. finish.

In the above-mentioned step S202, control part 109 ends the processing shown in Drawing 9, when vehicles 10 are not in a state suitable for car washing as a result of a judgment (Step S202, No).

Another example of the processing procedure by the terminal device 100 according to the embodiment will be described with reference to FIG. 10. FIG. 10 is a flowchart showing another example of the processing procedure executed by the terminal device 100 according to the embodiment. The processing procedure shown in FIG. 10 is different from the processing procedure shown in FIG. 8 in that the processing procedure using the position information is included.

As shown in FIG. 10, the control unit 109 acquires image information captured by the image capturing unit 105 (step S301). The control unit 109 determines whether the vehicle 10 is in a state suitable for car washing based on the image information captured by the image capturing unit 105, that is, the image in front of the vehicle 10 (image of the windshield G1) (step S302). ).

As a result of the determination, the control unit 109 acquires the position information from the position acquisition unit 107 when the vehicle 10 is in a state suitable for car washing (Yes in step S302) (step S303).

The control unit 109 identifies the address corresponding to the current position of the vehicle 10 based on the position information (step S304).

The control unit 109 selects the car wash preferential information from the preferential treatment information DB 108b based on the address based on the current position of the vehicle 10 and the address of the store that provides the car wash preferential information (step 305).

The control unit 109 notifies the user of the vehicle 10 of the selected car wash benefit information (step S306), and ends the process shown in FIG.

In the above-mentioned step S302, control part 109 ends the processing shown in Drawing 10, when vehicles 10 are not in a state suitable for car washing as a result of a judgment (Step S302, No).

Another example of the processing procedure by the terminal device 100 according to the embodiment will be described with reference to FIG. 11. FIG. 11 is a flowchart showing another example of the processing procedure executed by the terminal device 100 according to the embodiment. The processing procedure shown in FIG. 11 differs from the processing procedure shown in FIG. 9 in that it includes a processing procedure using position information in addition to a processing procedure using weather forecast information.

As shown in FIG. 11, the control unit 109 acquires image information captured by the image capturing unit 105 (step S401). The control unit 109 determines whether the vehicle 10 is in a state suitable for car washing based on the image information captured by the image capturing unit 105, that is, the image in front of the vehicle 10 (image of the windshield G1) (step S402). ).

As a result of the determination, the control unit 109 acquires the weather forecast information from the weather forecast information 108c when the vehicle 10 is in a state suitable for car washing (Yes in step S402) (step S403).

The control unit 109 determines whether or not the sunny weather continues for a predetermined period based on the weather forecast information (step S404).

As a result of the determination, the control unit 109 acquires the position information from the position acquisition unit 107 when the sunny weather continues for a predetermined period (step S404, Yes) (step S405).

The control unit 109 identifies the address corresponding to the current position of the vehicle 10 based on the position information (step S406).

The control unit 109 selects car wash preferential information from the preferential car information DB 108b based on the address based on the current position of the vehicle 10 and the address of the store that provides the car wash preferential information (step 407).

The control unit 109 notifies the user of the vehicle 10 of the car wash benefit information (step S408), and ends the process shown in FIG.

In the above step S404, the control unit 109 notifies the user of the vehicle 10 of the proposal regarding the car wash (step S409) when the result of the determination is that the sunny weather does not continue for a predetermined period (step S404, No), and the result is shown in FIG. The processing shown is ended.

In the above-mentioned step S402, control part 109 ends the processing shown in Drawing 11, when vehicles 10 are not in a state suitable for car washing as a result of a judgment (Step S402, No).

[5. Modification]
The terminal device 100 described above may be implemented in various different forms other than the above-described embodiments. Hereinafter, another embodiment of the terminal device 100 will be described.

In the above-described embodiment, the terminal device 100 estimates whether the interior of the vehicle 10 requires cleaning from an image obtained by capturing the interior of the vehicle 10, and can clean the interior of the vehicle based on the estimation result. You may notify the car wash preferential information provided by the store. The configuration of the terminal device 100 differs from the above-described embodiment in the points described below.

The image capturing unit 105 captures an image of the outside of the vehicle 10 as well as an image of the inside of the vehicle 10. The imaging unit 105 has a switching function for switching the shooting direction outside the vehicle 10 or inside the vehicle 10.

FIG. 12 is a diagram showing a configuration example of the preferential treatment information DB 108b according to another embodiment. The preferential treatment information DB 108b is configured for each store by associating the contents of the car wash preferential treatment information regarding car washing, the information indicating whether or not interior cleaning is being performed together with the car washing, and the store address.

The acquisition unit 109a acquires an image of the interior of the vehicle 10 captured by the image capturing unit 105.

The estimating unit 109b can respectively perform a process of estimating whether the vehicle 10 is in a state suitable for car washing, and a process of estimating whether the vehicle 10 requires indoor cleaning. The estimation unit 109b sets the reference image from the images of the interior of the vehicle 10 captured by the image capturing unit 105, and calculates the difference between the set reference image and the other images, so that the interior of the vehicle 10 is cleaned. Can be estimated.

If the estimation unit 109b estimates that the vehicle 10 is in a state suitable for car washing and that the vehicle needs indoor cleaning, the notification unit 109c provides the car wash benefit information provided by the store that is performing the indoor cleaning. Is selected from the preferential treatment information DB 108b to notify the user of the vehicle 10. If it is estimated that the estimation result by the estimation unit 109b is in a state suitable for car washing but does not require indoor cleaning, the notification unit 109c has no relation to whether the store is performing indoor cleaning. Instead, the user of the vehicle 10 is notified of the car wash benefit information.

An example of a processing procedure by the terminal device 100 according to another embodiment will be described with reference to FIG. 13. FIG. 13 is a flowchart showing an example of a processing procedure executed by the terminal device 100 according to another embodiment. The processing procedure shown in FIG. 13 differs from the above-described processing procedure shown in FIG. 8 in that it includes a procedure for determining whether or not the room needs to be cleaned.

As shown in FIG. 13, the control unit 109 acquires image information captured by the image capturing unit 105 (step S501). The control unit 109 determines whether or not the vehicle 10 is in a state suitable for car wash based on the image information acquired in step S501, that is, the image outside the vehicle 10 (for example, the image of the windshield 10G) (step S502). ).

As a result of the determination, when the vehicle 10 is in a state suitable for car washing (Yes in step S502), the control unit 109 determines the interior of the vehicle 10 based on the image information acquired in step S501, that is, the image of the interior of the vehicle 10. It is estimated whether or not is a state requiring cleaning (step S503).

As a result of the determination, when the interior of the vehicle 10 needs to be cleaned (Yes in step S503), the control unit 109 selects from the preferential treatment information DB 108b the car wash preferential information provided by the store that is performing the interior cleaning. The user of the vehicle 10 is notified (step S504), and the process shown in FIG. 13 is terminated.

As a result of the determination, when the interior of the vehicle 10 is not in a state requiring cleaning (No in step S503), the control unit 109 prompts the user of the vehicle 10 regardless of whether the store is performing indoor cleaning. The car wash benefit information is notified (step S505), and the process shown in FIG. 13 ends.

In the above step S502, if the result of determination is that the vehicle 10 is not in a state suitable for car washing (No in step S502), the control unit 109 ends the processing shown in FIG.

In the example shown in FIG. 13, the terminal device 100 may execute a processing procedure for deciding whether or not to notify the car wash preferential treatment information based on the weather forecast information, similarly to the processing procedure shown in FIG. 9.

In the example illustrated in FIG. 13, the terminal device 100, based on the address based on the current position of the vehicle 10 and the address of the store that provides the car wash preferential information, stores the preferential treatment information DB 108b in the same manner as the processing procedure illustrated in FIG. A processing procedure for selecting car wash benefit information may be executed.

In the example shown in FIG. 13, the terminal device 100, similar to the processing procedure shown in FIG. 11, determines the processing procedure for deciding whether or not to notify the car wash preferential treatment information based on the weather forecast information, and the current position of the vehicle 10. The processing procedure for selecting the car wash preferential information from the preferential treatment information DB 108b may be executed based on the address based on the above and the address of the store that provides the car wash preferential information.

[6. Hardware configuration]
The terminal device 100 according to the above-described embodiment and modification is realized by, for example, a computer 1000 configured as shown in FIG. Hereinafter, the terminal device 100 will be described as an example.

FIG. 14 is a hardware configuration diagram illustrating an example of a computer 1000 that realizes the functions of the terminal device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I/F) 1500, an input/output interface (I/F) 1600, and a media interface (I/F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each unit. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, a program dependent on the hardware of the computer 1000, and the like.

The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. The communication interface 1500 receives data from another device via the network N, sends the data to the CPU 1100, and transmits the data generated by the CPU 1100 to the other device via the network N.

The CPU 1100 controls output devices such as a display and a printer and input devices such as a keyboard and a mouse via the input/output interface 1600. The CPU 1100 acquires data from the input device via the input/output interface 1600. The CPU 1100 also outputs the data generated via the input/output interface 1600 to the output device.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) and a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Etc.

For example, when the computer 1000 functions as the terminal device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes the program loaded on the RAM 1200 to execute the estimation unit 109b and the notification unit 109c included in the control unit 109. Realize the function. Further, the HDD 1400 stores the same data as the information stored in the storage unit 108. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via the network N.

The computer 1000 may execute processing by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) instead of the CPU 1100.

[Other]
In the above-described embodiment and modification, the processing of the estimation unit 109b and the notification unit 109c of the terminal device 100 may be executed by an information processing apparatus such as a server having the same processing function as the estimation unit 109b and the notification unit 109c. .. In this case, the terminal device 100 can be used by uploading the image captured by the image capturing unit 105 to the information processing device and downloading the processing result from the information processing device.

In the above-described embodiment and modification, when notifying the car wash preferential information, the terminal device 100 selects the car wash preferential information that provides a large benefit to the user of the vehicle 10 when the content of the preferential information is the same. Then, it may be controlled to notify.

In addition, in the above-described embodiment, the terminal device 100 includes the preferential treatment information DB 108b, and the example of notifying the driver of the vehicle 10 of the car wash preferential information stored in the preferential treatment information DB 108b has been described. It need not be limited. For example, when notifying the car wash benefit information, the notification unit 109c may acquire the car wash benefit information from the server 20A that distributes the car wash benefit information via the communication unit 106, and notify the acquired car wash benefit information.

Further, in the above-described embodiments and modified examples, the position acquisition unit 107 may include a receiver capable of receiving signals from positioning artificial satellites other than GPS satellites, and may perform arithmetic processing of the current position. The terminal device 100 may include receivers for a plurality of types of positioning satellites. Examples of positioning satellites other than GPS satellites include GLONASS (Global Navigation Satellite System) artificial satellites, IRNSS (Indian Regional Navigational Satellite System) artificial satellites, COMPASS artificial satellites, and GALILEO artificial satellites.

The above-described embodiments and modified examples can be appropriately combined within a range in which the processing contents do not contradict each other.

[7. effect]
As described above, the terminal device 100 (an example of an estimation device) according to the embodiment includes the acquisition unit 109a and the estimation unit 109b. The acquisition unit 109a acquires an image outside the vehicle 10, which is an image generated by the imaging unit 105 mounted on the vehicle 10 (an example of a “moving body”). The estimation unit 109b estimates the feeling of use, which is the degree to which the vehicle 19 has been used, based on the image acquired by the acquisition unit 109a. Therefore, the terminal device 100 according to the embodiment can efficiently provide, for example, information regarding a discount on the car wash service based on the feeling of use, which is the degree to which the vehicle 10 has been used, and improve the discount providing method for the car wash service.

Further, the estimation unit 109b estimates whether the state of the vehicle 10 is suitable for car wash based on the image acquired by the acquisition unit 109a. Therefore, the terminal device 100 according to the embodiment can notify the driver of the vehicle 10 of the information regarding the discount of the car wash service when it is estimated that the vehicle 10 is in the state suitable for the car wash, and thus the discount of the car wash service is provided. You can improve the way.

Further, the terminal device 100 according to the embodiment, based on the estimation result by the estimation unit 109b, provides the driver of the vehicle 10 with the car wash preferential information regarding the car wash provided by the store whose car wash is a part of the business. A notification unit 109c for notifying a user” is included. Therefore, the terminal device 100 according to the embodiment can provide the driver of the vehicle 10 with the car wash preferential information when the vehicle 10 is estimated to be in a state suitable for the car wash.

In addition, the estimation unit 109b estimates whether the state of the vehicle 10 is suitable for car wash based on the comparison result between the images acquired by the acquisition unit 109a. Therefore, the terminal device 100 according to the embodiment can estimate whether the state of the vehicle 10 is suitable for car washing with a simple process.

Further, the estimation unit 109b estimates whether or not the state of the vehicle 10 is suitable for car wash based on the distribution of the brightness values of the image acquired by the acquisition unit 109a. Therefore, the terminal device 100 according to the embodiment can estimate whether the state of the vehicle 10 is suitable for car washing with a simple process.

Further, the notification unit 109c determines whether or not to notify the car wash preferential information, based on the weather forecast information 108c. Therefore, the terminal device 100 according to the embodiment provides the driver of the vehicle 10 with the car wash preferential information at an appropriate timing such that the effect of the car wash can be long-lasting, for example, when the weather is stable and the weather is stable. Can be provided to.

If the notification unit 109c determines not to notify the car wash preferential information based on the weather forecast information 108c, the notification unit 109c notifies the proposal related to the car wash. For this reason, the terminal device 100 according to the embodiment provides the driver of the vehicle 10 with useful suggestions in car washing, such as timing unsuitable for car washing, such as when weather is expected to collapse soon. it can.

In addition, the terminal device 100 according to the embodiment further includes a position acquisition unit 107 that acquires position information of the vehicle 10. The notification unit 109c identifies the address corresponding to the current position of the vehicle 10 based on the position information acquired by the position acquisition unit 107, and provides the address corresponding to the current position of the vehicle 10 and the car wash preferential information store. The car wash benefit information is selected based on the address. Therefore, the terminal device 100 according to the embodiment can provide the car wash preferential information that is easier for the driver of the vehicle 10 to use.

The acquisition unit 109a further acquires an image of the interior of the vehicle 10 captured by the imaging unit 105. The estimation unit 109b further estimates whether or not the interior of the vehicle 10 requires cleaning, based on the image of the interior of the vehicle 10 acquired by the acquisition unit 109a. When the estimation unit 109b estimates that the vehicle 10 is suitable for car washing and that the interior of the vehicle 10 needs to be cleaned, the notification unit 109c stores the vehicle 10 indoors. Notify the car wash benefit information provided by. Therefore, the terminal device 100 according to the embodiment can provide the driver of the vehicle 10 with the car wash benefit information that is more satisfying.

10 vehicle 100 terminal device 101 operation unit 102 voice acquisition unit 103 output unit 104 display unit 105 imaging unit 106 communication unit 107 position acquisition unit 108 storage unit 109 control unit 109a acquisition unit 109b estimation unit 109c notification unit

Claims (10)

An image generated by the image pickup unit mounted on the moving body, the obtaining unit obtaining an image outside the moving body,
Based on the image acquired by the acquisition unit, an estimation unit that estimates a feeling of use that is the degree to which the moving body has been used,
Based on the estimation result by the estimation unit, a notification unit for notifying the user of the mobile body of car wash preferential information related to the car wash provided by the store whose car washing of the mobile body is part of the business,
Equipped with
The notification unit,
Based on the weather forecast information, when it is a forecast that the sunny weather continues for a predetermined period, or when the precipitation probability is less than or equal to a predetermined probability for a predetermined period, it is determined to notify the car wash preferential information. Estimator. The estimation unit is
The estimation device according to claim 1, wherein the estimation unit estimates whether the state of the moving body is suitable for car washing, based on the image acquired by the acquisition unit. The estimation unit is
The estimation device according to claim 2, wherein whether the state of the moving body is suitable for car washing is estimated based on a comparison result between the images acquired by the acquisition unit. The estimation unit is
The estimation device according to claim 2, wherein the estimation unit estimates whether the state of the moving body is suitable for car washing based on the distribution of the brightness values of the image acquired by the acquisition unit. The notification unit,
The weather forecast on the basis of the information, when it is determined not to notify the car wash special offers, estimating apparatus according to claim 1, wherein the notifying proposals for car wash. Further comprising a position acquisition unit for acquiring the position information of the moving body,
The notification unit,
Based on the position information acquired by the position acquisition unit, identify the address corresponding to the current position of the moving body,
Wherein the address corresponding to the current position of the moving body, the based on the store address providing the car wash special offers, estimating apparatus according to claim 1, characterized in that selecting the car wash special offers. An image generated by the image pickup unit mounted on the moving body, the obtaining unit obtaining an image outside the moving body,
Based on the image acquired by the acquisition unit, an estimation unit that estimates a feeling of use that is the degree to which the moving body has been used,
Based on the estimation result by the estimation unit, a notification unit for notifying the user of the mobile body of car wash preferential information related to the car wash provided by the store whose car washing of the mobile body is part of the business,
Equipped with
The acquisition unit is
Further acquiring an indoor image of the moving body captured by the image capturing unit,
The estimation unit is
Based on the image of the room of the moving body acquired by the acquisition unit, further estimating whether or not the room of the moving body requires cleaning,
The notification unit,
When the estimation unit estimates that the moving body is in a state suitable for car washing and that the interior of the moving body needs to be cleaned, the store that is performing the indoor cleaning of the moving body is determined by the store. estimation device you and notifies the car wash special offers to be provided. Further equipped with a communication unit,
The notification unit via the communication unit, wherein acquiring the car wash special offers from the information distribution apparatus for distributing wash special offers, according to claim 1, wherein the notifying the acquired the wash preferential information Estimation device. An estimation method performed by the estimation device,
An image generated by an imaging unit mounted on the moving body, the step of acquiring an image outside the moving body;
Based on an image of the outside of the moving body, a step of estimating whether the state of the moving body is suitable for car washing ,
Based on the estimation result by the estimating step, a step of notifying the user of the mobile body of car wash preferential information regarding the car wash provided by the store whose car wash of the mobile body is part of the business;
Only including,
The step of notifying includes
Based on the weather forecast information, if it is a forecast that the sunny weather continues for a predetermined period, or if the precipitation probability is less than a predetermined probability for a predetermined period, it is determined to notify the car wash preferential information. How to estimate. On the computer,
An image generated by an imaging unit mounted on the moving body, the step of acquiring an image outside the moving body;
Based on an image of the outside of the moving body, a step of estimating whether the state of the moving body is suitable for car washing ,
Based on the estimation result by the estimating step, a step of notifying the user of the mobile body of car wash preferential information regarding the car wash provided by the store whose car wash of the mobile body is part of the business;
Was executed,
The step of notifying includes
Based on the weather forecast information, if it is a forecast that the sunny weather continues for a predetermined period, or if the precipitation probability is less than a predetermined probability for a predetermined period, it is determined to notify the car wash preferential information. Estimate program to do.

Images