JP7820163B2 - Information providing device, information providing system, and information providing method - Google Patents

Description

The present invention relates to an information provision device, an information provision system, and an information provision method.

Traditionally, when conducting accident prevention training within a company, there is technology that uses driving footage from drive recorders installed in company vehicles as educational materials for drivers or sends drivers warnings.

Japanese Patent Application Publication No. 09-081632

However, when providing information to drivers through notifications, repeated mechanical notifications can be annoying and increase the sense of being forced to do something, making it difficult for drivers to accept the information provided through notifications.

The present invention has been made in consideration of the above, and aims to provide an information provision device, information provision system, and information provision method that make it easier for drivers to accept information.

In order to solve the above-mentioned problems and achieve the objectives, the information providing device of the present invention includes a control unit. The control unit provides driving-related information to the driver. The control unit changes the manner in which the information is provided depending on the reliability between the dialogue device and the driver, which is estimated based on the dialogue history between the dialogue device and the driver.

The present invention makes it easier for drivers to accept information.

FIG. 1 is a diagram showing an overview of an information providing method according to an embodiment. FIG. 2 is a diagram showing an example of the configuration of an information providing system S according to the embodiment. FIG. 3 is a block diagram showing an example of the configuration of the information providing device. FIG. 4 is a block diagram showing an example of the configuration of the in-vehicle device. FIG. 5 is a diagram illustrating an example of the dialogue DB. FIG. 6 is a diagram showing an example of the driving image DB. FIG. 7 is a diagram illustrating an example of the driver DB. FIG. 8 is a diagram showing an example of speech mode information. FIG. 9 is a diagram illustrating an example of information provided by the providing unit via a terminal device. FIG. 10 is a flowchart illustrating a processing procedure of a process executed by the information providing device according to the embodiment.

Embodiments of the information provision device, information provision system, and information provision method disclosed herein will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

First, an overview of the information provision method according to the embodiment will be described using Figure 1. Figure 1 is a diagram showing an overview of the information provision method according to the embodiment. Figure 1 shows an example configuration of an information provision system S.

As shown in FIG. 1, the information provision system S includes an information provision device 1, an in-vehicle device 100, and a terminal device 200. The information provision method according to the embodiment is executed by the information provision device 1.

The information provision system S is a system that provides driving-related information to a driver D via an in-vehicle device 100 or a terminal device 200. In such an information provision system S, the information provision method according to the embodiment changes the manner in which information is provided depending on the reliability that indicates the degree of trust between the dialogue device and the driver D, which is estimated based on the history of dialogue information (dialogue history) between the dialogue device, which is the in-vehicle device 100 or the terminal device 200, and the driver D.

Specifically, in the information provision system S, the information provision device 1 first acquires dialogue information with the driver D from a dialogue device such as the in-vehicle device 100 or the terminal device 200 (step S1). The dialogue information includes, for example, whether or not there has been speech (audio or text) directed to the driver D, and the content of that speech, as well as whether or not there has been speech (audio or text) from the driver D to the dialogue device, and the content of that speech.

Then, the information providing device 1 according to the embodiment stores the acquired dialogue information in a dialogue database (DB) (step S2). The dialogue database stores dialogue information for each driver D.

Next, the information providing device 1 according to the embodiment estimates a reliability indicating the degree of trust between the dialogue device and driver D based on the dialogue history (step S3). Specifically, the information providing device 1 estimates the reliability based on the dialogue DB, which is the dialogue history, including the number of dialogues between the dialogue device and driver D, the driving time of driver D, and the driver D's reaction to utterances from the dialogue device. Note that the reliability can be estimated using, for example, a model generated by machine learning, as will be described in detail below.

Next, the information providing device 1 according to the embodiment changes the manner in which information is provided to the driver D depending on the estimated reliability (step S4). For example, when the reliability is equal to or greater than a threshold, the information providing device 1 changes the way the dialogue device speaks to the driver D to a more intimate manner (a more frank manner of speaking). In addition to the way the dialogue device speaks, the information providing device 1 also changes the content of the information it provides, for example; details of this point will be described later.

In this way, the information provision method according to the embodiment changes the manner in which information is provided depending on the degree of trust between the dialogue device and driver D, making it easier for driver D to accept the information.

Next, an example configuration of the information provision system S according to the embodiment will be described. FIG. 2 is a diagram showing an example configuration of the information provision system S according to the embodiment. As shown in FIG. 2, the information provision system S according to the embodiment is configured by connecting an information provision device 1, an in-vehicle device 100, and a terminal device 200 via a communication network N.

The information providing device 1 is, for example, a cloud server. By executing the information providing method, the information providing device 1 acquires dialogue information and provides driving-related information to the driver D via a dialogue device such as the in-vehicle device 100 or the terminal device 200.

The in-vehicle device 100 is an electronic device installed in a vehicle. The in-vehicle device 100 is configured as, for example, a drive recorder or a navigation device.

The terminal device 200 is a terminal device carried by the driver D. The terminal device 200 is, for example, a mobile terminal such as a smartphone.

Next, the configurations of the information providing device 1 and the in-vehicle device 100 will be described in detail with reference to Figures 3 and 4. Figure 3 is a block diagram showing an example configuration of the information providing device 1. Figure 4 is a block diagram showing an example configuration of the in-vehicle device 100. Note that in the block diagrams of Figures 3 and 4, only the components necessary to explain the features of this embodiment are shown as functional blocks, and descriptions of general components are omitted.

In other words, the components shown in the block diagrams of Figures 3 and 4 are conceptual functional components and do not necessarily have to be physically configured as shown. For example, the specific form of distribution and integration of each functional block is not limited to that shown, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

First, we will explain the information providing device 1 shown in Figure 3. As shown in Figure 3, the information providing device 1 includes a communication unit 2, a control unit 3, and a memory unit 4.

The communication unit 2 is a communication interface that connects to a communication network for two-way communication, and transmits and receives information between the in-vehicle device 100, the terminal device 200, etc.

The control unit 3 includes an acquisition unit 31, an estimation unit 32, an evaluation unit 33, and a provision unit 34, and includes, for example, a computer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a hard disk drive, input/output ports, etc., and various other circuits.

The computer's CPU functions as the acquisition unit 31, estimation unit 32, evaluation unit 33, and provision unit 34 of the control unit 3, for example, by reading and executing programs stored in the ROM.

Furthermore, at least some or all of the acquisition unit 31, estimation unit 32, evaluation unit 33, and provision unit 34 of the control unit 3 can be configured using hardware such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

The memory unit 4 is configured with a storage device such as a non-volatile memory, data flash, or hard disk drive. The memory unit 4 stores a dialogue DB 41, a driving video DB 42, a driver DB 43, and various programs.

Next, we will explain the in-vehicle device 100 shown in Figure 4. As shown in Figure 4, the in-vehicle device 100 includes a communication unit 110, a control unit 120, and a memory unit 130.

The communication unit 110 is a communication interface that connects to a communication network for two-way communication, and transmits and receives information between the information providing device 1, the terminal device 200, etc.

The control unit 120 includes, for example, a computer with a CPU, ROM, RAM, hard disk drive, input/output ports, etc., and various other circuits.

The computer's CPU functions as the control unit 120, for example, by reading and executing programs stored in ROM.

Furthermore, at least some or all of the functions of the control unit 120 can be configured using hardware such as an ASIC or FPGA.

The storage unit 130 is configured with a storage device such as a non-volatile memory, data flash, or hard disk drive. The storage unit 130 stores speech mode information 131 and various programs.

Figure 5 shows an example of the dialogue DB 41. The dialogue DB 41 is an information database that stores dialogue information acquired from the in-vehicle device 100 and the terminal device 200. As shown in Figure 5, the dialogue DB 41 includes items such as "driver ID," "number of dialogues," "driving time," and "reaction information."

"Driver ID" is identification information that identifies driver D. "Number of interactions" is the number of interactions, specifically including the number of times driver D spoke and the number of times the dialogue device spoke. "Driving time" is the amount of time driver D has been driving, specifically the period during which the vehicle ignition is on. "Reaction information" is information that indicates driver D's reaction status to the dialogue device, and includes, for example, the number of times they responded (replied) to utterances from the dialogue device and the content of the replies.

Figure 6 shows an example of the driving video DB 42. The driving video DB 42 is a database that stores driving video captured by the in-vehicle device 100, which is a drive recorder. As shown in Figure 6, the driving video DB 42 includes items such as "Driver ID" and "Driving video."

"Driver ID" is identification information that identifies driver D. "Driving footage" is driving footage captured by the in-vehicle device 100. Note that "driving footage" may be all driving footage captured by the in-vehicle device 100, or, for example, only driving footage related to dangerous driving such as sudden braking, sudden acceleration, or approaching objects. Note that driving footage related to dangerous driving may be extracted by the in-vehicle device 100 or by the information providing device 1.

Figure 7 is a diagram showing an example of driver DB 43. Driver DB 43 is a database that contains information about driver D. As shown in Figure 7, driver DB 43 includes items such as "driver ID," "attribute information," and "driving score."

"Driver ID" is identification information that identifies driver D. "Attribute information" includes information related to driver D's attributes. "Driving score" is information related to driver D's driving score, and is calculated by the evaluation unit 33, which will be described later.

Figure 8 is a diagram showing an example of speech mode information 131. Speech mode information 131 is information related to the speech specifications of the in-vehicle device 100. As shown in Figure 8, speech mode information 131 includes items such as "specification ID" and "speech mode."

"Specification ID" is identification information that identifies the speech specification (speech mode). "Speech mode" is information related to the speech specification. The "low reliability mode" of the speech mode is the speech mode when the reliability is below the threshold, and the "high reliability mode" is the speech mode when the reliability is above the threshold. Details of the speech modes will be explained later.

Next, we will explain each function (acquisition unit 31, estimation unit 32, evaluation unit 33, and provision unit 34) of the control unit 3 of the information provision device 1.

The acquisition unit 31 acquires various types of information. Specifically, the acquisition unit 31 acquires dialogue information regarding dialogue with driver D from the in-vehicle device 100 and the terminal device 200. The acquisition unit 31 stores the acquired dialogue information for each driver D in the dialogue DB 41 of the storage unit 4.

The acquisition unit 31 also acquires driving footage of the area around the vehicle captured by the drive recorder, which is the in-vehicle device 100, and stores the footage in the driving footage DB 42.

The estimation unit 32 estimates the reliability indicating the degree of trust between the dialogue device and driver D based on the dialogue history between the dialogue device and driver D. For example, the estimation unit 32 estimates the reliability based on at least one of the number of dialogues between the dialogue device and driver D, the driving time of driver D, and the response status of driver D to utterances from the dialogue device.

Specifically, the estimation unit 32 estimates that the reliability is higher the more interactions there are between the dialogue device and driver D, or the longer driver D's driving time. Furthermore, the estimation unit 32 estimates the reliability based on factors such as the number of times an operation to check information such as driving footage provided by the provision unit 34 was performed, and the number of times driver D spoke in response to the dialogue device's utterances (and the content of the utterances), as a response status to the dialogue device's utterances.

In this way, by estimating reliability based on at least one of the number of interactions between the dialogue device and driver D, driver D's driving time, and driver D's response to utterances from the dialogue device, it is possible to estimate reliability with high accuracy.

The estimation unit 32 may also estimate reliability using a model trained with the number of interactions between the dialogue device and driver D, the driving time of driver D, and the driver D's response to utterances from the dialogue device as explanatory variables, and the reliability as the objective variable.

In other words, the reliability estimated by the estimation unit 32 can be said to be an index of the sense of familiarity or distance that driver D feels toward the dialogue device. A high reliability state can also be said to be a state in which driver D is estimated to have a sense of familiarity with the dialogue device. For example, this is a state in which it is estimated that driver D is likely to accept information even if the dialogue device speaks in a frank manner.

On the other hand, a low reliability state can also be described as a state in which it is estimated that driver D feels distant from the dialogue device. For example, it is a state in which it is estimated that driver D is more likely to require information if the dialogue device speaks in a formal manner.

The evaluation unit 33 evaluates the driving technique of driver D. For example, the evaluation unit 33 calculates a driving score indicating driver D's driving technique as the evaluation result. Specifically, the evaluation unit 33 calculates the driving score based on the driving video acquired by the acquisition unit 31 and the behavior of driver D's accelerator, brake, and steering operations.

The providing unit 34 provides information about driving to driver D. For example, the providing unit 34 provides information about the driving score evaluated by the evaluating unit 33. The providing unit 34 also provides footage of dangerous driving extracted from the driving footage. The providing unit 34 also generates and provides educational materials for driver D and comments about the driving based on the driving score and footage of dangerous driving. Note that the providing unit 34 provides information via the in-vehicle device 100 when driver D is in the vehicle, and via the terminal device 200 when driver D is not in the vehicle. Note that whether driver D is in the vehicle or not can be determined, for example, from driver D's location information or whether the vehicle ignition key is on or off.

Furthermore, when providing the various types of information described above, the providing unit 34 changes the manner in which the information is provided depending on the reliability estimated by the estimating unit 32. Specifically, if the reliability is below a predetermined threshold, the providing unit 34 instructs the in-vehicle device 100 to set the speech mode information 131 to a low-reliability mode, and if the reliability is equal to or greater than the predetermined threshold, the providing unit 34 instructs the in-vehicle device 100 to set the speech mode information 131 to a high-reliability mode.

The providing unit 34 then provides the above-mentioned information in the specified speech mode. Specifically, the providing unit 34 changes the speech style between the low reliability mode and the high reliability mode. For example, in the low reliability mode, the providing unit 34 provides information using polite language and honorific language, and in the high reliability mode, the providing unit 34 provides information using frank language (casual language). In other words, the providing unit 34 changes the speech style depending on the reliability.

This prevents Driver D from becoming angry when spoken to in a casual manner despite low trustworthiness, or from feeling distant when spoken to in a polite manner despite high trustworthiness, making it easier for Driver D to accept the information provided.

Furthermore, the providing unit 34 may change the content of the information to be provided depending on the reliability (whether it is low reliability mode or high reliability mode) as a provision mode. For example, the providing unit 34 provides information with positive content when the reliability is below a threshold (low reliability mode), and provides information with negative content when the reliability is above the threshold (high reliability mode). This point will be explained using Figure 9. Note that reliability will be explained in two levels, high and low, for ease of explanation, but it may also be further subdivided into multiple levels, three or more levels, and information may be provided in different ways for each level.

Figure 9 is a diagram showing an example of information provided by the providing unit 34 via the terminal device 200. Figure 9 shows an example of a screen of the terminal device 200 in high reliability mode. Note that Figure 9 shows an example of information provided by a chatbot.

As shown in FIG. 9, when the providing unit 34 is in high reliability mode, it provides information with negative content, such as, "Hello, Mr. XX. The other day when I was driving through the XX intersection, it was very dangerous...I was really scared."

Although not shown, when in low reliability mode, the providing unit 34 does not provide the above-mentioned negative information, but instead provides information with positive content, such as, "It was great to be able to go for a drive with Mr./Ms. XX."

In this way, when the reliability is low, only positive content is spoken without negative content, and when the reliability is high, negative content is spoken. By providing driving caution information, etc. when driver D is in a state where he or she is more likely to accept the dialogue device's utterances (high reliability mode), driver D can be more likely to accept the information.

Note that while Figure 9 also provides driving footage, in low reliability mode, the driving footage shown in Figure 9 may not be provided, and for example, only the fact that dangerous driving occurred may be provided along with the footage.

Also, in Figure 9, driver D responds by saying, "That was certainly dangerous." The reliability may be corrected based on this response. For example, if the response is negative (irritated), the reliability may be corrected to be lowered.

In addition, while Figure 9 shows an example in which the providing unit 34 provides warning information regarding dangerous driving by the driver, the content of the warning information may be changed depending on the reliability, for example. For example, if the reliability is below a threshold, the providing unit 34 provides warning information regarding dangerous driving by driver D, and if the reliability is above the threshold, the providing unit 34 provides warning information linked to driver D's past driving tendencies.

Specifically, in the high reliability mode, the providing unit 34 may provide information about the driver D's past driving tendencies along with the warning information, such as, "Mr./Ms. XX tends to be careless at intersections, so I hope he/she will be more careful next time."

This allows driver D's driving tendencies to be provided when driver D is in a state where he or she is more likely to accept the information, making it easier for driver D to accept information about driving tendencies.

Next, we will explain each function of the control unit 120 of the in-vehicle device 100.

The control unit 120 acquires dialogue information related to the dialogue with the driver D and transmits it to the information providing device 1. The dialogue information is, for example, audio information collected by a microphone (not shown) (or text information converted from audio information).

The control unit 120 also transmits driving video of the area around the vehicle captured by an imaging unit (not shown) to the information providing device 1. The control unit 120 may also extract video related to dangerous driving (sudden acceleration, sudden deceleration, abrupt steering) from the driving video and transmit only the extracted video to the information providing device 1.

The control unit 120 also switches the speech mode of the speech mode information 131 in accordance with instructions from the information providing device 1. The control unit 120 also provides information about driver D's driving, which is provided by the information providing device 1, to driver D by speech in accordance with the current speech mode.

Next, the processing steps performed by the information providing device 1 according to the embodiment will be described using FIG. 10. FIG. 10 is a flowchart showing the processing steps performed by the information providing device 1 according to the embodiment.

As shown in FIG. 10, the control unit 3 of the information providing device 1 acquires dialogue information from the dialogue device and stores it in the dialogue DB 41 (step S101). Next, the control unit 3 estimates reliability based on the dialogue history in the dialogue DB 41 (step S102). Next, the control unit 3 determines whether the reliability is equal to or greater than a threshold (step S103). If the reliability is equal to or greater than the threshold (step S103: Yes), the control unit 3 instructs the in-vehicle device 100 to switch the speech mode information 131 to high-reliability mode (step S104) and terminates processing. On the other hand, if the reliability is less than the threshold (step S103: No), the control unit 3 instructs the in-vehicle device 100 to maintain the speech mode information 131 in low-reliability mode (step S105) and terminates processing.

As described above, the information providing device 1 according to the embodiment includes a control unit 3. The control unit 3 provides driving-related information to the driver D. The control unit 3 changes the manner in which the information is provided depending on the reliability between the dialogue device and the driver D, which is estimated based on the dialogue history between the dialogue device and the driver D. This makes it easier for the driver to accept the information.

Further advantages and modifications may readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

REFERENCE SIGNS LIST 1 Information providing device 2, 110 Communication unit 3, 120 Control unit 4, 130 Storage unit 31 Acquisition unit 32 Estimation unit 33 Evaluation unit 34 Providing unit 100 In-vehicle device 131 Speech mode information 200 Terminal device D Driver N Communication network S Information providing system

Claims (4)

An information providing device including a control unit that interacts with a driver and provides information regarding a driving skill evaluation of the driver,
The control unit
Estimating a reliability of the driver based on a dialogue history including the number of dialogues or responses with the driver;
If the reliability is less than a threshold, the system communicates with the driver in a manner of speaking in a positive manner;
If the reliability is equal to or greater than a threshold, the conversation with the driver is performed in a manner of speaking using negative expressions.
Information provision device. An information providing device including a control unit that interacts with a driver and provides information regarding a driving skill evaluation of the driver,
The control unit
Estimating a reliability of the driver based on a dialogue history including the number of dialogues or responses with the driver;
If the reliability is less than a threshold, providing the driver with warning information regarding dangerous driving performed by the driver;
If the reliability is equal to or greater than a threshold, provide the driver with the warning information and a comment that takes into account the driver's past driving tendencies.
Information provision device. An information providing method performed by an information providing device that interacts with a driver and provides information about a driving skill evaluation of the driver,
Estimating a reliability of the driver based on a dialogue history including the number of dialogues or responses with the driver;
If the reliability is less than a threshold, the system communicates with the driver in a manner of speaking in a positive manner;
If the reliability is equal to or greater than a threshold, the conversation with the driver is performed in a manner of speaking using negative expressions.
Information provision method. An information providing method performed by an information providing device that interacts with a driver and provides information about a driving skill evaluation of the driver,
Estimating a reliability of the driver based on a dialogue history including the number of dialogues or responses with the driver;
If the reliability is less than a threshold, providing the driver with warning information regarding dangerous driving performed by the driver;
If the reliability is equal to or greater than a threshold, provide the driver with the warning information and a comment that takes into account the driver's past driving tendencies.
Information provision method.