JP7171240B2 - Information output device - Google Patents

Description

The present invention relates to an information output device for outputting predetermined information in a moving object such as a vehicle.

Devices that warn of traffic violations of vehicles as mobile bodies have been proposed in the past. For example, in Patent Document 1, the front of a vehicle is photographed with a camera, and the type of traffic regulation information such as the speed limit displayed on the photographed traffic sign is recognized. It is described that information indicating the traffic violation and information about penalties to be imposed will be displayed when the user is doing so.

JP 2009-116461 A

In the case of the device described in US Pat. No. 6,200,000, a warning is issued in real time in the event of a traffic violation, and there is no review of the traffic violation at a later time. In other words, the review becomes a violating on-the-spot review, and the driver cannot concentrate on the review while driving, so the review may not be sufficiently effective.

In addition, when vehicles capable of advanced driving support such as automatic driving that runs autonomously based on information obtained from sensors installed in the vehicle become widespread, driving in driving support mode and driving in manual driving mode can be switched. A situation may arise in which the In such a situation, the vehicle automatically complies with traffic rules while driving in driving assistance mode, increasing the possibility that passengers will not pay attention to traffic signs. Observance of traffic rules such as traffic signs may become insufficient.

A problem to be solved by the present invention is to provide an information output device capable of making the driver comply with traffic rules in the manual driving mode in a vehicle capable of driving in the driving support mode and in the manual driving mode. is an example.

In order to solve the above-mentioned problems, the invention according to claim 1 is an information output device for outputting guide information according to a driving mode of a mobile body, comprising a traffic sign related to a road on which the mobile body is moving. and a sign detection unit for detecting a driving mode of the moving object, and outputting first guide information related to the traffic sign when the driving mode of the moving object is the manual driving mode, and the driving mode of the moving object is different from the manual driving mode. and an output unit that outputs second guide information related to the traffic sign in a predetermined driving assistance mode , wherein the second guide information includes more detailed information than the first guide information. It is characterized by

The invention according to claim 7 is a mobile body having a manual driving mode for outputting first guide information and a driving support mode for outputting second guide information, wherein the mobile body is on a road on which it is moving. A sign detection unit for detecting related traffic signs, wherein the first guide information and the second guide information include information about the traffic sign, and the second guide information includes the first guide information. It is characterized in that it contains more detailed information about the traffic sign than the traffic sign.

According to an eighth aspect of the invention, there is provided an information output method executed by an information output device for outputting guide information according to a driving mode of a mobile body, wherein the mobile body displays traffic signs related to a road on which it is moving . a sign detection step for detecting , when the driving mode of the moving body is the manual driving mode, outputting first guide information related to the traffic sign, and determining that the driving mode of the moving body is different from the manual driving mode; and an outputting step of outputting second guide information related to the traffic sign when the driving assistance mode is the driving assistance mode , wherein the second guide information includes more detailed information than the first guide information. It is characterized by

According to a ninth aspect of the invention, the information output method according to the eighth aspect is executed by a computer.

1 is a schematic configuration diagram of a system having an information output device according to a first embodiment of the present invention; FIG. 2 is a schematic configuration diagram of an information output device shown in FIG. 1; FIG. 3 is a functional configuration diagram of a control unit shown in FIG. 2; FIG. It is an example of first guide information. It is an example of second guide information. It is an example of second guide information. 3 is a flow chart of the operation of the information output device shown in FIG. 2; FIG. 5 is a schematic configuration diagram of an information output device according to a second embodiment of the present invention; 9 is a functional configuration diagram of a control unit shown in FIG. 8; FIG. It is an example of notification information. 9 is a flowchart of the operation of the information output device shown in FIG. 8;

An information output device according to an embodiment of the present invention will be described below. An information output device according to an embodiment of the present invention includes a driving mode acquisition unit that acquires a driving mode of a moving object having one or more driving support modes and a manual driving mode, and is applied to the moving moving object. A sign detection unit that detects a traffic sign and an output unit that outputs guide information related to the traffic sign detected by the sign detection unit are provided. The output unit outputs first guide information in the manual driving mode, and outputs second guide information that is more detailed than the first guide information in at least part of the driving assistance mode. By doing so, in the driving assistance mode, the passenger can obtain more detailed guide information than in the manual driving mode. can be

Also, the output unit may output the first guide information or the second guide information according to the degree of driving assistance. By doing so, when there are multiple degrees of driving support, the second guide information is output when the degree of driving support is the highest, and the first guide information is output when the degree of driving support is not the highest. can be output. Further, when the level of driving assistance is level 1, the second guide information can be output regardless of the level of the level.

Further, a traffic sign violation acquisition unit for acquiring traffic sign violation information generated by the driver of the moving body in the manual driving mode is provided, and the output unit outputs the traffic sign violation information related to the traffic sign to the second guide information in the driving support mode. may be included in the output. By doing so, detailed information about the sign violation caused by the passenger can be output and reviewed by the passenger.

Further, the traffic sign violation information includes the number of violations for each type of traffic sign, and the output unit may change the output mode of the guide information according to the number of violations. By doing so, it is possible to change the output mode, for example, display only or voice and display, according to the number of traffic sign violations.

In addition, the sign violation information includes information about when a traffic sign is violated for each type of traffic sign. You may make it change the output mode of guide information according to the said period. By doing so, for example, as the sign violation period becomes shorter, the output mode can be changed to display only or display with sound.

Further, in the manual driving mode, a judgment unit that judges whether or not the traffic sign detected by the sign detection unit is violated, and when the judgment unit judges that the traffic sign is violated, and an accumulation unit for accumulating as violation information. By doing so, it becomes possible to determine and store the sign violation caused by the driver in the manual driving mode. Thus, it is possible to review accumulated sign violations during the driver assistance mode.

Further, a moving body according to an embodiment of the present invention is a moving body having a manual driving mode in which first guide information is output and a driving support mode in which second guide information is output. The first guide information includes more detailed information about the traffic signs than the second guide information. By doing so, in the driving assistance mode, the passenger can obtain more detailed guide information than in the manual driving mode. can be

Further, an information output method according to an embodiment of the present invention is applied to an operation mode acquisition step of acquiring an operation mode of a moving object having one or more operation support modes and a manual operation mode, and to a moving object. and an outputting step of outputting guide information related to the traffic sign detected in the sign detecting step, wherein the outputting step outputs the first guide information in the manual driving mode, and at least In some driving assistance modes, second guide information that is more detailed than the first guide information is output. By doing so, in the driving assistance mode, the passenger can obtain more detailed guide information than in the manual driving mode. can be

Also, the information output method described above may be executed by a computer. By doing so, in the driving support mode, the passenger can obtain more detailed guide information than in the manual driving mode using a computer, so that the passenger is made aware of the traffic rules, and the traffic control system during manual driving is improved. You can enforce compliance with the rules.

An information output device according to a first embodiment of the present invention will be described with reference to FIGS. 1 to 7. FIG. The information output device 3 is mounted on a vehicle C as a mobile body having a driving support function. The driving support function that the vehicle C has is not limited to the so-called automatic driving function that autonomously travels to the destination, but also the accelerator (speed adjustment), brake, steering wheel (steering), etc. by the driver when driving the vehicle. Any one of the operations to be performed may be performed automatically regardless of the driver. In the following description of this embodiment, the driving support function will be described as an automatic driving function.

The information output device 3 mounted on the vehicle C can communicate with the server device 1 via a network N such as the Internet, as shown in FIG.

FIG. 2 shows a schematic configuration of the information output device 3. As shown in FIG. The information output device 3 includes a control section 31 , a communication section 32 and a storage section 33 .

The control unit 31 outputs guide information based on the camera image captured by the vehicle-mounted camera and the driving support information of the vehicle C. FIG. Driving support information and guide information will be described later. In addition, the control unit 31 detects a sign violation performed by the driver during manual driving in which driving assistance is not performed, and stores it in the storage unit 33 as sign violation information. Further, the traffic sign violation information stored in the storage unit 33 is associated with the driver information and transmitted to the server device 1 by the communication unit 32 . Furthermore, the traffic sign violation information and the driver information received from the server device 1 are stored in the storage unit 33 .

The communication unit 32 transmits the traffic sign violation information and the driver information to the server device 1 under the control of the control unit 31 . In addition, it outputs the traffic sign violation information and the driver information received from the server device 1 to the control unit 31 .

The storage unit 33 stores the above-described traffic sign violation information and driver information. The traffic sign violation information includes the type of violation traffic sign, the number of violations, the date and time of violation, and the like. The driver information includes information by which the driver can be identified (not limited to the name but may be a user ID or the like).

The server device 1 stores the traffic sign violation information and driver information described above. These pieces of information are stored in association with the traffic sign information and the driver information as described above. Therefore, even if a specific driver changes to another vehicle, the traffic sign violation information can be stored in the information output device 3 of the changed vehicle.

FIG. 3 shows the functional configuration of the control section 31. As shown in FIG. The control unit 31 includes a driving assistance detection unit 311 , a road sign/marking recognition unit 312 , a traffic violation detection unit 313 , and a guide information output unit 314 .

The driving assistance detection unit 311 receives driving assistance information from the vehicle C side and detects the driving assistance state of the vehicle C. FIG. The driving support state according to the present embodiment is an automatic driving mode (driving support mode) in which the vehicle C travels autonomously after the destination information is given, or a manual driving mode in which the driver performs the driving operation. mentioned. The driving support information includes information indicating an automatic driving mode or a manual driving mode, and information indicating a control state such as whether acceleration, braking, steering, etc. are performed automatically or by the driver. That is, the driving assistance detection unit 311 not only acquires mode information such as the driving assistance mode or the manual operation mode, but also identifies the driving assistance mode or the manual operation mode by itself based on the vehicle information regarding the accelerator, the brake, the steering, and the like. good too.

That is, the driving assistance detection unit 311 functions as a driving mode acquisition unit that acquires the driving mode of the moving object having one or more driving assistance modes and manual operation modes. The detected driving assistance state is output to the road sign/sign recognition unit 312 , the traffic violation detection unit 313 , and the guide information output unit 314 .

The road sign/sign recognition unit 312 recognizes (detects) traffic signs such as road signs and road markings based on image information captured by an on-board camera that captures an image of the traveling direction of the vehicle C, for example. Recognition of traffic signs may be performed by well-known image recognition processing. In other words, the road sign/sign recognition unit 312 functions as a sign detection unit that detects a traffic sign applied to a moving mobile body.

The type and content of the traffic sign recognized by the road sign/marking recognition unit 312 are output to the traffic violation detection unit 313 and the guide information output unit 314 when the driving support detection unit 311 detects that the manual driving mode is selected. When the driving support detection unit 311 detects the automatic driving mode, the information is output to the guide information output unit 314 . In addition, traffic signs may be recognized from information such as signs included in map information for navigation or automatic driving, without being limited to an in-vehicle camera.

The traffic violation detection unit 313 detects whether the traffic sign detected by the road sign/sign recognition unit 312 is in violation when the driving support detection unit 311 detects the manual driving mode. Whether or not a traffic sign is violated may be determined based on vehicle information such as information from an in-vehicle camera and speed information obtained from the vehicle C, for example. The traffic sign violation detected by the traffic violation detection unit 313 is stored in the storage unit 33 as sign violation information in association with the driver information, as described above. That is, the traffic violation detection unit 313 functions as a determination unit that determines whether or not the traffic sign detected by the sign detection unit is in violation during the manual driving mode. It functions as an accumulation unit that accumulates the result of the judgment as sign violation information when it is judged to be in violation.

Further, the traffic violation detection unit 313 searches the storage unit 33 for traffic sign violation information related to the traffic signs detected by the road sign/sign recognition unit 312 when the driving support detection unit 311 detects the automatic driving mode. , and if there is, the searched traffic sign violation information is output to the guide information output unit 314 . That is, the traffic violation detection unit 313 functions as a traffic violation acquisition unit that acquires traffic violation information generated by the driver of the mobile object in the manual driving mode.

The guide information output unit 314 outputs the type and content of the traffic sign detected by the road sign/sign recognition unit 312 as guide information (first guide information) when the manual driving mode is detected by the driving support detection unit 311. Output.

An example of the first guide information is shown in FIG. FIG. 4 is an example of output as display information when a temporary stop (stop) is detected as a traffic sign. As shown in FIG. 4, a stop sign and its content (pause) are included.

In addition, when the driving support detection unit 311 detects the automatic driving mode, the guide information output unit 314 adds detailed traffic rules, Penalties for violations, accident risks, etc. are output as guide information (second guide information). Furthermore, if there is traffic sign violation information related to traffic signs detected by the road sign/sign recognition unit 312, the traffic sign violation information is also included in the guide information (second guide information) and output. That is, the guide information output unit 314 functions as an output unit that outputs guide information related to traffic signs detected by the sign detection unit.

An example of the second guide information is shown in FIGS. 5 and 6. FIG. 5 and 6 are examples of output as display information when a temporary stop is detected as a traffic sign, similar to FIG. FIG. 5 is an example that does not include sign violation information, and includes detailed traffic rules, penalties for violations, and accident risks in addition to stop signs and their contents. FIG. 6 is an example including sign violation information, which includes stop signs and their contents, as well as sign violation information, detailed traffic rules, penalties for violations, and accident risks. In the examples of FIGS. 5 and 6, if the information cannot be displayed on one screen at once, it may be divided into multiple pages or scrolled.

The output destination of the guide information of the guide information output unit 314 is not limited to the display device installed in the vehicle (center console, meter panel, head-up display, etc.), but also an amplifier, speaker, etc. for audio output. There may be. In the case of voice, the voice having the content illustrated in FIGS. 4 to 6 is synthesized, generated, and output.

Next, the operation (information output method) of the information output device 3 configured as described above will be described with reference to the flowchart of FIG. Further, by constructing the flowchart shown in FIG. 7 as a computer program executed by the CPU of the control unit, an information output program can be obtained.

First, in step S101, the driving support detection unit 311 detects the driving support state, and when the manual driving mode is detected, the process proceeds to step S102, and when the automatic driving mode is detected, the process proceeds to step S106. Before or after executing this step, the driver information may be obtained, and the traffic sign violation information associated with the driver information may be received from the server device 1 and stored in the storage unit 33 . The driver information may be obtained, for example, by the driver himself/herself inputting a user ID or the like, or obtained from another device such as an IC card.

If manual driving is detected in step S101, the road sign/sign recognition unit 312 detects a traffic sign in step S102. Then, in step S103, the traffic violation detection unit 313 detects whether or not the traffic sign detected by the road sign/sign recognition unit 312 is in violation. is not detected (NO), the process proceeds to step S105.

Next, in step S104, since the traffic sign violation was detected in step S103, the traffic violation detection unit 313 saves (stores) the traffic sign violation information corresponding to the traffic sign violation in the storage unit 33 in association with the driver information. Let

Next, in step S105, the guide information output unit 314 outputs the type and content of the traffic sign detected by the road sign/sign recognition unit 312 as guide information.

On the other hand, when automatic driving is detected in step S101, the road sign/sign recognition unit 312 detects a traffic sign in step S106. Then, in step S107, the traffic violation detection unit 313 searches the storage unit 33 to see if there is traffic sign violation information related to the traffic sign detected by the road sign/sign recognition unit 312. If not, the process proceeds to step S108. goes to step S109.

Next, in step S108, since it is determined that there is no traffic sign violation information in step S107, the guide information output unit 314 adds detailed traffic sign types and contents detected by the road sign/sign recognition unit 312 to Rules, penalties for violations, accident risks, etc. are output as guide information.

In addition, in step S109, since it is determined in step S107 that there is traffic sign violation information, the guide information output unit 314 adds detailed traffic sign information in addition to the type and content of the traffic sign detected by the road sign/sign recognition unit 312. Rules, penalties for violations, accident risks, and information on violations of signs are output as guide information.

Then, in step S110, it is determined whether or not the vehicle C has finished traveling by turning off the ignition or the like. returns to step S101. Note that the traffic sign violation information stored in the storage unit 33 may be transmitted to the server device 1 when it is determined in this step that the vehicle has finished running. The timing for transmitting the traffic sign violation information to the server device 1 may be the timing for storing the traffic sign violation information in the storage unit 33 .

As is clear from the above description, step S101 functions as an operation mode acquisition process, steps S102 and S106 function as a sign detection process, and steps S105, S108, and S109 function as an output process.

According to the present embodiment, the information output device 3 includes the driving assistance detection unit 311 that acquires the driving assistance state of the vehicle C having the automatic driving mode and the manual driving mode, and the traffic sign applied to the moving vehicle C. A road sign/sign recognition unit 312 for detection and a guide information output unit 314 for outputting guide information related to the traffic sign detected by the road sign/sign recognition unit 312 are provided. Then, the guide information output unit 314 outputs the type and content of the traffic sign detected by the road sign/sign recognition unit 312 when the manual driving mode is detected, and outputs the traffic sign type and content when the automatic driving mode is detected. In addition to the type and content of signs, detailed traffic rules, penalties for violations, accident risks, etc. are output. In this way, during automatic driving, the passenger can obtain more detailed guide information than during manual driving, making the passenger aware of the traffic rules and making them comply with the traffic rules during manual driving. can be done.

In addition, a traffic violation detection unit 313 is provided to acquire traffic violation information generated by the driver of the vehicle C in the manual driving mode. In addition to traffic rules, penalties for violations, accident risks, etc., information on traffic violations related to the relevant signs is also included in the output. By doing so, detailed information about the sign violation caused by the passenger can be output and reviewed by the passenger.

Further, the traffic violation detection unit 313 determines whether or not the traffic sign detected by the road sign/sign recognition unit 312 is violated in the manual driving mode, and the traffic violation detection unit 313 determines that the traffic sign is violated. A storage unit 33 is provided for accumulating the result of the determination as sign violation information when the determination is made. By doing so, it becomes possible to determine and store the sign violation caused by the driver in the manual driving mode. Thus, it is possible to review the accumulated sign violations during the autonomous driving mode.

Since the traffic sign violation information includes the number of violations for each type of traffic sign, the guide information output unit 314 may change the guide information output mode according to the number of violations. . For example, depending on the number of violations, the output mode can be changed to display only or display with sound.

In addition, since the traffic sign violation information includes the date and time as information about when the traffic sign was violated for each type of traffic sign, the guide information output unit 314 obtains the period from the previous violation based on the date and time, You may make it change the output mode of guide information according to the said period. For example, as the period of violation becomes shorter, the output mode can be changed such as display only or sound and display.

Further, in the above-described embodiment, the driving support mode was described as an automatic driving mode for ease of understanding, but the driving support mode is not limited to fully automatic driving in which the system performs all driving. It also includes driving assistance that controls at least one of acceleration, braking, and steering. In addition, if the driving support mode has multiple modes with different degrees of driving support, such as fully automatic driving and auto-cruise that keeps the driving speed constant, the mode with the highest degree of driving support will be automatically driven as described above. The second guide information may be output corresponding to the operation described as . In other words, the second guide information should be output during at least part of the driving assistance mode.

For example, in the case of a vehicle with fully automated driving and auto-cruise driving support modes, detailed traffic rules, penalties for violations, accident risks, and sign violation information (second guide information) are output in the case of fully automated driving. In auto-cruise and manual driving modes, the type and content of the traffic sign (first guide information) are output. In addition, in the case of a vehicle that has only auto-cruise as a driving support mode, in the case of auto-cruise, detailed traffic rules, penalties for violations, accident risks, and sign violation information (second guide information) are output. . That is, the mobile body may have one or more driving assistance modes and output the first guide information or the second guide information according to the degree of driving assistance.

Next, an information output device according to a second embodiment of the invention will be described with reference to FIGS. 8 to 11. FIG. The same reference numerals are given to the same parts as those of the first embodiment described above, and the description thereof will be omitted.

FIG. 8 shows a schematic configuration of an information output device 3A according to this embodiment. The basic configuration is the same as in the first embodiment, but current position information is input from a GPS receiver, for example, in order to acquire the current position of the vehicle C. FIG.

FIG. 9 shows the functional configuration of the control section 31A. Although the functional configuration is basically the same as that of the first embodiment, the road sign/sign recognition unit 312 serves as the road sign/sign recognition unit 312A, the traffic violation detection unit 313 serves as the traffic violation detection unit 313A, and the guide The information output section 314 is changed to a guide information output section 314A.

In addition to recognizing traffic signs, the road sign/marking recognition unit 312A also outputs the current position information (position information) input from the GPS receiver to the traffic violation detection unit 313A and the guide information output unit 314A. . In other words, the road sign/marking recognition unit 312A functions as a current position information acquisition unit that acquires the current position information of the moving object.

The traffic violation detection unit 313A detects (determines) not only traffic sign violations but also driving behaviors that require notification in the manual driving mode, and notifies the driver information in association with the content and occurrence location of the driving behaviors. Stored in the storage unit 33 as information. Note that the date and time of occurrence may be included in the content of the driving action or the place of occurrence.

In addition, when the driving support detection unit 311 detects automatic driving, the traffic violation detection unit 313A determines whether there is notification information that matches the current location information input from the GPS receiver. 33 and outputs corresponding notification information to the guide information output unit 314A. That is, the traffic violation detection unit 313A functions as a notification information acquisition unit that acquires notification information in which the driving behavior of the driver determined to require notification in the manual driving mode and the place of occurrence of the driving behavior are associated with each other. Function.

Here, examples of driving behaviors that require notification detected by the traffic violation detection unit 313A are shown. The first is temporary non-stop. This is the act of driving without stopping at a stop sign. Such a driving behavior can be determined by detecting whether the vehicle has stopped (speed is 0 km/h) when a stop sign is recognized by the road sign/sign recognition unit 312A.

The second is pedestrian obstruction. A typical example of this is the driving behavior of blocking the sidewalk and stopping the vehicle to obstruct the passage of pedestrians and bicycles when entering the roadway from a parking lot or the like. Such driving behavior can be determined by recognizing a pedestrian or the like approaching the own vehicle from an image captured by an in-vehicle camera that captures the right or left direction of the vehicle.

The third is specific driving on narrow roads or roads with poor visibility. This means driving at high speed on narrow roads or roads with poor visibility without considering the possibility that pedestrians and bicycles may jump out, A typical example is driving in the vicinity of the center of the road without turning left without considering the passing of the road. In other words, it is determined that notification is necessary when the vehicle is traveling in such a predetermined traveling pattern. For such driving behavior, it is possible to analyze the width of the road and the poor visibility from the image of the vehicle-mounted camera. Further, map information may include road width information, poor visibility information, and the like. High-speed driving can be determined by whether the vehicle is traveling at a speed equal to or higher than the speed limit recognized by the road sign/sign recognition unit 312A. Driving near the center of the road can be analyzed from the image of the vehicle-mounted camera.

Fourth is speeding. This is the act of driving over the speed limit. In particular, when the speed limit is strict regardless of appearance, such as a large main road with two or more lanes on one side or a country road, there are cases where the driver misunderstands the speed limit and unintentionally drives over the speed limit. Such a driving behavior can be determined by comparing the speed limit recognized by the road sign/sign recognition unit 312A with speed information acquired from a vehicle speed sensor or the like of the vehicle.

As described above, the traffic violation detection unit 313A functions as a mobile object state acquisition unit that acquires the surrounding conditions of the mobile object from the vehicle-mounted camera or the like and acquires the moving state of the mobile object from the vehicle information such as the running speed. In the manual driving mode, the traffic violation detection unit 313A functions as a notification driving determination unit that determines that notification of the driver's driving behavior is necessary based on the acquired surrounding conditions and movement state.

The storage unit 33 also functions as an accumulation unit that accumulates, as notification information, the driving behavior determined to require notification and the place of occurrence of the driving behavior.

314 A of guide information output parts output the alerting|reporting information searched by 313 A of traffic violation detection parts, when the automatic driving mode is detected by the driving assistance detection part 311. FIG. In other words, the guide information output unit 314A functions as an output unit that outputs notification information indicating that the current location indicated by the current location information is the location of occurrence when the mobile body is moving in at least some of the driving assistance modes.

FIG. 10 shows an example of notification information. FIG. 10 is an example of output as display information when a temporary stop is detected as a traffic sign. As shown in FIG. 10, the notification information includes the content of the driving action (temporary non-stop) and the place of occurrence (xx). Note that the place of occurrence is not limited to a specific place name, and expressions such as "here" or "near here" may be used.

Next, the operation (information output method) of the information output device 3A configured as described above will be described with reference to the flowchart of FIG. Further, by constructing the flowchart shown in FIG. 11 as a computer program executed by the CPU of the control unit, an information output program can be obtained.

First, in step S201, the driving support detection unit 311 detects the driving support state, and when the manual driving mode is detected, the process proceeds to step S202, and when the automatic driving mode is detected, the process proceeds to step S204.

If the manual driving mode is detected in step S201, in step S202, the traffic violation detection unit 313A detects a driving action that requires notification based on the traffic signs and the like detected by the road sign/sign recognition unit 312A. determine whether or not As a result of the determination, if the driving action requiring notification is detected, the process proceeds to step S203, and if the driving action requiring notification is not detected, the process proceeds to step S206.

Next, in step S203, since the driving behavior requiring notification was detected in step S202, the traffic violation detection unit 313A stores (stores) the driving behavior in the storage unit 33 as notification information in association with the driver information. .

On the other hand, when automatic driving is detected in step S201, in step S204, the traffic violation detection unit 313A stores whether or not there is notification information that matches the current location information input from the GPS receiver. Search for part 33 . If there is corresponding notification information as a result of the search (in the case of YES), the process proceeds to step S205, and if there is no corresponding notification information (in the case of NO), the process proceeds to step S206.

Next, in step S205, the guide information output unit 314A outputs the notification information retrieved in step S204.

Then, in step S206, it is determined whether or not the vehicle C has finished traveling by operating the ignition OFF or the like. returns to step S201.

As is clear from the above description, step S201 functions as an operation mode acquisition step, step S204 functions as a current position information acquisition step, notification information acquisition step, and step S205 functions as an output step.

Also in this embodiment, by transmitting the notification information to the server device 1 in the same manner as in the first embodiment, the notification information can be acquired even when the driver changes to another vehicle. .

According to the present embodiment, the information output device 3A includes the driving support detection unit 311 that acquires the driving support state of the vehicle C having the automatic driving mode and the manual driving mode, and the road sign / and a sign recognition unit 312A. Then, the notification information in which the driving behavior of the driver determined to require notification in the manual driving mode and the location where the driving behavior occurs is acquired, and the vehicle C is moving in the automatic driving mode. A guide information output unit 314A is provided for outputting notification information indicating that the current position indicated by the current position information is the place of occurrence. By doing so, it is possible to review the driving behavior determined to require notification when traveling to the occurrence location indicated by the notification information in the automatic driving mode. Therefore, it is possible to experience what kind of driving was performed at the place where the driving action determined to require notification was performed. Therefore, it is possible to make the passenger more aware of the traffic rules and to comply with the traffic rules during manual driving.

In addition, traffic sign violations are included in the driving behavior determined to require notification. By doing so, it is possible to output a driving behavior that violates traffic signs as notification information.

In addition, the driving behavior that is determined to require notification includes behavior that interferes with pedestrians. By doing so, it is possible to output a driving behavior that disturbs a pedestrian as notification information.

In addition, vehicle information such as an image captured by an in-vehicle camera that acquires the surrounding conditions of the vehicle C and the traveling speed of the vehicle C is acquired, and in the manual operation mode, driving is performed based on the vehicle information such as the captured image and the traveling speed. A traffic violation detection unit 313A that determines that notification of the driving behavior of a person is necessary, and a storage unit 33 that accumulates the driving behavior determined to require notification and the location of occurrence of the driving behavior as notification information. By doing so, it is possible to determine and accumulate the driving behaviors generated by the driver during the manual driving mode that require notification. Therefore, it is possible to review the accumulated driving actions during driving assistance.

In addition, the traffic violation detection unit 313A determines that notification is necessary when the vehicle C is traveling in a predetermined driving pattern based on the image captured by the vehicle-mounted camera and the vehicle information. By doing so, for example, it is possible to output as notification information when the vehicle is traveling on a narrow road or a road with poor visibility at an excessive speed, or when it is difficult to pass an oncoming vehicle. can.

In the above description, the notification information is output when there is notification information corresponding to the location of occurrence that matches the current position information, but the present position information is not limited to this. For example, it may be within a predetermined range including the current position such as an area near the place of occurrence or the same road.

Moreover, the present invention is not limited to the above embodiments. That is, those skilled in the art can carry out various modifications according to conventionally known knowledge without departing from the gist of the present invention. As long as the information output device of the present invention is provided even with such modification, it is, of course, included in the scope of the present invention.

1 server device 3 vehicle control device 31 control unit 311 driving support detection unit (driving mode acquisition unit)
312, 312A road sign/sign recognition unit (sign detection unit, current location information acquisition unit)
313, 313A traffic violation detection unit (sign violation acquisition unit, determination unit, report information acquisition unit, moving body state acquisition unit, report driving determination unit)
314, 314A guide information output unit (output unit)
33 storage unit (storage unit)
C Vehicle (moving body)

Claims (9)

An information output device that outputs guide information according to the operation mode of a mobile body,
a sign detection unit that detects a traffic sign associated with a road on which the moving object is moving ;
When the driving mode of the moving body is the manual driving mode, the first guide information regarding the traffic sign is output, and the driving mode of the moving body is a predetermined driving support mode different from the manual driving mode. and an output unit that outputs second guide information related to the traffic sign ,
The second guide information contains more detailed information than the first guide information,
An information output device characterized by: The output unit outputs the first guide information or the second guide information in accordance with the degree of driving assistance when the driving mode of the moving body is the driving assistance mode. Item 1. The information output device according to item 1. a traffic sign violation acquiring unit that acquires traffic sign violation information generated by a driver of the moving object when the driving mode of the moving object is the manual driving mode;
When the driving mode of the moving object is a predetermined driving support mode, the output unit outputs the second guide information including the traffic sign violation information,
3. The information output device according to claim 1 or 2, characterized in that: The traffic sign violation information includes the number of violations for each type of traffic sign,
4. The information output device according to claim 3, wherein the output unit changes the output mode of the second guide information according to the number of times. The traffic sign violation information includes information about when the traffic sign is violated for each type of the traffic sign,
3. The output unit obtains the period from the previous violation based on the information about the time of violation of the traffic sign, and changes the output mode of the second guide information according to the period. The information output device described in . a determination unit that determines whether or not the traffic sign detected by the sign detection unit is in violation when the operation mode of the moving object is the manual operation mode;
an accumulation unit for accumulating a result of the judgment as the sign violation information when the judgment unit judges that the traffic sign is violated;
6. The information output device according to any one of claims 1 to 5, comprising: A moving body having a manual driving mode for outputting first guide information and a driving support mode for outputting second guide information,
A sign detection unit that detects a traffic sign related to a road on which the moving body is moving ;
the first guide information and the second guide information include information about the traffic sign;
the second guide information includes more detailed information about the traffic sign than the first guide information;
A moving body characterized by: An information output method executed by an information output device that outputs guide information according to an operation mode of a mobile object ,
a sign detection step of detecting a traffic sign associated with a road on which the mobile body is moving ;
When the driving mode of the moving object is the manual driving mode, the first guide information regarding the traffic sign is output, and the driving mode of the moving object is a predetermined driving support mode different from the manual driving mode. and an output step of outputting second guide information related to the traffic sign ;
The second guide information contains more detailed information than the first guide information,
An information output method characterized by: An information output program causing a computer to execute the information output method according to claim 8.

Images