JP7675538B2 - Display control device, display control method, and display control program - Google Patents

Description

This application belongs to the technical fields of display control devices, display control methods, and display control programs. More specifically, this application belongs to the technical fields of display control devices and display control methods that control the display of moving objects such as vehicles, and programs for such display control devices.

In recent years, the increase in traffic volume has led to a considerable number of traffic accidents. Meanwhile, one of the devices installed in vehicles to prevent traffic accidents is the hazard lamp. From the viewpoint of reducing the number of traffic accidents, there is a demand for preventing erroneous operation of turning on the hazard lamp and for improving its operability. For example, the following Patent Document 1 is an example of a prior art document that discloses an example of a conventional technology made from this viewpoint.

Patent Document 1 discloses a configuration in which, in order to prevent erroneous operation while maintaining good operability, multiple switch images, including an image of a hazard lamp switch, are displayed on a display or the like, and these switch images are operated using touch pads provided on the front and back of the steering wheel.

JP 2018-144582 A

However, from the perspective of preventing traffic accidents, turning on the hazard lamps is extremely urgent, and it is desirable to configure the hazard lamps so that they can be turned on immediately if a dangerous situation that could lead to a traffic accident occurs. However, Patent Document 1 does not take into consideration this need for urgency at all. Therefore, the technology disclosed in Patent Document 1 cannot meet the above need.

The present application has been made in consideration of the above demands and problems, and one example of the objective of the application is to provide a display control device and a display control method, as well as a program for the display control device, that can quickly turn on hazard lights, etc., in response to the occurrence of a dangerous situation that could lead to a traffic accident.

In order to solve the above problem, the invention described in claim 1 comprises an extraction means for extracting a danger sound indicating danger from the voice of a passenger of a moving body, and a control means for causing a display means to display at least one of the following images when the danger sound is extracted: i) a first operation image for activating a function of turning on hazard lights provided on the moving body, and ii) a second operation image for activating a function of recording at least image data of an image captured around the moving body .

In order to solve the above problem, the invention described in claim 7 is a display control method executed in a display control device equipped with an extraction means and a control means, and includes an extraction step of extracting a danger sound signifying danger from the voice of an occupant of a moving body by the extraction means, and a control step of causing the control means to display, when the danger sound is extracted, at least one of i) an operation image for activating a function of turning on hazard lights provided in the moving body, and ii) an operation image for activating a function of recording at least image data of an image captured around the moving body , on the display means.

In order to solve the above problem, the invention described in claim 8 causes a computer to function as an extraction means for extracting danger sounds indicating danger from the voices of passengers of a moving body, and as a control means for displaying, when the danger sound is extracted, at least one of the following on a display means: i) an operation image for activating a function of turning on hazard lights provided on the moving body, and ii) an operation image for activating a function of recording at least image data of an image captured around the moving body .

1 is a block diagram showing a schematic configuration of a display control device according to an embodiment; 1 is a block diagram showing a schematic configuration of a navigation device according to an embodiment of the present invention; 4 is a flowchart showing a display control process according to the embodiment. 1A and 1B are diagrams showing display examples in the display control process of the embodiment, in which FIG. 1A is a diagram showing a first example, and FIG. 1B is a diagram showing a second example.

Next, an embodiment of the present application will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the general configuration of a display control device according to an embodiment.

As shown in FIG. 1, the display control device S of the embodiment is configured to include an extraction means 1 and a control means 2.

In this configuration, the extraction means 1 extracts danger sounds indicating danger from the voices of passengers in the vehicle. When the danger sound is extracted by the extraction means 1, the control means 2 causes the display means DP to display an operation image for activating a function corresponding to the extracted danger sound.

As described above, according to the operation of the display control device S of the embodiment, when a dangerous voice is extracted from the voice of a passenger of a moving body, an operation image for activating a function corresponding to the dangerous voice is displayed on the display means.

This allows the necessary functions to be activated quickly in response to the occurrence of a danger.

Next, a specific example corresponding to the above-mentioned embodiment will be described with reference to Figs. 2 to 4. Note that the example described below is an example in which the present application is applied to the control of the display content on a display provided in a vehicle.

In addition, FIG. 2 is a block diagram showing the general configuration of the navigation device of the embodiment, FIG. 3 is a flowchart showing the display control process of the embodiment, and FIG. 4 is a diagram showing a display example in the display control process of the embodiment. In FIG. 2, the same component numbers as those of the respective components in the display control device S of the embodiment shown in FIG. 1 are used for the respective components in the embodiment.

As shown in FIG. 2, the navigation device SS of the embodiment, which is an example of the display control device S of the embodiment, is mounted on, for example, a vehicle, and more specifically, is configured with a processing unit 10 consisting of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., a non-volatile recording unit 11 consisting of a HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc., an operation unit 12 consisting of operation buttons, etc., a microphone 13, a camera 14 consisting of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) imaging element, etc., a sensor unit 15 constituting a GNSS (Global Navigation Satellite System) or an autonomous navigation system, etc., a display DP consisting of a liquid crystal display, etc., a touch panel TP provided on the surface of the display DP, a speaker 16, and an interface 17.

On the other hand, the processing unit 10 is composed of an extraction unit 1 and a control unit 2. In this case, the extraction unit 1 and the control unit 2 may be realized by a hardware logic circuit constituting the processing unit 10, or may be realized in software by the processing unit 10 reading and executing a program corresponding to the flowchart showing the display control process of the embodiment, for example, from the recording unit 11. The extraction unit 1 corresponds to an example of the extraction means 1 of the embodiment, the control unit 2 corresponds to an example of the control means 2 of the embodiment, and the processing unit 10 corresponds to an example of the "determination means" of the present application. In this case, as shown by the dashed line in FIG. 2, the extraction unit 1 and the control unit 2 constitute an example of a display control device S of the embodiment.

In the above configuration, the recording unit 11 stores in a non-volatile manner a program corresponding to the display control process of the embodiment, map data used in the vehicle guidance process by the navigation device SS, and the like, and is read out by the processing unit 10 as necessary. At this time, the display control process of the embodiment is executed as part of the guidance process.

On the other hand, under the control of the processing unit 10, the microphone 13 collects the speech of the vehicle occupants (including the driver or passengers of the vehicle; the same applies below) and outputs sound data corresponding to the collected speech to the processing unit 10. Furthermore, under the control of the processing unit 10, the camera 14 outputs to the processing unit 10 image data corresponding to the imaging results of the surroundings including the front and rear of the vehicle or the interior of the vehicle, which are necessary for the guidance process. Furthermore, under the control of the processing unit 10, the sensor unit 15 detects the current position, moving speed, traveling direction, etc. of the vehicle equipped with the navigation device using the GNSS, etc., as part of the guidance process, and generates detection data indicating the detection results and outputs it to the processing unit 10.

On the other hand, the display DP, which has a touch panel TP on its surface, displays images (including a hazard switch image, which is the subject of the display control process in the embodiment, described later) and maps required for the guidance process under the control of the processing unit 10. The speaker 16 also emits sounds or voices required for the guidance process under the control of the processing unit 10. Furthermore, the interface 17 controls the exchange of information or data required for the guidance process via a network, such as the Internet (not shown), under the control of the processing unit 10. Furthermore, when an instruction operation is performed on the navigation device SS by any of the passengers, the operation unit 12 generates an operation signal corresponding to the instruction operation and outputs it to the processing unit 10. As a result, the processing unit 10 mainly executes the guidance process, including the display control process in the embodiment, while controlling each component constituting the navigation device SS based on the operation signal.

At this time, the extraction unit 1 of the processing unit 10, as part of the display control process of the embodiment, extracts the danger sound of the embodiment uttered by any of the occupants from the speech corresponding to the sound data based on the sound data input from the microphone 13, and outputs the extraction result to the control unit 2. As a result, as part of the display control process of the embodiment, when the danger sound is extracted, the control unit 2 causes the display DP to display a hazard switch image of the embodiment for turning on hazard lights (not shown) of the vehicle in which the navigation device SS is mounted, which can be operated by the occupant's finger or the like touching the touch panel TP, immediately after the danger sound is extracted. Then, when the touch panel TP detects the occupant's operation of the hazard switch image, the processing unit 10 turns on the hazard lights.

Next, the display control process of the embodiment, which is executed mainly by the processing unit 10, will be specifically described with reference to Figs. 2 to 4. Note that the display control process of the embodiment is started as an interrupt process at regular intervals, for example, as part of the guidance process.

As shown in the corresponding flowchart in FIG. 3, when the display control process of the embodiment is started, the processing unit 10 recognizes the content of any of the occupants' utterances (voice recognition) based on the sound data from the microphone 13 (step S1). The extraction unit 2 then determines whether or not a danger voice of the embodiment is extracted from the recognized utterance (step S2). At this time, the danger voice is a voice that indicates danger, such as "Danger!", "Wow!", "Are you serious?", "That's dangerous!", or "Oh no!". If the danger voice is not extracted in the determination of step S2 (step S2: NO), the processing unit 10 proceeds to step S8 described below.

On the other hand, if the danger voice of the embodiment is extracted from the recognized speech in the judgment of step 2 (step S2: YES), the control unit 2 immediately displays the hazard switch image of the embodiment on the display DP (step S3) and starts timing on a timer (not shown) (step S4).

The hazard switch image displayed in step S3 is, for example, the hazard switch image MK illustrated in FIG. 4(a). At this time, as illustrated in FIG. 4(a), if a display DP is provided together with a touch panel TP in an area surrounded by the center console CC, dashboard DB, and front window W of the vehicle, the hazard switch image MK is displayed as large as possible in the displayable area of the display DP. When any of the passengers touches a part of the displayed hazard switch image MK, the vehicle's hazard lights are turned on.

Therefore, while the hazard switch image MK is being displayed, the processing unit 10 monitors whether or not a preset time (e.g., 5 seconds) corresponding to the illumination of the hazard lamps has elapsed in the timing started in step S4 (step S5). If the preset time has not elapsed in the monitoring in step S5 (step S5: NO), the processing unit 10 then determines whether or not the touch operation on the hazard switch image MK via the touch panel TP has been performed (step S6). If the determination in step S6 indicates that the touch operation has not been performed (step S6: NO), the processing unit 10 continues the timing. On the other hand, if the determination in step S6 indicates that the touch operation has been performed (step S6: YES), the processing unit 10 starts illumination of the hazard lamps in response to the touch operation and proceeds to step S7, which will be described later.

On the other hand, if the preset time has elapsed in the monitoring of step S5 (step S5: YES), or if the touch operation has been performed in the judgment of step S6 (step S6: YES), the processing unit 10 ends the display of the hazard switch image MK on the display DP (step S7). The processing unit 10 then judges whether or not to end the display control process of the embodiment, for example, because the vehicle has reached its destination (step S8). If the judgment of step S8 is that the display control process of the embodiment should continue to be executed (step S8: NO), the processing unit 10 returns to step S1 and continues the series of processes described above. On the other hand, if the judgment of step S8 is that the display control process of the embodiment should be ended (step S8: YES), the processing unit 10 ends the display control process as it is.

As described above, according to the display control process of the embodiment, when a danger sound is extracted from the voice of a vehicle occupant, an operation image such as a hazard switch image MK for activating a function corresponding to the danger sound (e.g., turning on the hazard lamps) is displayed on the display DP, so that a necessary function can be quickly activated in response to the occurrence of a danger.

In addition, if the function corresponding to the danger sound is a function for turning on the hazard lights, and the operation image is a hazard switch image MK, the hazard lights can be turned on quickly in response to the occurrence of danger.

Furthermore, if no operation is performed on the operation image until a predetermined time has elapsed from the start of displaying the operation image (see step S5: NO and step S6: NO in FIG. 4), the display of the operation image is terminated (see step S7 in FIG. 4), so that the display of the operation image that did not require any operation can be terminated and returned to the original display.

In addition, in the extraction of dangerous sounds in the display control process of the embodiment, it may be configured so that it is determined that a dangerous sound has been extracted from the utterance only if the strength of the sound's vocabulary (particularly the ending) is higher (stronger) than a threshold value that is preset according to the content of the dangerous sound (see step S2 in FIG. 4: YES). In this case, whether or not to display an operation image is determined based on the strength of the sound's vocabulary (particularly the ending) of the extracted dangerous sound, so that a necessary function can be quickly and accurately activated in response to the occurrence of a danger.

Variations

Next, a modification of the above-described embodiment will be described.
(I) First Modification
First, as the first modified example, in the above-mentioned embodiment, when a danger sound is extracted (see step S2 in FIG. 4: YES), a hazard switch image MK for turning on a hazard lamp is displayed on the display DP. However, in addition to this, in the case where there is a function for non-volatilely recording the image data from the camera 14 in the embodiment in the recording unit 11 (i.e., when the navigation device SS has a so-called drive recorder function), when a danger sound is extracted, a record button image MK2 as exemplified in FIG. 4(b) for starting the recording function is displayed on the display DP and a touch operation from the passenger is waited for. In this case, since the record button image MK2 is immediately displayed on the display DP when a danger sound is extracted, the recording function can be quickly started in response to the occurrence of a danger. Note that the first modified example can also be applied when the part functioning as the drive recorder including the camera 14 in the first modified example is a so-called retrofit drive recorder separate from the navigation device SS.

The hazard switch image MK of the embodiment and the record button image MK2 of the first modified example may be displayed on the display DP in parallel, for example, vertically or horizontally, and the hazard lamp lighting function and the image data recording function may be activated simultaneously by touching these simultaneously.

(II) Second Modification
Next, as a second modified example, in the above-mentioned embodiment, the embodiment is applied to the case where the display DP is provided in the vehicle itself (see FIG. 4). However, in addition to this, for example, when a smartphone (not shown) carried by a vehicle occupant is connected to the processing unit 10 by short-distance wireless communication, and the hazard lamp lighting function or the image data recording function can be activated by a touch operation on a touch panel provided on the display of the smartphone, the embodiment can also be applied to the case where the hazard switch image MK and/or the recording button image MK2 of the embodiment are displayed on the display of the smartphone. In this case, by displaying the hazard switch image MK etc. on a display that is closer to the occupant, the necessary functions can be activated more quickly in response to the occurrence of a danger.

The above-mentioned program corresponding to the display control process of the embodiment can be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and then read out and executed by a general-purpose microcomputer or the like, thereby causing the microcomputer or the like to function as the processing unit 10 of the embodiment.

1 Extraction means (extraction part)
2 Control means (control unit)
DP Display means (display)
S Display control device SS Navigation device TP Touch panel MK Hazard switch image MK2 Recording button image

Claims (8)

An extraction means for extracting danger voice indicating danger from the voice of a passenger of the vehicle;
a control means for displaying, when the danger sound is extracted, at least one of i) a first operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) a second operation image for activating a function of recording at least image data of an image captured around the moving body, on a display means;
A display control device comprising: 2. The display control device according to claim 1,
13. A display control device according to claim 12, wherein the first operation image is an image of a hazard switch . 2. The display control device according to claim 1 ,
The display control device according to claim 1, wherein the second operation image is an image of a record button . The display control device according to any one of claims 1 to 3,
The moving object is a vehicle,
A display control device, wherein the display means is provided in a portable device carried by a passenger of the vehicle. The display control device according to any one of claims 1 to 4,
the control means includes a determination means for determining whether or not to cause the display means to display the operation image based on a strength of a ending of the extracted danger sound,
The display control device is characterized in that the control means causes the display means to display the operation image when it is determined that the operation image is to be displayed. The display control device according to any one of claims 1 to 5,
The display control device is characterized in that the control means terminates the display of the operation image when no operation is performed on the operation image within a predetermined time corresponding to the function from the start of display of the operation image. A display control method executed in a display control device including an extraction means and a control means,
an extraction step of extracting a danger voice indicating danger from a voice of a passenger of the vehicle by the extraction means;
a control step of causing the control means to display, when the danger sound is extracted, at least one of i) an operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) an operation image for activating a function of recording at least image data of an image captured around the moving body, on the display means;
A display control method comprising: Computer,
An extraction means for extracting danger voice indicating danger from the voice of a passenger of the vehicle; and
a control means for displaying, when the danger sound is extracted, at least one of: i) an operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) an operation image for activating a function of recording at least image data of an image captured around the moving body , on a display means;
A display control program that causes the display control program to function as a display control program.

Images