JP6822538B2 - Vehicle imaging recording device, vehicle imaging control method and program - Google Patents

Description

The present invention relates to a vehicle imaging recording device, a vehicle imaging control method, and a program.

In recent years, drive recorders as image recording devices for vehicles have become widespread. The drive recorder records video data for a predetermined period before and after the occurrence of an event (acceleration detection due to an accident or the like) as event recording data. Patent Document 1 discloses a drive recorder that removes and records music from sound data included in video data based on music data acquired from an audio device.

JP-A-2017-134646

However, in the drive recorder disclosed in Patent Document 1, whether or not to perform the music canceling process for removing the music is performed by the changeover switch, which needs to bother the user.

The present invention has been made in view of the above background, and an object of the present invention is to provide an image pickup / recording device for a vehicle capable of more reliably recording a voice related to an accident.

The present invention is an image pickup / recording device for a vehicle, and a process of recording a peripheral video / audio acquisition unit for acquiring video and audio around the vehicle and a video / audio acquired by the peripheral video / audio acquisition unit in the recording unit. The recording control unit to be controlled, the electronic device audio acquisition unit that acquires the electronic device audio output by the electronic device, and the audio acquired by the peripheral video / audio acquisition unit are included in the audio acquired by the peripheral video / audio acquisition unit. The recording control unit includes a cancel processing unit that performs a cancel process that reduces the voice of the electronic device, and an abnormality detection unit that detects an abnormality in the vehicle. When the abnormality detection unit detects an abnormality, the cancellation is performed. The canceled sound that has been canceled by the processing unit is recorded on a recording medium together with the video acquired by the peripheral video / audio acquisition unit.

The present invention is a vehicle imaging control method, in which a first step of acquiring video and audio around a vehicle and acquiring electronic device audio output by an electronic device and the acquired audio around the vehicle are obtained. On the other hand, the second step of performing the cancel process for reducing the electronic device sound included in the sound around the vehicle and the cancel sound obtained by performing the cancel process when an abnormality of the vehicle is detected. It includes a third step of recording on a recording medium together with an image of the surroundings of the vehicle.

The present invention is a program for causing a computer to execute a processing procedure for vehicle imaging recording, and is a program for causing a computer to execute a processing procedure for vehicle imaging recording, and is a program around a vehicle. The vehicle is based on the first processing procedure for acquiring the video and audio and the electronic device audio output by the electronic device, and the acquired electronic device audio characteristics for the acquired audio around the vehicle. The second processing procedure for performing a cancel process for reducing the electronic device sound included in the sound around the vehicle, and the vehicle that has acquired the cancel sound for which the cancel process unit has performed the cancel process when the vehicle abnormality is detected. It includes a third processing procedure of recording on a recording medium together with an image of the surroundings of the above.

According to the present invention, it is possible to more reliably record the voice related to the accident.

It is a block diagram which shows the structure of the drive recorder as the image pickup recording apparatus for a vehicle which concerns on Embodiment 1. FIG. It is a flowchart which shows an example of the process flow concerning the recording operation of the drive recorder which concerns on Embodiment 1. FIG. It is a block diagram which shows the structure of the drive recorder as the image pickup recording apparatus for a vehicle which concerns on Embodiment 2. FIG. It is a block diagram which shows the structure of the drive recorder as a vehicle image pickup recording apparatus which concerns on Embodiment 3. FIG.

Hereinafter, the present invention will be described through embodiments of the invention, but the inventions in the claims are not limited to the following embodiments. Moreover, not all of the configurations described in the embodiments are indispensable as means for solving the problem. The following descriptions and drawings have been omitted or simplified as appropriate for the purpose of clarifying the explanation. In each drawing, the same elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary.

[Embodiment 1]
FIG. 1 is a block diagram showing a configuration of a drive recorder 1 as an image pickup / recording device for a vehicle according to a first embodiment. The drive recorder 1 is a device that records at least moving image data that combines images around the vehicle (own vehicle) and sounds inside and outside the vehicle. As shown in FIG. 1, the drive recorder 1 includes a camera 10, a microphone 23, a sensor 24, a recording unit 25, a display unit 26, a speaker 27, and a control unit 30.

The camera 10 is for photographing the surroundings of the own vehicle, and mainly includes a lens, an image sensor, an AFE (analog front end), a drive motor, and the like. The image data taken by the camera 10 is input to the control unit 30. The microphone 23 is a device installed in a vehicle interior (for example, a rear-view mirror) to collect sound in the vehicle interior. The voice data collected by the microphone 23 is input to the control unit 30.

The control unit 30 performs processing related to the recording operation of the drive recorder 1. The flow of processing related to the recording operation of the drive recorder 1 will be described later. The control unit 30 is connected to the camera 10 and the microphone 23 by wire or wirelessly. The control unit 30 includes a peripheral video / audio acquisition unit 31, an electronic device audio acquisition unit 32, a buffer memory 33, a recording control unit 34, an abnormality detection unit 35, a playback control unit 36, a cancellation processing unit 37, and the like. including.

The peripheral video / audio acquisition unit 31 acquires video and audio around the vehicle. The peripheral image / audio acquisition unit 31 acquires the image of the periphery of the vehicle taken by the camera 10. Further, the peripheral video / audio acquisition unit 31 acquires audio around the vehicle from, for example, the microphone 23. The video and audio acquired by the peripheral video / audio acquisition unit 31 are temporarily recorded in the buffer memory 33.

The electronic device sound acquisition unit 32 acquires the electronic device sound output by the electronic device 28. Here, the electronic device 28 is, for example, a car navigation system or a car audio system. The electronic device may be a portable device capable of playing music, such as a smartphone. When the electronic device 28 is a portable device, the electronic device voice acquisition unit 32 acquires a voice signal via wireless communication.

The cancel processing unit 37 performs a cancel process for reducing (cancelling) the electronic device audio included in the audio acquired by the peripheral video / audio acquisition unit 31. Specifically, the cancel processing unit 37 performs phase inversion, delay adjustment, and volume adjustment of the acquired electronic device sound, and adds the canceled sound to the vehicle internal (peripheral) sound collected by the microphone to perform the cancel process. .. The cancellation process is not necessarily limited to the cancellation that completely erases the electronic device sound, and may be a process that reduces the electronic device sound.

The image of the periphery of the vehicle taken by the camera 10 acquired by the electronic device sound acquisition unit 32 is temporarily recorded in the buffer memory 33. Further, two types of audio, that is, the audio acquired by the peripheral video / audio acquisition unit 31 and the canceled audio obtained by canceling the audio acquired by the peripheral video / audio acquisition unit 31, are temporarily recorded in the buffer memory 33. To.

The recording control unit 34 controls the process of recording the acquired video and audio in the recording unit 25. The recording control unit 34 selects at least one of the two types of audio recorded in the buffer memory 33, integrates the selected audio into the video, and records it in the recording unit 25. The details of the processing will be described in the flow of processing related to the imaging recording operation of the drive recorder 1 described later.

The recording unit 25 is a memory for recording video data. The recording unit 25 is a non-volatile memory such as a flash memory. If the recording unit 25 is a detachable memory card, the drive recorder 1 needs to be provided with a connection interface for connecting the memory card. The recording unit 25 may be another device that records video data via a communication line or the like.

The abnormality detection unit 35 detects the occurrence of an abnormality (event) for the own vehicle by the sensor 24 or the like. For example, when the sensor 24 is an acceleration sensor, the abnormality detection unit 35 acquires an acceleration signal from the sensor 24, and when the acceleration signal has a magnitude equal to or larger than a preset threshold value, an abnormality such as a collision occurs with respect to the own vehicle. Is detected. The abnormality is not limited to an accident such as a collision, but may be a sign that an accident may occur, such as a wobbling of the vehicle body.

The abnormality detection by the abnormality detection unit 35 is not limited to that by the acceleration sensor. The sensor 24 may be, for example, an optical sensor that detects an abnormality based on the degree of lane departure, the distance between vehicles and other vehicles, and the like. When the sensor 24 is, for example, a volume sensor and a loud voice such as a scream is generated in the vehicle interior, when the own vehicle is impacted and a loud impact sound is generated, or when a horn is sounded from another surrounding vehicle, etc. , An abnormality may be detected when a volume equal to or higher than a predetermined volume is detected. The sensor 24 may be built in the drive recorder 1 or may be a separate body from the drive recorder 1.

When the playback control unit 36 receives a playback command for the designated video / audio data recorded in the recording unit 25, the playback control unit 36 displays the video of the video / audio data on the display unit 26, which is a display device, and displays the video / audio data. Is output from the speaker 27.

Next, the flow of processing related to the imaging recording operation of the drive recorder 1 will be described. In the following description, FIG. 1 will be referred to as appropriate for the configuration of the drive recorder 1.

FIG. 2 is a flowchart showing an example of a processing flow related to the imaging recording operation of the drive recorder 1. As shown in FIG. 2, first, the peripheral video / audio acquisition unit 31 acquires the video and audio around the vehicle, and the electronic device audio acquisition unit 32 acquires the electronic device audio output by the electronic device 28 (step S101). ). Subsequently, the cancel processing unit 37 performs a cancel process on the acquired voice around the vehicle to reduce the electronic device voice included in the voice around the vehicle based on the characteristics of the acquired electronic device voice (step). S102). The video and audio around the vehicle acquired by the peripheral video / audio acquisition unit 31 and the canceled audio are temporarily recorded in the buffer memory 33.

The recording control unit 34 determines whether or not the abnormality detection unit 35 has detected an abnormality (step S103). When the abnormality of the vehicle is not detected in step S103 (NO), the recording control unit 34 discards the cancel sound, integrates only the sound around the vehicle with the image around the vehicle, and records it in the recording unit 25. (Step S104). The recording mode on the recording unit 25 here is loop recording. Loop recording is recording that is overwritten after a certain period of time has elapsed. That is, in loop recording, when the recording capacity of the predetermined recording area in the recording unit 25 is full, the oldest one is overwritten and updated. When an abnormality of the vehicle is detected in step S103 (YES), the recording control unit 34 records the cancel voice and the voice around the vehicle in the recording unit 25 together with the image around the vehicle as overwrite prohibition (step S105). ).

Following step S104 or step S105, it is determined whether or not there is a command to end the imaging recording operation (step S106). In step S106, when there is a command to end the imaging recording operation (YES), the imaging recording operation is terminated. In step S106, if there is no command to end the imaging recording operation (NO), the process returns to step S101.

In step S105, when the abnormality detection unit 35 detects an abnormality, the recording control unit 34 determines which of the cancel voice and the voice acquired by the peripheral video / audio acquisition unit 31 is selected by the peripheral video / audio acquisition unit 31. You may choose to integrate with the acquired video. Alternatively, when the video / audio when the abnormality is detected by the abnormality detection unit 35 is reproduced, the user can select which audio is to be integrated with the video acquired by the peripheral video / audio acquisition unit 31. You may.

From the above, the drive recorder 1 according to the present embodiment acquires the video and audio around the vehicle and the electronic device audio output by the electronic device. Then, with respect to the acquired voice around the vehicle, a cancel process is performed to reduce the voice of the electronic device included in the voice around the vehicle. Further, when an abnormality in the vehicle is detected, both the canceled sound and the sound acquired by the peripheral video / audio acquisition unit 31 are recorded in the recording unit 25 as overwrite prohibition together with the video acquired by the peripheral video / audio acquisition unit 31. By doing so, when the sound acquired by the peripheral video / sound acquisition unit 31 is obstructed by the sound of the electronic device when an abnormality in the vehicle is detected, the canceled sound is reproduced. , The sound related to the accident can be reproduced more reliably. When an abnormality in the vehicle is detected, the recording unit 25 records the voice acquired by the peripheral video / audio acquisition unit 31, that is, the voice that has not been canceled, together with the cancel voice. Therefore, the voice that has not been canceled can be used as evidence of an accident that has not been tampered with.

[Embodiment 2]
FIG. 3 is a block diagram showing a configuration of a drive recorder 101 as a vehicle image pickup / recording device according to a second embodiment. As shown in FIG. 3, the drive recorder 101 according to the second embodiment further includes a voice type determination unit 38 in the control unit 130 with respect to the configuration of the drive recorder 1 according to the first embodiment shown in FIG. ing.

The voice type determination unit 38 determines whether or not the electronic device voice acquired by the electronic device voice acquisition unit 32 is road information or information (route guidance information) related to a route set by the user. Whether or not the information is route guidance information is determined by comparing the frequency characteristics with the machine voice that transmits the route guidance information and pattern matching, which are specified in advance.

The flow of processing related to the imaging recording operation of the drive recorder 101 is basically the same as the flow of processing related to the imaging recording operation of the drive recorder 1 described with reference to FIG. In the drive recorder 101, when the voice type determination unit 38 determines that the electronic device voice is the route guidance information in step S105 of FIG. 2, the recording control unit 34 controls the voice acquired by the peripheral video / voice acquisition unit 31. Is selected and integrated with the video acquired by the peripheral video / audio acquisition unit 31. That is, when the acquired electronic device audio is route guidance information, the audio that is not canceled is integrated with the video data.

For example, if the route guidance information such as a car navigation system indicates a left turn, but you apologize and go straight, or if you follow a route different from the instruction, you may cause an accident in an attempt to recover. Is also assumed. It is also assumed that the cause of the accident is the attention to the route guidance information. As described above, the route guidance information included in the voice when the abnormality of the vehicle is detected is often useful for the verification of the accident. Therefore, when the acquired electronic device audio is route guidance information, the accident verification can be performed more smoothly by integrating the audio that is not canceled with the video data.

[Embodiment 3]
FIG. 4 is a block diagram showing a configuration of a drive recorder 201 as a vehicle image pickup / recording device according to a third embodiment. As shown in FIG. 4, the drive recorder 201 according to the third embodiment detects an abnormality level in the abnormality detection unit 35 of the control unit 230 with respect to the configuration of the drive recorder 1 according to the first embodiment shown in FIG. A portion 35a is further provided. The abnormality level detection unit 35a detects the abnormality of the own vehicle step by step. That is, for example, when the sensor 24 is an acceleration sensor, when the abnormality detection unit 35 acquires an acceleration signal from the sensor 24, the abnormality level detection unit 35a determines the abnormality level from the magnitude of the acceleration signal. If the acquired acceleration is large, it can be determined that the accident is a serious accident such as a collision with another vehicle or a pedestrian. When the acquired acceleration is small, it can be determined that it is a so-called hiyari hat phenomenon in which the abnormal level is relatively low, such as sudden braking or overcoming a step on the road. When the sensor 24 is a volume sensor, a sound determination unit (not shown) may determine whether it is a collision impact sound, a scream in the vehicle interior, or a horn of another vehicle, or an abnormality level may be determined by the volume. Good. Further, the risk of collision with the vehicle in front may be determined from the video data captured by the camera 10 or a distance sensor (not shown), and it may be determined that the abnormality level is high depending on the risk. Similarly, the degree of danger of deviating from the traveling lane may be determined from the video data captured by the camera 10.

The recording control unit 34 determines how much the cancel processing unit 37 reduces the electronic device audio included in the audio acquired by the peripheral video / audio acquisition unit 31 according to the abnormality level detected by the abnormality level detection unit 35a. Or, decide whether to perform the cancellation process. If it is determined that the accident has a high abnormality level, the acquired video data is likely to be evidence of the accident. Therefore, do not perform audio cancellation processing or reduce the degree of reduction so that the data is not tampered with. It is preferable to do so. If the anomaly level is relatively low, that is, the record of the so-called hiyari hat phenomenon, it is less likely that evidence ability will be required. At this time, in order to record the factor determined to be abnormal in more detail, it is preferable to perform a voice canceling process considered to be unrelated to the abnormality to increase the degree of voice reduction. If it is determined that the abnormal level is high, in order to achieve both evidence ability and detailed situation recording that is not hindered by audio, both audio with audio cancellation processing and audio without audio cancellation processing are recorded together with the video. May be good.

Although the invention made by the present inventor has been specifically described above based on the embodiment, the present invention is not limited to the embodiment and can be variously modified without departing from the gist thereof. Needless to say. In addition, the configuration in each embodiment may be appropriately exchanged between the respective embodiments. For example, the drive recorder 101 according to the second embodiment may be provided with an abnormality level detection unit 35a of the drive recorder 201 according to the third embodiment.

The processing in each part of the vehicle imaging recording device according to the present invention can be realized by causing a computer or the like to execute a program. More specifically, in the vehicle imaging recording device, the program stored in the program memory is loaded into the main storage device, and the program is executed and realized under the control of the CPU. Here, the program can be stored and supplied to a computer using various types of non-transitory computer readable media. Non-transient computer-readable media include various types of tangible storage media (tangible storage media). Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), photomagnetic recording media (eg, photomagnetic disks), CD-ROMs (Read Only Memory), CD-Rs, It includes a CD-R / W, a semiconductor memory (for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, and a RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer readable media (transitory computer readable media). Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path. Further, the processing in each part of the vehicle image pickup / recording device is not limited to being realized by software by a program, and may be realized by any combination of hardware, firmware, and software.

1, 101, 201 Drive recorder 10 Camera 23 Microphone 24 Sensor 25 Recording unit 26 Display unit 27 Speaker 28 Electronic device 30, 130, 230 Control unit 31 Peripheral video / audio acquisition unit 32 Electronic device audio acquisition unit 33 Buffer memory 34 Recording control unit 35 Abnormality detection unit 35a Abnormality level detection unit 36 Playback control unit 37 Cancel processing unit 38 Voice type judgment unit

Claims (4)

Peripheral video / audio acquisition unit that acquires video and audio around the vehicle,
A recording control unit that controls the process of recording the video and audio acquired by the peripheral video / audio acquisition unit in the recording unit.
An electronic device audio acquisition unit that acquires electronic device audio output by an electronic device,
A cancel processing unit that performs a cancel process for reducing the electronic device audio included in the audio acquired by the peripheral video / audio acquisition unit with respect to the audio acquired by the peripheral video / audio acquisition unit.
It is equipped with an abnormality detection unit that detects an abnormality in the vehicle.
When the abnormality detection unit detects an abnormality, the recording control unit records the cancellation sound that the cancellation processing unit has canceled, together with the video acquired by the peripheral video / audio acquisition unit, on a recording medium for vehicles. Imaging recording device. The abnormality detection unit further includes an abnormality level detection unit that detects an abnormality step by step.
The recording control unit determines how much the cancellation processing unit reduces the electronic device sound included in the sound acquired by the peripheral video / audio acquisition unit according to the level of the abnormality detected by the abnormality level detection unit. The vehicle imaging recording device according to claim 1, which is determined. The first step of acquiring the video and audio around the vehicle and the electronic device audio output by the electronic device,
A second step of canceling the acquired voice around the vehicle to reduce the voice of the electronic device included in the voice around the vehicle.
A vehicle imaging control method comprising a third step of recording a canceled voice subjected to the canceling process on a recording medium together with an acquired image of the surroundings of the vehicle when an abnormality of the vehicle is detected. A program that allows a computer to execute processing procedures for vehicle imaging recording.
The first processing procedure for acquiring the video and audio around the vehicle and the electronic device audio output by the electronic device,
A second processing procedure for canceling the acquired voice around the vehicle to reduce the voice of the electronic device included in the voice around the vehicle based on the characteristics of the acquired voice of the electronic device.
A program including a third processing procedure of recording the canceled voice subjected to the canceling process on a recording medium together with the acquired image of the surroundings of the vehicle when an abnormality of the vehicle is detected.

Images