JP7351111B2 - Vehicle recording control device, recording control method and program - Google Patents

Description

The present invention relates to a vehicle recording control device, a recording control method, and a program.

2. Description of the Related Art Recording devices such as drive recorders are known that store video data triggered by recognition of an event such as an accident. When verifying a vehicle accident, information written on the license plate of another vehicle may be useful for verifying the accident. For example, Patent Document 1 discloses a device that recognizes other vehicles and license plates from moving images and stores information about the other vehicles and license plates.

Japanese Patent Application Publication No. 2016-170735

For example, if the structure of a motorcycle is such that vibrations caused by running are directly transmitted to the mounting position of the recording device, license plate information may not be properly acquired from captured video data.

The present invention has been made in view of the above, and an object of the present invention is to provide a recording control device for a vehicle, a recording control method, and a program that can contribute to suitable identification of other vehicles to be photographed.

In order to achieve the above object, a vehicle recording control device according to one aspect of the present invention includes a video data acquisition unit that acquires video data captured by an imaging unit that photographs the surroundings of a vehicle, and a video data acquisition unit that acquires a recognition processing unit that recognizes information written on the other vehicle and the recognized license plate of the other vehicle from frame images constituting the video data; When the information written on the recognized other vehicle is recognized, the recognized other vehicle is associated with the information written on the recognized other vehicle's license plate, and the recognized other vehicle is included and the recognized other vehicle's license plate is identified. Even if the information written on the plate cannot be recognized in a frame image, the information written on the license plate of the other vehicle that is associated with the recognized other vehicle is associated with the other vehicle recognized in the frame image. An attaching processing section.

In order to achieve the above object, a recording control method according to one aspect of the present invention includes a video data acquisition step of acquiring video data captured by an imaging unit that photographs the surroundings of a vehicle; A recognition step of recognizing information written on the license plate of the other vehicle and the recognized other vehicle from frame images constituting the data; and a recognition step of recognizing information written on the license plate of the other vehicle and the recognized other vehicle in the recognition step. When the information is recognized, the recognized other vehicle is associated with the information written on the license plate of the recognized other vehicle, and the recognized other vehicle is included and the information written on the recognized other vehicle's license plate is determined. an association processing step for associating information written on a license plate of another vehicle associated with the recognized other vehicle with the other vehicle recognized in the frame image, even if the information recorded in the frame image is unrecognizable; ,including.

In order to achieve the above object, a program according to one aspect of the present invention includes a video data acquisition step of acquiring video data captured by an imaging unit that photographs the surroundings of a vehicle, and a video data acquisition step of acquiring video data captured in the video data acquisition step. A recognition step of recognizing the information written on the license plate of the other vehicle and the recognized other vehicle from the constituent frame images; and a recognition step of recognizing the information written on the license plate of the other vehicle and the recognized other vehicle in the recognition step. When recognized, the recognized other vehicle is associated with the information written on the license plate of the recognized other vehicle, and the information that includes the recognized other vehicle and written on the license plate of the recognized other vehicle is determined. Even if the frame image is unrecognizable, the step of associating the information written on the license plate of the other vehicle associated with the recognized other vehicle with the other vehicle recognized in the frame image; This is executed by a computer that operates as a vehicle recording control device.

According to the present invention, it is possible to contribute to suitable identification of other vehicles to be photographed.

FIG. 1 is a block diagram showing an example of the configuration of a recording apparatus according to the first embodiment. FIG. 2 is a schematic diagram showing an example of a frame image according to the first embodiment. FIG. 3 is a schematic diagram showing an example of another frame image corresponding to FIG. 2. FIG. 4 is a flowchart illustrating an example of the flow of recording processing by the control device according to the first embodiment. FIG. 5 is a schematic diagram illustrating the functions of the control device according to the first embodiment. FIG. 6 is a flowchart illustrating an example of the flow of recording processing by the control device according to the second embodiment. FIG. 7 is a schematic diagram illustrating the functions of the control device according to the second embodiment. FIG. 8 is a flowchart illustrating an example of the flow of regeneration processing by the control device. FIG. 9 is a schematic diagram showing an example of a playback screen. FIG. 10 is a schematic diagram showing an example of another playback screen corresponding to FIG. 9.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the present invention is not limited to this embodiment, and if there are multiple embodiments, the present invention may be configured by combining each embodiment.

(First embodiment)
[Device configuration]
A recording apparatus according to a first embodiment of the present invention will be described using FIG. 1. FIG. 1 is a block diagram showing an example of the configuration of a recording apparatus according to a first embodiment of the present invention. The recording device 1 is a vehicle recording device such as a drive recorder that records events that occur in the vehicle. The recording device 1 records video data as event record data based on events detected while the vehicle is running and parking. The video data includes moving image data consisting of continuous frame images. The recording device 1 associates the photographed other vehicle with the information written on the license plate of the other vehicle in the video data corresponding to the detection of the event. The recording device 1 may be referred to as a recording and reproducing device if it has a function of reproducing video data such as event record data.

The recording device 1 is mounted on any moving body including various vehicles. In addition to being mounted on a moving body such as a vehicle, the recording device 1 may be a device that is portable and usable in a moving body such as a vehicle. Further, the recording device 1 may be realized by including functions or configurations of a device or a navigation device installed in advance in a moving object such as a vehicle. In the following description, the recording device 1 will be described as being attached to a vehicle. The recording device 1 includes an imaging section 10, a recording section 20, a recognition dictionary storage section 30, an operation section 40, a display section 50, a sensor 60, and a GPS (Global Navigation Satellite System), which is an example of a GNSS (Global Navigation Satellite System). The controller includes a positioning system (positioning system) receiving section 70, a CAN (controller area network) interface section (hereinafter referred to as "IF section") 80, and a control device 100 as a vehicle recording control device.

The imaging unit 10 is a camera used in a vehicle in which the recording device 1 is mounted, and photographs an arbitrary range inside and outside the vehicle interior. The imaging unit 10 may be, for example, a camera specific to the recording device 1 or a camera for overhead video images attached to a vehicle. The imaging unit 10 may be, for example, a camera that photographs the front of the vehicle, a camera that photographs the rear of the vehicle, a camera that photographs the side of the vehicle, or a combination thereof, and photographs the surroundings of the vehicle. A camera unit including a plurality of cameras or an all-around camera may be used. Furthermore, it may include a camera that photographs the interior of the vehicle. The imaging unit 10 outputs video data captured by a camera used in the vehicle to the video data acquisition unit 120.

The recording unit 20 records various data in the recording device 1. The recording unit 20 records, for example, video data captured by the imaging unit 10 while the vehicle is running and while the vehicle is parked. The recording unit 20 stores, for example, video data for a predetermined period based on event detection as event record data. The recording unit 20 can be realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or a solid state drive. The recording unit 20 may be configured with a plurality of different memories. Alternatively, it may be an external recording unit that is wirelessly connected via a communication device (not shown). The recording unit 20 records video data or event recording data based on a control signal output from the recording control unit 123 of the control device 100.

The recognition dictionary storage unit 30 stores various recognition dictionaries for recognizing information on other vehicles and license plates of other vehicles from video data. The recognition dictionary stored in the recognition dictionary storage unit 30 is a dictionary in which vehicles viewed from various angles and various types of vehicles are machine-learned in advance in order to recognize various vehicles from video data, for example. Further, the recognition dictionary storage unit 30 may store a dictionary for specifying the license plate of another vehicle, a dictionary for recognizing characters written on the specified license plate, and the like. The recognition processing unit 125 refers to the recognition dictionary stored in the recognition dictionary storage unit 30. The recognition dictionary storage unit 30 may be a storage device such as an external server connected via a communication function (not shown).

The operation unit 40 is an interface that accepts various operations on the recording device 1. The operation unit 40 can accept, for example, an operation to manually save captured video data in the recording unit 20 as event record data. The operation unit 40 can accept, for example, an operation for reproducing video data or event recording data recorded in the recording unit 20. The operation unit 40 can accept, for example, an operation to delete event record data recorded in the recording unit 20. The operation unit 40 can accept, for example, an operation to start or end the operation of the recording device 1. The operation unit 40 outputs an operation signal according to the received operation to the operation control unit 126. The operation unit 40 can be realized by, for example, a physical switch or a touch panel provided on the display unit 50.

The display unit 50 displays various images. The display unit 50 displays a reproduced video when, for example, event record data recorded by the recording unit 20 is reproduced. The display unit 50 is, for example, a display device unique to the recording device 1 or a display device shared with other systems including a navigation system. The display section 50 may be formed integrally with the imaging section 10. The display unit 50 is a display including, for example, a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. In the present embodiment, the display unit 50 is arranged on a dashboard, an instrument panel, a center console, etc. in front of the driver of the vehicle. The display unit 50 displays video based on the video signal output from the display control unit 127 of the control device 100. The display unit 50 displays the video being photographed by the imaging unit 10 or the video recorded in the recording unit 20.

The sensor 60 is a sensor that detects various information resulting from the occurrence of an event on the vehicle. The sensor 60 is, for example, an acceleration sensor, and detects acceleration that occurs to the vehicle. The acceleration sensor is, for example, a sensor that detects acceleration in three axial directions. The three axial directions are the longitudinal direction, the horizontal direction, and the vertical direction of the vehicle. The sensor 60 is, for example, a gyro sensor, and detects information regarding the attitude of the vehicle. The sensor 60 outputs the detection result to the sensor information acquisition unit 128.

The GPS receiving unit 70 receives radio waves from a GPS satellite (not shown). The GPS receiving section 70 includes a GPS receiving circuit, a GPS receiving antenna, and the like. The GPS receiving unit 70 outputs the received radio wave signal to the position information acquiring unit 130.

The IF section 80 is an interface for acquiring various vehicle information via CAN. The vehicle information includes, for example, information regarding the operating status of the engine, the driving status of the vehicle, and the like.

The control device 100 is an arithmetic processing device (control device) including, for example, a CPU (Central Processing Unit). Control device 100 loads a stored program into memory and executes instructions included in the program. Control device 100 includes an internal memory (not shown) and the like. The internal memory stores programs for realizing each part of the control device 100. In this case, the control device 100 realizes the functions of each section by developing and executing programs stored in an internal memory or the like. The internal memory is also used for temporary storage of data in the control device 100. The control device 100 includes a video data acquisition unit 120, a buffer memory 121, a video data processing unit 122, a recording control unit 123, a playback control unit 124, a recognition processing unit 125, and an operation unit connected by a bus 110. It includes a control section 126, a display control section 127, a sensor information acquisition section 128, an event detection section 129, a position information acquisition section 130, a vehicle information acquisition section 131, and a correlation processing section 132.

The video data acquisition unit 120 acquires various types of video data from the outside. The video data acquisition unit 120 acquires video data captured by the imaging unit 10 from the imaging unit 10, for example. The video data acquisition unit 120 acquires video data of the surroundings of the vehicle. The video data acquisition unit 120 outputs the video data acquired from the imaging unit 10 to the buffer memory 121 and the display control unit 127, for example. In addition to the video data, the video data acquisition unit 120 may also acquire imaging data that includes audio data acquired by a microphone (not shown) located at the imaging unit 10 or at another location.

The buffer memory 121 is an internal memory of the control device 100 that temporarily stores the video data acquired by the video data acquisition unit 120. More specifically, the buffer memory 121 temporarily stores, while updating, a certain amount of time worth of video data acquired by the video data acquisition unit 120.

The video data processing unit 122 performs various processes on the video data temporarily stored in the buffer memory 121. The video data acquisition unit 120 acquires the video data temporarily stored in the buffer memory 121, for example, by using H. The file format is encoded using an arbitrary codec such as H.264 or MPEG-4 (Moving Picture Experts Group), and is converted into an arbitrary file format such as MP4 format. For example, the video data processing unit 122 generates video data as a data file for a certain period of time from the video data temporarily stored in the buffer memory 121. Specifically, the video data processing unit 122 generates 60 seconds of video data as one data file from the video data temporarily stored in the buffer memory 121. The video data processing section 122 outputs the generated video data to the recording control section 123. Although the period of video data generated as one data file is 60 seconds as an example, it is not limited to this. The video data referred to here may be data that includes audio in addition to video captured by the imaging unit 10.

The recording control section 123 records various data on the recording section 20. The recording control unit 123 controls, for example, to cause the recording unit 20 to record the video data that has been converted into a file by the video data processing unit 122. During a period when an event is not detected, such as when the accessory power of the vehicle is ON, the recording control unit 123 stores the video data that has been converted into a file by the video data processing unit 122 into the recording unit 20 as overwritable video data. to be recorded. More specifically, the recording control unit 123 continues to record the video data generated by the video data processing unit 122 in the recording unit 20 during a period when no event is detected. When the capacity of the recording unit 20 becomes full, the recording control unit 123 overwrites and records new video data over the oldest video data. Such recording processing is called loop recording processing.

When the event detection unit 129 detects the occurrence of an event, the recording control unit 123 stores video data corresponding to the detection of the event. The video data corresponding to event detection is video data of a predetermined period in the video data generated by the video data processing unit 122. The recording control unit 123 stores the video data corresponding to the detection of the event in the recording unit 20 as event recording data that is prohibited from being overwritten. When the other vehicle and license plate information are associated, the recording control unit 123 records the other vehicle recognized from the video data and the license plate information of the other vehicle while maintaining the association. , the event record data is stored in the recording unit 20 with overwriting prohibited.

The event recording data that the recording control unit 123 stores in the recording unit 20 is, for example, copying video data for a predetermined period of about 60 seconds before and after the event is detected from the buffer memory 121 and saving it as event recording data. .

The reproduction control unit 124 reproduces various data recorded in the recording unit 20. More specifically, the playback control unit 124 plays back arbitrary video data according to a control signal output from the operation control unit 126 and corresponding to the operation of the operation unit 40 . The playback control unit 124 plays back video data recorded as a data file in the recording unit 20, for example. The playback control unit 124 plays back event record data stored in the recording unit 20, for example.

The recognition processing unit 125 recognizes information on the other vehicle and the license plate of the other vehicle from the frame images forming the video data acquired by the video data acquisition unit 120. The recognition processing unit 125 refers to the recognition dictionary stored in the recognition dictionary storage unit 30 and recognizes information on other vehicles and license plates. The recognition processing unit 125 recognizes, for example, character information written on the license plate as the license plate information.

The operation control unit 126 acquires an operation signal related to an operation that the operation unit 40 receives from a user or the like. The operation control unit 126 acquires operation signals related to operations, such as storage operation information indicating a manual storage operation of video data, playback operation information indicating a playback operation, or deletion operation information indicating a video data deletion operation. The operation control section 126 outputs, for example, a control signal corresponding to the received operation signal to the recording control section 123 or the reproduction control section 124. In this case, the recording control section 123 and the reproduction control section 124 execute operations according to the control signals.

The display control section 127 causes the display section 50 to display various images. More specifically, the display control unit 127 outputs a video signal to the display unit 50, thereby causing the display unit 50 to display the video. The display control unit 127 outputs a video signal to be displayed by, for example, reproducing the video imaged by the imaging unit 10 or loop recording video data or event recording data recorded in the recording unit 20.

The sensor information acquisition unit 128 acquires various detection results from the sensor 60. The sensor information acquisition unit 128 acquires acceleration information applied to the vehicle from the sensor 60. The sensor information acquisition unit 128 acquires acceleration information when, for example, a vehicle collides with another object such as another vehicle. The sensor information acquisition unit 128 outputs the acquired detection results from the sensor 60 to the event detection unit 129.

The event detection unit 129 detects an event for the vehicle. The event detection unit 129 detects an event based on the detection result of the sensor 60 acquired by the sensor information acquisition unit 128. The event detection unit 129 detects an event based on, for example, the magnitude of acceleration as a detection result. The event detection unit 129 detects an event when the magnitude of the acquired acceleration is larger than a threshold value that allows determining that the acceleration corresponds to a collision. When the event detection unit 129 detects an event, it outputs a control signal indicating information that the event has been detected to the recording control unit 123. Detection of an event by the event detection unit 129 is not limited to detection of an event based on acceleration information, but is arbitrary. The event detection unit 129 may detect an event based on moving object detection based on the video data acquired by the video data acquisition unit 120, a detection result of a proximity sensor (not shown), or a combination of a plurality of sensor information.

The position information acquisition unit 130 acquires position information indicating the current position of the vehicle. The position information acquisition unit 130 calculates the position information of the current position of the vehicle based on the radio waves received by the GPS reception unit 70 using a known method. The position information acquisition unit 130 may calculate the position information of the current position of the vehicle using another positioning system including a quasi-zenith satellite. The position information calculated by the position information acquisition unit 130 may be stored in the recording unit 20 together with the event record data when the event detection unit 129 detects an event.

The vehicle information acquisition unit 131 acquires various vehicle information via CAN from the IF unit 80. The vehicle information acquisition unit 131 acquires, as vehicle information, information regarding the operation of the vehicle, such as information regarding the operation of the engine of the vehicle and vehicle speed information. Vehicle information acquisition section 131 outputs the acquired vehicle information to recording control section 123.

When the recognition processing unit 125 recognizes the other vehicle and the license plate information of the other vehicle, the association processing unit 132 associates the other vehicle with the license plate information. The association processing unit 132 associates the license plate information recognized in the frame image with the other vehicle in the frame image in which the other vehicle is included and the license plate information of the other vehicle cannot be recognized. If the recognition processing unit 125 recognizes license plate information of another vehicle in at least one of the frame images constituting the video data while the recognition processing unit 125 is recognizing the other vehicle, the association processing unit 132 associates the license plate with the other vehicle. Correlate with plate information. When associating other vehicles with license plate information, the association processing unit 132 associates the license plate information with the other vehicle in the frame image whose license plate information cannot be recognized.

[Correlation between other vehicles and license plate information]
The association between other vehicles and license plate information by the control device 100 according to the first embodiment will be described with reference to FIGS. 2 and 3. FIG. 2 is a schematic diagram showing an example of a frame image according to the first embodiment. FIG. 3 is a schematic diagram showing an example of another frame image corresponding to FIG. 2. The frame image F11 shown in FIG. 2 and the frame image F12 shown in FIG. 3 are frame images forming the video data acquired by the video data acquisition unit 120. It is assumed that all consecutive frame images from frame image F11 to frame image F12 include other vehicle C1.

As shown in FIG. 2, the frame image F11 includes the other vehicle C1 and the license plate N1 of the other vehicle C1. The recognition processing unit 125 recognizes the other vehicle C1 from the frame image F11. When recognizing the other vehicle C1, the recognition processing unit 125 starts recognition processing of the license plate N1 of the other vehicle C1. For example, the recognition processing unit 125 performs recognition processing for the license plate N1 of the other vehicle C1 from the other vehicle detection frame Fc11 that includes the other vehicle C1 in the frame image F11. When the recognition processing unit 125 recognizes the license plate N1, it recognizes the information of the license plate N1. The recognition processing unit 125 recognizes information about the license plate N1, for example, from the license plate detection frame Fn11 that includes the license plate N1 within the other vehicle detection frame Fc11. For example, when the recognition processing unit 125 recognizes the information of the license plate N1 included in the recognized other vehicle C1 at a predetermined rate or more, the recognition processing unit 125 processes the information as having recognized the information of the license plate N1. The predetermined ratio is, for example, 50% or more of the characters written on the license plate N1, or 3 or more characters. In the first embodiment, the recognition processing unit 125 recognizes character information written on the license plate N1. When the recognition processing unit 125 recognizes the character information written on the other vehicle C1 and the license plate N1 of the other vehicle C1 in the frame image F11, the association processing unit 132 recognizes the text information written on the other vehicle C1 and the license plate N1 of the other vehicle C1. It is stored in association with character information.

As shown in FIG. 3, the frame image F12 includes the other vehicle C1 and does not include the license plate N1 of the other vehicle C1. The recognition processing unit 125 recognizes the other vehicle C1 from the frame image F12. When recognizing the other vehicle C1, the recognition processing unit 125 starts recognition processing of the license plate N1 of the other vehicle C1. For example, the recognition processing unit 125 starts recognition processing for the license plate N1 of the other vehicle C1 from the other vehicle detection frame Fc12 that includes the other vehicle C1 in the frame image F12. When the recognition processing unit 125 does not recognize the information on the license plate N1 in the frame image F12, the association processing unit 132 replaces the text information written on the license plate N1 associated with the frame image F11 in the frame image F12. It is stored in association with the other vehicle C1. Furthermore, as shown in FIG. 3, the same matching process is performed for a frame image that includes the license plate N1 of another vehicle C1, and in which the license plate N1 cannot be properly recognized due to vibration or the like.

When the recognition processing unit 125 recognizes the information of the license plate N1 of the other vehicle C1 in at least one of the frame images constituting the video data while the recognition processing unit 125 is recognizing the other vehicle C1, the association processing unit 132 recognizes the license plate N1 of the other vehicle C1. The vehicle C1 is associated with the character information written on the license plate N1. When the association processing unit 132 associates the other vehicle C1 with the text information written on the license plate N1 in any of the frame images F11, the association processing unit 132 associates the text information written on the license plate N1 with the other vehicle C1 in any frame image F12 in which the text information written on the license plate N1 cannot be recognized. The character information written on the license plate N1 is associated with the other vehicle C1. The association between the other vehicle C1 and the character information written on the license plate N1 is maintained until the recognition processing unit 125 no longer recognizes the other vehicle C1.

[Processing by device]
The flow of video data recording processing by the control device 100 according to the first embodiment will be explained using FIGS. 4 and 5. Video data recording processing includes loop recording processing and event recording data storage processing. FIG. 4 is a flowchart illustrating an example of the flow of recording processing by the control device according to the first embodiment. FIG. 5 is a schematic diagram illustrating the functions of the control device according to the first embodiment. More specifically, FIG. 5 is a diagram showing an example of the other vehicle recognition period Pc1, the license plate recognition period Pn1, the association period Pm1, and the record storage period Ps1. The other vehicle recognition period Pc1 is a period from time t11 to time t16 during which the recognition processing unit 125 recognizes another vehicle, and in the case of FIGS. 2 and 3, it is a period during which the recognition processing unit 125 recognizes another vehicle C1. be. The license plate recognition period Pn1 is a period from time t12 to time t13 during which the recognition processing unit 125 recognizes the information on the license plate of another vehicle, and in the case of the example shown in FIG. This is the period during which plate N1 is recognized. The association period Pm1 is a period from time t12 to time t16 during which the association processing unit 132 associates other vehicles with license plate information. This is the period during which the vehicle C1 and the information on the license plate N1 are associated. The recording storage period Ps1 is a period from time t14 to time t15 that is recorded as event record data. The process shown in FIG. 4 is executed by the control device 100 based on a predetermined control program and data. For example, the control device 100 causes the operation control unit 126 to receive a predetermined operation signal related to a start operation that enables the vehicle to operate, that power is supplied from the vehicle to the recording device 1, or that the operation unit 40 receives from a user or the like. Upon acceptance, the process moves to step S101 shown in FIG. 4 and starts processing.

As shown in FIG. 4, the control device 100 starts loop recording processing of video data captured by the imaging unit 10, recognition processing of other vehicles and license plates, matching processing, and event detection processing (step S101). More specifically, the video data acquisition unit 120 starts acquiring the video data captured by the imaging unit 10. The buffer memory 121 starts temporarily storing the video data acquired by the video data acquisition unit 120. The video data processing unit 122 starts generating video data temporarily stored in the buffer memory 121 as a data file. The recording control unit 123 starts recording the video data generated by the video data processing unit 122 into the recording unit 20 . The recognition processing unit 125 starts recognition processing of information on the other vehicle and the license plate of the other vehicle from the frame image forming the video data acquired by the video data acquisition unit 120. The event detection unit 129 starts accepting detection results from the sensor 60. The event detection unit 129 starts event detection processing based on the received detection result.

As shown in FIG. 5, when the recognition processing unit 125 recognizes another vehicle at time t11, the recognition processing unit 125 performs recognition processing of the information on the license plate of the other vehicle. When the recognition processing unit 125 recognizes the license plate information of another vehicle at time t12, the association processing unit 132 associates the other vehicle with the license plate information. Even if the recognition processing unit 125 no longer recognizes the license plate at time t13, the association processing unit 132 continues to associate other vehicles with license plate information. In FIG. 5, the recognition processing unit 125 is able to recognize other vehicles during the period from time t11 to time t16, but the recognition processing unit 125 is able to recognize other vehicles during the period from time t11 to time t12 and from time t13 to time t16. This indicates that the license plate information of other vehicles cannot be recognized even though the vehicle can be recognized. Reasons why the license plate information of other vehicles cannot be recognized include the license plate being out of the shooting range or being obscured, or the license plate being captured but due to vehicle vibration, etc. This is the case when the license plate information cannot be recognized properly.

As shown in FIG. 4, after starting the process in step S101, the control device 100 moves to step S102 and determines whether an event for the vehicle has been detected (step S102). More specifically, control device 100 determines whether event detection unit 129 has detected an event. If the event is detected (step S102; Yes), the control device 100 moves to step S103. If no event is detected (step S102; No), the control device 100 moves to step S107.

If it is determined that an event has been detected (step S102; Yes), the control device 100 determines whether the other vehicle C1 is recognized (step S103). More specifically, control device 100 determines whether recognition processing unit 125 has already recognized another vehicle at time T1 when the event is detected. If the other vehicle is recognized (step S103; Yes), the control device 100 moves to step S104. If the other vehicle is not recognized (step S103; No), the control device 100 moves to step S106. In the example shown in FIG. 5, since the other vehicle has been recognized since time t11, which includes time T1 when the event was detected and is earlier than time T1, the control device 100 determines that the other vehicle has been recognized. to decide.

If the other vehicle is recognized (step S103; Yes), the control device 100 determines whether the license plate information of the recognized other vehicle is recognized (step S104). More specifically, the control device 100 determines whether the recognition processing unit 125 has already recognized the license plate information of the other vehicle at time T1 when the event is detected. If the information on the license plate of the recognized other vehicle is recognized (step S104; Yes), the control device 100 moves to step S105. If the license plate information of the recognized other vehicle C1 is not recognized (step S104; No), the control device 100 moves to step S106.

In the case of the example shown in FIG. 5, since the other vehicle is recognized at time t11 and the license plate of the other vehicle is recognized at time t12, which is before time T1 when the event is detected, the control device 100 It is determined that the license plate information of the recognized other vehicle is recognized. A period in the other vehicle recognition period Pc1 that is after the license plate recognition period Pn1 is an association period Pm1. That is, in the case of the example shown in FIG. 5, at time T1 when the event is detected, the other vehicle and the license plate information are associated with each other. Although the license plate recognition period Pn1 is illustrated as a period in FIG. 5, the same correspondence is possible even if the license plate can be recognized in only one frame of video.

If the information on the license plate of the recognized other vehicle is recognized (step S104; Yes), the control device 100 saves the video data before and after the event detection as event record data that is prohibited from being overwritten (step S105). At this time, the control device 100 stores the recognized other vehicle and license plate information in a state where they are associated with each other. More specifically, the recording control unit 123 records the video data of the recording storage period Ps1 before and after the event detection time T1 shown in FIG. , to be stored in the recording unit 20 as event record data. The control device 100 moves to step S107.

If the other vehicle is not recognized (step S103; No), or if the license plate information of the recognized other vehicle is not recognized (step S104; No), the control device 100 displays the images before and after the event detection. The data is saved with overwriting prohibited (step S106). More specifically, the recording control unit 123 causes the recording unit 20 to store video data before and after event detection as event recording data. In this case, the other vehicle and license plate information are not associated with each other and are therefore not saved. The control device 100 moves to step S107.

The control device 100 determines whether to end the loop recording process of the video data captured by the imaging unit 10, the recognition process of other vehicles and license plates, the association process, and the event detection process (step S107). More specifically, the control device 100 receives a predetermined operation signal related to a termination operation received by the operation unit 40 from the user or the like, for example, when the operation of the vehicle is finished, or when power is no longer supplied to the recording device 1 from the vehicle. , the operation control unit 126 determines whether or not it has been accepted. When the control device 100 determines to end the loop recording process, the recognition process, the association process, and the event detection process (step S107; Yes), the control device 100 ends the process of the flowchart shown in FIG. 4. When the control device 100 determines that the loop recording process, the recognition process, the association process, and the event detection process are not to be ended (step S107; No), the process proceeds to step S102.

When the control device 100 finishes the process of the flowchart shown in FIG. 4, the control device 100 ends the loop recording process of the video data captured by the imaging unit 10, the process of recognizing other vehicles and license plates, the process of matching, and the process of detecting an event. More specifically, the video data acquisition unit 120 finishes acquiring the video data captured by the imaging unit 10. The buffer memory 121 finishes temporarily storing the video data acquired by the video data acquisition unit 120. The video data processing unit 122 finishes generating the video data temporarily stored in the buffer memory 121 as a data file. The recording control unit 123 ends the recording of the loop recording video data generated by the video data processing unit 122 into the recording unit 20. The recognition processing unit 125 ends the recognition process of the information on the other vehicle and the license plate of the other vehicle from the frame image F11 that constitutes the video data acquired by the video data acquisition unit 120. The event detection unit 129 ends receiving the detection result from the sensor 60. The event detection unit 129 ends the event detection process based on the received detection result.

As described above, when the recording device 1 of the first embodiment recognizes the license plate information of the other vehicle while recognizing the other vehicle, it associates the other vehicle with the license plate information. The recording device 1 continues to associate other vehicles with license plate information even if the license plate is no longer recognized. Thereby, even if license plate information cannot be recognized in the event record data before and after the occurrence of an event is detected, the recording device 1 can associate already associated license plate information with another vehicle. Therefore, the recording device 1 can contribute to suitable identification of other vehicles to be photographed. The recording device 1 can provide event record data useful for verifying an accident, for example.

(Second embodiment)
[Processing by device]
The flow of video data recording processing by the control device 100 according to the second embodiment will be explained using FIGS. 6 and 7. Video data recording processing includes loop recording processing and event recording data storage processing. FIG. 6 is a flowchart illustrating an example of the flow of recording processing by the control device according to the second embodiment. FIG. 7 is a schematic diagram illustrating the functions of the control device according to the second embodiment. More specifically, FIG. 7 is a diagram showing an example of the other vehicle recognition period Pc2, the license plate recognition period Pn2, the association period Pm2, and the record storage period Ps2. The other vehicle recognition period Pc2 is a period from time t21 to time t24 during which the recognition processing unit 125 recognizes another vehicle, and in the case of the example shown in FIGS. 2 and 3, it recognizes the other vehicle C1. This is the period during which The license plate recognition period Pn2 is a period from time t22 to time t23 during which the recognition processing unit 125 recognizes the information on the license plate of another vehicle, and in the case of the example shown in FIG. This is the period during which plate N1 is recognized. The association period Pm2 is a period from time t21 to time t24 during which the association processing unit 132 associates other vehicles with license plate information. This is the period during which the vehicle C1 and the information on the license plate N1 are associated. The recording storage period Ps2 is a period from time t21 to time t24 that is recorded as event record data. The process shown in FIG. 6 is executed by the control device 100 based on a predetermined control program and data. For example, the control device 100 causes the operation control unit 126 to receive a predetermined operation signal related to a start operation that enables the vehicle to operate, that power is supplied from the vehicle to the recording device 1, or that the operation unit 40 receives from a user or the like. Upon acceptance, the process moves to step S121 shown in FIG. 6 and starts processing.

As shown in FIG. 6, the control device 100 starts loop recording processing of video data captured by the imaging unit 10 and event detection processing (step S121). More specifically, the video data acquisition unit 120 starts acquiring the video data captured by the imaging unit 10. The buffer memory 121 starts temporarily storing the video data acquired by the video data acquisition unit 120. The video data processing unit 122 starts generating video data temporarily stored in the buffer memory 121 as a data file. The recording control unit 123 causes the recording unit 20 to record the video data generated by the video data processing unit 122. The event detection unit 129 starts accepting detection results from the sensor 60. The event detection unit 129 starts event detection processing based on the received detection result. The control device 100 moves to step S122.

The control device 100 determines whether an event has been detected (step S122). More specifically, control device 100 determines whether event detection unit 129 has detected an event. If the event is detected (step S122; Yes), the control device 100 moves to step S123. If no event is detected (step S122; No), the control device 100 moves to step S130.

If an event is detected (step S122; Yes), the control device 100 starts recognition processing for other vehicles and license plates (step S123). More specifically, the recognition processing unit 125 starts recognition processing of the information on the other vehicle and the license plate of the other vehicle from the beginning of the video data in the buffer memory 121 including the time T2 at which the event was detected. The recognition processing unit 125 performs recognition processing of information on other vehicles and license plates of other vehicles from frame images that constitute video data. The control device 100 moves to step S124.

The control device 100 determines whether another vehicle is recognized (step S124). More specifically, control device 100 determines whether recognition processing unit 125 recognizes another vehicle in the video data in buffer memory 121 including time T2 at which the event was detected. If the other vehicle is recognized (step S124; Yes), the control device 100 moves to step S125. If the other vehicle is not recognized (step S124; No), the control device 100 moves to step S128. In the example shown in FIG. 7, the recognition processing unit 125 recognizes another vehicle during the other vehicle recognition period Pc2 from time t21 to time t24 from the video data in the buffer memory 121 including time T2 at which the event was detected.

If the other vehicle is recognized (step S124; Yes), the control device 100 determines whether the license plate information of the recognized other vehicle is recognized (step S125). More specifically, the control device 100 determines whether the recognition processing unit 125 recognizes the license plate information of another vehicle in the video data in the buffer memory 121 including the time T2 at which the event was detected. If the license plate information of the recognized other vehicle C1 is recognized (step S125; Yes), the control device 100 moves to step S126. If the information on the recognized license plate of the other vehicle is not recognized (step S125; No), the control device 100 moves to step S128. In the case of the example shown in FIG. 7, the recognition processing unit 125 recognizes the information of the license plate N1 in the period from time t22 to time t23 from the video data of the other vehicle recognition period Pc2. It is assumed that the plate recognition period is Pn2.

If the license plate information of the recognized other vehicle is recognized (step S125; Yes), the control device 100 associates the recognized other vehicle with the license plate information (step S126). More specifically, if the association processing unit 132 recognizes the license plate information of the other vehicle in at least one of the frame images constituting the video data while recognizing the other vehicle, the association processing unit 132 identifies the license plate information of the other vehicle and the other vehicle. information. In the example shown in FIG. 7, the association processing unit 132 associates the license plate information with the other vehicle during the association period Pm2 that matches the other vehicle recognition period Pc2. That is, the association processing unit 132 associates other vehicles with license plate information going back from time t22 when the license plate was recognized.

After executing the process in step S126, the control device 100 moves to step S127. The control device 100 saves the video data before and after the event detection as event record data with overwriting prohibited (step S127). At this time, the control device 100 stores the recognized other vehicle and license plate information in a state where they are associated with each other. More specifically, the recording control unit 123 records the video data of the recording storage period Ps2 before and after the event detection time T2 shown in FIG. , to be stored in the recording unit 20 as event record data. As in the example shown in FIG. 7, the record storage period Ps2 matches the other vehicle recognition period Pc2 and the association period Pm2. As shown in FIG. 6, the control device 100 moves to step S129.

If the other vehicle is not recognized (Step S124; No), or if the license plate information of the recognized other vehicle is not recognized (Step S125; No), the control device 100 displays the images before and after the event detection. The data is saved with overwriting prohibited (step S128). More specifically, the recording control unit 123 causes the recording unit 20 to store video data before and after event detection as event recording data. In this case, the other vehicle and license plate information are not associated with each other and are therefore not saved. The control device 100 moves to step S129.

The control device 100 ends the recognition process for other vehicles and license plates (step S129). The recognition processing unit 125 ends the recognition process of the information on the other vehicle and the license plate of the other vehicle from the frame images forming the video data acquired by the video data acquisition unit 120. The control device 100 moves to step S130.

The control device 100 determines whether to end the loop recording process of the video data captured by the imaging unit 10 and the event detection process (step S130). More specifically, the control device 100 receives a predetermined operation signal related to a termination operation received by the operation unit 40 from the user or the like, for example, when the operation of the vehicle is finished, or when power is no longer supplied to the recording device 1 from the vehicle. , the operation control unit 126 determines whether or not it has been accepted. If the control device 100 determines to end the loop recording process and the event detection process (step S130; Yes), the control device 100 ends the process of the flowchart shown in FIG. When the control device 100 determines that the loop recording process and the event detection process are not to be ended (step S130; No), the process proceeds to step S122.

When the control device 100 finishes the process of the flowchart shown in FIG. 6, the control device 100 ends the loop recording process of the video data captured by the imaging unit 10 and the event detection process. More specifically, the video data acquisition unit 120 finishes acquiring the video data captured by the imaging unit 10. The buffer memory 121 finishes temporarily storing the video data acquired by the video data acquisition unit 120. The video data processing unit 122 finishes generating the video data temporarily stored in the buffer memory 121 as a data file. The recording control unit 123 ends the recording of the loop recording video data generated by the video data processing unit 122 into the recording unit 20. The event detection unit 129 ends receiving the detection result from the sensor 60. The event detection unit 129 ends the event detection process based on the received detection result.

As explained above, when the recording device 1 of the second embodiment detects the occurrence of an event, it extracts information about the other vehicle and the license plate of the other vehicle from the video data in the buffer memory 121 including the time T2 at which the event was detected. performs recognition processing. When the recording device 1 recognizes the other vehicle and the license plate information of the other vehicle, the recording device 1 associates the other vehicle with the license plate information during the period in which the other vehicle is recognized. The association processing unit 132 associates other vehicles with license plate information going back from time t22 when the license plate was recognized. In this way, the recording device 1 associates other vehicles with license plate information even during a period when the license plate is not recognized. Thereby, even if the license plate information cannot be recognized in the frame image at time T2 when the occurrence of the event is detected, the recording device 1 can associate the other vehicle with the license plate information. Therefore, the recording device 1 can contribute to suitable identification of other vehicles to be photographed.

Next, with reference to FIGS. 8 to 10, a flow of a process for reproducing event record data on which association processing has been performed by the control device 100 according to the first embodiment and the second embodiment will be described. FIG. 8 is a flowchart illustrating an example of the flow of regeneration processing by the control device. The process in FIG. 8 may be executed by the recording device 1, or may be executed by another device when event record data saved by the recording device 1 is played back by another device. The process shown in FIG. 8 is executed by the control device 100 based on a predetermined control program and data. For example, when the recording device 1 is powered on, the control device 100 moves to step S111 shown in FIG. 8 and starts processing.

The control device 100 determines whether there is an instruction to start playing the event record data (step S111). More specifically, the control device 100 determines whether the operation control unit 126 has received a predetermined operation signal related to a playback start operation received by the operation unit 40 from the user or the like. When the control device 100 determines that there is an instruction to start playing the event record data (step S111; Yes), the process proceeds to step S112. When the control device 100 determines that there is no instruction to start reproducing the event record data (step S111; No), the control device 100 repeatedly executes step ST111 at predetermined intervals or ends this process.

If there is an instruction to start playing the event record data (step S111; Yes), the control device 100 determines whether there is associated license plate information (step S112). More specifically, the control device 100 determines whether license plate information is associated with the video data of the other vehicle recorded in the event record data. If there is information on the associated license plate (step S112; Yes), the control device 100 moves to step S113. If there is no associated license plate information (step S112; No), the control device 100 moves to step S114.

If there is associated license plate information (step S112; Yes), the control device 100 starts a reproduction process of the event record data so that the license plate information is displayed (step S113). More specifically, the control device 100 causes the reproduction control unit 124 to start the reproduction process of the event record data in a state where the video data of the other vehicle in the event record data is associated with the license plate association data. The control device 100 moves to step S115.

If there is no associated license plate information (step S112; No), the control device 100 starts the reproduction process of the event record data (step S114). More specifically, the control device 100 causes the playback control unit 124 to start playback processing of the event record data. The control device 100 moves to step S115.

After performing the process of step S113 or step S114, the control device 100 determines whether or not the reproduction of the event record data has ended (step S115). More specifically, when the control device 100 has finished playing the event record data to the end, for example, when the operation control unit 126 receives a predetermined operation signal related to the playback end operation received by the operation unit 40 from the user etc. etc., it is determined that the playback of the event record data has ended. If the control device 100 determines that the reproduction of the event record data has ended (step S115; Yes), the control device 100 ends the process of the flowchart shown in FIG. If the control device 100 determines that the reproduction of the event record data has not finished (step S115; No), the control device 100 moves to step S115.

When the control device 100 completes the processing of the flowchart shown in FIG. 8, the control device 100 ends the event recording data reproduction processing. More specifically, the control device 100 causes the playback control unit 124 to end the playback process of the event record data.

FIG. 9 is a schematic diagram showing an example of a playback screen. FIG. 10 is a schematic diagram showing an example of another playback screen corresponding to FIG. 9. 9 and 10 are diagrams schematically showing reproduced images of event record data displayed on the display unit 50 in the reproduction process of step S113 shown in FIG. 8.

As shown in FIG. 9, the display image F31 includes the other vehicle C3 and the license plate N3 of the other vehicle C3. FIG. 9 shows a state in which the recognition processing unit 125 recognizes the other vehicle C3 from the frame images that constitute the display image F31, and also recognizes the license plate N3 of the other vehicle C3. FIG. 9 shows that the information of the license plate N3 of the other vehicle C3 included in the video data of the period in which the video data was saved as event record data or the period before and after the event record data is recognized, and the information of the license plate N3 of the other vehicle C3 is recognized. This shows that the information on the license plate N3 is displayed as the association data Dm3. The method of displaying the association data Dm3 is not limited to the embodiment. When reproducing the event record data, the other vehicle detection frame Fc31 and the license plate detection frame Fn31 do not need to be displayed.

As shown in FIG. 10, the display image F32 includes the other vehicle C3, but does not include the license plate N3 of the other vehicle C3. Even in such a case, the information on the license plate N3 of the other vehicle C3 included in the period in which the video data was saved as event record data or in the video data in the period before and after the event record data is recognized. Therefore, the association data Dm3 can be displayed for the other vehicle C3. Furthermore, although not shown, even if the frame image includes the other vehicle C3 and the license plate N3 of the other vehicle C3, the information on the license plate N3 may not be recognized due to vibrations of the vehicle, etc. . Even in such a case, the association data Dm3 can be displayed as in FIG. 9. In the reproduction of event record data, the method of displaying the association data Dm3 is not limited to the embodiment. Other vehicle detection frame Fc32 and license plate detection frame Fn32 may not be displayed.

If the recognition processing unit 125 recognizes license plate information of another vehicle in at least one of the frame images constituting the video data while the recognition processing unit 125 is recognizing the other vehicle, the association processing unit 132 associates the license plate with the other vehicle. Correlate with the image information of the plate. When the association processing unit 132 associates the image information of the license plate with another vehicle from one of the frame images, the association processing unit 132 associates the image information of the license plate with the other vehicle in the frame image in which the image information of the license plate cannot be recognized. . The association between the other vehicle and the image information of the license plate is maintained until the recognition processing unit 125 no longer recognizes the other vehicle.

As explained above, the recording device 1 reproduces the license plate information associated with the processing of the first embodiment and the second embodiment in association with the event record data. Therefore, even if there is a period during which the license plate information cannot be recognized by the recognition processing unit 125 during playback of event record data, or if the license plate information cannot be visually confirmed, the license plate information can be properly displayed. It can be confirmed. The recording device 1 associates the recognized license plate information with the image information of the license plate in the frame image in which the license plate information can be recognized, as shown in FIGS. 9 and 10, with other vehicles. As a result, the condition of the license plate, such as dirt or modification, can be inferred from the shape and color of the license plate.

In the examples of FIGS. 9 and 10, as the association data Dm3, an image including the license plate of a frame image whose license plate information has been recognized by the recognition processing unit 125 can be associated with another vehicle in the event record data. However, the character information written on the license plate recognized by the recognition processing unit 125 may be displayed instead of the association data Dm3 in FIGS. 9 and 10.

As described above, the recording device 1 according to the present invention can contribute to suitable identification of other vehicles to be photographed. The recording device 1 can provide event record data useful for verifying an accident, for example.

The illustrated components of the recording apparatus 1 are functionally conceptual, and do not necessarily have to be physically configured as illustrated. In other words, the specific form of the recording device is not limited to the one shown in the diagram, and all or part of it may be functionally or physically distributed or integrated in arbitrary units depending on the processing load and usage conditions of the recording device. You can.

The configuration of the recording device 1 is realized by, for example, a program loaded into a memory as software. The above embodiments have been described as functional blocks realized by cooperation of these hardware or software. That is, these functional blocks can be implemented in various forms using only hardware, only software, or a combination thereof.

1 Recording device 10 Imaging section 20 Recording section 30 Recognition dictionary storage section 40 Operation section 50 Display section 60 Sensor 70 GPS receiving section 80 IF section (CAN interface section)
100 Control device (vehicle recording control device)
110 Bus 120 Video data acquisition section 121 Buffer memory 122 Video data processing section 123 Recording control section 124 Playback control section 125 Recognition processing section 126 Operation control section 127 Display control section 128 Sensor information acquisition section 129 Event detection section 130 Position information acquisition section 131 Vehicle information acquisition unit 132 Correspondence processing unit F11, F12 Frame images F31, F32 Display images Fc11, Fc12, Fc31, Fc32 Other vehicle detection frames Fn11, Fn31 License plate detection frames C1, C3 Other vehicles N1, N3 License plate Dm3 Correlation data

Claims (7)

a video data acquisition unit that acquires video data captured by an imaging unit that photographs the surroundings of the vehicle;
a recognition processing unit that recognizes information written on the other vehicle and the recognized license plate of the other vehicle from frame images constituting the video data acquired by the video data acquisition unit;
When the recognition processing unit recognizes the other vehicle and the information written on the license plate of the recognized other vehicle, associating the recognized other vehicle with the information written on the license plate of the recognized other vehicle, Even if the frame image includes a recognized other vehicle and the information written on the license plate of the recognized other vehicle cannot be recognized, the information written on the license plate of the other vehicle associated with the recognized other vehicle may not be recognized. an association processing unit that associates the information with other vehicles recognized in the frame image;
an event detection unit that detects an event for the vehicle;
a recording control unit that stores video data corresponding to the event detection when the event detection unit detects the occurrence of an event;
Equipped with
The recognition processing unit recognizes the other vehicle and information written on the license plate of the other vehicle from a frame image forming video data corresponding to event detection,
When the recognition processing unit recognizes the other vehicle and the information written on the license plate of the other vehicle, the association processing unit determines that the other vehicle is recognized in all frame images in which the other vehicle is recognized. A vehicle recording control device that correlates information written on the license plates of other vehicles . a playback control unit that plays back video data corresponding to event detection stored by the recording control unit;
a display control unit that causes a display unit to display video data corresponding to the detection of the event reproduced by the reproduction control unit and information written on a license plate associated with the recognized other vehicle;
The vehicle recording control device according to claim 1 , further comprising: When the recognition processing unit recognizes a predetermined percentage or more of information written on the license plate included in the range of the recognized other vehicle, the association processing unit is configured to identify the recognized other vehicle as the recognized other vehicle. to match the information written on the license plate of
The vehicle recording control device according to claim 1 or 2 . The association processing unit associates the recognized other vehicle with character information written on the license plate of the recognized other vehicle.
The vehicle recording control device according to any one of claims 1 to 3 . The association processing unit associates the recognized other vehicle with image information of a license plate of the recognized other vehicle.
The vehicle recording control device according to any one of claims 1 to 3 . a video data acquisition step of acquiring video data captured by an imaging unit that photographs the surroundings of the vehicle;
a recognition step of recognizing information written on the other vehicle and the recognized license plate of the other vehicle from frame images forming the video data acquired in the video data acquisition step;
When the other vehicle and the information written on the license plate of the recognized other vehicle are recognized in the recognition step, the recognized other vehicle and the information written on the recognized license plate of the other vehicle are associated and recognized. Even if the frame image contains a recognized other vehicle and the information written on the license plate of the recognized other vehicle cannot be recognized, the information written on the license plate of the other vehicle associated with the recognized other vehicle may not be recognized. an association processing step of associating the information with other vehicles recognized in the frame image;
an event detection step of detecting an event for the vehicle;
When the occurrence of an event is detected in the event detection step, a recording step of storing video data corresponding to the detection of the event;
including;
In the recognition step, the other vehicle and the information written on the license plate of the other vehicle are recognized from a frame image forming video data corresponding to the detection of the event;
In the association processing step, when the other vehicle and the information written on the license plate of the other vehicle are recognized in the recognition step, the other vehicle is recognized as the other vehicle in all frame images in which the other vehicle is recognized. A recording control method executed by a vehicle recording control device that associates information written on a vehicle's license plate . A computer that operates as a vehicle recording control device,
a video data acquisition step of acquiring video data captured by an imaging unit that photographs the surroundings of the vehicle;
a recognition step of recognizing information written on the other vehicle and the recognized license plate of the other vehicle from frame images forming the video data acquired in the video data acquisition step;
When the other vehicle and the information written on the license plate of the recognized other vehicle are recognized in the recognition step, the recognized other vehicle and the information written on the recognized license plate of the other vehicle are associated and recognized. Even if the frame image contains a recognized other vehicle and the information written on the license plate of the recognized other vehicle cannot be recognized, the information written on the license plate of the other vehicle associated with the recognized other vehicle may not be recognized. an association processing step of associating the information with other vehicles recognized in the frame image;
an event detection step of detecting an event for the vehicle;
When the occurrence of an event is detected in the event detection step, a recording step of storing video data corresponding to the detection of the event;
run the
In the recognition step, the other vehicle and the information written on the license plate of the other vehicle are recognized from a frame image forming video data corresponding to the detection of the event;
In the association processing step, when the other vehicle and the information written on the license plate of the other vehicle are recognized in the recognition step, the other vehicle is recognized as the other vehicle in all frame images in which the other vehicle is recognized. A program that correlates information written on a vehicle's license plate .

Images