JP6500692B2 - Vehicle security system, vehicle security method - Google Patents

Description

  The present invention relates to a crime prevention system for a vehicle and a crime prevention method for a vehicle, which prevent crimes such as theft of the vehicle and vandalism.

In recent years, instead of a side mirror such as a door mirror or a fender mirror of a vehicle, a display device is installed at a position easy for the driver to visually recognize in a vehicle interior, and a rear image including a side portion of the vehicle photographed by a camera is displayed A technology (so-called electronic side mirror) to be displayed on the screen has been developed (for example, Patent Document 1).
According to this technology, it is possible for the driver to confirm the rear including the side part of the vehicle with the display device as with the side mirror, but by eliminating the side mirror projecting from the vehicle, the air resistance of the vehicle can be obtained. It is possible to reduce or avoid the contact of the side mirror in a parking lot or a narrow alley.

  Since such electronic side mirrors tend to be adopted particularly for luxury cars, vehicles equipped with the electronic side mirrors are often provided with crime prevention technology for preventing crimes such as theft and car crash. As a crime prevention technology for vehicles, when a moving object approaching a vehicle while parking is detected by a sonar sensor, a vibration of a vehicle is detected by a vibration sensor, or a sound specific to a crime such as picking is detected by a sound sensor, It is known that a warning sound is output to prevent a crime (for example, Patent Document 2).

Unexamined-Japanese-Patent No. 2009-083618 JP, 2009-073256, A

  However, according to the conventional crime prevention technology such as Patent Document 2, a pedestrian without malicious intent passes near the vehicle, rain or snow falls, there is construction or earthquake in the vicinity, or the door is opened or closed by another adjacent vehicle. As a warning sound may be output by being performed, there is a problem of noise due to such a false alarm sound, and development of a new security technology is required.

  The present invention has been made in view of the above-described problems of the prior art, and aims to provide a crime prevention technology capable of accurately detecting a crime against a vehicle by using the technology of an electronic side mirror. .

The vehicle security system of the present invention to solve the problems described above, photographing the rear of the image containing a side face portion of the vehicle by a camera provided outside the vehicle, the display device provided in the interior of the vehicle The present invention is applied to a vehicle capable of displaying a photographed image, and acquires data of an image photographed by a camera with a parked vehicle. And if the abnormality of the side part of a vehicle is detected in the acquired image, the predetermined measure which prevents the crime with respect to a vehicle will be performed.
In addition, the data of the normal image before the abnormality is detected is stored, and the abnormal is detected based on the difference between the newly acquired image and the stored normal image. As an image of time, data of a matched image is stored by comparing two images acquired at predetermined time intervals.

Crimes such as theft of vehicles and vandalism are mainly conducted by illegally invading the passenger compartment from the side door. According to the present invention, since the side image of the vehicle is included in the captured image of the camera, it is possible not only to approach the vehicle, but also to capture people and objects touching the side surface of the vehicle. Therefore, if the side part of the vehicle has an abnormality (for example, a person or a thing touching the side part) by analyzing the acquired image, there is a strong suspicion that some kind of fraud is performed on the vehicle, and a crime against the vehicle is accurately detected. can do. Then, by executing measures such as outputting an alarm sound, it is possible to effectively protect the vehicle from crime.
In addition, since the image at the normal time is stored in advance, the newly acquired image is compared with the image at the normal time to extract the difference, thereby detecting the presence or absence of a suspicious person or the like touching the side portion of the vehicle. Can be easily determined. Furthermore, by contrasting the two images acquired after leaving a predetermined time, it is possible to eliminate the temporary reflection on the side of the vehicle due to other vehicles or bicycles that happened to pass through the area that does not enter the shooting area of the camera. It is possible to store images of normal times.

It is an explanatory view showing the composition of the crime prevention system 10 for vehicles of this example. It is an overhead view which shows the imaging | photography area | region of the camera 20 set around the vehicle 1 of a present Example. It is an explanatory view showing display 22 provided in the inside of vehicles 1 of this example. It is a flow chart which shows crime prevention control processing performed with crime prevention system 10 for vehicles of this example. It is explanatory drawing which showed the example which detects the crime with respect to the vehicle 1 according to a crime prevention control process. It is explanatory drawing which showed typically the example which acquires a normal image by the crime prevention system 10 for vehicles of a modification.

Below, in order to clarify the contents of the present invention mentioned above, an example is described.
A. Device configuration :
The structure of the crime prevention system 10 for vehicles of a present Example is shown by FIG. The vehicle equipped with the crime prevention system 10 for a vehicle according to the present embodiment has a display device 22 such as a liquid crystal display installed in a vehicle compartment, an image captured by a camera 20 attached to the outside of the vehicle instead of the side mirror. It has an electronic side mirror control unit 21 for displaying.
As illustrated, the vehicular crime prevention system 10 of the present embodiment includes an image data acquisition unit 11, a storage unit 12, an abnormality detection unit 13, an alarm sound output unit 14, and the like.
These four “parts” 11 to 14 are conceptually classified by focusing attention on the functions of the vehicle security system 10, and it is not necessary that they physically exist independently. These can be configured by various devices, electronic components, integrated circuits, computers, computer programs, or a combination thereof.

The image data acquisition unit 11 is connected to the electronic side mirror control unit 21 and acquires data of an image captured by the camera 20 while the vehicle is parked.
The image data acquisition unit 11 is also connected with a navigation system 23 for guiding to a destination based on position information of the vehicle and map information, and a door sensor 24 for detecting the opening and closing of the door of the vehicle. The timing and interval to be acquired are changed according to the position information of the vehicle, the map information, and the opening and closing information of the door.
The storage unit 12 stores data of an image acquired at the normal time before detection of an abnormality of the vehicle due to a crime such as theft of the vehicle or a crash on the vehicle.

The abnormality detection unit 13 emits a sound wave toward a predetermined range around the vehicle, and receives a reflection wave thereof, and the sonar sensor 15 detects a moving object approaching the vehicle, and the vibration sensor detects a vibration of the vehicle 16 and a sound sensor 17 for detecting a sound specific to a crime such as picking or destruction of glass are connected.
In the present embodiment, the sonar sensor 15 corresponds to the "approach sensor" in the present invention. However, the proximity sensor is not limited to the sonar sensor 15, and may be a radar sensor that detects by radio waves or a laser sensor that detects by light.

When an abnormality in the vehicle is detected based on any of the various sensors 15 to 17, the image data acquisition unit 11 acquires data of an image captured by the camera 20 at that time.
The abnormality detection unit 13 compares the image newly acquired by the image data acquisition unit 11 with the normal image stored in the storage unit 12 to determine whether there is an abnormality of the vehicle due to a crime ( That is, it is determined whether or not the vehicle is cheating.

When it is determined by the abnormality detection unit 13 that there is an abnormality in the vehicle, the alarm sound output unit 14 outputs an alarm sound using a horn or the like.
In the present embodiment, an alarm sound is output as a measure for preventing a crime against a vehicle, and the alarm sound output unit 14 corresponds to the “execution unit” in the present invention.
However, the measure to prevent a crime against the vehicle is not limited to the output of the alarm sound, and may be reported to, for example, the owner of the vehicle or a security company.

In FIG. 2, an imaging area of the camera 20 set around the vehicle 1 of the present embodiment is shown in an overhead view. As illustrated, the camera 20 is provided in a pair on the left and right sides of the front side of the vehicle 1, a shooting area is set from the camera 20 toward the rear of the vehicle 1, and the side portion of the vehicle 1 is set as the shooting area It contains.
When the vehicle 1 of this embodiment does not have a side mirror such as a door mirror, but instead has a door mirror, it sets a shooting area similar to the area reflected on the door mirror and shoots with the camera 20 It has become.
By eliminating the side mirror projecting from the vehicle 1, the air resistance of the vehicle 1 can be reduced, and the contact of the side mirror in a parking lot or a narrow alley can be avoided.

FIG. 3 shows a display device 22 provided inside the vehicle 1 of the present embodiment. The drawing shows the inside of the passenger compartment looking forward from the driver's seat. As illustrated, the display device 22 is installed in a pair on the inside of the window pillar (so-called A-pillar) 3 on the left and right sides of the windshield 2 (the display device 22 on the left side is omitted in the figure) A display screen composed of a display and the like is directed to the driver's seat.
The position at which the display device 22 is installed is not limited to the A-pillar 3 as long as it can be easily viewed from the driver's seat. For example, the display device 22 may be embedded in the left and right ends of the dashboard 4 or the door panel.

In the vehicle 1 of the present embodiment, instead of the side mirror, the electronic side mirror control unit 21 executes control to cause the display device 22 to display an image captured by the camera 20 while turning the image horizontally. Thus, the driver can check the rear including the side portion of the vehicle 1 similarly to the side mirror, if looking at the display device 22.
And in the crime prevention system 10 for vehicles of this example, an image is acquired from camera 20 which picturizes the picture displayed on display 22, and it uses for crime prevention of vehicles 1.

B. Security control processing:
FIG. 4 shows a flow chart of the crime prevention control process executed by the crime prevention system 10 of the present embodiment.
The crime prevention control process (S100) is started when the door is locked in a state where the engine of the vehicle 1 is stopped. That is, the crime prevention control process (S100) is a process executed while the driver or the passenger is away from the parked vehicle 1, and a state in which the engine is operating including the traveling of the vehicle 1, It is not executed when the door sensor 24 detects that the door is open.

  When the crime prevention control process (S100) is started, first, data of an image captured by the camera 20 is acquired (S101). As shown in FIG. 2, the camera 20 is adapted to capture an image of the rear including the side surface of the vehicle 1, and in the present embodiment, a predetermined detection including the side surface of the vehicle 1 in the image Get the data that trimmed the area.

Subsequently, it is determined whether or not a predetermined time (for example, 5 seconds) has elapsed after acquiring the image data (S102), and if it has not elapsed (S102: no), the process waits. Then, when the predetermined time has passed (S102: yes), the data of the image captured by the camera 20 is acquired again (S103), and the two latest images (here, detection areas) are compared and coincide with each other? It is determined whether or not it is (S104).
For example, when another vehicle or a bicycle which accidentally passes through an area not entering the imaging area (see FIG. 2) of the camera 20 is temporarily reflected on the side portion of the vehicle 1, the two images may not match.

Then, when the two images do not match (S104: no), the process returns to S102, and after a predetermined time has elapsed, data of an image captured by the camera 20 is acquired, and the two latest images are compared. Repeat the process.
On the other hand, when the two images match (S104: yes), the matched image is stored as an image at normal time (that is, before the fraud on the vehicle 1 is made) (S105).
As described above, it is possible to store a normal image (hereinafter referred to as a normal image) from which temporary reflection has been removed by comparing two images acquired after leaving a predetermined time.

After storing the normal image in this way, it is determined whether or not an abnormality is detected in any of various sensors (in the present embodiment, the sonar sensor 15, the vibration sensor 16, and the sound sensor 17) mounted on the vehicle 1 (S106) .
If no abnormality is detected (S106: no), it is then determined whether the door is unlocked (S107).
If the door lock is properly released (S107: yes), the driver and the passenger return to the range where the eyes of the vehicle 1 reach, so the crime prevention control process of FIG. .

On the other hand, when the lock of the door is not released (S107: no), the crime prevention control process is continued, and then it is determined whether the update time has elapsed since the normal image is stored in the process of S105. (S108).
Since the scenery around the vehicle 1 changes in accordance with changes in solar radiation, weather, etc., a change appears in the image captured by the camera 20. Therefore, a new normal image is stored each time a preset update time has elapsed.
Further, the length of the update time in the present embodiment is changed according to the time zone and the surrounding environment of the vehicle 1 (that is, the position information of the vehicle 1 from the navigation system 23). For example, in the daytime or in the urban area, a change is likely to occur in the vicinity of the vehicle 1 as compared to the nighttime or the suburbs, so a short update time is set.
Then, if the update time has elapsed (S108: yes), the process returns to S101, and if the two images acquired with a predetermined time interval match, they are stored as a new normal image (S101 to S105).

On the other hand, if the update time has not passed yet (S108: no), the process returns to S106, and it is determined whether or not an abnormality is detected by the various sensors 15-17.
Then, a moving object approaching the vehicle 1 is detected by the sonar sensor 15, a vibration of the vehicle 1 is detected by the vibration sensor 16, or a sound specific to a crime (for example, a sound of a specific frequency) is detected by the sound sensor 17. If it is (S106: yes), the data of the image taken by the camera 20 at that time is acquired (S109), and the acquired latest image is compared with the most recent normal image stored (S110) .
In this comparison, the difference between the two images is extracted, and it is determined whether a foreign substance which is not included in the latest normal image is included in the latest image (S111).

Crimes such as theft and vandalism of the vehicle 1 are mainly performed by illegally invading the passenger compartment from the side door. For this reason, if there is a suspicious person touching the side portion of the vehicle 1, the camera 20 that captures an image of the rear including the side portion of the vehicle 1 can capture the suspicious person as a foreign object in the image . Then, in the present embodiment, since the normal image is stored in advance, the presence or absence of the foreign material can be easily determined by comparing with the normal image.
As a result of comparison, if foreign matter is included in the latest image (S111: yes), it is determined that the vehicle 1 is tampered with, and a warning sound is output by means of a horn (S112) , And end the crime prevention control process of FIG.
On the other hand, when no foreign object is contained in the latest image, that is, when the latest image and the latest normal image match (S111: no), detection of abnormality by the various sensors 15 to 17 in the process of S106 Judging that it was a false detection, without outputting an alarm sound, as in the case where no abnormality is detected by the various sensors 15 to 17 (S106: no), the unlocking of the door and the lapse of the updating time are confirmed (S107, S108).

C. Detection example:
FIG. 5 shows an example of detecting a crime against the vehicle 1 in accordance with the above-described crime prevention control process (S100). The drawing shows an image taken by the camera 20, and as described above, the camera 20 is adapted to take an image of the rear including the side part of the vehicle 1.
Further, in the present embodiment, a predetermined area including the side portion of the vehicle 1 in the captured image of the camera 20 is set as the detection area, and the image as shown in FIG. When the image is taken with the camera, the data obtained by trimming the detection area is acquired and stored.
As described above, the load on the image data acquisition unit 11 and the storage unit 12 can be reduced by limiting the detection region to a part of detection images instead of all the images captured by the camera 20.

  In addition, although an image captured by the camera 20 for display on the display device 22 is a color image, by acquiring data of a binarized black and white image, the outline of the side portion of the vehicle 1 is emphasized. The load on the image data acquisition unit 11 and the storage unit 12 can be reduced.

  Then, when an abnormality is detected by the various sensors 15 to 17, it is assumed that an image as illustrated in FIG. 5B is captured by the camera 20. Comparing the detection area of FIG. 5 (b) with the detection area of FIG. 5 (a), the detection area of FIG. 5 (b) contains a foreign object which is considered to be a suspicious person. It is suspected that the fraud such as destruction of the glass. Therefore, by outputting an alarm sound using a horn or the like, a suspicious person is threatened, and the surrounding vehicle is notified of the injustice with respect to the vehicle 1.

  As described above, in the crime prevention system 10 for a vehicle according to the present embodiment, an image is acquired from the camera 20 that captures an image to be displayed on the display device 22 instead of the side mirror. Since a part is included, it is possible to catch people and objects touching the side part of the vehicle 1 as well as simply approaching the vehicle 1. Then, if there is a person or a thing touching the side part of the vehicle 1, there is a strong possibility that the vehicle 1 is incorrupted in some way, so that a crime against the vehicle 1 can be accurately detected.

  On the other hand, when an abnormality similar to that shown in FIG. 5A is taken by the camera 20 when an abnormality is detected by the various sensors 15 to 17, the detection area does not change (that is, no foreign matter is included) Therefore, the suspicion of the fraud on the vehicle 1 is resolved. Therefore, it is determined that the detection of the abnormality by the various sensors 15 to 17 is an error, and the alarm sound is not output. This makes it possible to suppress the generation of noise due to an erroneous alarm sound.

  In addition, the security system 10 for a vehicle according to the present embodiment is easy because it can be dealt with only by changing the software by using existing hardware (that is, the camera 20) that constitutes an electronic side mirror instead of the side mirror. Can be realized.

D. Modification:
In the embodiment described above, when the crime prevention control process (S100) is started after the engine of the vehicle 1 is stopped, a new normal image is acquired and stored whenever the preset update time elapses. The However, after the start of the crime prevention control process (S100), when a long period (for example, one day or more) elapses without detecting any abnormality, the number and frequency of acquiring a new normal image are reduced. It is also good. Hereinafter, such modifications will be described focusing on differences from the above-described embodiment.

  FIG. 6 schematically shows an example of acquiring a normal image by the vehicle security system 10 of the modification. The horizontal axis in the figure represents the flow of time, the upper row is within 24 hours from the start of the crime prevention control process (S100), and the lower row is after 24 hours have elapsed (ie, after the second day). Also, the black and white circles on the horizontal axis indicate the acquisition time of the image.

As illustrated, within 24 hours from the start of the crime prevention control process (S100), a normal image is acquired and stored each time a predetermined update time (10 minutes in this case) elapses.
Then, after 24 hours have elapsed, the newly acquired normal image is compared with the normal image stored 24 hours ago, and if there is no change, the update time is extended (here, 1 hour). , Reduce the number of normal image acquisition. In addition, when an abnormality is detected by the various sensors 15 to 17 while the number of times of acquisition of normal images is reduced as described above, the latest images acquired at that time are stored as normal images of the same time zone stored. The presence or absence of the fraud with respect to the vehicle 1 is determined by comparing with.

  On the other hand, even after 24 hours have passed, if there is a change between the newly acquired normal image and the normal image stored 24 hours ago, the stored normal image is no longer used. I can not Therefore, the extension of the update time is canceled, and a normal image is newly acquired and stored each time a predetermined update time (10 minutes in this case) elapses for the subsequent 24 hours.

As described above, in the security system 10 for a vehicle according to the modification, if it is possible to use a normal image that has already been stored, it is possible to use normal images It is designed to reduce the number of acquisitions. As a result, it is possible to reduce the power consumption in the vehicle security system 10 that executes the crime prevention control process (S100) while the engine of the vehicle 1 is stopped, and to prevent the battery from rising.
In addition, when the voltage drop of the battery is detected, the number of times of acquisition of the normal image as described above may be reduced.

In the above-described vehicle security system 10 according to the embodiment and the modification, whether or not there is a vehicle abnormality due to a crime by comparing the acquired latest image with the stored normal image (ie, To determine if there is any fraud on the vehicle). However, it is not necessary to compare with the normal image.
For example, assuming that the position of the vehicle 1 in the image is unchanged, an object different from the vehicle 1 is extracted from the acquired latest image. In the case of an image as shown in FIG. 5 (b), a part of the extracted object (in the illustrated example, a foreign object which is regarded as a suspicious person) overlaps a side part of the vehicle 1. A warning sound may be output upon touch to determine that some injustice has been made.
Alternatively, when a predetermined area including the side portion of the vehicle 1 in the image is set as the detection area and an object different from the vehicle 1 is extracted from the image, the object has a predetermined area in the detection area If it occupies the above, it may be determined that the vehicle 1 is cheating, and the alarm sound may be output. In this case, when the suspicious person actually touches the side portion of the vehicle 1, the predetermined area serving as the reference of the determination may be set to the minimum area occupied by the suspicious person in the detection area.
In this way, the process of acquiring and storing a normal image can be omitted.

  As mentioned above, although an Example and modification were described, the present invention is not limited to the above-mentioned example and modification, and can be carried out in various modes in the range which does not deviate from the gist.

  For example, in the above-described embodiment, when an abnormality is detected by the various sensors 15 to 17, the latest image captured by the camera 20 is acquired to check the side portion of the vehicle 1 . However, it is not necessary to be triggered by the detection of an abnormality by the various sensors 15 to 17. The vehicle 1 can be obtained by periodically acquiring the latest image (for example, every 10 minutes) and confirming the side part of the vehicle 1 You may detect frauds against

  In addition, when a situation occurs in which the side portion of the vehicle 1 can not be confirmed from the image, such as the camera 20 being occluded improperly or broken, an alarm sound is generated when an abnormality is detected by the various sensors 15 to 17 May be output.

1 ... vehicle, 2 ... windshield, 3 ... A pillar,
10: crime prevention system for vehicle, 11: image data acquisition unit, 12: storage unit,
13 ... abnormality detection unit, 14 ... alarm sound output unit, 15 ... sonar sensor,
16 ... Vibration sensor, 17 ... Sound sensor, 20 ... Camera,
21: Electronic side mirror control unit 22: Display device
23 ... navigation system, 24 ... door sensor.

Claims (3)

A camera (20) provided outside the vehicle and capturing an image of the rear including the side surface of the vehicle; and a display device (22) provided inside the vehicle and displaying the captured image of the camera A vehicle security system (10) applied to said vehicle comprising
An image data acquisition unit (11) for acquiring data of the image captured by the camera with the parked vehicle;
An abnormality detection unit (13) that detects an abnormality in the side portion of the vehicle in the image;
An execution unit (14) that executes a predetermined measure to prevent a crime against the vehicle when an abnormality is detected in the abnormality detection unit ;
A storage unit (12) for storing data of the image at normal times before the abnormality is detected ;
The abnormality detection unit detects the abnormality based on the difference between the newly acquired image and the stored normal image.
The storage unit stores, as the image at the time of normality, data of an image in which two images acquired with a predetermined time open are compared and matched.
Vehicle security system. It is a crime prevention system for vehicles according to claim 1,
Within 24 hours after parking of the vehicle, data of the normal image is stored in the storage unit each time a predetermined update time elapses.
After 24 hours have passed since the parking of the vehicle, the newly acquired image at normal time is compared with the image at normal time 24 hours before, and if there is no change, the update time is extended, and if there is a change The crime prevention system for vehicles by which extension of the update time is canceled . It is a crime prevention system for vehicles according to claim 2 ,
The vehicle includes at least one of an approach sensor (15) that detects a moving object approaching the vehicle, a vibration sensor (16) that detects a vibration of the vehicle, and a sound sensor (17) that detects a predetermined sound.
The image data acquisition unit newly acquires data of the image, triggered by detection by any of the proximity sensor, the vibration sensor, and the sound sensor.
The abnormality detection unit, while the update time is extended, is based on the difference between the newly acquired image and the image at normal time stored in the same time zone before 24 hours. Vehicle security system to detect abnormalities .

Images