JP4540490B2 - Parking lot monitoring device - Google Patents

Description

 The present invention relates to a parking lot monitoring apparatus that processes a video taken by a surveillance camera and presents a parking lot manager with a situation of a vehicle parked in a parking lot or the like for a long time.

In a conventional illegal parking status display device, a portable camera approaches a parked vehicle, images the tail part of each vehicle, identifies the vehicle by reading a license plate by image processing, and moves the vehicle by comparing the background. Determine presence or absence. When the same vehicle is parked without moving, the parking continuation time is measured from the shooting time. When the specified time has elapsed, the vehicle is determined to be a parking violation vehicle. (For example, Patent Document 1)
Similarly, time and shooting position information are added to a video shot close to a parked vehicle with a portable camera, and video editing is automatically performed for each shooting position. The regulator checks the edited video and checks for illegal parking and parking time for each shooting position. (For example, Patent Document 2)

JP-A-4-86998 (pages 3 to 5, FIG. 1) JP-A-8-242442 (pages 2 and 3, FIG. 1)

  Since the conventional parking lot monitoring apparatus is configured as described above, it is necessary to repeatedly move to the vicinity of each parked vehicle and capture a parking situation image a plurality of times. This is necessary to grasp the situation of vehicles parked for a long time exceeding the range of normal facility use in places where there are many parked vehicles such as service areas and parking lots of large shops. There was a problem that the burden of.

  The present invention has been made to solve the above-described problems. In a place where there are many ordinary parking vehicles such as service areas and parking lots of large shops, and in a place where the entrance and exit are frequent, The purpose is to obtain a parking lot monitoring device that can provide an administrator with information for grasping the situation of a neglected vehicle that has been parked for a long time exceeding the scope of facility use without increasing the burden of work. To do.

In the parking lot monitoring apparatus according to the present invention, an image input unit that captures images from a monitoring camera that captures a group of vehicles in the parking lot at a constant period, and a still image storage unit that accumulates still images captured by the image input unit The composite image is generated by averaging the luminance values of the pixels at the corresponding positions between the plurality of still images stored in the still image storage unit. A composite image generation unit that blurs the image of the vehicle and sharpens the image of the vehicle that has not moved, an abandoned vehicle position detection unit that detects the position of the abandoned vehicle using the composite image generated by the composite image generation unit; An accumulated image reproduction unit that reproduces a still image accumulated in the still image accumulation unit, and a position of the abandoned vehicle detected by the abandoned vehicle position detection unit is superimposed on the still image reproduced by the accumulated image reproduction unit. It was those having a display unit for displaying.

As described above, the present invention provides an image input unit that captures images from a monitoring camera that captures a group of vehicles in a parking lot at a certain period, a still image storage unit that accumulates still images captured by the image input unit, A vehicle that has moved in the composite image by generating a composite image by averaging the luminance values of pixels at corresponding positions among the plurality of still images stored in the still image storage unit. A composite image generation unit that blurs the image of the vehicle and sharpens the image of the vehicle that has not moved, a left vehicle position detection unit that detects the position of the left vehicle using the composite image generated by the composite image generation unit, An accumulated image reproduction unit that reproduces the still image accumulated in the image accumulation unit, and the position of the abandoned vehicle detected by the abandoned vehicle position detection unit is superimposed on the still image reproduced by the accumulated image reproduction unit and displayed. It is possible to communicate the status of a neglected vehicle to the administrator without having to move to the vicinity of each parked vehicle and take a picture of the parking situation, and the administrator can check the abandoned vehicle. Can be simplified.

Embodiment 1 FIG.
Embodiment 1 of the present invention will be described below with reference to the drawings.
FIG. 1 is a functional configuration diagram showing a parking lot monitoring apparatus according to Embodiment 1 of the present invention.
In FIG. 1, a vehicle group 11 parked in a parking lot or the like is photographed with a surveillance camera 12 of a CCTV camera. The parking lot monitoring device 13 captures the video of the monitoring camera 12 and presents information on the neglected parking status to the administrator.
This parking lot monitoring device 13 is configured as follows.
The video input unit 14 takes the video of the monitoring camera 12 having the same angle of view into the parking lot monitoring device 13 at a constant period. The still image storage unit 15 stores the still image captured by the video input unit 14 in the parking lot monitoring device 13. The composite image generation unit 16 generates a composite image from the still images stored in the still image storage unit 15. The parked vehicle position detection unit 17 detects the position of the parked parked vehicle from the still image stored in the still image storage unit 15 and the composite image generated by the composite image generation unit 16. The stored image playback unit 18 plays back the still images stored in the still image storage unit 15. The display unit 19 displays information on the neglected parking situation.

FIG. 2 is a flowchart showing processing of the parking lot monitoring apparatus according to Embodiment 1 of the present invention.
FIG. 3 is a diagram showing a synthesized image synthesized by the synthesized image generation unit of the parking lot monitoring apparatus according to Embodiment 1 of the present invention.
In FIG. 3, the composite image generation unit 16 synthesizes a plurality of still images 31, 32, and 33 that are photographed at different times and stored in the still image storage unit 15 to form a composite image 34.

  When a place to be monitored for neglected parking is a highway service area or a parking lot of a large store, usually many vehicles come in and out, and parked vehicles are also frequently replaced. When monitoring the situation of a vehicle that has been parked for a long time in such a place, compare the images taken with a certain shooting time interval to see if the same vehicle exists at the same location. It is necessary to confirm. The parking lot monitoring device 13 of the present invention provides a display method for the administrator to easily perform this comparison confirmation work.

Next, the operation will be described with reference to FIG.
In the parking lot monitoring device 13, the video input unit 14 captures a video of the parking lot taken by the monitoring camera 12 in processing step S1, and the still image storage unit 15 acquires a still image in processing step S2. . This operation is automatically performed periodically at a predetermined time interval. This time interval may be set to about 30 minutes, for example, depending on the purpose of the neglected parking monitoring.
Next, the composite image generation unit 16 generates a composite image to be described later using the still images stored in the still image storage unit 15 in processing step S3. Next, in the processing step S4, the abandoned vehicle position detection unit 17 determines the position where the abandoned vehicle exists based on the degree of change between the plurality of input still images and the sharpness of the contour in the parking area in the generated composite image. Is detected.
The operations of the composite image generation unit 16 and the abandoned vehicle position detection unit 17 may be processed automatically in advance at regular intervals, or when the administrator checks the status of the abandoned parked vehicle as needed. Processing may be performed.

Here, details of the processing of the composite image generation unit 16 will be described with reference to FIG.
The composite image generation unit 16 generates a composite image 34 by averaging the luminance values of the pixels of the plurality of still images 31, 32, and 33 photographed in the confirmation target time zone. The composite image 34 generated in this way has a characteristic that a portion where the vehicle is replaced becomes a blurred image, and a portion where the vehicle is not replaced appears clearly.

By using this feature, the abandoned vehicle position detection unit 17 can detect, for example, a portion where the vehicle is not replaced as a portion having a high edge strength by performing edge extraction processing of the composite image 34, and this position can be detected. It can be detected as the position. Further, by comparing the synthesized image 34 with the accumulated still images 31, 32, and 33, a portion with a small difference may be detected as the position of the left vehicle.
When the administrator confirms the state of the parked parked vehicle, the accumulated image reproduction unit 18 performs processing at step S5 in the still image accumulation unit 15 for the predetermined time zone to be confirmed or the time zone designated at the time of confirmation. The stored still image is played back, and the display unit 19 presents it to the administrator in processing step S6. At this time, the display unit 19 superimposes and displays the left vehicle position detected by the left vehicle position detection unit 17 on the image.
The display unit 19 displays the composite image generated by the composite image generation unit 16.

According to the first embodiment, it is not necessary to perform the operation of moving to the vicinity of each parked vehicle and photographing a parking situation image that has been repeated a plurality of times.
In addition, the function to automatically play back and store images that have been taken and stored provides an intuitive and easy-to-understand indication of whether a vehicle has been left or replaced, and the composite image shows the presence or absence of a vehicle that has been left for a long time. It can be presented easily.
Moreover, the confirmation work of the manager can be further simplified by detecting the abandoned parking position by image processing and displaying the position superimposed on the image.

Embodiment 2.
The second embodiment of the present invention will be described below with reference to FIG.
FIG. 4 is a functional configuration diagram showing a parking lot monitoring apparatus according to Embodiment 2 of the present invention.
In FIG. 4, 11 to 19 are the same as those in FIG. The image shift correction unit 20 corrects a minute image shift associated with the shaking of the monitoring camera 12 for the image obtained from the video input unit 14.

  The second embodiment includes an image shift correction unit 20, and the image shift correction by the image shift correction unit 20 is performed using, for example, a building or road paint reflected in the image. The direction and the amount of deviation are calculated, and correction is performed based on this.

  According to the second embodiment, even in a situation where a slight field angle shift occurs in the input image due to the installation structure of the monitoring camera 12, the parking image is left unattended in the composite image generated by the composite image generation unit 16. The vehicle is clearly reflected without blurring, and the parked parked vehicle can be easily confirmed even when the stored image is reproduced.

Embodiment 3.
The third embodiment of the present invention will be described below with reference to FIG.
FIG. 5 is a functional configuration diagram showing a parking lot monitoring apparatus according to Embodiment 3 of the present invention.
5, 11 and 13 to 20 are the same as those in FIG. The monitoring camera 12 ′ has a zoom turning function. The camera control unit 21 controls the zoom turning operation of the monitoring camera 12 ′. The abandoned vehicle enlarged photographing unit 22 uses the camera control unit 21 based on the abandoned vehicle position information obtained from the abandoned vehicle position detection unit 17 to acquire an enlarged image of the abandoned vehicle.
In the third embodiment, the monitoring camera 12 ′ is provided with a zoom turning function, and this is controlled by the camera control unit 21, and the neglected vehicle enlarged photographing unit 22 is used to leave the monitoring camera 12 ′ using the zoom turning function. Based on the left vehicle position information obtained from the vehicle position detection unit 17, an enlarged image of the left vehicle is acquired.
The enlarged image of the left vehicle acquired by the left vehicle enlarged photographing unit 22 is displayed by the display unit 19 and used by the administrator to confirm details of the left vehicle.

  According to the third embodiment, the details can be easily confirmed even for a neglected vehicle in which it is difficult to confirm details with a normal angle of view, such as when the vehicle is parked far away.

Embodiment 4.
A fourth embodiment of the present invention will be described below with reference to FIG.
FIG. 6 is a functional configuration diagram showing a parking lot monitoring apparatus according to Embodiment 4 of the present invention.
In FIG. 6, reference numerals 11, 12 ′, and 13 to 22 are the same as those in FIG. The vehicle number reading unit 23 reads the vehicle number from the enlarged image of the left vehicle. The abandoned parking history generation unit 24 generates an abandoned parking history for each vehicle number based on the reading result of the vehicle number reading unit 23.
In the fourth embodiment, a vehicle number reading unit 23 that reads a vehicle number from an enlarged image of an abandoned vehicle, and an abandoned parking history for each vehicle number is generated based on the vehicle number of the abandoned vehicle read thereby. It is.
The abandoned parking history for each vehicle number generated by the abandoned parking history generating unit 24 is displayed by the display unit 19 and is used by the administrator to confirm the history of the abandoned vehicle before leaving.

  According to the fourth embodiment, it is possible to easily confirm whether or not the neglected vehicle is regularly left unattended.

Embodiment 5.
The fifth embodiment of the present invention will be described below with reference to FIG.
FIG. 7 is a functional configuration diagram showing a parking lot monitoring apparatus according to Embodiment 5 of the present invention.
7, 11 and 13 to 24 are the same as those in FIG. In FIG. 7, a zoom / swivel camera group 12 ″ in which a plurality of zoom / swivel cameras are arranged at a plurality of locations in the parking lot.
In the fifth embodiment, the zoom / swivel camera group 12 ″ is installed corresponding to a plurality of locations in the parking lot, and the image input unit 14 periodically switches the zoom swivel monitoring camera group 12 ″. get.
Based on this video, as described in the first to fourth embodiments, the detection and display processing of the abandoned vehicle is performed for each surveillance camera.

  According to the fifth embodiment, it is possible to monitor a plurality of locations with one parking lot monitoring device, and to reduce costs.

It is a functional block diagram which shows the parking lot monitoring apparatus by Embodiment 1 of this invention. It is a flowchart which shows the process of the parking lot monitoring apparatus by Embodiment 1 of this invention. It is a figure which shows the synthesized image synthesize | combined by the synthesized image generation part of the parking lot monitoring apparatus by Embodiment 1 of this invention. It is a functional block diagram which shows the parking lot monitoring apparatus by Embodiment 2 of this invention. It is a functional block diagram which shows the parking lot monitoring apparatus by Embodiment 3 of this invention. It is a functional block diagram which shows the parking lot monitoring apparatus by Embodiment 4 of this invention. It is a functional block diagram which shows the parking lot monitoring apparatus by Embodiment 5 of this invention.

Explanation of symbols

11 Parked vehicles, 12 surveillance cameras,
12 'zoom and swivel surveillance cameras, 12 "zoom and swivel surveillance cameras,
13 parking lot monitoring device, 14 video input unit, 15 still image storage unit,
16 image composition unit, 17 unattended vehicle position detection unit, 18 stored image reproduction unit,
19 display unit, 20 image shift correction unit, 21 camera control unit,
22 abandoned vehicle enlarged photographing section, 23 vehicle number reading section,
24 Abandoned parking history generation unit.

Claims (5)

  An image input unit that captures images from a surveillance camera that captures a group of vehicles in a parking lot at a certain period,
A still image storage unit for storing still images captured by the image input unit;
Multiple still images stored in this still image storage unitAverage the luminance values of the pixels at the corresponding positions.Generate composite imageByA composite image generation unit that blurs an image of a vehicle that has moved in the composite image and sharpens an image of a vehicle that has not moved,
An abandoned vehicle position detector that detects the position of the abandoned vehicle using the composite image generated by the composite image generator;
  An accumulated image reproduction unit for reproducing the still image accumulated in the still image accumulation unit;
  And a parking lot monitoring apparatus comprising: a display unit that superimposes and displays the position of the neglected vehicle detected by the abandoned vehicle position detection unit on the still image reproduced by the accumulated image reproduction unit.   The parking lot monitoring apparatus according to claim 1, further comprising an image shift correction unit that corrects a shift of an image captured by the monitoring camera and captured by the image input unit.   The monitoring camera is configured to perform zoom turning, and based on the position of the left vehicle detected by the camera control unit that controls the zoom turning of the monitoring camera and the left vehicle position detection unit, the monitoring camera performs the above operation. 3. The parking lot monitoring apparatus according to claim 1, further comprising an abandoned vehicle enlargement photographing unit that takes an enlarged image of the abandoned vehicle and acquires the photographed enlarged image.   A vehicle number reading unit that reads a vehicle number from an enlarged image of the abandoned vehicle acquired by the abandoned vehicle enlarged photographing unit, and a parked parking for each vehicle number based on the vehicle number of the abandoned vehicle read by the vehicle number reading unit The parking lot monitoring apparatus according to claim 3, further comprising an abandoned parking history generation unit that generates a history.   2. The monitor camera according to claim 1, wherein a plurality of the monitor cameras are installed, and the video input unit periodically switches the plurality of monitor cameras and captures images taken by the plurality of monitor cameras. The parking lot monitoring apparatus according to claim 4.

Images