JP4653472B2 - Monitoring system and monitoring method - Google Patents

Description

  The present invention relates to a monitoring system and a monitoring method for transmitting image information captured by a monitoring camera, receiving image information transmitted by a security device, and monitoring a monitoring area, and in particular, detecting an abnormality from the image information. The present invention relates to a monitoring system and a monitoring method.

  Conventionally, in a monitoring system in which a security device and a monitoring center are connected via a network, when a monitoring camera is installed in a security area that is a security target of the security device, an image captured by the monitoring camera on the security device side It is generally known that an abnormality is detected by image processing data and an alarm is transmitted to a monitoring center when an abnormality is detected.

  In such a monitoring system, the security device detects temporal changes in the image data captured by the monitoring camera, extracts feature quantities such as the size and rate of change of the image in which the changes occurred, and the changes depend on the detection target. It is to determine whether or not it is a thing. However, when the background itself fluctuates over time, the fluctuation itself may be detected as a detection target. When the detection target is detected, an alarm is sent to the monitoring center, and the monitoring staff I had to go to and check. In order to solve such a problem, even when the background fluctuates, the detection target is detected by performing detection processing of the detection target with a plurality of comparison result images obtained by comparing a plurality of background images with the current image. A technique for accurately detecting is disclosed (for example, see Patent Document 1).

JP 2000-341679 A

  However, in the above-mentioned Patent Document 1, since the accuracy of abnormality detection on the security device side is increased, in order to introduce such a technique to the monitoring system, one customer where the security device is introduced. Therefore, it is necessary to replace an abnormality detection processing program, an LSI chip, etc. with permission to enter a customer in the security area, which requires a great amount of work labor and time. Therefore, in reality, it is difficult to upgrade the security device once introduced. In addition, it is conceivable that all image data is transmitted to the monitoring center side without performing abnormality detection processing on the security device side, and abnormality detection processing is performed on the monitoring center side, but the communication cost for transmitting the image data is enormous. In addition, a large amount of image data is transmitted to the monitoring center side, and it is necessary to perform abnormality detection processing for all of the image data, and such abnormality detection processing for such a large amount of data is enormous in the monitoring center system. There was a problem that a heavy load was applied and the processing could not be completed within an appropriate time.

  The present invention has been made in view of the above, and provides a monitoring system and a monitoring method capable of introducing high-accuracy abnormality detection processing as needed by sharing abnormality detection processing between a security device and a monitoring center. The purpose is to do.

In order to solve the above-described problems and achieve the object, the invention according to claim 1 is provided with a monitoring camera that captures an image of a monitoring region, and a security device that transmits image information captured by the monitoring camera, and the security device. And a monitoring center that receives the image information transmitted by the security device and monitors the monitoring area, and the security device is configured to receive the image information captured by the monitoring camera. First abnormality detection means for detecting an abnormality by performing image processing with information in units of pixels, and abnormality detection information for storing abnormality detection processing information indicating processing contents performed by the first abnormality detection means storage means, when an abnormality is detected in the first abnormality detecting means, the image information, stored in the abnormality detection information storage means Comprising an image information transmitting means for transmitting the serial abnormality detection process information to the monitoring center, and the monitoring center includes an image information receiving means for receiving the image information transmitted by the image information transmitting unit, the image An abnormality is detected by performing image processing using information in units of images of the image information received by the information receiving means, and an abnormality detection according to the abnormality detection processing information transmitted by the image information transmitting means is performed. And a second abnormality detection means for performing .

  According to a second aspect of the present invention, in the monitoring system according to the first aspect, the first abnormality detecting unit further converts the pixel of the image information captured by the monitoring camera into a white pixel or a black pixel. Abnormality is detected by performing image processing using the value-processed information, and the second abnormality detecting unit further performs image processing using image information including color pixels of the image information received by the image information receiving unit. Thus, an abnormality is detected.

  According to a third aspect of the present invention, in the monitoring system according to the first or second aspect, the first abnormality detection means further detects a moving object from information in units of pixels of the image information. An abnormality is detected by the above.

  The invention according to claim 4 is the monitoring system according to any one of claims 1 to 3, wherein the security device further converts the image information before the image information in the first abnormality detection means. In order to detect an abnormality as compared with the image information, image information storage means for storing the image information is provided.

According to a fifth aspect of the present invention, in the monitoring system according to any one of the first to fourth aspects, the image information transmitting unit is further configured to detect an abnormality by the first abnormality detecting unit. The image processing information that is the result of the broken image processing is transmitted.

The invention according to claim 6 includes a monitoring camera that captures an image of a monitoring area, is connected to a security device that transmits image information captured by the monitoring camera, the security device, and a network, and is transmitted by the security device. A monitoring method comprising: a monitoring center that receives the image information and monitors the monitoring area, wherein the security device performs image processing using information in units of pixels of the image information captured by the monitoring camera. A first abnormality detection step for detecting an abnormality by the abnormality, an abnormality detection information storage step for storing abnormality detection processing information indicating processing contents performed by the first abnormality detection step in an abnormality detection information storage means, when an abnormality is detected in one of the abnormality detecting step, and the image information, the abnormality detection information storage means to the stored Comprising an image information transmitting step of transmitting the normal detection process information to the monitoring center, and the monitoring center includes an image information receiving step of receiving the image information transmitted by the image information transmission step, the image information An abnormality is detected by performing image processing using information in units of images of the image information received in the reception step, and abnormality detection is performed according to the abnormality detection processing information transmitted in the image information transmission step. A second abnormality detection step.

  According to the invention of claim 1, the security device detects an abnormality by performing image processing with information in units of pixels of image information captured by the monitoring camera by the first abnormality detection unit, and the image When an abnormality is detected in the first abnormality detection unit by the information transmission unit, the image information is transmitted to the monitoring center. The monitoring center receives the image information transmitted by the image information transmission unit by the image information reception unit. Then, the abnormality is detected between the security device and the monitoring center by detecting an abnormality by performing image processing on the basis of the image of the image information received by the image information receiving means by the second abnormality detecting means. The detection process can be shared, relatively light processing is performed on the security device side, and the abnormality detection process is upgraded at any time on the monitoring center side. It is possible to introduce, an effect that can realize a high degree of abnormality detection processing as a whole monitoring system. In addition, there is an effect that advanced abnormality detection processing can be realized without changing the abnormality detection processing in the security device.

  According to the invention of claim 2, the first abnormality detection means further performs image processing with information obtained by binarizing the pixels of the image information captured by the monitoring camera into white pixels or black pixels. The second abnormality detecting means further detects an abnormality by performing image processing with image information composed of color pixels of the image information received by the image information receiving means. Since relatively light processing using binarized pixel data is performed and image processing can be performed with color information on the monitoring center side, the processing load on the security device side can be reduced, and the monitoring system As a whole, there is an effect that advanced abnormality detection processing can be realized.

  According to the invention of claim 3, the first abnormality detection means further detects an abnormality by detecting a moving object from information in units of pixels of the image information, thereby detecting an abnormality in the security device. Abnormality detection can be narrowed down in the processing, and the transmission of image data to the monitoring center is reduced, so that the processing load at the monitoring center is reduced.

  According to the invention of claim 4, the security device uses the image information storage means to further detect the abnormality by comparing the image information with the image information before the image information in the first abnormality detection means. By storing the image information, it is possible to detect an abnormality by comparing a plurality of pieces of image information. Therefore, it is possible to detect an abnormality with high accuracy in the abnormality detection process in the security device.

According to the invention of claim 5 , the image information transmitting means further monitors the image processing information by transmitting the image processing information that is the result of the image processing performed for detecting the abnormality by the first abnormality detecting means. The result of image processing performed by the security device in the abnormality detection processing at the center can be used, so there is no need to perform duplicate processing between the security device and the monitoring center, and the processing load at the monitoring center is reduced. There is an effect.

According to the invention of claim 6 , the security device detects an abnormality by performing image processing using information in units of pixels of image information captured by the monitoring camera in the first abnormality detection step. When an abnormality is detected in the first abnormality detection step by the image information transmission step, the image information is transmitted to the monitoring center, and the monitoring center transmits the image information transmitted by the image information transmission step by the image information reception step. By receiving information and detecting an abnormality by performing image processing on the basis of the image of the image information received by the image information receiving step by the second abnormality detecting step, the security device and the monitoring center Can share the abnormality detection process, and the monitoring device can detect abnormalities at any time by performing relatively light processing on the security device side. It is possible to introduce advanced technology to upgrade the physical, an effect that can realize a high degree of abnormality detection processing as a whole monitoring system. In addition, there is an effect that advanced abnormality detection processing can be realized without changing the abnormality detection processing in the security device.

  Exemplary embodiments of a monitoring system and a monitoring method according to the present invention are explained in detail below with reference to the accompanying drawings.

(First embodiment)
A first embodiment will be described with reference to the accompanying drawings. The monitoring system according to the first embodiment performs an abnormality detection process by performing image processing at the pixel level from image data on the security device side, and transmits the image data to the monitoring center when an abnormality is detected. The monitoring center further performs image processing at the image level to detect an abnormality and issue an alarm.

  First, a configuration example of a monitoring system to which the present invention is applied will be described. FIG. 1 is a block diagram illustrating a configuration of a monitoring system according to the first embodiment. The monitoring system 100 according to the present embodiment includes a security device 110 and a monitoring center 120, and the security device 110 and the monitoring center 120 are connected via a network 130 such as a telephone line, a wireless network, or the Internet. Has been.

  Furthermore, the security device 110 according to the present embodiment includes surveillance cameras 111a to 111n, an image information input unit 112, an abnormality detection unit 113, an image information transmission unit 114, an image information storage unit 115, and image processing information. And a storage unit 116.

  The monitoring cameras 111a to 111n capture images of the monitoring area and are arranged so as to grasp the status of the monitoring area. The image information input unit 112 receives input of image data captured by the monitoring cameras 111a to 111n.

  The abnormality detection unit 113 detects an abnormality in the monitoring area of the monitoring camera by performing image processing mainly on the pixel level of the image data received by the image input control unit 112. Specifically, the moving object is detected by performing pixel level image processing on the image data.

  The image information transmission unit 114 transmits image data in which an abnormality is detected to the monitoring center 120 when the abnormality detection unit 113 detects an abnormality. Note that the image information transmission unit 114 transmits not only the image data in which the abnormality is detected but also the image data before and after the image data in which the abnormality is detected and the data of the result of the image processing performed in the abnormality detection unit 113.

  The image information storage unit 115 stores the image data received by the image information input unit 112. The image processing information storage unit 116 stores data obtained as a result of image processing of image data by the abnormality detection unit 113.

  Note that part or all of the image information input unit 112, the abnormality detection unit 113, the image information transmission unit 114, the image information storage unit 115, and the image processing information storage unit 116 described above may be built in the monitoring camera 111. .

  The monitoring center 120 according to the present embodiment includes an image information receiving unit 121, an abnormality detection unit 122, an alarm display unit 123, an image information display unit 124, an image information storage unit 125, and an image processing information storage unit 126. It consists of and.

  The image information receiving unit 121 receives image data and image processing result data transmitted from the image information transmitting unit 114 of the security device 110.

  The abnormality detection unit 122 detects an abnormality in the monitoring area of the monitoring camera by performing image processing mainly at the image level on the image data and the image processing result data transmitted from the security device 110. Specifically, abnormality detection between pixels, that is, in units of images, that cannot be executed due to processing capacity limitations or the like in the abnormality detection processing in the security device is performed.

  The alarm display unit 123 displays an alarm on a monitor or the like when the abnormality detection unit 122 detects an abnormality. The image information display unit 124 displays image data in which an abnormality is detected on a monitor or the like when the abnormality detection unit 122 detects an abnormality.

  The image information storage unit 125 stores the image data received by the image information receiving unit 121 in a memory. The image processing information storage unit 126 stores data of the image processing result received by the image information receiving unit 121 in a memory.

  Next, monitoring processing by the monitoring system configured as described above will be described. 2A and 2B are an image information input unit, an abnormality detection unit, an image information transmission unit, an image information storage unit, an image processing information storage unit, an image information reception unit of the monitoring center, and an abnormality detection unit. It is a flowchart which shows the monitoring procedure which an alarm display part, an image information display part, an image information storage part, and an image process information storage part perform.

  First, in the security device 110, the image information input unit 112 accepts input of image data captured by the monitoring camera 111 (step S2001). The image information storage unit 115 stores the input image data in the memory (step S2002).

  The abnormality detection unit 113 performs image processing on the input image data and detects an abnormality (step S2003). Details of this processing will be described later. Further, the image processing information storage unit 116 stores image processing data, which is the result of image processing performed for abnormality detection by the abnormality detection unit 113, in the memory (step S2004).

  The abnormality detection unit 113 determines whether an abnormality is detected from the image processing result of the image data (step S2005). Specifically, image processing described later is performed using pixel-unit information of image data, that is, pixel values, and the same moving object is detected and the speed of the same moving object is within a predetermined threshold range. It can be determined whether or not an abnormality has been detected.

  When it is determined that an abnormality has been detected by the abnormality detection unit 113 (step S2005: Yes), the image information transmission unit 114 transmits image data from the image information storage unit 115 and image processing result data from the image processing information storage unit 116. Is acquired (step S2006).

  The image information transmission unit 114 transmits the acquired image data and image processing result data to the monitoring center 120 (step S2007). Returning to step S2005, if the abnormality detection unit 113 determines that no abnormality is detected (step S2005: No), the process returns to step S2001.

  In the monitoring center 120, the image information receiving unit 121 receives the transmitted image data and image processing result data (step S2008). The image information storage unit 125 stores the transmitted image data in the memory (step S2009). The image processing information storage unit 126 stores the transmitted image processing result data in the memory (step S2010).

  The abnormality detection unit 122 acquires the image data stored in the image information storage unit 125 and the image processing result data stored in the image processing information storage unit 126, performs image processing, and detects an abnormality (step S2011). Details of this processing will be described later.

  The abnormality detection unit 122 determines whether an abnormality is detected from the image processing result using the image data and the image processing result data (step S2012). Specifically, it is a person by performing image processing to be described later using information in image units of image data, that is, information determined as a moving object in the abnormality detection processing in the security device, and exceeding a predetermined threshold value. It is determined that an abnormality has been detected, for example, when it is predicted that the moving object determined to be a person will reach the most important security area such as a safe.

  When it is determined that an abnormality has been detected by the abnormality detection unit 122 (step S2012: Yse), the alarm display unit 123 displays an alarm on the monitor (step S2013). Further, the image information display unit 124 displays the image data on the monitor (step S2014), and the process is exited. Returning to step S2012, if the abnormality detection unit 122 determines that no abnormality is detected (step S2012: No), the process is exited.

  Next, the abnormality detection process for the security device in step S2003 in the above flowchart will be described. FIG. 3 is a flowchart showing an abnormality detection procedure performed by the abnormality detection unit of the security device.

  First, smoothing processing is performed on image data as image optimization processing (step S3001). Specifically, each pixel of the image data is averaged by multiplying a plurality of pixels by a predetermined coefficient based on one pixel. Note that the predetermined coefficients may all be 1 or may differ from pixel to pixel.

  The color image data is converted to gray scale (step S3002). Specifically, color image data input from a surveillance camera that captures a color image is converted to gray scale (an image composed of only achromatic colors). It is obtained by weighting the RGB components of each pixel and averaging them (output pixel = (0.299 * R component + 0.587 * G component + 0.114 * B component)).

  Contrast optimization processing is performed on the image data (step S3003). Specifically, the gray scale gradation is expanded to reduce the bias.

  Next, an edge detection process is performed as an image processing process (step S3004). Specifically, for each pixel of the image data, the amount of change in the pixel value with respect to the surrounding pixels is calculated on the basis of one pixel and the edge is detected.

  Difference calculation processing is performed on a plurality of image data (step S3005). Specifically, a difference between pixel values of pixels having the same coordinates is calculated by comparing a plurality of image data.

  A binarization process is performed on the result of the difference calculation process (step S3006). Specifically, each pixel is determined as a signal (black pixel) or noise (white pixel) depending on whether or not the threshold value is exceeded compared to a predetermined threshold value with respect to the difference calculation processing result. In addition, the above-described threshold value is not determined in advance, and a method of calculating from the image data for each image data is also common.

  Further, an image integration process is performed as a moving object detection process (step S3007). More specifically, a plurality of signal pixels adjacent to or within a certain distance from pixels determined as signal pixels in the binarization process are considered as a group, and these pixels are obtained as an area.

  A circumscribed ellipse calculation process is performed (step S3008). Specifically, an ellipse that is in contact with the outside of a group of pixels calculated by pixel integration processing is calculated, and the major axis and minor axis of the ellipse are calculated.

  The same moving object is detected (step S3009). Specifically, when a group of pixels calculated from a plurality of image data exists within a certain distance in each image data and falls within a certain area difference, it is detected as the same moving object, and the center of gravity of the same moving object is detected. The speed is calculated by dividing the linear distance by time.

  Furthermore, the abnormality detection process in the monitoring center in step S2011 of the flowchart of FIG. 2-2 will be described. FIG. 4 is a flowchart showing an abnormality detection procedure performed by the abnormality detection unit of the monitoring center.

  First, an area change distribution analysis process is performed as a shape analysis process of the moving object detected by the abnormality detection process in the abnormality detection unit of the security device (step S4001). Specifically, it analyzes how the moving body has changed its area with time, and determines whether the amount of change falls within a certain threshold.

  A circumscribed ellipse major / minor diameter change distribution analysis process is performed (step S4002). Specifically, it analyzes how the major axis and minor axis of the circumscribed ellipse calculated in the abnormality detection process of the security device have changed over time, and determines whether the amount of change falls within a certain threshold.

  Head / arm / leg detection processing is performed (step S4003). Specifically, the inscribed ellipse that fits inside the moving object is calculated, and pixel integration processing is performed for each signal pixel sandwiched between the inscribed ellipse and the circumscribed ellipse, and it is inconsistent assuming the head, arms, legs, etc. It is determined whether there is any.

  Next, a predicted reach area analysis process is performed as a moving body movement path analysis process (step S4004). Specifically, the arrival area on the extension line is predicted by obtaining the moving direction of the center of gravity of the moving object. If there is an important property such as a safe in the predicted arrival area, the warning level is changed and the warning is issued at an early stage. For example, even if it is currently determined that there is no abnormality, an alarm is issued if there is a safe or the like in the expected reach area, or a more important alarm may be issued if a current alarm is being issued. .

  Residence time analysis processing is performed (step S4005). Specifically, the time during which the moving object stays in the monitoring area is calculated. For example, there is a case where an abnormality is detected when there is no intention to use an ATM or the like inside a 24-hour ATM corner and the use of the ATM or the like of other customers is hindered. Conceivable.

  A velocity distribution analysis process is performed (step S4006). Specifically, it analyzes how the moving speed of the moving object has changed with time, and determines whether the amount of change falls within a certain threshold.

  Further, background color comparison analysis processing is performed as moving body color analysis processing (step S4007). Specifically, the color around the moving object detection position of the image data before moving object detection is compared with the color of the moving object.

  A moving body internal color gradient analysis process is performed (step S4008). Specifically, the degree of color change inside the moving object is analyzed, and the stereoscopic effect is determined from the shadow of the moving object. Color time variation analysis processing is performed (step S4009). Specifically, it analyzes how the color of the moving object has changed over time, and determines whether the amount of change falls within a certain threshold.

  Note that the above-described image processing is an example of image processing performed at the monitoring center and the abnormality detection unit of the security device, and part of the above-described image processing may be performed depending on the circumstances of the monitoring area, or other image processing may be performed. For example, image processing for determining a face may be added.

  As described above, since the abnormality detection processing is shared between the security device and the monitoring center, the abnormality detection processing with high accuracy can be realized by changing the abnormality detection processing in the monitoring center. Even if the abnormality detection process is not changed such as program installation or LSI chip replacement, the abnormality detection process with high accuracy can be realized as the entire monitoring system.

  In addition, the abnormality detection processing of the security device performs image processing that can be executed even if the processing speed of the pixel level is relatively slow and the memory is small, and the abnormality detection processing of the monitoring center requires a large amount of memory because the processing speed of the image level is high. By detecting anomalies separately for the image processing to be performed, it is possible to perform anomaly detection processing by image processing with higher accuracy compared to detecting an anomaly only by the security device and issuing an alarm. Can be reduced.

  Also, only when an abnormality is detected by performing image processing at the pixel level by the abnormality detection process in the security device, the image data is transmitted to the monitoring center and a more detailed abnormality detection process is performed. Since the image data is transmitted after being narrowed down to those with a high possibility of occurrence of abnormality to some extent, the image data to be transmitted is reduced compared to the case where all abnormality detection processing is performed only by the monitoring center. Since the image data to be subjected to abnormality detection processing at the monitoring center is reduced, the processing load at the monitoring center is reduced, and the time until abnormality detection can be shortened.

(Second Embodiment)
A second embodiment will be described with reference to the accompanying drawings. In the monitoring system according to the second embodiment, when a plurality of security devices are connected to a monitoring center via a network, when the level of image processing for image data differs for each security device, the monitoring center An abnormality is detected by performing image processing corresponding to the abnormality detection process executed by the security device, and an alarm is issued.

  A configuration example of a monitoring system to which the present invention is applied will be described. FIG. 5 is a block diagram illustrating a configuration of a monitoring system according to the second embodiment. The monitoring system 500 according to the present embodiment includes security devices 510, 540, and 550 and a monitoring center 520. The security devices 510, 540, and 550 and the monitoring center 520 include a telephone line, a wireless network, and the Internet. Or the like via a network 130.

  Furthermore, the security device 510 according to the present embodiment includes a monitoring camera 111a to 111n, an image information input unit 112, an abnormality detection unit 513, an image information transmission unit 514, an image information storage unit 115, and image processing information. The storage unit 116 and the processing level storage unit 517 are configured.

  Here, the configurations and functions of the monitoring cameras 111a to 111n, the image information input unit 112, the image information transmission unit 114, the image information storage unit 115, and the image processing information storage unit 116 are the same as those in the first embodiment. The description is omitted because it is similar.

  The abnormality detection unit 513 detects an abnormality in the monitoring area of the monitoring camera by performing image processing on the image data received by the image input control unit 112. In the present embodiment, it is possible to perform abnormality detection processing with different processing levels for each security device.

  When the abnormality detection unit 513 detects an abnormality, the image information transmission unit 514 transmits image data in which an abnormality is detected, image processing result data, and processing level information to the monitoring center 520.

  The processing level storage unit 517 stores processing level information of image processing performed by the abnormality detection unit 513 of the security device 510. Here, the processing level information is information indicating the processing content of the image processing executed by the abnormality detection unit of the security device. The abnormality detection processing information according to the present invention is configured.

  The processing level information is set according to the processing content of the image processing executed by the abnormality detection unit. If the processing content of the image processing is different, a different value is set accordingly. In addition, if the abnormality detection process of an abnormality detection part is changed, it will be changed in connection with it.

  FIG. 6 is an explanatory diagram illustrating an example of association between processing level information and processing content. For example, the processing level “1” indicates that the security processing to the binarization processing is performed by the security device, the processing level “2” indicates the smoothing processing to the same moving object detection processing, and the processing level “3” indicates the smoothing processing. It shows that the process up to the head / arm / leg detection process is performed by the security device. In the present embodiment, levels are classified according to whether or not processing is performed for a plurality of image processing. However, levels may be classified according to the accuracy of one image processing, and a combination of processing content and processing accuracy. You may divide the level.

  The other security devices 540 include the monitoring cameras 111a to 111n, the image information input unit 112, the abnormality detection unit 543, the image information transmission unit 514, the image information storage unit 115, and the image processing information storage unit 116. , And a processing level storage unit 547.

  Here, the configurations and functions of the monitoring cameras 111a to 111n, the image information input unit 112, the image information storage unit 115, and the image processing information storage unit 116 are the same as those in the first embodiment, and the image information transmission unit Since the configuration and function of 514 are the same as those of the security device 510, description thereof is omitted.

  The abnormality detection unit 543 detects an abnormality in the monitoring area of the monitoring camera by performing image processing on the image data received by the image input control unit 112 in the same manner as the abnormality detection unit 513 described above. Image processing in the abnormality detection unit 543 may be the same as or different from that of the abnormality detection unit 513 described above. The processing level storage unit 547 stores the processing level of image processing performed by the abnormality detection unit 543.

  Furthermore, the other security devices 550 include surveillance cameras 111a to 111n, an image information input unit 112, an abnormality detection unit 553, an image information transmission unit 514, an image information storage unit 115, and an image processing information storage unit 116. , And a processing level storage unit 557.

  Here, the configurations and functions of the monitoring cameras 111a to 111n, the image information input unit 112, the image information storage unit 115, and the image processing information storage unit 116 are the same as those in the first embodiment, and the image information transmission unit Since the configuration and function of 514 are the same as those of the security device 510, description thereof is omitted.

  The abnormality detection unit 553 detects an abnormality in the monitoring area of the monitoring camera by performing image processing on the image data received by the image input control unit 112 in the same manner as the abnormality detection units 513 and 543 described above. . Image processing in the abnormality detection unit 553 may be the same as or different from the above-described abnormality detection units 513 and 543. The processing level storage unit 557 stores the processing level of image processing performed by the abnormality detection unit 553.

  In the present embodiment, “2” as processing level information in the security device 510, “1” as processing level information in the security device 540, “3” as processing level information in the security device 550, processing level storage units 517, 547, 557 is assumed to be stored.

  The monitoring center 520 according to the present embodiment includes an image information reception unit 521, an abnormality detection unit 522, an alarm display unit 123, an image information display unit 124, an image information storage unit 125, and an image processing information storage unit 126. It consists of and.

  Here, since the configurations and functions of the alarm display unit 123, the image information display unit 124, the image information storage unit 125, and the image processing information storage unit 126 are the same as those in the first embodiment, description thereof is omitted. To do.

  The image information receiving unit 521 receives image data, image processing result data, and processing level information transmitted from the image information transmitting unit 514 of the security devices 510, 540, and 550. The abnormality detection unit 522 detects an abnormality in the monitoring area of the monitoring camera by performing image processing using the image data and the image processing result data in accordance with the processing level information received by the image information receiving unit 521. .

  Next, monitoring processing by the monitoring system configured as described above will be described. 7A and 7B are an image information input unit, an abnormality detection unit, an image information transmission unit, an image information storage unit, an image processing information storage unit, an image information reception unit of the monitoring center, and an abnormality detection unit. It is a flowchart which shows the monitoring procedure which an alarm display part, an image information display part, an image information storage part, and an image process information storage part perform.

  Since the procedure of the monitoring process according to the present embodiment is almost the same as the flowcharts shown in FIGS. 2-1 and 2-2, only different parts will be described. Steps S7001 to S7005 refer to the descriptions of Steps S2001 to S2005 in FIG. 2-1, Steps S7013 to S7015 refer to the descriptions of Steps S2012 to S2014 in FIG. 2-2, and descriptions thereof are omitted here.

  In step S7006, the image information transmission unit 514 acquires image data from the image information storage unit 115 and image processing result data from the image processing information storage unit 116 (step S7006), and the image information transmission unit 514 further processes the processing level. Processing level information of the image processing performed by the abnormality detection unit 513 of the security device 510 is acquired from the storage unit 517 (step S7007). The image information transmission unit 514 transmits the acquired image data, image processing result data, and processing level information to the monitoring center 520 (step S7008).

  In the monitoring center 520, the image information receiving unit 521 receives the transmitted image data, image processing result data, and processing level information (step S7009). The image information storage unit 125 stores the transmitted image data (step S7010). The image processing information storage unit 126 stores the transmitted image processing result data (step S7011).

  The abnormality detection unit 522 acquires the image data stored in the image information storage unit 125 and the image processing result data stored in the image processing information storage unit 126, and performs image processing according to the received processing level information. Abnormality is detected (step S7012). Details of this processing will be described later. For the following processing, refer to the description of step S2012 to step S2014 in FIG.

  Next, the abnormality detection process at the monitoring center in step S7012 of the above flowchart will be described. FIG. 8 is a flowchart showing an abnormality detection procedure performed by the abnormality detection unit of the monitoring center.

  First, the processing level of image processing in the security device is determined based on the processing level information transmitted from the security device (step S8001). If it is determined that the processing level is “1”, pixel integration processing (step S8002), circumscribed ellipse calculation processing (step S8003), and identical moving object detection processing (step S8004) are performed.

  Further, an area change distribution analysis process (step S8005), a circumscribed ellipse major and minor axis change distribution analysis process (step S8006), a head / arm / leg detection process (step S8007) are performed, and a predicted arrival area analysis process (step S8008). , Residence time analysis processing (step S8009), velocity distribution analysis processing (step S8010), background color comparison analysis processing (step S8011), moving object internal color gradient analysis processing (step S8012), color time variation analysis processing (step S8013) To exit the process.

  If it is determined that the processing level is “2”, the area change distribution analysis process (step S8005), the circumscribed ellipse major and minor axis change distribution analysis process (step S8006), the head / arm / leg detection process (step S8005). S8007), predicted arrival area analysis processing (step S8008), residence time analysis processing (step S8009), velocity distribution analysis processing (step S8010), background color comparison analysis processing (step S8011), moving body internal color gradient analysis processing ( Step S8012), color time variation analysis processing (step S8013) is performed, and the processing is exited.

  When it is determined that the processing level is “3”, the predicted arrival area analysis process (step S8008), the residence time analysis process (step S8009), the velocity distribution analysis process (step S8010), the background color comparison analysis process ( Step S8011), moving object internal color gradient analysis processing (step S8012), and color time variation analysis processing (step S8013) are performed, and the processing is exited. For details of each process, refer to the first embodiment, and a description thereof will be omitted.

  For example, in the case of the security device 510, since the processing level information is “2”, the abnormality detection unit 513 of the security device 510 performs the smoothing process to the same moving object detection process (see FIG. 6). In the abnormality detection unit 522 of the center 520, the area change distribution analysis process (step S8005) to the color time change amount analysis process (step S8013) are executed.

  Note that, as in the first embodiment, the above-described image processing is an example of image processing performed by the security device and the abnormality detection unit of the monitoring center, and performs part of the above-described image processing depending on the circumstances of the monitoring area. Further, other image processing, for example, image processing for identifying a person by determining a face may be added.

  Thus, even if the image processing performed by the security device installed at the customer performs different processing for each security device, the monitoring center grasps the processing contents of the image processing performed on the security device side. Therefore, it is possible to absorb the difference in image processing contents on the monitoring center side, so that with the introduction of new technology, change the abnormality detection processing for each security device, such as program installation or LSI chip replacement. Therefore, it is possible to realize a highly accurate abnormality detection process in which a new technology is introduced as the entire monitoring system.

  Note that the monitoring program executed by the security device constituting the monitoring system of the first and second embodiments and the monitoring program executed by the monitoring center are provided by being incorporated in advance in a ROM, an LSI chip, or the like.

  The monitoring program executed in the security device of the first and second embodiments and the monitoring program executed in the monitoring center are an installable format or executable format file, CD-ROM, flexible disk (FD). , A CD-R, a DVD (Digital Versatile Disk), or the like may be provided by being recorded on a computer-readable recording medium.

  Furthermore, the monitoring program executed in the security device of the first and second embodiments and the monitoring program executed in the monitoring center are stored on a computer connected to a network such as the Internet and downloaded via the network. You may comprise so that it may provide. Further, the monitoring program executed by the security device of the present embodiment and the monitoring program executed by the monitoring center may be provided or distributed via a network such as the Internet.

  The monitoring program executed by the security device according to the first and second embodiments includes the above-described units (image information input unit, abnormality detection unit, image information transmission unit, image information storage unit, image processing information storage unit, etc.). As the actual hardware, the CPU (processor) reads the monitoring program from the ROM and executes it to load the above units onto the main storage device. A unit, an image information transmission unit, an image information storage unit, an image processing information storage unit, and the like are generated on the main storage device.

  The monitoring program executed in the monitoring center according to the first and second embodiments includes the above-described units (image information receiving unit, abnormality detecting unit, alarm display unit, image information display unit, image information storage unit, image As a real hardware, the CPU (processor) reads the monitoring program from the ROM and executes it to load each unit on the main storage device. An information reception unit, an abnormality detection unit, an alarm display unit, an image information display unit, an image information storage unit, an image processing information storage unit, and the like are generated on the main storage device.

It is a block diagram which shows the structure of the monitoring system concerning 1st Embodiment. Image information input unit of security device, abnormality detection unit, image information transmission unit, image information storage unit, image processing information storage unit and image information reception unit of monitoring center, abnormality detection unit, alarm display unit, image information display unit, image It is a flowchart which shows the monitoring procedure which an information storage part and an image process information storage part perform. Image information input unit of security device, abnormality detection unit, image information transmission unit, image information storage unit, image processing information storage unit and image information reception unit of monitoring center, abnormality detection unit, alarm display unit, image information display unit, image It is a flowchart which shows the monitoring procedure which an information storage part and an image process information storage part perform. It is a flowchart which shows the abnormality detection procedure which the abnormality detection part of a security device performs. It is a flowchart which shows the abnormality detection procedure which the abnormality detection part of a monitoring center performs. It is a block diagram which shows the structure of the monitoring system concerning 2nd Embodiment. It is explanatory drawing which shows an example of matching of process level information and process content. Image information input unit of security device, abnormality detection unit, image information transmission unit, image information storage unit, image processing information storage unit and image information reception unit of monitoring center, abnormality detection unit, alarm display unit, image information display unit, image It is a flowchart which shows the monitoring procedure which an information storage part and an image process information storage part perform. Image information input unit of security device, abnormality detection unit, image information transmission unit, image information storage unit, image processing information storage unit and image information reception unit of monitoring center, abnormality detection unit, alarm display unit, image information display unit, image It is a flowchart which shows the monitoring procedure which an information storage part and an image process information storage part perform. It is a flowchart which shows the abnormality detection procedure which the abnormality detection part of a monitoring center performs.

Explanation of symbols

100 500 Monitoring system 110 510 540 550 Security device 120 520 Monitoring center 130 Network 111a to 111n Monitoring camera 112 Image information input unit 113 513 543 553 Abnormality detection unit 114 514 544 554 Image information transmission unit 115 Image information storage unit 116 Image processing information Storage unit 517 547 557 Processing level storage unit 121 521 Image information reception unit 122 522 Abnormality detection unit 123 Alarm display unit 124 Image information display unit 125 Image information storage unit 126 Image processing information storage unit

Claims (6)

A monitoring device that captures an image of the monitoring area; a security device that transmits image information captured by the monitoring camera; and the security device that is connected to the security device and a network and that receives the image information transmitted by the security device and receives the monitoring area In a monitoring system comprising a monitoring center for monitoring
The security device
First abnormality detecting means for detecting abnormality by performing image processing with information in units of pixels of the image information captured by the monitoring camera;
Abnormality detection information storage means for storing abnormality detection processing information indicating the content of processing performed by the first abnormality detection means;
Image information transmitting means for transmitting the image information and the abnormality detection processing information stored in the abnormality detection information storage means to the monitoring center when an abnormality is detected in the first abnormality detection means; With
The monitoring center is
Image information receiving means for receiving the image information transmitted by the image information transmitting means;
Abnormality according to the abnormality detection processing information transmitted by the image information transmitting means, as well as detecting abnormality by performing image processing with information in units of images of the image information received by the image information receiving means Second abnormality detecting means for performing detection;
A monitoring system comprising: The first abnormality detection means further detects abnormality by performing image processing with information obtained by binarizing the pixels of the image information captured by the monitoring camera into white pixels or black pixels,
The said 2nd abnormality detection means further detects abnormality by performing an image process with the image information which consists of the color pixel of the said image information received by the said image information receiving means. Monitoring system.   The monitoring system according to claim 1, wherein the first abnormality detection unit further detects an abnormality by detecting a moving object from information in units of pixels of the image information.   The security device further includes image information storage means for storing the image information in order to detect the abnormality by comparing the image information with the image information before the image information in the first abnormality detection means. The monitoring system according to any one of claims 1 to 3. The image information transmitting means according to claim 1 any one of 4, characterized by further transmitting said image processing information is a result of image processing performed to detect abnormalities by the first abnormality detecting means Monitoring system described in one. A monitoring device that captures an image of the monitoring area; a security device that transmits image information captured by the monitoring camera; and the security device that is connected to the security device and a network and that receives the image information transmitted by the security device and receives the monitoring area In a monitoring method comprising a monitoring center for monitoring
The security device
A first abnormality detection step of detecting abnormality by performing image processing with information in units of pixels of the image information captured by the monitoring camera;
An abnormality detection information storage step for storing in the abnormality detection information storage means abnormality detection processing information indicating the content of processing performed by the first abnormality detection step;
An image information transmission step of transmitting the image information and the abnormality detection processing information stored in the abnormality detection information storage means to the monitoring center when an abnormality is detected in the first abnormality detection step; With
The monitoring center is
An image information receiving step for receiving the image information transmitted by the image information transmitting step;
Abnormality according to the abnormality detection processing information transmitted by the image information transmitting step is detected by performing image processing using information in units of images of the image information received by the image information receiving step. A second abnormality detection step for performing detection;
A monitoring method comprising:

Images