JP7708148B2 - PROGRAM, VIDEO MONITORING METHOD AND VIDEO MONITORING SYSTEM - Google Patents

Description

The present invention relates to video surveillance technology.

There are surveillance systems that use multiple surveillance (security) cameras. The following Patent Document 1 proposes a surveillance method that links multiple cameras, including a rotating camera that can be controlled with pan, tilt, and zoom, to display an enlarged image of an intruding object without blind spots using a minimum number of cameras. With this method, while no intruder is detected in the monitored space, two rotating cameras are made to capture a wide area of the monitored space, each compensating for the other's blind spots. When an intruder is detected in the monitored space in an image captured by one of the cameras, the coordinates of the intruder in the monitored space are calculated, and the other camera is controlled to face the coordinates and capture an enlarged image.

Patent Document 2 below proposes a surveillance camera system in which a master camera and a slave camera work together to capture images of entertainers, who are the subject of surveillance. In this system, when the subject of surveillance is captured by the master camera, the shooting direction of the slave camera is calculated based on the shooting direction of the master camera and the position information of the master camera and the slave camera. Then, by pointing the shooting direction of the slave camera in the calculated direction, the master camera and the slave camera work together to capture the subject of surveillance.

JP 2004-343718 A JP 2005-333628 A

The above-mentioned proposed methods for coordinating operations between cameras (imaging devices) capture images of people with multiple cameras so that intruders and other people can be monitored without any blind spots. That is, each proposed method is a method in which, when an intruder or other person is detected by one imaging device, another imaging device is aimed in the direction of the person. However, such methods reduce the surveillance efficiency in scenes where multiple people are coming and going. In other words, when each proposed method is applied to a scene where multiple people are coming and going, it reacts to all of the large number of people coming and going, and the camera is controlled each time, reducing the surveillance efficiency.

The present invention was made in consideration of these circumstances, and provides technology for efficient monitoring using multiple imaging devices.

In order to solve the above-mentioned problems, each aspect of the present invention adopts the following configuration.

The first aspect relates to a program for a video surveillance system, the program causing a computer to execute (1) a storage process for storing a plurality of surveillance positions and camera parameters for capturing images of the plurality of surveillance positions in association with each other, (2) a detection process for detecting an intrusion of a person into a predetermined position that is a part of an image captured by a first camera, and (3) a control process for controlling an image capturing direction of the second camera so that the second camera captures the detected predetermined position based on the camera parameters.

A second aspect relates to a video surveillance method executed by at least one computer, the video surveillance method including : (1) storing a plurality of surveillance positions and camera parameters for capturing images of the plurality of surveillance positions in association with each other; (2) detecting an intrusion of a person into a predetermined position that is a part of an image captured by a first camera; and (3) controlling an imaging direction of a second camera based on the camera parameters so that the second camera captures an image of the detected predetermined position .

The third aspect relates to a video surveillance system, the video surveillance system including: (1) a storage unit that stores a plurality of surveillance positions and camera parameters for capturing images of the plurality of surveillance positions in association with each other; (2) a detection unit that detects an intrusion of a person into a predetermined position that is a part of an image captured by a first camera; and (3) a control unit that controls an image capturing direction of the second camera based on the camera parameters so that the second camera captures an image of the detected predetermined position.
According to another aspect of the present invention, there may be provided a computer-readable recording medium having the program according to the first aspect recorded thereon. The recording medium includes a non-transitory tangible medium.

The above aspects provide a technology that enables efficient monitoring using multiple imaging devices.

The above objects, as well as other objects, features and advantages, will become more apparent from the preferred embodiments described below and the accompanying drawings.

1 is a diagram conceptually illustrating an example of a hardware configuration of a video monitoring system according to a first embodiment. 2 is a diagram conceptually illustrating an example of a processing configuration of a monitoring and control device in the first embodiment; FIG. 1 is a diagram showing the relationship between the imaging area of a surveillance camera and a set surveillance area. 11 is a diagram illustrating an example of correspondence relationship information stored in a correspondence storage unit. FIG. 4 is a flowchart showing an example of the operation of the monitoring and control device in the first embodiment. FIG. 13 is a diagram conceptually illustrating an example of control of a surveillance camera. 1 is a diagram showing the relationship between an imaging area of a surveillance camera, a surveillance target position, and a detection target position; 13 is a diagram showing an example of correspondence relationship information further stored in a correspondence storage unit. FIG. 10 is a flowchart showing an example of the operation of the monitoring and control device in the second embodiment. FIG. 13 is a diagram conceptually illustrating an example of control of a surveillance camera. FIG. 13 is a diagram conceptually illustrating an example of a processing configuration of a video monitoring system according to a third embodiment. FIG. 13 is a diagram conceptually illustrating an example of a hardware configuration of a video monitoring system according to a third embodiment. 13 is a flowchart showing an example of the operation of the video monitoring system in the third embodiment. 1 is a conceptual diagram of a stadium to which a video surveillance system is applied. FIG. 11 is a diagram showing a specific example of a predetermined event.

First, in order to facilitate understanding of embodiments of the present invention, a background of the present invention will be described.
There are monitoring systems that control other monitoring cameras when a certain monitoring camera detects an object such as a person or a car. With such a monitoring system, multiple monitoring cameras can cooperate with each other to comprehensively monitor intruders and the like. However, such monitoring systems are originally intended to be applied to prohibited areas where people are prohibited from entering or scenes where people's appearance is somewhat limited, so they simply start controlling other cameras when they detect a person. Therefore, in scenes where many people come and go or crowds form, such as streets in cities, large commercial facilities, airports, terminal stations, important facilities such as platforms, leisure facilities, sports facilities, stadiums, etc., the monitoring cameras are controlled each time a person is detected, and monitoring work cannot be performed efficiently.

According to the embodiments of the present invention described below, the above problems are solved and monitoring operations can be performed efficiently. However, each of the embodiments described below is merely an example, and the present invention is not limited to the configuration of each of the following embodiments.

[First embodiment]
[System Configuration]
1 is a diagram conceptually illustrating an example of the hardware configuration of a video monitoring system 1 (hereinafter, sometimes abbreviated as system 1) in a first embodiment. The system 1 includes a monitoring control device 10 and multiple monitoring cameras 9 (#1), 9 (#2) to 9 (#n).

The multiple surveillance cameras 9 (#1), 9 (#2) to 9 (#n) each include at least one movable camera whose imaging direction can be changed. As long as the imaging direction of this movable camera can be changed, its movable direction may only be changed up and down, or only left and right. In the following explanation, it is assumed that surveillance camera 9 (#1) is a PTZ (Pan-Tilt-Zoom) camera. The other surveillance cameras 9 (#2) and others are fixed or movable cameras. Hereinafter, each surveillance camera will be referred to as "surveillance camera 9" unless it is necessary to distinguish between individual surveillance cameras.

Each surveillance camera 9 is installed in a different location so that the imaging area overlaps with at least one other surveillance camera 9. Each surveillance camera 9 sends a video signal (image frame) to the communication unit 5. The transmission rate of the image frames sent by each surveillance camera 9 to the communication unit 5 is not limited. If the transmission rate of the image frames is high, the surveillance control device 10 can acquire many image frames per time unit, thereby enabling highly accurate surveillance control. The transmission rate of the image frames may be determined according to the frame rate specifications of each surveillance camera 9, the communication capacity between the surveillance control device 10 and each surveillance camera 9, the accuracy required for the video surveillance system 1, etc. Furthermore, as long as each surveillance camera 9 can output a video signal, its performance and function are not limited.

The monitoring and control device 10 is a so-called computer, and has, for example, a CPU (Central Processing Unit) 2, a memory 3, an input/output interface (I/F) 4, a communication unit 5, etc., which are connected by a bus. There is no limit to the number of each hardware element, and these hardware elements can also be collectively referred to as an information processing circuit. The hardware configuration of the monitoring and control device 10 is not limited to the example shown in FIG. 1.

The CPU 2 may also include an application specific integrated circuit (ASIC), a digital signal processor (DSP), a graphics processing unit (GPU), etc. The memory 3 is a random access memory (RAM), a read only memory (ROM), or an auxiliary storage device (such as a hard disk).

The input/output I/F 4 can be connected to user interface devices such as a display device 7, an input device 8, a printer (not shown), and a projection device (not shown). The display device 7 is a device that displays a screen corresponding to drawing data processed by a CPU 2 or a GPU (Graphics Processing Unit) (not shown), such as an LCD (Liquid Crystal Display) or CRT (Cathode Ray Tube) display. The display device 7 may display images obtained from video signals sent from each surveillance camera 9. The input device 8 is a device that accepts user operation input such as a keyboard or mouse. The surveillance control device 10 may also be implemented as a calculator for a mobile device (such as a smartphone or tablet), and the input/output I/F 4 may be connected to a touch panel in which the display device 7 and the input device 8 are integrated.

The communication unit 5 exchanges signals with other computers and devices via wired or wireless communication. In this embodiment, the communication unit 5 communicates with multiple surveillance cameras 9. There are no limitations on the communication method between the communication unit 5 and each surveillance camera 9. For example, the communication unit 5 acquires a video signal from each surveillance camera 9 and sends an instruction signal to the surveillance camera 9. A portable recording medium or the like can also be connected to the communication unit 5.

[Processing configuration]
2 is a diagram conceptually illustrating an example of a processing configuration of the monitoring control device 10 in the first embodiment. As shown in FIG. 2, the monitoring control device 10 has an acquisition unit 11, an image storage unit 12, a detection unit 13, a camera control unit 14, a correspondence storage unit 15, an output processing unit 16, an input unit 17, a calculation unit 18, and the like. Each of these processing modules is realized, for example, by the CPU 2 executing a program stored in the memory 3. In addition, the program may be installed, for example, from a portable recording medium such as a CD (Compact Disc) or a memory card, or from another computer on a network, via the input/output I/F 4 or the communication unit 5, and stored in the memory 3.

The acquisition unit 11 acquires data of images captured by each surveillance camera 9 from each surveillance camera 9. Specifically, the acquisition unit 11 sequentially acquires image data from the video signal sent from each surveillance camera 9. At this time, the acquisition unit 11 may acquire image data by capturing the input video signal at any timing. The acquisition unit 11 associates the acquired image data with the identification information of the surveillance camera 9 that captured the image, and stores the image data in the image storage unit 12. The acquisition unit 11 acquires images, for example, via the communication unit 5.

The acquisition unit 11 further acquires camera parameters capable of identifying the imaging direction of the surveillance camera 9, and further associates the camera parameters with the image data and the identification information of the surveillance camera 9, and stores them in the image storage unit 12. The camera parameters indicate, for example, the position of the surveillance camera 9, the attitude of the surveillance camera 9, the zoom value, etc. (which may include internal parameters) indicating the imaging direction, etc., and may be acquired from each surveillance camera 9 or from the camera control unit 14. Hereinafter, image data may also be referred to as an image.

The input unit 17 accepts input by the user of the setting of a monitoring position at which a specific event is to be detected. A "monitoring position" is defined as any static point, line, plane, or space in a common coordinate system or a camera coordinate system. A "monitoring position" is, for example, the "position of the video monitoring line" or the "position of the monitoring area." A common coordinate system is a coordinate system that is commonly recognized among multiple monitoring cameras 9 and among images captured by each monitoring camera 9. For example, a GPS (Global Positioning System) coordinate system or a coordinate system defined on a floor map within a facility can be used as the common coordinate system. A camera coordinate system is a coordinate system that is set on an image captured by a certain monitoring camera 9.

That is, the input unit 17 may accept the setting of the monitoring position in the camera coordinate system of a specified monitoring camera 9, or in a common coordinate system. When the monitoring position is set in the camera coordinate system, the input unit 17 converts the monitoring position into the common coordinate system based on the above-mentioned camera parameters. Various known methods can be applied to the conversion between the common coordinate system and the camera coordinate system using the camera parameters.

The input unit 17 outputs the received common coordinate system information of the monitoring position together with the identification information of the monitoring position to the calculation unit 18. The input unit 17 receives the monitoring position settings input by the user operating the input device 8 illustrated in FIG. 1 via the input/output I/F 4.

Here, we will explain the video monitoring line and monitoring area at the "position of the video monitoring line" or "position of the monitoring area", which are specific examples of monitoring positions. A "video monitoring line" is a line specified by the user that is superimposed on a monitoring image, etc., and is used to detect objects that cross (pass) or touch the line. A "monitoring area" is a part of a monitoring image, etc., set by the user, and is used to detect a specified event. Other names for the monitoring area include AOI (Area Of Interest), ROI (Region Of Interest), detection area, restricted area, etc.

Figure 3 is a diagram showing the relationship between the imaging areas of the surveillance cameras and the set surveillance area. In the example of Figure 3, surveillance cameras 9 (#1) and 9 (#2) are installed so that their imaging areas overlap. Furthermore, surveillance area AM is set so that it partially overlaps the imaging area where the two imaging areas overlap. In the example of Figure 3, surveillance area AM is set as a planar area on a common coordinate system, i.e., a planar area on the floor surface (ground) in the real world. In this embodiment, it is assumed that surveillance cameras 9 are installed and surveillance area AM is set as shown in Figure 3.

The calculation unit 18 calculates camera parameters for capturing an image of each monitoring camera 9 capable of capturing an image of the monitoring position from the monitoring position represented in the common coordinate system output from the input unit 17. The method by which the calculation unit 18 calculates the camera parameters is not limited, and various known methods may be used. For example, the correspondence storage unit 15 may hold, in addition to the stored information described later, a correspondence between the imageable range of each monitoring camera 9 in the common coordinate system and a camera parameter group for capturing the image of the range for each monitoring camera 9 in advance. In that case, the calculation unit 18 can determine the camera parameters so that a certain position (monitoring position) on the common coordinate system can be captured using the correspondence stored in the correspondence storage unit 15. The calculation unit 18 may calculate the camera parameters so that a video monitoring line is captured in the center of the angle of view. For example, the calculation unit 18 may calculate the camera parameters so that the proportion of the monitoring area occupying the entire angle of view is about half. The calculation unit 18 outputs to the correspondence storage unit 15 information that corresponds the identification information (ID) of each monitoring position, the coordinate information of each monitoring position in a common coordinate system, and the camera parameters capable of capturing an image of the monitoring position for each monitoring camera 9 that can capture the monitoring position.

The detection unit 13 detects a predetermined event at a monitoring position included in an image captured by each surveillance camera 9. The detection unit 13 can identify a monitoring position in an image based on the camera parameters of the surveillance camera 9 when capturing the image and the common coordinates of the monitoring position stored in the correspondence storage unit 15. The camera parameters of the surveillance camera 9 when capturing an image may be those stored in the image storage unit 12 in association with the image. For example, the detection unit 13 can convert the camera coordinate system on the image to a common coordinate system based on the correspondence between the captureable range of each surveillance camera 9 in the common coordinate system and the camera parameter group for capturing the range, and the camera parameters when capturing the image. The correspondence is, for example, stored in advance in the correspondence storage unit 15 as described above. This allows the detection unit 13 to determine whether or not a surveillance position is included in the image based on the relationship between the range of the common coordinate system shown in the image and the common coordinates of the surveillance position. If a surveillance position is included in the image, the detection unit 13 can convert the common coordinates of the surveillance position into the camera coordinates of the surveillance camera 9. The detection unit 13 detects a predetermined event at a monitoring position (a monitoring position in an image) represented in the camera coordinate system. However, there are no limitations on the method by which the detection unit 13 identifies the monitoring position.

The predetermined events detected by the detection unit 13 are various situations to be monitored in this system 1. For example, the detection unit 13 detects a predetermined situation caused by an object as the above-mentioned predetermined event. An "object" is a part or all of a predetermined object, such as a person, an animal, a vehicle such as a car, or a suitcase. For example, the predetermined events include an object passing through a video surveillance line, a predetermined situation of an object in a surveillance area (intrusion, leaving, appearing, disappearing, fighting, staying, loitering, falling, standing up, sitting down, changing the direction of movement, running in the wrong direction, shoplifting, detouring, damaging, taking away, abandoning, graffiti, etc.), and the movement of an object along a specific route defined by a line segment.

The detection unit 13 may also detect, as a predetermined event, that a predetermined situation has occurred in a predetermined number or more of objects. The term "object" is as described above. The predetermined situation is a situation that can occur due to an object, and includes the above-mentioned situations such as the passing of a video surveillance line and an intrusion into a surveillance area. The detected predetermined event in this case can also be described as an "abnormal state" as a situation that requires special attention. For example, when the object is a person, if a plurality of people remain in the surveillance area, a crowd will be formed. The detection unit 13 detects the state in which the crowd is formed as an abnormal state. The detection unit 13 may also detect, as an "abnormal state", a case in which the above-mentioned predetermined situation has occurred in a predetermined number or more of objects at almost the same time. For example, when the object is a person, if a plurality of people sit down at the same time in the surveillance area, it is considered that an abnormal situation such as a person suddenly firing a gun has occurred. The detection unit 13 detects the situation in which a large number of people sit down at the same time as an abnormal state. The video surveillance line may have a directional attribute (right to left, left to right, both directions, etc.), and may be designed to be detected as a specified event only when an object passes in a direction specified by the user. It may also be designed to be detected as a specified event when the number of people passing through the video surveillance line per unit time exceeds a specified number. It may also be designed to detect that state as an abnormal state.

The detection unit 13 detects an object from the acquired image in order to detect a predetermined event. The detection unit 13 detects the object using various existing methods. For example, the detection unit 13 detects the object from the acquired image by a background subtraction method. In this case, the detection unit 13 constructs a model representing background information from multiple images input in a time series, and detects a moving object using the model. In the simplest case, the detection unit 13 defines a background image generated by averaging information of a still area of an image between multiple frames as a background model. The detection unit 13 calculates the difference between the target image and the background image, and detects an area with a large difference as an object. The detection unit 13 may directly use a model of an object such as a person for detection without using a background model. For example, in the case of a person, the model used here may be a model representing the entire person, or a model representing a part of a person. For example, the detection unit 13 may detect the face or head using a face detector or a head detector that models and detects the face or head as part of a person. Alternatively, the detection unit 13 may detect the target object using a detector that detects part of a person's area, such as the upper body or lower body.

The detection unit 13 also detects a predetermined event using various existing methods. For example, the detection unit 13 detects a change in a detected object to a predetermined state while tracking the object between multiple images. The predetermined state after the change may be stored in advance as an image feature. Well-known methods may be used for tracking an object between images and detecting a change in the state of an object. Alternatively, the detection unit 13 may detect an event corresponding to a predetermined state by detecting the predetermined state using the image feature of an object that is in the predetermined state.

The detection unit 13 detects a specific event at a monitoring position in an image by converting the common coordinates of the monitoring positions stored in the correspondence storage unit 15 into the camera coordinate system. Therefore, when the detection unit 13 detects a specific event, it can identify the ID of the monitoring position where the specific event or abnormal state was detected based on the information stored in the correspondence storage unit 15. The ID of the monitoring position where the specific event or abnormal state was detected is used, for example, by the camera control unit 14 described below.

After the detection unit 13 detects a specific event, the camera control unit 14 selects a surveillance camera 9 capable of capturing an image of the surveillance position (e.g., the position of the video surveillance line or the position of the surveillance area) from among the multiple surveillance cameras 9, and controls the selected surveillance camera 9 to capture an image of the surveillance position where the specific event was detected. The camera control unit 14 excludes the surveillance cameras 9 that were not selected from the control targets when the specific event was detected. In this embodiment, the camera control unit 14 selects, as the control target, a surveillance camera 9 other than the surveillance camera 9 that captured the image where the specific event was detected from among the multiple surveillance cameras 9, which is capable of capturing an image of the surveillance position where the specific event was detected. For example, the camera control unit 14 selects the surveillance camera 9 to be controlled by referring to the correspondence relationship information stored in the correspondence storage unit 15 illustrated in FIG. 4.

Figure 4 is a diagram showing an example of the correspondence information stored in the correspondence storage unit 15. As illustrated in Figure 4, the correspondence storage unit 15 stores information showing multiple correspondences between the identification information (camera ID) of the surveillance camera 9, the identification information (surveillance location ID) of the surveillance location, the common coordinates of the surveillance location, and the camera parameters. The camera parameters included in the correspondence information indicate parameters for the surveillance camera 9 specified by the camera ID to capture the surveillance location specified by the surveillance location ID, and indicate the attitude and zoom value of the surveillance camera 9. The common coordinates of the surveillance location may be defined by a line segment such as a video surveillance line, or may be defined by an area such as a surveillance area. In the case of a line segment, the coordinates of both ends of the line segment are indicated. In the case of an area, the coordinates of the lower left vertex and the upper right vertex of the area defined by, for example, a rectangle are indicated. In Figure 4, an example is shown in which the common coordinates are defined by the X-axis and Y-axis set on a map of a street.

The camera control unit 14 acquires, from the detection unit 13, the identification information (ID) of the monitoring location where the specified event was detected. Alternatively, the camera control unit 14 may directly refer to the correspondence information stored in the correspondence storage unit 15 to identify the ID of the monitoring location where the specified event was detected. That is, the camera control unit 14 can identify the ID of the monitoring location using the camera parameters acquired together with the image captured by the monitoring camera 9 (#1). For example, the camera control unit 14 selects a parameter that is closer to the camera parameter acquired together with the image where the specified event was detected from "parameter 01" and "parameter 02" associated with the ID "001" of the monitoring camera 9 (#1). The camera control unit 14 can identify the monitoring location identified by the ID "002" associated with the selected "parameter 02" as the monitoring location where the specified event was detected.

When the camera control unit 14 identifies the ID of the monitoring location where the predetermined event was detected, it can acquire the ID of the monitoring camera 9 (control target) other than the monitoring camera 9 that captured the image where the predetermined event was detected, which is associated with the ID of the identified monitoring location, and the camera parameters from the corresponding storage unit 15. The camera control unit 14 uses the acquired camera parameters to control the monitoring camera 9 identified by the acquired ID. As a result of this control, the monitoring camera 9 other than the monitoring camera 9 that captured the image where the predetermined event was detected will capture the monitoring location where the predetermined event was detected. The camera control unit 14 can control the monitoring camera 9 by sending the acquired camera parameters to the monitoring camera 9 so that the camera parameters are set to the monitoring camera 9 that is the control target. The camera control unit 14 may also send a control signal to the monitoring camera 9 so that the attitude or zoom value indicated by the acquired camera parameters is set. The camera control unit 14 may change the imaging direction of the monitoring camera 9, may change other parameters (zoom value, etc.) of the monitoring camera 9, or may change both. There are no specific limitations on the specific control method, as long as the surveillance camera 9 that was not able to capture the surveillance position where the specified event was detected is controlled so that it can capture the image.

The method of selecting the surveillance camera 9 to be controlled and the method of controlling that surveillance camera 9 are not limited to the above examples, and various known methods may be used. In the correspondence storage unit 15, other information that enables the surveillance camera 9 to capture an image of the surveillance position, rather than the camera parameters, may be associated with the camera ID and the ID of the surveillance position. Furthermore, the correspondence information stored in the correspondence storage unit 15 may be information that associates identification information of multiple surveillance cameras 9 that can capture the same surveillance position with each camera parameter for the surveillance cameras 9 to capture the surveillance position.

Furthermore, the correspondence information stored in the correspondence storage unit 15 may not include information used to control the imaging direction of the surveillance camera 9 to be controlled. In this case, the camera control unit 14 may control the surveillance camera 9 to be controlled, and check the images obtained from the surveillance camera 9 after control one by one until the target surveillance position is included. When the camera control unit 14 confirms that the target surveillance position is included, it stops controlling the surveillance camera 9.

The output processing unit 16 causes the display device 7 to display the images captured by each surveillance camera 9 and stored in the image storage unit 12. The output processing unit 16 may also cause the display device 7 to display the images acquired by the acquisition unit 11. For example, the output processing unit 16 causes the display device 7 to constantly display the images captured by each surveillance camera 9. When a predetermined event is detected by the detection unit 13, the output processing unit 16 can also display the image in which the predetermined event was detected on the display device 7 with emphasis over other images. When a predetermined event is detected, the output processing unit 16 can also output to an output device other than the display device 7 (such as a printer, an audio output device, or an LED (Light Emitting Diode)). In this embodiment, the output form of the images captured by each surveillance camera 9 is not limited.

[Example of operation]
The video monitoring method in the first embodiment will be described below with reference to Fig. 5 and Fig. 6. Fig. 5 is a flow chart showing an example of the operation of the monitoring control device 10 in the first embodiment. As shown in Fig. 5, the video monitoring method in the first embodiment is executed by at least one computer (CPU 2) such as the monitoring control device 10. Since each process is similar to the processing content of each of the above-mentioned processing modules possessed by the monitoring control device 10, details of each process will be omitted as appropriate.

The monitoring control device 10 accepts the user's input of the setting of the monitoring position (S51). For example, the monitoring control device 10 accepts the setting of the monitoring position in the camera coordinate system of a specified monitoring camera 9 or in a common coordinate system. When the monitoring position is set in the camera coordinate system, the monitoring control device 10 converts the monitoring position into the common coordinate system based on the camera parameters of the camera that captured the image in which the camera coordinate system is set.

Then, the monitoring control device 10 calculates (S52) the camera parameters for capturing an image of the monitoring position for each monitoring camera 9 capable of capturing an image of the monitoring position from the common coordinates of the monitoring position obtained from the input received in (S51). The method for calculating these camera parameters is as described above.

The monitoring control device 10 determines a monitoring location ID for the monitoring location set by the input received in (S51), and stores the monitoring location ID, the common coordinates for that monitoring location, and the camera parameters for each monitoring camera 9 calculated in (S52) in association with each other in the correspondence storage unit 15 (S53). As a result, the correspondence storage unit 15 stores, for the monitoring location input by the user, the identification information (ID), the common coordinates, and the camera parameters for capturing an image of that monitoring location with a monitoring camera 9 capable of capturing an image of that monitoring location in association with each other.

The monitoring control device 10 acquires data of images captured by each monitoring camera 9 from each monitoring camera 9 (S54). The monitoring control device 10 associates the acquired image data with the identification information of the monitoring camera 9 that captured the image, and stores the image data in the image storage unit 12. At this time, the monitoring control device 10 further acquires the camera parameters of the monitoring camera 9 that captured the image, and further associates the camera parameters with the image data and the identification information of the monitoring camera 9, and stores the image data in the image storage unit 12.

The monitoring control device 10 identifies the monitoring position (e.g., the position of the video monitoring line or the position of the monitoring area) in the image acquired in (S51) or the image extracted from the image storage unit 12 (S55). In this identification, the camera parameters acquired in (S54) and the common coordinates of the monitoring position stored in the corresponding storage unit 15 are used. The specific method of identifying the monitoring position from the image is as described above. The process of S55 is executed each time the PTZ of the monitoring camera is controlled (each time the imaging range changes).

The monitoring control device 10 detects (S56) a predetermined event at the monitoring position identified in (S55). For example, the monitoring control device 10 detects one or more of the following as the predetermined event: the passing of an object through a video monitoring line, a predetermined state of an object in a monitoring area, movement of an object along a specific route defined by a line segment, etc. The monitoring control device 10 may also detect an abnormal state as the predetermined event. The content of the predetermined event and the method of detecting the predetermined event are as described above.

When a predetermined event is detected at the monitoring location, the monitoring control device 10 selects (S57) from among the multiple monitoring cameras 9 a monitoring camera 9 other than the monitoring camera 9 that captured the image acquired in (S54) and that is capable of capturing an image of the monitoring location identified in (S55). The method of selecting the monitoring camera 9 is also as described above.

The monitoring control device 10 controls the monitoring camera 9 selected in (S57) so as to capture an image of the monitoring position identified in (S55) (S58). For example, the monitoring control device 10 changes the imaging direction of the monitoring camera 9 selected in (S57) so as to be able to capture an image of the monitoring position. The method of controlling the monitoring camera 9 is also as described above.

Figure 6 is a diagram conceptually illustrating an example of control of the surveillance camera 9. In the example of Figure 6, the surveillance control device 10 accepts an input of the setting of the position of the surveillance area AM (S51). This input may be made by a user's range specification operation on the image captured by the surveillance camera 9 (#2). The surveillance control device 10 calculates the common coordinates of the surveillance area AM. Then, the surveillance control device 10 calculates the camera parameters for capturing the position of the surveillance area AM in the surveillance cameras 9 (#1) and (#2) that can capture the position of the surveillance area AM (S52). If the camera parameters of the surveillance camera 9 (#2) are fixed, the surveillance control device 10 may hold the camera parameters in advance. The surveillance control device 10 associates the ID of the position of the surveillance area AM, the common coordinates of the surveillance area, the camera parameters of the surveillance camera 9 (#1), and the camera parameters of the surveillance camera 9 (#2) and stores them in the correspondence storage unit 15 (S53).

In (S54), the monitoring control device 10 acquires the data of the image captured by the monitoring camera 9 (#2) and the camera parameters at the time of capturing the image. If the camera parameters of the monitoring camera 9 (#2) are fixed, the monitoring control device 10 may hold the camera parameters in advance. The monitoring control device 10 identifies the position of the monitoring area AM in the image (S55) and detects the intrusion of a human OB1 into the position of the monitoring area AM as a predetermined event (S56). At this time, the monitoring camera 9 (#1) captures images in the imaging direction D1 and is unable to capture the position of the monitoring area AM. When the predetermined event is detected, the monitoring control device 10 selects a monitoring camera 9 (#1) other than the monitoring camera 9 (#2) as a monitoring camera capable of capturing the position of the monitoring area AM (S57). Then, the monitoring control device 10 controls the selected monitoring camera 9 (#1) to capture the position of the monitoring area AM (S58). That is, the monitoring control device 10 controls the imaging direction of the monitoring camera 9 (#1) to change from D1 to D2. As a result, the position of the monitoring area AM is captured by both the monitoring cameras 9 (#1) and (#2), and images of the monitoring area AM captured from different directions can be obtained.

[Actions and Effects of the First Embodiment]
As described above, in the first embodiment, a predetermined event is detected at a monitoring position (e.g., the position of a video monitoring line or the position of a monitoring area) included in an image captured by a certain monitoring camera 9. In response to this detection, monitoring cameras 9 other than the monitoring camera 9 that captured the image in which the predetermined event was detected are controlled to capture the predetermined position. As a result, the monitoring position in which the predetermined event was detected is captured by two or more monitoring cameras 9. Therefore, according to the first embodiment, the state of the monitoring position (e.g., the position of the video monitoring line or the position of the monitoring area) when the predetermined event occurs, and the state of the predetermined event that occurred can be monitored in detail from multiple directions.

Furthermore, in the first embodiment, the surveillance camera 9 is controlled in response to the detection of a specific event, such as an object passing through the video surveillance line, a specific situation in the surveillance area of the object, or the movement of an object along a specific route defined by a line segment. Therefore, compared to a method in which the surveillance camera is controlled each time a person is detected, surveillance operations can be performed efficiently even in situations where a large number of people are coming and going or a crowd is formed. Also, in the first embodiment, the occurrence of a specific situation in a specified number or more of objects is detected, and the surveillance camera 9 is controlled in response to this detection. In this way, the surveillance camera 9 is controlled only in response to the occurrence of an event that requires particular attention, such as an abnormal state, and the efficiency of surveillance operations can be further improved.

In addition, in the first embodiment, a movable surveillance camera 9 such as a PTZ camera is included, and the movable surveillance camera 9 is controlled to capture an image of a surveillance position where a specific event is detected. Therefore, by using the movable surveillance camera 9, a wide area can be comprehensively monitored with a small number of surveillance cameras, and a surveillance position such as the position of a video surveillance line or the position of a surveillance area can be monitored preferentially in conjunction with the detection of a specific event.

[Second embodiment]
In the above-described first embodiment, when a predetermined event is detected at a monitoring position in an image captured by a certain monitoring camera 9, the other monitoring cameras 9 are controlled to capture the monitoring position. In the second embodiment, when an event is detected in an image captured by a certain monitoring camera 9, the other monitoring cameras 9 are controlled to capture a position different from the position where the event was detected. Below, the video monitoring system 1 in the second embodiment will be described, focusing on the differences from the first embodiment. In the following description, the same contents as in the first embodiment will be omitted as appropriate.

[Processing configuration]
The processing configuration of the monitoring and control device 10 in the second embodiment is similar to that in the first embodiment (see FIG. 2). The processing contents are different from those in the first embodiment as follows.

The detection unit 13 detects a specific event at a specific position included in an image captured by a certain surveillance camera 9. The camera control unit 14 controls the other surveillance cameras 9 so that they capture other positions corresponding to the specific position where the detection unit 13 detected the specific event. Hereinafter, the specific position for detecting a specific event using an image of a certain surveillance camera 9 is referred to as a "detection target position", and the position monitored by one or more other controlled surveillance cameras 9 is referred to as a "monitoring target position". In other words, the detection unit 13 detects a specific event at a detection target position included in an image captured by a certain surveillance camera 9 and different from the monitoring target position. The "detection target position" is a position that is predetermined to detect a specific event and is a position that can be imaged by at least one surveillance camera 9. The "monitoring target position" is a position to be monitored that is associated with one or more "detection target positions" and is a position that can be imaged by at least one surveillance camera 9. The "detection target position" and the "monitoring target position" are set to any static point, line, plane, or space in the real world. The "detection target position" corresponds to, for example, the "position of the video monitoring line" or the "position of the monitoring area" in the first embodiment. The "monitoring target position" is any position on a line or area. The common coordinates of the detection target position and the monitoring target position are each acquired from a user input received by the input unit 17. In the second embodiment, the correspondence storage unit 15 stores the ID of the detection target position, the common coordinates of the detection target position, the ID of the monitoring target position corresponding to the detection target position, and the camera parameters for capturing the monitoring target position for each monitoring camera 9 that can capture the monitoring target position.

The predetermined event detected by the detection unit 13 is as described above. However, since the target position is monitored by the control of the surveillance camera 9, the occurrence of a predetermined event at the target position is a trigger (priming) that makes it necessary to monitor the target position. Therefore, for example, based on such a relationship, the target position for detection and the contents of the predetermined event to be detected are determined for the target position for detection. For example, the target position for detection is set to a position where a person heading to the target position is likely to pass. In this case, the detection unit 13 detects, as a predetermined event, a state in which a person moves toward the target position for detection (passing of the video surveillance line in a predetermined direction) or a state in which a person is staying at the target position for detection. As another example, the target position for monitoring is set to an area along the tracks on a platform of a certain station, and the target position for detection is set to a part of the tracks around the station. In this case, the detection unit 13 detects, as a predetermined event, a state in which a train moves toward the target position for monitoring (station) at the target position for detection. In addition, as for the subsequent control, for example, the surveillance camera 9 installed on the platform and monitoring the escalator is controlled to monitor the area along the tracks that is the target position for monitoring. The locations to be monitored, the locations to be detected, and the contents of the specified events to be detected are not limited to the examples given above.

The detection unit 13 can identify the detection target position in the image using a method similar to the monitoring position in the first embodiment. The detection unit 13 detects a specific event at the detection target position in the image by converting the common coordinates of the detection target position stored in the correspondence storage unit 15 into the camera coordinate system. Therefore, when the detection unit 13 detects a specific event, it can identify the ID of the detection target at which the specific event was detected based on the information stored in the correspondence storage unit 15. The ID of the detection target position at which the specific event was detected is used, for example, by the camera control unit 14 described below.

Figure 7 is a diagram showing the relationship between the imaging area of a surveillance camera, the surveillance target position, and the detection target position. In the example of Figure 7, the surveillance target position is set as a planar area on the floor surface (ground) in the real world, and the detection target position is set as a line segment on the floor surface (ground) in the real world. Surveillance cameras 9 (#1), 9 (#3), and 9 (#4) are capable of imaging the surveillance target positions, and surveillance camera 9 (#2) is capable of imaging the detection target position. In this case, detection unit 13 detects a predetermined event at the detection target position included in the image captured by surveillance camera 9 (#2).

The correspondence storage unit 15 stores the following correspondence information: The correspondence storage unit 15 stores multiple pieces of correspondence information between the identification information of the surveillance camera 9, the identification information of a detection target position that can be captured by the surveillance camera 9, the common coordinates of the detection target position, the identification information of a monitoring target position that corresponds to the detection target position, and the camera parameters for capturing an image of the monitoring target position by the surveillance camera 9.

Figure 8 is a diagram showing an example of the correspondence information stored in the correspondence storage unit 15. In the example of Figure 8, the correspondence information stored in the correspondence storage unit 15 indicates multiple correspondences between the camera ID of the surveillance camera 9, the ID of the detection target position, the common coordinates of the detection target position, the ID of the monitoring target position corresponding to the detection target position, and the camera parameters for capturing an image of the monitoring target position with the surveillance camera 9. The camera parameters indicate parameters for the surveillance camera 9 identified by the camera ID to capture an image of the monitoring target position identified by the monitoring target position ID, and indicate the attitude and zoom value of the surveillance camera 9, etc.

8, the surveillance camera 9 with the camera ID "001" can capture both the detection target position "001" and the corresponding monitoring target position "001". The surveillance camera 9 with the camera ID "002" can capture the monitoring target position "001". The surveillance camera 9 with the camera ID "003" can capture the monitoring target position "001" and the detection target position "002", but cannot capture the monitoring target position "002" corresponding to the detection target position "002" (this can be understood from the fact that the camera holds the camera parameter "03" for capturing the monitoring target position "001" and the common coordinates of the detection target position "002", but does not hold the camera parameter for capturing the monitoring target position "002"). The surveillance camera 9 with the camera ID "004" can capture the monitoring target position "002". Note that the information stored in the correspondence storage unit 15 is stored by accepting the settings of the detection target position and the monitoring target position by the user at the input unit, as described above. The camera parameters capable of capturing an image of the monitored position are calculated for each monitoring camera 9 by the calculation unit 18 based on the common coordinates of the monitored position input by the user.

After the detection unit 13 detects a specific event, the camera control unit 14 refers to the correspondence information stored in the correspondence storage unit 15 to identify a surveillance camera 9 capable of capturing an image of a specific monitoring target position corresponding to the specific detection target position where the specific event was detected.

For example, the camera control unit 14 acquires, from the detection unit 13, the identification information (ID) of the detection target position where the predetermined event was detected, as described above. The camera control unit 14 identifies the identification information (ID) of the monitoring target position corresponding to the acquired ID of the detection target position and the camera ID of the monitoring camera 9 capable of capturing the monitoring target position from the correspondence relationship information stored in the correspondence storage unit 15. The camera control unit 14 can acquire camera parameters capable of capturing the monitoring target position for each of the identified camera IDs of the monitoring cameras 9. Here, in the example of FIG. 8, it is assumed that a predetermined event was detected at the detection target position identified by the detection target position ID "001" of the monitoring camera 9 identified by the camera ID "001". In this case, the camera control unit 14 acquires the monitoring target position ID "001" corresponding to the detection target position ID "001", and further acquires the camera IDs "001", "002", and "003" of the monitoring cameras corresponding to the monitoring target position ID "001". Furthermore, the camera control unit 14 acquires camera parameters for each of the acquired camera IDs. The camera control unit 14 uses the acquired camera parameters to control the surveillance camera 9 identified by the acquired ID. For example, the camera control unit 14 uses camera parameter "01" to control the surveillance camera 9 with camera ID "001", uses camera parameter "02" to control the surveillance camera 9 with camera ID "002", and uses camera parameter "03" to control the surveillance camera 9 with camera ID "003". In this example, the surveillance camera 9 with camera ID "001" that captured the image in which the specified event was detected is also controlled to face in the direction of the monitored position.

[Example of operation]
The video monitoring method in the second embodiment will be described below with reference to Figs. 9 and 10. Fig. 9 is a flow chart showing an example of the operation of the monitoring control device 10 in the second embodiment. As shown in Fig. 9, the video monitoring method in the second embodiment is executed by at least one computer (CPU 2) such as the monitoring control device 10. Since each process is similar to the processing content of each of the above-mentioned processing modules possessed by the monitoring control device 10, details of each process will be omitted as appropriate.

The monitoring control device 10 accepts the user's input of the detection target position and monitoring target position settings (S91). For example, the monitoring control device 10 accepts the detection target position and monitoring target position settings in the camera coordinate system of a specified monitoring camera 9 or a common coordinate system. When the detection target position and monitoring target position are set in a camera coordinate system, the monitoring control device 10 converts the detection target position and monitoring target position into the common coordinate system based on the camera parameters of the camera that captured the image in which the camera coordinate system is set.

Then, the monitoring control device 10 calculates (S92) the camera parameters for capturing an image of the monitoring target position for each monitoring camera 9 capable of capturing an image of the monitoring target position from the common coordinates of the monitoring target position obtained from the input received in (S91). The method for calculating these camera parameters is as described in the first embodiment.

The monitoring control device 10 determines the IDs of the detection target position and monitoring target position for the detection target position and monitoring target position set by the input received in (S91), and stores the IDs of the detection target position and monitoring target position, the common coordinates of the detection target position, and the camera parameters for each monitoring camera 9 calculated in (S92) in correspondence with each other in the correspondence storage unit 15 (S93). As a result, the correspondence storage unit 15 stores the correspondence relationship between the detection target position and the monitoring target position input by the user, the common coordinates of the detection target position, and the camera parameters for capturing an image of the monitoring target position corresponding to the detection target position with a monitoring camera 9 that can capture the image, in correspondence with each other.

The monitoring control device 10 acquires data of images captured by each monitoring camera 9 from each monitoring camera 9 (S94). The monitoring control device 10 associates the acquired image data with the identification information of the monitoring camera 9 that captured the image, and stores the image data in the image storage unit 12. At this time, the monitoring control device 10 further acquires the camera parameters of the monitoring camera 9 that captured the image, and further associates the camera parameters with the image data and the identification information of the monitoring camera 9, and stores the image data in the image storage unit 12.

The monitoring control device 10 identifies (S95) the detection target position set in (S91) in the image acquired in (S94) or the image extracted from the image storage unit 12. In this identification, the camera parameters acquired in (S94) and the common coordinates of the detection target position stored in the corresponding storage unit 15 are used. The method of identifying the detection target position from the image is the same as the method of identifying the monitoring position in the first embodiment. Note that the process of S95 is executed each time the PTZ of the monitoring camera is controlled (each time the imaging range changes).

The monitoring control device 10 detects (S96) a predetermined event at the detection target position identified in (S95). For example, the monitoring control device 10 detects one or more of the following as the predetermined event: the passing of an object through a video monitoring line, a predetermined state of an object in a monitoring area, and the movement of an object along a specific route defined by a line segment. The monitoring control device 10 may also detect an abnormal state as the predetermined event. The content of the predetermined event and the detection method of the predetermined event are as described in the first embodiment.

When a predetermined event is detected at the detection target position, the monitoring control device 10 selects (S97) from among the multiple monitoring cameras 9, a monitoring camera 9 that can capture an image of the monitoring target position corresponding to the detection target position identified in (S95). The method of selecting the monitoring camera 9 is also as described above.

The monitoring control device 10 controls the monitoring camera 9 selected in (S97) (S98) so as to capture an image of the monitoring target position corresponding to the detection target position identified in (S95). For example, the monitoring control device 10 changes the imaging direction of the monitoring camera 9 selected in (S97) so as to be able to capture an image of the monitoring target position. The method of controlling the monitoring camera 9 is also as described above.

Figure 10 is a diagram conceptually illustrating an example of control of a surveillance camera 9. The surveillance control device 10 accepts input of the detection target position (video surveillance line) and the settings of the surveillance target position (S91). This input may be performed by the user's line segment specification operation and range specification operation for each image captured by each surveillance camera 9. The surveillance control device 10 calculates common coordinates of the detection target position and the surveillance target position. Then, the surveillance control device 10 calculates camera parameters for imaging the surveillance target position for each of the surveillance cameras 9 (#1), 9 (#3), and 9 (#4) that can image the surveillance target position (S92). If the camera parameters of any one of the surveillance cameras 9 are fixed, the surveillance control device 10 may hold the camera parameters in advance.

The monitoring control device 10 stores the following correspondence information in the correspondence storage unit 15 (S93). For the monitoring camera 9 (#2), the monitoring control device 10 stores correspondence information between the camera ID, the ID of the detection target position (video monitoring line), and the ID of the monitoring target position corresponding to the detection target position. For the monitoring camera 9 (#1), the monitoring control device 10 stores correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position. For the monitoring camera 9 (#3), the monitoring control device 10 stores correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position. For the monitoring camera 9 (#4), the monitoring control device 10 stores correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position.

In (S94), the monitoring control device 10 acquires the image data captured by the monitoring camera 9 (#2) and the camera parameters at the time of capturing the image. If the camera parameters of the monitoring camera 9 (#2) are fixed, the monitoring control device 10 may store the camera parameters in advance. The monitoring control device 10 identifies the detection target position (video monitoring line) in the image (S95), and detects the passing of a person across the video monitoring line as a specified event (S96). At this time, it is assumed that the monitoring cameras 9 (#1), 9 (#3), and 9 (#4) are not able to capture the monitoring target position, as shown in FIG. 7.

When a specific event is detected, the monitoring control device 10 selects monitoring cameras 9 (#1), 9 (#3), and 9 (#4) as monitoring cameras capable of capturing an image of the monitoring target position corresponding to the detected target position based on the correspondence information stored in the correspondence storage unit 15 (S97). The monitoring control device 10 then controls the selected monitoring cameras 9 (#1), 9 (#3), and 9 (#4) using the camera parameters included in the correspondence information so as to capture an image of the monitoring target position (S98). As a result, the monitoring target position is captured by the monitoring cameras 9 (#1), 9 (#3), and 9 (#4), as shown in FIG. 10.

[Actions and Effects of the Second Embodiment]
As described above, in the second embodiment, a detection target position and a monitoring target position indicating different positions are obtained by user input, a specified event is detected at the detection target position in an image captured by a certain surveillance camera 9, and another surveillance camera 9 is controlled to capture an image of the monitoring target position corresponding to the detection target position where the specified event was detected.

According to the second embodiment, for example, a sign that something is about to happen at the monitored location can be captured by detecting a specified event at the detection target location, and the monitored location can be placed under surveillance at the stage of the sign. For example, a video monitoring line is set up on the passageway leading to an escalator, and an event is set to be detected when the number of people passing through per unit time exceeds a specified number, indicating that an abnormal condition has occurred. By detecting such an event, the monitoring control device 10 in the second embodiment captures the sign of an accident, issues an alert, and controls multiple monitoring cameras 9 installed around the escalator to focus on monitoring the escalator entrance and exit. In this way, by controlling the monitoring cameras 9 in advance before something happens at the monitored location, it is possible to reliably monitor the situation occurring at the monitored location without missing anything.

[Modification]
In the first embodiment described above, the camera parameters for capturing an image of a monitoring position for each monitoring camera 9 capable of capturing an image of the monitoring position are automatically calculated (calculation unit 18) from the common coordinates of the monitoring positions output by the input unit 17. Then, the identification information (ID), coordinate information of the common coordinate system, and camera parameters are stored for each monitoring position in the correspondence storage unit 15. However, in the first embodiment described above, the common coordinates of the monitoring positions do not need to be used.

For example, the input unit 17 accepts an input of a setting of one monitoring position that can be captured by two movable monitoring cameras 9. In this case, the user performs an operation to specify the monitoring position for each image captured by each of the two monitoring cameras 9. The input unit 17 acquires the camera coordinate information (in-image coordinates) of the monitoring position specified by the user input for the image of one of the monitoring cameras 9 and the camera parameters at the time of capturing the image. Furthermore, the input unit 17 acquires the camera coordinate information (in-image coordinates) of the monitoring position specified by the user input for the image of the other monitoring camera 9 and the camera parameters at the time of capturing the image. The corresponding storage unit 15 stores the ID of the monitoring position, the camera IDs of the two monitoring cameras 9, the camera parameters for each monitoring camera 9 for capturing the monitoring position, and the camera coordinate information of the monitoring position. The detection unit 13 can use this stored information to detect a predetermined event at the monitoring position for the image of each monitoring camera 9. In this case, changes to the camera parameters of each movable surveillance camera 9 are permitted within a range that includes the camera parameters stored in the corresponding storage unit 15. The camera control unit 14 can use this stored information to control each surveillance camera 9 to capture an image of the surveillance position where a specific event is detected.

The second embodiment can be modified in a similar manner. That is, in the second embodiment, common coordinates for the detection target position and the monitoring target position do not need to be used. In this case, the input unit 17 acquires the camera parameters of each monitoring camera 9 when capturing an image of the monitoring target position. The input unit 17 also acquires camera coordinate information (in-image coordinates) of the detection target position for each monitoring camera 9 that can capture the detection target position, and further acquires correspondence information between the detection target position and the monitoring target position. The correspondence storage unit 15 stores the correspondence relationship (ID pair) between the detection target position and the monitoring target position, the camera ID of the monitoring camera 9 that can capture the detection target position or the monitoring target position, and correspondence relationship information of the camera parameters for capturing the image of the monitoring target position.

In addition, when the user inputs the position setting of the monitoring area, the input unit 17 may acquire image features of the monitoring area instead of the coordinate information of the monitoring area. In this case, the detection unit 13 detects an area in the acquired image that is similar to the image features of the monitoring area, and identifies the detected area as the monitoring area. In this case, the image features of the monitoring area input by the user may be stored in the correspondence storage unit.

[Third embodiment]
A video monitoring system and a video monitoring method according to the third embodiment will be described below with reference to Figures 11, 12, and 13. The third embodiment may be a program for causing at least one computer to execute the video monitoring method, or a recording medium having such a program recorded thereon and readable by the at least one computer.

FIG. 11 is a diagram conceptually illustrating an example of the processing configuration of a video monitoring system 100 in the third embodiment. As shown in FIG. 11, the video monitoring system 100 has a detection unit 101 and a control unit 102. The video monitoring system 100 shown in FIG. 11 can be realized as the above-mentioned monitoring control device 10 shown in FIG. 1. In this case, the video monitoring system 100 has a hardware configuration similar to that of the monitoring control device 10 shown in FIG. 1.

Figure 12 is a diagram conceptually illustrating an example of the hardware configuration of the video surveillance system 100 in the third embodiment. As shown in Figure 12, the video surveillance system 100 may be realized as a surveillance camera 9 (#n). In this case, the video surveillance system 100 (surveillance camera 9 (#n)) has a CPU 2, memory 3, input/output interface (I/F) 4, communication unit 5, etc., and the surveillance camera 9 (#n) controls itself and other surveillance cameras 9. In this case, the surveillance camera 9 (#n) is a so-called intelligent camera. The hardware configuration of the video surveillance system 100 in the third embodiment is not limited to the examples of Figures 1 and 12, and the video surveillance system 100 may be realized by both the surveillance control device 10 and the surveillance camera 9 (#n).

The detection unit 101 and the control unit 102 are realized, for example, by the CPU 2 executing a program stored in the memory 3. The program may also be installed from a portable recording medium such as a CD or memory card, or from another computer on the network, via the input/output I/F 4 or the communication unit 5, and stored in the memory 3. When the video surveillance system 100 is realized by both the surveillance control device 10 and the surveillance camera 9 (#n), the detection unit 101 may be realized by the surveillance control device 10, and the control unit 102 may be realized by the surveillance camera 9 (#2).

The detection unit 101 detects a predetermined event based on an image captured by a first imaging device (e.g., surveillance camera 9 (#2)). The detection unit 101 corresponds to the above-mentioned detection unit 13. The content of the predetermined event and the method of detecting the predetermined event are as described above and are not limited. In addition, the first imaging device may be a fixed surveillance camera 9 or a movable surveillance camera 9.

After the detection unit 101 detects a predetermined event, the control unit 102 controls the second imaging device (e.g., surveillance camera 9 (#1)) so that the second imaging device captures an image of a predetermined position. The "predetermined position" is a predetermined surveillance position, and is set to any static point, line, plane, or space in the real world. The control unit 102 corresponds to the camera control unit 14 described above. The method of controlling the second imaging device is as described above and is not limited.

As shown in FIG. 11, the video surveillance system 100 in the third embodiment does not need to have the acquisition unit 11, image storage unit 12, corresponding storage unit 15, and output processing unit 16 shown in FIG. 2. Each of these processing modules that the video surveillance system 100 does not have is provided by another computer, and the video surveillance system 100 can cooperate with those processing modules by communicating with the other computer.

Figure 13 is a flowchart showing an example of the operation of the video monitoring system 100 in the third embodiment. As shown in Figure 13, the video monitoring method in the third embodiment is executed by at least one computer such as the video monitoring system 100. For example, each of the illustrated steps is executed by each processing module of the video monitoring system 100.

The video surveillance method in this embodiment includes detecting a predetermined event based on an image captured by a first imaging device (e.g., surveillance camera 9 (#2)) (S131), and after detecting the predetermined event (S132; YES), controlling a second imaging device (e.g., surveillance camera 9 (#1)) so that the second imaging device captures an image of a predetermined position (S133).

The third embodiment can provide the same effects as the first and second embodiments described above.

[Example]
Hereinafter, application examples of the video monitoring systems 1 and 100 (hereinafter collectively referred to as reference numeral 1) in the above-described embodiments will be described. However, application of the above-described embodiments is not limited to the following examples.

Figure 14 is a conceptual diagram of a stadium to which the video surveillance system 1 is applied. For example, the above-mentioned video surveillance system 1 is applied to a stadium where many people gather, as shown in Figure 14. In this case, multiple surveillance cameras 9 are installed in positions where they can capture images of spectator seats, aisles, entrances, etc., and multiple areas where many people may be present are set as surveillance areas. The surveillance control device 10 (detection unit 13) detects, as a specified event, a simultaneous change in state of multiple people (crowd) in the surveillance area. In this embodiment, the specified event is treated as an abnormal state. For example, the surveillance control device 10 detects, as a specified event (abnormal state), a crowd captured in an image from the surveillance camera 9 capturing images of the spectator seats all starting to run outward from a certain point.

Figure 15 is a diagram showing a specific example of a specified event. In the example of Figure 15, a person D1 is shown brandishing a weapon. In this case, the monitoring control device 10 detects, as a specified event, that multiple people in the image start running away from the center of person D1.

The monitoring control device 10 (camera control unit 14) is installed near the monitoring area where the specified event (abnormal state) was detected, and simultaneously controls all monitoring cameras 9 capable of capturing images of that monitoring area to capture the image of that monitoring area. This allows the cause of the abnormal state, for example, a person who suddenly brandishes a weapon (see FIG. 15), to be captured from multiple angles, making it easy to identify the culprit in a post-mortem investigation.

As another example, multiple areas where a large number of people may be present are each set as a detection target area, and multiple monitoring target areas corresponding to these detection target areas are set. For example, the area around the seating area is set as a detection target area, and multiple entrances and exits are each set as monitoring target areas. The monitoring control device 10 (detection unit 13) detects a simultaneous change in state of multiple people (crowd) in the detection target area as a specified event (abnormal state). As in the example of Figure 15, the monitoring control device 10 detects a simultaneous start of a crowd of people in an image captured by the monitoring camera 9 capturing an image of the seating area running outward from a certain point as a specified event (abnormal state).

The monitoring control device 10 (camera control unit 14) selects multiple monitoring cameras 9 capable of capturing images of the monitoring target area (entrance/exit) corresponding to the detection target area in which the specified event (abnormal state) was detected. The monitoring control device 10 simultaneously controls all of the selected multiple monitoring cameras 9 to capture images of the monitoring target area (entrance/exit). As a result, even if a suspicious person escapes from the point where he or she brandished a weapon (detection target area), the multiple entrances will already be under surveillance by that time, so the suspicious person's figure can be confirmed with certainty.

In the multiple flow charts used in the above explanation, multiple steps (processing) are described in order, but the order of execution of the steps in each embodiment is not limited to the order described. In each embodiment, the order of the illustrated steps can be changed to the extent that does not cause any problems in terms of content. In addition, each of the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

Some or all of the above contents may also be specified as follows. However, the above contents are not limited to the following descriptions.

1. A detection means for detecting a predetermined event based on an image captured by a first imaging device;
a control means for controlling the second imaging device so that the second imaging device captures an image of a predetermined position after the predetermined event is detected;
A video surveillance system comprising:
2. After detecting the predetermined event, the control means selects a movable imaging device capable of imaging the predetermined position from among a plurality of movable imaging devices capable of changing the imaging direction, controls the selected movable imaging device, and excludes the non-selected movable imaging devices from the control targets at the time of detecting the predetermined event.
1. The video surveillance system according to claim 1.
3. The detection means detects the predetermined event at the predetermined position included in the image captured by the first imaging device.
1. The video surveillance system according to 1 or 2.
4. The detection means detects the predetermined event at another predetermined position, which is included in the image captured by the first imaging device and is different from the predetermined position.
1. The video surveillance system according to 1 or 2.
5. A correspondence storage unit that stores a plurality of pieces of correspondence relationship information between a predetermined detection target position where the predetermined event is detected and a predetermined monitoring target position corresponding to the predetermined detection target position among a plurality of predetermined monitoring target positions;
Further comprising:
the control means, after detecting the predetermined event, refers to the correspondence information to identify the second imaging device capable of imaging the predetermined monitoring target position corresponding to the predetermined detection target position where the predetermined event was detected;
4. The video surveillance system according to Item 1.
6. The detection means detects, as the predetermined event, the passage of an object through a video monitoring line or a predetermined situation in a monitoring area of the object.
5. The video surveillance system according to any one of 1 to 5.
7. The detection means detects, as the predetermined event, the passage of the object through the video monitoring line or the occurrence of a predetermined situation in the monitoring area of the object for a plurality of objects during a predetermined time interval.
6. The video surveillance system according to claim 1.

8. A video surveillance method implemented by at least one computer, comprising:
Detecting a predetermined event based on an image captured by the first imaging device;
controlling a second imaging device so that the second imaging device captures an image of a predetermined position after the predetermined event is detected;
A video surveillance method comprising:
9. Select a movable imaging device capable of imaging the predetermined position from among a plurality of movable imaging devices capable of changing the imaging direction;
excluding the non-selected movable imaging devices from being controlled when the predetermined event is detected;
Further including:
the control of the second imaging device includes controlling the selected movable imaging device as the second imaging device;
8. The video monitoring method according to item 1.
10. The detection of the predetermined event includes detecting the predetermined event at the predetermined position included in the image captured by the first imaging device.
8. The video monitoring method according to claim 9.
11. The detection of the predetermined event includes detecting the predetermined event at another predetermined position that is different from the predetermined position and is included in the image captured by the first imaging device.
8. The video monitoring method according to claim 9.
12. Refer to a correspondence storage unit that stores a plurality of pieces of correspondence relationship information between a predetermined detection target position where the predetermined event is detected and a predetermined monitoring target position corresponding to the predetermined detection target position among a plurality of predetermined monitoring target positions;
identifying the second imaging device capable of imaging the predetermined monitoring target position corresponding to the predetermined detection target position where the predetermined event is detected;
12. The video surveillance method according to claim 11, further comprising:
13. The detection of the predetermined event includes detecting, as the predetermined event, the passage of an object through a video monitoring line or a predetermined situation in a monitoring area of the object.
8. The video monitoring method according to any one of 8. to 12.
14. The detection of the predetermined event includes detecting, as the predetermined event, the passage of the object through a video monitoring line or the occurrence of a predetermined situation in a monitoring area of the object for a plurality of objects during a predetermined time interval.
13. The video monitoring method according to claim 1.

15. A program for causing at least one computer to execute the video monitoring method described in any one of 8. to 14.

Claims (9)

a storage process for storing a plurality of monitoring positions and camera parameters for capturing images of the plurality of monitoring positions in association with each other;
A setting process for setting a predetermined area within an imaging area of a first camera based on an input to an image captured by the first camera;
a detection process for detecting that a person within an imaging area of the first camera has entered the predetermined area;
a control process of controlling an imaging direction of the second camera so that the second camera images the predetermined area based on the camera parameters when an intrusion of the person into the predetermined area is detected;
on the computer,
The predetermined area is a part of the imaging area.
program. a display control process for simultaneously displaying an image captured by the first camera and an image captured by the second camera on a display screen;
The program according to claim 1, further comprising: The program according to claim 1 , wherein the camera parameters include attitude information of the second camera for capturing an image of the monitoring position. 1. A method for video surveillance implemented by at least one computer, comprising:
storing a plurality of monitoring positions and camera parameters for capturing images of the plurality of monitoring positions in association with each other;
Based on an input to an image captured by a first camera, a predetermined area is set within an image capturing area of the first camera;
Detecting that a person within an imaging area of the first camera has entered the predetermined area;
when an intrusion of the person into the predetermined area is detected, an imaging direction of the second camera is controlled based on the camera parameters so that the second camera images the predetermined area.
Including,
The predetermined area is a part of the imaging area.
Video surveillance methods. The at least one computer:
displaying the image captured by the first camera and the image captured by the second camera simultaneously on a display screen;
The video surveillance method according to claim 4 , further comprising: 6. The video monitoring method according to claim 4 , wherein the camera parameters include attitude information of the second camera for capturing an image of the monitoring position. a storage means for storing a plurality of monitoring positions and camera parameters for capturing images of the plurality of monitoring positions in association with each other;
a setting means for setting a predetermined area within an imaging area of the first camera based on an input to an image captured by the first camera;
a detection means for detecting that a person within an imaging area of the first camera has entered the predetermined area;
a control means for controlling an imaging direction of the second camera so that the second camera images the predetermined area based on the camera parameters when the intrusion of the person into the predetermined area is detected;
Equipped with
The predetermined area is a part of the imaging area.
Video surveillance system. The display control means further includes a display control unit for simultaneously displaying an image captured by the first camera and an image captured by the second camera on a display screen.
The video surveillance system according to claim 7 . 9. The video surveillance system according to claim 7 , wherein the camera parameters include attitude information of the second camera for capturing an image of the surveillance position.