JP6689566B2 - Security system and security method - Google Patents

Description

  The present invention relates to a security system and a security method that realizes security in cooperation with security personnel.

  Conventionally, there is known a technique of detecting a suspicious individual based on image information of a predetermined monitoring area acquired by an image capturing device. For example, in Patent Document 1, an image of an attendee is imaged by an imaging device fixedly installed in an apartment, etc., and a face image of the attendee extracted from the imaged image and the behavior of the attendee analyzed from the imaged image are described. Based on the above, there is disclosed a technique of determining whether or not the visitor is a suspicious person. Specifically, the extracted face image of the visitor is compared with the face image of the resident such as an apartment house, and among those who are determined not to be residents, those whose behavior is determined to be suspicious are identified. A technique of determining a suspicious person is disclosed.

JP, 2006-120084, A

  However, with the technique of Patent Document 1, the imaging device needs to be fixedly installed, and a suspicious individual cannot be detected in an area where the imaging device is not installed. In addition, even if an imaging device is installed, if a place with a large number of people who are targets for suspicious person detection is to be monitored, such as a theme park, a huge number of face images will be displayed. Since collation processing is performed, a large-scale system corresponding to the processing amount is required. On the other hand, it is possible to reduce the system scale by reducing the number of image pickup devices installed, but by reducing the number of image pickup devices installed, blind spots increase and suspicious persons cannot be properly detected. Become.

  As described above, the conventional technique has a problem that the efficiency of security is significantly reduced when the number of image pickup devices installed is insufficient. Such a problem is not limited to security using an imaging device, but commonly occurs when a sensor is installed to protect a target area.

  From these things, how to realize a system that can effectively guard even if the number of information acquisition devices such as imaging devices and sensors is insufficient is an important issue. There is.

  The present invention is for solving the above-mentioned problems of the related art, and a security system and a security method that realizes efficient security in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient. The purpose is to provide.

In order to solve the above-mentioned problems and to achieve the object, the invention according to claim 1 is an information acquisition unit that is carried or worn by a security guard and acquires information around the security guard, and a state of the security guard. Security state determination means for determining, the detection means for detecting an object existing around the security person as an evaluation target based on the information acquired by the information acquisition means, and determined by the security status determination means. The state of the security guard, and using the information acquired by the information acquisition unit related to the object detected as the evaluation target by the detection unit, and a security target evaluation unit that performs evaluation as a security target of the object, the information acquisition means acquires the image information of the direction in which at least the face guards opposite, the guards state determining means uses the image information acquired by the information acquiring means When the guard determines a state where the guard is paying special attention to the object included in the image of the image information, the detection means is that the guard directs special attention by the guard state determination means. The determined object is detected as the evaluation target, and the security target evaluation means is in a state where the security officer is paying special attention to the object included in the image of the image information by the security status determination means. If it is determined that the object is evaluated as a warning target using the image information acquired by the information acquisition unit for the object .

Further, the invention according to claim 2, in the invention described in claim 1, before Symbol security target evaluation means, especially a person the guards by the security guard state determining means included in the image of the image information When it is determined that the user is paying attention, the similarity between the image information of the person acquired by the information acquisition unit and the image information of the person who needs caution is evaluated, and the similarity is evaluated. Is high, the person is evaluated as a person requiring caution.

Further, in the invention according to claim 3 , in the invention according to claim 1 or 2 , when the security target evaluation means evaluates that the object of the evaluation target needs to be alerted, the security officer evaluates the result. Is further provided with an evaluation result notifying means.

Further, the invention according to claim 4 is an information acquisition unit that is carried or worn by a guard and acquires information about the periphery of the guard, a guard state determination unit that determines the state of the guard, and Detecting means for detecting an object existing around the security officer as an evaluation target based on the information acquired by the information acquiring means, the state of the security officer determined by the security officer state determining means, and the detecting means Using the information acquired by the information acquisition unit related to the object detected as an evaluation target, and a security target evaluation unit that performs evaluation as a security target of the object, and the information acquisition unit, at least the security guard acquires image information of the surrounding, if the address with respect to the object of the evaluation were rated as required by the security target evaluation means, notifies the information relating to the procedure of the address to said guard Characterized in that that procedure further comprising a notification means.

Further, in the invention described in claim 5 , in the invention described in any one of claims 1 to 4 , the information acquired by the information acquisition means is not only image information but also voice information, position information, and the guard. It is characterized by including one or more information of information related to the operation of the member, information related to the living body of the guard, and information related to the environment.

Further, the invention according to claim 6 is a security method in a security system having an information acquisition device which is carried or worn by a security guard and acquires information about the periphery of the security guard, and a server device, A server device detects the state of the security guard, and a server state determination step, and the server device detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition device. The detection step, the server device uses the state of the security guard determined by the security guard state determination step, and the information acquired by the information acquisition device for the object detected as the evaluation target by the detection step. , and a security target evaluation step of evaluating as vigilance object of the object, the information acquiring apparatus, the direction facing face of at least the guards It acquires image information, the guards condition determining step, using the image information acquired by the information acquiring apparatus, which is directed toward a special attention to an object the guards included in the image of the image information The state is determined, the detection step detects the object determined by the security guard state determination step as being the special attention of the security guard as the evaluation target, and the security target evaluation step is the security guard. When it is determined by the member state determination step that the security guard is in a state of paying special attention to the object included in the image of the image information, the image information acquired by the information acquisition device related to the object is displayed. It is characterized in that the object is evaluated as a warning target.
Further, the invention according to claim 7 is a security method in a security system having an information acquisition device which is carried or worn by a security guard and acquires information about the periphery of the security guard, and a server device. A server device detects the state of the security guard, and a server state determination step, and the server device detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition device. The detection step, the server device uses the state of the guard determined by the guard state determination step, and the information acquired by the information acquisition device for the object detected as the evaluation target by the detection step. , and a security target evaluation step of evaluating as vigilance object of the object, the information acquiring apparatus, the image information of the periphery of at least the guards And further comprising a procedure notifying step of notifying the guard with information regarding the procedure of the countermeasure when the countermeasure against the object to be evaluated is evaluated to be necessary by the security target evaluating step. .

  According to the present invention, the information about the periphery of the guard is obtained by the device carried or worn by the guard, the state of the guard is determined, and the surroundings of the guard are determined based on the obtained information around the guard. Detecting an existing object as an evaluation target, the state of the security guard determined, and using the information around the security guard acquired by the device carried or worn by the security guard on the object detected as the evaluation target, Since the object detected as the evaluation target is configured to be evaluated as a warning target, it is possible to realize efficient security in a situation where the number of information acquisition devices such as an imaging device and a sensor is insufficient.

FIG. 1 is a diagram for explaining an outline of processing relating to detection of a suspicious person in security implemented by a security system that cooperates with a security officer according to the present embodiment. FIG. 2 is a system configuration diagram of the security system according to the present embodiment. FIG. 3 is a block diagram showing a functional internal configuration of the mobile terminal device shown in FIG. 2 according to the present embodiment. FIG. 4 is an explanatory diagram for explaining a data configuration according to the present embodiment of the mobile terminal device shown in FIG. FIG. 5 is a block diagram showing a functional internal configuration of the control center server shown in FIG. 2 according to this embodiment. FIG. 6 is an explanatory diagram (No. 1) for explaining the data configuration of the control center server shown in FIG. 5 according to the present embodiment. FIG. 7 is an explanatory diagram (No. 2) for explaining the data configuration of the control center server shown in FIG. 5 according to the present embodiment. FIG. 8 is a flowchart showing a processing procedure when the control center server receives information from the mobile terminal device. FIG. 9 is a flowchart showing a processing procedure of an incident detection process of blacklist search in the reception data analysis process shown in FIG. FIG. 10 is a flowchart showing the processing procedure of the blacklist search processing in the output data generation processing shown in FIG. FIG. 11 is a flowchart showing a processing procedure of guide processing of the procedure for the guard when the procedure information in the mobile terminal device shown in FIG. 2 is received.

  Hereinafter, preferred embodiments of a security system and a security method according to the present invention will be described in detail with reference to the accompanying drawings.

  First, an outline of processing relating to detection of a suspicious person in security implemented by a security system that cooperates with the security personnel according to the present embodiment will be described with reference to FIG. FIG. 1 shows a person identified by the security system when the security system automatically detects that the security personnel has identified a person who is suspected to be a suspicious individual in security in an area where an unspecified number of people come and go. FIG. 4 is a diagram for explaining a series of processing outlines in which a search is performed to determine whether or not the person matches a person listed in a blacklist or the like, and the search result and a procedure of a countermeasure to be taken by a security guard are notified.

  As shown in FIG. 1, a guard wears a wearable camera 10, a motion sensor 21, a biometric information sensor 22, and an environment information sensor 23. The wearable camera 10 can not only acquire an image and a sound of a direction in which the security guard is facing in a worn state, but also output a image to a part of the field of view of the security guard in a worn state. The earphone 14 that outputs a sound is included. The motion sensor 21 is a device that detects the movement of a guard who is wearing the motion sensor 21. The biometric information sensor 22 is a device that acquires biometric information such as body temperature, heart rate, and acceleration of a guard who is wearing the biometric sensor. The environment information sensor 23 is a device that acquires environment information such as temperature, humidity, altitude, and position.

  Moreover, the guard carries the mobile terminal device 40 separately from the device for acquiring various information. Devices such as the wearable camera 10, the motion sensor 21, the biometric information sensor 22, and the environment information sensor 23 transmit various information acquired to the mobile terminal device 40 by short-range wireless communication such as Bluetooth (registered trademark). If the portable terminal device 40 receives information acquired by these devices from devices such as the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23, the received image data, audio data, and other information. The various sensor data of the above are transmitted to the control center server 50 installed in the control center.

  When the control center server 50 receives the information acquired by the various information acquisition devices worn by the security staff via the mobile terminal device 40, the control center server 50 analyzes the received information based on the analysis result and a predetermined determination criterion. Determine whether a member is paying attention to a particular person. In the determination, for example, a person who appears in the image acquired by the wearable camera 10 is identified based on the color of the clothes, the height of the person, and the like, and the image of the person is displayed in the image within a predetermined time for each person who appears in the image. The appearance rate of appearance is calculated, and if there is a person whose appearance rate is equal to or higher than a predetermined rate, it is determined that the guard gives special attention to the person. In addition, when a security person detects a person suspected to be a suspicious person, a biological reaction such as heart rate or sweating often appears as compared with the case where the person is not suspected. The acquired information may be used to determine that the security guard has detected any abnormality. In addition, assuming the behavior of the security guard such that the security guard tracks a person suspected to be a suspicious person, the position information acquired by the environmental information sensor 23 indicating that the security guard has deviated from the normal patrol route is displayed. It may be detected by using it, and may be used to determine that the guard has detected any abnormality that the vehicle deviates from the normal patrol route.

  In this way, when it is detected that the security officer is paying attention to a specific person, the control center server 50 determines from the image of the person who is paying attention from the image information acquired by the wearable camera 10 that person. Of the face image of the suspicious individual is extracted, and the blacklist DB 54m including information such as feature data of the face of the suspicious person is searched using the extracted face image. When there is a corresponding person in the search processing of the blacklist DB 54m, the control center server 50 transmits information on the corresponding person in the blacklist DB 54m to the mobile terminal device 40 as suspicious person information. In addition, the control center server 50 also selects, from the procedure DB 54n, information on procedures to be taken by the guards from the procedure DB 54n and transmits the information to the mobile terminal device 40.

  When the mobile terminal device 40 receives the suspicious person information from the control center server 50, the portable terminal device 40 outputs the received suspicious person information to the display 12 or the earphone 14 of the wearable camera 10 to notify the guard of the processing result of the control center server 50. To do. In addition, the mobile terminal device 40 can guide the guard to follow the procedure by outputting the procedure information received from the control center server 50 in order as voice from the earphone 14 of the wearable camera 10.

  Although the outline of the process relating to the detection of a suspicious individual has been described with reference to FIG. 1, the present invention is not limited to the suspicious person, but may be an abnormality detection for an object or a place. For example, in the case of abnormality detection for an object or a place, it is detected that the security officer is paying attention to the specific object or place from the frequency of appearance of the same object or place in the image acquired by the wearable camera 10, and it is normal. By determining the difference from normal times by comparing with the image of the same place at the time, it is possible to judge whether or not there is an abnormality different from normal times in the object or place where the guard is paying attention. It is possible to do.

  As described above, based on the information acquired by various information acquisition devices such as the wearable camera 10, the motion sensor 21, the biometric information sensor 22, and the environment information sensor 23 worn by the security guard, the security officer can compare the normal time with the person or the object. Detects that different special attention is directed, the security officer determines whether the person or thing to which the special attention is directed is a target to be watched, and the judgment result and the judgment result Since the corresponding countermeasure procedure is notified to the security guard, it is possible to realize efficient security in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

  Next, the system configuration of the security system according to this embodiment will be described. FIG. 2 is a system configuration diagram of the security system according to the present embodiment. As shown in FIG. 2, the devices related to the security system include a device equipped by a security guard, a device installed in a control center that controls the security guard, and a device fixedly installed in the security target area. And are connected via the communication network 91.

  The device equipped by the guard includes a wearable camera 10 worn on the body, a motion sensor 21, and a biological information sensor 22, a wireless communication device 30, a portable terminal device 40, and an environment information sensor 23 that are carried. The wearable camera 10 is mounted on the head as shown in FIG. 2, and a camera 11 for acquiring image data in the direction in which the face is facing, a microphone 13 for acquiring voice data, and a wearer's camera 10 in a mounted state. A display 12 that outputs an image in a part of the visual field and an earphone 14 (not shown) that outputs sound are included. As shown in FIG. 2, the motion sensor 21 has a plurality of sensors for detecting movements at positions corresponding to the respective parts of the security guard's body, and by detecting the movements of the respective parts of the security guard, information on the movements of the security guard is obtained. Is a device for acquiring. The biometric information sensor 22 is a device that is worn in contact with the body of the security guard, and is a device that acquires biometric information such as the body temperature, heart rate, and acceleration of the security guard. The environment information sensor 23 is a device that, when carried by a security guard, periodically acquires position information of the security guard such as temperature, humidity, altitude, and GPS.

  The mobile terminal device 40 is connected to the wearable camera 10, the motion sensor 21, the biometric information sensor 22, and the environment information sensor 23 by short-range wireless communication such as Bluetooth, and the wearable camera 10, the motion sensor 21, the biometric information sensor 22, and the environment information. The information acquired by the sensor 23 is transmitted to the control center server 50 of the control center. Further, the mobile terminal device 40 generates a process (hereinafter, referred to as “incident”) that should be performed as support for security based on the information acquired from the wearable camera 10, the motion sensor 21, the biometric information sensor 22, and the environment information sensor 23. When the occurrence of an incident is detected, the information related to the detected incident is transmitted to the control center server 50.

  In addition, when the mobile terminal device 40 receives output data such as image data and audio data from the control center server 50, the mobile terminal device 40 outputs the received output data to the display 12 and the earphone 14 included in the wearable camera 10. In addition, when the received output data is neither image data nor audio data, the mobile terminal device 40 can convert the audio data to the earphones 14 or convert the audio data into an image and display the image on the display 12. . Further, the mobile terminal device 40 can output the received output data to the display operation unit 41 and the voice input / output unit 46 included in the mobile terminal device 40.

  The wireless communication device 30 is a communication relay device that can be connected to the communication network 91 via a connection path different from the connection path used by the mobile terminal device 40. Further, the wireless communication device 30 can be connected by a communication procedure such as Wi-Fi or a wireless LAN, and can be connected to the communication network 91 with respect to a device connected by a communication procedure such as Wi-Fi or a wireless LAN. Provides a communication path with the device. When the connection route used by the mobile terminal device 40 is in an unusable state due to a disaster, or when the connection route connected to the communication network 91 used by the mobile terminal device 40 is in an unusable state due to congestion or the like, By connecting to the communication network 91 via the wireless communication device 30, communication between the mobile terminal device 40 and the control center server 50 becomes possible. In addition, it is possible to change the settings of the wireless communication device 30 such as Wi-Fi or wireless LAN network name disclosure or non-disclosure, encryption keys, and the like, which can be used only in the security system or related to security. It is also possible to make it usable by a general device other than the above device.

  The control center server 50 detects the occurrence of the incident based on various information acquired by the equipment of the security guard received via the mobile terminal device 40, and if the occurrence of the incident is detected, the process corresponding to the detected incident. Then, the processing result is output to the mobile terminal device 40 or the like carried by the security guard.

  Further, the control center server 50 assigns the control center terminal 62 in the control center when the specific processing content cannot be determined, for example, when an abnormal value of the biological information sensor 22 is detected. Thus, a state in which the operator operating the control center terminal 62 and the guard can communicate with each other is created. Specifically, the control center terminal 62 acquires and outputs information such as images, voice, biometric information, and environmental information acquired by the guard's equipment, and outputs a voice input device such as a voice input device connected to the control center terminal 62. The information input by the input device is transmitted to the mobile terminal device 40. The mobile terminal device 40 outputs the received information to the display 12 of the wearable camera 10, the earphones 14, the display operation unit 41 and the voice input / output unit 46 of the mobile terminal device 40, so that the operator operates the control center terminal 62. Enables bidirectional information exchange with security guards. Further, since the operator who operates the control center terminal 62 can confirm the information acquired by the various information acquisition devices worn by the security guard, whether or not the security guard is in a state in need of assistance and the required support content. It is possible to make the appropriate determination in a short time. When the control center terminal 62 receives the operator's judgment content, the control center terminal 62 notifies the control center server 50 of the content, and the control center server 50 specifies the type of incident based on the operator's judgment content and identifies the specified incident. Perform processing according to.

  Further, the control center server 50 can be connected to the surveillance camera 92 and the notification device 93 installed in the security target area via the communication network 91, obtain image data obtained by the surveillance camera 92, and control center. Information can be output from the server 50 to the notification device 93. That is, for example, in response to a guard's request, an image acquired by the surveillance camera 92 is displayed on the display 12 of the wearable camera 10 worn by the guard, or the guard can judge the evacuation guidance in the event of a disaster, for example. It is also possible to immediately reflect the evacuation route based on the notification device 93.

  Next, a functional internal configuration of the mobile terminal device 40 shown in FIG. 2 according to the present embodiment will be described. FIG. 3 is a block diagram showing a functional internal configuration of the mobile terminal device 40 according to the present embodiment. As shown in FIG. 3, the mobile terminal device 40 includes a display operation unit 41, a short-range wireless communication unit 42, a wireless communication unit 43, an external communication unit 44, a camera 45, a voice input / output unit 46, a storage unit 47, and a control unit. It has a section 48.

  The display / operation unit 41 is an input / output unit that displays a touch-type liquid crystal panel and receives operations. The short-range wireless communication unit 42 is an interface unit for performing short-range wireless communication with the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 by Bluetooth or the like. The wireless communication unit 43 is an interface unit for performing wireless communication with the wireless communication device 30 by a communication procedure such as Wi-Fi or wireless LAN. The external communication unit 44 is an interface unit for communicating with the control center server 50 of the control center.

  The camera 45 is an input unit that acquires image data. The voice input / output unit 46 includes a voice input unit such as a microphone and a voice output unit such as a speaker and headphones.

  The storage unit 47 is a storage device including a DDR-SDRAM (Double Data Rate Synchronous Dynamic Random Access Memory). The storage unit 47 has specific facial feature data 47a and procedure data 47b. The specific face feature data 47a is data used by the offline face authentication unit 48i of the individual application 48h described later. The procedure data 47b is data used by the procedure guide unit 48k of the individual application 48h described later.

  The control unit 48 is a control unit that controls the entire mobile terminal device 40, and includes a collected data transmission unit 48a, a collected data analysis unit 48b, an output processing unit 48g, and an individual application 48h. In practice, programs corresponding to these functional units are stored in a ROM (Read Only Memory) or a non-volatile memory (not shown), and these programs are loaded into a CPU (Central Processing Unit) and executed, It will run the corresponding process.

  The collected data transmitting unit 48a transmits various information transmitted from the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 to the control center server 50 via the short-range wireless communication unit 42.

  The collected data analysis unit 48b detects the occurrence of various incidents based on various information transmitted from the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 via the short-range wireless communication unit 42. . The collected data analysis unit 48b has a voice analysis unit 48c, an image analysis unit 48d, a motion analysis unit 48e, an abnormality detection unit 48f, and the like according to the information to be analyzed and the type of incident to be detected.

  The voice analysis unit 48c analyzes the voice data acquired by the microphone 13 of the wearable camera 10 to detect the occurrence of an incident. For example, the instruction by the voice of the guard may be analyzed to detect the incident according to the instruction.

The image analysis unit 48d analyzes the image data acquired by the camera 11 of the wearable camera 10 to detect the occurrence of an incident. In this embodiment, the detection incidents for suspicious person whether the search process, although the be carried out in the control center server 50, may be performed in images analyzing unit 48d of the portable terminal device 40.

  The motion analysis unit 48e analyzes the information related to the operation of the security guard acquired by the motion sensor 21 and detects the occurrence of the incident. For example, the corresponding incident may be detected according to the operation of the security guard corresponding to the predetermined incident.

  The abnormality detection unit 48f analyzes the data acquired by the motion sensor 21 and the biological information sensor 22 and detects the occurrence of an incident. For example, if an abnormal value of the data acquired by the motion sensor 21 and the biometric information sensor 22 is detected, it is determined that there is a high possibility that the security guard is in an abnormal state, and the status of the security guard by the control center terminal 62. It may be possible to detect that an incident of confirmation has occurred.

  The output processing unit 48g receives information such as image information and audio information which is a processing result corresponding to the incident received from the control center server 50, and the image information is a display operation of the display 12 of the wearable camera 10 or the mobile terminal device 40. The unit 41 outputs the voice information to the earphone 14 of the wearable camera 10 or the voice input / output unit 46 of the mobile terminal device 40. In addition, when the received processing result is neither image information nor audio information, the output processing unit 48g can convert it into sound and output it to the earphone 14, or convert it into an image and display it on the display 12, for example. .

  The individual application 48h is a processing unit that performs processing on a processing result in a special format, which is not a general-purpose processing result such as image information and audio information, as the processing result corresponding to the incident received from the control center server 50. . The individual application 48h includes an offline face authentication unit 48i, a wireless communication device setting unit 48j, a procedure guide unit 48k, and the like.

  The offline face authentication unit 48i may, for example, determine whether the person of the face image acquired by the wearable camera 10 is a person included in the blacklist as the processing result of the incident of the blacklist search, together with the blacklist. When the feature data of the face image of the person included in is received, the feature data of the received face image is stored in the specific face feature data 47a. Further, the offline face authentication unit 48i carries out detection of a suspicious person once detected by performing matching between the face image of the person acquired by the camera 11 of the wearable camera 10 and the face characteristic data included in the specific face characteristic data 47a. By using the terminal device 40, it is possible to support the tracking of a suspicious person locally without cooperating with the control center server 50.

  The wireless communication device setting unit 48j receives, for example, setting change information related to disclosure or non-disclosure of the network name of the wireless communication device 30 or an encryption key from the control center server 50 as a processing result for the incident of wireless access point setting. In this case, the wireless communication device setting unit 48j transmits the received setting change information to the wireless communication device 30 to change the setting related to the public or private disclosure of the network name and the encryption key.

  For example, if the procedure guide unit 48k receives the information of the processing procedure related to the specific business as the processing result as the processing result of the incident of the support related to the specific business, the procedure guide unit 48k stores the information of the received processing procedure in the procedure data 47b. . Further, the procedure guide unit 48k sequentially outputs the procedure information including the voice and the image included in the stored procedure data 47b to the display 12 and the earphone 14 included in the wearable camera 10 to perform the specific task of the security guard. To guide.

  Next, the data structure of the mobile terminal device 40 shown in FIG. 3 according to this embodiment will be described with reference to FIG.

  The specific face feature data 47a is data having record numbers of an identification number for identifying the face feature data, attribute information of a person corresponding to the identification number, and face feature information. The attribute information includes information such as the name of the person corresponding to the identification number, sex, age, and the reason why the person is listed in the blacklist. The example of the specific facial feature data 47a in FIG. 4 indicates that the person with the identification number “00101” has the name “Taro Tanaka”, the gender “male”, and the age “30”.

The procedure data 47b is data having a record number of a procedure number indicating the order of performing the procedure, a data section indicating the type of the procedure instruction data, and the procedure instruction data. The data division is coded data, "1" indicates that the procedure instruction data is audio data, "2" indicates that the procedure instruction data is image data, and "3" indicates the procedure. The instruction data is voice + image data, and "4" indicates that the procedure instruction data is character data.

  In the example of the procedure data 47b of FIG. 4, the procedure instruction data corresponding to the procedure application number “1” is voice data with a data division of “1”, and the procedure instruction data corresponding to the procedure application number “2”. Indicates that the data division is “1” and is voice data, and the procedure instruction data corresponding to the procedure request “3” is data +3 and voice + image data.

  Next, the functional internal configuration of the control center server 50 shown in FIG. 2 according to this embodiment will be described. FIG. 5 is a block diagram showing the functional internal configuration of the control center server 50 according to this embodiment. As shown in FIG. 5, the control center server 50 is connected to the input unit 51 and the display unit 52. The input unit 51 is a keyboard, a mouse or the like, and the display unit 52 is a display device such as a liquid crystal panel.

  The control center server 50 also includes a communication unit 53, a storage unit 54, and a control unit 55. The communication unit 53 is an interface unit for performing data communication with the wireless communication device 30, the mobile terminal device 40, the monitoring camera 92, and the notification device 93 via the communication network 91.

  The storage unit 54 is a storage device including a hard disk device, a non-volatile memory, and the like. The storage unit 54 has collected data 54a, guard data 54b, terminal management data 54c, incident data 54d, output data 54e, a blacklist DB 54m, and a procedure DB 54n.

  The collected data 54a is data in which the information received from the mobile terminal device 40 and acquired by the various information acquisition devices worn by the security guard is accumulated. The guard data 54b is information relating to a guard to be supported by the guard system, and is data including a real-time situation of the guard and attribute information such as a skill possessed by the guard. The terminal management data 54c is data indicating the operating status of the plurality of control center terminals 62 installed in the control center. The incident data 54d is data for managing incidents that have occurred, and is data that includes information such as identification information assigned to each incident, the type of incident, and the status of the incident.

  The output data 54e is a processing result associated with the incident, and includes output destination data 54f, instruction text data 54g, voice output data 54h, image output data 54i, specific face feature data 54j, procedure data 54k, and the like. The output destination data 54f is information relating to the destination to which the processing results such as the instruction text data 54g, the voice output data 54h, the image output data 54i, the specific face feature data 54j, and the procedure data 54k are transmitted. For example, in the case of a blacklist search incident, the destination to which the processing result of the blacklist search is normally sent is a guard who wears the wearable camera 10 that has acquired a facial image. In the case of an incident such as a request, it becomes a guard who is the target of dispatch instructions.

  The instruction text data 54g is output data to a security guard, and the mobile terminal device 40 that has received the instruction text data 54g displays the received instruction text data 54g as character information on the display 12 of the wearable camera 10 or converts it to voice data to use the earphones. It outputs to 14. The voice output data 54h is output data to the guard, and the mobile terminal device 40 that has received the voice output data 54h outputs the received voice output data 54h to the earphone 14. The image output data 54i is output data to the security guard, and the received mobile terminal device 40 outputs the received image output data 54i to the display 12 of the wearable camera 10.

  The specific face feature data 54j is data output as an incident processing result such as a blacklist search, and is data including information such as face feature data corresponding to the searched blacklist person. When the specific face feature data 54j is transmitted to the mobile terminal device 40, the mobile terminal device 40 additionally registers the accepted specific face feature data 54j in the specific face feature data 47a.

  The procedure data 54k is information on the procedure for the security officer to take as the result of the incident, and when the procedure data 54k is transmitted to the mobile terminal device 40, the mobile terminal device 40 receives the procedure data 54k. Is stored in the procedure data 47b and the procedure is navigated.

  The blacklist DB 54m is a database including the feature data of the face image of the person requiring attention and the information relating to the person requiring attention, and is a DB used in the processing according to the incident of the blacklist search. Further, the procedure DB 54n is a DB that stores the procedure of the procedure performed by the security guard. When the procedure data 54k is output as the processing result of the incident, the corresponding procedure is selected from the procedure DB 54n and output to the procedure data 54k. To do.

  The control unit 55 is a control unit that controls the entire control center server 50, and includes a data collection / accumulation processing unit 55a, a collected data monitoring unit 55b, a guard data management unit 55c, a terminal control unit 55d, an individual processing unit 55e, and an output. It has a processing unit 55h. In practice, programs corresponding to these functional units are stored in a ROM or a non-volatile memory (not shown), and these programs are loaded into a CPU (Central Processing Unit) and executed to execute the corresponding processes. I will let you.

The data collection / accumulation processing unit 55a receives various data acquired from the mobile terminal device 40 by various devices equipped with security guards and accumulates them in the collected data 54a.

  The collected data monitoring unit 55b is a processing unit that monitors various information acquired from the mobile terminal device 40 by various information acquisition devices worn by security guards and detects the occurrence of various incidents. Although the collected data monitoring unit 55b and the collected data analysis unit 48b of the mobile terminal device 40 can detect incidents based on the same data, they do not perform duplicated processing, and the occurrence frequency of data and The functions are appropriately distributed to the mobile terminal device 40 and the control center server 50 according to the information necessary for analyzing the data.

  The guard data management unit 55c manages the real-time status of the guard in the guard data 54b. For example, the location information is received from the environmental information sensor 23 carried by the security personnel, the location information of the security personnel included in the security personnel data 54b is updated, and the information of the incident occurring in association with the security personnel is obtained in real time. Update with.

  The terminal control unit 55d allocates and releases incidents of the control center terminals 62 installed in the control center. Further, when the control center terminal 62 is assigned to the incident, the terminal control unit 55d relays data communication between the assigned control center terminal 62 and the mobile terminal device 40 corresponding to the incident, and the control center terminal 62d A state in which the operator who operates 62 and the guard can communicate with each other is created.

  The individual processing unit 55e performs individual processing according to the type of incident and outputs the output data 54e as the processing result. The individual processing unit 55e includes a blacklist search unit 55f and a wireless communication device setting unit 55g, which are processing units for each type of incident.

  The blacklist search unit 55f is a processing unit for incidents called blacklist search that confirms whether the person included in the image data acquired by the wearable camera 10 is a person included in the blacklist, and includes the image data acquired by the wearable camera 10. The face image of the person to be matched is used to match the information of the blacklist DB 54m, and as the processing result, the instruction text data 54g, the voice output data 54h, the image output data 54i, the specific face feature data 54j, the procedure data 54k, etc. Output the data.

  The wireless communication device setting unit 55g is, for example, a processing unit for incidents such as wireless access point setting, and outputs setting change information related to disclosure or non-disclosure of the network name of the wireless communication device 30 or an encryption key as a processing result. To do.

  The output processing unit 55h is a processing unit that transmits the output data 54e output by the individual processing unit 55e for the generated incident to the output destination indicated by the output destination data 54f included in the output data 54e.

  Next, the data structure of the control center server 50 shown in FIG. 5 according to this embodiment will be described with reference to FIGS. 6 and 7.

  The collected data 54a in FIG. 6 includes the date and time when the data was collected, the identification information of the guard who wears or carries the device that acquired the data, the data classification indicating the type of the collected data, and the acquired data as the retained items of the record. The data. The data classification is coded data, "01" indicates that the data is acquired by the camera 11 of the wearable camera 10, and "02" is data acquired by the microphone 13 of the wearable camera 10. “03” indicates that the data is acquired by the motion sensor 21, “04” indicates that the data is acquired by the biological information sensor 22, and “05” is the data acquired by the environment information sensor 23. “81” indicates that the data is acquired by the surveillance camera 92, and “90” indicates the result of analyzing the information acquired by the mobile terminal device 40 by the various information acquisition devices worn by the security guard. Indicates that the data. The acquired data has a data format according to the data classification.

  In the example of the collected data 54a of FIG. 6, data acquired by the camera 11 of the wearable camera 10 worn by the security guard whose date and time is "2014/4/10 15:00" and whose security guard identification information is "05015" is recorded. It has been shown that.

  The guard data 54b in FIG. 6 is data in which record identification items include guard identification information, guard status indicating the guard's real-time status, guard attribute information, and the like. The security officer status includes a mission number that identifies the mission assigned to the security officer, an incident number that is being processed in association with the security officer, position information received from the security officer's environmental information sensor 23, and the security officer's position information. It includes the communication address of the portable terminal device 40 to carry. The security guard attribute information includes information such as gender and possession skill.

  In the example of the guard data 54b of FIG. 6, the guard whose identification information of the guard is “12345” is assigned the mission for the mission number “123”, and the incident of “12301234” corresponding to the guard is concerned. Is being processed, and the sex is "M", which indicates that he is male.

  The terminal management data 54c of FIG. 6 is data in which the status of the control center terminal 62 with respect to the terminal identification number associated with the terminal identification number that can identify the control center terminal 62, the related incident number, and the like are held items in the record. Is. The status is coded data, and “0” indicates that it is not assigned to any incident, and “1” indicates that it is assigned to any incident. In the example of the terminal management data 54c in FIG. 6, the control center terminal 62 having the terminal identification number “011” has the status “1” and is assigned to the incident, and the assigned incident number is “1010251”. It is shown that.

  The incident data 54d in FIG. 6 is a record holding item such as the date and time of the incident, the incident number for identifying the incident, the type of the incident, the status of the incident, and the identification information of the guards corresponding to the incident. Data to The incident status is coded data, "00" indicates that the incident is being determined, "01" indicates that the destination to which the processing result is to be transmitted has been determined, and "02" indicates Indicates that the processing result has been transmitted, and “90” indicates that the handling of the incident has been completed.

  In the example of the incident data 54d of FIG. 6, the incident date and time is “2014/4/10 17:30”, the incident number is “12301234”, the incident type is “201”, and the incident status is “01”. It indicates that the destination to which the processing result is to be transmitted has been determined, and that the identification information of the guard corresponding to the incident is “12345”.

  The output data 54e shown in FIG. 6 is a common data format of the output destination data 54f, the instruction text data 54g, the voice output data 54h, the image output data 54i, the specific face feature data 54j, and the procedure data 54k, and corresponds to them. The record number includes an incident number of an incident, an incident branch number for identifying a plurality of output data 54e for the incident number, a data division, and data for each division. The data. The data division is coded data, "01" indicates that the data included in the divisional data is the output destination data 54f, and "02" indicates that the data included in the divisional data is the instruction text data. 54g, “03” indicates that the data included in the classification data is audio output data 54h, and “04” indicates that the data included in the classification data is image output data 54i. ing.

  In the example of the output data 54e of FIG. 6, the data having the incident number “12301234” and the incident branch number “001” has the data division “01” and the output destination data 54f as the divisional data. It indicates that

  The blacklist DB 54m of FIG. 7 has the same structure as the specific face feature data 47a of the mobile terminal device 40 shown in FIG. Further, the procedure DB 54n of FIG. 7 is data in which a procedure identification number associated with a series of procedures is added to the record item with respect to the procedure data 47b of the mobile terminal device 40 of FIG. The procedure data 47b shown in FIG. 4 is data obtained by selecting any one procedure from the procedure DB 54n in which a plurality of procedures is stored.

  Next, a processing procedure when the control center server 50 receives information from the mobile terminal device 40 will be described. FIG. 8 is a flowchart showing a processing procedure when the control center server 50 receives information from the mobile terminal device 40.

  If the data collection / accumulation processing unit 55a receives a notification of an incident detected on the basis of various information acquired from the mobile terminal device 40 by various information acquisition devices worn by security guards, the received information is stored in the collected data 54a. Register (step S101).

  If the information received in step S101 is not an incident report (step S102; No), the collected data monitoring unit 55b analyzes the received data to determine whether an incident has occurred and the type of incident ( Step S103). If the information received in step S101 is an incident notification (step S102; Yes), the data collection / accumulation processing unit 55a registers the content of the received incident notification in the incident data 54d (step S104) and the process proceeds to step S112.

When it is determined that the incident is not an incident in the determination process of step S103 (step S105; Yes), the process ends. Further, when it is determined that the incident is an incident in the determination process of step S103 (step S105; No), the collected data monitoring unit 55b registers the determination result of the process of step S103 in the incident data 54d (step S106). . Also, if it is determined also incident type in the determination process in step S107; (step S107 Yes), the process proceeds to step S112.

When the incident type is not determined in the determination process in step S107; (step S107 No), the terminal control unit 55d corresponds to the control center terminal 62 and incident assigned perform the assignment of control center terminal 62 a mobile terminal By connecting with the device 40, the operator operating the control center terminal 62 and the guard can communicate with each other (step S108).

If the incident type is received from the control center terminal 62 as a result of the process in step S108 (step S109; Yes), the terminal control unit 55d registers the received incident type in the incident data 54d (step S110). Further, as a result of the processing of step S108, if accepted the fact that corresponding from the control center terminal 62 for the incident has ended (step S109; No), ends late control unit 55d is incident status of the corresponding incident data 54d The processing is updated by updating the correspondence to "90" (step S111).

  When the incident type is determined, the individual processing unit 55e executes processing according to the incident type. Specifically, the individual processing unit 55e executes processing according to the incident type, outputs the processing result to the output data 54e (step S112), determines the destination to which the processing result is transmitted, and outputs the output data 54e. To the output destination data 54f (step S113).

  The output processing unit 55h transmits the processing result according to the output data 54e to the portable terminal device 40 carried by the security guard (step S114), and regarding the incident in which the processing ends by transmitting the processing result (step S115; Yes). , The incident status of the corresponding record of the incident data 54d is updated to “90”, which is the completion of handling (step S116), and the process is terminated. Further, for the incident whose processing for the incident is not ended by transmitting the processing result (step S115; No), the processing is ended without performing the incident closing processing of step S116.

  Next, the processing procedure of the incident detection processing of the blacklist search in the reception data analysis processing (step S103) shown in FIG. 8 will be described using the flowchart shown in FIG.

  When the received information is image data (step S201; Yes), the collected data monitoring unit 55b analyzes the received image data and detects a person included in the image (step S202). Further, the collected data monitoring unit 55b determines the feature for each person detected in step S202, and stores the feature information of each person detected in step S202 together with the image data reception time (step S203). The collected data monitoring unit 55b receives the image data last time based on the detected characteristic information of each person accumulated in time series by the processing performed in steps S202 and S203 each time the image data is received. The appearance rate, which is the rate at which the same person having the same feature appears in the image in the range of a predetermined time from, is calculated for each person (step S204).

  There is a person whose appearance rate for each person calculated in step S204 is equal to or higher than a predetermined value (step S205; Yes), and the heart rate acquired by the biometric information sensor 22 worn by the guard at that time is compared with other times. When a significant change is recognized (step S206; Yes), the collected data monitoring unit 55b determines that the guard pays special attention to the person with a high appearance rate, and the person is blacklisted. It is determined that the incident is a blacklist search of searching for a person included in (step S207), and the process ends.

  When there is no person whose appearance rate for each person calculated in step S204 is equal to or higher than a predetermined value (step S205; No), or when there is a person whose appearance rate for each person calculated in step S204 is equal to or higher than a predetermined value (step Even if (S205; Yes), if there is no significant change in the heart rate acquired by the biological information sensor 22 worn by the guard at that time compared to other times (step S206; No), The process ends without performing the process of step S207. Also, if the received information is not image data (step S201; No), the process is terminated.

  The criterion shown in FIG. 9 that the guard pays special attention to a specific person is an example. For example, a sensor that detects the line of sight of the guard is attached to the guard, The determination may be made by analyzing the movement of the line of sight.

  Next, the processing procedure of the blacklist search processing in the output data generation processing (step S112) shown in FIG. 8 will be described using the flowchart shown in FIG.

  The blacklist search unit 55f extracts the face image of the person to be evaluated from the received image data (step S301), and calculates the face feature data based on the extracted face image (step S302). The blacklist search unit 55f evaluates the similarity between the facial feature data of the person to be evaluated calculated in step S302 and the facial feature data of the person included in the blacklist DB 54m, and determines that the similarity is high. A search process is performed to determine whether or not the person to be displayed exists in the blacklist DB (step S303).

  In the blacklist DB 54m search process of step S303, if a person with a high similarity exists in the blacklist DB 54m (step S304; Yes), the blacklist search unit 55f determines that the blacklist has a high similarity. Information regarding the person in the DB 54m is output as the specific face feature data 54j (step S305), and the procedure data 54k is used as a coping procedure for the guard when a person having a high similarity to the person included in the blacklist DB 54m is detected. Output (step S306) and end the process.

  In the blacklist DB 54m search process of step S303, if a person with high similarity does not exist in the blacklist DB 54m (step S304; No), the processes of steps S305 and S306 are skipped and the process ends.

  Next, the processing procedure of the guide processing of the procedure for the guard when the procedure information in the mobile terminal device 40 shown in FIG. 2 is received will be described using the flowchart shown in FIG.

  When the procedure guide unit 48k receives the procedure data 54k from the control center server 50, the procedure guide unit 48k stores the accepted procedure data 54k as the procedure data 47b, and confirms whether or not to guide the procedure according to the procedure data 47b. Is performed (step S401). In the guide confirmation process of step S401, if a response from the guard indicating that a guide instruction is necessary is received (step S402; Yes), the procedure guide unit 48k outputs the procedure instruction data that has not been output in the procedure data 47b. The procedure instruction data having the smallest procedure number is output to the output destination corresponding to the data classification (step S403).

  When the response from the guard indicating that the procedure for the instruction procedure data output in step S403 has been completed is accepted (step S404; Yes), and there is no unoutput procedure instruction data (step S405; Yes), the procedure guide The unit 48k outputs the fact that the guide of the procedure according to the procedure data 47b is completed to the earphone 14 or the like of the wearable camera 10 (step S406), and ends the process.

  When the response from the guard indicating that the procedure for the procedure instruction data output in step S403 has been completed has not been received (step S404; No), the process returns to step S404 to wait for the response from the guard. If there is any procedure instruction data that has not been output (step S405; No), the procedure proceeds to step S403, and the procedure proceeds to output processing for the next procedure number. Further, in the guide confirmation process of step S401, if a response from the guard that the instruction of the guide is unnecessary is received (step S402; No), the process is terminated without performing the guide process of the procedure based on the procedure data 47b. .

  As described above, based on the information acquired by various information acquisition devices such as the wearable camera 10, the motion sensor 21, the biometric information sensor 22 and the environment information sensor 23 worn by the security guard, the security officer normally operates on the person or the object. Detecting that special attention different from time is being directed, the security officer determines whether the person or object to which the special attention is directed is a target to be watched, and the determination result and the determination Since it is configured to notify the guard of the coping procedure according to the result, it is possible to realize efficient guarding in a situation where the number of installed information acquisition devices such as imaging devices and sensors is insufficient.

  In the present embodiment, in the control center server 50 that has received the information acquired by the various information acquisition devices worn by the security guard, the security guard can detect the person or the object based on the information acquired by the various information acquisition devices received. Although it has been described that the security guard determines that the person or object that has given special attention is detected by detecting that special attention is directed, the present invention is not limited to this. Not something. For example, the mobile terminal device 40 may detect that the security officer is paying special attention to a person or an object based on the information acquired by the various information acquisition devices worn by the security officer. In addition, the security personnel may determine whether or not a person or thing to which special attention is directed should be performed by another device such as the control center server 50. The mobile terminal device 40 may also be used to determine whether or not the person or object to which the member has given special attention is an object to be watched.

  In addition, each configuration illustrated in the present embodiment is a functional schematic, and does not necessarily have to be physically configured as illustrated. That is, the form of distribution / integration of each device is not limited to that shown in the figure, and all or a part of them may be functionally or physically distributed / integrated in arbitrary units according to various loads and usage conditions. Can be configured.

  As described above, the security system and the security method according to the present invention are suitable for realizing efficient security in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

10 wearable camera 11, 45 camera 12 display 13 microphone 14 earphone 21 motion sensor 22 biological information sensor 23 environment information sensor 30 wireless communication device 40 mobile terminal device 41 display operation unit 42 short-range wireless communication unit 43 wireless communication unit 44 external communication unit 46 voice input / output unit 47, 54 storage unit 47a, 54j specific face feature data 47b, 54k procedure data 48, 55 control unit 48a collected data transmission unit 48b collected data analysis unit 48c voice analysis unit 48d image analysis unit 48e motion analysis unit 48f Abnormality detection part 48g, 55h Output processing part 48h Individual application
48i offline face recognition unit
48j, 55g Wireless communication device setting unit 48k Procedure guide unit 50 Control center server 51 Input unit 52 Display unit 53 Communication unit 54a Collected data 54b Security guard data 54c Terminal management data 54d Incident data 54e Output data 54f Output destination data 54g Instruction text data 54h Audio output data 54i Image output data 54m Blacklist DB
54n Procedure DB
55a Data collection / accumulation processing unit 55b Collected data monitoring unit 55c Security guard data management unit 55d Terminal control unit 55e Individual processing unit 55f Blacklist search unit 62 Control center terminal 91 Communication network 92 Surveillance camera 93 Notification device

Claims (7)

An information acquisition unit that is carried or worn by a security guard and acquires information about the security guard's surroundings,
A guard state determination means for determining the state of the guard,
A detection unit that detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition unit,
The state of the security guard determined by the security guard state determination means and the information acquired by the information acquisition means concerning the object detected as the evaluation target by the detection means are used to evaluate the object as a security target. Equipped with a security target evaluation means to perform,
The information acquisition unit acquires image information of at least the direction in which the face of the security guard is facing,
The guard state determination means, by using the image information acquired by the information acquisition means, to determine a state in which the guard is paying special attention to the object included in the image of the image information,
The detection means detects an object determined by the security guard state determination means that the security guard is paying special attention as the evaluation target,
The security target evaluation means, when it is determined by the security guard status determination means that the security guard is in a state of paying special attention to the object included in the image of the image information, A security system characterized in that the image information acquired by the information acquisition means is used to evaluate the object as a warning target. The security target evaluation means,
An image of the person obtained by the information obtaining unit when the guard state determining unit determines that the guard is in a state of paying special attention to the person included in the image of the image information. 2. The information according to claim 1, wherein the similarity between the information and the image information of the person requiring caution is evaluated, and when the similarity is high, the person is evaluated as a person requiring caution. Security system.   The evaluation result informing means for informing the security officer of an evaluation result when the security object evaluation means evaluates that the object to be evaluated needs to be alerted, further comprising: Security system described. An information acquisition unit that is carried or worn by a security guard and acquires information about the security guard's surroundings,
A guard state determination means for determining the state of the guard,
A detection unit that detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition unit,
The state of the security guard determined by the security guard state determination means, and the information obtained by the information acquisition means concerning the object detected as the evaluation target by the detection means is used to evaluate the object as a security target. Equipped with a security target evaluation means to perform,
The information acquisition means acquires at least image information around the security guard,
A security system further comprising procedure notification means for notifying the security staff of information relating to the procedure when the object to be evaluated is evaluated to be required to be dealt with by the security target evaluation means. .   In addition to image information, the information acquired by the information acquisition unit is one or more of audio information, position information, information related to the operation of the guard, information related to the living body of the guard, and information related to the environment. The security system according to any one of claims 1 to 4, further comprising: It is carried or attached to the guards, and the information acquisition device for acquiring information around the guards, a guard process in security systems and a server device,
The server device, a guard state determination step of determining the state of the guard,
A detection step in which the server device detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition device ;
The server device uses the state of the guard determined in the guard state determination step and the information acquired by the information acquisition device regarding the object detected as the evaluation target in the detection step to warn the object. And a security target evaluation step for performing evaluation as a target ,
The information acquisition device acquires at least image information in a direction in which the face of the security guard is facing,
The guard state determination step, by using the image information acquired by the information acquisition device , to determine a state in which the guard is paying special attention to the object included in the image of the image information,
The detection step detects as the evaluation target an object determined by the security guard state determination step that the security guard is paying special attention,
The security target evaluation step, when it is determined by the security officer state determination step that the security officer is paying special attention to the object included in the image of the image information, A security method, wherein the image information acquired by the information acquisition device is used to evaluate the object as a warning target. It is carried or attached to the guards, and the information acquisition device for acquiring information around the guards, a guard process in security systems and a server device,
The server device, a guard state determination step of determining the state of the guard,
A detection step in which the server device detects an object existing around the security guard as an evaluation target based on the information acquired by the information acquisition device ;
The server device uses the state of the guard determined in the guard state determination step and the information acquired by the information acquisition device regarding the object detected as the evaluation target in the detection step to warn the object. And a security target evaluation step for performing evaluation as a target,
The information acquisition device , at least acquires image information around the security guard,
The security method, further comprising a procedure notifying step of notifying the security personnel of information regarding the procedure of the countermeasure when the countermeasure against the object to be evaluated is evaluated to be necessary by the security target evaluating step.

Images