JP7811862B2 - Security system, security method and program - Google Patents

Description

The present invention relates to a security system, a security method, and a program.

Conventionally, security systems have been commonly used in which security terminals installed in the spaces to be guarded, such as individual buildings, detect the presence of people or the outbreak of a fire and then notify security companies or other entities of the occurrence of an abnormality. In such security systems, when the homeowner or other entity is absent, such as at night or on holidays, or when an abnormality is notified, a security guard or other patrol officer patrols the building on behalf of the homeowner or entity to check the situation. In such cases, the accuracy of the patrol officer's patrol work (hereinafter referred to as "patrol accuracy") depends on the patrol officer's state of consciousness, such as their concentration level and emotional state, so it is important to understand the patrol officer's state of consciousness.

Technology for understanding the state of consciousness of a worker performing a certain task has been disclosed, including analyzing the worker's electroencephalogram (EEG) and determining the occurrence rate of the alpha wave component of the EEG to assess the worker's judgment and thinking ability (see, for example, Patent Document 1). Another technology has been disclosed that acquires information on the worker's eye movement and EEG signals, determines a correlation value between the worker's attention level and the EEG signal, and estimates the worker's attention state from the correlation value (see, for example, Patent Document 2).

Japanese Patent Application Publication No. 2-193645 JP 2013-244116 A

The conventional technology described above can determine whether a decline in work accuracy is due to a decline in consciousness by estimating the worker's state of concentration, emotions, and other aspects of their state of consciousness. However, patrol personnel move around the building while checking the situation, and the conventional technology described above has the problem of being unable to fully grasp the locations where patrol accuracy has declined.

The present invention was made in consideration of the above, and aims to provide a security system, security method, and program that can efficiently maintain patrol accuracy by correlating the patrol accuracy of patrol personnel with the detection results of sensors.

To solve the above-mentioned problems and achieve the object, the present invention is characterized by comprising a first acquisition unit that acquires a biological signal related to a patrolman from a measuring device that detects the biological signal; a second acquisition unit that, when the patrolman is detected by one or more sensors installed in a guarded space patrolled by the patrolman, acquires security information including at least information about the sensor that detected the patrolman; a calculation unit that calculates predetermined feature amounts from the biological signal acquired by the first acquisition unit; an analysis unit that analyzes the patrolman's state of consciousness based on the feature amounts calculated by the calculation unit; an accuracy determination unit that determines the patrolman's patrol accuracy based on the analysis results by the analysis unit; and a generation unit that generates operation history information that associates at least the sensor information indicated in the security information with the patrol accuracy determination result by the accuracy determination unit.

The present invention can contribute to maintaining patrol accuracy by identifying areas where patrol accuracy has declined.

FIG. 1 is a diagram illustrating an example of the overall configuration of a security system according to an embodiment. FIG. 2 is a diagram showing an example of a state of consciousness determined from an electroencephalogram. FIG. 3 is a diagram showing an example of feedback based on the analysis results. FIG. 4 is a diagram illustrating an example of a hardware configuration of an information terminal according to an embodiment. FIG. 5 is a diagram illustrating an example of a hardware configuration of a management server according to an embodiment. FIG. 6 is a diagram illustrating an example of a functional block configuration of a security system according to an embodiment. FIG. 7 is a diagram for explaining how the concentration level is determined from an electroencephalogram. FIG. 8 is a diagram illustrating the distribution of consciousness states based on the emotion analysis results. FIG. 9 is a diagram showing an example of a waveform of a myoelectric potential during eye movement. FIG. 10 is a diagram illustrating an example of a consciousness state based on a result of determining the navigation accuracy of the information terminal according to the embodiment. FIG. 11 is a diagram illustrating an example of a security target space. FIG. 12 is a diagram illustrating an example of operation history information. FIG. 13 is a flowchart showing an example of the flow of patrol work when the security system according to the embodiment is used. FIG. 14 is a flowchart showing an example of the flow of the accuracy determination process of the security system according to the embodiment.

Embodiments of the security system, security method, and program according to the present invention will be described in detail below with reference to the drawings. Furthermore, the present invention is not limited to the following embodiments, and the components in the following embodiments include those that would be easily conceived by a person skilled in the art, those that are substantially identical, and those that are within the scope of what is known as equivalents. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the following embodiments.

(Overall configuration of security system)
Fig. 1 is a diagram showing an example of the overall configuration of a security system according to an embodiment. Fig. 2 is a diagram showing an example of a state of consciousness determined from electroencephalograms, where the horizontal axis represents time and eight waves represent electroencephalogram waveforms. Fig. 3 is a diagram showing an example of feedback based on analysis results. An overview of the overall configuration and operation of security system 1 according to this embodiment will be described with reference to Figs. 1 to 3.

The security system 1 shown in Figure 1 determines the patrol accuracy of each area in the security space STS by analyzing biosignals such as electroencephalograms obtained from a patrolman patrolling the security space STS and provides feedback on the determination results to the patrolman. As shown in Figure 1, the security system 1 includes an information terminal 10 carried by the patrolman and a management server 20 (host device) at the monitoring center. The patrolman patrols the security space STS while wearing a helmet H equipped with an electroencephalograph (EEG) E. The electroencephalograph E is a measuring device that measures the neural activity state of the brain by detecting weak electrical signals (brain waves) emitted from the human brain using multiple electrodes. Note that the electroencephalograph E is not limited to being built into the helmet H, but may be worn or carried in a manner that allows it to detect the patrolman's brain waves. Furthermore, the measuring device for measuring the patrolman's biological signals is not limited to the electroencephalograph E, but may also be a magnetoencephalogram (MEG) or a brain activity sensor that uses near-infrared light to measure changes in blood flow in brain tissue.

In addition, various sensors such as motion sensors, cameras, and door sensors, as well as a security terminal ST equipped with a communication device (not shown), are installed at various locations within the guarded space STS, allowing the presence of humans or other objects in any area within the guarded space STS to be detected. At least one sensor is installed in the guarded space STS. When a sensor detects a human or other object, the communication device transmits detection information including identification information indicating the sensor's installation location via network N to the management server 20 in the monitoring center. The human or other object may be, for example, a patrol person. Network N is a network such as a LAN (Local Area Network) or the Internet that complies with protocols such as TCP (Transmission Control Protocol)/IP (Internet Protocol). Network N may include not only wired lines but also wireless lines.

The information terminal 10 is an information processing device such as a smartphone or tablet that wirelessly receives brain waves measured by an electroencephalograph E attached to a helmet H worn by the patrolman, and determines the patrolman's state of consciousness through various analyses of the brain waves, thereby assessing the accuracy of the patrol work.

For example, the information terminal 10 wirelessly receives brain waves such as those shown in FIG. 2(a) from the electroencephalograph E and performs various analyses of the brain waves to determine the patrol member's state of consciousness, such as "concentration," "drowsiness," "lethargy," "distraction," or "fear," as shown in FIG. 2(b). The information terminal 10 then determines the accuracy of the patrol work based on the determined state of consciousness of the patrol member and executes feedback processing based on the determination result. For example, as shown in FIG. 3, if the information terminal 10 determines that the patrol member's state of consciousness is "drowsiness" or the like, and the patrol member's patrol accuracy has decreased, the information terminal 10 issues a feedback processing instruction to improve the patrol member's state of consciousness, such as by vibrating a vibrator. Furthermore, as shown in FIG. 3, if the information terminal 10 determines that the patrol member's state of consciousness is "distraction," and the patrol member's patrol accuracy has decreased, the information terminal 10 extracts the area patrolled with decreased patrol accuracy and instructs the patrol member to patrol the area again, as feedback processing. Furthermore, as shown in Figure 3, if the patrolman's state of consciousness is "fear," the information terminal 10 determines that the patrolman has encountered some kind of dangerous situation and sends an emergency alert to the management server 20 of the monitoring center. Note that when the information terminal 10 receives brain waves from the electroencephalograph E, it is not limited to receiving them wirelessly, and may receive them via a wired connection.

The management server 20 is a server device that receives detection information via the network N from the security terminal ST installed in the security target space STS, and transmits security information including the detection information and the time the detection information was acquired to the information terminal 10 via the network N.

Details about the configuration and operation of the information terminal 10 and management server 20 will be provided later. Note that in Figure 1, the security system 1 includes the information terminal 10 and management server 20, but this is not limited to this. If the information terminal 10 is configured to receive detection information directly from the security terminal ST, the system can be realized without including the management server 20.

(Hardware configuration of information terminal)
4 is a diagram showing an example of the hardware configuration of an information terminal according to an embodiment of the present invention, with reference to which the hardware configuration of the information terminal 10 according to the present embodiment will be described.

As shown in FIG. 4, the information terminal 10 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM (Electrically Erasable Programmable Read Only Memory) 404, a long-distance communication circuit 410, an antenna 410a, a short-distance communication circuit 411, an antenna 411a, a microphone 412, a speaker 413, an audio input/output I/F 414, a display 415, a vibrator 417, and a touch panel 418.

CPU 401 is a computing device that controls the overall operation of information terminal 10. ROM 402 is a non-volatile storage device that stores programs used to drive CPU 401, such as IPL. RAM 403 is a volatile storage device used as a work area for CPU 401. EEPROM 404 is a non-volatile storage device that stores programs and various data.

The long-distance communication circuit 410 is a communication circuit that wirelessly communicates with other devices via the network N via antenna 410a in accordance with standards such as Wi-Fi (registered trademark).

The short-range communication circuit 411 is a communication circuit that performs short-range wireless communication with other devices via the antenna 411a in accordance with standards such as NFC (Near Field Communication) or Bluetooth (registered trademark).

The microphone 412 is a built-in sound collection device that converts sound into an electrical signal. The speaker 413 is a built-in audio device that converts electrical signals into physical vibrations and outputs sounds such as music or voice. The sound input/output I/F 414 is an interface that processes the input and output of sound signals between the microphone 412 and speaker 413 under the control of the CPU 401.

Display 415 is a display device such as a liquid crystal display or organic EL (electroluminescence) display that displays various icons, etc.

Vibrator 417 is a device that generates physical vibrations under the control of CPU 401.

The touch panel 418 is an input device that allows the user to perform various functions of the information terminal 10 by touching the display 415.

The above-mentioned CPU 401, ROM 402, RAM 403, EEPROM 404, long-distance communication circuit 410, short-distance communication circuit 411, sound input/output I/F 414, display 415, vibrator 417, and touch panel 418 are communicatively connected to one another via bus lines 409 such as an address bus and a data bus.

Note that the hardware configuration of the information terminal 10 shown in Figure 4 is an example, and it is not necessary to include all of the components, and other components may also be included.

(Management server hardware configuration)
5 is a diagram showing an example of the hardware configuration of the management server 20 according to the embodiment, which will be described with reference to FIG.

As shown in FIG. 5, the management server 20 includes a CPU 501, a ROM 502, a RAM 503, an auxiliary storage device 505, a network I/F 508, a display 509, a keyboard 511, and a mouse 512.

The CPU 501 is a computing device that controls the overall operation of the management server 20. The ROM 502 is a non-volatile storage device that stores programs for the management server 20. The RAM 503 is a volatile storage device used as a work area for the CPU 501.

The auxiliary storage device 505 is a storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores various data, programs, etc.

The network I/F 508 is an interface for communicating data with external devices such as the security terminal ST and information terminal 10 via the network N. The network I/F 508 is, for example, a NIC (Network Interface Card) that supports Ethernet (registered trademark) and is capable of communication compliant with TCP/IP, etc.

Display 509 is a display device made of liquid crystal or organic electroluminescence (EL) or the like that displays various information such as a cursor, menu, window, text, or image.

The keyboard 511 is an input device for selecting letters, numbers, and various instructions, and for moving the cursor. The mouse 512 is an input device for selecting and executing various instructions, selecting processing targets, and for moving the cursor.

The above-mentioned CPU 501, ROM 502, RAM 503, auxiliary storage device 505, network I/F 508, display 509, keyboard 511, and mouse 512 are communicatively connected to each other via a bus line 510 such as an address bus and a data bus.

Note that the hardware configuration of the management server 20 shown in Figure 5 is an example, and it is not necessary to include all of the components shown in Figure 5, or it may include other components.

(Configuration and operation of security system functional blocks)
FIG. 6 is a diagram illustrating an example of the functional block configuration of a security system according to an embodiment. FIG. 7 is a diagram illustrating determining a concentration level from electroencephalograms, where the horizontal axis represents time and the two waveforms represent alpha and beta electroencephalogram waveforms, respectively. FIG. 8 is a diagram illustrating the distribution of consciousness states based on the results of emotional analysis. FIG. 9 is a diagram illustrating an example of a myoelectric potential waveform during eye movement. FIG. 10 is a diagram illustrating an example of a consciousness state based on the results of patrol accuracy determination of an information terminal according to an embodiment. FIG. 11 is a diagram illustrating an example of a space to be guarded. FIG. 12 is a diagram illustrating an example of operation history information. The configuration and operation of the functional blocks of the security system 1 according to this embodiment will be described with reference to FIGS. 6 to 12.

As shown in FIG. 6, the information terminal 10 has a biosignal acquisition unit 101 (first acquisition unit), a feature calculation unit 102 (calculation unit), a concentration analysis unit 103 (an example of an analysis unit), an emotion analysis unit 104 (an example of an analysis unit), an eye movement analysis unit 105 (an example of an analysis unit), a patrol accuracy determination unit 106 (accuracy determination unit), a security information acquisition unit 107 (second acquisition unit), an operation history generation unit 108 (generation unit), a reduced accuracy area extraction unit 109 (extraction unit), a feedback processing unit 110, a memory unit 111, and an input unit 112.

The biological signal acquisition unit 101 is a functional unit that acquires biological signals such as brain waves of the patrolman measured by an electroencephalograph E built into a helmet H worn by the patrolman via a short-range communication circuit 411. The biological signal acquisition unit 101 outputs the acquired biological signals such as brain waves to the feature calculation unit 102.

The feature calculation unit 102 is a functional unit that calculates predetermined feature amounts from biosignals such as electroencephalograms acquired by the biosignal acquisition unit 101. Examples of predetermined feature amounts include the frequency of electroencephalograms, myoelectric potentials, frequency characteristics obtained by FFT (Fast Fourier Transformation), and frequency components containing time information obtained by wavelet transformation. Furthermore, the waveform information of electroencephalograms themselves may be used as feature amounts. The feature calculation unit 102 outputs the calculated feature amounts to the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105.

The concentration level analysis unit 103 is a functional unit that determines the concentration level of the patrol member by analyzing the frequency components of the brain waves as features received from the feature calculation unit 102. For example, as shown in FIG. 7, the concentration level analysis unit 103 compares the intensity of alpha waves in the frequency components of 8 to 13 Hz with the intensity of beta waves in the frequency components of 14 to 30 Hz, and determines that the concentration level is a "concentrated state" if the intensity of beta waves is higher than that of alpha waves, and determines that the concentration level is a "distracted state (relaxed state)" if the intensity of alpha waves is higher than that of beta waves. The concentration level analysis unit 103 outputs the determined concentration level to the patrol accuracy determination unit 106.

The emotion analysis unit 104 is a functional unit that determines arousal (Arousal) and emotionality (Valence) by analyzing the features received from the feature calculation unit 102. Here, arousal refers to a numerical value that represents the level of consciousness, and is expressed as a numerical value between -1 (low level of consciousness) and +1 (high level of consciousness). Furthermore, emotionality refers to a numerical value that represents the level of emotion, and is expressed as a numerical value between -1 (negative emotion) and +1 (positive emotion).

As shown in Figure 8, the emotional state of the patrolman can be understood by plotting the arousal level and emotional level determined by the emotional analysis unit 104, with arousal level on the vertical axis and emotional level on the horizontal axis. For example, as shown in Figure 8, emotional area AR1, where arousal level is high and emotional level is low, can be understood to be an emotional state indicating "strong fear," and emotional area AR2, where arousal level is low and emotional level is close to 0, can be understood to be an emotional state indicating "lethargy."

The emotion analysis unit 104 outputs the determined arousal level and emotion level to the navigation accuracy determination unit 106.

The eye movement analysis unit 105 is a functional unit that determines the state of the patrol's eye movement by analyzing the myoelectric potential (EMG) as a feature acquired from the feature calculation unit 102. For example, the eye movement analysis unit 105 can grasp the degree of visual confirmation by the patrol member by measuring the number of eye movements per unit time as the state of eye movement. When a patrol member looks at various locations, they frequently change their viewpoint, increasing the number of eye movements. For example, as shown in Figure 9, by analyzing the waveforms of myoelectric potential obtained from electrodes on multiple channels (Ch1 to Ch4 in Figure 9), it is possible to grasp the rightward, leftward, upward, downward, blinking, and other eye movements. Note that while the feature calculation unit 102 determines the myoelectric potential from electroencephalograms, this is not limited to this and the myoelectric potential may be obtained directly from electrodes of an electromyograph placed around the neck or eyes. The eye movement analysis unit 105 outputs the determined state of eye movement to the patrol accuracy determination unit 106.

The patrol accuracy determination unit 106 is a functional unit that determines the patrol member's state of consciousness based on the concentration level determined by the concentration level analysis unit 103, the arousal level and emotional level determined by the emotion analysis unit 104, and the state of eye movement determined by the eye movement analysis unit 105, and comprehensively determines the patrol member's patrol accuracy based on the determined state of consciousness. Here, the state of consciousness refers to the patrol member's overall state of consciousness, indicating their state of concentration and emotional state. Note that the above-mentioned concentration level, arousal level, emotional level, and state of eye movement can also be considered to indicate the state of consciousness, and the concentration level analysis unit 103, emotional level analysis unit 104, and eye movement analysis unit 105 can be said to analyze the patrol member's state of consciousness. For example, the patrol accuracy determination unit 106 determines that the patrol member's patrol accuracy is high if the patrol member has a high level of concentration, moderate emotional states of anxiety and fear, and frequent eye movement. On the other hand, the tour accuracy determination unit 106 determines that the tour accuracy of the visitor is low if the level of concentration is low, the emotional state is low in arousal level and the emotional level is inappropriate, or there is little eye movement.

Furthermore, as shown in FIG. 10, the cycling accuracy determination unit 106 may determine the cycling accuracy by categorizing the state of consciousness, such as "apathy," "distracted," "fear," "drowsiness," and "normal." The cycling accuracy determination unit 106 outputs the result of the determination of cycling accuracy to the operation history generation unit 108 and the feedback processing unit 110. Note that in this case, the result of the determination of cycling accuracy may include the time at which the determination was made by the cycling accuracy determination unit 106.

Note that the information terminal 10 is not limited to being provided with all of the analysis functions of the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105 described above, and may have at least one of the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105, as long as a certain degree of accuracy can be obtained as a result of the navigation accuracy determination by the navigation accuracy determination unit 106.

The security information acquisition unit 107 is a functional unit that acquires security information from the management server 20 via the long-distance communication circuit 410. The security information includes identification information indicating the installation location of the sensor that detected a patrolman, among the various sensors that make up the security terminal ST located in the guarded space STS, and the time of detection, and is information indicating that a patrolman was detected by that sensor. As described above, various sensors that make up the security terminal ST, such as human sensors, cameras, or door sensors, are installed in various locations in the guarded space STS, and it is possible to detect in which areas within the guarded space STS a person or the like is present.

For example, in the example of the guarded space STS shown in Figure 11, the security terminals ST include a door sensor ST-D1 that detects the opening and closing of the entrance door of the guarded space STS to detect the presence of a person near the entrance door, door sensors ST-D2 and ST-D3 installed on the doors of each room, and ST-D4 installed on the exit door. These door sensors ST-D1 to ST-D4 indirectly detect patrols by detecting the opening and closing of doors. Furthermore, security terminals ST are located in various locations and rooms of the guarded space STS, including motion sensors ST-M1 and ST-M2 that detect patrols, and cameras ST-C1 and ST-C2 that detect patrols by capturing images. For example, when camera ST-C1 detects a patrol person based on the captured image, it transmits detection information indicating the detection to the monitoring center's management server 20 via a communication device constituting the security terminal ST. The detection information may include, for example, identification information indicating the installation location of the sensor that detected the patrol. As described below, security information is information based on the detection information.

The security information acquisition unit 107 outputs the acquired security information to the operation history generation unit 108.

The operation history generation unit 108 is a functional unit that generates operation history information based on the patrol accuracy determination result by the patrol accuracy determination unit 106 and the security information acquired by the security information acquisition unit 107.

Specifically, the operation history generation unit 108 compares the time included in the patrol accuracy determination result with the time included in the security information, and generates operation history information by using the patrol accuracy determination result and security information that match (or are deemed to match) to associate the time (detection time shown in FIG. 12 ), the identification information included in the security information (sensor shown in FIG. 12 ), and the patrol accuracy determination result (patrol accuracy result shown in FIG. 12 ). The patrol accuracy result shown in FIG. 12 categorizes the patrol person's state of consciousness. The operation history information shown in FIG. 12 associates, for example, the detection time "03:52:10," the identification information "DDD," and the patrol accuracy result "apathetic." This allows the user to recognize that the patrol person was detected by the sensor installed at the position indicated by the identification information "DDD" at time "03:52:10," and was patrolling in a state of "apathetic" consciousness.

The operation history generation unit 108 then stores the generated operation history information in the storage unit 111. Note that the operation history generation unit 108 may output the generated operation history information directly to the accuracy degradation area extraction unit 109.

The accuracy-decreasing area extraction unit 109 is a functional unit that references the operation history information stored in the memory unit 111 and extracts areas in the guarded space STS where patrol accuracy is low, i.e., areas where patrol accuracy has decreased and is not normal, based on the patrol accuracy determination results (patrol accuracy results) of the operation history information. For example, in the example of operation history information shown in FIG. 12, the accuracy-decreasing area extraction unit 109 extracts, as areas with low patrol accuracy, the area around the installation location of the sensor whose patrol accuracy result is "drowsy" and whose identification information is "AAA," and the area around the installation location of the sensor whose patrol accuracy result is "lethargy" and whose identification information is "DDD." Note that the accuracy-decreasing area extraction unit 109 is not limited to referencing the operation history information stored in the memory unit 111, but may also directly receive and use the operation history information generated by the operation history generation unit 108. The accuracy-decreasing area extraction unit 109 outputs information on the extracted areas to the feedback processing unit 110.

The feedback processing unit 110 is a functional unit that executes predetermined feedback processing based on the results of the tour accuracy determination by the tour accuracy determination unit 106 and information on areas with low tour accuracy extracted by the low-accuracy area extraction unit 109. It is desirable that this feedback processing by the feedback processing unit 110 be executed in real time. For example, as feedback processing, the feedback processing unit 110 displays information on areas with low tour accuracy extracted by the low-accuracy area extraction unit 109 on the display 415. This makes it possible to encourage the visitor to visit the areas with low tour accuracy again.

Furthermore, if the patrol accuracy determination unit 106 determines that the patrol accuracy is "drowsy," for example, the feedback processing unit 110 may provide feedback by vibrating the vibrator 417 (an example of an output device) to instruct the patrol member to improve their state of consciousness. This can encourage the patrol member to improve their state of consciousness, such as drowsiness. Depending on the situation, the instruction to improve their state of consciousness may be displayed on the display 415 (an example of an output device) or output as audio from the speaker 413 (an example of an output device). Furthermore, if the patrol accuracy determination unit 106 determines that the patrol member is "fear" (an example of a predetermined state of consciousness), the feedback processing unit 110 may determine that a dangerous situation has been encountered and send an emergency call to the management server 20 of the monitoring center via the long-distance communication circuit 410. This can improve the chances of avoiding danger to the patrol member or make it possible to call for additional help in the situation.

The memory unit 111 is a functional unit that stores various information, such as the operation history information generated by the operation history generation unit 108. Note that the information stored in the memory unit 111 is not limited to operation history information, and it may also store information generated or acquired by the above-mentioned functional units (e.g., information on the results of analysis by the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105). The memory unit 111 is realized by the RAM 403 or EEPROM 404 shown in Figure 4.

The input unit 112 is a functional unit that accepts operational inputs to the information terminal 10. For example, when a patrol person starts patrolling the security target space STS, the patrol person may input this information via the input unit 112, which may then be transmitted to the management server 20 via the long-distance communication circuit 410. The input unit 112 is implemented by the touch panel 418 shown in Figure 4.

The above-mentioned biosignal acquisition unit 101, feature calculation unit 102, concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, patrol accuracy determination unit 106, security information acquisition unit 107, operation history generation unit 108, accuracy degradation area extraction unit 109, and feedback processing unit 110 are realized by the CPU 401 shown in FIG. 4 executing a program. Note that this program may be a native application installed directly on the information terminal 10, or a web application running on a web browser. Furthermore, at least some of these functional units may be realized by hardware circuits such as an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

Furthermore, the functional units of the information terminal 10 shown in FIG. 6 are conceptual representations of functions, and are not limited to this configuration. For example, the multiple functional units shown as independent functional units in the information terminal 10 shown in FIG. 6 may be configured as a single functional unit. On the other hand, the functions of a single functional unit in the information terminal 10 shown in FIG. 6 may be divided into multiple units and configured as multiple functional units.

As shown in FIG. 6, the management server 20 has a detection information acquisition unit 201, a security information transmission unit 202, and a memory unit 203.

The detection information acquisition unit 201 is a functional unit that acquires, via the network N and the network I/F 508, detection information indicating that the presence of a human or the like has been detected from a security terminal ST installed in the guarded space STS. The detection information may include, for example, identification information of the sensor that performed the detection. This detection information makes it possible to recognize in real time which area of the guarded space STS the patrol person is in. The detection information acquisition unit 201 outputs the acquired detection information to the security information transmission unit 202. The detection information acquisition unit 201 may also store the acquired detection information in the memory unit 203.

The security information transmission unit 202 is a functional unit that generates security information including the sensor identification information contained in the detection information acquired by the detection information acquisition unit 201 and the time at which the detection information acquisition unit 201 acquired the detection information, and transmits the security information to the information terminal 10 via the network I/F 508. Note that the detection information may include the time at which the security terminal ST made the detection, and the security information transmission unit 202 may include the time contained in the detection information in the security information. The security information transmission unit 202 may also generate security information using detection information stored in the memory unit 203.

The storage unit 203 is a functional unit that stores (accumulates) the detection information acquired by, for example, the detection information acquisition unit 201. The storage unit 203 is realized by the auxiliary storage device 505 shown in Figure 5.

The detection information acquisition unit 201 and security information transmission unit 202 described above are realized by the CPU 501 shown in FIG. 5 executing a program. Furthermore, at least some of these functional units may be realized by hardware circuits such as FPGAs or ASICs.

Furthermore, the functional units of the management server 20 shown in Figure 6 are conceptual representations of functions, and are not limited to this configuration. For example, the multiple functional units shown as independent functional units in the management server 20 shown in Figure 6 may be configured as a single functional unit. On the other hand, the functions of a single functional unit in the management server 20 shown in Figure 6 may be divided into multiple units and configured as multiple functional units.

(Flow of patrol work by patrol personnel)
13 is a flowchart showing an example of the flow of patrol work when the security system according to the embodiment is used. The flow of patrol work by a patrol person will be described with reference to FIG.

First, a patrolman wearing a helmet H with an internal electroencephalograph E and carrying an information terminal 10 arrives at the security space STS, which is the site to be patrolled (step S11). Biological signals such as brain waves of the patrolman wearing the helmet are acquired by the information terminal 10 via short-range wireless communication.

The patrol person then operates the input unit 112 of the information terminal 10 to input a command to start patrol, which causes the command to be transmitted to the management server 20 via the long-distance communication circuit 410, thereby commencing patrol of the security target space STS (step S12). As part of the patrol, the patrol person first inspects the perimeter of the security target space STS (step S13). After inspecting the perimeter, the patrol person enters the security target space STS (step S14). In this case, for example, in the case of the security target space STS shown in FIG. 11, when the entrance door is opened and the patrol person enters the security target space STS, the door sensor ST-D1 detects that the entrance door is open and transmits detection information indicating this to the management server 20. By receiving this detection information, the management server 20 can recognize that the patrol person has entered the security target space STS.

The patrol then proceeds to inspect the interior of the security space STS (step S15). The information terminal 10 then analyzes biological signals such as brain waves acquired from the patrol patrolling the security space STS, and acquires detection information from sensors installed in various locations within the security space STS, while performing an accuracy determination process to determine the patrol accuracy of each area within the security space STS and provide feedback of the determination results to the patrol (step S16). Details of the flow of the accuracy determination process performed by the security system 1 will be described later in Figure 14.

When the patrol finishes patrolling the security space STS (step S17), the patrol leaves the security space STS (step S18). At this time, for example, in the case of the security space STS shown in FIG. 11, when the patrol opens the exit door and leaves the security space STS, the door sensor ST-D4 detects that the exit door is open and transmits detection information indicating this to the management server 20. The patrol then inputs a signal to the effect that the patrol is finished via the input unit 112 of the information terminal 10, which causes this signal to be transmitted to the management server 20 via the long-distance communication circuit 410.

Patrol work is carried out by the patrol personnel through the flow of steps S11 to S18 above.

(Accuracy determination process flow)
Fig. 14 is a flowchart showing an example of the flow of the accuracy determination process of the security system according to the embodiment. The flow of the accuracy determination process by the security system 1 according to the embodiment will be described with reference to Fig. 14. The accuracy determination process shown in Fig. 14 corresponds to the process of step S16 shown in Fig. 13.

<Step S161>
When a patrol person starts patrolling the guarded space STS, the biosignal acquisition unit 101 of the information terminal 10 starts acquiring biosignals such as the patrol person's brain waves measured by the electroencephalograph E built into the helmet H worn by the patrol person via the short-range communication circuit 411. The timing at which the biosignal acquisition unit 101 starts acquiring biosignals may be, for example, the timing when the patrol person sends a notice to start patrol to the management server 20, the timing when the information terminal 10 receives a response from the management server 20 after sending a notice to start patrol, or the timing when a detection signal from the door sensor ST-D1 is sent to the management server 20 upon entry into the guarded space STS and security information based on the detection signal is received by the information terminal 10.

Also, at this timing, the security information acquisition unit 107 of the information terminal 10 begins acquiring security information from the management server 20 via the long-distance communication circuit 410. Specifically, when various sensors installed within the guarded space STS detect a patrol person, detection information including identification information indicating the installation location of the sensor is transmitted to the management server 20 via the network N. The detection information acquisition unit 201 of the management server 20 acquires the detection information from the security terminal ST via the network N and the network I/F 508 and outputs it to the security information transmission unit 202. The security information transmission unit 202 generates security information including identification information indicating the installation location of the sensor contained in the detection information acquired by the detection information acquisition unit 201 and the time when the detection information acquisition unit 201 acquired the detection information, and transmits the security information to the information terminal 10 via the network I/F 508. This enables the security information acquisition unit 107 of the information terminal 10 to acquire security information. The security information acquisition unit 107 then outputs the acquired security information to the operation history generation unit 108.

Then, proceed to step S162.

<Step S162>
The feature amount calculation unit 102 of the information terminal 10 calculates a predetermined feature amount from the biosignal, such as an electroencephalogram, acquired by the biosignal acquisition unit 101. The feature amount calculation unit 102 then outputs the calculated feature amount to the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105. Then, the process proceeds to steps S163 to S165. That is, the processes of steps S163 to S165 are executed in parallel.

<Step S163>
The concentration level analysis unit 103 of the information terminal 10 determines the concentration level of the patrol member by analyzing the frequency components of the brain waves as the features received from the feature calculation unit 102. For example, the concentration level analysis unit 103 compares the intensity of alpha waves with the intensity of beta waves in the frequency components, and determines the concentration level to indicate a state of concentration if the intensity of beta waves is higher than that of alpha waves, and determines the concentration level to indicate a state of distraction (relaxation) if the intensity of alpha waves is higher than that of beta waves. The concentration level analysis unit 103 outputs the determined concentration level to the patrol accuracy determination unit 106. Then, the process proceeds to step S166.

<Step S164>
The emotion analysis unit 104 of the information terminal 10 determines the level of arousal and the level of emotion by analyzing the feature amounts received from the feature amount calculation unit 102. The emotion analysis unit 104 outputs the determined level of arousal and the level of emotion to the navigation accuracy determination unit 106. Then, the process proceeds to step S166.

<Step S165>
The eye movement analysis unit 105 of the information terminal 10 determines the state of the eye movement of the visitor by analyzing the myoelectric potential as a feature acquired from the feature calculation unit 102. For example, the eye movement analysis unit 105 can grasp the degree of visual confirmation by the visitor by measuring the number of eye movements per unit time as the state of eye movement. The eye movement analysis unit 105 outputs the determined state of eye movement to the visit accuracy determination unit 106. Then, the process proceeds to step S166.

<Step S166>
The patrol accuracy determination unit 106 of the information terminal 10 determines the patrol member's state of consciousness based on the concentration level determined by the concentration level analysis unit 103, the arousal level and emotional level determined by the emotional analysis unit 104, and the state of eye movement determined by the eye movement analysis unit 105, and comprehensively determines the patrol member's patrol accuracy based on the state of consciousness. For example, the patrol accuracy determination unit 106 determines that the patrol member's patrol accuracy is high if the patrol member has a high concentration level, an emotional state showing moderate anxiety or fear, and frequent eye movement. On the other hand, the patrol accuracy determination unit 106 determines that the patrol member's patrol accuracy is low if the patrol member has a low concentration level, an emotional state showing low arousal level and an inappropriate emotional level, or frequent eye movement. The patrol accuracy determination unit 106 may also determine the patrol accuracy by categorizing the state of consciousness, such as "apathy,""distracted,""fear,""drowsiness," and "normal." The cycling accuracy determination unit 106 outputs the determination result of the cycling accuracy to the operation history generation unit 108 and the feedback processing unit 110. Then, the process proceeds to step S167.

<Step S167>
Then, the operation history generating unit 108 of the information terminal 10 generates operation history information based on the result of the patrol accuracy determination by the patrol accuracy determining unit 106 and the security information acquired by the security information acquiring unit 107 .

Specifically, the operation history generation unit 108 compares the time included in the patrol accuracy determination result with the time included in the security information, and generates operation history information by using the patrol accuracy determination result and security information that match (or are deemed to match) to associate that time (detection time), the identification information included in the security information, and the patrol accuracy determination result (patrol accuracy result).

The operation history generation unit 108 then stores the generated operation history information in the storage unit 111. Then, the process proceeds to step S168.

<Step S168>
The accuracy-decreasing area extraction unit 109 of the information terminal 10 references the operation history information stored in the memory unit 111 and extracts areas in the guarded space STS where patrol accuracy is low based on the patrol accuracy determination result of the operation history information (patrol accuracy result). For example, in the example of operation history information shown in FIG. 12, the accuracy-decreasing area extraction unit 109 extracts, as areas where patrol accuracy is low, the area around the installation location of the sensor where the patrol accuracy result is "drowsiness" and where the identification information is "AAA," and the area around the installation location of the sensor where the patrol accuracy result is "lethargy" and where the identification information is "DDD." The accuracy-decreasing area extraction unit 109 outputs information about the extracted areas to the feedback processing unit 110. Then, the process proceeds to step S169.

<Step S169>
The feedback processing unit 110 of the information terminal 10 executes a predetermined feedback process based on the result of the determination of the navigation accuracy by the navigation accuracy determination unit 106 and information on the area with low navigation accuracy extracted by the accuracy-degraded area extraction unit 109. For example, as the feedback process, the feedback processing unit 110 displays information on the area with low navigation accuracy extracted by the accuracy-degraded area extraction unit 109 on the display 415. Furthermore, when the result of the determination of the navigation accuracy by the navigation accuracy determination unit 106 is, for example, "drowsiness," the feedback processing unit 110 may issue an instruction to improve the state of consciousness by vibrating the vibrator 417. Depending on the situation, the instruction to improve the state of consciousness may be displayed on the display 415 or output as a voice from the speaker 413. Furthermore, when the result of the determination of the navigation accuracy by the navigation accuracy determination unit 106 is, for example, "fear," the feedback processing unit 110 may determine that a dangerous situation has been encountered and may issue an emergency call to the management server 20 of the monitoring center via the long-distance communication circuit 410.

The accuracy determination process by the security system 1 is performed through the flow of steps S161 to S169 described above. This accuracy determination process by the security system 1 is repeatedly performed from the start to the end of the patrol of the security target space STS by the patrol personnel.

As described above, in the security system 1 according to this embodiment, the biosignal acquisition unit 101 acquires biosignals related to a patrolman from an electroencephalograph E that detects the biosignals; when a patrolman is detected by one or more security terminals ST installed in the guarded space STS that is to be patrolled by the patrolman, the security information acquisition unit 107 acquires security information including at least information (identification information, etc.) related to the sensor that detected the patrolman; the feature calculation unit 102 calculates predetermined feature amounts from the biosignals acquired by the biosignal acquisition unit 101; at least one of the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105 analyzes the state of consciousness of the patrolman based on the feature amounts calculated by the feature calculation unit 102; the patrol accuracy determination unit 106 determines the patrol accuracy of the patrolman based on the analysis results; and the operation history generation unit 108 generates operation history information that associates at least the sensor information (identification information, etc.) indicated by the security information with the determination result of the patrol accuracy by the patrol accuracy determination unit 106. In this way, by generating operation history information that associates the patrol accuracy of the patrol person with the detection results of the sensor, patrol accuracy can be efficiently maintained.

Furthermore, in the security system 1 according to this embodiment, the accuracy-decreasing area extraction unit 109 extracts areas in the security target space STS where patrol accuracy has decreased and is abnormal, based on operation history information. In this way, by extracting areas from the security target space STS where patrol accuracy has decreased and is determined to be abnormal, the patrol person can be notified of the area and encouraged to patrol again.

Furthermore, in the security system 1 according to this embodiment, the feedback processing unit 110 displays information about the areas extracted by the accuracy-decreasing area extraction unit 109 on the display 415. This allows the patrol personnel to recognize areas where patrol accuracy has decreased, and by patrolling those areas again, patrol accuracy can be efficiently maintained.

In addition, in the security system 1 according to this embodiment, if the patrol accuracy determination unit 106 determines that the patrol accuracy is low and abnormal, the feedback processing unit 110 outputs instructions to improve the patrol member's state of consciousness to an output device such as the display 415, vibrator 417, or speaker 413. This allows the patrol member to improve their state of consciousness, and patrol accuracy can be efficiently maintained.

Furthermore, in the security system 1 according to this embodiment, the feedback processing unit 110 sends an emergency call to the management server 20 when the patrol accuracy determination result from the patrol accuracy determination unit 106 indicates a predetermined state of consciousness (fear, etc.). This makes it possible to improve the possibility of avoiding danger to patrol personnel, or to call for new helpers in response to the situation.

In the security system 1 according to this embodiment, the identification information indicates the installation location of the sensor, but the allocation information assigned to each sensor may also be used as the identification information and transmitted from the security terminal ST to the management server 20. In this case, the management server 20 pre-stores a plan view of the guarded space recording the installation location of each sensor, and upon receiving detection information from the security terminal ST, transmits security information including the identification information (assigned information) and the plan view of the guarded space to the information terminal 10. The information terminal 10 that receives this security information generates operation history information using the allocation information as identification information, and displays the allocation information (assigned information when patrol accuracy was low) and the plan view of the guarded space included in the security information on the display 415, allowing the patrol person to confirm the installation location of the sensor corresponding to the allocation information and recognize that patrol accuracy near that sensor has decreased.

The management server 20 may also store in advance the location where each sensor is installed for each piece of allocation information. In this case, the management server 20 determines the installation location of the corresponding sensor based on the received identification information, and includes the determined installation location information as identification information in the security information before transmitting it. This allows the information terminal 10 to generate operation history information based on the security information.

(Modification)
A security system 1 according to a modification of the above-described embodiment will be described, focusing on the differences from the security system 1 according to the above-described embodiment. In the above-described embodiment, all functions constituting the accuracy determination process, except for the function of receiving detection information from the security terminal ST and transmitting security information to the information terminal 10, were described as operations realized by the information terminal 10. In this modification, the analysis process by the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105, and the patrol accuracy determination process by the patrol accuracy determination unit 106 will be described as operations realized using a learning model generated by machine learning. Note that the overall configuration of the security system 1 according to this modification, and the hardware configurations of the information terminal 10 and the management server 20, are the same as those described in the above-described embodiment.

In a security system according to a modified example, some functions are replaced by processing using a learning model based on machine learning. The configuration and operation of the security system 1 according to this modified example will be described below.

The management server 20 has the same functions as the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and tour accuracy determination unit 106. The management server 20 acquires biosignals, such as electroencephalograms, from the tour participant in advance, and creates training data based on the features calculated from the biosignals, with the results of the tour accuracy determined by the concentration analysis unit, emotion analysis unit, eye movement analysis unit, and tour accuracy determination unit as labels. It then generates a learning model through machine learning (supervised learning) based on the training data. In other words, the learning model is a model generated using the features of the biosignals as explanatory variables and the results of the tour accuracy determination as objective variables. In this case, well-known algorithms such as SVM (Support Vector Machine), random forest, decision tree, neural network, and GBDT (Gradient Boosting Decision Tree) can be used as the machine learning algorithm.

Note that, while the feature quantities of biosignals such as electroencephalograms are used as explanatory variables, this is not limited to this, and a learning model may be generated using the biosignals themselves as explanatory variables. Furthermore, the learning model is not limited to being generated by the management server 20, and a learning model generated by an external device may be operated on the management server 20.

The management server 20 then receives, via network N, feature amounts calculated by the feature amount calculation unit 102 from the biosignals acquired by the biosignal acquisition unit 101 in the information terminal 10, inputs the feature amounts as sample data into the learning model, and acquires the patrol accuracy judgment result as output. The management server 20 then transmits the acquired patrol accuracy judgment result to the information terminal 10 via network N. The operation history generation unit 108 of the information terminal 10 then generates operation history information using the received patrol accuracy judgment result and security information separately received from the management server 20. Other operations are the same as those of the security system 1 according to the above-described embodiment.

In other words, the functions of the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and patrol accuracy determination unit 106 of the information terminal 10 according to the above-described embodiment are replaced by a learning model operated on the management server 20. This achieves the same effects as those achieved by the security system 1 according to the above-described embodiment, and by replacing some of the functions of the information terminal 10 with the learning model of the management server 20, the processing load on the information terminal 10 can be reduced. Furthermore, by improving the accuracy of the learning process for constructing the above-described learning model, the accuracy of the patrol accuracy determination process can be improved.

Note that, while the functions of the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and patrol accuracy determination unit 106 of the information terminal 10 are replaced by the management server 20 using a learning model based on machine learning, this is not limited to this. For example, by replacing only the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105 with the learning model of the management server 20, the concentration level, arousal level, emotion level, and eye movement state can be output using the learning model, and the patrol accuracy determination can be performed by the information terminal 10. Furthermore, this is not limited to using a learning model, and some of the functions of the information terminal 10 may simply be replaced by the management server 20. Furthermore, the functions of the management server 20, namely the functions of the detection information acquisition unit 201 and the security information transmission unit 202, can also be replaced by the information terminal 10.

In the above-described embodiments and variations, if at least one of the functional units of the information terminal 10 and the management server 20 is realized by executing a program, the program is provided pre-installed in a ROM or the like. Furthermore, in the above-described embodiments and variations, the programs executed by the information terminal 10 and the management server 20 may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), a flexible disk (FD), a CD-R (Compact Disk-Recordable), or a DVD (Digital Versatile Disc). Furthermore, in the above-described embodiments and variations, the programs executed by the information terminal 10 and the management server 20 may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Furthermore, in the above-described embodiments and variations, the programs executed by the information terminal 10 and management server 20 may be configured to be provided or distributed via a network such as the Internet. Furthermore, in the above-described embodiments and variations, the programs executed by the information terminal 10 and management server 20 have a modular configuration including at least one of the above-described functional units, and in terms of actual hardware, the CPU 401, CPU 501 reads and executes the programs from the above-described storage devices (e.g., ROM 402, EEPROM 404, auxiliary storage device 505, etc.), causing the above-described functional units to be loaded and generated in the main storage devices (RAM 403, RAM 503).

REFERENCE SIGNS LIST 1 Security system 10 Information terminal 20 Management server 101 Biometric signal acquisition unit 102 Feature amount calculation unit 103 Concentration analysis unit 104 Emotion analysis unit 105 Eye movement analysis unit 106 Patrol accuracy determination unit 107 Security information acquisition unit 108 Operation history generation unit 109 Accuracy reduction area extraction unit 110 Feedback processing unit 111 Memory unit 112 Input unit 201 Detection information acquisition unit 202 Security information transmission unit 203 Memory unit 401 CPU
402 ROM
403 RAM
404 EEPROM
405 Imaging unit 406 Imaging I/F
407 Acceleration and direction sensor 408 GPS receiver 409 Bus line 410 Long-distance communication circuit 410a Antenna 411 Short-distance communication circuit 411a Antenna 412 Microphone 413 Speaker 414 Sound input/output I/F
415 Display 416 External device connection I/F
417 Vibrator 418 Touch panel 501 CPU
502 ROM
503 RAM
505 Auxiliary storage device 508 Network I/F
509 Display 510 Bus line 511 Keyboard 512 Mouse AR1, AR2 Emotional area E Electroencephalograph H Helmet N Network ST Security terminal STS Security target space ST-C1, ST-C2 Camera ST-M1, ST-M2 Human presence sensor ST-D1, ST-D2, ST-D3 Door sensor

Claims (8)

a first acquisition unit that acquires a biological signal related to the visitor from a measurement device that detects the biological signal;
a second acquisition unit that acquires security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in a security target space that is the target of patrol by the patrol person;
a calculation unit that calculates a predetermined feature amount from the biological signal acquired by the first acquisition unit;
an analysis unit that analyzes the state of consciousness of the patrolman based on the feature amount calculated by the calculation unit;
an accuracy determination unit that determines the patrol accuracy of the patrol person based on the analysis result by the analysis unit;
a generating unit that generates operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy by the accuracy determining unit;
A security system equipped with The security system of claim 1 further comprises an extraction unit that extracts areas in the security target space where the patrol accuracy is abnormal based on the operation history information. The security system described in claim 2, further comprising a feedback processing unit that displays information about the area extracted by the extraction unit on a display device. The security system described in claim 3, wherein the feedback processing unit causes an output device to output instructions to improve the patrol person's state of consciousness if the accuracy determination unit determines that the patrol accuracy is not normal. The security system described in claim 3 or 4, wherein the feedback processing unit issues an emergency call to a higher-level device when the accuracy determination unit's determination of the patrol accuracy indicates a predetermined state of consciousness. The security system described in any one of claims 1 to 5, wherein the analysis unit includes at least one of: a concentration analysis unit that determines the patrolman's concentration level by analyzing the feature amount; an emotion analysis unit that determines the patrolman's level of arousal and emotionality by analyzing the feature amount; and an eye movement analysis unit that determines the patrolman's eye movement state by analyzing the myoelectric potential as the feature amount. a first acquisition step of acquiring a biological signal related to the visitor from a measurement device that detects the biological signal;
a second acquisition step of acquiring security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in the security target space that is the target of patrol by the patrol person;
a calculation step of calculating a predetermined feature amount from the acquired biological signal;
an analysis step of analyzing the state of consciousness of the visitor based on the calculated feature amount;
an accuracy determination step of determining the accuracy of the visitor's visit based on the results of the analysis;
a generating step of generating operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy;
A security method having the above. On the computer,
a first acquisition step of acquiring a biological signal related to the visitor from a measurement device that detects the biological signal;
a second acquisition step of acquiring security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in the security target space that is the target of patrol by the patrol person;
a calculation step of calculating a predetermined feature amount from the acquired biological signal;
an analysis step of analyzing the state of consciousness of the visitor based on the calculated feature amount;
an accuracy determination step of determining the patrol accuracy of the patrol person based on the result of the analysis;
a generating step of generating operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy;
A program to execute.