JP4492062B2 - Monitoring system, information processing apparatus and method, recording medium, and program - Google Patents

Description

  The present invention relates to a monitoring system, an information processing apparatus and method, a recording medium, and a program, and more particularly, to a monitoring system, an information processing apparatus and method, a recording medium, and a program that can efficiently reduce power consumption. .

  Conventionally, in a monitoring system, a method has been proposed in which a plurality of different types of sensors are provided and information of each sensor is displayed (see, for example, Patent Document 1).

  Also, a method for detecting a human body that has entered a monitoring area by combining an infrared sensor and an image sensor has been proposed (see, for example, Patent Document 2).

Furthermore, a system has been proposed in which a monitoring camera is provided with a moving body sensor to detect abnormal movement in the monitoring area, and an output signal of the monitoring camera is controlled according to the detection output of the moving body sensor (for example, a patent). Reference 3).
Japanese Patent Laid-Open No. 8-124078 JP 2000-339554 A JP-A-7-212748

  However, in these inventions, regardless of whether or not the user contributes to the detection of an event that requires notification, a plurality of sensors including the camera are constantly operating, consuming wasteful power, There was a problem of having only a short time.

  The present invention has been made in view of such a situation, and is capable of efficiently suppressing power consumption.

The monitoring system of the present invention includes an event detection means for detecting the occurrence of an event based on data output from a plurality of sensors, a presentation control means for controlling the presentation of an event detected by the event detection means, and a presentation control means. Input acquisition means for acquiring a determination input by the user whether or not notification of an event presented based on the control of the user is necessary, and the probability that each sensor has detected an event determined to be notification by the user based on provided with a capability determination means for determining a capacity of a plurality of sensors, based on the determination result of the capability determination unit, and a power supply control means for executing the respective on or off to control a plurality of sensors of the power.

The capability determination means determines whether an event for which the user needs to be notified based on whether or not the probability of detecting an event determined to be required by the user for each of the plurality of sensors is equal to or greater than a predetermined threshold. The power supply control means executes control to turn off the power of the sensor determined to have no ability to detect an event for which the user needs to be notified. be able to.

The power control unit is configured to execute control to turn off the power of the sensors other than the sensor with the least power consumption, which is determined to have an ability of detecting an event that requires notification by the user among the plurality of sensors. Can be.
When the event detection unit detects the occurrence of an event, the power control unit executes control to turn on the sensor when the sensor capable of detecting the event with the largest amount of information is turned off. can do.

The event detection means , the presentation control means, the input acquisition means, the ability determination means, and the power supply control means are arranged separately in either the first information processing apparatus or the second information processing apparatus. Can do.

The event detection unit and the power supply control unit may be disposed in the first information processing apparatus, and the presentation control unit, the ability determination unit, and the input acquisition unit may be disposed in the second information processing apparatus. .

The power supply control means can be arranged in the first information processing apparatus, and the presentation control means, the ability determination means, the input acquisition means and the event detection means can be arranged in the second information processing apparatus.

According to a first information processing method of the present invention, an event detection step in which a monitoring system detects the occurrence of an event based on data output from a plurality of sensors, and an event detected by the process of the event detection step are presented. A presentation control step to be controlled, an input acquisition step for obtaining an input of judgment by the user as to whether or not notification of an event presented by the processing of the presentation control step is necessary, and an event for which notification is judged to be necessary by the user the based on the probability of detection by each sensor, the power to run the capability determination step of determining the ability of a plurality of sensors, based on the capability determination step of the determination result, the respective oN or oFF controlling a plurality of sensors of the power Control steps .

The first program of the present invention includes an event detection step for detecting the occurrence of an event based on data output from a plurality of sensors, and a presentation control step for controlling the presentation of the event detected by the processing of the event detection step. Each sensor detects an input acquisition step for acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary, and an event that is determined to be notified by the user based on the probability, the process comprising the capability determination step of determining the ability of a plurality of sensors, based on the capability determination step of determining results, and a power control step of executing the respective on or off to control a plurality of sensors of the power cause the computer to execute.

The first information processing apparatus of the present invention transmits a plurality of sensors and data output by the plurality of sensors to another information processing apparatus, and among the events detected based on the data in the other information processing apparatus Communication means for receiving determination results of the capabilities of a plurality of sensors determined based on the probability that each sensor has detected an event determined to be notified by a user from another information processing apparatus, and a plurality of sensors And a power supply control means for executing control for turning on or off the power supply of each of the plurality of sensors based on the determination result of the ability .
According to a second information processing apparatus of the present invention, an event detection unit that detects occurrence of an event based on data output from a plurality of sensors and generates notification data for notifying the event, and an event detection unit The generated notification data is transmitted to another information processing apparatus, and each sensor detects an event that is determined to be notified by the user from among the events detected by the event detection means in the other information processing apparatus. On the basis of the communication means for receiving the determination results of the plurality of sensors determined based on the probability of being received from other information processing apparatuses and the determination results of the plurality of sensor capacities, respectively. Alternatively, power supply control means for executing control to turn off is provided.

The power supply control unit can execute control to turn off the power of the sensor that is determined not to have the ability of the user to detect an event that requires notification in another information processing apparatus.

The power supply control means turns off the power of the sensors other than the sensor with the least power consumption that is determined to have an ability to detect an event that requires the user to be notified in another information processing apparatus among the plurality of sensors. The control to be performed can be executed.

When the occurrence of an event is detected, the power supply control means can execute control to turn on the power of the sensor that can detect the event with the most information amount when the power of the sensor is turned off. .

According to a second information processing method of the present invention, an information processing apparatus including a plurality of sensors transmits data output from the plurality of sensors to another information processing apparatus, and the other information processing apparatus transmits the data From the other information processing apparatuses, the determination results of the abilities of the plurality of sensors determined based on the probability that each sensor detected an event determined to be notified by the user among the events detected based on comprising a receiving step of, based on the determination result of the ability of a plurality of sensors, and a power control step of executing the respective on or off to control a plurality of sensors of the power.

In the second program of the present invention, a transmission step of transmitting data output from a plurality of sensors to another information processing apparatus, and notification from the user among events detected based on the data in the other information processing apparatus. A reception step for receiving a determination result of the capabilities of a plurality of sensors determined from the probability that each sensor has detected an event determined to be necessary from another information processing apparatus, and a determination of the capabilities of the plurality of sensors based on the results, to execute processing including the power control step of executing the respective on or off to control a plurality of sensors of the power to the computer.
According to a third information processing method of the present invention, an information processing apparatus including a plurality of sensors detects occurrence of an event based on data output from the plurality of sensors, and generates notification data for notifying the event An event detection step, a transmission step for transmitting notification data generated by the event detection step processing to another information processing device, and an event detected by the event detection step processing in the other information processing device. A receiving step for receiving determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be notified by the user from another information processing apparatus; and a plurality of sensors A power control step for performing control to turn on or off the power of each of the plurality of sensors based on the determination result of Including.
According to a third program of the present invention, an event detection step of detecting occurrence of an event based on data output from a plurality of sensors and generating notification data for notifying the event, and processing of the event detection step A transmission step for transmitting the generated notification data to another information processing device, and an event that is determined to be required by the user from among the events detected by the event detection step in the other information processing device A plurality of sensors based on the reception step of receiving the determination results of the capabilities of the plurality of sensors determined from the probabilities detected by the sensors from the other information processing apparatus and the determination results of the capabilities of the plurality of sensors. The computer is caused to execute a process including a power supply control step for executing a control for turning on or off the power supply of the computer.

The third information processing apparatus according to the present invention includes a communication unit that receives data output from a plurality of sensors from another information processing apparatus including a plurality of sensors, and an event based on data received from the other information processing apparatus. By event detection means for detecting the occurrence of the event , presentation control means for controlling the presentation of the event detected by the event detection means, and whether or not notification of the event presented based on the control of the presentation control means is necessary an input acquisition means for acquiring an input of determination, based on the event notification is determined to be required by the user to the probability that the detected each sensor, and a capacity determining means for determining a capacity of a plurality of sensors, communication The means transmits the determination results of the capabilities of the plurality of sensors to another information processing apparatus.
The fourth information processing apparatus of the present invention is a communication for receiving notification data for notifying an event whose occurrence is detected based on data output from a plurality of sensors from another information processing apparatus including a plurality of sensors. An input acquisition unit for acquiring an input of a determination as to whether or not notification of an event presented based on the control of the presentation control unit is necessary; Means for determining the capabilities of a plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user, and the communication means includes the capabilities of the plurality of sensors. The determination result is transmitted to another information processing apparatus.

Further comprising power control means for generating a power control signal for turning on or off the power of each of the plurality of sensors based on the determination results of the capabilities of the plurality of sensors , and the transmitting means replaces the determination results of the capabilities of the plurality of sensors. In addition, the power control signal can be transmitted to another information processing apparatus.

According to a fourth information processing method of the present invention, an information processing apparatus receives a data output from a plurality of sensors from another information processing apparatus including a plurality of sensors, and data received from the other information processing apparatus. The event detection step to detect the occurrence of the event, the presentation control step to control the presentation of the event detected by the processing of the event detection step, and the notification of the event presented by the processing of the presentation control step is necessary An input acquisition step for acquiring an input of determination by the user as to whether or not, and an ability determination step for determining the capabilities of a plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user And a transmission step of transmitting the determination results of the abilities of the plurality of sensors to another information processing apparatus.

According to a fourth program of the present invention , an event is generated based on a reception step of receiving data output from a plurality of sensors from another information processing apparatus including the plurality of sensors, and data received from the other information processing apparatuses. An event detection step for detecting the event, a presentation control step for controlling the presentation of the event detected by the process of the event detection step, and a determination by the user whether notification of the event presented by the process of the presentation control step is necessary An input acquisition step for acquiring an input , an ability determination step for determining the capabilities of a plurality of sensors based on the probability that each sensor has detected an event determined to be notified by a user, and the capabilities of the plurality of sensors The computer is caused to execute a process including a transmission step of transmitting the determination result to the other information processing apparatus .
A fifth information processing method according to the present invention is for a notification for an information processing device to notify an event whose occurrence is detected based on data output from a plurality of sensors from another information processing device including the plurality of sensors. Receive input for receiving data, presentation control step for controlling the presentation of events based on the notification data, and input of user's judgment on whether notification of events presented by the processing of the presentation control step is necessary An input acquisition step, a capability determination step of determining the capabilities of a plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user, and a determination result of the capabilities of the plurality of sensors Transmitting to the other information processing apparatus.
A fifth program of the present invention includes a receiving step of receiving notification data for notifying an event whose occurrence is detected based on data output from a plurality of sensors from another information processing apparatus including the plurality of sensors; A presentation control step for controlling the presentation of the event based on the data for notification, an input acquisition step for obtaining an input of judgment by the user as to whether notification of the event presented by the processing of the presentation control step is necessary, and a user Based on the probability that each sensor has detected an event determined to be notified by the capability determination step of determining the capabilities of the plurality of sensors and the determination result of the capabilities of the plurality of sensors to other information processing devices And causing the computer to execute processing including a transmission step of transmitting.
One of the first to fifth programs of the present invention is recorded on the recording medium of the present invention.

In the monitoring system, the first information processing method, the first program recorded on the recording medium, and the first program of the present invention, occurrence of an event is detected based on data output from a plurality of sensors The detection of the detected event is controlled, the input of the user's judgment whether the notification of the presented event is necessary is acquired, and each sensor detects the event that the user has determined that the notification is necessary. Based on the probability, the capabilities of the plurality of sensors are determined, and based on the determination result, the power of the plurality of sensors is turned on or off, respectively .

In the first information processing apparatus, the second information processing method, the second program recorded on the recording medium, and the second program of the present invention, data output from a plurality of sensors is another information processing apparatus. Of the plurality of sensors determined based on the probability that each sensor detected an event determined to be notified by the user among events detected based on the data in other information processing apparatuses. the ability of the determination result is received from the other information processing apparatus, based on the determination result of the ability of a plurality of sensors, each on or control of turning off a plurality of sensors of the power supply is executed.
In the second information processing apparatus, the third information processing method, the third program recorded on the recording medium, and the third program of the present invention, the event information is based on the data output from the plurality of sensors. The occurrence is detected, notification data for notifying the event is generated, the generated notification data is transmitted to another information processing device, and the other information processing device notifies the user of the detected events. The determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be necessary are received from other information processing devices, and the determination results of the capabilities of the plurality of sensors are received. Based on this, control is performed to turn on or off the plurality of sensors.

In the third information processing apparatus, the fourth information processing method, the fourth program recorded on the recording medium, and the fourth program of the present invention, a plurality of information processing apparatuses including a plurality of sensors are provided. Whether or not the output of the sensor is received, the occurrence of an event is detected based on the data received from another information processing device, the presentation of the detected event is controlled , and notification of the presented event is required Kano user input by the determination are obtained, based on an event notification is determined to be required by the user to the probability that the detected each sensor, it is determined a plurality of sensors of capacity, determination of the ability of a plurality of sensors The result is transmitted to another information processing apparatus.
In the fourth information processing apparatus, the fifth information processing method, the fifth program recorded on the recording medium, and the fifth program of the present invention, a plurality of information from other information processing apparatuses including a plurality of sensors. Whether notification data for notifying an event whose occurrence has been detected based on the data output by the sensor is received, the event presentation is controlled based on the notification data, and notification of the presented event is required Based on the probability that each sensor has detected an event for which a determination input by the user is obtained and an event determined to be necessary for notification by the user, the capabilities of the multiple sensors are determined, and the determination of the capabilities of the multiple sensors The result is transmitted to another information processing apparatus.

  According to the present invention, an event can be notified. In particular, according to the present invention, the sensor to be used can be switched based on the input of the user's judgment. As a result, a necessary and sufficient amount of information can be provided to the user with less power.

  Embodiments of the present invention will be described below. The correspondence between the invention described in this specification and the embodiments is illustrated as follows. Although this description is described in this specification, there is an embodiment which is not described here as corresponding to the invention. It does not mean that it does not correspond to. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean that all the inventions described in this specification are claimed. In other words, this description is an invention described in the present specification and is not claimed in this application, that is, a future divisional application, appearing by amendment, or added. It does not deny the existence of the invention.

According to the present invention, a monitoring system is provided. This monitoring system (for example, the monitoring system 1 in FIG. 1) has data (for example, the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n in FIG. 2) output from the data ( For example, based on sensor data, event detection means (for example, the event detection unit 33 in FIG. 2) that detects the occurrence of an event, and presentation control means (for example, that controls the presentation of the event detected by the event detection means) 3, and an event acquisition control unit 52) and an input acquisition unit (for example, FIG. 3) that acquires an input of determination by the user whether notification of the event presented based on the control of the presentation control unit is necessary . The user input interface unit 53) and the probability that each sensor has detected an event determined to be notified by the user . A capability determination unit (for example, sensor determination unit 55 in FIG. 3) that determines the capability, and a power control unit that performs control to turn on or off the power of each of the plurality of sensors based on the determination result of the capability determination unit (For example, the sensor power supply control unit 35 in FIG. 2).

In this monitoring system (for example, the monitoring system 1 in FIG. 1), the event detection means (for example, the event detection unit 33 in FIG. 2), the presentation control means (for example, the event presentation control unit 52 in FIG. 3), The input acquisition means (for example, the user input interface unit 53 in FIG. 3), the capability determination means (for example, the sensor determination unit 55 in FIG. 3), and the power supply control means (for example, the sensor power supply control unit 35 in FIG. 2) The first information processing apparatus (for example, the multi-sensor camera 11 in FIG. 1) and the second information processing apparatus (for example, the server 12 in FIG. 1) may be arranged separately. it can.

According to the present invention, an information processing method is provided. In this information processing method, a monitoring system (for example, the monitoring system 1 in FIG. 1) has a plurality of sensors (for example, the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n in FIG. 2). The event detection step (for example, step S3 in FIG. 10) for detecting the occurrence of an event and the presentation of the event detected by the processing of the event detection step are controlled based on the data (for example, sensor data) output by A presentation control step (for example, step S42 in FIG. 12), and an input acquisition step (for example, FIG. 12) for acquiring an input of judgment by the user as to whether notification of the event presented by the processing of the presentation control step is necessary . Step S45) and the probability that each sensor has detected an event that the user has determined that notification is required. The plurality of capacity determining capability determination step of the sensor (e.g., step S49 of FIG. 13) and execution, based on the capability determination step of the determination result, the respective on or off to control the power of the plurality of sensors Power supply control step (for example, step S14 in FIG. 11).

According to the present invention, a program is provided. This program is based on data (for example, sensor data) output from a plurality of sensors (for example, the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n in FIG. 2) . An event detection step (for example, step S3 in FIG. 10) for detecting occurrence, a presentation control step (for example, step S42 in FIG. 12) for controlling the presentation of the event detected by the process of the event detection step, An input acquisition step (for example, step S45 in FIG. 12) for acquiring a determination input by the user as to whether or not notification of the event presented by the processing of the presentation control step is necessary, and the notification is determined to be necessary by the user. Capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected the detected event (E.g., step S49 of FIG. 13) and, based on the capability determination step of determining that said plurality of power control step of executing the respective on or off to control the power supply of the sensor (e.g., step S14 in FIG. 11) Causes the computer to execute processing including

According to the present invention, an information processing apparatus is provided. The information processing apparatus (e.g., multi-sensor camera 311 in FIG. 18) includes a plurality of sensors (eg, CCD imaging device 341 in FIG. 19, CMOS imaging device 342, and the photo sensor 343-1 to 343-n), wherein Data output from a plurality of sensors is transmitted to another information processing apparatus (for example, the server 312 in FIG. 18), and the user needs to be notified of events detected based on the data in the other information processing apparatus. Communication means for receiving the determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be from the other information processing apparatus (for example, the communication unit in FIG. 19) and 334), based on the determination result of the ability of said plurality of sensors, said plurality of power control hand to perform respectively turned on or the control to turn off the sensor (For example, the sensor power supply control unit 335 in FIG. 19) .
According to the present invention, an information processing apparatus is provided. The information processing apparatus (for example, the multi-sensor camera 11 in FIG. 1) includes a plurality of sensors (for example, the CCD imaging apparatus 41, the CMOS imaging apparatus 42, and the photosensors 43-1 to 43-n in FIG. 2), Event detection means (for example, event detection unit 33 in FIG. 2) for detecting occurrence of an event based on data output from a plurality of sensors and generating notification data for notifying the event, and the event detection The notification data generated by the means is transmitted to another information processing apparatus (for example, the server 12 of FIG. 1), and the other information processing apparatus notifies the user of the events detected by the event detection means. The determination result of the capabilities of the plurality of sensors determined based on the probability that each sensor detected an event determined to be necessary, and the other information Power supply control for executing control for turning on or off the power of the plurality of sensors based on the communication means (for example, the communication unit 34 in FIG. 2) received from the processing device and the determination result of the capabilities of the plurality of sensors. Means (for example, the sensor power supply control unit 35 of FIG. 2).

According to the present invention, an information processing method is provided. This information processing method is an information processing apparatus (for example, the multi-sensor camera of FIG. 18) including a plurality of sensors (for example, the CCD imaging apparatus 341, the CMOS imaging apparatus 342, and the photosensors 343-1 to 343-n in FIG. 19). 311) a transmission step (for example, step S203 in FIG. 21 ) for transmitting data output from the plurality of sensors to another information processing apparatus (for example, the server 312 in FIG. 18 ), and the other information processing apparatus. The determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be notified by a user among events detected based on the data, Based on the reception step (for example, step S204 in FIG. 21) received from the information processing apparatus and the determination results of the capabilities of the plurality of sensors. There are, and a plurality of power control step of executing the respective on or off to control the power supply of the sensor (e.g., step S205 in FIG. 21).

According to the present invention, a program is provided. This program outputs data output from a plurality of sensors (for example, the CCD imaging device 341, the CMOS imaging device 342, and the photosensors 343-1 to 343-n in FIG. 19) to other information processing devices (for example, in FIG. 18). A transmission step (for example, step S203 in FIG. 21 ) to be transmitted to the server 312) and an event determined to be notified by the user from among the events detected based on the data in the other information processing apparatus A receiving step (for example, step S204 in FIG. 21) for receiving the determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected, and the plurality of sensors based on the ability of the determination result of the power control step of executing the respective on or off to control the power of the plurality of sensors (For example, step S205 in FIG. 21) .
According to the present invention, an information processing method is provided. This information processing method is an information processing apparatus (for example, the multi-sensor camera of FIG. 1) including a plurality of sensors (for example, the CCD image capturing apparatus 41, the CMOS image capturing apparatus 42, and the photosensors 43-1 to 43-n in FIG. 2). 11) is an event detection step for detecting occurrence of an event based on data output from the plurality of sensors and generating notification data for notifying the event (for example, steps S3 and S6 in FIG. 10). A transmission step (for example, step S7 in FIG. 10) for transmitting the notification data generated by the process of the event detection step to another information processing apparatus (for example, the server 12 in FIG. 1); In the information processing apparatus, it is determined that the user needs to be notified of the events detected by the event detection step. A receiving step (for example, step S13 in FIG. 11) for receiving the determination results of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected a vent from the other information processing apparatus; And a power control step (for example, step S14 in FIG. 11) for executing control to turn on or off the power of the plurality of sensors based on the determination result of the sensor capability.
According to the present invention, a program is provided. This program detects the occurrence of an event based on data output from a plurality of sensors (for example, the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n in FIG. 2). An event detection step (for example, steps S3 and S6 in FIG. 10) for generating notification data for notifying an event, and the notification data generated by the processing of the event detection step are used as another information processing device (for example, In the transmission step (for example, step S7 in FIG. 10) to be transmitted to the server 12 in FIG. 1 and the other information processing apparatus, notification is required by the user among the events detected by the processing in the event detection step. A determination result of the capabilities of the plurality of sensors determined based on the probability that each sensor detected an event determined to be present Is received from the other information processing device (for example, step S13 in FIG. 11), and the control to turn on or off the plurality of sensors based on the determination result of the capabilities of the plurality of sensors, respectively. Including a power supply control step (for example, step S14 in FIG. 11).

According to the present invention, an information processing apparatus is provided. This information processing apparatus (for example, the server 312 in FIG. 18) includes other information including a plurality of sensors (for example, the CCD imaging apparatus 341, the CMOS imaging apparatus 342, and the photosensors 343-1 to 343-n in FIG. 19). Communication means (for example, the communication unit 351 in FIG. 20) that receives data output from the plurality of sensors from a processing device (for example, the multi-sensor camera 311 in FIG. 18), and the data received from the other information processing apparatus. Based on the event detection means for detecting the occurrence of the event (for example, the event detection unit 357 in FIG. 20) and the presentation control means for controlling the presentation of the event detected by the event detection means (for example, the event in FIG. 20) . The presentation control unit 352) and an input of judgment by the user as to whether notification of the presented event is necessary based on the control of the presentation control means Based on the probability that each sensor has detected an event that is determined to be notified by the user and input acquisition means (for example, the user interface input unit 353 in FIG. 20) that acquires the capability of the plurality of sensors. And a capability determination unit (for example, a sensor determination unit 356 in FIG. 20), and the communication unit transmits the determination results of the capabilities of the plurality of sensors to the other information processing apparatus.
According to the present invention, an information processing apparatus is provided. The information processing apparatus (for example, the server 12 in FIG. 1) includes other information including a plurality of sensors (for example, the CCD image capturing apparatus 41, the CMOS image capturing apparatus 42, and the photosensors 43-1 to 43-n in FIG. 2). A communication means (for example, FIG. 3) for receiving notification data for notifying an event whose occurrence is detected based on data output from the plurality of sensors from a processing device (for example, the multi-sensor camera 11 of FIG. 1). Communication unit 51), a presentation control means for controlling the presentation of an event based on the notification data (for example, event presentation control section 52 in FIG. 3), and an event presented based on the control of the presentation control means. Input acquisition means (for example, the user interface input unit 53 in FIG. 3) for acquiring a determination input by the user as to whether or not notification is necessary, and the user determines that notification is necessary. Based on the probability that each sensor has detected the detected event, capability determination means (for example, sensor determination unit 55 in FIG. 3) for determining the capabilities of the plurality of sensors, and the communication means The ability determination result is transmitted to the other information processing apparatus.

The information processing apparatus (e.g., server 312 of the server 12 or 18 of FIG. 1) is based on the determination result of the ability of said plurality of sensors, a power control signal for each on or off the plurality of sensors The power supply control means to generate (for example, the sensor power supply control command part 56 of FIG. 3 or the sensor power supply control command part 356 of FIG. 20) can be further provided.

According to the present invention, an information processing method is provided. In this information processing method, an information processing apparatus (for example, the server 312 in FIG. 18) has a plurality of sensors (for example, a CCD imaging apparatus 341, a CMOS imaging apparatus 342, and photosensors 343-1 to 343-n in FIG. 19). A receiving step (for example, step S241 in FIG. 22) for receiving data output from the plurality of sensors from another information processing apparatus (for example, the multi-sensor camera 311 in FIG. 18), and the other information processing apparatus. Based on the received data, an event detection step (for example, step S242 in FIG. 22) for detecting the occurrence of an event, and a presentation control step (for example, for controlling the presentation of the event detected by the process of the event detection step) The notification of the event presented by the process of step S246) of FIG. 22 and the presentation control step is performed. Based on the input acquisition step (for example, step S250 in FIG. 23) for acquiring the determination input by the user as to whether or not necessary, and the probability that each sensor has detected an event determined to be notified by the user, A capability determination step (for example, step S254 in FIG. 23) for determining the capabilities of the plurality of sensors, and a transmission step (for example, in FIG. 23) for transmitting the determination results of the capabilities of the plurality of sensors to the other information processing apparatus. Step S256) .

According to the present invention, a program is provided. This program is another information processing apparatus (for example, the multi-sensor camera of FIG. 18) including a plurality of sensors (for example, the CCD imaging apparatus 341, the CMOS imaging apparatus 342, and the photosensors 343-1 to 343-n in FIG. 19). 311) receiving the data output from the plurality of sensors (for example, step S241 in FIG. 22), and event detection for detecting the occurrence of the event based on the data received from the other information processing apparatus Step (for example, step S242 in FIG. 22), a presentation control step (for example, step S246 in FIG. 22) for controlling the presentation of the event detected by the process of the event detection step, and a presentation by the process of the presentation control step Input acquisition to obtain user input for determining whether notification of an event is required An obtaining step (for example, step S250 in FIG. 23) and an ability determining step (for example , determining the ability of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user ) Step S254) in FIG. 23 and a transmission step (for example, Step S256 in FIG. 23) for transmitting the determination results of the capabilities of the plurality of sensors to the other information processing apparatus .
According to the present invention, an information processing method is provided. In this information processing method, an information processing apparatus (for example, the server 12 in FIG. 1) has a plurality of sensors (for example, the CCD imaging apparatus 41, the CMOS imaging apparatus 42, and the photosensors 43-1 to 43-n in FIG. 2). A receiving step of receiving notification data for notifying an event whose occurrence has been detected based on data output from the plurality of sensors from another information processing apparatus (for example, the multi-sensor camera 11 of FIG. 1). For example, step S41 in FIG. 12, a presentation control step (for example, step S42 in FIG. 12) for controlling the presentation of the event based on the notification data, and notification of the event presented by the processing of the presentation control step An input acquisition step (for example, step S45 in FIG. 12) for acquiring a determination input by the user as to whether or not notification is necessary, and notification by the user are required. A capability determination step (for example, step S49 in FIG. 13) for determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be important, and a determination of the capabilities of the plurality of sensors. And a transmission step (for example, step S50 in FIG. 12) for transmitting the result to the other information processing apparatus.
According to the present invention, a program is provided. This program is stored in another information processing apparatus (for example, the multi-sensor camera in FIG. 1) including a plurality of sensors (for example, the CCD image capturing apparatus 41, the CMOS image capturing apparatus 42, and the photosensors 43-1 to 43-n in FIG. 2). 11) from the receiving step (for example, step S41 in FIG. 12) for receiving notification data for notifying an event whose occurrence is detected based on the data output from the plurality of sensors, and based on the notification data An input acquisition for acquiring a presentation control step (for example, step S42 in FIG. 12) for controlling the presentation of the event and a user's judgment input as to whether notification of the event presented by the processing of the presentation control step is necessary. Each sensor detects a step (for example, step S45 in FIG. 12) and an event that is determined to be notified by the user. A capability determining step (for example, step S49 in FIG. 13) for determining the capabilities of the plurality of sensors based on the probabilities, and a transmitting step for transmitting the determination results of the capabilities of the plurality of sensors to the other information processing apparatus. (For example, step S50 in FIG. 12).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of a monitoring system 1 to which the present invention is applied. In this configuration example, a multi-sensor camera 11 is provided on the left monitoring area side in the figure, and a server 12 and a presentation unit 13 are provided on the notification / presentation side on the right side in the figure. The multi-sensor camera 11 and the server 12 perform wireless communication. The presentation unit 13 is, for example, a general television receiver or a dedicated monitor.

  The multi-sensor camera 11 is provided with a plurality of sensors, and each sensor is driven by a battery. In addition, each sensor is installed so that an area (necessary place) where an event is to be monitored can be monitored. When an event occurs, detection data is notified from the multi-sensor camera 11 to the server 12, and data for presentation is created by the server 12, and is notified to the presentation unit 13 and presented.

  The user 14 determines whether or not notification is required in the future for the presented event, and inputs a command indicating the determination to the server 12. Based on the determination input from the user 14, a sensor determination process to be described later selects an optimal sensor for the user 14 to detect an event that requires notification, and the other sensors are turned off. Thus, useless power consumption is suppressed.

  FIG. 2 is a block diagram showing a functional configuration of the multi-sensor camera 11 of FIG.

  The multi-sensor camera 11 includes a sensor unit 31, a sensor data processing unit 32, an event detection unit 33, a communication unit 34, a sensor power supply control unit 35, and a battery 36. The sensor unit 31 includes a CCD imaging device 41, a CMOS imaging device 42, and n photosensors 43-1 to 43-n. Although the value of n is arbitrary, it is four, for example. Both the CCD imaging device 41 and the CMOS imaging device 42 image an object in the monitoring area. The photosensors 43-1 to 43-n detect the presence or absence of an object in each monitoring area. Further, the CCD image pickup device 41, the CMOS image pickup device 42, and the photosensors 43-i (i = 1, 2,..., N) in that order have large power consumption and high resolution.

  Until the sensor determination process described later with reference to FIG. 14 is executed, all the sensors provided in the sensor unit 31 are powered on, and all the sensors detect an event (hereinafter referred to as event detection). The monitoring area is monitored as a sensor). After the sensor determination process is executed and the event detection sensor is selected, only the selected event detection sensor is powered on, which monitors the monitoring area. Further, when an event occurs, an image captured by the CCD imaging device 41 is presented to the user. Therefore, when the CCD imaging device 41 is not selected as an event detection sensor by the sensor determination process, the power of the CCD imaging device 41 is turned on in accordance with the occurrence of the event.

  The sensor data processing unit 32 detects data output from the CCD imaging device 41, the CMOS imaging device 42, and the plurality of photosensors 43-1 to 43-n that detect humans, animals, and other objects to be monitored (hereinafter referred to as sensors). Data required for event detection and event presentation (hereinafter referred to as event processing data) is extracted from the data and output to the event detection unit 33.

  The event detection unit 33 performs event detection processing based on the event processing data obtained from the sensor data processing unit 32. When detecting an event, the event detection unit 33 generates data (hereinafter, referred to as event notification data) including detection status of each sensor with respect to the detected event and data necessary for event presentation, via the communication unit 34. Send to server 12. In addition, the communication unit 34 receives the sensor power control signal transmitted from the server 12 and supplies it to the sensor power control unit 35.

  The sensor power supply control unit 35 controls the power supply state of each sensor of the sensor unit 31 based on the sensor power supply control signal. In addition, the sensor power supply control unit 35 controls the power supply of the CCD imaging device 41 after the above-described sensor determination process. When the CCD imaging device 41 is not selected as the event detection sensor, the sensor power supply control unit 35 turns on the power of the CCD imaging device 41 when an event occurs, and turns off the power of the CCD imaging device 41 when the event ends.

  The sensor power supply control unit 35 controls the power supply state of each sensor of the sensor unit 31 and turns off the power supply other than the sensor optimal for the detection of an event that requires notification to the user. Suppress.

  The battery 36 supplies necessary power to each part of the multi-sensor camera 11.

  FIG. 3 is a block diagram showing a functional configuration of the server 12 of FIG.

  The server 12 includes a communication unit 51, an event presentation control unit 52, a user input interface unit 53, an event information storage unit 54, a sensor determination unit 55, and a sensor power supply control command unit 56.

  The communication unit 51 communicates with the communication unit 34 of the multi-sensor camera 11 wirelessly. The event presentation control unit 52 receives event notification data transmitted from the communication unit 34 of the multi-sensor camera 11 via the communication unit 51. The event presentation control unit 52 creates presentation data for the presentation unit 13 based on the acquired event notification data and outputs the presentation data to the presentation unit 13. In addition, the event presentation control unit 52 stores event information of the presented event in the event information storage unit 54.

  The user input interface unit 53 accepts an input for the user to determine whether the notification is required in the future or not in the future, and the acquired determination input information is sent to the event information storage unit 54. Add to saved event information.

  The sensor determination unit 55 is based on the event information accumulated in the event information accumulation unit 54, and is an optimum sensor (a sensor that can obtain the minimum necessary resolution (information amount) for detecting an event for which the user needs to be notified. ) And the sensor power control command unit 56 is notified of the selection result.

  The sensor power control command unit 56 transmits a sensor power control signal to the multi-sensor camera 11 via the communication unit 51 based on the notification of the sensor determination result from the sensor determination unit 55.

  Next, the concept of the sensor determination process performed by the monitoring system 1 will be described with reference to FIGS. 4 to 9, and the flow of the process executed by the monitoring system 1 will be described with reference to FIGS. 10 to 15. Will be explained.

  FIG. 4 is a diagram showing the relationship between the amount of information used (having) for detecting an event and the power required for detecting the event of each sensor provided in the multi-sensor camera 11. is there. The horizontal axis represents the amount of information, and the vertical axis represents power. A line 101 is a characteristic of the CCD image pickup device 41, a line 102 is a characteristic of the CMOS image pickup device 42, a line 103 is a characteristic when n photosensors 43-1 to 43-n are used, and a line 104 is a photosensor. The characteristics in the case of using one photosensor among 43-1 to 43-n are respectively shown.

  The line 101 in FIG. 4 indicates that the amount of information from an event in which the CCD image pickup device 41 has a small amount of information (low resolution) compared to the CMOS image pickup device 42 having the characteristics of the line 102 and the photosensor 43 having the characteristics of the lines 103 and 104. It is possible to detect up to many events (with high resolution), but the power required for event detection increases. The CMOS imaging device 42 having the characteristics of the line 102 can detect events having a small amount of information (low resolution) to events having a large amount of information (high resolution) compared to the photosensor 43 having the characteristics of the lines 103 and 104. However, it shows that the power required for event detection increases. On the other hand, the n photosensors 43-1 to 43-n having the characteristic of the line 103 can detect an event with a larger amount of information (high resolution) than the one photosensor 43i having the characteristic of the line 104. It shows that the power required for detection also increases. Therefore, the power consumption of the multi-sensor camera 11 can be minimized by switching the sensor to be used according to the amount of information necessary for detecting the event that the user wants to notify.

  For example, FIG. 5 and FIG. 6 show examples of images in which the same scene is detected by different sensors, FIG. 5 shows examples of images detected by the CCD imaging device 41 as a high resolution sensor, and FIG. The example of the image detected with the CMOS imaging device 42 as a sensor of is shown. The presence of the doll 61 shown in the center of FIG. 5 can be detected even in a portion surrounded by a circle 62 in FIG. Therefore, for example, if the user needs to be notified of an event that requires an amount of information sufficient to detect the presence of the doll 61 in this example, the use of a high-resolution sensor (for example, the CCD imaging device 41) should be used. Instead, only low resolution sensors (eg, CMOS imaging device 42) can be used to detect events that require notification by the user. Thereby, compared with the case where a high-resolution sensor (for example, CCD imaging device 41) is used, the power consumption of the multi-sensor camera 11 can be suppressed.

  Similarly, FIG. 7 and FIG. 8 show examples of images in which the same scene is detected by another sensor, FIG. 7 is a high-resolution sensor (for example, CCD imaging device 41), and FIG. 8 is a low-resolution sensor (for example, for example). Examples of images respectively detected by the CMOS imaging device 42) are shown. The car shown in the part surrounded by the circle 71 in FIG. 7 cannot be distinguished from the previous car in the image of FIG. Therefore, for example, when a user wants to monitor the traffic of a car, use a high-resolution sensor (for example, the CCD imaging device 41) and stop using a low-resolution sensor (for example, the CMOS imaging device 42). Thus, it is possible to detect an event for which the user needs to be notified.

  However, the amount of information required for event detection varies depending on the event that the user needs to notify, and in general, the user does not know how much information is required to detect the event. .

  FIG. 9 is a graph obtained by adding lines and points for assisting the explanation to the characteristic graph of FIG. From the graph of FIG. 9, it is shown that by grasping a sensor that can detect an event for a certain event, it is possible to grasp a guideline for the amount of information necessary to detect the event. For example, if all sensors have detected a certain event, the amount of information necessary to detect the event is the area on the right side of the point I4 of the information amount corresponding to the right end point of the line 104 in FIG. Become. Similarly, when the CMOS imaging device 42 and the CCD imaging device 41 can detect an event, the amount of information necessary to detect the event is the point of the information amount corresponding to the right end point of the line 102 in FIG. It is the area on the right side from I2.

  In the monitoring system 1, an input for determining whether a notification is necessary in the future or whether a notification is unnecessary in the future is acquired from the user with respect to the event presented by the monitoring system 1. For all events that the user has determined to need to be notified in the future, by gathering statistics on the sensors that were able to detect those events, grasp the amount of information necessary to detect the events that the user needs be able to. Then, based on the statistical results, the most suitable sensor for detecting an event for which the user needs to be notified is selected, and the power consumption of the multi-sensor camera 11 is suppressed by turning off the power of the other sensors. Can do. For example, if the amount of information necessary to detect an event required by the user is less than or equal to the point I2 (a range that can be detected by the CMOS imaging device 42), CCD imaging can be performed by using only the CMOS imaging device 42. Compared with the case where the apparatus 41 is used, the power consumption of the multi-sensor camera 11 can be suppressed.

  Next, processing executed by the monitoring system 1 in FIG. 1 will be described with reference to FIGS. 10 to 15.

  First, an event monitoring process executed by the multi-sensor camera 11 will be described with reference to FIGS. 10 and 11. The description will be made in the order of the process after the sensor detection process is executed, the process until the sensor detection process is selected, the sensor determination process is executed, and the event detection sensor is selected. This process is started when the user gives an instruction to start monitoring in the monitoring area. All the sensors provided in the sensor unit 31 of the multi-sensor camera 11 from the start of the event monitoring process in the monitoring system 1 to the selection of a predetermined event detection sensor by the sensor determination process are all event detections. As a sensor, the power is always turned on and the monitoring area is monitored.

  In the state before the sensor determination process is executed, the following process is performed. That is, in step S1, the sensor unit 31 acquires sensor data from each of the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n provided in the monitoring area, and a sensor data processing unit. 32. Each of the CCD imaging device 41 and the CMOS imaging device 42 outputs image data obtained by imaging an object as sensor data, and each of the photosensors 43-1 to 43-n includes the presence / absence of an object (change presence / absence). ) Is output as sensor data.

  In step S2, the sensor data processing unit 32 extracts data necessary for event detection and event presentation from the acquired sensor data, and generates event processing data.

  In step S3, the event detection unit 33 acquires event processing data from the sensor data processing unit 32, and determines whether an event to be notified to the user is occurring based on the acquired event processing data. For example, the interframe difference of the image data acquired by the CCD image pickup device 41 or the CMOS image pickup device 42 is calculated, the feature amount is calculated from the barycentric position of the interframe difference, and it is determined whether or not an event is occurring from the feature amount. Or whether or not an event is occurring is determined based on whether or not a change in brightness that exceeds a reference value is detected by the photosensors 43-1 to 43-n. If it is determined in step S3 that an event to be notified to the user is not occurring (an event has not yet occurred), the process proceeds to step S13.

  In step S <b> 13, the communication unit 34 determines whether a sensor power supply control signal has been received from the server 12. This sensor power control signal is transmitted from the server 12 to turn off power other than the event detection sensor selected in the sensor determination process in step S50 of FIG. The sensor determination process is performed when sufficient event information is accumulated in the server 12 for the sensor determination process after the event ends. In this case, since sufficient event information has not yet been accumulated, the process of step S14 is skipped, and the process proceeds to step S15.

  In step S15, it is determined whether or not the user has instructed termination of monitoring in the monitoring area. If it is determined that there is no termination command, the process returns to step S1 and the subsequent processes are repeated. If it is determined that the user has instructed to end the monitoring in the monitoring area, the event monitoring process is ended.

  If it is determined in step S3 that an event to be notified to the user is occurring (newly generated), the process proceeds to step S4.

  In step S <b> 4, the sensor power supply control unit 35 determines whether the CCD imaging device 41 is an event detection sensor. In this case, it is before the sensor determination process is performed, and like the other sensors, the CCD imaging device 41 is also an event detection sensor. Therefore, the process of step S5 is skipped, and the process proceeds to step S6.

  In step S6, the event detection unit 33 generates data (event notification data) including the detection status of each sensor for the detected event and data necessary for event presentation based on the event processing data acquired in step S3.

  In step S <b> 7, the event detection unit 33 transmits event notification data to the server 12 via the communication unit 34.

  In step S <b> 8, as in step S <b> 1, the sensor unit 31 acquires sensor data from each of the CCD imaging device 41, the CMOS imaging device 42, and the photosensors 43-1 to 43-n and outputs the sensor data to the sensor data processing unit 32. To do.

  In step S9, as in step S2, the sensor data processing unit 32 generates event processing data.

  In step S10, as in step S3, the event detection unit 33 determines whether an event to be notified to the user is still occurring. If it is determined that an event to be notified to the user is still occurring (the event is continuing), the processing returns to step S6, and the subsequent processing (transmission of event notification data to the server 12) is repeated. . As a result, once the event has occurred, it is continuously notified to the server.

  If it is determined in step S10 that no event has occurred (the event has ended), the process proceeds to step S11.

  In step S11, as in step S4, the sensor power supply control unit 35 determines whether or not the CCD imaging device 41 is an event detection sensor. In this case, it is before the sensor determination process is performed, and like the other sensors, the CCD imaging device 41 is also an event detection sensor. Therefore, the process of step S12 is skipped, and the process proceeds to step S13.

  In step S <b> 13, as described above, the communication unit 34 determines whether the sensor power supply control signal transmitted from the server 12 has been received. Until the server 12 performs the sensor determination process and transmits the sensor power control signal, the process of step S14 is skipped, and the process proceeds to step S15. In step S15, when it is determined that the user has not instructed to end the monitoring in the monitoring area, the process returns to step S1, the monitoring process is continued as it is, and the instruction is given to end the monitoring. If so, the monitoring process ends.

  When event detection is repeated in the monitoring system 1 and sufficient event information is accumulated in the server 12 for sensor determination processing, the sensor determination processing is performed in the server 12 in step S49 of FIG. The In step S50 of FIG. 13, a sensor power supply control signal is transmitted from the server 12. In this case, in step S13, the communication unit 34 of the multi-sensor camera 11 receives the sensor power supply control signal, and the process proceeds to step S14.

  In step S <b> 14, the sensor power supply control unit 35 acquires a sensor power supply control signal from the communication unit 34. The sensor power supply control unit 35 controls the power supply other than the event detection sensor selected in the sensor determination process to be turned off based on the sensor power supply control signal, so that the power consumption of the multi-sensor camera 11 can be suppressed thereafter. Further, the sensor power supply control unit 35 stores the type of event detection sensor selected in the event determination process. Then, the process proceeds to step S15, and when it is determined that the user has not instructed to end the monitoring in the monitoring area, the process returns to step S1, the monitoring process is continued, and the monitoring is ended. When the command is issued, the monitoring process ends.

  Next, a process after the event detection sensor is selected in the sensor determination process will be described. Here, it is assumed that the CMOS imaging device 42 is selected as the event detection sensor, and that the power supply other than the CMOS imaging device 42 is turned off in the process of step S14 in FIG. 13 described above.

  In step S <b> 1, the sensor unit 31 acquires sensor data (image data) from the CMOS imaging device 42 and outputs it to the sensor data processing unit 32.

  In step S2, the sensor data processing unit 32 extracts data necessary for event detection and event presentation from the acquired sensor data, and generates event processing data.

  In step S3, the event detection unit 33 acquires event processing data from the sensor data processing unit 32, and determines whether an event to be notified to the user is occurring based on the acquired event processing data. If it is determined that an event to be notified to the user is not occurring, the process proceeds to step S13, and the same process as before the sensor determination process described above is performed.

  If it is determined in step S3 that an event to be notified to the user is occurring (occurred), the process proceeds to step S4.

  In step S <b> 4, the sensor power supply control unit 35 determines whether the CCD imaging device 41 is an event detection sensor. In this case, since the CMOS imaging device 42, not the CCD imaging device 41, is an event detection sensor, the process proceeds to step S5.

  In step S <b> 5, the sensor power supply control unit 35 turns on the power of the CCD imaging device 41. The sensor unit 31 acquires sensor data (image data) of the CCD imaging device 41 whose power is turned on and outputs the sensor data to the sensor data processing unit 32. The sensor data processing unit 32 extracts data (event processing data) necessary for event presentation from the acquired sensor data (in this case, the image data is extracted as event processing data as it is), and is sent to the event detection unit 33. The process proceeds to step S6. As described above, this process is performed to cause the user to present an image captured by the CCD imaging device 41 when an event occurs. If the CCD imaging device 41 is an event detection sensor, it is not necessary to turn on the power of the CCD imaging device 41, and thus the process of step S5 is skipped.

  In step S6, the event detection unit 33 generates event notification data based on the event processing data acquired in steps S3 and S5. In this case, the image data is generated as it is as event notification data.

  In step S <b> 7, the event detection unit 33 transmits event notification data to the server 12 via the communication unit 34.

  In step S <b> 8, as in step S <b> 1, the sensor unit 31 acquires sensor data from the CCD imaging device 41 and the CMOS imaging device 42 and outputs the sensor data to the sensor data processing unit 32.

  In step S9, as in step S2, the sensor data processing unit 32 generates event processing data. In this case, the image data output from the CCD imaging device 41 and the image data output from the CCD imaging device 42 are event processing data.

  In step S10, the event detection unit 33 acquires event processing data from the sensor data processing unit 32, and determines whether an event to be notified to the user is still occurring based on the acquired event processing data. However, since the CCD imaging device 41 is not an event detection sensor, the sensor data of the CCD imaging device 41 is not used for the event determination process, and the sensor data (image data) of the CMOS imaging device 42 selected as the event detection sensor. Is used for event determination processing. If it is determined that an event to be notified to the user is still occurring, the process returns to step S6, and the subsequent processing (transmission processing of event notification data to the server 12) is repeated.

  If it is determined in step S10 that an event has not occurred (the event has ended), the process proceeds to step S11, and, similar to step S4, the sensor power supply control unit 35 causes the CCD imaging device 41 to detect an event. It is determined whether or not it is a sensor. In this case, since the event detection sensor is the CMOS image pickup device 42 and not the CCD image pickup device 41, the process proceeds to step S12.

  In step S12, the presentation of the event to the user is terminated with the end of the event, so the sensor power supply control unit 35 turns off the power of the CCD imaging device 41 for the event presentation. As described above, the power consumption of the multi-sensor camera 11 can be suppressed by controlling the power supply of the CCD imaging device 41 according to the state of the event. Note that when the CCD imaging device 41 is an event detection sensor, it is not necessary to turn off the power of the CCD imaging device 41, and thus the process of step S12 is skipped.

  In step S13 and subsequent steps, processing similar to that before the sensor determination processing described above is performed.

  In the above description, the CCD imaging device 41 is described as the sensor that captures an image presented to the user after the sensor determination process. However, the image of the CMOS imaging device 42 is presented to the user as it is, or the presented image is captured. It is also possible to allow the user to select a sensor to perform.

  Next, event monitoring processing executed by the server 12 in response to the processing by the multi-sensor camera 11 will be described with reference to FIGS. This process is started when the user gives an instruction to start the event monitoring process.

  In step S <b> 41, the communication unit 51 determines whether event notification data has been received from the multi-sensor camera 11. This event notification data is data transmitted from the multi-sensor camera 11 in step S7 of FIG. If it is determined that the event notification data has not been received, the process proceeds to step S51.

  In step S51, it is determined whether or not the user has instructed termination of monitoring in the monitoring area. If it is determined that there is no termination command, the process returns to step S41, and the subsequent processes are repeated. If it is determined that the user has instructed to end the monitoring in the monitoring area, the event monitoring process is ended.

  If it is determined in step S41 that event notification data has been received, the process proceeds to step S42, and the event presentation control unit 52 acquires event notification data from the communication unit 51. The event presentation control unit 52 creates data to be presented to the user based on the acquired event notification data, and outputs the data to the presentation unit 13 in FIG. 1 for presentation. As a result, an image detected as an event (an image captured by the CCD imaging device 41) is presented to the user.

  In step S43, as in step S41, the communication unit 51 determines whether event notification data transmitted from the multi-sensor camera 11 is still being received. If it is determined that event notification data is being received, the process returns to step S42, and the subsequent processes (event presentation process) are repeated.

  If it is determined in step S43 that event notification data is not being received (reception of event notification data has ended), the process proceeds to step S44. In step S44, the event presentation control unit 52 stores information on the presented event in the event information storage unit 54 as event information. In this event information, the event occurrence time, the event detection information of each sensor indicating whether or not each sensor has detected the event, and whether or not future notification input from the user in step S45 is necessary are determined. Judgment input information is included.

  In step S <b> 45, the user input interface unit 53 determines whether or not an input for determining whether or not further notification is necessary for the event presented in step S <b> 42 has been acquired from the user. When the determination input from the user is acquired, the process proceeds to step S46, and the user input interface unit 53 adds the acquired determination input information to the event information stored in the event information storage unit 54 in step S44. ,save. If the determination input from the user is not acquired, the process of step S46 is skipped, and the process proceeds to step S47.

  Note that the judgment input from the user acquired in step S45 can be input during the event presentation in step S42, and if input during the event presentation, the user input interface unit 53 until the processing in step S45 is performed. Is temporarily saved.

  In step S47, the sensor determination unit 55 determines whether the sensor determination process is not performed. If the sensor determination process has not been performed, the process proceeds to step S48.

  In step S48, the sensor determination unit 55 determines that the accumulated amount of the judgment input information from the user stored in the event information accumulation unit 54 is a predetermined amount sufficient to execute the sensor determination process (for example, a predetermined number of times). ) Is exceeded. Until the accumulated amount of the judgment input information exceeds a predetermined amount, the processing of the next steps S49 and S50 is skipped as in the case where it is judged that the sensor judgment processing has been performed in step S47, and the processing is step. Proceed to S51. If it is determined in step S51 that the user has not instructed termination of monitoring in the monitoring area, the process returns to step S41, and the subsequent processes are repeated. If it is determined that the user has instructed to end the monitoring in the monitoring area, the event monitoring process is ended.

  When event detection is repeated and it is determined in step S48 that the accumulated amount of determination input information has exceeded a predetermined amount, the process proceeds to step S49, where sensor determination processing is performed and an event for which the user needs to be notified. The most suitable sensor for detecting the event is selected as the event detection sensor. Details of the sensor determination process will be described later with reference to FIG.

  In step S50, the sensor determination unit 55 notifies the sensor power supply control command unit 56 of the result of the sensor determination process. The sensor power control command unit 56 transmits a sensor power control signal for turning off the power other than the event detection sensor selected in step S49 to the multi-sensor camera 11 via the communication unit 51. Based on this sensor power control signal, the multi-sensor camera 11 turns off the power other than the event detection sensor in step S14 of FIG. 11 described above. In addition, the sensor power control command unit 56 stores the type of sensor selected in the sensor determination process.

  If it is determined in step S51 that the user has not instructed termination of monitoring in the monitoring area, the process returns to step S41, and the subsequent processes are repeated. If it is determined that the user has instructed to end the monitoring in the monitoring area, the event monitoring process is ended.

  The processing executed by the server 12 after the sensor determination processing (processing when NO is determined in step S47) is the same as the processing before the sensor determination processing. Note that the user's determination input information for the event acquired in step S45 is, for example, after the sensor determination process, classifies events detected by the event detection sensor into events that require further notification and events that do not require notification. It can be used as information for controlling to notify only events for which notification is determined to be necessary.

  Next, the sensor determination process executed in step S49 of FIG. 13 will be described with reference to FIG.

  In step S <b> 101, the sensor determination unit 55 loads past event information accumulated in the event information accumulation unit 54.

  FIG. 15 shows an example of the event information loaded in step S101.

  The first line in FIG. 15 shows the event occurrence time except for the rightmost column. In the example of this figure, a total of three events have occurred at times T = t, T = t + M, and T = t + M + N.

  The second to fifth lines in FIG. 15 represent event detection information for each sensor indicating whether or not each sensor described in the first column can detect an event at each time except the most rightmost column. . “Change detection” indicates that the sensor has detected an event, and “no response” indicates that the sensor has not detected an event. For example, the event that occurred at time T = t was detected by the CCD imaging device 41 and the CMOS imaging device 42. However, the n photosensors 43-1 to 43-n and the photosensors 43-1 to 43- An event could not be detected with only one of n.

  The sixth line in FIG. 15 shows the user's judgment input information for each event. “Notification required” indicates that the user has entered a determination that the event will continue to be required, and “Notification not required” indicates that the user has entered a determination that the event will no longer be required. Show.

  The sensor determination unit 55 obtains the total result of each sensor shown in the rightmost column of FIG. 15 based on the above event information. The denominator of the counting result represents the number of events that the user has entered a judgment that needs to be notified in the future, and the numerator represents the number of times each sensor can detect the event that the user has entered a judgment that needs to be notified in the future. Represent. For example, when n photosensors 43-1 to 43-n are used, since the user can detect one out of two events in which a determination that notification is still necessary is input, the counting result (probability) Becomes 1/2.

  The capability of the sensor is determined based on whether the value of the total result is equal to or greater than a predetermined threshold value. For example, in the example of FIG. 15, when the sensor capability determination threshold is 90%, the CCD imaging device 41 and the CMOS imaging device 42 detect the event that the user needs to be notified because the counting result is 100%. Determined to have the ability to In contrast, only one of the n photosensors 43-1 to 43-n and one of the photosensors 43-1 to 43-n has a count result of 50%, so the user needs to be notified. It is determined that it does not have the ability to detect the event.

  Hereinafter, based on the event information of FIG. 15, the processing of FIG. 14 will be described with the sensor capability determination threshold set to 90%.

  In step S <b> 102, the sensor determination unit 55 selects a sensor with the least power consumption from the sensors that have not been subjected to the sensor determination process as a sensor determination process target. Therefore, in the sensor determination process, one of the photosensors 43-1 to 43-n, the n photosensors 43-1 to 43-n, the CMOS imaging device 42, and the CCD imaging device are sequentially arranged from the sensor with the lowest power consumption. It is performed in the order of 41.

  In step S103, the sensor determination unit 55 determines whether or not the sensor selected in step S102 has an ability to detect an event that requires notification from the user. First, sensor determination processing is performed when only one of the photosensors 43-1 to 43-n is used, and processing is performed when it is determined that the user does not have the ability to detect an event that requires notification. Advances to step S105.

  In step S <b> 105, the sensor determination unit 55 determines whether determination processing for all sensors has been completed. In this case, since the determination process for all the sensors has not been completed, the process returns to step S102.

  Next, in step S102, n photosensors 43-1 to 43-n are subjected to sensor determination processing. Even when n photosensors 43-1 to 43-n are used, if it is determined that the user does not have the ability to detect an event that requires notification, the process returns to step S102 by the same processing, and the next In this case, the CMOS imaging device 42 is a target of the sensor determination process, and the process proceeds to step S103.

  In step S103, the CMOS imaging device 42 is determined to have the ability to detect an event that requires a user notification. Since the sensor determination process is performed in order from the sensor with the lowest power consumption, the CMOS imaging device 42 is the sensor with the highest power consumption among the sensors having the ability to detect an event for which the user needs to be notified. Therefore, the sensor selection process is completed, and the process proceeds to step S104.

  In step S104, the sensor determination unit 55 selects a determination target sensor (CMOS imaging device 42) as an event detection sensor, and the sensor determination process is ended.

  In step S105, it is determined that the determination process for all the sensors has been completed, and the process proceeds to step S106. All sensors do not have the ability to detect an event for which the user needs to be notified. Is determined. The CCD imaging device 41 is capable of detecting an event detected by another sensor and is assumed to have an event detection rate of 100%. If the CCD imaging device 41 cannot detect an event under some condition and the process proceeds to step S106, the sensor determination unit 55 selects a sensor (CCD imaging device 41) that can detect an event with the largest amount of information as an event. A sensor for detection is selected, and the sensor determination process is terminated.

  Through the series of processes of the monitoring system 1 described above, the monitoring system 1 has the ability to detect an event that requires notification from the sensors of the multi-sensor camera 11, and consumes the least amount of power. The sensor is selected as the event detection sensor, and the other sensors are turned off. In addition, after the sensor determination process, the power supply of the CCD imaging device 41 that captures an image to be presented to the user is controlled in accordance with the occurrence of the event. Therefore, it is possible to present an event for which the user needs to be notified while minimizing the power consumption of the multi-sensor camera 11.

  Further, the monitoring system 1 detects objects based on different principles such as a photosensitive CCD imaging device 241 and a photosensor 243 and a thermal infrared pyroelectric sensor 244 as in the multi-sensor camera 211 of FIG. Sensors can be used. In FIG. 16, portions corresponding to those in FIG. 2 are denoted by the same reference numerals or the last two digits, and the description thereof will be omitted because it is repeated.

  In the case of sensors with different detection principles and, therefore, detection targets, it is difficult to simply compare which sensor has better detection capability. However, the monitoring system 1 determines whether or not the user has the ability to detect an event that requires notification for each sensor by the sensor determination process described above with reference to FIG. By selecting the sensor that consumes the least amount of power from among the sensors it has, it is possible to select the most appropriate sensor for detecting an event that requires notification by the user, regardless of the detection target of the sensor. It is.

  FIG. 17 shows an example of event information accumulated in the monitoring system 1 when the multi-sensor camera 211 is used. In FIG. 17, when the threshold for determining the capability of the sensor is 90%, the CCD imaging device 241 and the photosensor 243 have the capability of detecting an event for which the user needs to be notified, and the sensor determination described with reference to FIG. Through the processing, the photosensor 243 with low power consumption is selected as the event detection sensor.

  In addition, a microphone, a microwave sensor, and other sensors can be used for the multi-sensor camera.

  In the above, the event detection process is performed on the multi-sensor camera 11 side, but it can also be performed on the server. FIG. 18 shows a configuration example of the monitoring system 301 in this case. Compared to the monitoring system 1 of FIG. 1, the multi-sensor camera 11 is replaced with a multi-sensor camera 311 and the server 12 is replaced with a server 312. Other configurations are the same as those in FIG. The monitoring system 301 is applied when the power consumed by the event detection process is large, and the event detection process executed by the server 312 can reduce the power consumption of the multi-sensor camera 311.

  FIG. 19 is a block diagram illustrating a functional configuration of the multi-sensor camera 311, and FIG. 20 is a block diagram illustrating a functional configuration of the server 312. The multi-sensor camera 311 and the server 312 are different from the multi-sensor camera 11 in FIG. 2 and the server 12 in FIG. 3 in that the event detection unit 357 is arranged in the server 312 instead of the multi-sensor camera 311. . Other configurations are the same as those in FIGS. In the figure, parts corresponding to those in FIG. 2 and FIG. 3 are given the same reference numerals in the last two digits, and the description of parts having the same processing will be omitted because it will be repeated.

  The multi-sensor camera 311 is provided with a sensor unit 331, a sensor data processing unit 332, a communication unit 334, a sensor power supply control unit 335, and a battery 336. The sensor unit 331 includes a CCD image pickup device 341, a CMOS image pickup device 342, and n sensors of a plurality of photosensors 343-1 to 343-n.

  The sensor data processing unit 332 is necessary for event detection and event presentation from data (sensor data) obtained from a plurality of sensors of the CCD imaging device 341, the CMOS imaging device 342, and the n photosensors 343-1 to 343-n. Data (event processing data) is extracted and transmitted to the server 312 via the communication unit 334.

  The server 312 is provided with an event detection unit 357 in addition to a communication unit 351, an event presentation control unit 352, a user input interface unit 353, an event information storage unit 354, a sensor determination unit 355, and a sensor power supply control command unit 356. Yes.

  The event detection unit 357 performs event detection processing based on event processing data acquired from the multi-sensor camera 311 via the communication unit 351. When the event detection unit 357 detects an event, the event detection unit 357 outputs, to the event presentation control unit 352, data (event notification data) including detection status of each sensor for the detected event and data necessary for event presentation.

  The event presentation control unit 352 acquires event notification data from the event detection unit 357, creates presentation data based on the acquired event notification data, and outputs the presentation data to the presentation unit 13. In addition, the event presentation control unit 352 stores information on the presented event in the event information storage unit 354.

  The sensor power control command unit 356 transmits a sensor power control signal to the multi-sensor camera 311 via the communication unit 351 based on the notification of the result of the sensor determination process from the sensor determination unit 355. The sensor power supply control command unit 356 stores the type of event detection sensor selected in the sensor determination process, and controls the power supply of the CCD imaging device 341 in accordance with the occurrence and end of the event after the sensor determination process. A sensor power supply control signal is transmitted to the multi-sensor camera 311 via the communication unit 351.

  Next, processing executed by the monitoring system 301 in FIG. 18 will be described with reference to FIGS. The processing differs from the monitoring system of FIG. 1 when an event occurs in the monitoring area before the sensor determination process, when an event occurs in the monitoring area after the sensor determination process, and when the event has ended. Those cases will be described.

  First, processing executed by the multi-sensor camera 311 before the sensor determination processing is performed will be described with reference to FIG. This process is executed regardless of whether or not an event in the monitoring area has occurred.

  In step S <b> 201, the sensor unit 331 acquires sensor data from each of the CCD imaging device 341, the CMOS imaging device 342, and the photosensors 343-1 to 343-n provided in the monitoring area, and sends them to the sensor data processing unit 332. Output.

  In step S202, the sensor data processing unit 332 extracts data necessary for event detection and event presentation from the acquired sensor data, and generates event processing data.

  In step S <b> 203, the sensor data processing unit 332 transmits the data to the server 312 via the communication unit 334 regardless of whether an event has occurred in the monitoring area. The transmitted event processing data is received by the server 312 in S241 of FIG. 22 to be described later and used for event detection processing.

  In step S <b> 204, the communication unit 334 determines whether a sensor power supply control signal has been received from the server 312. Since the sensor power supply control signal is not received before the sensor determination process, the process of step S205 is skipped, and the process proceeds to step S206.

  In step S206, it is determined whether or not the user has instructed termination of monitoring in the monitoring area. If it is determined that there is no termination command, the process returns to step S201, and the subsequent processes are repeated. If it is determined that the user has instructed to end the monitoring in the monitoring area, the event monitoring process is ended.

  Next, a process executed by the server 312 when an event is detected before the sensor determination process is performed will be described with reference to FIGS. 22 and 23. FIG.

  In step S241, the event detection unit 357 acquires event processing data transmitted from the multi-sensor camera 311 through the communication unit 351 in step S203 in FIG.

  In step S242, the event detection unit 357 determines whether an event to be notified to the user is occurring based on the event processing data acquired in step S241 by the same processing as in step S3 of FIG. 10 of the multi-sensor camera 11. Determine. In this case, since the event is detected, the process proceeds to step S243.

  In step S243, the sensor power supply control command unit 356 determines whether the CCD imaging device 341 is an event detection sensor. Before the sensor determination process, the CCD imaging device 341 is also an event detection sensor together with other sensors, so the processes of steps S244 and S245 are skipped, and the process proceeds to step S246.

  In step S246, the event detection unit 357 generates data (event notification data) including the detection status of each sensor for the event and data necessary for event presentation based on the event processing data acquired in step S241, and event presentation control is performed. To the unit 352. The event presentation control unit 352 creates data to be presented to the user based on the acquired event notification data, and outputs the data to the presentation unit 13 in FIG. 18 for presentation.

  In step S247, the event detection unit 357 acquires the event processing data transmitted from the multi-sensor camera 311 in the process of step S203 in FIG. 21 as in step S241.

  In step S248, the event detection unit 357 determines whether an event to be notified to the user is occurring, as in step S242. If it is determined in step S248 that an event is occurring, the process returns to step S246, and the subsequent process (event presentation process) is repeated.

  If it is determined in step S248 that no event is occurring (the event has ended), the process proceeds to step S249. The processing after step S249 is the same as the processing after step S44 of FIG.

  Next, a process executed by the monitoring system 1 when an event occurs in the monitoring area and when the generation ends after the sensor determination process is performed will be described with reference to FIGS. In the following description, it is assumed that the CMOS imaging device 342 is selected as the event detection sensor by the sensor determination process, and the power supply other than the CMOS imaging device 342 is turned off.

  As described with reference to FIGS. 11 and 12, in the monitoring system 1, the sensor power control unit 35 of the multi-sensor camera 11 captures an image of the CCD imaging device 41 to be presented to the user when an event occurs after the sensor determination process. The power source of the CCD imaging device 41 is controlled in accordance with the event state. On the other hand, in the monitoring system 301, since the multi-sensor camera 311 does not have an event detection unit and the event state cannot be determined, the sensor determination unit 355 of the server 312 sends the sensor power control signal to the multi-sensor camera in accordance with the event state. By transmitting to 311, the power source of the CCD imaging device 341 of the multi-sensor camera 311 is controlled.

  First, with reference to FIG. 21, a process executed by the multi-sensor camera 311 when an event occurs in the monitoring area and when the generation ends after the sensor determination process is performed will be described.

  If the server 312 determines that an event to be notified to the user has occurred, a sensor power supply control signal for turning on the CCD imaging device 341 is transmitted from the server 312 by the processing in step S244 in FIG. . The sensor power supply control signal is received by the communication unit 334 of the multi-sensor camera 311 in the process of step S204 in FIG. 21, and the process proceeds to step S205.

  In step S205, the sensor power supply control unit 335 acquires a sensor power supply control signal from the communication unit 334, and turns on the power of the CCD imaging device 341 based on the sensor power supply control signal.

  If it is determined in step S206 that the user has not instructed termination of monitoring in the monitoring area, the process returns to step S201.

  In step S <b> 201, the sensor unit 331 acquires sensor data from the CMOS imaging device 342 and the CCD imaging device 341 that has been powered on in step S <b> 205, and outputs the sensor data to the sensor data processing unit 332.

  In step S202, the sensor data processing unit 332 extracts data necessary for event detection and event presentation from the acquired sensor data, and generates event processing data.

  In step S <b> 203, the sensor data processing unit 332 transmits the data to the server 312 via the communication unit 334 regardless of whether an event has occurred in the monitoring area. The transmitted event processing data is received by the server 312 in step S241 of FIG. 22 described later, and is used for event detection processing.

  Thereafter, the processes in steps S201 and S203 are repeated until the event detection process is completed.

  When the server 312 determines that the occurrence of the event has ended, a sensor power supply control signal for turning off the CCD imaging device 341 is transmitted from the server 312 by processing in step S259 of FIG. The sensor power supply control signal is received by the communication unit 334 of the multi-sensor camera 311 in the process of step S204 in FIG. 21, and the process proceeds to step S205.

  In step S205, the sensor power supply control unit 335 acquires a sensor power supply control signal from the communication unit 334, and turns off the power of the CCD imaging device 341 based on the sensor power supply control signal.

  Thereafter, event processing data based on the sensor data detected by the CMOS imaging device 342 is transmitted to the server 312 through the processing of steps S201 and S203 until an event is detected by the server 312.

  Next, with reference to FIGS. 22 and 23, a process executed by the server 312 when an event occurs in the monitoring area and when the generation ends after the sensor determination process is performed will be described.

  In step S241, event processing data is received from the multi-sensor camera 311. If it is determined in step S242 that an event to be notified to the user has occurred, the process proceeds to step S243. In step S243, the sensor power supply control command unit 356 determines whether the CCD imaging device 341 is an event detection sensor. In this case, since the CCD imaging device 341 is not an event detection sensor, the process proceeds to step S244.

  In step S244, the sensor power control command unit 356 transmits a sensor power control signal for turning on the power of the CCD imaging device 341 to the multi-sensor camera 311 via the communication unit 351. This sensor power control signal is received by the multi-sensor camera 311 in the process of step S204 of FIG. 21 described above, and the power of the CCD imaging device 341 is turned on in the process of step S205.

  Thereafter, event presentation processing similar to that at the time of event occurrence before the sensor determination processing is performed until the event occurrence ends. However, in step S248, since the CCD imaging device 341 is not an event detection sensor, the sensor data of the CCD imaging device 341 is not used for event determination processing.

  Thereafter, when the occurrence of the event is finished in the monitoring area, it is determined in step S248 that the event is not occurring (the event is finished), and the process proceeds to step S249.

  In step S249, event information is recorded in the event information storage unit 354. In steps S250 and S251, determination input information from the user is acquired and added to the event information, and then the process proceeds to step S252.

  In step S252, in this case, since the sensor determination process has been performed, the process proceeds to step S258. In step S258, the sensor power supply control command unit 356 determines whether or not the CCD imaging device 341 is an event detection sensor. In this case, since the CCD imaging device 341 is not an event detection sensor, the process proceeds to step S259.

  In step S <b> 259, the sensor power control command unit 356 transmits a sensor power control signal for turning off the CCD imaging device 341 to the multi-sensor camera 311 via the communication unit 351. This sensor power control signal is received by the multi-sensor camera 311 in the process of step S204 of FIG. 21 described above, and the power of the CCD imaging device 341 is turned off in the process of step S205.

  If it is determined in step S257 that the user has instructed to end monitoring in the monitoring area, the monitoring process ends. If the user has not instructed monitoring termination, the process returns to step S241 and the subsequent processing is repeatedly executed.

  When the power consumed by the event detection process is large, and when the event processing data is transmitted from the multi-sensor camera 311 to the server 312 and the event detection process is executed by the server 312, the power consumption of the multi-sensor camera 311 can be reduced. The event detection processing can be executed by the server 312 by the processing of the monitoring system 301 described.

  In addition, the above example is an example which implement | achieves the monitoring system 1 and the monitoring system 301, and many other system configurations can be considered. An example is shown below.

  For example, communication between the multi-sensor camera 11 and the server 12 or between the multi-sensor camera 311 and the server 312 is not limited to wireless communication, and may be wired communication.

  Further, the multi-sensor camera 11 or the multi-sensor camera 311 may be provided in a plurality instead of one.

  Furthermore, it is possible to provide a plurality of the presenting units 13 instead of one.

  Further, the server 12 or the server 312 can be integrated with the presenting unit 13 instead of a separate housing.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. It can be installed from a recording medium such as a general-purpose personal computer. In this case, the processing described above is executed by a personal computer 500 as shown in FIG.

  In FIG. 24, a CPU (Central Processing Unit) 501 performs various processes according to a program stored in a ROM (Read Only Memory) 502 or a program loaded from a storage unit 508 to a RAM (Random Access Memory) 503. Execute. The RAM 503 also appropriately stores data necessary for the CPU 501 to execute various processes.

  The CPU 501, ROM 502, and RAM 503 are connected to each other via an internal bus 504. An input / output interface 505 is also connected to the internal bus 504.

  The input / output interface 505 includes an input unit 506 including a keyboard and a mouse, a display including a CRT (Cathode Ray Tube) and an LCD (Liquid Crystal Display), an output unit 507 including a speaker, and a hard disk. A communication unit 509 including a storage unit 508, a modem, a terminal adapter, and the like is connected. A communication unit 509 performs communication processing via various networks including a telephone line and CATV.

  A drive 510 is connected to the input / output interface 505 as necessary, and a removable medium 521 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted, and a computer program read therefrom is It is installed in the storage unit 508 as necessary.

  When a series of processing is executed by software, various functions can be realized by installing a program that constitutes the software in a dedicated dedicated hardware computer or by installing various programs. For example, a general-purpose personal computer or the like that can be executed is installed from a network or a recording medium.

  As shown in FIG. 24, this recording medium is not only composed of a package medium consisting of a removable medium 521 on which a program is recorded, which is distributed to provide a program to the user, separately from the computer. These are configured by a hard disk including a ROM 502 storing a program and a storage unit 508 provided to the user in a state of being pre-installed in the apparatus main body.

  In the present specification, the step of describing a computer program includes not only processing performed in time series according to the described order but also processing executed in parallel or individually even if not necessarily processed in time series. Is also included.

  Further, in the present specification, the term “system” means an overall apparatus constituted by a plurality of apparatuses and means.

It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a block diagram which shows the functional structure of one Embodiment of the multi sensor camera of FIG. It is a block diagram which shows the functional structure of one Embodiment of the server of FIG. It is a figure which shows the characteristic of the sensor mounted in the multi sensor camera of FIG. It is a figure which shows the example of an image detected with the multi sensor camera of FIG. It is a figure which shows the example of an image detected with the multi sensor camera of FIG. It is a figure which shows the example of an image detected with the multi sensor camera of FIG. It is a figure which shows the example of an image detected with the multi sensor camera of FIG. It is a figure which shows the characteristic of the sensor mounted in the multi sensor camera of FIG. It is a flowchart explaining the monitoring process in the multi-sensor camera of FIG. It is a flowchart explaining the monitoring process in the multi-sensor camera of FIG. It is a flowchart explaining the monitoring process in the server of FIG. It is a flowchart explaining the monitoring process in the server of FIG. It is a flowchart explaining the sensor determination process in the server of FIG. It is a figure which shows the example of the event information by the monitoring system of FIG. It is a block diagram which shows the functional structure of one Embodiment of the multi sensor camera of FIG. It is a figure which shows the example of the event information by the monitoring system of FIG. It is a figure which shows the structure of one Embodiment of the monitoring system to which this invention is applied. It is a block diagram which shows the functional structure of one Embodiment of the multi sensor camera of FIG. It is a block diagram which shows the functional structure of one Embodiment of the server of FIG. It is a flowchart explaining the monitoring process in the camera of FIG. It is a flowchart explaining the monitoring process in the server of FIG. It is a flowchart explaining the monitoring process in the server of FIG. And FIG. 16 is a block diagram illustrating a configuration example of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Surveillance system, 11 Multi sensor camera, 12 Server, 13 Presentation part, 31 Sensor part, 32 Sensor data processing part, 33 Event detection part, 34 Communication part, 35 Sensor power supply control part, 36 Battery, 51 Communication part, 52 Event Presentation control unit, 53 user input interface unit, 54 event information storage unit, 55 sensor determination unit, 56 sensor power supply control command unit, 301 monitoring system, 311 multi-sensor camera, 312 server, 357 event detection unit

Claims (26)

Event detection means for detecting the occurrence of an event based on data output by a plurality of sensors;
Presentation control means for controlling the presentation of the event detected by the event detection means;
Input acquisition means for acquiring an input of judgment by a user as to whether notification of an event presented based on the control of the presentation control means is necessary;
Capability determination means for determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A monitoring system comprising: power control means for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capability determination means. The capability determination means requires the user to notify each of the plurality of sensors based on whether or not the probability of detecting an event determined to be required by the user is greater than or equal to a predetermined threshold. Determine whether you have the ability to detect events
The monitoring system according to claim 1, wherein the power control unit executes control to turn off a power of a sensor that is determined not to have an ability to detect an event that requires notification by a user. The power control unit is configured to perform control to turn off the power of sensors other than the sensor with the least power consumption, which is determined to have an ability of detecting an event that requires notification from the user among the plurality of sensors. The monitoring system according to claim 2. The power control means executes control to turn on the power of a sensor that can detect an event with the largest amount of information when the occurrence of an event is detected by the event detection means, when the power of the sensor that can detect the event with the largest amount of information is turned off. The monitoring system according to claim 1. The event detection means, the presentation control means, the input acquisition means, the capability determination means, and the power supply control means are arranged separately in any of the first information processing apparatus and the second information processing apparatus. The monitoring system according to claim 1. The event detection means and the power supply control means are arranged in the first information processing apparatus,
The monitoring system according to claim 5, wherein the presentation control unit, the capability determination unit, and the input acquisition unit are arranged in the second information processing apparatus. The power control means is disposed in the first information processing apparatus,
The monitoring system according to claim 5, wherein the presentation control unit, the ability determination unit, the input acquisition unit, and the event detection unit are arranged in the second information processing apparatus. Surveillance system
An event detection step for detecting the occurrence of an event based on data output from a plurality of sensors;
A presentation control step for controlling the presentation of the event detected by the event detection step;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
An information processing method including: a power control step for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capability determination step. An event detection step for detecting the occurrence of an event based on data output from a plurality of sensors;
A presentation control step for controlling the presentation of the event detected by the event detection step;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A program for causing a computer to execute a process including: a power control step for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capability determination step. Multiple sensors,
The data output from the plurality of sensors is transmitted to another information processing apparatus, and the event that is determined to be notified by the user among the events detected based on the data in the other information processing apparatus. A communication means for receiving the determination results of the capabilities of the plurality of sensors determined based on the probability detected by each sensor from the other information processing apparatus;
An information processing apparatus comprising: power control means for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. Multiple sensors,
Event detection means for detecting occurrence of an event based on data output from the plurality of sensors and generating notification data for notifying the event;
The notification data generated by the event detection means is transmitted to another information processing apparatus, and the other information processing apparatus determines that notification is required by the user among the events detected by the event detection means. Communication means for receiving the determination result of the capabilities of the plurality of sensors determined based on the probability that each sensor has detected the event, from the other information processing apparatus;
An information processing apparatus comprising: power control means for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. The said power supply control part performs control which turns off the power supply of the sensor determined that it is not capable of detecting the event which the said user requires notification in said other information processing apparatus. Information processing device. The power control means is determined to have an ability to detect an event that requires a user notification in the other information processing apparatus among the plurality of sensors, and sensors other than the sensor that consumes the least power. The information processing apparatus according to claim 10 or 11, wherein control for turning off the power is executed. The power supply control unit executes control to turn on the power of a sensor that can detect the event with the largest amount of information when the occurrence of the event is detected, when the power of the sensor that can detect the event with the largest amount of information is turned off. The information processing apparatus described in 1. An information processing apparatus including a plurality of sensors
A transmission step of transmitting data output from the plurality of sensors to another information processing apparatus;
In the other information processing apparatus, the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be notified by the user among events detected based on the data A receiving step of receiving the determination result of the other information processing apparatus;
A power control step of performing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. A transmission step of transmitting data output by a plurality of sensors to another information processing apparatus;
In the other information processing apparatus, the capabilities of the plurality of sensors determined based on the probability that each sensor has detected an event determined to be notified by the user among events detected based on the data A receiving step of receiving the determination result of the other information processing apparatus;
A program for causing a computer to execute a process including: a power supply control step for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. An information processing apparatus including a plurality of sensors
An event detection step of detecting occurrence of an event based on data output from the plurality of sensors and generating notification data for notifying the event;
A transmission step of transmitting the notification data generated by the process of the event detection step to another information processing device;
In the other information processing apparatus, the plurality of sensors determined based on a probability that each sensor has detected an event determined to be notified by a user among events detected by the process of the event detection step. A reception step of receiving the determination result of the ability from the other information processing apparatus;
A power control step of performing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. An event detection step of detecting the occurrence of an event based on data output from a plurality of sensors and generating notification data for notifying the event;
A transmission step of transmitting the notification data generated by the process of the event detection step to another information processing device;
In the other information processing apparatus, the plurality of sensors determined based on a probability that each sensor has detected an event determined to be notified by a user among events detected by the process of the event detection step. A reception step of receiving the determination result of the ability from the other information processing apparatus;
A program for causing a computer to execute a process including: a power supply control step for executing control for turning on or off the power of each of the plurality of sensors based on a determination result of the capabilities of the plurality of sensors. Communication means for receiving data output from the plurality of sensors from another information processing apparatus including a plurality of sensors;
Event detection means for detecting the occurrence of an event based on the data received from the other information processing apparatus;
Presentation control means for controlling the presentation of the event detected by the event detection means;
Input acquisition means for acquiring an input of judgment by a user as to whether notification of an event presented based on the control of the presentation control means is necessary;
A capability determination means for determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by a user;
The communication means transmits the determination result of the capabilities of the plurality of sensors to the other information processing apparatus. A communication means for receiving notification data for notifying an event in which an occurrence is detected based on data output from the plurality of sensors from another information processing apparatus including the plurality of sensors;
Presentation control means for controlling the presentation of an event based on the notification data;
Input acquisition means for acquiring an input of judgment by a user as to whether notification of an event presented based on the control of the presentation control means is necessary;
A capability determination means for determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by a user;
The communication means transmits the determination result of the capabilities of the plurality of sensors to the other information processing apparatus. Further comprising power control means for generating a power control signal for turning on or off the power of the plurality of sensors based on the determination results of the capabilities of the plurality of sensors,
The information processing apparatus according to claim 19 or 20, wherein the transmission unit transmits the power control signal to the other information processing apparatus instead of the determination result of the capabilities of the plurality of sensors. Information processing device
A receiving step of receiving data output from the plurality of sensors from another information processing apparatus including the plurality of sensors;
An event detection step of detecting the occurrence of an event based on the data received from the other information processing apparatus;
A presentation control step for controlling the presentation of the event detected by the process of the event detection step;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A transmission step of transmitting the determination results of the capabilities of the plurality of sensors to the other information processing apparatus. A receiving step of receiving data output from the plurality of sensors from another information processing apparatus including the plurality of sensors;
An event detection step of detecting the occurrence of an event based on the data received from the other information processing apparatus;
A presentation control step for controlling the presentation of the event detected by the process of the event detection step;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A program for causing a computer to execute processing including a transmission step of transmitting determination results of the capabilities of the plurality of sensors to the other information processing apparatus. Information processing device
A receiving step for receiving notification data for notifying an event in which an occurrence is detected based on data output from the plurality of sensors from another information processing apparatus including the plurality of sensors;
A presentation control step for controlling the presentation of an event based on the notification data;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A transmission step of transmitting the determination results of the capabilities of the plurality of sensors to the other information processing apparatus. A receiving step for receiving notification data for notifying an event in which an occurrence is detected based on data output from the plurality of sensors from another information processing apparatus including the plurality of sensors;
A presentation control step for controlling the presentation of an event based on the notification data;
An input acquisition step of acquiring an input of judgment by a user as to whether or not notification of an event presented by the processing of the presentation control step is necessary;
A capability determination step of determining the capabilities of the plurality of sensors based on the probability that each sensor has detected an event determined to be notified by the user;
A program for causing a computer to execute processing including a transmission step of transmitting determination results of the capabilities of the plurality of sensors to the other information processing apparatus.   A computer-readable recording medium on which the program according to any one of claims 9, 16, 18, 18, 23, and 25 is recorded.

Images