JP7799458B2 - Image capture device, image capture device control method and program - Google Patents

Description

This disclosure relates to an imaging device, a control method for an imaging device, and a program.

Traditionally, surveillance cameras typically track subjects by changing the imaging area using the camera's pan and tilt mechanisms. The Open Network Video Interface Forum (ONVIF) is a common standard for connecting surveillance cameras to video receiving client devices. ONVIF also standardizes a command called MoveAndStartTracking, which starts tracking after driving the imaging mechanism in a specified direction. This command specifies a Profile containing imaging mechanism settings such as VideoSourceConfiguration, which indicates video settings, and PTZConfiguration, which indicates PTZ settings, as well as the imaging mechanism's operating method. This allows the PTZ to be driven using the specified operating method, and then a subject within the imaging area can be tracked. This command determines the operation method by specifying one or more of the following as control values for moving the imaging range: position information, a position in the PTZ coordinate space, a preset position, or a subject identifier.

However, the ONVIF standard requires that each camera stores a subject identifier, so even if the same subject is being captured, different subject identifiers may be assigned. As a result, when attempting to track with multiple cameras, if the subject identifier of one of the cameras is mistakenly specified, an error will be returned, causing inconvenience to the user.

For example, Patent Document 1 discloses a means for selecting one piece of location information from the location information of multiple tracking target candidates to start tracking.

JP 2012-221289 A

Patent Document 1 describes a method for selecting a position to be tracked from multiple pieces of position information, but it has the problem of having to issue different tracking commands to each camera.

The purpose of this disclosure is to enable the sharing of subject identifiers used by multiple imaging devices.

The imaging device has a setting means for, when receiving multiple types of movement control values and an identifier of one subject, setting the identifier of the subject for a subject located at a position where the imaging direction or imaging range has been moved based on one of the multiple types of movement control values , and a control means for, when receiving either the movement control value or the subject identifier, controlling the imaging direction or imaging range to be moved based on the movement control value or the subject identifier.

This disclosure makes it possible to standardize subject identifiers used by multiple imaging devices.

FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. FIG. 2 is a block diagram showing an example of the configuration of a camera. FIG. 2 is a block diagram illustrating an example of the configuration of a client device. 10 is a flowchart illustrating a drive operation determination method. 10 is a flowchart illustrating a drive operation determination method.

(First embodiment)
1 is a diagram showing an example of the configuration of an imaging system according to the first embodiment. The imaging system includes cameras 1000a and 1000b, a client device 2000, and a network 3000. The cameras 1000a and 1000b are each an example of an imaging device.

Multiple cameras 1000a and 1000b are connected to client device 2000 via network 3000 so that they can communicate with each other. Client device 2000 is an example of an external device, and sends control commands such as movement and tracking to cameras 1000a and 1000b. The MoveAndStartTracking command can specify an ObjectID as a movement control value if cameras 1000a and 1000b have detection and tracking functions. Therefore, for example, client device 2000 can continue tracking by assigning the ObjectID of the subject that was being detected and tracked by camera 1000a when sending a command to camera 1000b. Cameras 1000a and 1000b send responses to the commands to client device 2000.

Figure 2 is a block diagram showing an example configuration of camera 1000a in Figure 1. The following explanation uses the configuration of camera 1000a as an example, but camera 1000b also has a similar configuration to camera 1000a. Camera 1000a has a control unit 1001, a memory unit 1002, a communication unit 1003, an imaging unit 1004, and an imaging mechanism 1005.

The control unit 1001 controls the entire camera 1000a. The control unit 1001 is composed of, for example, a CPU.

The memory unit 1002 is used as a storage area for various data. For example, the memory unit 1002 is used primarily as a storage area for programs executed by the control unit 1001 and movement control values assigned to commands (described below). The memory unit 1002 may also function as a work area during program execution.

The communication unit 1003 receives commands, sends responses to each command, and sends various data such as image data stored in the memory unit 1002 to the client device 2000 via the network 3000.

The imaging mechanism 1005 has an imaging optical system consisting of a lens and an imaging element, etc., and pan, tilt, and zoom mechanisms that control the imaging direction and angle of view. The imaging mechanism 1005 has a mechanism that moves the lens orientation in the pan direction (left and right), a tilt mechanism that moves the lens orientation in the tilt direction (up and down), and a zoom mechanism that enlarges and reduces the imaging area using a zoom lens. The imaging mechanism 1005 also generates an imaging signal of the imaged subject through photoelectric conversion of the imaging optical system.

The imaging unit 1004 converts the analog imaging signal generated by the imaging mechanism 1005 into digital data and outputs it as captured image data to the storage unit 1002. The storage unit 1002 stores the captured image data.

The configuration of camera 1000a has been described above using Figure 2, but the processing blocks shown in Figure 2 are an example of camera 1000a and are not limited to this. Camera 1000a can be modified and changed in various ways, such as by including an audio input unit and an audio output unit.

Figure 3 is a block diagram showing an example configuration of the client device 2000 in Figure 1. The client device 2000 has a control unit 2001, a memory unit 2002, a display unit 2003, an input unit 2004, and a communication unit 2005.

The control unit 2001 is composed of, for example, a CPU, and performs overall control of the client device 2000. The memory unit 2002 stores, for example, programs executed by the control unit 2001 and various data such as information on connectable cameras currently present on the network 3000. The memory unit 2002 also functions as a work area while the program is running.

The display unit 2003 is composed of, for example, a liquid crystal display (LCD) and displays various setting screens, data acquisition and display screens, various messages, etc. to the user of the client device 2000. The input unit 2004 is composed of, for example, buttons, a touch panel, or a mouse and transfers the contents of user operations to the control unit 2001.

The communication unit 2005 transmits commands, such as movement requests, to the camera 1000a or camera 1000b via the network 3000, and receives responses to each command from the camera 1000a or camera 1000b.

The configuration of the client device 2000 has been described above using Figure 3, but the above configuration is an example of the configuration of the client device 2000 and is not limited to this. The client device 2000 may have, for example, a received image display unit, an image analysis processing unit, or an image storage unit, and various modifications and variations are possible.

Figure 4 is a flowchart showing the control method for camera 1000a. Below, the control method for camera 1000a will be described as an example, but the control method for camera 1000b is similar to the control method for camera 1000a. The process for linking the subject identifier and the movement control value will be described with reference to the flowchart in Figure 4.

In step S4001, the control unit 1001 receives a MoveAndStartTracking command from the client device 2000 via the communication unit 1003. The MoveAndStartTracking command is a command for driving the imaging mechanism of the imaging unit 1004 in a specified direction and then starting a tracking operation. The MoveAndStartTracking command specifies a Profile and the operation method of the imaging mechanism. The Profile includes a group of setting values for the imaging mechanism, such as VideoSourceConfiguration, which indicates the video settings, and PTZConfiguration, which indicates the PTZ (pan-tilt-zoom) settings. When the camera 1000a receives a MoveAndStartTracking command, it drives the PTZ using the specified operation method, and then can track a subject that exists within the imaging range after driving. The MoveAndStartTracking command determines the operation method by specifying one or more of position information, a position within the PTZ coordinate space, a preset position, and a subject identifier as movement control values for the imaging range. As described above, the MoveAndStartTracking command is a command that moves and tracks based on the movement control values. The client device 2000 can assign one or more movement control values to the MoveAndStartTracking command. The control unit 1001 stores the received MoveAndStartTracking command in the memory unit 1002.

In step S4002, the control unit 1001 acquires the movement control value attached to the MoveAndStartTracking command received in step S4001. Specifically, the control unit 1001 reads the movement control value attached to the MoveAndStartTracking command stored in the memory unit 1002 for the subject identifier and movement control value to be used in steps S4003 to S4007, which will be described later.

In steps S4003 to S4008, the control unit 1001 associates the subject identifier assigned to the MoveAndStartTracking command with a movement control value. The movement control value includes a Geolocation indicating location information, a PresetToken indicating a preset position that has been set in advance, a TargetPosition indicating a position within the PTZ coordinate space, and an ObjectID indicating the subject identifier.

In step S4003, the control unit 1001 determines whether position control values excluding Object ID (identifier of the subject) have been assigned to the MoveAndStartTracking command. If position control values excluding Object ID have been assigned, the control unit 1001 proceeds to step S4004; if position control values excluding Object ID have not been assigned, the control unit 1001 proceeds to step S4007.

In step S4004, the control unit 1001 determines whether an Object ID (identifier of the subject) has been assigned to the MoveAndStartTracking command. If an Object ID has been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S4005. If an Object ID has not been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S4006.

In step S4005, the control unit 1001 associates the movement control values (excluding Object ID) assigned to the MoveAndStartTracking command with the Object ID, and proceeds to step S4010. Specifically, the control unit 1001 sets the assigned Object ID for the subject located at the position indicated by the assigned movement control values (excluding Object ID), and proceeds to step S4010. In step S4010, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

The Object ID assigned to the MoveAndStartTracking command received by camera 1000a from client device 2000 in step S4001 may be the Object ID set by another camera 1000b. Furthermore, the Object ID set by the other camera 1000b may differ from the Object ID set by camera 1000a. In such cases, camera 1000a can set a common Object ID with the other camera 1000b by resetting the Object ID in step S4005. Because camera 1000a can set a common Object ID between multiple cameras 1000a and 1000b, it is possible to resolve inconsistencies in Object IDs between multiple cameras 1000a and 1000b and perform PTZ driving and tracking operations appropriately.

In step S4006, the control unit 1001 determines the movement control values (excluding Object ID) assigned to the MoveAndStartTracking command as the movement control values for the movement of the imaging mechanism 1005 and tracking of the subject, and proceeds to step S4010. In step S4010, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

In step S4007, the control unit 1001 determines whether an Object ID (identifier of the subject) has been assigned to the MoveAndStartTracking command. If an Object ID has been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S4008. If an Object ID has not been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S4009.

In step S4008, the control unit 1001 determines the Object ID assigned to the MoveAndStartTracking command as the movement control value for moving the imaging mechanism 1005 and tracking the subject, and proceeds to step S4010. In step S4010, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

In step S4009, the control unit 1001 determines that an error has occurred and proceeds to step S4010. In step S4010, the control unit 1001 sends a response (error) to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

The control unit 1001 can realize subject detection and subject tracking functions using the imaging unit 1004 and imaging mechanism 1005. The control unit 1001 performs PTZ driving of the imaging mechanism 1005 and subject tracking based on the movement control values determined in step S4006 or S4008.

Above, with reference to Figure 4, a method for linking a movement control value using the MoveAndStartTracking command of the ONVIF standard with a subject identifier has been described, but this is not limiting. Even if an inconsistency occurs, such as the subject being unable to be detected, after the control unit 1001 has moved the imaging mechanism 1005 based on the movement control value, the control unit 1001 may re-determine the movement control value in accordance with Figure 4. The method for determining the movement control value can be modified and changed in various ways.

As described above, in step S4001, the control unit 1001 can receive a MoveAndStartTracking command that includes a movement control value and a subject identifier. The subject identifier is, for example, ObjectID. In this case, in step S4005, the control unit 1001 functions as a setting unit and sets the subject identifier for the subject located at a position to which the imaging direction or imaging range has been moved based on the movement control value.

Also, in step S4001, the control unit 1001 can receive a MoveAndStartTracking command that includes a movement control value. In that case, in step S4006, the control unit 1001 controls the imaging direction or imaging range to move based on that movement control value. Specifically, the control unit 1001 controls the imaging direction or imaging range to move based on that movement control value so as to track a subject that is located at the position to which the imaging direction or imaging range has been moved.

Also, in step S4001, the control unit 1001 can receive a MoveAndStartTracking command that includes a subject identifier. In that case, in step S4008, the control unit 1001 controls the imaging direction or imaging range to move based on the subject identifier. Specifically, the control unit 1001 controls the imaging direction or imaging range to move so as to track the subject whose identifier is set.

In steps S4006 and S4008, the control unit 1001 controls the pan, tilt, or zoom of the imaging mechanism 1005 to move the imaging direction or imaging range.

The above movement control value is, for example, Geolocation, which indicates the location information of the imaging point, PresetToken, which indicates the preset position of the imaging direction or imaging range, or TargetPosition, which indicates the coordinate position within the pan-tilt-zoom coordinate space.

As described above, according to the first embodiment, the control unit 1001 can link the movement control value assigned to the MoveAndStartTracking command with the subject identifier. Even if multiple cameras 1000a and 1000b have set different subject identifiers for the same subject, the subject identifier is re-linked. Even if multiple cameras 1000a and 1000b have set different Object IDs, they can be changed to a common Object ID, making it possible to properly perform PTZ driving and tracking operations without returning an error.

The imaging system can track the same subject using multiple cameras 1000a and 1000b. The control unit 1001 assigns a subject identifier to the subject located at a position based on the movement control value. This allows the subject identifier to be shared between the multiple cameras 1000a and 1000b.

Second Embodiment
An imaging system according to the second embodiment will be described below with reference to Figures 1, 2, 3, and 5. The configuration of the imaging system in Figure 1, the configuration of the camera 1000a in Figure 2, and the configuration of the client device 2000 in Figure 3 are the same as those in the first embodiment.

Figure 5 is a flowchart showing a control method for camera 1000a according to the second embodiment. Below, the control method for camera 1000a will be described as an example, but the control method for camera 1000b is similar to the control method for camera 1000a. With reference to the flowchart in Figure 5, we will explain a method for determining the movement control value to be linked to the subject's identifier when the subject's identifier and multiple movement control values are specified in a command.

In step S5001, the control unit 1001 receives a MoveAndStartTracking command from the client device 2000 via the communication unit 1003. The client device 2000 can assign one or more movement control values to the MoveAndStartTracking command. The control unit 1001 stores the received MoveAndStartTracking command in the memory unit 1002.

In step S5002, the control unit 1001 acquires the movement control value attached to the MoveAndStartTracking command received in step S5001. Specifically, the control unit 1001 reads the movement control value attached to the MoveAndStartTracking command stored in the memory unit 1002 for the subject identifier and movement control value to be used in steps S5003 to S5011, which will be described later.

In steps S5003 to S5012, the control unit 1001 determines the movement control value to use from one or more movement control values assigned to the MoveAndStartTracking command. As described above, the movement control value includes Geolocation, which indicates position information, PresetToken, which indicates a preset position that has been set in advance, TargetPosition, which indicates a position within the PTZ coordinate space, and ObjectID, which indicates the identifier of the subject.

In step S5003, the control unit 1001 determines whether Geolocation is assigned to the MoveAndStartTracking command as a movement control value. If Geolocation is assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5004. If Geolocation is not assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5005.

In step S5004, the control unit 1001 determines whether the positioning accuracy of the geolocation is high. For example, the camera 1000a has an interface that registers and updates positioning methods in the camera 1000a. If the geolocation is positioned using a beacon, the control unit 1001 determines that the positioning accuracy of the geolocation is low. Furthermore, if the geolocation is positioned using position information from a camera whose position information is clear, the control unit 1001 determines that the positioning accuracy of the geolocation is high. Note that the method of determining positioning accuracy is not limited to the above method.

If the positioning accuracy of Geolocation is high, the control unit 1001 proceeds to step S5007. In step S5007, the control unit 1001 determines Geolocation as the movement control value to use, and proceeds to step S5008. If the positioning accuracy of Geolocation is low, the control unit 1001 proceeds to step S5005.

In step S5005, the control unit 1001 determines whether TargetPosition is assigned as a movement control value to the MoveAndStartTracking command. If TargetPosition is assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5007. In step S5007, the control unit 1001 determines TargetPosition as the movement control value to be used, and proceeds to step S5008. If TargetPosition is not assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5006.

In step S5006, the control unit 1001 determines whether a PresetToken has been assigned to the MoveAndStartTracking command as a movement control value. If a PresetToken has been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5007. In step S5007, the control unit 1001 determines the PresetToken as the movement control value to be used, and proceeds to step S5008. If a PresetToken has not been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5011.

In step S5008, the control unit 1001 determines whether an ObjectID has been assigned to the MoveAndStartTracking command. If an ObjectID has been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5009. If an ObjectID has not been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5010.

In step S5009, the control unit 1001 associates the movement control value determined in step S5007 with the Object ID, and proceeds to step S5014. Specifically, the control unit 1001 sets the assigned Object ID for the subject located at the position indicated by the determined movement control value, and proceeds to step S5014. In step S5014, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

The Object ID assigned to the MoveAndStartTracking command received by camera 1000a from client device 2000 in step S5001 may be the Object ID set by another camera 1000b. Furthermore, the Object ID set by the other camera 1000b may differ from the Object ID set by camera 1000a. In such cases, camera 1000a can set a common Object ID with the other camera 1000b by resetting the Object ID in step S5009. Because camera 1000a can set a common Object ID between multiple cameras 1000a and 1000b, it is possible to resolve inconsistencies in Object IDs between multiple cameras 1000a and 1000b and perform PTZ driving and tracking operations appropriately.

In step S5010, the control unit 1001 determines the movement control values determined in step S5007 as the movement control values for the image capture mechanism 1005 and subject tracking, and proceeds to step S5014. In step S5014, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

In step S5011, the control unit 1001 determines whether an Object ID (identifier of the subject) has been assigned to the MoveAndStartTracking command. If an Object ID has been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5012. If an Object ID has not been assigned to the MoveAndStartTracking command, the control unit 1001 proceeds to step S5013.

In step S5012, the control unit 1001 determines the Object ID assigned to the MoveAndStartTracking command as the movement control value for the movement of the imaging mechanism 1005 and the tracking of the subject, and proceeds to step S5014. In step S5014, the control unit 1001 sends a response to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

In step S5013, the control unit 1001 determines that an error has occurred and proceeds to step S5014. In step S5014, the control unit 1001 sends a response (error) to the MoveAndStartTracking command to the client device 2000 via the communication unit 1003.

The control unit 1001 can realize subject detection and subject tracking functions using the imaging unit 1004 and imaging mechanism 1005. The control unit 1001 performs PTZ driving of the imaging mechanism 1005 and subject tracking based on the movement control values determined in step S5010 or S5012.

The method for linking a movement control value using the MoveAndStartTracking command of the ONVIF standard with a subject identifier has been described above with reference to Figure 5, but the method is not limited to this. For example, the control unit 1001 may determine the movement control value to be used from among multiple movement control values assigned to the MoveAndStartTracking command, based on a pre-prepared table of priorities. Even if an inconsistency occurs, such as the subject being unable to be detected, after moving the imaging mechanism 1005 based on the movement control value, the control unit 1001 may re-determine the movement control value in accordance with Figure 5. The method for determining the movement control value can be modified and changed in various ways.

As described above, in step S5001, the control unit 1001 can receive multiple types of movement control values and the identifier of one subject. The subject identifier is, for example, ObjectID. In this case, in step S5009, the control unit 1001 sets the identifier of the subject that is located at a position to which the imaging direction or imaging range has been moved based on one of the multiple types of movement control values.

The multiple types of movement control values described above include, for example, Geolocation and other movement control values. If the positioning accuracy of the Geolocation is high (YES in S5004), the control unit 1001 sets an identifier for the subject located at a position where the imaging direction or imaging range is moved based on the Geolocation (S5009).

Furthermore, if the positioning accuracy of the Geolocation is low (NO in S5004), the control unit 1001 sets an identifier for the subject located at a position to which the imaging direction or imaging range has been moved based on other movement control values (S5009).

In addition, the control unit 1001 may set an identifier for a subject that is located at a position where the imaging direction or imaging range has been moved based on the movement control value with the highest priority among the multiple types of movement control values, based on the table.

In addition, there may be cases where the subject is not present at a position where the imaging direction or imaging range is moved based on one of the multiple types of movement control values. In such cases, the control unit 1001 can set an identifier for the subject that is present at a position where the imaging direction or imaging range is moved based on another of the multiple types of movement control values.

As described above, according to the second embodiment, the control unit 1001 can link the movement control value assigned to the MoveAndStartTracking command with the subject identifier. When an ObjectID and multiple types of movement control values are assigned to the MoveAndStartTracking command, the control unit 1001 can determine the movement control value to use and perform PTZ driving and tracking operations appropriately without returning an error.

When multiple types of movement control values are assigned, the control unit 1001 determines the single most appropriate movement control value to use (S5007) and sets a subject identifier for the subject located at a position based on the determined movement control value (S5009). Note that if the subject is not located at a position based on the determined movement control value, the control unit 1001 can set a subject identifier for a subject located at a position based on another movement control value. This allows the control unit 1001 to share a subject identifier across multiple cameras 1000a and 1000b, allowing movement and tracking.

(Other embodiments)
The present disclosure can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present disclosure can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions.

The above-described embodiments merely illustrate specific examples of how the present disclosure may be implemented, and should not be construed as limiting the technical scope of the present disclosure. In other words, the present disclosure can be implemented in various forms without departing from its technical concept or main features.

1001 Control unit, 1002 Memory unit, 1003 Communication unit, 1004 Imaging unit, 1005 Imaging mechanism

Claims (8)

a setting means for, when receiving a plurality of types of movement control values and an identifier of one subject, setting the identifier of the subject to a position to which an imaging direction or imaging range has been moved based on one of the plurality of types of movement control values ;
and a control means for, when receiving either a movement control value or a subject identifier, controlling the imaging direction or imaging range to move based on the movement control value or the subject identifier. the plurality of types of movement control values include position information of an image capturing point and other movement control values;
The imaging device according to claim 1, characterized in that, when the positioning accuracy of the position information of the imaging point is high, the setting means sets an identifier of the subject to the subject located at a position obtained by moving the imaging direction or imaging range based on the position information of the imaging point, and when the positioning accuracy of the position information of the imaging point is low, the setting means sets an identifier of the subject to the subject located at a position obtained by moving the imaging direction or imaging range based on the other movement control value. The imaging device according to claim 1, characterized in that the setting means sets an identifier of a subject to a position to which the imaging direction or imaging range is moved based on the movement control value with the highest priority among the plurality of types of movement control values. The imaging device of any one of claims 1 to 3, characterized in that, when a subject is not present at a position to which the imaging direction or imaging range is moved based on one of the multiple types of movement control values, the setting means sets an identifier of the subject to a subject that is present at a position to which the imaging direction or imaging range is moved based on another of the multiple types of movement control values. The imaging device described in any one of claims 1 to 4, characterized in that the control means controls panning, tilting, or zooming. An imaging device according to any one of claims 1 to 5, characterized in that the movement control value is position information of the imaging point, a preset position of the imaging direction or imaging range, or a coordinate position within a pan-tilt-zoom coordinate space. a setting step of, when a plurality of types of movement control values and an identifier of one subject are received, setting the identifier of the subject to a position to which an imaging direction or imaging range is moved based on any one of the plurality of types of movement control values ;
and when either a movement control value or an identifier of a subject is received, a control step of controlling to move an imaging direction or an imaging range based on the movement control value or the identifier of the subject. A program for causing a computer to function as each means of the imaging device according to any one of claims 1 to 6 .