JP3762050B2 - Camera control system, control method thereof, and storage medium storing program for executing control - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a camera control system that remotely controls one or more cameras suitable for use in, for example, a video conference system or a surveillance camera.
[0002]
[Prior art]
Conventionally, the present applicant has developed a camera control system (remote monitoring system) for remotely controlling the imaging direction of a video camera connected to a network such as the Internet or a LAN and acquiring the image of the captured video camera. ing.
[0003]
In such a camera control system, when a plurality of camera clients access the same video camera, even if a control command is issued from the plurality of camera clients, the camera control cannot be performed according to the commands of the plurality of camera clients. Since inconvenience arises, a system in which camera control authority is given to only one camera client is considered.
[0004]
[Problems to be solved by the invention]
However, with the above-described method of giving control rights to only one camera client, camera clients that do not have other control rights cannot freely view their favorite videos.
[0005]
In order to solve such a problem, an object of the present invention is to provide an image in the imaging direction of a video camera according to each preference to all camera clients.
[0006]
[Means for Solving the Problems]
In order to achieve the above-described object, according to the first aspect of the present invention, in the camera control system capable of controlling a video camera by supplying video camera control commands from a plurality of camera clients to the camera server, the camera The client comprises control request issuing means for issuing a control right acquisition request for the video camera, and generating means for generating a control command for the imaging direction of the video camera, and the camera server includes a plurality of video cameras. In response to a request for acquiring control rights of the video camera from the camera client, a control unit that executes imaging in the imaging direction, a storage unit that stores images corresponding to a plurality of imaging directions of the video camera, A permission command issuing means for issuing a camera control permission command and the permission command issuing means. Selecting means for selecting an image to be output from among images stored by the storage means based on a control command from a camera client for which no permission command has been issued, for a camera client for which a permission command has not been issued; It is characterized by providing.
[0007]
According to a second aspect of the present invention, in the first aspect, the control unit causes the video camera to perform imaging based on a predetermined sequence, and executes the predetermined sequence every predetermined time. It is configured.
[0008]
According to a third aspect of the present invention, in the second aspect of the present invention, when the permission command is issued by the permission command issuing means, the prohibiting means for prohibiting the control means from performing imaging of the video camera. It is characterized by having.
[0009]
According to the fourth aspect of the present invention, in the camera server that controls the imaging direction of the video camera based on control commands from a plurality of camera clients, the control for executing imaging in the plurality of imaging directions of the video camera. Means,
Storage means for storing images corresponding to a plurality of imaging directions of the video camera, and a permission command for issuing a permission command for controlling the video camera in response to an acquisition request for the control right of the video camera from the camera client Among the images stored by the storage unit based on a control command from a camera client for which the permission command is not issued to an issuing unit and a camera client for which the permission command is not issued by the permission command issuing unit And selecting means for selecting an image to be output from.
[0010]
According to a fifth aspect of the present invention, in the fourth aspect, the control unit causes the video camera to perform imaging based on a predetermined sequence, and executes the predetermined sequence every predetermined time. It is configured.
[0011]
According to the invention of claim 6, in claim 5, when a permission command is issued by the permission command issuing means, a prohibiting means for prohibiting execution of imaging of the video camera by the control means. It is characterized by having.
[0012]
According to the seventh aspect of the invention, in the camera server control method for controlling the imaging direction of the video camera based on control commands from a plurality of camera clients, imaging in the plurality of imaging directions of the video camera is performed. A control step to be executed; a storage step for storing a plurality of images picked up in the control step corresponding to a plurality of image pickup directions of the video camera; and a request for acquiring control rights of the video camera from the camera client A permission command issuing step for issuing a permission command for controlling the video camera, and a camera client for which the permission command has not been issued to a camera client for which a permission command has not been issued in the permission command issuing step. An image to be output from among a plurality of images stored in the storing step based on a control command from Characterized in that it comprises a selection step of selecting.
[0013]
According to an eighth aspect of the present invention, in the seventh aspect, the control step causes the video camera to perform imaging based on a predetermined sequence, and executes the predetermined sequence every predetermined time. Features.
[0014]
According to the invention according to claim 9, in claim 8, when a permission command is issued by the permission command issuing step, a prohibiting step for prohibiting execution of imaging of the video camera by the control step. It is characterized by having.
[0015]
According to a tenth aspect of the present invention, in the storage medium storing the program for executing the operation processing of the camera server that controls the imaging direction of the video camera based on control commands from a plurality of camera clients, the video Images corresponding to a plurality of imaging directions of the camera are stored, and in response to a video camera control right acquisition request from the camera client, the video camera control permission command is issued, and the permission command is not issued The camera client is caused to select an image to be output from images corresponding to a plurality of imaging directions of the video camera based on a control command from a camera client to which the permission command has not been issued. .
[0016]
According to an eleventh aspect of the present invention, in the tenth aspect, the imaging of the video camera is executed based on a predetermined sequence, and the predetermined sequence is executed every predetermined time.
[0017]
According to a twelfth aspect of the present invention, in the eleventh aspect, when a permission command is issued, execution of imaging by the video camera is prohibited.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the present embodiment, an embodiment on the Internet will be described, but the present invention can also be realized in a LAN by executing the same configuration and operation processing.
[0019]
FIG. 1 is a configuration diagram of a camera control system according to the present embodiment. In FIG. 1, reference numeral 101 denotes a video camera capable of controlling an imaging direction or shooting conditions such as zoom and backlight correction. The camera server 102 is a video camera based on a video camera control command received via a network. Control of the imaging direction of 101 is executed.
[0020]
After acquiring the control right of the video camera 101, the camera client 109 transmits a camera control command to the camera server 102 via the network. As shown in FIG. 1, a plurality of camera clients 109a, 109b,... Are connected to the network. In this embodiment, for simplicity of explanation, a single camera server (video camera) is connected to the network, but a plurality of cameras may be connected.
[0021]
Next, the configuration of the camera server 102 will be described. The ROM 113 stores a program for executing the operation process of the camera server 102. The CPU 105 reads a program stored in the ROM 113 and provides a work area to the CPU 105. A CPU 105 performs overall control of operation processing of the camera server 102.
[0022]
The camera control circuit 103 controls the imaging direction of the video camera 101 via the RS232C interface. The video capture 104 captures video information captured by the video camera 101. Further, the secondary storage device 107 is composed of a hard disk or a flash memory, and stores the video data captured by the video capture 104.
[0023]
The HTTP server 106 transfers data such as video data to the camera client in response to a request from the camera client. The communication interface 108 inputs and outputs data to and from the camera client via the network. The timer 114 measures time.
[0024]
Next, the configuration of the camera client 109 will be described. The ROM 110 stores a program for executing an operation process of the camera client 109, and among them, a WWW browser 110a that is client software for information retrieval for accessing various data on the Internet is also stored. The WWW browser 110a displays an image based on the data acquired from the camera server 102, and further executes an applet program (Java program embedded in the WWW page) sent from the camera server 102. Reference numeral 116 denotes a RAM, and the CPU 117 performs overall control of the entire camera client 109 by reading a program stored in the ROM 110 onto the RAM 116.
[0025]
The bitmap display 118 is a monitor for displaying an image based on the video data transmitted from the camera server 102. The mouse 115 functions as a pointing device, and the communication interface 111 inputs / outputs data to / from the camera server 102 via the network.
[0026]
FIG. 2 shows an example of a screen displayed on the bitmap display 118.
[0027]
An input unit 201 inputs an HTML document in order to make a connection request to the desired camera server 102. When accessing the camera server 102, for example, a description of http://www.foo.co.jp/ is performed. The HTTP server 106 (= www.foo.co.jp) transmits text information to the www browser 110 in response to such a request from the browser.
[0028]
The video display window 202 displays the video transmitted from the camera server 102.
[0029]
The buttons 203a, 203b, 203c, and 203d generate a movement command for moving the cursor 205 by an operation with the mouse 115 and moving the imaging direction of the connected video camera 101 up, down, left, and right by clicking, respectively. To do. When the button 204 is turned on, a signal for requesting acquisition of the control right of the currently connected video camera 101 is generated.
[0030]
FIG. 3 is a flowchart showing an operation process of the camera server 102. In the present embodiment, the camera server 102 stores images captured in a plurality of imaging directions at predetermined time intervals. FIG. 3 is a flowchart showing the processing of the camera server 102. Note that a control program for executing this control is stored in the ROM 113, loaded into the RAM 112 at the time of execution, and executed by the CPU 105.
[0031]
First, in s101, camera parameters are initialized. The camera parameters may include pan, tilt, zoom, backlight correction ON / OFF, and the like, but in this embodiment, only the case of handling the pan and tilt of the video camera 101 will be described.
[0032]
The video camera 101 can control the imaging direction of pan and tilt by an external command. However, when the control range is limited, in this embodiment, the control range is assumed as follows. To do.
0 <pvalue <100 (pvalue: pan angle of the video camera 101)
0 <tvalue <40 (tvalue: tilt angle of the video camera 101)
[0033]
In the present embodiment, the initial values are pvalue = 0 and tvalue = 0. That is, in s102 and s103, the camera parameter setting values when t = 1 are pvalue = 0 and tvalue = 0. Here, it is assumed that the camera parameter values of t = 1 to n are determined in advance and stored in the ROM 113.
[0034]
In s 104, first, video information when t = 1 is acquired from the video camera 101. In s105, the camera parameter information at that time is stored in the secondary storage device 107 together with pvalue = 0 and tvalue = 0 when t = 1. At that time, the file name is “image pvalue tvalue” which means the imaging direction. For example, when pvalue = 10 ° and tvalue = 20 °, the file name is “image 10 20”.
[0035]
In s108, t = t + 1 = 1 + 1 = 2, and then such a process is performed for t = 2. In s106, the above-described process is repeated, and when t ≧ n, this operation is terminated. FIG. 4 is a diagram illustrating the imaging ranges of the image data stored in the secondary storage device 107. The arrows in FIG. 4 indicate the control order of the imaging direction of the video camera 101 of this embodiment. By such an operation process, an image in the entire range in which the imaging direction can be controlled can be recorded.
[0036]
If it is determined in s107 that the predetermined time has elapsed due to the time measured by the timer 114, the process proceeds to s109 to determine whether or not the video camera 101 is controlled. When the video camera 101 is not controlled, the video information is acquired by controlling the imaging direction of the video camera 101 again to set the camera parameter of t = 1 to n, and the video information stored in the secondary storage device 107 is obtained. Update. This process is prohibited when the video camera 101 is controlled by the camera client.
[0037]
FIG. 5 is a flowchart showing an operation process when the camera server 102 receives a control right acquisition request.
[0038]
First, when a control right acquisition request from the camera client is received via the network in s201, it is determined in s202 whether or not the control right of the already connected video camera 101 has been acquired.
[0039]
If the control right of the video camera 101 has not been acquired by another camera client, that is, if the control right has not yet been acquired by any camera client, the process proceeds to s206, and the image captured by the video capture 104 and its image The information regarding the imaging direction is output to the camera client. If a control command for the imaging direction is received from the camera client that made the acquisition request in s207, the imaging direction of the video camera 101 is controlled based on the control command in s208.
[0040]
On the other hand, if the control right of the video camera 101 has already been acquired by another camera client, the process proceeds to s203, and the image stored in the secondary storage device 107 is output to the camera client that made the acquisition request. In this embodiment, first, an image at the center of the control range of the video camera 101 and information regarding the imaging direction at that time are output. If a control command from the camera client is received in s204, a stored image at a position in the imaging direction close to the control command is selected from the secondary storage device 107 and output to the camera client.
[0041]
By performing the processing as described above, it is possible to provide a video in a preferred imaging direction even to a camera client that does not have a control right.
[0042]
FIG. 6 is an operational process flowchart on the camera client side when a control right acquisition request is made for the video camera 101 and a control command is generated. Note that a control program for executing this control is stored in the ROM 113, loaded into the RAM 112 at the time of execution, and executed by the CPU 105.
[0043]
First, variables (pvalue, tvalue) held by the applet are initialized. In the present embodiment, the center of the control range of the video camera 101 (for example, pvalue = 50 degrees, tvalue = 20 degrees) is set as an initial value. Then, a callback that is an execution function when the buttons 203a, 203b, 203c, and 203d (FIG. 2) for controlling the imaging direction of the video camera 101 are turned on is registered.
[0044]
First, the control right acquisition button 204 is turned on, and a control right acquisition request is output to the camera server 102. At this time, it is requested to control to the initial value described above. In s401, when image data and information regarding the imaging direction of the image are received from the camera server 102, an image is displayed on the video display window 202 based on the image data in s402.
[0045]
In s403, it is checked whether there is an input from the user. If there is an input from the user, the process proceeds to s404.
[0046]
In s404, it is checked whether or not the input from the user is the up button 203a. If it is determined that the input is the up button 203a, a command to decrease the value of tvalue by a predetermined value (for example, 10 degrees) is generated in s405. If it is not the input of the up button 203a, the process proceeds to s406.
[0047]
In s406, it is checked whether or not the input from the user is the down button 203b. If it is determined that the input is the down button 203b, a command to increase the value of tvalue by a predetermined value (for example, 10 degrees) is generated in s407. If the input is not the down button 203b, the process proceeds to s408.
[0048]
In s408, it is checked whether or not the input from the user is the left button 203c. If it is determined that the input is the left button 203c, in s409, a command for reducing the value of pvalue by a predetermined value (for example, 10 degrees) is generated. If the input is not the left button 203c, the process proceeds to s410.
[0049]
In s410, it is checked whether or not the input from the user is the right button 203d. If it is determined that the input is the right button 203d, a command to increase the value of pvalue by a predetermined value (for example, 10 degrees) is generated in s411. If not, a predetermined control command is generated.
[0050]
In s412, the control command described above is transmitted to the camera server. For example, if the variables held by the applet are pvalue = 20 degrees and tvalue = 30 degrees, the video camera 101 is transferred by transferring the character string “GET / image 20 30 HTTP / 1.0” to the camera server 102. From the initial value of the imaging direction, an imaging direction that is 20 ° to the right of the pan direction and 30 ° below the tilt direction can be acquired. That is, the character string “GET” is followed by the character string “/ image numerical value 1 numerical value 2”, and then the character string indicating the version of the HTTP protocol to be used. In the flowchart of FIG. 6, when the control right is not acquired and the image stored in advance on the camera server 102 side is output, the control right acquisition button 204 is turned on to always make a control right acquisition request. Can do.
[0051]
In this embodiment, the CPU 117, the RAM 116, and the ROM 110 correspond to the control request issuing means and the generating means, and the CPU 105, the RAM 112, and the ROM 113 correspond to the control means, the permission command issuing means, the selecting means, and the prohibiting means. The storage device 107 corresponds to storage means. The predetermined sequence corresponds to the operation processing of s102 to s106 and s108 in FIG.
[0052]
According to the present invention, a recording medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus is stored in a storage medium. This can also be achieved by reading and executing the program code.
[0053]
In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
[0054]
As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0055]
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. A case where part or all of actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.
[0056]
Further, after the program code read from the storage medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. The CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
[0057]
When the present invention is applied to the storage medium, the program code corresponding to the flowchart described above is stored in the storage medium, but in brief, it is an indispensable module for the camera control system of the present invention. Is stored in a storage medium.
[0058]
【The invention's effect】
As described above, the camera client that does not have the camera control right selects an image stored in advance for a plurality of imaging directions in accordance with the control command and outputs the image. A favorite image can be provided to the user as if the video camera is controlled for all camera clients.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a camera control system.
FIG. 2 is a diagram showing an example of a display screen on the camera client side.
FIG. 3 is an operational process flowchart of the camera server.
FIG. 4 is a diagram showing an imaging range of each of image data stored in the secondary storage device 107.
FIG. 5 is an operational process flowchart of the camera server.
FIG. 6 is an operational process flowchart of the camera client.
[Explanation of symbols]
101 Video Camera 102 Camera Server 103 Camera Control Circuit 104 Video Capture 105 CPU
106 HTTP server 107 Secondary storage device 108 Communication interface 109 Camera client 110 ROM
111 Communication interface 112 RAM
113 ROM
114 Timer 115 Mouse 116 RAM
117 CPU
118 bitmap display

Claims (12)

In a camera control system capable of controlling a video camera by supplying video camera control commands from a plurality of camera clients to a camera server,
The camera client
Control request issuing means for issuing a control right acquisition request for the video camera;
Generating means for generating a control command for the imaging direction of the video camera;
The camera server is
Control means for performing imaging in a plurality of imaging directions of the video camera;
Storage means for storing images corresponding to a plurality of imaging directions of the video camera;
A permission command issuing means for issuing a permission command for controlling the video camera in response to a request for acquiring the control right of the video camera from the camera client;
An image output from the image stored in the storage unit based on a control command from a camera client for which the permission command has not been issued to a camera client for which the permission command has not been issued by the permission command issuing unit. And a selection means for selecting the camera control system.   2. The camera control system according to claim 1, wherein the control means is configured to execute imaging of the video camera based on a predetermined sequence, and to execute the predetermined sequence every predetermined time. .   3. The camera control according to claim 2, further comprising: prohibiting means for prohibiting execution of imaging of the video camera by the control means when the permission instruction is issued by the permission instruction issuing means. system. In the camera server that controls the imaging direction of the video camera based on control commands from a plurality of camera clients,
Control means for performing imaging in a plurality of imaging directions of the video camera;
Storage means for storing images corresponding to a plurality of imaging directions of the video camera;
A permission command issuing means for issuing a permission command for controlling the video camera in response to a request for acquiring the control right of the video camera from the camera client;
An image output from the image stored in the storage unit based on a control command from a camera client for which the permission command has not been issued to a camera client for which the permission command has not been issued by the permission command issuing unit. And a selection means for selecting the camera server.   5. The camera server according to claim 4, wherein the control unit is configured to cause the video camera to perform imaging based on a predetermined sequence and to execute the predetermined sequence every predetermined time.   6. The camera server according to claim 5, further comprising prohibiting means for prohibiting execution of imaging of the video camera by the control means when the permission instruction is issued by the permission instruction issuing means. . In a camera server control method for controlling the imaging direction of a video camera based on control commands from a plurality of camera clients,
A control step of performing imaging in a plurality of imaging directions of the video camera;
A storage step of storing a plurality of images captured in the control step in correspondence with a plurality of imaging directions of the video camera;
A permission command issuing step for issuing a permission command for controlling the video camera in response to a request for acquiring the control right of the video camera from the camera client;
Output from among a plurality of images stored in the storage step based on a control command from a camera client for which the permission command has not been issued to a camera client for which a permission command has not been issued in the permission command issuance step And a selection step of selecting an image to be performed.   8. The method of controlling a camera server according to claim 7, wherein the control step causes the video camera to perform imaging based on a predetermined sequence, and executes the predetermined sequence every predetermined time.   9. The camera server according to claim 8, further comprising a prohibiting step of prohibiting execution of imaging of the video camera by the control step when a permission command is issued by the permission command issuing step. Control method. In a storage medium that stores a program for executing an operation process of a camera server that controls an imaging direction of a video camera based on control commands from a plurality of camera clients,
Storing images corresponding to a plurality of imaging directions of the video camera;
In response to a video camera control right acquisition request from the camera client, a permission command for controlling the video camera is issued, and the permission command is not issued to a camera client for which a permission command has not been issued. A storage medium storing a program for causing an image to be output to be selected from images corresponding to a plurality of imaging directions of the video camera based on a control command from a camera client.   11. A storage medium storing a program according to claim 10, wherein imaging of the video camera is executed based on a predetermined sequence, and the predetermined sequence is executed every predetermined time.   12. The storage medium storing a program according to claim 11, wherein when a permission command is issued, execution of imaging by the video camera is prohibited.

Images