JP7745453B2 - Information processing device, control method and program for information processing device - Google Patents

Description

The present invention relates to an information processing device, a control method for an information processing device, and a program.

In recent years, the demand for live streaming and video production has grown with the increase in online events and other events. Examples include filming entertainment events such as music events and plays, e-learning systems for lectures, and business applications such as online presentations and online meetings. Furthermore, lectures are often recorded and live streamed by installing cameras in existing classrooms that do not have streaming or filming equipment, and filming is done with as few cameras as possible. As mentioned above, filming takes place in a variety of locations, and space for equipment, cameramen, and operators is often limited, so filming is often done with a small number of people.

When capturing video in these situations, the preset function of a PTZ (pan-tilt-zoom) camera is used, which allows a single camera to capture multiple angles of view. Pan and tilt are functions that rotate the lens or the entire camera horizontally and vertically, respectively, relative to the surface on which the camera is installed. Zoom is a function that enlarges or reduces the image output by the camera's image sensor. The camera's preset function allows the operator operating the camera to specify PTZ values in advance to determine the capture area, and includes functions such as preset patrol, which automatically patrols through multiple capture areas, and preset movement, which allows the operator to specify a specific preset to change the capture area.

Patent Document 1 discloses a technology that automatically captures high-quality images by assigning a composition score to image data input from an imaging sensor during preset rotation of a PTZ camera. Composition in photographs and videos refers to the subjects that make up the image, the position of the subjects on the screen, and the size of the subjects that occupy the screen.

Patent No. 6729572

However, with conventional technology, when the shooting area is moved by specifying a preset, if the subject moves in the new shooting area, the operator is unable to continue shooting with the intended composition. If the intended composition is not achieved, the operator must manually operate the camera to correct the angle of view after moving the preset, and manual PTZ causes image blurring, making it difficult to capture continuous, smooth images. As such, there is an issue of it being difficult to capture appropriate images when the subject's position changes.

The present invention was made in consideration of the above-mentioned problems, and aims to provide technology for capturing appropriate images even when the subject's position changes.

To achieve the above object, an information processing device according to one aspect of the present invention comprises:
a receiving means for receiving an instruction to change an area photographed by the first photographing means from the first photographing area to the second photographing area;
an acquisition means for acquiring, when the instruction is received by the receiving means , position information of a subject associated in advance with the second photographing area based on an image acquired by a second photographing means having a wider angle than the first photographing means;
a difference acquiring means for acquiring a difference between a predetermined position in the second photographing area and a position of the subject based on the position information;
a change unit that changes the angle of view of the first image capturing unit based on the difference to change the second image capturing area;
Equipped with
The change means is characterized in that, when there are multiple subjects that are pre-associated with the second shooting area and the area size of the multiple subjects changes due to movement of the multiple subjects, it changes the angle of view after the change in accordance with the area size of the multiple subjects before the change .

This invention makes it possible to capture appropriate images even when the subject's position changes.

FIG. 1 is a diagram showing an example of the configuration of an information processing system according to an embodiment. FIG. 10 is a conceptual diagram illustrating an example of a situation change over time according to an embodiment. FIG. 1 is a diagram showing an example of the hardware configuration of an information processing apparatus according to an embodiment. FIG. 2 is a diagram showing an example of a software logical configuration (functional configuration) of an information processing apparatus according to an embodiment. 10 is a flowchart showing a procedure of a process performed by an information processing apparatus according to an embodiment when registering a preset. FIG. 10 is an explanatory diagram of information stored by an information processing apparatus according to an embodiment at the time of preset registration. 10 is a flowchart showing a procedure of a process performed by an information processing device according to an embodiment when capturing video. 10A and 10B are diagrams illustrating an example of correction when a composition in which a subject is at the center of the screen is not established according to an embodiment. 10A and 10B are diagrams illustrating an example of correction when the number of subjects to be photographed changes according to an embodiment. 10A to 10C are diagrams showing examples of correction when the size of a subject being photographed changes according to an embodiment.

The following describes the embodiments in detail with reference to the attached drawings. Note that the following embodiments do not limit the scope of the claimed invention. Although the embodiments describe multiple features, not all of these features are necessarily essential to the invention, and multiple features may be combined in any desired manner. Furthermore, in the attached drawings, the same reference numbers are used to designate identical or similar components, and redundant explanations will be omitted.

<System Configuration>
An example of the configuration of an information processing system including multiple cameras according to this embodiment will be described with reference to FIG.

The system according to this embodiment includes an information processing device 101, a PTZ camera 103, and an overhead camera 104, which are connected via a network 102. Multiple presets can be registered in the PTZ camera 103. A preset is information in which an operator operating the PTZ camera 103 specifies a PTZ value in advance to define a shooting area. When registering a preset, the subject included in the shooting area is associated with the shooting area. For example, when registering a preset in a situation where a subject is located at a specific position in the shooting area, the shooting area is registered by associating it with the position (initial position) of the subject within the shooting area.

By specifying a preset via the information processing device 101, the operator outputs an instruction to change the shooting area to the PTZ camera 103. There is a one-to-one relationship between the above-mentioned shooting areas and presets. In this configuration example, the PTZ camera 103 is a camera that captures images of a subject in various compositions and is a camera that can control at least one of pan, tilt, and zoom. The overhead camera 104 is a wide-angle camera that can capture all of the shooting areas set by the multiple presets set in the PTZ camera 103. In other words, the overhead camera 104 is a camera that captures an image overlooking the shooting area captured by the PTZ camera 103. Subject position information is obtained based on the image captured by this overhead camera 104. The images captured by the PTZ camera 103 and overhead camera 104 may be recorded on each camera or on a storage device connected via the network 102.

The information processing device 101 is a computer device that performs the above-described operations, and can be configured as a personal computer, smartphone, tablet terminal device, or the like. Furthermore, the preset switching may be performed automatically by programming a preset tour in the information processing device 101 or the PTZ camera 103, rather than manually by an operator. Note that Figure 1 shows the main components of the system of this embodiment that will be referenced in the following description, and further devices may be included in addition to the components shown. For example, there may be multiple PTZ cameras and overhead cameras. Furthermore, other devices such as a server device that operates the cameras and controls image transmission, and a device that relays data communications may also be included.

<Photography conditions and photographic area>
The movement of the shooting conditions and shooting area (preset) according to this embodiment will be described with reference to Fig. 2. In Fig. 2, situations that change over time are represented by time t1 shown in situation 21, time t2 shown in situation 22, time t3 shown in situation 23, and time t4 shown in situation 24. In this embodiment, preset A, in which a shooting area 205 for shooting a subject 201 is set, and preset B, in which a shooting area 203 for shooting a subject 202 is set, are registered in the PTZ camera 103.

First, at time t1, preset B is specified by the operator for the PTZ camera 103, and the PTZ camera 103 is capturing an image of subject 202 in the capture area 203. At time t2, the operator specifies capturing an image of preset A. The PTZ camera 103, having specified preset A, captures an image of subject 201 in the capture area 205. At time t3, subject 202, the subject being captured by preset B, moves. At this time, the information processing device 101 detects from the image of the overhead camera 104 that the subject 202 captured within the capture area 204 acquired from the overhead camera 104 has moved, and is able to acquire position information for the subject 202.

At time t4, when the operator again specifies preset B, the information processing device 101 issues a PTZ instruction to the PTZ camera 103 to change the shooting area 203 set in preset B, which captures the subject 202 before movement, to the shooting area 207, which captures the subject 202 after movement, based on the position information of the subject 202 acquired from the image of the overhead camera 104.

<Hardware configuration>
Fig. 3 is a diagram showing an example of the hardware configuration of an information processing device 101 according to this embodiment. The information processing device 101 according to this embodiment will be described using Fig. 3. The information processing device 101 has a CPU 301, a RAM 302, a ROM 303, an operation unit 304, an output control unit 305, and a communication I/F 306. Note that in the example of Fig. 3, the information processing device 101, the PTZ camera 103, and the overhead camera 104 are all connected to a network 102 such as a LAN, but the form of the network connecting each device can take various forms and is not limited to a specific form.

CPU 301 is one or more CPUs that operate based on programs stored in ROM 303 and control the entire information processing device 101. ROM 303 stores a boot program executed by CPU 301 when the information processing device 101 starts up, an instruction program for executing the processing of the information processing device 101, and data used by these programs.

The CPU 301 controls output devices such as displays and input devices such as keyboards, mice, camera controllers, and camera switchers via the operation unit 304 and output control unit 305. The CPU 301 acquires data via the operation unit 304. The CPU 301 also outputs generated data to output devices via the output control unit 305. For example, when the hardware configuration in FIG. 3 functions as the information processing device 101 according to the embodiment, the CPU 301 of the information processing device 101 realizes the functions of the information processing device 101 by executing a program loaded on the RAM 302.

The communication I/F 306 receives data from other devices via the network 102 and sends it to the CPU 301, and transmits data generated by the CPU 301 to other devices such as the PTZ camera 103 and the overhead camera 104 via the network 102. Furthermore, devices connected to these networks communicate with the information processing device 101 via the communication I/F 306. The ROM 303 also stores image data acquired by the PTZ camera 103 and the overhead camera 104 from the network 102 via the communication I/F 306. The CPU 301 of the information processing device 101 loads these programs from the ROM 303 into the RAM 302 and executes them, but as another example, these programs may be acquired from other devices via the communication I/F 306.

<Software configuration (functional configuration)>
4 is a diagram showing an example of the software logical configuration (functional configuration) of the information processing device 101 according to this embodiment. The information processing device 101 includes an image acquisition unit 401, a subject extraction unit 402, a position information acquisition unit 403, a position change amount acquisition unit 404, a correction unit 405, an imaging control unit 406, a preset instruction receiving unit 413, and a preset registration unit 414. In FIG. 4, reference numeral 410 denotes image data, 411 denotes subject information data, 412 denotes position information data, and 415 denotes preset information.

The image acquisition unit 401 acquires image data 410 from the PTZ camera 103 and/or the overhead camera 104. The subject extraction unit 402 extracts subjects from the images acquired by the image acquisition unit 401 and acquires subject information data 411. The position information acquisition unit 403 acquires position information data 412 of the subjects extracted from the images from the overhead camera 104.

The position change amount acquisition unit 404 acquires the position change amount of the subject based on the difference between the extracted position information of the subject and the initial position of the subject within the shooting area in the preset information (difference acquisition). If the position change amount is equal to or greater than a threshold, the correction unit 405 corrects the shooting area corresponding to the preset instruction received by the preset instruction receiving unit 413 based on the position change amount. The shooting control unit 406 controls the PTZ camera 103 to capture the shooting area corrected by the correction unit 405, or to capture the shooting area corresponding to the preset instruction if no correction is made by the correction unit 405.

The preset instruction receiving unit 413 receives an instruction to change the shooting composition of the PTZ camera 103 by specifying one of multiple presets. The preset registration unit 414 generates and registers preset information that can identify the subject that existed at the time of preset registration and the subject's position information, based on the subject information data 411 and position information data 412.

The following describes the processing performed by the information processing device 101 having the logical configuration shown in Figure 4, with reference to the flowcharts in Figures 5 and 7. Note that the following description focuses on the components shown in Figure 4, or the functional components that make up the components, as the main actors in the processing. However, in reality, the functions of the functional components of the information processing device 101 are realized by the CPU 301 executing a computer program that causes the CPU 301 to realize the functions of the functional components of the information processing device 101. Note that the functional components shown in Figure 4 may also be implemented in hardware.

<Processing when registering presets>
5 is a flowchart showing the procedure of a process performed by the information processing apparatus according to this embodiment when registering a preset. The following preset registration process is performed when registering one preset for a photographing composition. When registering multiple presets, the processes from step S501 to step S504 shown in FIG. 5 are repeated.

In step S501, when the operator instructs preset registration, the image acquisition unit 401 acquires image data 410 from the PTZ camera 103 and the overhead camera 104 and stores it in RAM 302. The image data may be a still image or one frame of a series of frames from a video.

In step S502, the subject extraction unit 402 extracts subjects such as subject 201 and subject 202 as shown in Figure 2 from the acquired image data. The extracted subject information data 411 is output to the position information acquisition unit 403. General object recognition is a widely known method of object recognition using images, but in this embodiment, the subjects to be extracted are not limited to people; any subject that can be recognized from an image may be extracted. However, it is also possible to determine the subjects to be extracted in advance, or to exclude subjects that are unnecessary for reproducing the composition from the subjects to be extracted.

In step S503, the position information acquisition unit 403 acquires position information of the subject (position at the time of preset registration) extracted from the image data of the overhead camera 104 in accordance with the subject information data 411, and outputs position information data 412. At this time, the position information acquisition unit 403 associates the image acquired from the PTZ camera 103 with the subject included in the image acquired from the overhead camera 104, and acquires only the position information of the subject included in the image from the PTZ camera 103. Feature matching is a widely known method for associating the same subject appearing in different images. Other known methods for acquiring a position from an image include acquiring the actual coordinates of the subject by placing a reference marker in advance, and performing calculations based on the blurred shape of the image, and the method for acquiring position information is not particularly limited.

The subject position may be the coordinates of the center position (e.g., center of gravity) of the subject area of a person or other object recognized from the image, or, if a specific part of the subject is photographed using a preset, the center coordinates of the part area (e.g., center of gravity coordinates) may be used as the subject position.

In step S504, the preset registration unit 414 outputs preset information 415 that can identify the subject and the subject's position information based on the subject information data 411 and the position information data 412. The subject's position registered here becomes the initial position.

<Example of preset information>
An example of the preset information 415 according to this embodiment will now be described with reference to Fig. 6. The saved preset information is information associated with a PTZ value that specifies the shooting area of the PTZ camera 103, and includes a preset ID, a subject ID, subject identification information, and information on the initial position, and can also store information on the current position.

Presets and subjects are assigned a preset ID and subject ID that allow them to be uniquely identified, respectively. Subject identification information is information about the subject's features used when extracting the subject from an image or when obtaining location information from an image. Subject identification information can be any information that can identify the subject with high accuracy.

The current position can also be stored as information about the subject's current location. The current position is set to a value similar to the initial position, and is updated by the process described below with reference to Figure 7. Therefore, when processing is first started, there will be no current position information, and only information about the initial position will be included.

By storing the preset ID, subject ID, subject identification information, and initial position of the subject in association with each other, when a preset is specified, information about the subject included in the specified preset and the initial position of that subject at the time the preset was registered can be obtained.

Furthermore, if there are multiple subjects within the same preset, the position information for each of the subjects may be obtained and saved separately. In this case, multiple subject IDs, multiple subject identification information, multiple initial positions, and multiple current positions will be associated with one preset ID.

<Processing during shooting>
7 is a flowchart showing the procedure of processing during video capture according to this embodiment. This processing may start when video recording begins. Alternatively, the processing may start when the information processing system is started, or after one or more presets have been registered.

In step S701, the image acquisition unit 401 acquires an image from the overhead camera 104 and outputs image data 410 to the subject extraction unit 402. In step S702, the subject extraction unit 402 acquires pre-registered preset information 415. The subject extraction unit 402 then extracts a subject from the image data 410 in accordance with the preset information 415 and outputs subject information data 411 to the position information acquisition unit 403.

In step S703, the position information acquisition unit 403 acquires the current position of the subject extracted from the image data of the overhead camera 104 in accordance with the subject information data 411, and updates the current position of the subject included in the preset information 415. The current positions of all subjects that are included in the preset information 415 and that can be detected from images acquired from the overhead camera 104 are subject to updating.

In step S704, the preset designation receiving unit 413 determines whether a preset designation for instructing a change in the shooting area has been received from the operator. If a preset designation has been received, the preset ID of the designated preset is output to the position change amount acquisition unit 404, and the process proceeds to step S705. On the other hand, if a preset designation has not been received, the process returns to step S701.

Note that the processing from step S701 to step S704 may be performed each time a frame of video is captured, depending on the frame rate of the overhead camera 104, or the number of times the processing is repeated within a specific time period may be set arbitrarily.

In step S705, the position change amount acquisition unit 404 acquires position information, etc. associated with the input preset ID from the preset information 415, and calculates and acquires the position change amount by comparing the initial position of the subject at the time of preset registration with the current position.

In step S706, the correction unit 405 determines whether the amount of change in subject position is equal to or greater than a threshold. If the amount of change in subject position is equal to or greater than the threshold, it can be determined that PTZ angle of view correction is necessary because it will affect the composition, and the process proceeds to step S707. On the other hand, if the amount of change in subject position is less than the threshold, the process proceeds to step S709. The threshold may be set to any value.

In step S707, the correction unit 405 determines the PTZ value of the PTZ camera 103 calculated in accordance with the change in position of the subject. The corrected (changed) PTZ value is determined by converting the calculation result of the amount of position change output by the correction value calculation unit 406 into the coordinate system used by the PTZ camera 103. For example, the PTZ value is determined by controlling the imaging direction and zoom magnification based on the current position of the subject so that the imaging area has the same composition as when the preset was registered. An example of correcting this PTZ value will be described later.

In step S708, the imaging control unit 409 outputs the corrected PTZ value to the PTZ camera 103, thereby performing PTZ movement of the PTZ camera 103. In step S709, the imaging control unit 409 outputs the preset PTZ value to the PTZ camera 103, thereby performing PTZ movement of the PTZ camera 103. This completes the series of processes in Figure 7.

<PTZ value correction>
Next, an example of PTZ value correction according to this embodiment will be described with reference to FIGS. 8(a) to 8(d) and 10(a) to 10(c).

Figures 8(a) to 8(d) show examples of corrections made when a composition with the subject at the center of the screen cannot be achieved due to subject movement. First, Figure 8(a) shows an example of an image captured by the PTZ camera 103 using the PTZ value set when registering a preset. The preset shown in Figure 8(a) sets a shooting area for capturing a person as the subject, with the entire head included in the shooting area.

Figure 8 (b) shows an example of an image captured by the PTZ camera 103 at the PTZ value set during preset registration after the subject's head has moved from the center position of the shooting area at the time of preset registration. The center of the subject's head after the movement is indicated as point P.

Figure 8(c) shows an example of correction values when performing angle of view correction. For example, as shown in Figure 8(c), the correction value for the PTZ camera 103 can be calculated by calculating the pan and tilt distances from point P using the center of the screen as a reference. In the case of Figure 8(c), since the distance from the PTZ camera 103 does not change, the pan and tilt distances from point P are correction values x and y, respectively. Therefore, by performing correction to shift the shooting area by correction values x and y as shown in Figure 8(c), it is possible to recreate a composition in which the subject's head can be photographed at the center of the shooting area, as shown in Figure 8(d). In this way, the angle of view is corrected so that the subject is positioned at the center of the shooting area after correction.

Next, Figures 9(a) to 9(d) show examples of correction when the number of subjects changes due to subject movement. First, Figure 9(a) shows an example of an image captured by the PTZ camera 103 using the PTZ value set when the preset was registered. The preset shown in Figure 9(a) has two people as subjects, and the shooting area is set to capture images that include the entire heads of both people.

Figure 9(b) shows an example of comparing the state of the subject before and after movement, viewed from above. In the example after movement shown in Figure 9(b), one of the subjects has moved outside the shooting area captured by the PTZ camera 103 shown in Figure 9(a).

Figure 9 (c) shows an example of an image captured by the PTZ camera 103 using the PTZ value set at the time of preset registration after the subject has moved outside the shooting area at the time of preset registration.

Figure 9 (d) shows an example of an image acquired from the PTZ camera 103 when angle of view correction has been performed. For example, one correction method may be to correct the zoom value of the PTZ camera 103 to the wide side so that both subjects are included in the shooting area. Furthermore, to position the center of gravity of multiple subjects at the center of the screen, the corrected PTZ value may be calculated so that point C, which is the midpoint between points P and Q, which are the centers of the heads of the two people, is positioned at the center of the screen. In this way, the angle of view is corrected so that there is little change in the number of subjects included in the corrected shooting area compared to the number of subjects previously associated with the preset shooting area to be changed.

Figures 10(a) to 10(c) show examples of correction when the size of the subject being photographed changes due to the subject's movement.

First, Figure 10(a) shows an example of an image captured by the PTZ camera 103 using the PTZ value set when the preset was registered. The preset shown in Figure 10(a) sets a shooting area for capturing images of three people as subjects, with the entire heads of all three people included in the shooting area. The head areas are indicated by dotted lines, with the heights of the head areas being A, C, and E, and the widths of the head areas being B, D, and F.

Figure 10(b) shows an example of an image captured by the PTZ camera 103 using the PTZ value set at the time of preset registration when one of the subjects moves closer to the PTZ camera 103. In this example, the size of the subject's area after movement is larger, with height G and width H, than at the time of preset registration, as shown in the figure.

Figure 10(c) shows an example of an image acquired from the PTZ camera 103 when angle of view correction has been performed. For example, one method of correction may be to correct the zoom value of the PTZ camera 103 to the wide side so that the subject area sizes G and H are close to the sizes C and D at the time of preset registration. However, because only one of the three subjects is closer to the PTZ camera 103, if the zoom value is corrected based on that person, the size of the head areas of the remaining two subjects will be smaller than at the time of preset registration.

In such cases, the PTZ value may be adjusted so that the average area size indicated by IxJ, KxL, and MxN becomes the average area size of AxB, CxD, and ExF, for example. In other words, the angle of view is corrected so that the change in the size of the subject included in the corrected shooting area is small relative to the size of the subject previously associated with the preset shooting area to be changed. Alternatively, the maximum or minimum area size may be determined in advance, and the PTZ value may be corrected so that the area falls within the determined size.

If the correction results from Figures 8(a) to 8(d) to 10(a) to 10(c) or other correction methods conflict, the operator may determine in advance which correction content to prioritize. In other words, when using multiple correction methods to correct the angle of view of a PTZ camera, if the multiple correction methods conflict and cannot be executed simultaneously, a predetermined correction method may be prioritized. In other words, of the multiple correction methods (change methods), a correction method (change method) according to a predetermined priority may be executed. In addition, the correction content to prioritize may be determined for each preset. This can further improve the reproducibility of the composition.

The correction method is not limited to the correction examples shown in Figures 8(a) to 8(d) and 10(a) to 10(c). For example, the PTZ value may be corrected in accordance with the movement of the subject. Also, as mentioned above, the subject is not limited to a person, and can be any object that is included in the composition intended by the operator and can be recognized from the image.

If the number of subjects included in the new shooting area increases compared to the number of subjects previously associated with the new shooting area, the angle of view may be corrected so that the subjects previously associated with the shooting area fit within the corrected shooting area and are maximized in size. For example, if the original composition had three subjects A, B, and C in the shooting area, but the subjects moved, increasing the number of subjects A, B, C, and D in the shooting area as a result of this preset movement, the angle of view may be corrected so that subjects A, B, and C fit within the shooting area and so that the size of subjects A, B, and C is maximized within the shooting area. In this case, part or all of subject D may or may not be included within the shooting area as a result. Alternatively, rather than correcting to maximize the center of gravity, the center of gravity of subjects A, B, and C may be corrected to be at the center of the shooting area (e.g., the center of the screen). A combination of these methods may also be used.

As described above, in this embodiment, when the PTZ camera 103 receives an instruction to change the area it captures to a preset area, it acquires information about the current position of the subject associated with the preset from the overhead camera 104 that captures the subject. Then, based on the current position information, it acquires the amount of change in position of the subject from a specified position in the preset area (e.g., the center of the screen), and corrects the preset area by correcting the angle of view of the PTZ camera 103 based on the amount of change in position.

This allows the desired subject to be automatically tracked at the appropriate position, size, etc. when a preset movement is performed, reducing the effort required for adjustments after the preset movement. Therefore, it is possible to capture continuous, smooth video even if the subject's position changes.

(Other embodiments)
The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Therefore, the following claims are appended to clarify the scope of the invention.

101: Information processing device, 103: PTZ camera, 104: Bird's-eye view camera, 401: Image acquisition unit, 402: Subject extraction unit, 403: Position information acquisition unit, 404: Position change amount acquisition unit, 405: Correction unit, 406: Photography control unit, 411: Preset registration unit, 413: Preset instruction reception unit

Claims (12)

a receiving means for receiving an instruction to change an area photographed by the first photographing means from the first photographing area to the second photographing area;
an acquisition means for acquiring, when the instruction is received by the receiving means , position information of a subject associated in advance with the second photographing area based on an image acquired by a second photographing means having a wider angle than the first photographing means;
a difference acquiring means for acquiring a difference between a predetermined position in the second photographing area and a position of the subject based on the position information;
a change unit that changes the angle of view of the first image capturing unit based on the difference to change the second image capturing area;
Equipped with
The information processing device is characterized in that, when there are multiple subjects that are pre-associated with the second shooting area and the area size of the multiple subjects changes due to movement of the multiple subjects, the change means changes the angle of view after the change in accordance with the area size of the multiple subjects before the change . The information processing device described in claim 1, characterized in that the change means changes the second shooting area when the difference is equal to or greater than a threshold, and does not change the second shooting area when the difference is less than the threshold. The information processing device of claim 2 further comprising a control means for controlling the first imaging means so that imaging is performed in accordance with the second imaging area or the imaging area changed by the change means. An information processing device according to any one of claims 1 to 3, characterized in that the change means changes the angle of view so that the subject is positioned at the center of the changed shooting area. An information processing device according to any one of claims 1 to 4, characterized in that the change means changes the angle of view so as to minimize the change in the number of subjects included in the corrected shooting area relative to the number of subjects previously associated with the second shooting area. An information processing device according to any one of claims 1 to 5, characterized in that the change means changes the angle of view so as to reduce the change in size of the subject included in the changed shooting area relative to the size of the subject previously associated with the second shooting area. An information processing device according to any one of claims 1 to 3, characterized in that, when the number of subjects included in the second shooting area increases compared to the number of subjects previously associated with the second shooting area, the change means changes the angle of view so that the subjects previously associated with the second shooting area fit within the shooting area and so that the size of the subjects is maximized within the shooting area. The information processing device described in any one of claims 1 to 7, characterized in that the change means executes a change method from among multiple change methods according to a predetermined priority. the first photographing means is a PTZ camera capable of controlling at least one of pan, tilt, and zoom;
2. The information processing apparatus according to claim 1 , wherein the second image capturing means is an overhead camera that captures an image overlooking the area captured by the first image capturing means. 2. The information processing apparatus according to claim 1, wherein the change means changes the angle of view so that an average value of the area sizes of the plurality of subjects after the change becomes equal to an average value of the area sizes of the plurality of subjects before the change. a receiving step of receiving an instruction to change an area photographed by the first photographing means from the first photographing area to the second photographing area;
an acquisition step of acquiring, when the instruction is received in the receiving step , position information of the subject associated in advance with the second photographing area based on an image acquired by a second photographing means having a wider angle than the first photographing means;
a difference obtaining step of obtaining a difference between a predetermined position in the second photographing area and a position of the subject based on the position information;
a changing step of changing the second photographing area by changing the angle of view of the first photographing means based on the difference;
and
In the change process, when there are a plurality of subjects that are pre-associated with the second shooting area, and the area size of the plurality of subjects changes due to movement of the plurality of subjects, the angle of view after the change is changed according to the area size of the plurality of subjects before the change . A program for causing a computer to function as the information processing device described in any one of claims 1 to 10.