JP6626538B2 - Information processing apparatus and control method therefor - Google Patents

Description

  The present invention relates to an information processing apparatus for a passage determination process of an object in an image and a control method thereof.

  Generally, an object in an image is detected by image analysis. By using this technique, an object is tracked on a moving image by detecting an object from each frame image of the moving image. Further, in recent years, by applying this object tracking technology, a surveillance camera system or the like has performed passage detection for determining whether or not the vehicle has passed a certain area on an image plane.

  For example, in Patent Literature 1, passage detection is performed by segmenting a person reflected in a captured image and analyzing whether the segmented image region crosses a predetermined boundary line and then crosses in a specified direction. The technology is disclosed.

JP 2005-506740 A

  As described above, when the segmented object crosses in the designated direction, it can be detected as passing. However, this method alone cannot detect a case where an object protrudes from a designated boundary line. Furthermore, in this method, it is not possible to set a condition for determining that the object has passed, so that a difference occurs between the timing at which the apparatus determines that the object has passed and the timing at which the user actually wants to be notified.

  The present invention has been made in view of the above problems, and has as its object to provide an information processing apparatus and a control method that can flexibly set conditions for passage detection.

An information processing apparatus according to one embodiment of the present invention for achieving the above object has the following configuration. That is,
An information processing device for a passage determination process to determine whether an object has passed a line set in an image captured by the imaging device,
A first area for selecting the passing direction to be used for the passage determination processing among a plurality of passage direction with respect to the lines of the object in the image, including a plurality of figures corresponding to each of the plurality of passage direction display control means for displaying a first area a on the display screen,
Receiving means for receiving, in the first area, an operation of selecting a graphic corresponding to the passing direction to be used for the pass determination processing among the plurality of graphics ,
Each of the plurality of figures is a line, a mark of a first display mode corresponding to one end of the line, and a mark corresponding to the other end of the line, and a mark of a second display mode different from the first display mode. And a mark that intersects the line and that indicates the passing direction .

  According to the present invention, it is possible to flexibly set conditions for passage detection.

FIG. 1 is a diagram illustrating a system configuration example of a passage determination setting system according to a first embodiment. FIG. 2 is a diagram illustrating a hardware configuration of the imaging device 1 according to the first embodiment. FIG. 2 is a diagram illustrating a hardware configuration example of the information processing apparatus 2 according to the first embodiment. FIG. 2 is a diagram showing an example of a functional configuration of the imaging device 1 according to the first embodiment. FIG. 2 is a diagram illustrating a functional configuration example of an information processing apparatus 2 according to the first embodiment. The figure which shows an example of the passage detection setting screen which concerns on 1st embodiment. 5 is a flowchart illustrating a processing example of the imaging device according to the first embodiment. 5 is a flowchart illustrating a processing example of the information processing apparatus according to the first embodiment. 9 is a flowchart illustrating processing for initial setting or changing the setting of passage detection according to the first embodiment. FIG. 6 is a diagram illustrating an example of a hardware configuration of an information processing apparatus 2 according to a second embodiment. The figure which shows an example of the passage detection setting screen which concerns on 2nd embodiment. The figure which shows an example of the setting of a typical determination position. The figure which shows the system configuration example of the passage determination setting system which concerns on 3rd embodiment. The figure which shows an example of the passage detection setting screen concerning 4th Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

[First embodiment]
A passage determination setting system according to the first embodiment will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a system configuration of a passage determination setting system according to the first embodiment. In FIG. 1, an imaging device 1 is, for example, a network camera that can be connected to a network. The information processing device 2 is realized by, for example, a personal computer, performs various settings for the passage determination of the present embodiment, and generates passage determination setting information. The display device 3 displays a graphical user interface generated by the information processing device 2 for performing the pass determination setting. Reference numeral 4 denotes an input device, which is used by a user to operate passage determination setting application software that operates on the information processing device 2.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging device 1. As shown in FIG. 2, the imaging device 1 includes a CPU 11 (Central Processing Unit), a ROM 12 (Read Only Memory), a RAM 13 (Random Access Memory), an imaging unit 14, a Net-IF 15, and a CPU bus 19. The imaging unit 14 includes a lens and a sensor, and outputs a digital image signal. The ROM 12 holds an imaging control software program and information. The CPU 11 executes a control software program stored in the ROM 12 and controls each device. The RAM 13 has a work area for the CPU 11, a save area for information during error processing, a load area for a control software program, an area for storing passage determination setting information described later, and the like. Further, the imaging apparatus 1 can communicate with the information processing apparatus 2 via a network interface (Net-IF 15) via a wired or wireless connection. CPU bus 19 includes an address bus, an information bus, and a control bus. When the CPU 11 executes a process based on a control software program stored in the ROM 12, a process related to a part of the functions of the imaging apparatus 1 described later with reference to FIG. 4 is realized.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the information processing device 2. As shown in FIG. 3, the information processing device 2 includes a CPU 21, an HDD 22, a RAM 23, a display control unit 24, an operation input unit 26, a network interface 25 (Net-IF), and a CPU bus 29. The HDD 22 holds an information processing control software program and information. The CPU 21 executes a control software program stored in the HDD 22, and controls each device.

  The display control unit 24 controls display of a graphical user interface displayed on the display device 3. The operation input unit 26 receives an input signal from the input device 4. The RAM 23 has a work area for the CPU 21, an area for saving information during error processing, an area for loading a control software program, and the like. The network interface (Net-IF) 25 communicates with the imaging device 1 via a wire or wirelessly. CPU bus 29 includes an address bus, an information bus, and a control bus. When the CPU 21 executes a process based on the control software program, a process related to a part of the function of the information processing device 2 described later with reference to FIG. 5 is realized.

  FIG. 4 is a diagram illustrating an example of a functional configuration of the imaging device 1. Each function illustrated in FIG. 4 is realized by the hardware configuration of the imaging device 1 illustrated in FIG. For example, the lens 101, the sensor 102, and the A / D converter 103 in FIG. 4 are realized as the configuration of the imaging unit 14 in FIG. Each processing unit such as the image encoding unit 110 is realized by the CPU 11 executing a program stored in the ROM 12.

  In FIG. 4, a sensor 102 includes an image sensor, converts an optical image formed by the lens 101 into an electric signal, and outputs the electric signal as a sensor signal. The A / D converter 103 digitizes the sensor signal output from the sensor 102. The image generation unit 104 generates an image using a digital signal output from the A / D converter 103. The image encoding unit 110 encodes the image generated by the image generation unit 104. The object detection unit 120 performs image detection on the image (image before encoding) generated by the image generation unit 104 to perform object detection, and determines an image feature of the object detected from the image and a range of the detected object. The object information including the object area indicated by the shape is output. Note that the object detection unit 120 may detect an object by comparing an image with a background by a background difference method. The object determining unit 121 determines whether or not the objects detected in a plurality of images are the same based on the object information (image characteristics) output by the object detecting unit 120 and the distance of the objects between the plurality of images. judge.

  The setting information storage unit 122 is configured by, for example, the RAM 13 and stores passage determination setting information used by the determination position determination unit 123 and the passage determination unit 130. The passage determination setting information includes determination position information indicating a position of the object area used for the passage determination, and information for identifying a boundary line used for the passage determination. The determination position determination unit 123 uses the passage determination setting information (determination position information) read from the setting information storage unit 122 and the object information (object area) detected by the object detection unit 120 to determine that the object has passed. The above determination position is determined for each object existing on the image. In addition, the determination position determination unit 123 associates the determination position of the same object in the object area using the determination result of the object determination unit 121. The passage determination unit 130 determines that the object has passed based on the positional relationship between the determination position of each identical object associated with the determination position determination unit 123 and the boundary indicated by the passage determination setting information stored in the setting information storage unit 122. It is determined whether or not.

  The image information transmission unit 140 transmits the image encoded by the image encoding unit 110, the object information detected by the object detection unit 120, and the pass determination result by the pass determination unit 130 to the information processing device 2 using the Net-IF 15. Send. The setting information transmitting / receiving unit 150 transmits and receives the passage determination setting information to and from the information processing device 2 using the Net-IF 15. For example, the setting information transmitting / receiving unit 150 receives the passage determination setting information set and updated by the information processing device 2 and writes the updated setting in the setting information storage unit 122, or reads the current setting from the setting information storage unit 122 The pass-through determination setting information is read and transmitted to the information processing device 2.

  FIG. 5 is a diagram illustrating an example of a functional configuration of the information processing device 2. Each unit illustrated in FIG. 5 is realized by CPU 21 of information processing device 2 executing a program loaded from HDD 22 to RAM 23, for example. 5, the image information receiving unit 201 receives information transmitted from the image information transmitting unit 140 of the imaging device 1 via the Net-IF 25. The image decoding unit 202 decodes an encoded image (encoded image) included in the information received by the image information receiving unit 201, and provides the decoded image to the display image generating unit 230. The determination result confirming unit 203 confirms the passage determination result included in the information received by the image information receiving unit 201, and provides the result to the display image generating unit 230. The object information confirmation unit 204 confirms the object information (object area) included in the information received by the image information reception unit 201 and provides the information to the display image generation unit 230.

  The operation receiving unit 210 is realized by the operation input unit 26. The operation receiving unit 210 receives an operation input from the input device 4 via the operation input unit 26. The setting information generation unit 211 generates / updates pass determination setting information (a determination position or a boundary line in the object area) for the pass determination based on the operation received by the operation reception unit 210. The setting information transmitting / receiving unit 220 transmits the passage determination setting information generated / updated by the setting information generating unit 211 to the imaging device 1 via the Net-IF 25, and transmits the current passage determination setting information from the imaging device 1 to the Net-IF 25. The data is received via the IF 25. The display image generation unit 230 generates a display image to be displayed on the display device 3 using the decoded image, the object information (object area), the pass determination setting information, and the pass determination result. The display output unit 231 is realized by the display control unit 24, and outputs the display image generated by the display image generation unit 230 to the display device 3.

  FIG. 6 is an example of a pass determination setting screen displayed on the display device 3. In FIG. 6, an image display area 310 for displaying an image captured by the imaging device 1 is displayed on the display screen 300 of the display device 3. The boundary line 320 is a line for performing passage detection, and is generally called a trip wire. The object 321 is a photographed person, and the object area 322 is an area of the detected object 321. The object area is, for example, a rectangle circumscribing the object 321. In the present embodiment, the object area is formed by a rectangle, but is not limited to this, and a predetermined figure such as an ellipse can be applied. Also, the determination of such an object area is well known. The menu 330 is a menu for setting which position in the detected object area passes through the boundary line 320 and is regarded as passing.

  In FIG. 6, for convenience, a determination position for performing the passage determination is indicated by a point, and a plurality of determination positions that can be set are listed, and the screen is selected by a radio button. It goes without saying that the form of the menu 330 is not limited to the illustrated one, and other examples of the setting of the determination position will be described later in the second embodiment. In the menu 330, the currently selected determination position among the plurality of determination positions that can be designated for selection is clearly indicated by a radio button so that the user can be identified (in the figure, “center” in the figure). The determination position is the selected determination position). Note that, based on the passage determination information provided by the determination result confirmation unit 203, the display image generation unit 230 displays the object area in a display form (for example, an object area) so that the user can identify the object determined to have passed through the boundary 320. , The display color of the frame of the object area).

  7A and 7B are diagrams illustrating an example of a processing flow of the entire system from imaging to display of an object detection result in a state in which passage detection setting exists. First, the processing of the imaging device 1 will be described with reference to FIG. 7A.

  First, the setting information transmitting / receiving unit 150 reads the passage determination setting information from the setting information storage unit 122 (S1). Here, the passage determination setting information includes boundary line information that can uniquely determine the boundary line 320 based on coordinate information on the image plane and the like, and information on an object area used when determining whether the boundary line 320 has been passed. Includes position setting information indicating the determination position. The determination position is selected, for example, from the determination positions shown in menu 330 of FIG. 6, and boundary 320 can be designated in image display area 310 shown in FIG. Next, the setting information transmission / reception unit 150 transmits the read passage determination setting information to the information processing device 2 (S2). Thereafter, the following processes from S3 to S9 are repeated until a change in the passage detection setting is received from the information processing device 2 or until an end instruction is issued.

  The electric signal received by the sensor 102 through the lens 101 is converted into a digital signal by the A / D converter 103, and the subsequent image generation unit 104 generates a digital image (captured image) based on the digital signal (S3). The generated digital image is copied and sent to the image encoding unit 110 and the object detection unit 120. Further, the object detection unit 120 detects object information by image analysis, and the image information transmission unit 140 sends and outputs the detected object information to the information processing device 2 (S4). The image encoding unit 110 encodes the digital image into an image format represented by, for example, JPEG, and the image information transmitting unit 140 transmits the encoded image to the information processing device 2 (S5). When transmitting the object information to the information processing apparatus 2, the object information itself may be transmitted, but the present invention is not limited to this. For example, the object detection unit 120 may send the object information to the image encoding unit 110, put the object information in the header of the encoded image, and transmit it. Although S4 and S5 are described in the flowchart as continuous processing for convenience, it is apparent that parallel processing can be performed.

  Incidentally, the object area included in the object information may be any information that can uniquely determine an area on a plane surrounding the detected object so as to have an arbitrary shape. For example, if the detected object area is normalized to a rectangle, the object information may represent the object area using the coordinates of the upper right end and the coordinates of the lower left end.

  Returning to FIG. 7A, it is necessary to consider the temporal continuity of the object to perform the passage detection, and therefore, it is necessary to compare with the object detected from the image captured immediately before. Therefore, the object determination unit 121 checks whether there is an image for which object detection has already been performed (S6). If there is no object-detected image, that is, immediately after initialization or activation, there is no object to be compared, and the process jumps to S10. On the other hand, if there is an image that can be compared, the object determination unit 121 checks whether the detected object is the same as the object detected in the image to be compared (S7). If the objects are not the same, the process jumps to S10 because the object is not recognized as having passed the boundary line.

  If the objects are the same, the determination position determination unit 123 determines a determination position for passage detection for each object (each object area) from the above-described detection position information (S8). The passage determination unit 130 determines whether or not the object has passed the boundary line from the determination position and the boundary line information for each object, and transmits the determination result to the information processing device 2 (S9).

  Until the passage determination setting is updated (NO in S10 and NO in S11), the processes of S3 to S9 are repeated. For example, when an update has occurred in the passage determination setting such as when the updated passage determination setting information is received from the information processing device 2 (YES in S10), the process returns to S1, and the new passage determination setting information is updated. The processing is restarted from S1 to perform the used processing. When the end is instructed (YES in S11), the present process ends. The end instruction is received, for example, from the information processing device 2.

  Next, the processing of the information processing apparatus 2 will be described with reference to FIG. 7B. In the information processing device 2, the image information receiving unit 201 transmits the pass determination setting information transmitted from the imaging device 1 in S2, the encoded image transmitted in S5, the object information transmitted in S4, and the information transmitted in S9. The judgment result of the passage detection is received (S21). The reception of each information in S21 does not need to be performed collectively, and may be appropriately received for each information. The object information confirmation unit 204 specifies the position (coordinates) and size of the detected object area from the received object information (S22). Further, the image decoding unit 202 decodes the received encoded image (S23).

  The display image generation unit 230 generates a display image in which the object area specified in S22 and the passage determination result received in S21 are superimposed on the image decoded in S23, and is output to the display device 3 via the display output unit 231. (S24). Further, the display of the menu 330 is generated based on the passage determination setting information received in S21, and is set as a part of the display image (S25). The display contents at this time are as described above with reference to FIG. Note that the determination position (the currently applied determination position) acquired from the passage determination setting information received from the imaging device 1 is indicated by a radio button in the menu 330. The menu 330 may be displayed so as to be superimposed on the decoded image, or may be displayed in an area different from the decoded image as shown in FIG.

  Until there is an update of the passage detection setting (for example, setting and updating in the processing described later with reference to the flowchart of FIG. 8) (NO in S26 and NO in S27), the processing of S21 to S25 is repeated. . If another determination position is selected in the menu 330 or the boundary line 320 is moved or rotated to update the passage detection setting (YES in S26), the process proceeds to S28. Here, the setting information transmitting / receiving unit 220 transmits the updated passage determination setting information to the imaging device 1 (S28), and returns the processing to S21. Further, when the end is instructed from the user interface (YES in S27), the setting information transmitting / receiving unit 220 transmits an end instruction to the imaging device 1 (S29), and ends the processing.

  FIG. 8 is a diagram illustrating an example of a processing flow when initializing the passage detection or changing the setting of the passage detection. First, the setting information transmitting / receiving unit 220 checks whether boundary information (information specifying the boundary 320) is already stored in the setting information storage unit 122 (S31). This can be performed, for example, by receiving passage determination setting information from the imaging device 1. If the boundary information has not been set, the setting information transmitting / receiving unit 220 waits until the boundary information is input (S32). When the boundary line information is stored (YES in S31) or when the boundary line information is input (YES in S32), the setting information transmitting / receiving unit 220 checks whether the boundary line information is new or changed. (S33). Then, when it is determined that the boundary line information is new or changed, the setting information transmitting / receiving unit 220 transmits the boundary line information to the imaging device 1 as an update instruction (S34). The updated boundary information is stored in the setting information storage unit 122 of the imaging device 1.

  Next, the setting information transmitting / receiving unit 220 checks whether or not the determination position information indicating the determination position of the object area for which the determination of the passage detection is performed is already stored (S35). If there is no determination position information, the processing up to this point is repeated until the determination position is input / set (NO in S35, NO in S36). On the other hand, when the determination position information is stored (YES in S35) or when the determination position information is input (YES in S36), the setting information transmitting / receiving unit 220 checks whether the determination position line information has been changed. (S37). If the determination position line information has been changed or is a new input, the setting information transmission / reception unit 220 transmits the determination position information to the imaging device 1 as an update instruction (S38). Thus, the updated determination position is stored in the setting information storage unit 122 of the imaging device 1. The above processing is repeated until there is a termination instruction (S39).

  Note that the imaging device 1 detects the update notification by receiving the update instruction transmitted in S34 or S38 via the setting information transmitting / receiving unit 150. When the update notification is detected, the process branches to YES in S10 of FIG. 7A, and the passage determination process based on the new passage determination setting information is started.

  With the above-described configuration, the user can specify the position of the object that is determined to have passed the boundary line in the passage detection, so that a desired passage determination condition can be set.

[Second embodiment]
Hereinafter, an embodiment of the passage determination setting system in the second embodiment will be described with reference to the drawings. In addition, the description of the parts according to the first embodiment is omitted. The main difference from the first embodiment is that, in the information processing device 2, a determination position set by the user for determining that the user has passed the boundary line can be displayed so as to be superimposed on the object area 322. .

  The functional blocks of the imaging device 1 according to the second embodiment are the same as those in FIG. However, the image information transmission unit 140 transmits the determination position information for each object area determined by the determination position determination unit 123. FIG. 9 is a diagram illustrating an example of a functional configuration of the information processing device 2 according to the second embodiment. 9, the same components as those in the first embodiment (FIG. 5) are denoted by the same reference numerals.

  The determination position confirmation unit 940 confirms the determination position information for each object area received by the image information receiving unit 201 from the imaging device 1, and provides the information to the display image generation unit 230. By newly adding the determination position confirmation unit 940, the display image generation unit 230 superimposes the detection position used for the passage detection determination for each object area extracted by the object information confirmation unit 204, and displays the display image. Can be generated.

  FIG. 10 is a diagram illustrating an example of a pass determination setting screen displayed on the display device 3. Display similar to that of the passage determination screen (FIG. 6) described in the first embodiment is denoted by the same reference numeral as in FIG. 340 is a determination position used for the determination of the passage detection superimposed and displayed. With this configuration, the user can more easily confirm that the object has passed the boundary line as set. Further, in the superimposed display of the determination position used for the determination of the passage detection, it is preferable that the display of the determination position be a display mode (for example, a different shape or color) different from the display of the object area. In this way, the user can easily distinguish the display of the position used for the passage detection determination from the object area, and the user can more easily recognize the display. In the menu 330, the determination position in the rectangle is represented by a graphic instead of the character expression such as "center" or "upper left" shown in FIG. According to such a menu display, the user can more intuitively select the determination position.

  In the first and second embodiments described above, a point in the object area is used as the determination position for determining whether the object only passes through the boundary line. However, the present invention is not limited to this. Hereinafter, some types of the determination positions will be described.

  FIG. 11 shows a typical determination position setting. Although the determination position has been described in terms of points, it is needless to say that the determination can be made with a line or a plane (area) as shown in the figure. Further, it is still not possible to allow the user to set the type of these determination positions (one of a point, a line, and a surface). Further, the determination positions based on these points, lines, and planes may all be displayed on the menu 330 so that the user can select a desired determination position.

  Also, for example, when a rectangle is used as the object area and a point is used as the determination position, settings such as “center of gravity or center”, “upper left”, “lower left”, “upper right”, and “lower right” of the object area are set. it can. In addition, for example, when a rectangle is used as the object area and a line is used as the determination position, “top”, “left”, “right”, “bottom”, “center vertical”, “center horizontal” can be set. In addition, for example, when a rectangle is used as the object area and a plane is used as the determination position, settings such as “upper left”, “upper right”, “lower left”, and “lower right” partial areas and “entire” indicating the entire area can be made. .

  In the case of determining with a line or a plane, for example, it may be determined that the vehicle has passed when all the set positions have passed, or it may be determined that some of the positions have passed when the vehicle has passed the boundary line. For this reason, the determination method may be determined in advance, or a user interface that allows the user to set may be separately provided. In the display in the object area 322 when the determination position is a plane (area), for example, the determination position (area) set in the object area 322 is set to the user by painting it in a predetermined color and translucent. Can be indicated.

[Third embodiment]
Hereinafter, the passage determination setting system according to the third embodiment will be described with reference to the drawings. The main difference between the first embodiment and the second embodiment is that the information processing apparatus 2 can perform passage detection from an encoded image stored in a recording medium or the like.

  FIG. 12 is a diagram illustrating an example of a functional configuration of the present system. 12, the same configurations as those of the first and second embodiments (FIGS. 4, 5, and 9) are denoted by the same reference numerals as those shown in FIGS. 4, 5, and 9. . 1200 is a passage determination setting system main body, and 1201 is an encoded image storage unit that stores encoded images. The image decoding unit 202 decodes the encoded image stored in the encoded image storage unit 1201, and provides the obtained image to the object detection unit 120 and the display image generation unit 230. The operations of the object determination unit 121, the determination position determination unit 123, and the passage determination unit 130 are as described in the first embodiment, but the respective processing results are provided to the display image generation unit 230. The display image generation unit 230 displays a user interface as shown in FIG.

  The setting information access unit 1211 reads the passage determination setting information from the setting information storage unit 122, and supplies the determination position information to the determination position determination unit 123, and the information for specifying the boundary line to the passage determination unit 130 and the display image generation unit 230. I do.

  According to such a configuration, the passage determination system 1200 can perform the display as described in FIGS. 6 and 10 using the encoded image stored in the encoded image storage unit 1201. Therefore, according to the passage determination system 1200, the user can easily confirm or change the passage determination conditions even for the images accumulated in the past. In the configuration of FIG. 12, instead of reading out the encoded image from the encoded image storage unit 1201, the encoded image output from the imaging device 1 may be received. In this case, the imaging device 1 may simply encode and transmit the captured image, and may not have the function of executing the passage determination process.

  [Fourth embodiment]

  Hereinafter, a passage determination system according to the fourth embodiment will be described with reference to the drawings. In addition, the description of the parts according to the first embodiment, the second embodiment, or the third embodiment is omitted. The main difference between the first embodiment, the second embodiment, and the third embodiment is that in the process of determining whether or not the object in the imaging device 1 has passed the boundary line, and in the pass determination setting in the information processing device 2, This is the point where the passing direction is added.

  The setting information generation unit 211 of the information processing device 2 according to the fourth embodiment generates / updates by adding the passing direction to the passing determination setting information based on the received operation. The setting information transmission / reception unit 220 transmits the passage determination setting information including the passing direction to the imaging device 1 and stores it in the setting information storage unit 122, or receives the current passage determination setting information from the imaging device 1.

  The difference of the passage detection processing flow according to the fourth embodiment will be described with reference to FIG. 7A. The passage determination setting information read by the setting information transmitting / receiving unit 150 in S1 includes the setting of the passing direction. The passage determination unit 130 determines whether or not the object has passed the boundary line (S9) as follows. That is, if the determination position passes through the boundary line and the moving direction of the determination position with respect to the boundary line matches the setting of the passing direction from the setting of the determination position, the boundary line information, and the passing direction for each object, It is determined that the vehicle has passed the line. In other states, it is determined that the object has not passed through the boundary line. The determination result is transmitted to the information processing device 2.

  FIG. 13 shows an example of a passage determination setting screen according to the fourth embodiment. 13 is different from FIG. 6 in that the passing direction 350 is displayed on the boundary 320 and whether the setting of the passing direction is bidirectional, rightward, or leftward from the start point to the end point of the boundary line. This is a point including a passing direction menu 351 for selecting. The display of the passing direction, such as the arrow of the passing direction 350, is changed by selecting the passing direction menu 351. In FIG. 13, there is one boundary line 320, but a plurality of boundary lines 320 can be set, and different passing directions can be set for each boundary line. When there are a plurality of boundary lines, the passing direction set for the selected boundary line is reflected in the passing direction menu 351. Similarly to the above-described setting and changing of the determination position using the menu 330, the user uses the passing direction menu 351 to confirm the selection state of the passing direction as the passing determination condition, and to select and set the passing direction. be able to.

  In each of the above embodiments, the passage determination condition may be set commonly for all objects, or may be set individually for each object. When the pass judgment condition can be set for each object, an individual object is specified by face recognition or the like, an identifier is assigned, and the pass judgment condition may be held in association with the identifier.

Other Embodiments The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or an apparatus via a network or various storage media, and a computer (or a CPU or an MPU or the like) of the system or the apparatus reads out the program. This is the process to be performed.

1: image apparatus 2: information processing apparatus 3: display apparatus 3, 201: image information receiving unit, 202 image decoding unit, 203: determination result confirmation unit, 204: object information confirmation unit, 210: operation reception unit, 211: setting information generating unit, 220: setting information transmitting / receiving unit, 230: display image generating unit, 231: display output unit

Claims (13)

An information processing device for a passage determination process to determine whether an object has passed a line set in an image captured by the imaging device,
A first area for selecting the passing direction to be used for the passage determination processing among a plurality of passage direction with respect to the lines of the object in the image, including a plurality of figures corresponding to each of the plurality of passage direction display control means for displaying a first area a on the display screen,
Receiving means for receiving, in the first area, an operation of selecting a graphic corresponding to the passing direction to be used for the pass determination processing among the plurality of graphics ,
Each of the plurality of figures is a line, a mark of a first display mode corresponding to one end of the line, and a mark corresponding to the other end of the line, and a mark of a second display mode different from the first display mode. An information processing apparatus comprising: a mark; and a mark that intersects the line and indicates the passing direction .   The display control means displays, on the display screen, the first area and a second area in which the image captured by the imaging device is displayed, and further displays the graphic selected in the first area. The information processing apparatus according to claim 1, wherein the passing direction corresponding to (i) and the line are displayed so as to be superimposed on the second area.   The display control means superimposes the line, a mark of the first display mode corresponding to one end of the line, and a mark of the second display mode corresponding to the other end of the line on the second area. The information processing apparatus according to claim 2, wherein the information is displayed. The passage direction is the line information processing apparatus according both directions to any one of claims 1 to 3, characterized in that either the right or left direction from one end relative to the other end of the.   5. The mark according to claim 1, wherein the mark indicating the passing direction is a mark indicating one of two directions, a right direction, and a left direction with respect to one end to the other end of the line. 6. Information processing device. Detecting means for detecting the object from the image;
Wherein the object detected by the detecting means is any one of claims 1 to 5, characterized by further comprising a determining means for determining whether or not passing through the lines set in the image An information processing apparatus according to claim 1. A control method of an information processing device for a passage determination process for determining whether an object has passed a line set in an image captured by an imaging device,
A first area for selecting the passing direction to be used for the passage determination processing among a plurality of passage direction with respect to the lines of the object in the image, including a plurality of figures corresponding to each of the plurality of passage direction a display control step of displaying a first area a on the display screen,
A receiving step of receiving, in the first area, an operation of selecting a graphic corresponding to the pass direction used for the pass determination process among the plurality of graphics ,
Each of the plurality of figures is a line, a mark of a first display mode corresponding to one end of the line, and a mark corresponding to the other end of the line, and a mark of a second display mode different from the first display mode. A control method for an information processing apparatus, comprising: a mark; and a mark that intersects the line and indicates the passing direction .   In the display control step, the first area and a second area in which the image captured by the imaging device is displayed are displayed on the display screen, and the graphic selected in the first area is further displayed. The control method of the information processing apparatus according to claim 7, wherein the passing direction corresponding to (i) and the line are superimposed and displayed on the second area.   In the display control step, the line, a mark of the first display mode corresponding to one end of the line, and a mark of the second display mode corresponding to the other end of the line are superimposed on the second area. The control method for an information processing apparatus according to claim 8, wherein the information is displayed. 10. The information processing apparatus according to claim 7 , wherein the passing direction is one of two directions, a right direction, and a left direction from one end to the other end of the line. Method.   11. The mark according to claim 7, wherein the mark indicating the passing direction is a mark indicating one of two directions, a right direction, and a left direction with respect to one end to the other end of the line. A method for controlling an information processing apparatus. A detection step of detecting the object from the image,
Said detecting the object detected by the process, any one of claims 7 to 11, further comprising a, a determination step of determining whether or not passing through the lines set in the image 1 The control method for an information processing apparatus according to claim 1 . Program for causing a computer to function as each unit of the information processing apparatus according to any one of claims 1 to 6.

Images