JP7830985B2 - Information processing system, information processing method, and information processing program - Google Patents

Description

This invention relates to an information processing system, information processing method, and information processing program for reading code images.

Technologies for managing the location of people and objects at construction sites are being considered (see, for example, Patent Document 1). The technology described in Patent Document 1 uses IC tags to manage work status, such as the progress of the construction process and the employment status of workers at the construction site. For this purpose, an IC tag reader that reads the tag ID from the IC tag and a management server that can communicate with the IC tag reader are used. IC tags are attached to each element present at the construction site, such as materials, tools, and workers. IC tag readers are installed within each space at the construction site and at entrances and exits to each space. The management server receives the tag ID and the space ID of the space where the IC tag reader is installed from each IC tag reader. Furthermore, this management server manages the entry and exit times of each element to and from each space based on the tag ID, space ID, and the time the tag ID was read.

Furthermore, technologies using code images for managing parts are also being considered (see, for example, Patent Document 2). In the technology described in Patent Document 2, an operator loads identification information for a specific part into a terminal computer. In this case, corresponding distribution history data is transmitted from the host computer to the terminal computer, and the value of that distribution history data is displayed on the terminal's display device.

Japanese Patent Publication No. 2005-326965 Japanese Patent Publication No. 2019-99361

However, the technology described in Patent Document 1 requires attaching IC tags to the items to be managed and installing IC tag readers for location management. Since the items to be managed on-site are diverse, managing the attachment and maintenance of communication devices for location identification becomes burdensome. Furthermore, the technology described in Patent Document 2 requires workers to input identification information for specific components into a terminal computer, which is time-consuming. On the other hand, accurate management is impossible in environments where code images are difficult to read.

The information processing system for solving the above problem includes a control unit that acquires captured images taken by a camera. The control unit acquires multiple captured images of the same code image, identifies a code region image containing a portion of the code image in each acquired image, integrates these code region images, and decodes the code image.

This invention enables efficient and accurate reading of code images.

This is an explanatory diagram of the system according to the embodiment. This is an explanatory diagram of the hardware configuration of the embodiment. This is an explanatory diagram of the information recorded in the managed storage unit of the embodiment. This is an explanatory diagram of the information recorded in the camera information storage unit of the embodiment. This is an explanatory diagram of the information recorded in the location information storage unit of the embodiment. This is an explanatory diagram of the confirmation form for the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the processing procedure of the embodiment. This is an explanatory diagram of the display screen of the embodiment. This is an explanatory diagram of the display screen of the embodiment.

Hereinafter, an embodiment of an information processing system, an information processing method, and an information processing program will be described with reference to Figures 1 to 14.
As shown in Figure 1, this embodiment describes an information processing system for managing the location of managed objects at a construction site. Managed objects include managed persons T1 such as workers, and managed objects T2 such as materials and equipment. In this embodiment, a code image C1 is used to manage the location of these objects. The code image C1 is a one-dimensional code or a two-dimensional code, for example, a QR code (registered trademark) is used.

In this embodiment, as shown in Figure 1, a field device 10 and a management device 20 are used, interconnected via a network. Multiple surveillance cameras 30 (image capture devices) are connected to the field device 10 via wired or wireless connections. These surveillance cameras 30 are installed for monitoring purposes and capture images of a predetermined range from their installation location. When a target object is located within the predetermined range, the code image C1 attached to the target object is also captured.

(Description of hardware configuration)
Using Figure 2, the hardware configuration of the information processing device H10, which constitutes the field device 10 and the management device 20, will be explained. The information processing device H10 includes a communication device H11, an input device H12, a display device H13, a storage device H14, and a processor H15. Note that this hardware configuration is just one example, and it can also be implemented with other hardware.

Communication device H11 is an interface that establishes a communication path with other devices and performs data transmission and reception; for example, it could be a network interface or a wireless interface.

The input device H12 is a device that accepts input of various types of information, such as a mouse or keyboard. The display device H13 is a display that shows various types of information.
The storage device H14 stores data and various programs for executing the various functions of the field device 10 and the management device 20. Examples of storage devices H14 include ROM, RAM, and hard disks.

The processor H15 controls the various processes in the field device 10 and the management device 20 using programs and data stored in the memory device H14. An example of the processor H15 is a CPU or MPU. This processor H15 loads programs stored in ROM, etc., into RAM and executes various processes for each operation.

The processor H15 is not limited to performing all of its operations through software processing. For example, the processor H15 may include dedicated hardware circuits (e.g., application-specific integrated circuits: ASICs) that perform hardware processing for at least a portion of its operations. That is, the processor H15 may be configured as follows:

(1) One or more processors that operate according to a computer program (software) (2) One or more dedicated hardware circuits that perform at least some of the various processes (3) A circuit including a combination of these
A processor includes a CPU and memory such as RAM and ROM, where memory stores program code or instructions configured to cause the CPU to execute processes. Memory, or computer-readable media, includes any available media that can be accessed by a general-purpose or dedicated computer.

(Each function of the information processing system)
Next, we will explain each function of the information processing system using Figure 1.
The field device 10 is a computer device (personal computer, smartphone, etc.) used by the person in charge of managing the construction site. This field device 10 includes a control unit 11. This control unit 11 functions as a recognition processing unit 111 by executing a code recognition program.
The recognition processing unit 111 performs the process of recognizing the code image. In this embodiment, this recognition processing unit 111 is provided for each surveillance camera 30.

The management device 20 is a computer device (server, etc.) that manages the location of managed objects. This management device 20 comprises a control unit 21, a managed object storage unit 22, a camera information storage unit 23, and a location information storage unit 24. Furthermore, in this embodiment, the management device 20 includes a code reader 25. This code reader 25 is a device that decodes the code image C1. In this embodiment, when registering managed objects, the code reader 25 is used to encode the code image C1 attached to the managed object and obtain identification information (managed object ID). If a code reader 25 is not available, the managed object ID can be entered manually.

The control unit 21 assists in managing the location of managed objects at the construction site. To this end, the control unit 21 functions as a management processing unit 211 and a display processing unit 212 by executing a management program.

The management processing unit 211 identifies the location of the managed object and executes a process to register it in the location information storage unit 24.
The display processing unit 212 executes a process to output the location of the managed object.

As shown in Figure 3, the managed object storage unit 22 records managed object information 220. This managed object information 220 is recorded when a managed object is registered. The managed object information 220 consists of the managed object ID and detailed information.

The managed ID is a managed identifier used to identify each managed item.
The detailed information is the content of the managed item. For example, in the case of a managed item T1 such as a worker, it includes the name, affiliation, etc. In this embodiment, the detailed information is the information contained in the form used when entering the construction site (new entrant confirmation form, etc.). However, since the form used when entering the construction site is not always used, the detailed information may be obtained by other methods, as will be described later. Furthermore, the detailed information may also include a photograph of the worker. In addition, in the case of a managed item T2 such as equipment, the detailed information may include information on its delivery to the construction site (name, manufacturer, management company, specifications, dimensions, weight, material, and other attribute information, etc.).

As shown in Figure 4, camera information 230 is recorded in the camera information storage unit 23. This camera information 230 is recorded after the surveillance camera 30 is installed and information about the surveillance camera 30 is registered. The camera information 230 includes the camera ID and placement information.
The camera ID is an identifier used to identify each surveillance camera 30.
The placement information indicates the location within the construction site where this surveillance camera 30 is installed.

As shown in Figure 5, the location information storage unit 24 records location management information 240 of the managed object. In this embodiment, location management information 240 is recorded when the location of the managed object is identified. This location management information 240 records the managed object ID, the date and time of reading, and the reading location.

The managed ID is an identifier used to identify the managed object.
The reading date and time is the date and time when the location of this managed object was identified.
The reading position is information about the location of the camera that captured the image identifying the target. In this embodiment, the camera ID of the surveillance camera 30 is used. Alternatively, the placement information corresponding to the camera ID recorded in the camera information storage unit 23 may be used.

(Initial registration process)
Next, the initial registration process will be explained using Figures 6 and 7.

First, let's explain how to register the managed user T1.
In this case, as shown in Figure 6, this embodiment describes an example in which a confirmation form 500 for new entrants is used. The confirmation form 500 can be any existing form that can obtain information about new entrants, for example, a new entrant training form can also be used. The confirmation form 500 includes a detailed entry field 501, a confirmation form code image 502, and a code image sticker 503. The detailed entry field 501 contains information about new entrants required when entering a construction site. For example, it includes information such as affiliated company, occupation, name, gender, date of birth, current address, emergency contact information, employment status, health status, licenses held, and safety confirmation items. The same code image is printed on the confirmation form code image 502 and the code image sticker 503. The code image sticker 503 is removable from the confirmation form 500 and has adhesive applied to its back. Note that multiple code image stickers 503 may be printed. Furthermore, while the size of the confirmation slip code image 502 and the code image sticker 503 are not limited, making the code image sticker 503 larger can improve visibility from a distance. This code image sticker 503 is then affixed to the helmet H1 used by the worker (new entrant), who is the person being managed T1. In this case, since the surveillance camera 30 is positioned above, it is affixed to a position visible from above, such as the top of the helmet H1. However, the affixing position of the code image sticker 503 is not limited to the top, as long as it is in a position that is easily visible from the surveillance camera 30.

Furthermore, regarding the registration of managed items T2 such as equipment and materials, a confirmation slip (delivery information) is obtained when the managed items are delivered. This confirmation slip contains detailed information about the managed items T2. Then, the code image sticker on the confirmation slip is peeled off and affixed to the managed items T2 such as equipment and materials.

Then, as shown in Figure 7, the control unit 21 of the management device 20 executes the process of acquiring detailed information (step S101). Specifically, the administrator reads the confirmation slip code image 502 of the confirmation slip 500 using the code reader 25. In this case, the management processing unit 211 of the control unit 21 obtains the managed item ID by decoding the confirmation slip code image 502. Next, the management processing unit 211 outputs a new registration screen to the display device H13. The managed item ID may also be entered manually. Then, the administrator enters the contents recorded in the detailed entry field 501 of the confirmation slip 500 into the registration screen.

Next, the control unit 21 of the management device 20 executes the registration process for the managed object (step S102). Specifically, the management processing unit 211 of the control unit 21 generates managed object information 220, including the detailed information and managed object ID entered on the registration screen, and records it in the managed object storage unit 22.

(Code recognition processing)
The code recognition process will be explained using Figure 8. This process is executed when images (still images) are periodically acquired from the surveillance camera 30.

First, the control unit 11 of the field device 10 executes a code search process (step S201). Specifically, the recognition processing unit 111 of the control unit 11 checks for the presence or absence of a code image in the captured image acquired from the surveillance camera 30 using image recognition.

Next, the control unit 11 of the field device 10 performs a determination process to determine whether a code is included (step S202). Specifically, the recognition processing unit 111 of the control unit 11 determines that a code is included if it detects a code region image with a high probability of being a code image through image recognition. For example, even if only a part of the code image is included, or if the resolution is low and decoding is not possible, if a code region image is detected, it is determined that a code is included.

If it is determined that no code is present (i.e., "NO" in step S202), the code recognition process is terminated.
On the other hand, if it is determined that a code is present (if the answer is "YES" in step S202), the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S203). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image in the code region image included in the captured image. If the managed object ID can be decoded, the recognition processing unit 111 checks whether the decoded managed object ID is recorded in the managed object storage unit 22. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified. On the other hand, if decoding is not possible, or if the decoded managed object ID is not recorded in the managed object storage unit 22, it is determined that the managed object cannot be identified.

If it is determined that the managed object can be identified (if "YES" is answered in step S203), the control unit 11 of the field device 10 executes the registration process (step S204). Specifically, the recognition processing unit 111 of the control unit 11 transmits a read notification to the management device 20. This read notification includes information regarding the acquired managed object ID and camera ID. In this case, the management processing unit 211 of the control unit 21 of the management device 20 obtains the current date and time from the system timer. Then, the management processing unit 211 generates location management information 240, which records the read date and time (current date and time), managed object ID, and camera ID, and records it in the location information storage unit 24.

On the other hand, if it is determined that the managed object cannot be identified (i.e., "NO" in step S203), the control unit 11 of the field device 10 performs integration processing (step S205). Here, if the code area image is set in memory as a code tracking target, the code area images included in images continuously acquired from the same surveillance camera 30 within a predetermined time are integrated. Then, an attempt is made to identify the managed object ID using the integrated image. Details will be described later with reference to Figure 9.

Even in the integrated processing (step S205), if the managed object cannot be identified, the control unit 11 of the field device 10 performs image processing (step S206). Here, multiple processed images are generated by image processing such as changing the brightness and enlarging the captured image and integrated image. Then, an attempt is made to identify the managed object ID using the processed images. Details will be described later with reference to Figure 10.

Even during the image processing (step S206), if the managed object cannot be identified, the control unit 11 of the field device 10 performs a partial search (step S207). Here, the processed image is used to search for managed object information 220 that partially matches the code image of the managed object ID recorded in the managed object storage unit 22. Details will be described later with reference to Figure 11.

Next, the control unit 11 of the field device 10 executes the code tracking target setting process (step S208). Specifically, the recognition processing unit 111 of the control unit 11 sets the code region images for which the target object could not be identified as code tracking targets in memory. In this case, object tracking technology (a known technology) for consecutive images is applied to the code images. With this setting, the recognition processing unit 111 stores multiple consecutively captured images in memory for common code images. If the target object can be identified, the recognition processing unit 111 resets the memory. If the code region image is lost in consecutive captured images due to disappearance or other reasons, the recognition processing unit 111 terminates tracking for that code region image and resets the memory.

(Integration process)
The integration process (step S205) will be explained using Figure 9.
Here, the control unit 11 of the field device 10 performs a determination process to determine whether there are multiple images (step S301). Specifically, the recognition processing unit 111 of the control unit 11 checks whether a code region image set as a code tracking target is recorded in the memory.

If it is determined that there are no multiple images (i.e., "NO" in step S301), the control unit 11 of the field device 10 returns to the code recognition process (Figure 8).
If it is determined that there are multiple images (if the answer is "YES" in step S301), the control unit 11 of the field device 10 performs integration processing of the multiple images (step S302). Specifically, the recognition processing unit 111 of the control unit 11 combines the code region images that are set in memory as code tracking targets. In this case, the position of each code region image in the code image is estimated according to the image pattern of the code image, and the multiple code region images are combined to generate an integrated image. Alternatively, high dynamic range synthesis may be performed to combine multiple photographs with different brightness levels.

Next, the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S303). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image using the integrated image. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified.

If it is determined that the target can be identified (if the answer is "YES" in step S303), the control unit 11 of the field device 10 executes the registration process in the same manner as in step S204 (step S304).
On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S303), the control unit 11 of the field device 10 returns to the code recognition process.

(Image processing)
The image processing (step S206) will be explained using Figure 10.

Here, the control unit 11 of the field device 10 performs image processing (step S401). Specifically, the recognition processing unit 111 of the control unit 11 generates multiple processed images by performing image processing such as changing the brightness of the code region image and the integrated image of the captured image, and enlarging them.

Next, the control unit 11 of the field device 10 performs a determination process to determine whether the managed object can be identified (step S402). Specifically, the recognition processing unit 111 of the control unit 11 attempts to decode the code image using the processed image. If the decoded managed object ID is recorded in the managed object storage unit 22, it is determined that the managed object can be identified.

Next, if it is determined that the target can be identified (if the answer is "YES" in step S402), the control unit 11 of the field device 10 performs the registration process in the same manner as in step S204 (step S403).
On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S402), the control unit 11 of the field device 10 returns to the code recognition process.

(Partial search processing)
The partial search process (step S207) will be explained using Figure 11.

Here, the control unit 11 of the field device 10 performs a search process using a portion of the code image (step S501). Specifically, the recognition processing unit 111 of the control unit 11 matches the code area image, integrated image, and processed image of the captured image with the code image of the managed ID recorded in the managed ID storage unit 22. Then, it searches for managed IDs whose matching rate is equal to or greater than a certain threshold value.

Next, the control unit 11 of the field device 10 performs a determination process to determine whether identification was achieved by partial match (step S502). Specifically, the recognition processing unit 111 of the control unit 11 determines that identification was achieved by partial match if the match rate is above a certain threshold and a single managed ID is obtained.

If it is determined that the item has been identified by a partial match (if the answer is "YES" in step S502), the control unit 11 of the field device 10 executes the registration process in the same manner as in step S204 (step S503).
On the other hand, if it is determined that the target object cannot be identified (i.e., "NO" in step S502), the control unit 11 of the field device 10 returns to the code recognition process.

(Display processing)
The display process will be explained using Figures 12 to 14. This process is executed when a display request is received.

Here, the control unit 21 of the management device 20 performs the process of identifying the managed ID (step S601). Specifically, the display processing unit 212 of the control unit 21 identifies the managed ID in the managed storage unit 22.

Then, the control unit 21 of the management device 20 executes a process to acquire the most recent location for each identified managed object ID (step S602). Specifically, the display processing unit 212 of the control unit 21 extracts the location management information 240 containing the managed object ID from the location information storage unit 24. Next, the display processing unit 212 identifies the location management information 240 with the most recent reading date and time. Next, the display processing unit 212 identifies the camera ID of the identified location management information 240. Then, the display processing unit 212 temporarily stores the reading date and time and the managed object ID in memory, associated with the camera ID.

Next, the control unit 21 of the management device 20 executes the display processing of location information (step S603). Specifically, the display processing unit 212 of the control unit 21 generates a location management screen for each camera ID, arranging the managed objects in chronological order based on the most recent reading date and time. That is, the managed objects that passed by most recently are displayed first. In this case, the display processing unit 212 changes the display format of the managed objects according to the detailed information recorded in the managed object storage unit 22. Then, the display processing unit 212 outputs the location management screen to the display device H13 of the management device 20.

In this case, as shown in Figure 13, the location management screen 600 is displayed. On this location management screen 600, an icon corresponding to the type of managed object is displayed for each surveillance camera. For example, for managed person T1, an icon 610 including a person's image is displayed. Furthermore, each icon 610 changes its display format according to the details recorded in the managed object information 220. For example, the frame and background patterns are changed according to the affiliation. Also, for managed objects T2 such as equipment, the icon 611 is changed according to the type recorded in the details of the managed object information 220.

Then, as shown in Figure 14, if the managed item moves, the location management screen 600 is updated. In this example, since the equipment moved from the first-floor entrance to the side of the first-floor elevator, the display position of the icon 611 has been changed.

According to this embodiment, the following effects can be obtained.
(1) In this embodiment, a surveillance camera 30 is used to capture a code image of the managed object. This makes it possible to manage the location of the managed object simply by attaching the code image to it. If location management is performed by attaching a communication device to the managed object, it requires the effort of attaching and maintaining the communication device. On the other hand, using a code image is low-cost and requires no maintenance.

(2) In this embodiment, the managed information storage unit 22 records managed information 220. This managed information 220 records information about the managed person T1 and the managed object T2. This allows for unified management of managed persons T1 (workers, etc.) and managed objects T2 (materials, equipment, etc.) located on-site, including past data. Unified management makes it possible to identify workers and equipment that entered, brought in, or were present at the same time period.

(3) In this embodiment, a confirmation form 500 is used. The confirmation form 500 includes a detailed entry field 501, a confirmation form code image 502, and a code image sticker 503. This allows information about the managed object to be registered in the managed object storage unit 22 using the detailed entry field 501 and the confirmation form code image 502. Furthermore, since the code image sticker 503 is affixed to the managed object, affixing errors can be suppressed. It is also possible to register detailed information in the managed object storage unit 22 using the confirmation form code image 502 after the code image sticker 503 has been affixed to the managed object.

(4) In this embodiment, if it is determined that the target object can be identified (if the answer is "YES" in step S203), the control unit 11 of the field device 10 executes a registration process (step S204). This allows the location of the target object to be recorded in accordance with the placement of the surveillance camera 30.

(5) In this embodiment, the control unit 11 of the field device 10 performs integration processing (step S205). Here, the code image C1 is captured naturally without performing actions such as holding the code image C1 up to the surveillance camera 30. In this case, the entire image of the code image C1 may not be visible, or the shooting distance may be far and the image may not be clear. Through integration processing, even if only a portion of the code image is captured in the captured image, the original code image can be reconstructed by combining the partial images. Furthermore, the reproducibility of the image can be improved by high dynamic range synthesis. And, the target of management can be identified by the integrated image.

(6) In this embodiment, the control unit 11 of the field device 10 performs image processing (step S206). Since the code image C1 is captured naturally using the surveillance camera 30, even if the image is not clear, the code image can be clarified. Then, using the clarified processed image, an attempt can be made to identify the target of management.

(7) In this embodiment, the control unit 11 of the field device 10 performs a partial search process (step S207). This allows the surveillance camera 30 to capture the code image C1 in a natural manner, and even if only a portion of the code image is captured, it is possible to attempt to identify the target object.

(8) In this embodiment, the control unit 11 of the field device 10 performs a code tracking target setting process (step S208). This allows for the collection of multiple images of the same code image to attempt to identify the target even when the target cannot be identified.
(9) In this embodiment, the control unit 21 of the management device 20 executes the process of identifying the managed ID (step S601) to displaying the location information (step S603). This makes it possible to confirm the location of the managed items in chronological order.

This embodiment can be implemented with the following modifications. This embodiment and the following modifications can be combined with each other to the extent that they do not contradict each other technically.
In the above embodiment, the location of the managed objects is managed at the construction site. The present invention is not limited to construction sites and can be used in any location where multiple managed objects are present.
In the above embodiment, if it is determined that the managed object can be identified (if "YES" is answered in step S203, etc.), the control unit 11 of the field device 10 executes a registration process (step S204, etc.). Here, if the managed object is recorded in the managed object storage unit 22, it is determined that the managed object can be identified. Alternatively, the registration process may be executed if the managed object ID can be identified. In this case, the managed object ID is generated according to a predetermined code creation rule. Then, when a managed object ID that satisfies the code creation rule is identified, the location registration process is executed. This makes it possible to manage the location of the managed object ID even if the managed object is not recorded in the managed object storage unit 22. For example, by maintaining historical data of location information of people and objects for which detailed information has not yet been entered in chronological order, the location of a specific person or object can be reflected when detailed information is entered later.
In the above embodiment, a field device 10 and a management device 20 are used as hardware, but the system is not limited to these. It is sufficient if a code image attached to the managed object (person or object) is read by a surveillance camera 30 and time-series information about the location of the managed object is managed.

In the above embodiment, the control unit 11 of the field device 10 acquires still images from the surveillance camera 30. Alternatively, video may be acquired from the surveillance camera 30. In this case, the video is divided into scenes, and multiple still images are acquired.

In the above embodiment, the control unit 11 of the field device 10 performs integrated processing (step S205), image processing (step S206), and partial search processing (step S207). The processing method for recognizing the managed object is not limited to these. For example, some of these processes or other processes may be combined. Furthermore, the order of processing is not limited.

In the above embodiment, the managed items are registered in the managed item storage unit 22 using a confirmation form 500 that includes a detailed entry field 501, a confirmation form code image 502, and a code image sticker 503. The registration method is not limited to this. For example, when detailed information about the managed item is entered, one or more code image stickers 503 may be printed. In this case, the management device 20 may acquire and register the detailed information via a network or the like.

In the above embodiment, a QR code is used as the code image. The code image is not limited to a QR code; a barcode may also be used. Furthermore, a string of characters may be used as the code image. In this case, the recognition processing unit 111 recognizes the managed ID by character recognition.

In the above embodiment, the location is determined using a surveillance camera 30. The imaging means is not limited to a surveillance camera, as long as the location can be determined. For example, an imaging device may be installed on a mobile body such as a drone or AGV. In this case, the mobile body uses a location information acquisition means (GNSS, etc.) to determine its current location as camera placement information, and updates the camera information 230 in the camera information storage unit 23.

In the above embodiment, the control unit 11 of the field device 10 performs image processing (step S401). Specifically, the recognition processing unit 111 of the control unit 21 generates multiple processed images by image processing such as changing the brightness and enlarging the captured image and the integrated image. Image processing is not limited to changing brightness and enlarging. For example, super-resolution technology to increase image resolution may be used.

Furthermore, the field device 10 may instruct the surveillance camera 30 on shooting conditions such as magnification and exposure adjustment (ISO sensitivity, aperture value, shutter speed). In the case of magnification, the position of the code area image is specified.

In the above embodiment, the managed information 220 is recorded in the managed information storage unit 22. The managed information storage unit 22 may also record information indicating the validity of the managed information 220 (validity flag). The validity flag is recorded when the managed information 220 is registered for entry into or delivery to the construction site. The validity flag is deleted when the managed person T1 completes their work at the construction site, or when the managed object T2, such as equipment, is removed from the construction site.

Then, in the display processing, the display format is changed depending on whether or not the valid flag is present. For example, in the process of identifying the managed ID (step S601), the display processing unit 212 extracts the managed information 220 in which the valid flag is recorded from the managed storage unit 22 and identifies the managed ID.
Furthermore, if the location management information 240 includes a managed ID for which the valid flag is not recorded, the recognition processing unit 111 may display it in a way that alerts the user.

In the above embodiment, the control unit 21 of the management device 20 performs a process to identify the managed ID (step S601) and, for each identified managed ID, performs a process to acquire the most recent location (step S602). In this case, only location management information 240 whose reading date and time fall within the extraction period may be extracted. Alternatively, the specified extraction period may be acquired in the display request.

Alternatively, the managed ID may be identified after extracting the location management information 240. In this case, first, the location management information 240 for a predetermined period is extracted from the location information storage unit 24. Then, if location management information 240 containing the same managed ID is extracted, the most recent location management information 240 is used.

In the above embodiment, the control unit 21 of the management device 20 performs location information display processing (step S603). For each surveillance camera 30, a location management screen is displayed, arranging the managed items in order of the most recent reading date and time. The display format is not limited to this. For example, location information (arrangement of surveillance cameras 30) may be output for each managed item.
Furthermore, on the location management screen 600, an icon corresponding to the type of managed object is displayed for each surveillance camera. The display format of the managed object's location information is not limited to this. For example, it may be possible to set individual names and facial photographs.

Next, the technical concepts that can be understood from the above embodiments and alternative examples are described below.
(a) The information processing system according to claim 1, characterized in that the control unit estimates the position of each code region image in the code image according to the image pattern of the code image, and combines a plurality of the code region images to generate an integrated image.

(b) The information processing system according to 1 or (a), characterized in that the control unit tracks the code region image.
(c) Further comprising a managed storage unit in which managed identifiers are recorded,
The information processing system according to 1, (a) or (b), characterized in that the control unit identifies the managed identifier contained in the captured image using the managed identifier recorded in the managed storage unit and the code region image showing a part of the code image.

(d) The information processing system according to (c), characterized in that the control unit generates a code image of the managed identifier recorded in the managed storage unit, matches the code image with the code area image to identify the managed identifier included in the captured image.

10…Field device, 11…Control unit, 111…Recognition processing unit, 20…Management device, 21…Control unit, 211…Management processing unit, 212…Display processing unit, 22…Managed device storage unit, 23…Camera information storage unit, 24…Location information storage unit.

Claims (3)

An information processing system comprising a control unit that acquires captured images taken by a camera placed on site , and a management unit that stores the management identifiers of the managed objects at the site ,
The control unit,
Obtain multiple images taken of the same code image,
In each of the acquired captured images, identify the code region image in which a part of the code image is captured,
The respective code region images are integrated, and the code image is decoded .
An information processing system characterized in that, if the managed identifier cannot be identified by the above decoding, a code image of the managed identifier recorded in the managed storage unit is generated, and the generated code image is matched with the code area image to identify the managed identifier included in the captured image . A method for reading a code image using an information processing system comprising a control unit that acquires captured images taken by a camera placed on site , and a management storage unit that records the management identifier of the managed object at the site ,
The control unit,
Obtain multiple images taken of the same code image,
In each of the acquired captured images, identify the code region image in which a part of the code image is captured,
The respective code region images are integrated, and the code image is decoded .
If the managed identifier cannot be identified by the decoding, the information processing method is characterized by generating a code image of the managed identifier recorded in the managed storage unit, matching the generated code image with the code area image, and identifying the managed identifier included in the captured image . A program for reading a code image using an information processing system comprising a control unit that acquires captured images taken by a camera placed on site , and a management storage unit that records the management identifiers of the managed objects at the site ,
The control unit,
Obtain multiple images taken of the same code image,
In each of the acquired captured images, identify the code region image in which a part of the code image is captured,
The respective code region images are integrated, and the code image is decoded .
An information processing program characterized in that, if the managed identifier cannot be identified by the above decoding, it generates a code image of the managed identifier recorded in the managed storage unit, matches the generated code image with the code area image, and functions as a means to identify the managed identifier contained in the captured image .