JP7821364B2 - Information processing system, information processing device, information processing method and program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing method, and a program.

In recent years, a system has been developed in which an inspection server receives the results of an inspection of equipment, etc., in accordance with an inspection plan from a terminal device on which the inspector has entered the results, creates an inspection record based on the received results, and stores the results in a database (see, for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 2005-276123

In technology such as that described in Patent Document 1, when approving test results, the test record stored in a database is viewed and approved using an approver's terminal device. This means that the approver cannot confirm whether the actual test results are correct. In order to approve that the test results are correct, the approver must be present during the test, which is time-consuming. As such, there is a problem in that the correct test results cannot be efficiently confirmed.

The object of the present invention is to provide an information processing system, information processing device, information processing method, and program that can efficiently confirm the correct results of a test.

The information processing system of the present invention comprises:
The system includes an information processing device, a first communication terminal, and a second communication terminal,
The first communication terminal
a first imaging unit;
a first communication unit that transmits imaging data indicating an image captured by the first imaging unit to the information processing device;
a first display unit;
the second communication terminal has a second display unit;
the information processing device has a third communication unit that determines whether access from the first communication terminal and the second communication terminal has started, and when it determines that access from the first communication terminal and the second communication terminal has started, transmits predetermined record data to the first communication terminal and also to the second communication terminal, and further transmits imaging data transmitted from the first communication unit to the second communication terminal;
the first display unit displays the record data transmitted from the third communication unit;
The second display unit displays the record data transmitted from the third communication unit and an image represented by the imaging data.

Further, the information processing device of the present invention comprises:
The communication unit determines whether access has been initiated from a first communication terminal and a second communication terminal, and when it determines that access has been initiated from the first communication terminal and the second communication terminal, transmits specified report data to the first communication terminal and also to the second communication terminal, and further transmits the imaging data transmitted from the first communication terminal to the second communication terminal.

Further, the information processing method of the present invention comprises:
An information processing method implemented by an information processing device,
a process of determining whether access from the first communication terminal and the second communication terminal has started;
a process of transmitting predetermined record data to the first communication terminal and the second communication terminal when it is determined that access from the first communication terminal and the second communication terminal has started;
The imaging data transmitted from the first communication terminal is transmitted to the second communication terminal.

The program of the present invention also includes:
A program to be executed by a computer,
a step of determining whether access from the first communication terminal and the second communication terminal has been initiated;
a step of transmitting predetermined record data to the first communication terminal and the second communication terminal when it is determined that access from the first communication terminal and the second communication terminal has started;
and a procedure for transmitting the imaging data transmitted from the first communication terminal to the second communication terminal.

The present invention allows for efficient confirmation of correct test results.

1 is a diagram illustrating a first embodiment of an information processing system according to the present invention; 2 is a diagram illustrating an example of an internal configuration of a first communication terminal illustrated in FIG. 1 . 2 is a diagram showing an example of an internal configuration of a second communication terminal shown in FIG. 1; FIG. FIG. 2 is a diagram illustrating an example of an internal configuration of the information processing device illustrated in FIG. 1 . FIG. 5 is a diagram showing an example of data stored in the database shown in FIG. 4 . 2 is a sequence diagram illustrating an example of an information processing method in the information processing system illustrated in FIG. 1 . 2 is a sequence diagram illustrating an example of an information processing method in the information processing system illustrated in FIG. 1 . FIG. 10 is a diagram showing an example of a display on the display unit of the second communication terminal in step S5. FIG. 10 is a diagram showing an example of a display on the display unit of the first communication terminal in step S6. FIG. 4 is a diagram showing an example of a signature input screen displayed on the display unit shown in FIG. 3 . FIG. 10 is a diagram showing an example of a display on the display unit of the second communication terminal in step S22. FIG. 10 is a diagram illustrating a second embodiment of an information processing system according to the present invention. FIG. 12 is a diagram illustrating an example of the internal configuration of the second communication terminal illustrated in FIG. 11 . FIG. 12 is a diagram illustrating an example of an internal configuration of the information processing device illustrated in FIG. 11 . FIG. 14 is a diagram showing an example of data stored in the database shown in FIG. 13. 12 is a sequence diagram illustrating an example of an information processing method in the information processing system illustrated in FIG. 11. FIG. 12 is a sequence diagram illustrating an example of an information processing method in the information processing system illustrated in FIG. 11. FIG. FIG. 10 is a diagram showing an example of a display on the display unit of the second communication terminal in step S37. FIG. 10 is a diagram showing an example of a display on the display unit of the first communication terminal in step S38. FIG. 13 is a diagram showing an example of a signature input screen displayed on the display unit shown in FIG. 12 . FIG. 10 is a diagram showing an example of a display on the display unit of the second communication terminal in step S54.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
(First embodiment)

Figure 1 is a diagram showing a first embodiment of an information processing system of the present invention. As shown in Figure 1, the information processing system in this embodiment has communication terminals 100 and 200 and an information processing device 300. Communication terminal 100, communication terminal 200, and information processing device 300 are connected to each other via communication network 400. This connection may be wired or wireless. Communication network 400 is a general communication network. Communication terminal 100 is a first communication terminal carried by an operator who performs on-site measurements (inspections) using this system. Communication terminal 200 is a second communication terminal carried by an observer who remotely observes the measurements (inspections) performed by the operator and confirms (approves) the measurement results. Communication terminals 100 and 200 are preferably mobile. Information processing device 300 provides information to communication terminals 100 and 200 and performs predetermined processing based on the information transmitted from communication terminals 100 and 200. Note that Figure 1 shows an example in which there is one communication terminal 100 and one communication terminal 200, but the number is not limited to this.

Figure 2 is a diagram showing an example of the internal configuration of the communication terminal 100 shown in Figure 1. As shown in Figure 2, the communication terminal 100 shown in Figure 1 has a display unit 110, an input unit 120, a call unit 130, an imaging unit 140, and a communication unit 150. Note that Figure 2 shows only the main components related to this embodiment, out of the components of the communication terminal 100 shown in Figure 1.

The display unit 110 is a first display unit that displays data transmitted from the information processing device 300. Examples of the display unit 110 include a display mounted on a mobile terminal such as a smartphone. The display unit 110 may have a touch panel function. If the display unit 110 has a touch panel function, the display unit 110 also has the functions of the input unit 120. The display unit 110 also displays images captured by the imaging unit 140.

The input unit 120 is a worker input unit that inputs information based on external operations on the data displayed by the display unit 110. The input unit 120 may use input devices such as a touch panel, keyboard, or mouse.

The communication unit 130 communicates with the communication terminal 200 via the communication network 400, a predetermined telephone line, or the like. The communication line used by the communication unit 130 for communication needs only to be capable of communicating with the communication terminal 200, and may be either wired or wireless. The communication unit 130 is equipped with a microphone and speaker that allow the worker carrying the communication terminal 100 to communicate.

The imaging unit 140 is a camera (first imaging unit) that captures an image of the subject to be inspected. The imaging unit 140 is a camera with a resolution and other performance that allows a worker or witness to determine whether the inspection criteria are met when the display unit 110 or the display unit provided in the communication terminal 200 displays the inspection subject captured by the imaging unit 140.

The communication unit 150 is a first communication unit that has an interface function for exchanging information (data) with the communication terminal 200 and the information processing device 300 via the communication network 400.

Figure 3 is a diagram showing an example of the internal configuration of communication terminal 200 shown in Figure 1. As shown in Figure 3, communication terminal 200 shown in Figure 1 has display unit 210, input unit 220, call unit 230, and communication unit 250. Note that Figure 3 shows only the main components related to this embodiment, out of the components of communication terminal 200 shown in Figure 1.

The display unit 210 is a second display unit that displays data transmitted from the information processing device 300. Examples of the display unit 210 include a display mounted on a mobile terminal such as a smartphone. The display unit 210 may have a touch panel function. If the display unit 210 has a touch panel function, the display unit 210 also has the function of the input unit 220. The display unit 210 also displays images captured by the imaging unit 140.

The input unit 220 is a witness input unit that inputs information based on external operations on the data displayed by the display unit 210. The input unit 220 may use input devices such as a touch panel, keyboard, or mouse.

The communication unit 230 communicates with the communication terminal 100 via the communication network 400, a predetermined telephone line, or the like. The communication line used by the communication unit 230 for communication needs only to be capable of communicating with the communication terminal 200, and may be either wired or wireless. The communication unit 230 is equipped with a microphone and speaker that allow the worker carrying the communication terminal 200 to communicate.

The communication unit 250 is a second communication unit that has an interface function for exchanging information (data) with the communication terminal 100 and the information processing device 300 via the communication network 400.

Figure 4 is a diagram showing an example of the internal configuration of the information processing device 300 shown in Figure 1. As shown in Figure 4, the information processing device 300 shown in Figure 1 has a communication unit 310, a data writing unit 320, a registration unit 330, and a database 340. Note that Figure 4 shows only the main components related to this embodiment, out of the components of the information processing device 300 shown in Figure 1.

The communication unit 310 is a third communication unit with an interface function that exchanges information (data) with the communication terminals 100 and 200 via the communication network 400. The communication unit 310 transmits predetermined data to the communication terminals 100 and 200. The predetermined data is record data indicating a witness report describing the measurements performed by the worker. This record data may be pre-registered in a storage device such as a cloud server on the Internet, or in a database at a specific site; there are no particular restrictions on where it is registered. The survey data may be obtained from a specific site or a contractor's server, or may be created according to a predetermined format. The witness report may also include pass criteria and tolerance ranges for measured values to pass the inspection. The worker performs measurements according to the measurement details described in the witness report. The witness confirms the measurement results performed according to the measurement details described in the witness report. The communication unit 310 also transmits the measurement data written by the data writing unit 320 to the communication terminals 100 and 200. The communication unit 310 also transmits the imaging data transmitted from the communication terminal 100 to the communication terminal 200.

The data writing unit 320 writes information input by the input unit 120 (e.g., measurement values) into the data displayed by the display unit 110 and the display unit 210. The data writing unit 320 also writes information input by the input unit 220 (e.g., a sign) into the data displayed by the display unit 110 and the display unit 210.

The registration unit 330 registers the data (examination transcript) written by the data writing unit 320 in the database 340. At this time, the registration unit 330 may register in the database 340 the file name indicated in the examination transcript and each piece of information specifying that file in association with each other.

Database 340 stores data registered by registration unit 330. Figure 5 is a diagram showing an example of data stored in database 340 shown in Figure 4. As shown in Figure 5, the file name of a witness record is stored in database 340 in association with the site name, inspection target, witness inspection date, measurer, and witness for the measurement and confirmation performed using the witness record. Information indicating the site name, inspection target, witness inspection date, measurer, and witness may be read by registration unit 330 from the corresponding witness record and registered in database 340, or may be registered in database 340 by registration unit 330 based on an operation received from outside information processing device 300. Note that witness record files are also stored in database 340. Database 340 may also be located outside information processing device 300. The witness record file may be registered in database 340 using, for example, a dedicated application pre-installed on information processing device 300. Furthermore, trading records registered in database 340 can be edited externally, except for locked data, as described below.

The following describes an information processing method in the information processing system shown in Figure 1. Figures 6A and 6B are sequence diagrams illustrating an example of an information processing method in the information processing system shown in Figure 1.

First, based on an operation received from an external device, the communication terminals 100, 200 launch a dedicated application pre-installed on the communication terminals 100, 200, access a predetermined site that can communicate with the information processing device 300, and begin the following processing. At this time, authentication processing using a password or the like may be performed between the communication terminals 100, 200 and the information processing device 300. Alternatively, the information processing device 300 may display a list of witnessed sites and inspection objects on the communication terminals 100, 200, and allow the worker and witness to select (input) the target site or inspection object. Alternatively, by inputting the witnessed inspection date, the name of the person measuring, and the name of the witness into the communication terminals 100, 200, the information processing device 300 may search for the corresponding site or inspection object and notify the communication terminals 100, 200 of the search results.

The communication unit 310 of the information processing device 300 transmits the audit trail report to the communication terminals 100 and 200 via the communication network 400 (step S1). Here, the audit trail report transmitted by the information processing device 300 may be one designated according to the measurement target, or may be one used for general-purpose measurement. The timing of transmission of the audit trail report may be, for example, the timing when access to the information processing device 300 is initiated from the communication terminals 100 and 200, or the date and time when measurement is scheduled to begin.

Next, the imaging unit 140 of the communication terminal 100 begins capturing images (step S2). This capturing may be initiated when the worker operates the communication terminal 100, for example, by pressing (selecting) a specific button. The worker also adjusts the orientation of the communication terminal 100 (imaging unit 140) so that the object to be measured is included in the capturing range. The imaging unit 140 transmits the captured (captured) image data to the information processing device 300 via the communication network 400 using the communication unit 150 (step S3). The communication unit 310 of the information processing device 300 then transmits the image data transmitted from the communication terminal 100 to the communication terminal 200 via the communication network 400 (step S4). The display unit 210 of the communication terminal 200 then displays the witness transcript transmitted in step S1 and the captured image represented by the imaging data transmitted in step S4 (step S5).

7 is a diagram showing an example of the display on the display unit 210 of the communication terminal 200 in step S5. As shown in FIG. 7, the display unit 210 of the communication terminal 200 displays the witness record 260 and the captured image 270 represented by the imaging data. The display unit 210 also displays an electronic signature button 280 that the witness can press (select) to confirm the measurement results performed in accordance with the witness record 260 based on the captured image 270 and, upon completion of confirmation, transition to a screen for electronic signature. By displaying the display as shown in FIG. 7 on the display unit 210, the witness can confirm the measurement results performed in accordance with the witness record. In this way, the communication terminal 200 held by the witness displays the image captured by the communication terminal 100 held by the worker, allowing the witness to remotely view the measurement target. Furthermore, the witness can instruct the worker via the communication unit 230 to change the imaging orientation, etc., so that the worker can adjust the orientation of the communication terminal 100 (imaging unit 140) and the communication terminal 200 can display the image desired by the witness. In other words, even if an observer is not present at the measurement site, the same level of inspection can be performed as if an observer were present at the measurement site.

The display unit 110 of the communication terminal 100 also displays the witness transcript transmitted in step S1 and the image captured by the imaging unit 140 (step S6).

Figure 8 is a diagram showing an example of the display on the display unit 110 of the communication terminal 100 in step S6. As shown in Figure 8, the display unit 110 of the communication terminal 100 displays the witness record 160 and the captured image 170. The witness record 160 is the same as the witness record 260 shown in Figure 7. The captured image 170 is the same as the captured image 270 shown in Figure 7. The worker adjusts the orientation of the communication terminal 100 (capture unit 140) and captures an image using the capture unit 140 in accordance with the witness record 160 displayed on the display unit 110 so that the object being inspected and the inspection/measurement process are included in the captured image 170. The captured image 170 captured by the capture unit 140 is then displayed on the display unit 110. Furthermore, the display unit 110 displays a save button 190 that is pressed (selected) when confirmation is complete after the witness electronically signs the measurement results performed in accordance with the witness record 260.

Note that the display unit 110 of the communication terminal 100 may also display the electronic signature button 280 displayed by the display unit 210 of the communication terminal 200, and the display unit 210 of the communication terminal 200 may also display the save button 190 displayed by the display unit 110 of the communication terminal 100. In other words, the display screen of the display unit 210 in step S5 and the display screen of the display unit 110 in step S6 may be the same display screen.

Then, when the input unit 120 receives input of measurement results (measurement data) from the worker in accordance with the witness transcript displayed on the display unit 110 (step S7), the communication unit 150 transmits the input measurement data to the information processing device 300 via the communication network 400 (step S8). At this time, the worker can input information indicating the measurement results as measurement data into the desired field of the witness transcript by touching and moving their finger or an attached stylus or the like on the surface of the display unit 110 where the witness transcript is displayed, as if writing letters. The input unit 120 also identifies which field (position) of the witness transcript displayed on the display unit 110 the input was received in, and the communication unit 150 transmits location information indicating the input position to the information processing device 300 along with the measurement data.

The witness record may display a field for entering measurement results for each measurement item, or it may display the acceptable range for each measurement item and provide a field for entering whether the measurement result falls within the acceptable range. For example, it may be possible to select and enter whether the measurement result falls within the acceptable range using a pull-down menu.

The data writing unit 320 writes the measurement data transmitted from the communication terminal 100 into the trading session transcript (step S9). At this time, the data writing unit 320 writes the measurement data into the trading session transcript based on the location information transmitted from the communication terminal 100 along with the measurement data. Specifically, the data writing unit 320 writes the measurement data transmitted from the communication terminal 100 into the trading session transcript at the location indicated by the location information transmitted from the communication terminal 100. Next, the communication unit 310 transmits the write data, which is the measurement data transmitted by the data writing unit 320 into the trading session transcript, to the communication terminal 200 via the communication network 400 (step S10). The display unit 210 of the communication terminal 200 then displays the write data transmitted from the information processing device 300 (step S11). By displaying the write data in this way on the display unit 210, the measurement data input into the communication terminal 100 is reflected in the trading session transcript displayed on the display unit 210. The timing for updating the display on the display unit 210 of the communication terminal 200 may be when new write data is transmitted from the information processing device 300, or when the input unit 220 of the communication terminal 200 receives an input for updating the display data from outside (for example, selection of an update button (not shown)).

Alternatively, notification may be made using sound. For example, if the input unit 120 accepts input of the pass/fail result of the measurement in step S7, then in step S8 the communication unit 150 transmits information indicating the pass/fail result to the information processing device 300 via the communication network 400. The communication unit 310 may then transmit sound information indicating the sound corresponding to the pass/fail result to the communication terminal 200 via the communication network 400, and the communication terminal 200 may output the sound indicated by the sound information transmitted from the communication unit 310.

The display unit 110 of the communication terminal 100 also displays the written data (step S12). This display may be the result of software pre-installed on the communication terminal 100 for use with this system. For example, when information is input by touching a touch pen or the like to information displayed on the display unit 110, the input information may be displayed on the display unit 110. Alternatively, the information processing device 300 may transmit the written data to the communication terminal 100, and the written data received by the communication terminal 100 may be displayed on the display unit 110.

Note that steps S7 to S12 may not be performed in some cases. Furthermore, similar to the processing in step S7, when the input unit 220 receives input of information such as notes from the witness regarding the witness transcript displayed on the display unit 210 of the communication terminal 200, processing similar to steps S8 to S12 may be performed.

After that, when the measurement and confirmation in accordance with the witness record is completed and the communication terminal 200 accepts the pressing (selection) of the electronic signature button 280, the display unit 210 displays a signature input screen for inputting an electronic signature. Figure 9 is a diagram showing an example of the signature input screen displayed by the display unit 210 shown in Figure 3. As shown in Figure 9, the display unit 210 displays a signature input screen including a signature field 2810 and an apply button 2820. The signature field 2810 is a field for inputting a signature by touching and moving an attached stylus or the like on the surface of the display unit 210 as if writing characters. Here, when the witness inputs his/her signature in the signature field 2810, the input signature is displayed in the signature field 2810. This may be due to the operation of software pre-installed on the communication terminal 200 for use with this system. Furthermore, the apply button 2820 is a button that is pressed (selected) after the signature has been input in the signature field 2810 to apply the input signature. When a signature is entered in signature field 2810 and apply button 2820 is pressed (selected) (step S13), signature information indicating the entered signature is sent as input data from communication unit 250 via communication network 400 to information processing device 300 (step S14). Alternatively, when the witness touches and moves a touch pen, finger, etc. at any position on the surface of display unit 210 as if writing a character, display unit 210 may display the path of the touch as a signature. When the witness touches and moves a touch pen, finger, etc. on display unit 210 as if moving the signature displayed on display unit 210, display unit 210 may move the display position of the signature in accordance with the movement. This operation may be performed by software pre-installed on communication terminal 200.

The data writing unit 320 of the information processing device 300 writes the signature indicated by the signature information transmitted from the communication terminal 200 into a predetermined position in the trading session transcript (step S15). The communication unit 310 transmits the trading session transcript with the signature written by the data writing unit 320 as writing data to the communication terminal 100 via the communication network 400 (step S16). The display unit 110 of the communication terminal 100 displays the trading session transcript data with the signature transmitted from the information processing device 300. When the input unit 120 receives an input (selection) of the Save button 190 shown in FIG. 8 in response to the display, confirmation information is received (step S17), and the confirmation information is transmitted from the communication unit 150 to the information processing device 300 (step S18). This confirmation information is information for confirming the trading session transcript data with the signature transmitted from the information processing device 300 and locking it as data that cannot be edited externally.

When the confirmation information is transmitted from the communication terminal 100, the data writing unit 320 locks the witness session record data on which the signature was written in step S15 as confirmed data (step S19). At this time, the data writing unit 320 may write a confirmation seal on the witness session record on which the signature was written in step S15, and then lock the witness session record data as confirmed data. Locked data cannot be edited externally. This locking method may use a function similar to the document protection function provided in general software. The communication unit 310 transmits the witness session record on which the signature and confirmation seal were written by the data writing unit 320 to the communication terminals 100 and 200 via the communication network 400 as written data (step S20). The written data transmitted from the communication unit 310 may include not only still images but also, for example, video of the object being measured. The registration unit 330 also registers the attendance record on which the data writing unit 320 has written the confirmation seal and signature as written data in the database 340 (step S21). At this time, the registration unit 330 may also register in the database 340 as written data a attendance record in which the data writing unit 320 has written the signature and on which an image of the measurement object has been added (superimposed). The written data registered in the registration unit 330 may include not only still images but also, for example, videos of the measurement object. The written data registered in the registration unit 330 may also include data to be added to an already registered record, the names of workers and witnesses, etc.

The display unit 210 of the communication terminal 200 then displays the write data transmitted from the information processing device 300 (step S22). Also, the display unit 110 of the communication terminal 100 displays the write data transmitted from the information processing device 300 (step S23).

Figure 10 is a diagram showing an example of the display on the display unit 210 of the communication terminal 200 in step S22. As shown in Figure 10, compared to the display on the display unit 210 of the communication terminal 200 shown in Figure 7, the display unit 210 displays the witness transcript 260 with the witness's signature 261 written in and a confirmation mark 291 added. In addition, the captured image 270 is not displayed. The same may be true for the display on the display unit 110 of the communication terminal 100 in step S23. As another display example, the captured image 270 may also be displayed.

Note that a call may be made between the call unit 130 and the call unit 230 from the processing of step S1 until the processing of step S23 is performed. This call may be similar to a call made using a regular telephone and is a two-way call. Furthermore, the call may not only be a voice call, but also a text call using a text messaging tool such as a chat.

In this way, the system has communication terminal 100 carried by the worker undergoing the witnessed inspection and communication terminal 200 carried by the witness, and data written by the worker in the witnessed inspection record displayed on communication terminal 100 at the measurement site and images captured by communication terminal 100 are displayed on communication terminal 200, and the witness can view the display on communication terminal 200. This allows the witness to remotely check the measurement contents. Furthermore, when the witness writes a signature on communication terminal 200 as approval of the measurement results (confirmation of confirmation), the information processing device 300 registers the witnessed inspection record with the signature. This allows the witnessed inspection record with the approval signature to be registered remotely.
Second Embodiment

Figure 11 is a diagram showing a second embodiment of the information processing system of the present invention. As shown in Figure 11, the information processing system in this embodiment has communication terminals 100 and 201 and an information processing device 301. Communication terminal 100, communication terminal 201, and information processing device 301 are connected to each other via communication network 400. This connection is preferably wireless, but may also be wired. Communication network 400 is a general communication network. Communication terminal 100 is the same first communication terminal as in the first embodiment. Communication terminal 201 is a second communication terminal carried by an attendant who remotely attends measurements (examinations) performed by workers and confirms (approves) the measurement results. Communication terminals 100 and 201 are preferably mobile. Information processing device 301 provides information to communication terminals 100 and 201 and performs predetermined processing based on the information transmitted from communication terminals 100 and 201. Note that Figure 11 shows an example in which there is one communication terminal 100 and one communication terminal 201, but the number is not limited to this.

Figure 12 is a diagram showing an example of the internal configuration of the communication terminal 201 shown in Figure 11. As shown in Figure 12, the communication terminal 201 shown in Figure 11 has a display unit 210, an input unit 220, a call unit 230, an imaging unit 241, and a communication unit 251. Note that Figure 12 shows only the main components related to this embodiment of the components of the communication terminal 201 shown in Figure 11. The display unit 210, input unit 220, and call unit 230 are the same as those in the first embodiment.

The imaging unit 241 is a camera (second imaging unit) that captures an image of the witness holding the communication terminal 201. Because the witness is viewing the display unit 210, the imaging unit 241 is a so-called internal camera that captures images from the side of the communication terminal 200 where the display unit 210 is located.

The communication unit 251 is a second communication unit that has an interface function for exchanging information (data) with the communication terminal 100 and the information processing device 301 via the communication network 400. The communication unit 251 transmits the image data captured by the imaging unit 241 to the information processing device 300 via the communication network 400.

Figure 13 is a diagram showing an example of the internal configuration of the information processing device 301 shown in Figure 11. As shown in Figure 13, the information processing device 301 shown in Figure 11 has a communication unit 311, a data writing unit 321, a registration unit 331, and a database 341. Note that Figure 13 shows only the main components related to this embodiment, out of the components included in the information processing device 301 shown in Figure 11.

The communication unit 311 is a third communication unit with an interface function that exchanges information (data) with the communication terminals 100 and 201 via the communication network 400. The communication unit 311 transmits predetermined data to the communication terminals 100 and 201. The predetermined data is record data indicating a witness report describing the measurements performed by the worker. This record data may be pre-registered in a storage device such as a cloud server on the Internet, or in a database at a specific site; there are no particular restrictions on where it is registered. The survey data may be obtained from a specific site or a contractor's server, or may be created according to a predetermined format. The witness report may also include pass criteria and tolerance ranges for measured values that pass the inspection. The worker performs measurements according to the measurement details described in the witness report. The witness confirms the measurement results performed according to the measurement details (measurement items) described in the witness report. The communication unit 311 also transmits the data written by the data writing unit 321 to the communication terminals 100 and 201. The communication unit 311 also transmits the imaging data transmitted from the communication terminal 100 to the communication terminal 201. The communication unit 311 also transmits the imaging data transmitted from the communication terminal 201 to the communication terminal 100.

The data writing unit 321 writes information input by the input unit 120 (e.g., measurement values) into the data displayed by the display unit 110 and the display unit 210. The data writing unit 321 also writes information input by the input unit 220 (e.g., a sign) into the data displayed by the display unit 110 and the display unit 210.

The registration unit 331 registers the data (examination transcript) written by the data writing unit 321 in the database 341. At this time, the registration unit 331 may register in the database 341 the file name indicated in the examination transcript and each piece of information specifying that file in association with each other. The registration unit 331 also registers the image data captured by the imaging unit 241 of the communication terminal 201 together with the data in the database 341.

Database 341 stores the data and image data registered by registration unit 331. Figure 14 is a diagram showing an example of data stored in database 341 shown in Figure 13. As shown in Figure 14, the file names of the witness transcript and the image data are stored in database 341 in association with the site name, inspection target, witness inspection date, measurer, and witness for the measurement and confirmation performed using the witness transcript. The information indicating the site name, inspection target, witness inspection date, measurer, and witness may be read by registration unit 331 from the witness transcript with the corresponding witness transcript file name and registered in database 341 by registration unit 331, or may be registered in database 341 by registration unit 331 based on an operation received from outside information processing device 301. The witness transcript file and the image data file are also stored in database 341. Database 341 may also be provided external to information processing device 301. The trading session log files may be registered in the database 341 using, for example, a dedicated application pre-installed on the information processing device 301. Furthermore, trading session logs registered in the database 341 can be edited externally, except for locked data, as described below.

The following describes an information processing method in the information processing system shown in Figure 11. Figures 15A and 15B are sequence diagrams illustrating an example of an information processing method in the information processing system shown in Figure 11.

First, based on an operation received from an external device, the communication terminal 100, 201 launches a dedicated application pre-installed on the communication terminal 100, 201, accesses a predetermined site that can communicate with the information processing device 301, and begins the following processing. At this time, authentication processing using a password or the like may be performed between the communication terminal 100, 201 and the information processing device 301. Alternatively, the information processing device 301 may display a list of witnessed sites and inspection objects on the communication terminal 100, 201, and allow the worker and witness to select (input) the target site or inspection object. Alternatively, by inputting the witnessed inspection date, the name of the person measuring, and the name of the witness into the communication terminal 100, 201, the information processing device 301 may search for the corresponding site or inspection object and notify the communication terminal 100, 201 of the search results.

The communication unit 311 of the information processing device 301 transmits the witness statement to the communication terminals 100 and 201 via the communication network 400 (step S31). Here, the witness statement transmitted by the information processing device 301 may be one designated according to the measurement target, or one used for general-purpose measurement. The timing of transmission of the witness statement may be, for example, the timing when access to the information processing device 301 is initiated from the communication terminals 100 and 201, or the date and time when measurement is scheduled to begin.

Next, the imaging unit 241 of the communication terminal 201 begins capturing images (step S32). This capturing may be initiated when the witness operates the communication terminal 201 and, for example, presses (selects) a specific button. The witness adjusts the orientation of the communication terminal 201 (imaging unit 241) so that at least the witness's own face is included in the captured image range. The imaging unit 241 transmits the captured (captured) image data, which is witness image data, to the information processing device 301 via the communication network 400 using the communication unit 251 (step S33). The imaging unit 140 of the communication terminal 100 begins capturing images (step S34). This capturing may be initiated when the worker operates the communication terminal 100 and, for example, presses (selects) a specific button. The worker adjusts the orientation of the communication terminal 100 (imaging unit 140) so that the object to be measured is included in the captured image range. The imaging unit 140 transmits the imaging data being captured (captured) to the information processing device 301 via the communication network 400 using the communication unit 150 (step S35). Note that the order of the processing of steps S32 and S33 and the processing of steps S34 and S35 is not specified.

The communication unit 311 of the information processing device 301 then transmits the imaging data transmitted from the communication terminal 100 to the communication terminal 201 via the communication network 400, and transmits the witness image data transmitted from the communication terminal 201 to the communication terminal 100 via the communication network 400 (step S36). The display unit 210 of the communication terminal 201 then displays the witness transcript transmitted in step S31, the witness image indicated by the witness image data captured by the imaging unit 241 in step S32, and the captured image indicated by the imaging data transmitted in step S36 (step S37).

Figure 16 is a diagram showing an example of the display on the display unit 210 of the communication terminal 201 in step S37. As shown in Figure 16, the display unit 210 of the communication terminal 201 displays the witness record 260, a captured image 270 indicated by the imaging data, and an observer image 271. The observer image 271 is an image captured by the imaging unit 241. The display unit 210 also displays an electronic signature button 280 that the observer can press (select) to confirm the measurement results performed in accordance with the witness record 260 based on the captured image 270 and, once confirmation is complete, to move to a screen for entering an electronic signature. By displaying the display as shown in Figure 16 on the display unit 210, the observer can confirm the measurement results performed in accordance with the witness record.

In addition, the display unit 110 of the communication terminal 100 displays the witness transcript transmitted in step S31, the captured image indicated by the imaging data captured by the imaging unit 140 in step S34, and the witness image indicated by the witness image data transmitted in step S36 (step S38).

Figure 17 is a diagram showing an example of the display on the display unit 110 of the communication terminal 100 in step S38. As shown in Figure 17, the display unit 110 of the communication terminal 100 displays the witness record 160, the captured image 170 indicated by the imaging data, and the witness image 171. The witness record 160 is the same as the witness record 260 shown in Figure 16. The captured image 170 is the same as the captured image 270 shown in Figure 16. The worker adjusts the orientation of the communication terminal 100 (imaging unit 140) in accordance with the witness record 160 displayed on the display unit 110, and the captured image 170 captured by the imaging unit 140 is displayed on the display unit 110. The witness image 171 is the same as the witness image 271 shown in Figure 16. The display unit 110 also displays a save button 190 that can be pressed (selected) when confirmation is complete after the witness electronically signs the measurement results performed in accordance with the measurement content (measurement items) described in the witness record 260.

Note that the display unit 110 of the communication terminal 100 may also display the electronic signature button 280 displayed by the display unit 210 of the communication terminal 201, and the display unit 210 of the communication terminal 201 may also display the save button 190 displayed by the display unit 110 of the communication terminal 100. In other words, the display screen of the display unit 210 in step S37 and the display screen of the display unit 110 in step S38 may be the same display screen.

Then, when the input unit 120 accepts input of measurement results (measurement data) from the worker in accordance with the witness transcript displayed on the display unit 110 (step S39), the communication unit 150 transmits the input measurement data to the information processing device 301 via the communication network 400 (step S40). At this time, the worker can use an attached stylus or the like to touch and move the surface of the display unit 110, where the witness transcript is displayed, as if writing letters, to input the measurement data indicating the measurement results into the desired field of the witness transcript. The input unit 120 also identifies which field (position) of the witness transcript displayed on the display unit 110 the input was received in, and the communication unit 150 transmits location information indicating the input position to the information processing device 301 along with the measurement data.

The witness record may display a field for entering measurement results for each measurement item, or it may display the acceptable range for each measurement item and provide a field for entering whether the measurement result falls within the acceptable range. For example, it may be possible to select and enter whether the measurement result falls within the acceptable range using a pull-down menu.

The data writing unit 321 writes the measurement data transmitted from the communication terminal 100 into the trading session transcript (step S41). At this time, the data writing unit 321 writes the measurement data into the trading session transcript based on the location information transmitted from the communication terminal 100 along with the measurement data. Specifically, the data writing unit 321 writes the measurement data transmitted from the communication terminal 100 into the trading session transcript at the location indicated by the location information transmitted from the communication terminal 100. Next, the communication unit 311 transmits the write data, which is the measurement data transmitted by the data writing unit 321 into the trading session transcript, to the communication terminal 201 via the communication network 400 (step S42). The display unit 210 of the communication terminal 201 then displays the write data transmitted from the information processing device 301 (step S43). By displaying the write data in this way on the display unit 210, the measurement data input into the communication terminal 100 is reflected in the trading session transcript displayed on the display unit 210. The timing for updating the display on the display unit 210 of the communication terminal 201 may be when new write data is sent from the information processing device 301, or when the input unit 220 of the communication terminal 201 receives an input for updating the display data from outside (for example, selection of an update button (not shown)).

Alternatively, notification may be made using sound. For example, if the input unit 120 accepts input of the pass/fail result of the measurement in step S39, in step S40 the communication unit 150 transmits information indicating the pass/fail result to the information processing device 301 via the communication network 400. The communication unit 311 may then transmit sound information indicating the sound corresponding to the pass/fail result to the communication terminal 201 via the communication network 400, and the communication terminal 201 may output the sound indicated by the sound information transmitted from the communication unit 311.

The display unit 110 of the communication terminal 100 also displays the written data (step S44). This display may be the result of software pre-installed on the communication terminal 100 for use with this system. For example, when information is input by touching a touch pen or the like to information displayed on the display unit 110, the input information may be displayed on the display unit 110 by software operation. Alternatively, the information processing device 301 may transmit the written data to the communication terminal 100, and the written data received by the communication terminal 100 may be displayed on the display unit 110.

After that, when the measurement and confirmation in accordance with the witness record is completed and the communication terminal 201 accepts the pressing (selection) of the electronic signature button 280, the display unit 210 displays a signature input screen for inputting an electronic signature. Figure 18 is a diagram showing an example of the signature input screen displayed by the display unit 210 shown in Figure 12. As shown in Figure 18, the display unit 210 displays a signature input screen including a signature field 2810, an apply button 2820, a capture button 2830, and an observer image 271. The signature field 2810 and the apply button 2820 are the same as those in the first embodiment. The capture button 2830 is a button selected when registering a witness record to cause the image capture unit 241 to capture an image of the observer (observer image 271) to be registered in association with the image. A signature is entered in the signature field 2810, the capture button 2830 is pressed (selected) to capture an image of the witness 271, and when the apply button 2820 is pressed (selected) (step S45), the signature information indicating the entered signature and the witness image data indicating the witness image 271 are sent as input data from the communication unit 251 to the information processing device 301 via the communication network 400 (step S46).

The data writing unit 321 of the information processing device 301 writes the signature indicated by the signature information transmitted from the communication terminal 201 at a predetermined position on the witness record, and displays the witness image indicated by the witness image data transmitted from the communication terminal 201 superimposed on the predetermined position on the witness record (step S47). The data writing unit 321 writes the signature, and the witness record with the witness image superimposed is transmitted by the communication unit 311 to the communication terminal 100 via the communication network 400 as write data (step S48). The display unit 110 of the communication terminal 100 displays the witness record data with the signature written and the witness image superimposed, transmitted from the information processing device 301. When the input unit 120 receives an input (selection) of the save button 190 shown in FIG. 17 on the display, the confirmation information is received (step S49), and the confirmation information is transmitted from the communication unit 150 to the information processing device 301 (step S50). This confirmation information is used to confirm the signed witness record data sent from the information processing device 301 and lock it as data that cannot be edited externally.

When the confirmation information is transmitted from the communication terminal 100, the data writing unit 321 locks the witness record data, on which the signature and witness image were written in step S47 and the witness image were superimposed, as confirmed data (step S51). At this time, the data writing unit 321 may write a confirmation stamp on the witness record data on which the signature and witness image were written in step S47 and the witness image were superimposed, and then lock the witness record data as confirmed data. Locked data cannot be edited externally. This locking method may use a function similar to the document protection function provided in general software. The witness record on which the data writing unit 321 wrote the confirmation stamp and signature and the witness image were superimposed is transmitted by the communication unit 311 as written data to the communication terminal 100, 201 via the communication network 400 (step S52). The written data transmitted from the communication unit 311 may include not only still images but also, for example, images of the witness and videos of the measured object. The registration unit 331 also registers the attendance record on which the data writing unit 321 has written the confirmation seal and signature and on which the witness image has been superimposed as written data in the database 341 (step S53). At this time, the registration unit 331 may also register in the database 341 as written data a attendance record in which the data writing unit 321 has written the signature and on which the witness image has been superimposed, and on which an image of the measured object has been further added (superimposed). The written data registered in the registration unit 331 may include not only still images but also, for example, images of the witness and videos of the measured object.

The display unit 210 of the communication terminal 201 then displays the write data transmitted from the information processing device 301 (step S54). Also, the display unit 110 of the communication terminal 100 displays the write data transmitted from the information processing device 301 (step S55).

Figure 19 is a diagram showing an example of the display on the display unit 210 of the communication terminal 201 in step S54. As shown in Figure 19, compared to the display on the display unit 210 of the communication terminal 201 shown in Figure 16, the display unit 210 displays the witness signature 261 written in the witness transcript 260 and a confirmation stamp 291 added. In addition, an witness image 262 is displayed superimposed on the witness transcript 260. Also, the captured image 270 is not displayed. The same may be true for the display on the display unit 110 of the communication terminal 100 in step S55. Note that as another display example, the captured image 270 may also be displayed.

Furthermore, the communication terminal 100 may save (store) the display screen (display image) displayed in step S55. The communication terminal 100 stores image data showing an image, known as a screenshot, in its own memory (storage unit). This allows the worker carrying the communication terminal 100 to leave confirmation of the attendance on the communication terminal 100.

Note that a call may be made between the call unit 130 and the call unit 230 from the processing of step S31 to the processing of step S55. This call may be similar to a call made using a regular telephone and is a two-way call. Furthermore, the call may not only be a voice call, but also a text call using a text messaging tool such as a chat.

In this way, the system has a communication terminal 100 carried by the worker undergoing the witnessed inspection and a communication terminal 201 carried by the witness, and data written by the worker in the witnessed inspection record displayed on the communication terminal 100 at the measurement site and images captured by the communication terminal 100 are displayed on the communication terminal 201, and the witness views the display on the communication terminal 201. This allows the witness to remotely check the measurement contents. Furthermore, when the witness writes a signature on the communication terminal 201 to approve the measurement results (confirmation of confirmation), the information processing device 301 registers the witnessed inspection record with the signature written on it. At this time, the communication terminal 201 captures an image of the witness's face, and the information processing device 301 registers the captured image of the witness along with the witnessed inspection record. This allows the witnessed inspection record, in which the image of the witness is displayed and the signature of approval is written, to be registered remotely.
(Other embodiments)

The input unit 120 of the communication terminal 100 may accept the input of the signature of the worker who performed the measurement. In this case, the input unit 120 may accept the input of the signature based on an operation in a predetermined field of the witness record displayed on the display unit 110. Alternatively, the display unit 110 of the communication terminal 100 may display a signature field as shown in FIG. 9, and the input unit 120 may accept the input of the signature in accordance with that display. The data writing unit 320 of the information processing device 300 writes the worker's signature accepted by the input unit 120 into the witness record. The method for inputting and writing the worker's signature may be the same as the method for inputting and writing the witness' signature described above.

The display unit 210 of the communication terminal 200 may display a button similar to the save button 190 shown in FIG. 8 (a button for finalizing the trading session transcript), and when the input unit 220 receives an input of pressing (selecting) the displayed button, a finalization notification may be sent from the communication unit 250 to the information processing device 300. In this case, when the finalization notification is sent from the communication terminal 200, the data writing unit 320 writes a finalization stamp on the trading session transcript with the signature. The trading session transcript data with this finalization stamp is locked as finalized data. Locked data cannot be edited from the outside. This locking method may use a function similar to the document protection function provided in general software.

The above has been described with each component being assigned a different function (process), but this allocation is not limited to the above. Furthermore, the configuration of the components is also not limited to the above-described forms, which are merely examples. Furthermore, a combination of each embodiment may also be used.

The processing performed by each of the above-mentioned means and devices may be performed by logic circuits created for each purpose. Alternatively, a computer program (hereinafter referred to as the program) describing the processing steps may be recorded on a recording medium readable by each of the information processing devices 300 and 301, and the program recorded on this recording medium may be read and executed by each of the information processing devices 300 and 301. The recording media readable by each of the information processing devices 300 and 301 include removable recording media such as magneto-optical disks, DVDs (Digital Versatile Discs), CDs (Compact Discs), Blu-ray (registered trademark) Discs, and USB (Universal Serial Bus) memories, as well as memories such as ROMs (Read Only Memory) and RAMs (Random Access Memory), HDDs (Hard Disc Drives), and SSDs (Solid State Drives) built into each of the information processing devices 300 and 301. The programs recorded on these recording media are read by the CPUs provided in each of the information processing devices 300 and 301, and the same processing as described above is performed under the control of the CPUs. Here, the CPU operates as a computer that executes programs read from a recording medium on which the programs are recorded.

100, 200, 201 Communication terminal 110, 210 Display unit 120, 220 Input unit 130, 230 Call unit 140, 241 Imaging unit 150, 250, 251, 310, 311 Communication unit 160, 260 Witness record 170, 270 Captured image 171, 262, 271 Witness image 190 Save button 261 Signature 280 Electronic signature button 291 Confirmation seal 300, 301 Information processing device 320, 321 Data writing unit 330, 331 Registration unit 340, 341 Database 400 Communication network 2810 Signature field 2820 Apply button 2830 Imaging button

Claims (17)

an information processing device, a first communication terminal, and a second communication terminal;
The first communication terminal
a first imaging unit;
a first communication unit that transmits imaging data indicating an image captured by the first imaging unit to the information processing device;
a first display unit;
the second communication terminal has a second display unit;
the information processing device has a third communication unit that determines whether access from the first communication terminal and the second communication terminal has started, and when it determines that access from the first communication terminal and the second communication terminal has started, transmits predetermined record data to the first communication terminal and also to the second communication terminal, and further transmits imaging data transmitted from the first communication unit to the second communication terminal;
the first display unit displays the record data transmitted from the third communication unit;
The second display unit displays the record data transmitted from the third communication unit and the image represented by the imaging data. The second communication terminal
an observer input unit that inputs confirmation information based on an external operation;
a second communication unit that transmits the confirmation information input by the witness input unit to the information processing device;
The information processing device includes:
2. The information processing system according to claim 1, further comprising a data writing unit that confirms the record data when the confirmation information is transmitted from the second communication unit. the data writing unit writes the confirmation information transmitted from the second communication unit into the record data;
3. The information processing system according to claim 2, wherein the information processing device further comprises a registration unit that registers the record data into which the data writing unit has written the final information in a database. the third communication unit transmits to the first communication terminal the record data into which the data writing unit has written the confirmation information;
4. The information processing system according to claim 3, wherein the first display unit displays the record data in which the final information is written, the record data being transmitted from the third communication unit. the second communication terminal has a second imaging unit;
the second communication unit transmits witness image data indicating the witness image captured by the second imaging unit to the information processing device;
5. The information processing system according to claim 3, wherein the registration unit registers the witness image data transmitted from the second communication terminal together with the report data into which the data writing unit has written the final information. The third communication unit transmits to the first communication terminal the record data on which the witness image indicated by the witness image data is superimposed by the data writing unit,
the first display unit displays the transcript data transmitted from the third communication unit, with the witness image superimposed thereon;
6. The information processing system according to claim 5, wherein the first communication terminal stores the record data displayed by the first display unit. the first communication terminal has an operator input unit that inputs measurement data based on an external operation on the data displayed on the first display unit,
the first communication unit transmits the measurement data input by the worker input unit to the information processing device;
the data writing unit writes the measurement data transmitted from the first communication unit into the record data;
the third communication unit transmits to the second communication terminal report data into which the data writing unit has written the measurement data;
the second display unit displays the record data into which the measurement data is written, the record data being transmitted from the third communication unit;
The information processing system according to claim 3 , wherein the registration unit registers, in the database, the report data into which the data writing unit has written the measurement data and the determination information. The information processing system described in any one of claims 1 to 7, wherein the first communication terminal and the second communication terminal each have a call unit for conducting calls between them. The information processing system described in any one of claims 1 to 8, wherein the first display unit and the second display unit each have a touch panel function. An information processing device having a communication unit that determines whether access has been initiated from a first communication terminal and a second communication terminal, and, when it determines that access has been initiated from the first communication terminal and the second communication terminal, transmits specified report data to the first communication terminal and also to the second communication terminal, and further transmits image data transmitted from the first communication terminal to the second communication terminal. The information processing device of claim 10, further comprising a data writing unit that confirms the record data when confirmation information is transmitted from the second communication terminal. the data writing unit writes the confirmation information transmitted from the second communication terminal into the record data;
The information processing device according to claim 11 , further comprising a registration unit that registers the report data into which the data writing unit has written the final information in a database. The information processing device according to claim 12, wherein the communication unit transmits the report data into which the data writing unit has written the confirmation information to the first communication terminal. The information processing device described in claim 12 or 13, wherein the registration unit registers the imaging data transmitted from the second communication terminal together with the report data into which the confirmation information has been written by the data writing unit. the data writing unit writes the measurement data transmitted from the first communication terminal into the record data;
the communication unit transmits to the second communication terminal report data into which the data writing unit has written the measurement data;
The information processing device according to claim 12 , wherein the registration unit registers, in the database, the report data into which the data writing unit has written the measurement data and the determination information. An information processing method implemented by an information processing device,
a process of determining whether access from the first communication terminal and the second communication terminal has started;
a process of transmitting predetermined record data to the first communication terminal and the second communication terminal when it is determined that access from the first communication terminal and the second communication terminal has started;
and transmitting the imaging data transmitted from the first communication terminal to the second communication terminal. On the computer,
a step of determining whether access from the first communication terminal and the second communication terminal has been initiated;
a step of transmitting predetermined record data to the first communication terminal and the second communication terminal when it is determined that access from the first communication terminal and the second communication terminal has started;
and a program for executing a procedure for transmitting the imaging data transmitted from the first communication terminal to the second communication terminal.