JP7691384B2 - Information processing device - Google Patents

Description

This disclosure relates to an information processing device and an information processing method.

For example, when a person is unable to complete a procedure at a financial institution due to old age or other reasons, a proxy can be appointed.

However, there are cases where the procedure for appointing a proxy is burdensome or reluctant. Even if a proxy is appointed, there may still be concerns about impersonation and fraud.

In one aspect, the present invention aims to provide an information processing device and an information processing method that allow a person to safely carry out a procedure without having to go to the procedure site in person.

(1) In one aspect, a storage processing unit stores in a storage unit first video data obtained by capturing a speech action of a person who expresses or confirms his/her intention in association with an application for a prescribed procedure that requires the person or guardian to express or confirm his/her intention, the first video data including audio data of the first utterance related to the expression or confirmation of intention;
The video data processing device further includes a viewing processing unit that causes a person who determines whether or not to enable the predetermined procedure to view the first video data.

(2) In the above aspect, preferably, the system further includes a determination unit that identifies a speaker included in the video based on the first video data, and determines whether the speaker is a legitimate registered person based on a comparison result between information of the identified speaker and registered information,
The storage processing unit is further configured to store a result of the determination made by the determination unit in the storage unit in association with the first moving image data.

(3) In the above aspect, preferably, the storage processing unit is further characterized in that the judgment result by the judge is stored in the storage unit in association with the first video data.

(4) In the above aspect, preferably, the storage processing unit further stores, in the storage unit, second video data obtained by capturing an image of an agent or assistant for the predetermined procedure in association with the first video data, based on a first predetermined input from the person who expresses or confirms the intention,
The viewing processing unit causes the assessor to view the first moving image data and the second moving image data.

(5) In the above aspect, the second video data is preferably characterized in that it includes audio data of a second utterance in which the agent or assistant refers to the specified procedure.

(6) In the above aspect, preferably, the device further includes an output data generation unit that embeds the first video data in a playable manner in document data that includes input information related to the application for the specified procedure.

(7) In the above aspect, preferably, the storage processing unit is further characterized in that, based on a second predetermined input from the person expressing or confirming the intention, the first video data is associated with an expiration date of the predetermined procedure.

(8) In the above aspect, preferably, a video playback unit acquires in real time first video data of a person who expresses or confirms their intention when a specific procedure requires the person or guardian to express or confirm their intention, the first video data including audio data of a first utterance related to the expression or confirmation of intention, and plays the acquired first video data in real time in a manner that can be viewed by an assessor;
The system further includes a storage processing unit that stores a judgment result made by an judge who judges whether or not to enable the predetermined procedure in association with the first video data.

(9) In another aspect, a document storage step of storing a procedural document associated with an application for a prescribed procedure that requires an expression of intent or confirmation of intent of the person or guardian;
a video storage step of storing a video of a speech action of a person related to the predetermined procedure in association with the procedural document;
a selection receiving step of receiving a selection of the procedural document;
a display step of displaying or making displayable the video associated with the selected procedural document when the selection of the procedural document is accepted by the selection accepting step;
The present invention is characterized by comprising:

In one aspect, the present invention makes it possible to provide an information processing device and information processing method that enable a person to safely carry out a procedure without having to go to the procedure site in person.

FIG. 1 is a diagram illustrating a configuration of an information processing apparatus according to an embodiment of the present invention. FIG. 1 is a diagram showing an example of a configuration in which a plurality of terminal devices (computers) and a server (computer) are capable of communicating with each other. 10 is a flowchart illustrating an example of an information processing procedure in an information processing device. 10 is a flowchart illustrating an example of an information processing procedure in an information processing device. 10 is a flowchart illustrating an example of an information processing procedure in an information processing device. 10 is a flowchart illustrating an example of an information processing procedure in an information processing device. 1 is a diagram illustrating an example of a moving image handled in an information processing device; 1 is a diagram illustrating an example of a moving image handled in an information processing device; 1 is a diagram illustrating an example of a moving image handled in an information processing device; 1 is a diagram illustrating an example of a moving image handled in an information processing device; FIG. 11 is a diagram showing a procedure in a second embodiment. FIG. 11 is a diagram illustrating a moving image handled in the second embodiment.

Each embodiment will be described in detail below with reference to the attached drawings.

(First embodiment)
FIG. 1 is a diagram showing the configuration of an information processing apparatus according to this embodiment.

As shown in FIG. 1, the information processing device 10 of this embodiment includes: a storage processing unit 12 that stores in a storage unit 11 the first video data 21, which is a captured speech action of a person who expresses or confirms their intention, in association with an application for a specified procedure that requires the person or guardian to express or confirm their intention, the first video data 21 including audio data of the first utterance related to the expression of intention or confirmation of intention; a viewing processing unit 13 that allows a judge who determines whether or not to enable the specified procedure to view the first video data 21; a judgment unit 14 that identifies a speaker included in the video based on the first video data 21, and determines whether or not the speaker is a legitimate registered person based on the result of comparing the information of the identified speaker with the registered information; and an output data generation unit 16 that replayably embeds the first video data 21 in document data 23 of a procedural document that includes input information related to the application for the specified procedure.

The storage processing unit 12 stores the judgment result by the judgment unit 14 and the judgment result by the judge in the storage unit 11 in association with the first video data 21, together with the first video data 21. Furthermore, the storage processing unit 12 can further store second video data 22, which captures an image of an agent or assistant for the specified procedure, in the storage unit 11 in association with the first video data 21, based on a first specified input from the person who expresses or confirms his/her intention. This second video data 22 includes audio data of a second utterance in which the agent or assistant refers to the specified procedure.

The storage processing unit 12 can further associate the expiration date of the above-mentioned specified procedure with the first video data 21 based on a second specified input from the person expressing or confirming the above-mentioned intention.

Here, the above-mentioned prescribed procedures are optional, but may include, for example, procedures for various contracts, procedures requiring consent for medical treatment, applications for vaccination, etc.

In addition, the information processing device 10 is connected to a camera 31 that captures the first video data 21 and the second video data 22, a microphone 32 that acquires audio data of the first utterance and the second utterance, an operation reception unit 33 that receives the judgment result by the judge, a first specified input and a second specified input, etc., and a display unit 34 that displays the first video data 21 and the second video data 22. The camera 31, microphone 32, operation reception unit 33, and display unit 34 are configured, for example, as devices built into or externally attached to a terminal device used by a person involved in the information processing.

The information processing device 10 of this embodiment can be configured, for example, by a single computer or by multiple computers that can communicate with each other. FIG. 2 shows an example in which multiple terminal devices (computers) and a server (computer) are configured to be able to communicate with each other. In this case, all of the elements that make up the information processing device 10 may be provided, for example, in the server 10D shown in FIG. 2. The elements that make up the information processing device 10 may also be distributed and provided in multiple devices among the terminal devices 10A, 10B, and 10C and the server 10D shown in FIG. 2. For example, among the elements that make up the information processing device 10, the viewing processing unit 13 and the output data generation unit 16 may be provided in each of the terminal devices 10A to 10C, and the other elements may be provided in the server 10D. Application software (programs) for executing the necessary processes are implemented in each of the terminal devices 10A, 10B, and 10C.

Next, the procedure for executing information processing in the information processing device 10 will be described.

Figures 3 to 3C are flowcharts showing an example of the procedure for information processing in an information processing device, and Figures 4 to 4C are diagrams showing examples of videos handled in the information processing device.

As shown in FIG. 3, in step S102, company X first provides the document data 23 or the video 101 shown in FIG. 4 to the server 10D.

The document data 23 is created, for example, based on an application to company X of the person or guardian 301 who is applying for the specified procedure, and is stored in the memory unit 11. The document data 23 may include, for example, information identifying the person or guardian 301 who is applying for the specified procedure to company X (the name, address, age, etc. of the person or guardian 301) and the date of the document data 23 (the date the document data 23 was created or submitted). Note that guardians include the person's parents, guarantors, guardians of minors, etc.

As shown in FIG. 4, the video 101 has an area 201 in which document data 23, such as an application form selected as the subject of the procedure, is displayed. The document data 23 is stored in the storage unit 11, and the video 101 is generated by the output data generation unit 16 based on the document data 23. Note that instead of the video 101, a still image having the area 201 in which the document data 23 is displayed may be stored in the storage unit 11.

Next, in step S200, a first video data storage process is executed to store video data related to the application of the individual or guardian 301.

Figure 3A is a flowchart showing the first video data storage process (step S200).

In step S202 in FIG. 3A, the storage processing unit 12 determines whether the first video data 21 related to the application of the person or guardian 301 has been received, and proceeds to step S206 when the determination is affirmative. Here, for example, the determination in step S202 is affirmative when the first video data 21 has been transmitted from the terminal device 10A of the person or guardian 301.

In step S206, the determination unit 14 identifies a speaker included in the video of the first video data 21 based on the received first video data 21, and determines whether the speaker is a legitimate registered person based on the result of matching the information related to the identified speaker with the registered information. If the determination is positive, the determination unit 14 proceeds to step S208, and if the determination is negative, the determination unit 14 proceeds to step S210.

The registration information may include, for example, a facial photograph and voice of the person or guardian 301 that have been registered in advance. The determination unit 14 can determine whether the speaker is a legitimate registrant by image matching or voiceprint matching. The determination result by the determination unit 14 is associated with a predetermined procedure (document data 23) via the storage processing unit 12 and stored in the storage unit 11.

In step S208, the storage processing unit 12 stores the first video data 21 received in step S202 in the storage unit 11 in association with the specified procedure (document data 23), and then returns.

Prior to the processing of step S208, the storage processing unit 12 may receive a second specified input from the person or guardian 301 via the terminal device 10A. In this case, the storage processing unit 12 associates the expiration date of the specified procedure with the first video data 21 based on the received second specified input. Setting an expiration date can improve procedural security. This expiration date is associated with the specified procedure (document data 23) and stored in the storage unit 11.

In step S210, the determination unit 14 notifies the terminal device 10A of the individual or guardian 301 that the matching results are a mismatch, and ends the process.

Prior to the application video data storage process (step S200), the person or guardian 301 acquires video 101 (FIG. 4) from information processing device 10 using, for example, terminal device 10A. In addition, using application software implemented in terminal device 10A, the person or guardian 301 captures his/her own expression or confirmation of intention, i.e., speech action indicating the expression or confirmation of intention to apply for a specified procedure, using a built-in or external camera (corresponding to camera 31 in FIG. 1) of terminal device 10A, and records his/her own voice (voice of the first utterance) using a built-in or external microphone (corresponding to microphone 32 in FIG. 1) of terminal device 10A.

At this time, the output data generating unit 16 creates video data of the video 101 using the document data 23 stored in the storage unit 11, and the viewing processing unit 13 transmits the created video data of the video 101 to the terminal device 10A. As a result, the person or guardian 301 can, for example, check the contents of the application form by watching the video 101 displayed on the screen of the terminal device 10A (corresponding to the display unit 34 in FIG. 1), while shooting the speaking action and recording the sound. In addition, the terminal device 10A can display a video (video corresponding to the first video data 21) in which the person or guardian 301 has shot the speaking action of expressing or confirming his/her intention in the area 202 of the video 101, so that the person or guardian 301 can shoot the speaking action and record the sound while checking that not only the application form but also his/her speaking action is shot correctly. In this way, the person or guardian 301 can create the first video data 21 in the terminal device 10A in a form similar to creating the video 102 (FIG. 4A).

As shown in FIG. 4A, video 102 includes a video (video corresponding to first video data 21) of the person or guardian 301 recording a speech action to express or confirm his/her intention. As shown in FIG. 4A, an application form is displayed in area 201 of video 102, as in video 101, and a video (video corresponding to first video data 21) of the person or guardian 301 recording a speech action to express or confirm his/her intention is displayed in area 202 of video 102. In addition, this video (video corresponding to first video data 21) includes audio (audio of first utterance) accompanying the speech action of the person or guardian 301. Video 102 is generated by output data generation unit 16 based on document data 23 and first video data 21 stored in storage unit 11.

After the speaking action of the person or guardian 301 is filmed, the person or guardian 301 transmits the first video data 21 to the server 10D, and the determination in step S202 is affirmative.

In addition, a series of processes may be continuously performed to have the person or guardian 301 watch the video 101, record the speaking movements of the person or guardian 301, and then store the first video data 21 in the storage unit 11.

Next, in step S104, the information processing device 10 (server 10D) notifies, for example, the terminal device 10B of the agent or assistant 302 of the principal or guardian 301 that the principal or guardian 301 wishes to apply for a specified procedure. The agent or assistant 302 is registered in advance. In addition, information related to the agent or assistant 302, for example, access information to the terminal device 10B, is stored in advance in the server 10D.

Next, in step S300 of FIG. 3, the second video data storage process is executed.

Figure 3B is a flowchart showing the second video data storage process (step S300).

In step S302 of FIG. 3B, in response to a request from the terminal device 10B of the agent or assistant 302, the output data generation unit 16 generates a video 102 based on the first video data 21 and document data 23 stored in the memory unit 11, and the viewing processing unit 13 transmits the video data of the video 102 to the terminal device 10B.

In step S304 in FIG. 3B, the information processing device 10 (server 10D) determines whether the second video data 22 (FIG. 1) has been received, and proceeds to step S308 when the determination is affirmative. Here, for example, if the second video data 22 has been transmitted from the terminal device 10B of the agent or assistant 302, the determination in step S304 is affirmative.

In step S308, the storage processing unit 12 stores the second video data 22 received in step S304 in the storage unit 11 in association with the specified procedure (document data 23) and the first video data 21, and then returns.

Prior to the processing of step S308, the agent or assistant 302, for example, uses application software implemented in the terminal device 10B to capture the agent or assistant 302's speech actions for his/her own specified procedure with a camera built into or external to the terminal device 10B (corresponding to camera 31 in FIG. 1), and records the voice (voice of the second utterance) with a microphone built into or external to the terminal device 10B (corresponding to microphone 32 in FIG. 1).

At this time, the output data generating unit 16 creates video data of the video 102 using the first video data 21 and the document data 23 stored in the storage unit 11, and the viewing processing unit 13 transmits the created video data of the video 102 to the terminal device 10A. As a result, the agent or assistant 302 can, for example, check the contents of the application form and the audio of the first utterance of the principal or guardian 301 by viewing the video 103 being shot displayed on the screen of the terminal device 10B or the video 102 displayed on the screen of the terminal device 10A, while shooting his/her own speech and recording the audio. In addition, the terminal device 10B can display a video (video corresponding to the second video data 22) in which the agent or assistant 302 shot his/her own speech in the area 203 of the video 102, so that the agent or assistant 302 can shoot his/her speech and record the audio while checking that his/her own speech is shot correctly. In this way, the agent or assistant 302 can create the second video data 22 on the terminal device 10B in a form similar to that of creating the video 103 (Figure 4B).

Video 103 shown in FIG. 4B includes a video (video corresponding to second video data 22) of the speaking action of agent or assistant 302. As shown in FIG. 4B, an application form is displayed in area 201 of video 103, similar to video 102, and a video of the person or guardian 301 expressing or confirming his/her intentions in speaking action is displayed in area 202 of video 103, similar to video 102.

In addition, a video of an agent or assistant 302 for a specified procedure is displayed in area 203 of video 103, and this video corresponds to second video data 22. In addition, second video data 22 includes audio data of a second utterance in which agent or assistant 302 refers to the specified procedure. Video 103 is generated by output data generation unit 16 based on document data 23, first video data 21, and second video data 22 stored in memory unit 11.

After the speaking action of the agent or assistant 302 is filmed, the agent or assistant 302 transmits the second video data 22 to the server 10D, whereby the determination in step S304 is affirmative.

In addition, a series of processes may be continuously executed to have the agent or assistant 302 watch the video 102, record the speaking action of the agent or assistant 302, and then store the second video data 22 in the storage unit 11.

In step S308, the storage processing unit 12 may wait for a first predetermined input from the person or guardian 301 and store the second video data 22 in the storage unit 11.

In this case, the video data of video 103 can be transferred from server 10D to terminal device 10A in advance to the person or guardian 301, and step S308 can be executed after waiting for the first predetermined input to be received via terminal device 10A.

Through this process, the principal or guardian 301 can, for example, confirm whether the agent or assistant 302 is a legitimate person by viewing the video 103. In this case, the principal or guardian 301 can simply perform the first predetermined input after confirming that the agent or assistant 302 captured in the video 103 is a legitimate person.

Next, in step S400 of FIG. 3, a judgment process is executed. The judgment process (step S400) is a process in which the judge 303 judges the validity of the predetermined procedure. The judge 303 is, for example, a person in charge at company X.

Figure 3C is a flowchart showing the determination process (step S400).

In step S402, the information processing device 10 determines whether the specified procedure is valid based on the information stored in the memory unit 11, and if the determination is affirmative, the process proceeds to step S404, and if the determination is negative, the process proceeds to step S408. In step S408, the information processing device 10 notifies the person or guardian 301 that the procedure is invalid, and ends the process.

In step S402, for example, the information processing device 10 determines the validity of the procedure based on the date of the document data 23 stored in the memory unit 11 (the date the document data 23 was submitted), information identifying the person or guardian 301 (e.g., age), an expiration date specified by a second predetermined input from the person or guardian 301, etc.

In step S404, the viewing processing unit 13 causes the assessor 303 to view the video 103 including the document data 23, the first video data 21, and the second video data 22.

As shown in FIG. 4B, the video 103 includes a video (corresponding to the second video data 22) that captures the speaking action of the agent or assistant 302.

As shown in FIG. 4B, an application form is displayed in area 201 of video 103, similar to video 102, a video (video corresponding to first video data 21) of the principal or guardian 301 expressing or confirming his/her intention is displayed in area 202 of video 103, and a video (video corresponding to second video data 22) of the agent or assistant 302's speaking action is displayed in area 203 of video 103. In addition, the video corresponding to first video data 21 includes audio (audio of first utterance) accompanying the speaking action of the principal or guardian 301, and the video corresponding to second video data 22 includes audio (audio of second utterance) accompanying the speaking action of the agent or assistant 302. Video 103 is generated by output data generating unit 16 based on document data 23, first video data 21, and second video data 22 stored in storage unit 11.

As a result, the assessor 303 can, for example, by watching the video 103 displayed on the screen of the terminal device 10C, check the contents of the application form, the speech actions of the principal or guardian 301, and the speech actions of the agent or assistant 302, and make a judgment regarding the prescribed procedures.

In step S404, the assessor 303 watching the video 103, for example, uses application software implemented in the terminal device 10C of the assessor 303 to capture his/her own speech with a built-in or external camera (corresponding to camera 31 in FIG. 1) of the terminal device 10C and record the sound with a built-in or external microphone (corresponding to microphone 32 in FIG. 1) of the terminal device 10C. In addition, the terminal device 10C can display a video of the assessor 303 capturing his/her own speech in the area 204 of the video 103, so that the assessor 303 can capture his/her speech and record the sound while checking that his/her own speech is captured correctly. In this way, the assessor 303 can record and film the speech in a manner similar to creating the video 104. The created video 104 is stored in the server 10D in association with a predetermined procedure.

The stored video 104 may be stored in a form that can be viewed by the person in question or guardian 301, the agent or assistant 302. This allows the person in question or guardian 301, the agent or assistant 302 to confirm, for example, that the prescribed procedure is being treated as valid.

Next, in step S406, the information processing device 10 accepts the judgment result by the judge 303. Here, the judge 303 watches the video 103 to confirm the expression or confirmation of the intention of the person or guardian 301, and the reference to the specified procedure by the agent or assistant 302, and ultimately judges whether or not to treat the specified procedure as valid. The judgment content of the judge 303 is arbitrary, but for example, the judgment can be made based on whether the person or guardian 301 is a legitimate person or the intention of the person or guardian 301. In addition, the judge 303 can make a judgment based on the content of the reference to the specified procedure by the agent or assistant 302, for example, whether or not the specified procedure is allowed to proceed. The judgment result of the judge 303 is associated with the specified procedure (document data 23) by the storage processing unit 12 and stored in the storage unit 11.

In step S410, the information processing device 10 determines whether or not to treat the procedure as valid based on the determination result received in step S406, and if the determination is positive, the process proceeds to step S412, and if the determination is negative, the process proceeds to step S408.

In step S412, the information processing device 10 notifies the person or guardian 301 and the agent or assistant 302 that the procedure will be treated as valid, and then returns.

As described above, in this embodiment, a single video 103 including the speech actions and audio of the person in question or guardian 301 is created, and the assessor 303 can watch this. This allows the assessor 303 to easily determine whether or not a specified procedure should be treated as valid. Even if the person in question does not go to the procedure site, there is no need to worry about impersonation or fraud involving an agent, and the procedure can be carried out safely.

In addition, in this embodiment, a single video 103 containing the speech actions of multiple people related to the specified procedure and their audio is created, and the assessor 303 can watch this. Therefore, the assessor 303 can easily determine whether or not the specified procedure should be treated as valid simply by checking the single video 103. In addition, the burden on those involved in the specified procedure can be significantly reduced.

In addition, videos 102 to 104 allow you to see the link between facial (mouth) movements and audio, which not only allows you to clearly understand the intention of the speech, but also helps prevent dubbing.

In addition, in this embodiment, the speech actions of multiple people involved in the specified procedure are saved as videos 102 to 104 and can be viewed. Therefore, the speech of people involved in the specified procedure can be confirmed at any time using the videos 102 to 104, and mistakes and the like can be effectively prevented.

In the above embodiment, an example is shown in which an agent or assistant 302 is involved in the prescribed procedure, but the present invention is also applicable to cases in which an agent or assistant 302 is not involved. In this case, the assessor 303 can make a judgment on the prescribed procedure by executing a judgment process (FIG. 3C) on the video 102 (FIG. 4A) instead of the video 103.

In this embodiment, measures to prevent tampering or copying of the stored videos 101 to 104 may be implemented, such as signing using an NFT (non-fungible token).

Second Example
As described above, when the agent or assistant 302 is not involved in the predetermined procedure, the predetermined procedure becomes valid when the assessor 303 makes a judgment on the video 102 in which the speaking action of the person in question or guardian 301 is recorded. In this case, the assessor 303 can make the necessary judgment based on real-time exchange with the person in question or guardian 301, rather than watching the video 102 based on the first video data 21 stored in the storage unit 11.

Figure 5 shows the procedure in the second embodiment, and Figure 6 shows an example of an image handled in the second embodiment.

In the example of FIG. 5, for example, the person or guardian 301 and the assessor 303 have a real-time conversation between the terminal device 10A and the terminal device 10C via the video 105 shown in FIG. 6. In this case, the video 105 is displayed in real time on the screens of the terminal device 10A and the terminal device 10C. In the area 201 of the video 105, an image of an application form based on the document data 23 is displayed, in the area 202 of the video 105, the speech action of the person or guardian 301 captured by the camera of the terminal device 10A, and in the area 204 of the video 105, the speech action of the assessor 303 captured by the camera of the terminal device 10C, are displayed in real time. In addition, the video 105 displayed on the screen of the terminal device 10C is stored in the memory unit 11 in association with a predetermined procedure (document data 23) by the memory processing unit 12 together with the voices of the person or guardian 301 and the assessor 303. The video 105 stored in the memory unit 11 can be made viewable.

In this embodiment, the assessor 303 can make a judgment while checking the speech actions and voice of the person or guardian 301. This allows the assessor 303 to easily determine whether or not a specified procedure should be treated as valid. Even if the person or guardian does not go to the procedure site, the procedure can be carried out safely without concerns about impersonation or fraud involving the agent.

In this embodiment, the assessor 303 can confirm the link between the facial (mouth) movements and the voice in conversation with the person or guardian 301 from the video 105, and can therefore clearly understand the intention of the speech and easily make a judgment on the prescribed procedures. The judgment result of the assessor 303 is stored in the memory unit 11 in association with the video 105.

In this embodiment, measures to prevent tampering or copying of the stored video 105 may be implemented, such as a signature using an NFT (non-fungible token).

Although each embodiment has been described in detail above, it is not limited to a specific embodiment, and various modifications and changes are possible within the scope of the claims. It is also possible to combine all or some of the components of the above-mentioned embodiments.

10 Information processing device 11 Storage unit 12 Storage processing unit 13 Viewing processing unit (video playback unit)
14 Determination unit 16 Output data generation unit (video playback unit)

Claims (6)

a storage processing unit that stores in a storage unit first video data obtained by capturing a speech action of a person who expresses or confirms an intention of the person or guardian in association with an application for a prescribed procedure that requires the person or guardian to express or confirm the intention, the first video data including audio data of the first utterance related to the expression or confirmation of intention;
a viewing processing unit that causes a determiner who determines whether or not the predetermined procedure is enabled to view the first video data;
The storage processing unit further stores, in the storage unit, second video data obtained by capturing an image of an agent or assistant for the predetermined procedure in association with the first video data based on a first predetermined input from the person who expresses or confirms the intention,
The viewing processing unit causes the determiner to view the first video data and the second video data . a storage processing unit that stores in a storage unit first video data obtained by capturing a speech action of a person who expresses or confirms an intention of the person or guardian in association with an application for a prescribed procedure that requires the person or guardian to express or confirm the intention, the first video data including audio data of the first utterance related to the expression or confirmation of intention;
a viewing processing unit that causes a determiner who determines whether or not the predetermined procedure is enabled to view the first video data;
a determination unit that identifies a speaker included in the video based on the first video data, and determines whether the speaker is a legitimate registered person based on a comparison result between information of the identified speaker and registration information of the person and a guardian that has been registered in advance,
The storage processing unit further stores a result of the determination by the determination unit in the storage unit in association with the first video data . The information processing device according to claim 1 or 2, wherein the storage processing unit further stores the judgment result by the judge in the storage unit in association with the first video data. The information processing device according to claim 1 , wherein the second video data includes audio data of a second utterance in which the agent or the assistant refers to the predetermined procedure. The information processing apparatus according to claim 1 , further comprising an output data generating section that embeds the first video data in document data including input information related to an application for the predetermined procedure in a reproducible manner. The information processing device according to claim 1 , wherein the memory processing unit further associates an expiration date of the specified procedure with the first video data based on a second specified input from the person expressing or confirming the intention.