JP7080780B2 - Authentication device, authentication method and authentication program - Google Patents

Description

The present invention relates to an authentication device, an authentication method and an authentication program.

In recent years, with the spread of communication networks, various services via networks have been provided. As an example of such a service, a technique for authenticating a user is known. As an example of the technique for performing such authentication, when the similarity of accelerations measured by a plurality of terminal devices to be authenticated exceeds a predetermined threshold, each terminal device is used by the same user. As a technique, a technique for authenticating each terminal device is known.

Japanese Unexamined Patent Publication No. 2018-042745

However, with the above-mentioned techniques, it may not be possible to say that the authentication accuracy is high.

For example, the technique described above merely determines whether or not the same user is using the device based on the similarity of accelerations measured by each terminal device. Therefore, there is a risk that a user who is not the owner of each terminal device may perform authentication when using each terminal device.

The present application has been made in view of the above, and an object thereof is to improve the authentication accuracy of the user.

The authentication device according to the present application has an acquisition unit that acquires sensor information acquired by a sensor of a terminal device used by the user when the user unlocks the key, and the sensor information satisfies a predetermined condition. It is characterized by having an authentication unit that authenticates the user based on whether or not the user is authenticated.

According to one aspect of the embodiment, the authentication accuracy is improved.

FIG. 1 is a diagram showing an example of processing executed by the information providing device according to the embodiment. FIG. 2 is a diagram showing a configuration example of the terminal device according to the embodiment. FIG. 3 is a diagram showing a configuration example of the information providing device according to the embodiment. FIG. 4 is a diagram showing an example of information registered in the authentication information database according to the embodiment. FIG. 5 is a flowchart showing an example of the flow of the authentication process executed by the information providing device according to the embodiment. FIG. 6 is a diagram showing an example of a hardware configuration.

Hereinafter, the authentication device, the authentication method, and the embodiment for implementing the authentication program according to the present application (hereinafter referred to as “the embodiment”) will be described in detail with reference to the drawings. It should be noted that this embodiment does not limit the authentication device, the authentication method and the authentication program according to the present application. In addition, each embodiment can be appropriately combined as long as the processing contents do not contradict each other. Further, in each of the following embodiments, the same parts are designated by the same reference numerals, and duplicate explanations are omitted.

[Embodiment]
[1. About the outline of the information providing device]
First, with reference to FIG. 1, an example of a process executed by an information providing device, which is an example of an authentication device, will be described. FIG. 1 is a diagram showing an example of processing executed by the information providing device according to the embodiment. In the example shown in FIG. 1, an example of the information providing system 1 having the information providing device 10, the terminal device 100, and the information processing device 200 has been described. The information providing system 1 may be a system having only the information providing device 10 and the terminal device 100.

The information providing device 10 is an information processing device that executes the authentication process described below, and is realized by, for example, a server device, a cloud system, or the like. For example, the information providing device 10 can communicate with the terminal device 100 and the information processing device 200 via a predetermined network N (see, for example, FIG. 2) such as the Internet. The information providing device 10 may be capable of communicating with an arbitrary number of terminal devices 100 and information processing devices 200.

The terminal device 100 is realized by various information processing devices such as smart devices such as smartphones and tablets, and PCs (Personal Computers). For example, the terminal device 100 has a function of displaying various information and a function of posting various information to an arbitrary service. Further, the terminal device 100 has various sensors and has a function of measuring the physical state of the terminal device 100.

For example, the terminal device 100 has a gyro sensor and measures the inclination of the terminal device 100 with respect to each axial direction. For example, the terminal device 100 has an X-axis in the left-right direction of the screen of the terminal device 100, a Y-axis in the vertical direction, and a Z-axis in the back direction and the front direction, and the direction in which the terminal device 100 is tilted and the gravity direction. Detects the tilted angle as a reference. For example, when the terminal device 100 is tilted so as to rotate clockwise around the Y axis from a state in which the screen is turned up and parallel to the direction of gravity, the terminal device 100 is tilted to the right with the Y axis as the center. , When tilted so as to rotate counterclockwise about the Y axis, it is detected that the tilt is to the left with the Y axis as the center.

In addition to the gyro sensor, the terminal device 100 may include any sensor as long as it is a sensor that detects the physical state of the terminal device 100. For example, the terminal device 100 may have an acceleration sensor that detects acceleration, an illuminance sensor that detects ambient illuminance, and a sound sensor such as a microphone.

The information processing device 200 is realized by various information processing devices such as a PC (Personal Computer), a server device, and a tablet. For example, the information processing device 200 is a device capable of displaying various types of information according to instructions from the information providing device 10.

[1-1. About authentication]
Here, the information providing system 1 authenticates a user who uses the terminal device 100 and the information processing device 200. The information providing system 1 may authenticate the information processing apparatus 200. Here, the authentication performed by the information providing system 1 is a process of determining whether or not the user who uses the terminal device 100 and the information processing device 200 is a pre-registered legitimate user. The authentication performed by the information providing system 1 may be a process of determining whether or not the information processing device 200 is a device used by a legitimate user. That is, in the following description, the authentication performed by the information providing system 1 may correspond to any purpose.

[1-2. About authentication process]
Here, in order to improve the authentication system, the information providing device 10 executes the following authentication process. First, the information providing device 10 acquires the sensor information acquired by the sensor of the terminal device 100 used by the user when the user performs the unlocking operation. Then, the information providing device 10 authenticates the user based on whether or not the sensor information satisfies a predetermined condition.

Further, the information providing device 10 causes the information processing device 200 to be authenticated to display predetermined information. Subsequently, the information providing device 10 acquires the sensor information acquired by the sensor of the terminal device 100 used by the user. Then, the information providing device 10 changes the information displayed on the information processing device according to the sensor information. Further, the information providing device 10 authenticates the user based on whether or not the sensor information satisfies a predetermined condition.

Hereinafter, an example of the flow of the authentication process executed by the information providing device 10 will be described with reference to FIG. For example, the information providing device 10 generates a two-dimensional code used for authentication, and distributes the generated two-dimensional code to the information processing device 200 (step S1). In such a case, the information processing apparatus 200 displays the two-dimensional code on the screen.

In such a case, the terminal device 100 captures the two-dimensional code displayed by the information processing device 200 according to the operation of the user (step S2). Then, the terminal device 100 transmits the information corresponding to the two-dimensional code to the information providing device 10 (step S3). For example, the terminal device 100 may transmit the image of the two-dimensional code to the information providing device 10 as it is, or transmit various information (for example, a character string or the like) indicated by the two-dimensional code to the information providing device 10. May be good.

Subsequently, the information providing device 10 transmits the image of the lock to the information processing device 200 when the two-dimensional code transmitted in step S1 corresponds to the information received in step S3 (step S4). For example, in the information providing device 10, the information indicated by the transmitted two-dimensional code and the information received from the terminal device 100 match, or the transmitted two-dimensional code image and the image received from the terminal device 100 match. In some cases, the image of the lock is transmitted to the information processing apparatus 200. In such a case, the information processing apparatus 200 displays the received lock image on the screen (step S5).

Subsequently, the terminal device 100 accepts the input of the handwritten key image (step S6). For example, the terminal device 100 displays a predetermined campus on the screen and accepts an image of a key drawn by a user. Here, the terminal device 100 may accept an image of a key of any color specified by the user. Then, the terminal device 100 transmits the input handwritten key image, that is, the handwritten key image KP, to the information providing device 10 (step S7). In such a case, the information providing device 10 transmits the handwritten key image KP to the information providing device 10 (step S8), and displays the handwritten key image KP together with the lock on the screen (step S9).

Subsequently, the terminal device 100 regards the terminal device 100 as a key, and receives an input of an operation for unlocking the lock (step S10). For example, as shown in FIG. 1, the user of the terminal device 100 supports the lower part of the main body of the terminal device 100 and tilts the terminal device 100 as if twisting a key. When such an operation is performed, the terminal device 100 detects the inclination of the terminal device 100 in each axial direction via the gyro sensor. The user may perform an operation of inserting the terminal device 100 into the key hole (that is, an operation of moving the terminal device in the Y-axis direction) and then an operation of tilting the terminal device 100. When such an operation is performed, the terminal device 100 detects the moving direction of the terminal device 100 in each axial direction via the acceleration sensor.

As the operation for unlocking the lock by regarding the terminal device 100 as a key (hereinafter, referred to as "unlocking motion"), any operation can be adopted by the user. For example, the unlocking motion may reproduce a predetermined pose while holding the terminal device 100, or may reproduce a predetermined motion. Then, the terminal device 100 transmits the operation information indicating the unlocking motion to the information providing device 10 (step S11). More specifically, the terminal device 100 transmits the sensor data measured by the acceleration sensor or the gyro sensor to the information providing device 10 as operation information at predetermined time intervals.

In such a case, the information providing device 10 transmits the operation information to the information processing device 200 (step S12). Then, the information processing apparatus 200 rotates the key image according to the operation information (step S13). That is, when the information acquired from the terminal device 100 and the two-dimensional code displayed on the information processing device 200 correspond to each other, the information providing device 10 changes according to the sensor information acquired from the terminal device 100 until authentication is performed. The information processing apparatus 200 displays the predetermined information to be processed.

For example, the information processing device 200 regards the Y-axis direction of the terminal device as the longitudinal direction of the key, and rotates the key image on the screen according to the rotation around the Y-axis indicated by the operation information. When the operation information includes the detection result of the acceleration sensor, the information processing apparatus 200 identifies the movement mode of the terminal device 100 from the detection result of the acceleration sensor, and the key is to reproduce the specified movement mode. You may move the image.

To give a more specific example, for example, as an unlocking motion, the user holds the screen of the terminal device 100 so as to be perpendicular to the direction of gravity, and the terminal device 100 is clocked around the Y-axis direction. Rotate 90 degrees clockwise, then rotate the screen counterclockwise so that it is perpendicular to the direction of gravity, rotate the terminal device 100 clockwise 90 degrees around the Y-axis direction again, and then rotate the screen 90 degrees. Is rotated counterclockwise so as to be perpendicular to the direction of gravity, and then rotated 90 degrees counterclockwise as it is. In such a case, the information processing apparatus 200 rotates the key displayed on the screen by 90 degrees clockwise around the axis in the depth direction of the screen, then rotates it to the original position, and then rotates it clockwise again by 90 degrees. Rotate it by a degree, then rotate it back to its original position and then rotate it 90 degrees counterclockwise.

Then, the information providing device 10 executes user authentication by using the identifier of the terminal device 100, the feature amount of the handwritten key image KP, and the operation information while changing the image to be displayed on the information processing device 200. (Step S14). First, the information providing device 10 specifies the MAC address of the terminal device 100, which is the source of the two-dimensional code in step S3, as the identifier of the terminal device 100. The information providing device 10 may acquire arbitrary information as an identifier as long as it is information that can identify the terminal device 100. Then, the information providing device 10 determines whether or not the MAC address of the terminal device 100 is registered in advance, and if it is registered in advance, starts authentication using the handwritten key image KP.

For example, the information providing device 10 compares the feature amount of the handwritten key image registered in advance by the user with the feature amount of the handwritten key image KP acquired in step S7. That is, the information providing device 10 determines whether or not the handwritten key registered in advance and the handwritten key acquired in step S7 are similar to each other. The information providing device 10 may compare, for example, the feature quantities indicating the characteristics of the shape of the key, or may compare the feature quantities indicating the feature quantities of the color of the key. Then, when the feature amount of the handwritten key image registered in advance by the user and the feature amount of the handwritten key image KP acquired in step S7 are similar to each other, the information providing device 10 uses the operation information. Start user authentication.

For example, the information providing device 10 determines whether or not the operation information received from the terminal device 100 satisfies a predetermined condition registered in advance. For example, the information providing device 10 authenticates the user based on whether or not the direction in which the terminal device 100 is tilted satisfies a predetermined condition. To give a more specific example, the information providing device 10 specifies from the operation information which axis the terminal device 100 is tilted in which direction and how much, in which direction and in what order, and the like. do. To give a more specific example, the information providing device 10 indicates that the terminal device 100 is tilted clockwise about the Y axis, then tilted clockwise again, and then counterclockwise. Identify. Then, the information providing device 10 determines whether or not the specified operation matches the operation registered in advance.

The information providing device 10 may calculate the similarity between the operation information and the operation information registered in advance, and determine whether or not the calculated similarity exceeds a predetermined threshold value. Then, the information providing device 10 authenticates that the user is an appropriate user when the operation information received from the terminal device 100 satisfies a predetermined condition registered in advance.

Then, when the user is authenticated, the information providing device 10 transmits the authentication information indicating that the user has been authenticated to the information processing device 200 (step S15). In such a case, the information processing apparatus 200 executes a preset post-authentication process as a process to be executed after the authentication (step S16). For example, the information processing apparatus 200 may display predetermined contents (for example, contents after login by user authentication), or may execute various billing processes and the like.

In the information providing device 10, if the terminal device 100 is not the terminal device 100 registered in advance, the handwritten key image KP does not match or resemble the pre-registered handwritten key image, or the operation information is registered in advance. If the specified conditions are not satisfied, it is determined that the user is not an appropriate user. Then, the information providing device 10 transmits the authentication information indicating that the authentication has failed to the information processing device 200. In such a case, the information processing apparatus 200 displays that the authentication has failed.

In this way, the information providing device 10 authenticates the user based on the unlocking motion input by the user via the terminal device 100. As a result, the information providing device 10 can authenticate the user based on an operation known only to the user, so that the authentication accuracy can be improved.

Further, the information providing device 10 is authenticated using the identifier of the terminal device 100, that is, the authentication using the fingerprint of the terminal device 100, the authentication using the image input by the user by hand, and the opening by the user. A three-step authentication process called authentication using lock motion is performed. Therefore, the information providing device 10 can further improve the authentication accuracy.

[1-3. About authentication timing]
In the above example, when the information providing device 10 receives the operation information from the terminal device 100, the information providing device 10 authenticates the user using the identifier of the terminal device 100, the feature amount of the handwritten key image KP, and the operation information. gone. In this way, the information providing device 10 collectively performs authentication after receiving all the information used for authentication, and outputs the authentication result. Therefore, when the authentication fails, which information the authentication fails is performed. Can be hidden, which can improve the security of authentication.

However, the information providing device 10 may perform authentication using each information step by step. For example, when the information providing device 10 receives the two-dimensional code and the identifier from the terminal device 100, the two-dimensional code displayed on the information processing device 200 corresponds to the two-dimensional code received from the terminal device 100. Moreover, it is determined whether or not the identifier is registered in advance. When the information providing device 10 corresponds to the two-dimensional code displayed on the information processing device 200 and the two-dimensional code received from the terminal device 100, and the identifier is registered in advance, the information is provided. The lock image is displayed on the processing device 200.

Subsequently, when the information providing device 10 receives the handwritten key image KP from the terminal device 100, the information providing device 10 determines whether or not the handwritten key image KP matches or is similar to the pre-registered handwritten key image, and matches or matches. If it is determined that they are similar, the information processing apparatus 200 displays the key image. Subsequently, the information providing device 10 rotates the key image displayed on the information processing device 200 based on the operation information received from the terminal device 100, and whether or not the operation information satisfies a predetermined condition registered in advance. Is determined. Then, when the operation information satisfies a predetermined condition, the information providing device 10 may transmit the authentication information to the information processing device 200.

[1-4. Authentication using operation information]
In the above-mentioned example, the information providing device 10 authenticates the user based on whether or not the unlocking motion indicated by the operation information satisfies a predetermined condition. However, the embodiments are not limited to this. For example, the information providing device 10 may authenticate the user based on whether or not the operation information acquired in advance and the operation information received from the terminal device 100 are similar. More specifically, if the sensor information measured by the acceleration sensor or gyro sensor of the terminal device 100 matches or is similar to the sensor information registered in advance, the information providing device 10 may authenticate the user. good. It should be noted that such comparison of sensor information can be realized by various known techniques such as comparison of feature quantities indicating the characteristics of the sensor information.

Further, the information providing device 10 may authenticate the user based on whether or not the angle at which the terminal device 100 is tilted satisfies a predetermined condition. For example, the information providing device 10 may authenticate the user when the angle of inclination of the terminal device 100 indicated by the operation information and the angle registered in advance are within a predetermined range.

Further, when the angle at which the terminal device 100 is tilted in a predetermined direction exceeds a predetermined threshold value, the information providing device 10 determines that the terminal device 100 is tilted in the predetermined direction, and the determined direction is predetermined. The user may be authenticated based on whether or not the conditions of the above conditions are satisfied. For example, when the user rotates the terminal device 100 clockwise by 60 degrees or more around the Y axis, the information providing device 10 determines that the user has rotated the terminal device 100 clockwise, and determines that the terminal device 100 has been rotated clockwise. When the 100 is rotated counterclockwise by 60 degrees or more, it is determined that the user has rotated the terminal device 100 counterclockwise.

Then, for example, in the information providing device 10, information such as "clockwise, clockwise, counterclockwise" is registered as a condition, and the user "clockwise, clockwise, counterclockwise" the terminal device 100 from the operation information. If it is determined that the product has been rotated "clockwise", the user may be authenticated. That is, the information providing device 10 may authenticate the user based on whether or not the order in which the terminal device 100 is tilted in each direction satisfies a predetermined condition.

In the above description, an example of the process of performing authentication based on the rotation of the terminal device 100 around the Y axis has been described, but the embodiment is not limited to this. For example, the information providing device 10 may perform authentication based on the inclination around the X axis or the Z axis, or may perform authentication based on the inclination in each axis direction.

Further, the information providing device 10 estimates the motion of the terminal device 100 based on the acceleration measured by the acceleration sensor, and authenticates the user based on whether or not the estimated motion is a pre-registered motion. You may go. For example, in the information providing device 10, the acceleration sensor indicates that the terminal device 100 has been pushed out in the Y-axis direction, and then the gyro sensor indicates that the terminal device 100 has been tilted in a predetermined direction in a predetermined order. If indicated by, the user may be authenticated.

Further, the information providing device 10 may estimate the user's motion from the motion information and determine whether or not the estimated motion satisfies a predetermined condition. For example, the information providing device 10 uses the unlocking motion of the user as operation information, such as at what speed the user moves the terminal device 100 and at what speed the terminal device 100 is rotated in which direction. Estimate based on. Then, the information providing device 10 may authenticate the user if the estimated unlocking motion satisfies a predetermined condition. Further, the information providing device 10 determines whether or not various information indicated by the operation information or estimated from the operation information, such as the order of the user's operations, the time for performing the operations, and the speed of the operations, satisfies a predetermined condition. Based on this, the user may be authenticated.

[1-5. About authentication using handwritten key]
In the above example, the information providing device 10 acquires an image of a key picture manually input by the user, that is, a handwritten key image KP, and whether or not the handwritten key image KP is similar to a pre-registered key image. The user was authenticated based on the key. However, the embodiment is not limited to this, and for example, the information providing device 10 may authenticate the user based on whether or not the handwritten key image KP satisfies a predetermined condition.

For example, the information providing device 10 may authenticate the user based on whether or not the shape of the key in the handwritten key image KP is similar to the shape of the key registered in advance. For example, the information providing device 10 determines whether or not the number and spacing of the convex portions of the key manually input by the user match the number and spacing of the convex portions of the key in the pre-registered handwritten key image. , The user may be authenticated. Further, the information providing device 10 may authenticate the user by converting the features of the shape of the key into feature quantities and comparing the feature quantities with each other.

Further, the information providing device 10 may authenticate the user based on whether or not the color of the key handwritten by the user is similar to the color of the key registered in advance. Further, the information providing device 10 calculates the feature amount indicating the color of the key in the handwritten key image KP and the handwritten key image registered in advance, and compares the calculated feature amounts with each other to authenticate the user. May be done.

Further, the information providing device 10 may compare arbitrary features related to the shape such as whether or not an opening is located in the key, the size of the convex portion, the range to which the color is applied, the angle of the convex portion, and the like. .. Further, the information providing device 10 is used not only when the shape and color of the key in the handwritten key image KP and the pre-registered handwritten key image completely match, but also when the similarity exceeds a predetermined threshold value. Authentication may be performed. That is, if it can be determined that the handwritten key image KP and the pre-registered handwritten key image are input by the same user, the information providing device 10 may authenticate the user.

[1-6. Authentication using identifiers]
Here, the information providing device 10 may adopt any information as an identifier as long as it is information that can identify the terminal device 100. For example, the information providing device 10 may adopt a MAC (Media Access Control) address of the terminal device 100, an IMEI (International Mobile Equipment Identifier) number, or the like as an identifier. Further, when the identifier of the terminal device 100 is registered, the information providing device 10 is used by determining whether or not the handwritten key image KP or the operation information satisfies the condition associated with the identifier in advance. All you have to do is authenticate the person.

[1-7. About authentication using locks]
Here, the information providing device 10 does not need to display the image of the lock on the information processing device 200. On the other hand, the information providing device 10 may authenticate the user based on the image of the lock displayed on the information processing device 200. For example, the information providing device 10 causes the information processing device 200 to display a plurality of locks. To give a more specific example, the information providing device 10 displays an image of a lock registered in advance by a user of the terminal device 100 and an image of another lock. Further, the information providing device 10 acquires information indicating the lock selected by the user from among the plurality of locks via the information processing device 200 or the terminal device 100. Then, when the lock selected by the user matches the lock registered in advance, the information providing device 10 may perform authentication based on the handwritten key image KP or the operation information.

Further, the information providing device 10 causes the user to input the shape of the lock by hand, and authenticates the user based on whether or not the shape of the inserted lock is similar to the shape of the pre-registered lock. You may. That is, even if the information providing device 10 authenticates the user when the shape of the lock and the shape of the key handwritten by the user are similar to the shape of the lock and the shape of the key registered in advance. good.

[1-8. About authentication using authentication of different users]
Further, the information providing device 10 may authenticate the user by authenticating a plurality of other users in case the user forgets the shape of the key. For example, the information providing device 10 acquires sensor information acquired by a sensor of each terminal device 100 from a plurality of terminal devices 100 used by a plurality of other users associated with a user to be authenticated in advance. Then, the information providing device 10 may authenticate the user based on whether or not the sensor information acquired from each terminal device 100 satisfies a predetermined condition.

For example, when the information providing device 10 receives a notification from the terminal device 100 of the first user that another user authenticates, the second user and the third user previously associated with the first user. Identify the user. In such a case, the information providing device 10 displays the image of the lock corresponding to the second user and the image of the lock corresponding to the third user to the information processing device 200.

Subsequently, the information providing device 10 acquires the identifier, the handwritten key drawing KP, and the operation information from the terminal device 100 of the second user, and authenticates the second user. Further, the information providing device 10 acquires an identifier, a handwritten key drawing KP, and operation information from the terminal device 100 of the third user, and authenticates the third user. At this time, the information providing device 10 may display a predetermined key image without displaying the handwritten key image of the second user or the third user on the information processing device 200. Further, the information providing device 10 may not rotate each key image based on the operation information of each user, but may simply rotate the key image in a predetermined direction.

Then, when the authentication of the second user is successful and the authentication of the third user is successful, the information providing device 10 determines that the authentication of the first user has been performed. Then, the information providing device 10 may transmit the authentication information indicating that the first user has been authenticated to the information processing device 200. That is, the information providing device 10 authenticates the first user by causing a plurality of other users to authenticate the first user and authenticates these other users. May be determined.

In the information providing device 10, for example, the timing of acquiring the operation information from the terminal device 100 of the second user and the timing of acquiring the operation information from the terminal device 100 of the third user are within a predetermined time. Only in that case, the first user may be authenticated. That is, the information providing device 10 may authenticate the first user only when the second user and the third user input the unlocking motion of each user at the same time. Further, the information providing device 10 may perform authentication only when the terminal device 100 of each user is connected to the same access point or connected to the same base station.

[1-9. About authentication using other information]
Further, the information providing device 10 may perform authentication according to the positions of the terminal device 100 and the information processing device 200. For example, the information providing device 10 acquires the position information acquired by the terminal device 100 or the information processing device 200 using GPS or the like, and only when the position indicated by the acquired position information is included in the pre-registered area. , The user may be authenticated. Further, the information providing device 10 may authenticate the user only when the positions of the terminal device 100 and the information processing device 200 are within a predetermined range. Further, in the information providing device 10, the terminal device 100 of the first user, the terminal device 100 of the second user, the terminal device 100 of the third user, and the information processing device 200 are located in the same area. You may authenticate only if you do.

Further, the information providing device 10 may authenticate the user only within a predetermined time set in advance. Further, the information providing device 10 may perform authentication only when the terminal device 100 or the information processing device 200 is located in an area corresponding to the type of processing executed by the information processing device 200 after authentication. For example, when the information processing device 200 after authentication displays a predetermined web content, the information providing device 10 authenticates the user regardless of the position of the terminal device 100 or the information processing device 200, and performs information processing after the authentication. When the device 200 provides financial services such as net banking, authentication is performed only when the positions of the terminal device 100 and the information processing device 200 are located in a preset area (for example, office or home). You may.

Further, the information providing device 10 may perform authentication only in a time zone corresponding to the type of processing executed by the information processing device 200 after the authentication. For example, when the information processing device 200 provides financial services after authentication, the information providing device 10 may perform authentication only in a predetermined time zone during the daytime.

Further, the information providing device 10 may detect the operation when the key is inserted into the key hole of the lock by the acceleration sensor, and perform authentication based on the characteristics of the operation. Further, for example, the information providing device 10 authenticates the user according to the position on the screen touched by the user when holding the terminal device 100 or the position on the screen tapped by the user at an arbitrary timing. May be done.

Further, for example, when the operation of swiping the handwritten key image is performed, the terminal device 100 transmits the handwritten key image KP to the information providing device 10, and the content of the swipe operation (for example, swiping is performed). The position and speed) are transmitted to the information providing device 10. In such a case, the information providing device 10 may authenticate the user based on the content of the swipe operation.

[1-10. About authentication using a model]
Further, the information providing device 10 may generate an authentication model for each user and perform authentication using the generated authentication model. For example, the information providing device 10 is used for SVM (Support Vector Machine), DNN (Deep Neural Network), CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), LSTM (Long short-term memory), and the like. The characteristics of the handwritten key image by the person and the characteristics of the operation information are learned as the characteristics of the correct answer data. Then, the information providing device 10 may input the features of the handwritten key image acquired from the terminal device 100 and the features of the operation information into the authentication model to determine whether or not the data is correct.

[1-11. Suggestions for operation using sound and vibration]
Here, in the above-mentioned processing, the information providing device 10 states that when the terminal device 100 is tilted clockwise or counterclockwise by a predetermined angle or more, the terminal device 100 is rotated clockwise or counterclockwise. Judged. Here, the information providing device 10 may notify the user that the terminal device 100 has been determined to have rotated. For example, when the terminal device 100 is tilted by a predetermined angle or more, the information providing device 10 may output a predetermined click sound or the like from the information processing device 200 or the terminal device 100, and causes the terminal device 100 to vibrate. May be good.

Further, for example, the information providing device 10 may vibrate the terminal device 100 when the acquired operation information does not match the registered operation information.

[1-12. Providing information used for authentication]
The information providing device 10 may change the two-dimensional code displayed on the information processing device 200 at the time of authentication at predetermined time intervals, and may deliver a different two-dimensional coat each time. Further, the information providing device 10 may generate a new unlocking motion each time of authentication, and notify the terminal device 100 of the generated unlocking motion via SMS (Short Message Service) or the like.

For example, when the information providing device 10 receives an authentication request from the terminal device 100, the information providing device 10 indicates an unlocking motion such as "clockwise, counterclockwise, counterclockwise" using a telephone number registered in advance by the user. Send a short message. The information providing device 10 may notify the user of an unlocking motion such as "clockwise, counterclockwise, counterclockwise" via mechanical voice. Then, when the information providing device 10 receives the operation information indicating the unlocking motion such as "clockwise, counterclockwise, counterclockwise" from the terminal device 100 within a predetermined time after notifying the unlocking motion. May authenticate the user. That is, when the information providing device 10 detects the same operation as the operation notified to the user, the user may be authenticated. Any content can be adopted for such an unlocking motion, and it is possible to change to a different unlocking motion each time authentication is performed.

[1-13. others〕
The information providing device 10 may extract a feature amount indicating the physical characteristics of the user from the operation information and perform authentication based on whether or not the extracted feature amount satisfies a predetermined condition. For example, the sensor information acquired by the terminal device 100 includes unlocking motion information, that is, local movements such as tremors that are factors in the movements of the user's muscles, in addition to the global movements. Here, the local movement is considered to be different for each user. Therefore, the information providing device 10 extracts a local feature from the sensor information acquired as operation information, and determines whether or not the extracted feature matches the local feature amount extracted from the sensor information acquired in advance. Based on this, the user may be authenticated.

Further, for example, the information providing device 10 calculates the similarity of local features and the similarity of global features with respect to the operation information acquired from the terminal device 100 and the operation information registered in advance. Then, the information providing device 10 integrates the first count with respect to the similarity of the local features and the second count smaller than the first count with respect to the similarity of the global features. The user may be authenticated based on the sum of. That is, the information providing device 10 may perform authentication that emphasizes local features rather than global features.

Further, the information providing device 10 may authenticate the user based on the characteristics when manually inputting the key. For example, when the terminal device 100 receives a manual input of a key from a user, not only the final handwritten key image but also information indicating each stroke when the key is manually input is transmitted to the information providing device 10. Send. In such a case, the information providing device 10 may authenticate the user when the stroke order of the keys indicated by each stroke matches the stroke order registered in advance.

Further, the information providing device 10 may specify the habit of holding the terminal device 100 from various sensor information and authenticate the user based on the specified habit. In addition, the information providing device 10 may authenticate the user based on whether or not any information that can be acquired from the terminal device 100 matches or is similar to the information registered in advance. For example, the information providing device 10 may authenticate the user based on various activity logs and the like that can be acquired by the terminal device 100.

In the above-mentioned example, the information providing system 1 causes the user to input the picture of the key by hand, but the picture input by the user is not limited to the picture of the key. For example, as the picture input by the user, a picture or a character of an arbitrary object can be adopted in addition to the image of the key.

[1-14. About processing at the time of registration]
Here, the information providing device 10 accepts registration of the identifier of the terminal device 100, the handwritten key image, and the operation information in advance in order to authenticate the user. When accepting such registration, the information providing device 10 determines whether or not the handwritten key image or operation information satisfies a predetermined condition in order to improve security, and if not, a different handwritten key image. Or you may request the user to register the operation information.

For example, the information providing device 10 may estimate the complexity of the handwritten key image and request the user to register a more complicated handwritten key image when the estimated complexity is equal to or less than a predetermined threshold value. .. For example, the information providing device 10 calculates a score based on the number and roundness of the convex portions, and if the calculated score is equal to or less than a predetermined threshold value, asks the user to register a more complicated handwritten key image. May be good.

Further, for example, the information providing device 10 estimates the complexity of the unlocking motion indicated by the operation information, and when the estimated complexity is equal to or less than a predetermined threshold value, the user is requested to register a more complicated unlocking motion. You may ask for it. For example, the information providing device 10 calculates a score based on the number of times the terminal device 100 is rotated and the complexity of the direction, and if the calculated score is equal to or less than a predetermined threshold value, a more complicated unlocking motion is registered. You may ask the user to do so.

[1-15. Applicable target]
In the above-mentioned example, the information providing system 1 executes the above-mentioned processing in order to authenticate the information processing apparatus 200 and the user. However, the embodiments are not limited to this. For example, the information providing system 1 may execute the above-mentioned process in order to authenticate the user in so-called mobile payment.

For example, the information providing system 1 may have a POS (Point of Sale) terminal for making payment as the information processing device 200. Then, when the user is authenticated, the information providing device 10 acquires the payment amount from the POS terminal or the terminal device 100, and executes the payment processing of the acquired payment amount in cooperation with various payment servers and the like. do. Then, the information providing device 10 may transmit to the POS terminal device that the payment has been completed.

Further, for example, the information providing system 1 may combine VR (Virtual Reality) or AR (Augmented Reality) with the above-mentioned authentication process. For example, the information providing device 10 has an HMD (Head Mounted Display) worn by the user as the information processing device 200, and displays the lock in the user's field of view. Further, when the user receives the handwritten key image input by handwriting via the virtual terminal device 100 reproduced in the VR space or the AR space, the information providing device 10 uses the handwritten key as a virtual key. Is displayed in the user's field of view.

Then, the information providing device 10 may authenticate the user based on the motion when the user unlocks the lock using the virtual key. For example, the information providing device 10 may specify the motion of the user based on the operation information acquired by the controller that accepts various operations on the VR space or the AR space and the various wearable devices.

Further, the information providing device 10 may execute the above-mentioned authentication process in order to unlock the house key or the like. For example, the information providing device 10 regards the device for locking the entrance as the above-mentioned information processing device 200, executes the above-mentioned authentication process, and when the user is authenticated, unlocks the entrance key. You may. In such processing, the information providing device 10 does not need to display the lock or the handwritten key image.

[2. About an example of functional configuration]
Hereinafter, an example of the functional configuration of the terminal device 100 and the information providing device 10 that realize the above-mentioned authentication process will be described.

[2-1. About an example of the functional configuration of the terminal device 100]
First, an example of the functional configuration of the terminal device 100 will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the terminal device according to the embodiment. As shown in FIG. 2, the terminal device 100 includes a communication unit 120, a storage unit 130, an input unit 140, an output unit 150, a sensor 160, and a control unit 170.

The communication unit 120 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 120 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the information providing device 10 and the information processing device 200.

The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk.

The input unit 140 is an input device that receives various inputs from the outside. For example, the input unit 140 is an operation device for the user to perform various operations such as a keyboard, a mouse, and operation keys. The input unit 140 functions as an input means of the terminal device T. When a touch panel is adopted in the terminal device 100, the touch panel is also included in the input unit 140. In this case, the user performs various operations by touching the screen with a finger or a stylus.

The output unit 150 is a device that outputs various outputs such as sound, light, vibration, and an image to the outside. The output unit 150 functions as an output means of the terminal device T. The output unit 150 includes a display device that displays various types of information. The display device is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. When a touch panel is adopted for the terminal device T, the display device (hereinafter referred to as a screen) may be integrated with the input unit 140. The output unit 150 displays an image under the control of the control unit 170.

The sensor 160 is various sensor devices for measuring the physical state of the terminal device 100. For example, the sensor 160 is realized by various sensing devices such as a gyro sensor, an acceleration sensor, an illuminance sensor, a microphone, and various image sensors.

The control unit 170 is a controller, and for example, various programs stored in a storage device inside the terminal device 100 by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) store a RAM or the like. It is realized by being executed as a work area. Further, the control unit 170 is a controller, and may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 2, the control unit 170 has a photographing unit 181, a reception unit 182, and a measurement unit 183 by executing the authentication application 180. The control unit 170 may execute any application other than the authentication application 180.

The photographing unit 181 photographs the two-dimensional code displayed on the information processing apparatus 200. For example, the photographing unit 181 displays the images acquired by various image sensors on the screen, and photographs the images acquired by the image sensors according to the user's operation. Further, the photographing unit 181 specifies the two-dimensional code included in the photographed image, and specifies the information indicated by the specified two-dimensional code. Then, the photographing unit 181 transmits the specified information and the identifier of the terminal device 100 to the information providing device 10.

The reception unit 182 accepts the input of the handwritten key image. For example, the reception unit 182 inputs handwritten information on the screen when the photographing unit 181 transmits the information of the two-dimensional code or when the information providing device 10 receives a response to the effect that the information of the two-dimensional code has been received. The campus part to be accepted and the icon to accept the color switching are displayed. Then, the reception unit 182 receives the image of the key handwritten by the user according to the operation of the user. After that, the reception unit 182 transmits the received key image as a handwritten key image KP to the information providing device 10.

The measuring unit 183 measures the unlocking motion. For example, when the measurement unit 183 receives the operation information transmission request from the information providing device 10, the measurement unit 183 displays information prompting the input of the unlocking motion on the screen and acquires various sensor information acquired by the sensor 160. do. Then, the measurement unit 183 transmits the acquired sensor information to the information providing device 10.

[2-2. An example of the functional configuration of the information providing device 10]
Subsequently, an example of the functional configuration of the information providing device 10 will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the information providing device according to the embodiment. As shown in FIG. 3, the information providing device 10 includes a communication unit 20, a storage unit 30, and a control unit 40.

The communication unit 20 is realized by, for example, a NIC or the like. Then, the communication unit 20 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the terminal device 100 and the information processing device 200.

The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. Further, the storage unit 30 stores the authentication information database.

Authentication information used in user authentication is registered in the authentication information database 31. For example, FIG. 4 is a diagram showing an example of information registered in the authentication information database according to the embodiment. As shown in FIG. 4, the transaction target database includes "authentication information ID (Identifier)", "terminal identifier", "device identifier", "handwritten key feature amount", "unlocking motion", and "lock information". Information with items is registered.

Here, the "authentication information ID" is an identifier for identifying the authentication information. Further, the "terminal identifier" is an identifier for identifying the terminal device 100. The "device identifier" is an identifier for identifying the information processing device 200. The "handwritten key feature amount" is a feature amount of the handwritten key image registered in advance. Further, the "unlocking motion" is information indicating a pre-registered unlocking motion. Further, the "lock information" is information indicating a lock registered in advance by the user.

For example, in the example shown in FIG. 4, the authentication information ID "ID # 1", the terminal identifier "TID # 1", the device identifier "PCID # 1", the handwritten key feature amount "feature amount # 1", and the unlocking motion "open". "Lock motion # 1" and lock information "lock # 1" are registered in association with each other. Such information is for the authentication information ID "ID # 1" to perform authentication using the terminal device 100 indicated by the terminal identifier "TID # 1" and the information processing device 200 indicated by the device identifier "PCID # 1". Indicates that the authentication information is. Further, in such information, the feature amount of the handwritten key image KP received from the terminal device 100 indicated by the terminal identifier "TID # 1" is similar to the handwritten key feature amount "feature amount # 1", and the terminal identifier "TID" is used. When the unlocking motion indicated by the operation information received from the terminal device 100 indicated by "# 1" matches the unlocking motion "unlocking motion # 1", it indicates that the user is authenticated. Further, such information indicates that the information processing apparatus 200 indicated by the device identifier "PCID # 1" is to display the image of the lock indicated by the lock information "lock # 1".

In addition to the information shown in FIG. 4, various information used for authentication may be registered in the authentication information database 31. Further, in the example shown in FIG. 4, conceptual values such as "feature amount # 1", "unlocking motion # 1", and "lock # 1" are described, but in reality, the authentication information database 31 contains Various information indicating the feature amount of the handwritten key image and various information indicating the content of the unlocking motion are registered, and the image of the lock and the like are registered in the authentication information database 31.

Returning to FIG. 3, the explanation will be continued. The control unit 40 is a controller, and is realized by, for example, using a processor such as a CPU or MPU to execute various programs stored in the storage device inside the information providing device 10 using the RAM or the like as a work area. Further, the control unit 40 is a controller, and may be realized by an integrated circuit such as an ASIC or FPGA.

As shown in FIG. 3, the control unit 40 includes a registration unit 41, a display control unit 42, an acquisition unit 43, and an authentication unit 44. The registration unit 41 accepts the registration of the authentication information. For example, the registration unit 41 receives in advance the identifier of the terminal device 100, the device identifier of the information processing device 200, the handwritten key image, and the operation information from the terminal device 100. Further, the registration unit 41 acquires an image of the lock selected by the user or an image of the lock input by handwriting. In such a case, the registration unit 41 extracts the feature amount of the handwritten key image and specifies the unlocking motion from the operation information. Then, the registration unit 41 registers the identifier of the terminal device 100, the device identifier of the information processing device 200, the feature amount extracted from the handwritten key image, the specified unlocking motion, and the image of the lock in association with each other in the authentication information database 31. ..

The display control unit 42 causes the information processing device 200 to display various types of information. For example, when the display control unit 42 receives an authentication request from the terminal device 100 or the information processing device 200, the display control unit 42 transmits an image of the two-dimensional code to the information processing device 200 and displays it on the screen. Further, when the display control unit 42 receives the information from the terminal device 100, the display control unit 42 determines whether or not the received information corresponds to the two-dimensional code, and when it determines that the information corresponds, the information of the two-dimensional code is used. A response to the effect of acceptance is transmitted to the terminal device 100.

Further, the display control unit 42 identifies the device identifier associated with the terminal layer identifier of the terminal device 100, and transmits the lock information associated with the terminal identifier to the information processing device 200 indicated by the specified device identifier. Then, the image of the lock is displayed. In addition to the lock image indicated by the lock information, the display control unit 42 may acquire a plurality of lock images and transmit the acquired plurality of lock images to the information processing apparatus 200 for display. ..

When the handwritten key image KP is acquired by the acquisition unit 43, the display control unit 42 transmits the acquired handwritten key image KP to the information processing apparatus 200 and displays it on the screen. Then, when the operation information is acquired by the acquisition unit 43, the display control unit 42 instructs the information processing apparatus 200 to rotate the handwritten key image KP according to the acquired operation information. For example, the display control unit 42 instructs the information processing device 200 to rotate the image of the picture of the key displayed on the information processing device 200 according to the inclination of the terminal device 100 indicated by the sensor information acquired as the operation information. Then, the display control unit 42 instructs the information processing apparatus 200 to rotate the image of the picture of the key according to the sensor information until the authentication is performed.

The acquisition unit 43 acquires the sensor information acquired by the sensor of the terminal device 100 used by the user when the user performs the unlocking operation. For example, the acquisition unit 43 acquires information indicating an image taken by the terminal device 100, that is, information corresponding to the two-dimensional code and an identifier that identifies the terminal device 100. Then, when the acquired two-dimensional code and the corresponding information correspond to the two-dimensional code displayed on the information processing device 200, the acquisition unit 43 has a key picture manually input by the user from the terminal device 100. Image, that is, the handwritten key image KP is acquired.

Then, the acquisition unit 43 acquires the operation information indicating the unlocking motion. For example, the acquisition unit 43 acquires sensor information indicating the inclination of the terminal device 100 acquired by the gyro sensor of the terminal device 100 as operation information. When the information processing device 200 displays images of a plurality of locks, the acquisition unit 43 acquires information indicating the lock selected by the user from the information processing device 200 or the terminal device 100. You may. Further, when the acquisition unit 43 authenticates the first user by authenticating the second user and the third user, the acquisition unit 43 uses a plurality of terminals used by a plurality of other users previously associated with the user. The sensor information acquired by the sensor of each terminal device 100 may be acquired from the device 100.

The authentication unit 44 authenticates the user based on whether or not the sensor information satisfies a predetermined condition. First, the authentication unit 44 authenticates the user based on whether or not an identifier that identifies the terminal device 100 is registered in advance. For example, the authentication unit 44 determines whether or not the identifier received from the terminal device 100 is registered in the authentication information database 31, and if it is registered, the handwritten key feature registered in association with the identifier. Specify the amount. Then, the authentication unit 44 compares the feature amount of the handwritten key image received from the terminal device 100 with the specified handwritten key feature amount, and if the feature amounts match or are similar, starts authentication based on the operation information. do.

For example, the authentication unit 44 reads the unlocking motion associated with the terminal identifier of the terminal device 100 from the authentication information database 31. Then, the authentication unit 44 identifies the unlocking motion of the user from the operation information acquired from the terminal device 100, and determines whether or not the identified unlocking motion and the unlocking motion read from the authentication information database 31 match. do. After that, when the unlocking motions match, the authentication unit 44 authenticates that the user is an appropriate user.

For example, when the angle at which the terminal device 100 is tilted in a predetermined direction exceeds a predetermined threshold value, the authentication unit 44 determines that the terminal device 100 is tilted in a predetermined direction, and the determined direction is a predetermined condition. Authenticate the user based on whether or not the conditions are met. More specifically, the authentication unit 44 authenticates the user based on whether or not the order in which the terminal device 100 is tilted in each direction satisfies a predetermined condition. For example, in the authentication unit 44, information such as "clockwise, clockwise, counterclockwise" is registered in the authentication information database 31 as the unlocking motion, and the unlocking motion specified from the operation information is "clockwise". , Clockwise, counterclockwise ", the user may be authenticated.

The authentication unit 44 may perform authentication by comparing sensor information instead of comparing unlocking motions. That is, the authentication unit 44 may perform authentication based on whether or not the sensor information and the sensor information registered in advance from the user are similar. Further, for example, the authentication unit 44 may authenticate the user based on whether or not the direction in which the terminal device 100 is tilted satisfies a predetermined condition. Further, the authentication unit 44 may authenticate the user based on whether or not the angle at which the terminal device 100 is tilted satisfies a predetermined condition. Further, the authentication unit 44 may authenticate the user based on whether or not the inclination of the terminal device 100 indicated by the sensor information satisfies the condition corresponding to the identifier of the terminal device 100.

Further, the authentication unit 44 may authenticate the user based on whether or not the shape of the key manually input by the user is similar to the shape of the key registered in advance, and the user may hand-write the key. The user may be authenticated based on whether or not the color of the key input in is similar to the color of the key registered in advance. Further, the authentication unit 44 displays a plurality of lock images on the information processing apparatus 200, and when the information of the lock image selected by the user is acquired, the authentication unit 44 authenticates with the lock image indicated by the acquired information. The lock information registered in the information database 31 may be compared, and if they match, the user may be authenticated. In addition, the authentication unit 44 executes authentication of the second user and the third user by various processes described above, authenticates that the second user is an appropriate user, and is a third user. If is authenticated as an appropriate user, the first user may be authenticated as an appropriate user.

After that, when the user is authenticated, the authentication unit 44 causes the information processing apparatus 200 to execute a predetermined process. For example, the authentication unit 44 transmits the authentication information to the information processing apparatus 200 and causes the post-authentication process to be executed.

[3. About the flow of processing executed by the information providing device]
Next, an example of the flow of processing executed by the information providing device 10 will be described with reference to FIG. FIG. 5 is a flowchart showing an example of the flow of the authentication process executed by the information providing device according to the embodiment.

As shown in FIG. 5, the information providing device 10 causes the information processing device 200 to display the two-dimensional bar code (step S101). Then, the information providing device 10 determines whether or not the information corresponding to the identifier and the two-dimensional bar code is received from the terminal device 100 (step S102). Here, when the information providing device 10 receives the identifier and the two-dimensional bar code (step S102: Yes), the information processing device 200 causes the information processing device 200 to display the lock (step S103). Subsequently, the information providing device 10 determines whether or not the handwritten key image KP has been received from the terminal device 100 (step S104), and if so (step S104: Yes), the information processing device 200 has the handwritten key image. Is displayed (step S105).

Subsequently, the information providing device 10 determines whether or not the unlocking motion, that is, the operation information is received from the terminal device 100 (step S106), and if it is received (step S106: Yes), the unlocking motion is performed. At the same time, the key image displayed on the information processing apparatus 200 is rotated (step S107). Then, in the information providing device 10, the identifier of the terminal device 100 is registered, the feature amount of the handwritten key image KP is similar to the registered feature amount, and the unlocking motion coincides with the registered unlocking motion. It is determined whether or not to do so (step S108).

Then, when each condition is satisfied (step S108: Yes), the information providing apparatus 10 causes the information processing apparatus 200 to execute the post-authentication process (step S109), and ends the process. On the other hand, if any of the conditions is not satisfied (step S108: No), the information providing device 10 notifies the information processing device 200 that the authentication has failed (step S110), and ends the process.

The information providing device 10 has not received the information corresponding to the identifier and the two-dimensional bar code from the terminal device 100 (step S102: No), and has not received the handwritten key image KP from the terminal device 100 (step S102: No). Step S104: No), or if the unlocking motion has not been received (step S106: No), the process waits until it is received.

[4. Modification example]
In the above, an example of the authentication process by the information providing device 10 has been described. However, the embodiments are not limited to this. Hereinafter, variations of the processing executed by the information providing device 10 will be described.

[4-1. About terminal equipment and information processing equipment]
In the above description, when the information providing device 10 receives the operation information from the terminal device 100 such as a smartphone, the information processing device 200 such as a PC displays the information corresponding to the operation information. Here, when the user is authenticated on the VR space or the AR space, the terminal device 100 or the information processing device 200 may be a virtual device on the VR space or the AR space. Further, the terminal device 100 and the information processing device 200 are single or a plurality of information processing devices that provide a VR space or an AR space to the user, and the terminal device 100 and the information processing device 200 described above are realized. It may be an information processing device that executes various processes.

For example, the lock image or the handwritten key image may be displayed on a virtual screen or may be displayed directly on a virtual space. For example, the information processing device proposes to display the lock in the virtual space and to handwrite the key in the virtual space. Then, the information processing apparatus detects the user's motion and identifies the image of the key drawn in the virtual space by using various known techniques for detecting the user's motion.

Further, when the information processing apparatus detects such an operation of inserting the virtual key into the lock, the information processing apparatus displays an image of inserting the key into the lock in the virtual space. Then, the information providing device 10 determines that the user has been properly authenticated when the operation of the user satisfies a predetermined condition, that is, when the unlocking motion matches the unlocking motion registered in advance. May be good. It should be noted that such user authentication can be used, for example, for user login in a VR space or an AR space.

[4-2. others〕
Further, among the processes described in the above-described embodiment, all or a part of the processes described as being automatically performed can be manually performed, and conversely, the processes described as being manually performed. It is also possible to automatically perform all or part of the above by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in any unit according to various loads and usage conditions. Can be integrated and configured.

In addition, the above-described embodiments can be appropriately combined as long as the processing contents do not contradict each other.

[4-3. program〕
Further, the information providing device 10 according to the above-described embodiment is realized by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 6 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to the output device 1010 and the input device 1020, and the arithmetic unit 1030, the primary storage device 1040, the secondary storage device 1050, the output IF (Interface) 1060, the input IF 1070, and the network IF 1080 are connected by the bus 1090. Have.

The arithmetic unit 1030 operates based on a program stored in the primary storage device 1040 or the secondary storage device 1050, a program read from the input device 1020, or the like, and executes various processes. The primary storage device 1040 is a memory device that temporarily stores data used by the arithmetic unit 1030 for various operations such as RAM. Further, the secondary storage device 1050 is a storage device in which data used by the calculation device 1030 for various calculations and various databases are registered, such as a ROM (Read Only Memory), an HDD (Hard Disk Drive), and a flash memory. Is realized by.

The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various information such as a monitor and a printer. For example, USB (Universal Serial Bus), DVI (Digital Visual Interface), and the like. It is realized by a connector of a standard such as HDMI (registered trademark) (High Definition Multimedia Interface). Further, the input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, a scanner, and the like, and is realized by, for example, USB.

The input device 1020 is, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), or a tape. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like. Further, the input device 1020 may be an external storage medium such as a USB memory.

The network IF 1080 receives data from another device via the network N and sends it to the arithmetic unit 1030, and also transmits the data generated by the arithmetic unit 1030 to the other device via the network N.

The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040, and executes the loaded program.

For example, when the computer 1000 functions as the information providing device 10, the arithmetic unit 1030 of the computer 1000 controls the control unit 40 by executing the program or data (for example, the model M1) loaded on the primary storage device 1040. Realize the function. The arithmetic unit 1030 of the computer 1000 reads and executes these programs or data (for example, model M1) from the primary storage device 1040, but as another example, obtains these programs from other devices via the network N. You may.

[5. effect〕
As described above, the information providing device 10 acquires the sensor information acquired by the sensor of the terminal device 100 used by the user when the user performs the unlocking operation. Then, the information providing device 10 authenticates the user based on whether or not the sensor information satisfies a predetermined condition. Therefore, the information providing device 10 can improve the authentication accuracy of the user.

Further, the information providing device 10 authenticates the user when the acquired sensor information and the sensor information for which registration has been received in advance from the user are similar. For example, the information providing device 10 acquires information indicating the inclination of the terminal device 100 acquired by the sensor of the terminal device 100 as sensor information. Then, the information providing device 10 authenticates the user based on whether or not the direction in which the terminal device 100 is tilted satisfies a predetermined condition. Further, the information providing device 10 authenticates the user based on whether or not the angle at which the terminal device 100 is tilted satisfies a predetermined condition.

To give a more specific example, when the angle at which the terminal device 100 is tilted in a predetermined direction exceeds a predetermined threshold value, the information providing device 10 determines that the terminal device 100 is tilted in the predetermined direction. Then, the user is authenticated based on whether or not the determined direction satisfies a predetermined condition. For example, the information providing device 10 authenticates the user based on whether or not the order in which the terminal device 100 is tilted in each direction satisfies a predetermined condition. Therefore, since the information providing device 10 realizes the authentication based on the unlocking motion of the user, the authentication accuracy of the user can be improved.

Further, the information providing device 10 acquires an image of a picture of a key handwritten by the user, and authenticates the user based on whether or not the acquired image satisfies a predetermined condition. For example, the information providing device 10 authenticates the user based on whether or not the shape of the key handwritten by the user is similar to the shape of the key registered in advance. Further, for example, the information providing device 10 authenticates the user based on whether or not the color of the key handwritten by the user is similar to the color of the key registered in advance. Therefore, the information providing device 10 can further improve the authentication accuracy of the user.

Further, the information providing device 10 distributes and displays the acquired image of the picture of the key to the predetermined information processing device 200. Then, the information providing device 10 acquires information indicating the tilt of the terminal device 100 acquired by the sensor of the terminal device 100 as sensor information, and causes the information processing device 200 to display the information according to the tilt of the terminal device 100 indicated by the sensor information. Rotate the image of the picture of the key. Therefore, the information providing device 10 can indicate to the user that the authentication is properly performed.

Further, the information providing device 10 further acquires an identifier for identifying the terminal device 100, and authenticates the user based on whether or not the identifier for identifying the terminal device 100 is registered in advance. Therefore, the information providing device 10 can further improve the authentication accuracy.

Further, the information providing device 10 acquires information indicating the inclination of the terminal device 100 acquired by the sensor of the terminal device 100 as sensor information, and the inclination of the terminal device 100 indicated by the sensor information corresponds to the identifier of the terminal device 100. Authenticate the user based on whether or not the conditions are met. Further, the information providing device 10 causes the information processing device 200 to display a predetermined image, acquires information indicating an image taken by the terminal device 100, and the information acquired from the terminal device 100 and the displayed image are combined. If so, the user is authenticated based on whether or not the sensor information satisfies a predetermined condition. Therefore, the information providing device 10 can further improve the authentication accuracy.

Further, when the information acquired from the terminal device 100 and the displayed image correspond to each other, the information providing device 10 outputs predetermined information that changes according to the acquired sensor information until the authentication is performed. To display. Then, when the user is authenticated, the information providing device 10 causes the information processing device 200 to execute a predetermined process. Therefore, the information providing device 10 can indicate that the authentication is properly performed.

Further, the information providing device 10 causes a predetermined information processing device 200 to display a plurality of locks. Then, the information providing device 10 acquires information indicating the lock selected by the user among the plurality of locks, and if the lock selected by the user satisfies a predetermined condition, does the sensor information satisfy the predetermined condition? Authenticate the user based on whether or not. Therefore, the information providing device 10 can further improve the authentication accuracy.

Further, the information providing device 10 acquires sensor information acquired by the sensor of each terminal device 100 from a plurality of terminal devices 100 used by a plurality of other users associated with the user in advance, and each terminal device 100. The user is authenticated based on whether or not the sensor information acquired from is satisfied with a predetermined condition. Therefore, for example, when the second user and the third user can authenticate the first user, the information providing device 10 authenticates the second user and the third user. Since the first user is authenticated, even if the first user forgets an appropriate unlocking motion, the authentication can be realized.

Further, the information providing device 10 causes the predetermined information processing device 200 to display the predetermined information, acquires the sensor information acquired by the sensor of the terminal device 100 used by the user, and causes the information processing device 200 to acquire the sensor information according to the sensor information. The displayed information is changed, and the user is authenticated based on whether or not the sensor information satisfies a predetermined condition. Therefore, the information providing device 10 can improve the authentication accuracy of the user.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to carry out the present invention in other modified forms.

Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the estimation unit can be read as an estimation means or an estimation circuit.

10 Information provider 20, 120 Communication unit 30, 130 Storage unit 31 Authentication information database 40, 170 Control unit 41 Registration unit 42 Display control unit 43 Acquisition unit 44 Authentication unit 100 Terminal device 140 Input unit 150 Output unit 160 Sensor 180 Authentication application 181 Shooting section 182 Reception section 183 Measuring section

Claims (17)

The identifier of the terminal device used by the user, the image of the picture of the key handwritten by the user, and the sensor of the terminal device used by the user when the user performs the unlocking operation are acquired. An acquisition unit that acquires sensor information indicating the tilt of the terminal device, and
The first determination of whether or not the identifier of the terminal device satisfies a predetermined condition, the second determination of whether or not the image of the picture of the key satisfies a predetermined condition, and the sensor information acquired by the acquisition unit. It also has an authentication unit that executes a third determination as to whether or not the sensor information registered in advance from the user is similar, and authenticates the user based on each determination result.
If the authentication unit determines that the predetermined conditions are not satisfied by at least one of the first determination, the second determination, and the third determination, it means that the authentication has failed after all the determinations are completed. An authentication device characterized in that the user is notified of the above. The authentication device according to claim 1, wherein the authentication unit authenticates the user based on whether or not the tilted direction of the terminal device satisfies a predetermined condition. The authentication device according to claim 2, wherein the authentication unit authenticates the user based on whether or not the angle at which the terminal device is tilted satisfies a predetermined condition. When the angle at which the terminal device is tilted in a predetermined direction exceeds a predetermined threshold value, the authentication unit determines that the terminal device is tilted in the predetermined direction, and the determined direction satisfies a predetermined condition. The authentication device according to claim 3, wherein the user is authenticated based on whether or not the user is satisfied. Any one of claims 2 to 4, wherein the authentication unit authenticates the user based on whether or not the order in which the terminal device is tilted in each direction satisfies a predetermined condition. The authentication device described in one. Claim 1 is characterized in that the authentication unit authenticates the user based on whether or not the shape of the key handwritten by the user is similar to the shape of the key registered in advance. The authentication device according to any one of 5 to 5. Claim 1 is characterized in that the authentication unit authenticates the user based on whether or not the color of the key handwritten by the user is similar to the color of the key registered in advance. The authentication device according to any one of 6 to 6. The invention according to any one of claims 1 to 7, wherein the first display control unit is provided to distribute and display an image of a picture of a key acquired by the acquisition unit to a predetermined information processing apparatus. Authentication device. The acquisition unit acquires, as the sensor information, information indicating the inclination of the terminal device acquired by the sensor of the terminal device.
The authentication device according to claim 8, wherein the first display control unit rotates an image of a picture of a key displayed on the information processing device according to an inclination of the terminal device indicated by the sensor information. The acquisition unit acquires information indicating the tilt of the terminal device acquired by the sensor of the terminal device as the sensor information, and the authentication unit further obtains the tilt of the terminal device indicated by the sensor information of the terminal. The authentication device according to claim 9, wherein the user is authenticated based on whether or not the identifier of the device and the corresponding condition are satisfied. It has a second display control unit that displays a predetermined image on a predetermined information processing device.
The acquisition unit further acquires information indicating an image taken by the terminal device, and obtains information.
When the information acquired from the terminal device and the image displayed by the second display control unit correspond to each other, the authentication unit uses the sensor information based on whether or not the sensor information satisfies a predetermined condition. The authentication device according to any one of claims 1 to 10, wherein the person is authenticated. When the information acquired from the terminal device and the image displayed by the second display control unit correspond to each other, the second display control unit is acquired by the acquisition unit until the authentication by the authentication unit is performed. The authentication device according to claim 11, wherein predetermined information that changes according to the sensor information is displayed on the information processing device. The authentication device according to claim 11 or 12, wherein the authentication unit causes the information processing device to execute a predetermined process when the user is authenticated. A third display control unit for displaying a plurality of locks on a predetermined information processing device is provided, and the acquisition unit is a lock selected by the user from the plurality of locks from the information processing device or the terminal device. Get the information that indicates
When the lock selected by the user satisfies a predetermined condition, the authentication unit authenticates the user based on whether or not the sensor information satisfies the predetermined condition. Item 6. The authentication device according to any one of Items 1 to 13. The acquisition unit acquires sensor information acquired by the sensor of each terminal device from a plurality of terminal devices used by a plurality of other users associated with the user in advance.
One of claims 1 to 14, wherein the authentication unit authenticates the user based on whether or not the sensor information acquired from each terminal device satisfies a predetermined condition. The authentication device described in one. It is an authentication method executed by the authentication device.
The identifier of the terminal device used by the user, the image of the picture of the key handwritten by the user, and the sensor of the terminal device used by the user when the user performs the unlocking operation are acquired. The acquisition process for acquiring the sensor information indicating the tilt of the terminal device, and
The first determination of whether or not the identifier of the terminal device satisfies a predetermined condition, the second determination of whether or not the image of the picture of the key satisfies a predetermined condition, and the sensor information acquired from the acquisition step. A third determination as to whether or not the sensor information registered in advance from the user is similar, and an authentication step for authenticating the user based on each determination result.
Including
If it is determined in at least one of the first determination, the second determination, and the third determination that the predetermined condition is not satisfied, the authentication step indicates that the authentication has failed after all the determinations are completed. Is an authentication method, characterized in that the user is notified of the above. The identifier of the terminal device used by the user, the image of the picture of the key handwritten by the user, and the sensor of the terminal device used by the user when the user performs the unlocking operation are acquired. The acquisition procedure for acquiring the sensor information indicating the tilt of the terminal device, and
The first determination of whether or not the identifier of the terminal device satisfies a predetermined condition, the second determination of whether or not the image of the picture of the key satisfies a predetermined condition, and the sensor information acquired from the acquisition procedure. A third determination as to whether or not the sensor information registered in advance from the user is similar, and an authentication procedure for authenticating the user based on each determination result.
Is an authentication program that allows a computer to execute
If it is determined that at least one of the first determination, the second determination, and the third determination does not satisfy the predetermined condition, the authentication procedure indicates that the authentication has failed after all the determinations are completed. An authentication program characterized by notifying the user of the above.

Images