JP6975595B2 - Information terminal and information terminal control program - Google Patents

Description

The present invention relates to an information terminal and an information terminal control program, and can be applied to, for example, a smartphone or an in-vehicle device.

In recent years, the act of operating a device while walking or driving has become a social problem. In particular, the act of operating a smartphone while walking is called "while smartphone".

In order to deal with the above problems, some products such as smartphones and in-vehicle devices (car navigation systems) detect the state of walking or driving by using, for example, mainly speed / acceleration sensor information, and the state is detected. There are some that limit the content and terminal operation in (Patent Document 1).

Re-table 2015/122406 Gazette Japanese Unexamined Patent Publication No. 2012-066719 Japanese Unexamined Patent Publication No. 2012-187178 Japanese Unexamined Patent Publication No. 2012-21257

However, there are cases where the conventional method of determining the state of the terminal user, such as walking or driving, mainly based on the state of the speed / acceleration of the terminal does not match the situation where the actual terminal user is placed. be. As an example, there is a car navigation system that restricts operations while moving by a speed sensor, but it also limits operations from the terminal user in the passenger seat, which reduces convenience.

Therefore, comprehensively judge information such as the state of the terminal user (line of sight), the state of the terminal (moving state), and the content of the content used in the device, and take necessary and sufficient safety measures for the terminal user. An information terminal and an information terminal control program capable of being able to do so are desired.

The first invention is an information terminal, and (1) the user's image information is detected by the first sensor whose detection target is the user who uses the information terminal. A movement that analyzes the movement state of the information terminal based on information including the movement information of the information terminal detected by the line-of-sight detection unit that analyzes the line-of-sight state and (2) the second sensor that targets the information terminal. An input / output restriction unit that restricts all or part of the output from the state detection unit and (3) the display unit that displays the content according to the classification of the content, and the input to the operation unit that accepts a predetermined operation for the content. (4) A first comparison between the moving state of the information terminal, the continuous screen gaze time, which is the time during which the user's line of sight was continuously gaze on the display unit, and the continuous screen gaze time. The user said the above based on a threshold value, a screen gaze ratio indicating the ratio of the user's gaze on the display unit within a predetermined time, and a second threshold value to be compared with the screen gaze ratio. When the dangerous use state detection unit that determines whether or not there is a danger in the usage status of the information terminal and (5) the line of sight of the user has moved to a place other than the display unit and the display unit a predetermined number of times or more. When the user is determined to be a terminal restriction target person and the dangerous use state detection unit determines that the usage status of the information terminal by the user is a dangerous state, control by the input / output restriction unit is performed. (6) The first threshold value and the second threshold value are determined according to the moving speed of the information terminal.

The second information terminal control program of the present invention detects the computer mounted on the information terminal, and (1) the image information of the user detected by the first sensor whose detection target is the user who uses the information terminal. Based on the information including the line-of-sight detection unit that analyzes the line-of-sight state of the user and (2) the movement information of the information terminal detected by the second sensor whose detection target is the information terminal. All or all of the output from the movement state detection unit that analyzes the movement state of the terminal, (3) the output from the display unit that displays the content according to the classification of the content, and the input to the operation unit that accepts the predetermined operation for the content. The input / output restriction unit that partially restricts, (4) the moving state of the information terminal, the continuous screen gaze time, which is the time during which the user's line of sight is continuously gazed at the display unit, and the continuous screen. The first threshold value to be compared with the gaze time, the screen gaze ratio indicating the ratio of the user's line of sight to the display unit within a predetermined time, and the second threshold value to be compared with the screen gaze ratio. Based on this, a dangerous use state detection unit that determines whether or not there is a danger in the usage status of the information terminal by the user, and (5) the user's line of sight is placed in a place other than the display unit and the display unit a predetermined number of times. When the line of sight is moving as described above, the user is determined to be a terminal restriction target person, and further, when the dangerous use state detection unit determines that the usage status of the information terminal by the user is a dangerous state. (6) The first threshold value and the second threshold value are determined according to the moving speed of the information terminal.

According to the present invention, information such as the state of the terminal user (line-of-sight state), the state of the terminal (moving state), and the content of the content used in the device is comprehensively determined, and is necessary and sufficient for the terminal user. Safety measures can be taken.

It is a block diagram which shows the structure of the information terminal which concerns on 1st Embodiment. It is a figure which shows the image of the non-restricted person and the non-restricted person which concerns on 1st Embodiment. It is a flowchart which shows the operation of the restriction target person determination process which concerns on 1st Embodiment. It is a flowchart which shows the operation of the restriction processing according to the content classification which concerns on 1st Embodiment. It is a figure which shows an example of the content restriction according to the content classification which concerns on 1st Embodiment. It is a block diagram which shows the structure of the information terminal which concerns on 2nd Embodiment. It is a flowchart which shows the operation of the dangerous use state detection processing which concerns on 2nd Embodiment. It is a figure which shows the image which the danger judgment threshold value changes by the movement speed and continuous screen gaze time / cumulative screen gaze time which concerns on 2nd Embodiment.

(A) First Embodiment In the following, the first embodiment of the information terminal according to the present invention will be described in detail with reference to the drawings.

(A-1) Configuration of First Embodiment (A-1-1) Configuration of Information Terminal 1 FIG. 1 is a block diagram showing a configuration of an information terminal according to the first embodiment. In FIG. 1, the information terminal 1 has a content control unit 10, a camera 20 as a first sensor, a sensor 30 as a second sensor, a content 40, a display unit 50, and an operation unit 60.

Although not shown, the hardware configuration of the information terminal 1 is a circuit device having, for example, a CPU, ROM, RAM, EEPROM, an input / output interface unit, etc., and the CPU is a processing program (information terminal control program) stored in the ROM. ) Is executed, the function as the information terminal 1 is realized.

The information terminal 1 is an information processing terminal that can move together with a moving body (person, passenger car, bicycle, etc.), and for example, a mobile phone, a smartphone, a tablet terminal, an in-vehicle device (car navigation system), or the like can be applied. Further, the information terminal 1 may be integrated with a vehicle such as a passenger car, and may be applied to, for example, an information display panel integrated with the vehicle. Hereinafter, the information terminal 1 may be simply referred to as a "terminal".

The content control unit 10 controls the display and operation of the content based on the information on the position and line of sight of the terminal user and the information on the terminal obtained from each sensor 30. The content control unit 10 includes a line-of-sight detection unit 11, a terminal user detection unit 12, a movement state detection unit 13, and an input / output restriction unit 14.

The line-of-sight detection unit 11 detects (analyzes) the line of sight (in which direction the line of sight is directed) of the terminal user based on the information (image information) from the camera 20. As the line-of-sight detection technique used by the line-of-sight detection unit 11 (and the terminal user detection unit 12 described later), for example, the techniques described in Patent Documents 2 to 4 can be applied.

The terminal user detection unit 12 analyzes the direction and distance in which the terminal user exists with respect to the information terminal 1 based on the image information from the camera 20. The terminal user detection unit 12 also analyzes the number of terminal users in the image captured by the camera 20.

The moving state detection unit 13 detects (determines) whether or not the information terminal 1 is in a moving state based on sensor information such as speed and acceleration notified from the sensor 30.

The input / output limiting unit 14 dynamically restricts input / output (operation of the operation unit 60 and display of the display unit 50) according to the moving state of the terminal, the state of the terminal user (line of sight), and the content of the content 40. ..

The camera 20 is an image pickup device equipped with an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Sensor). The camera 20 outputs image information (information for detecting the line of sight of the terminal user and the direction and position) to the content control unit 10. As a modification, another device equipped with an image sensor may be applied instead of the camera 20.

The display unit 50 is a device for displaying various information including the content 40, and is realized by, for example, a liquid crystal display, an organic EL display, or the like. The display unit 50 may be realized by, for example, a touch panel display and may include the functions of the operation unit 60.

The operation unit 60 is a device that provides a terminal user with an operation (volume adjustment, etc.) on the information terminal. The operation unit 60 and the display unit 50 described above are interfaces between the terminal user and the terminal.

The sensor 30 senses the movement information of the information terminal 1 (for example, the speed / acceleration, direction, tilt, position, etc. of the information terminal 1) and outputs the movement information to the content control unit 10.

The content 40 is the original information of the content provided to the terminal user. The content 40 is, for example, information such as map information, television images, and game screens. In this embodiment, the content 40 is classified into a plurality of types according to the content of the content. For example, the content 40 is content classified into driving assistance content, video content, interactive content, and the like. Although not shown in FIG. 1, for example, when a television image is used as the content 40, it is assumed that the information terminal 1 has a built-in television tuner or the like.

(A-1-2) Details of Content Control Unit 10 The information terminal 1 (content control unit 10) of this embodiment is currently in use (or by utilizing the movement of the line of sight while the terminal user is walking or driving. Restrict the content 40 (display restriction, operation restriction) to be used. Generally, when the terminal user is walking or driving, he / she does not pay attention to the display unit 50 of the information terminal 1, and the line of sight moves in the traveling direction on a regular basis. The content control unit 10 determines the terminal user who implements the content restriction according to the movement of the line of sight (frequency of the line of sight).

That is, the content control unit 10 uses the line-of-sight detection unit 11 and the terminal user detection unit 12 to frequently use the display unit 50 of the information terminal 1 and the traveling direction other than on the terminal for a certain terminal user. When the movement of the line of sight is detected, the terminal user is regarded as the "restricted person". The "restricted person" means a terminal user who is in a dangerous state to operate the terminal by looking away from the direction of travel, such as walking or driving.

On the other hand, if the content control unit 10 does not detect frequent line-of-sight movements, the terminal user is designated as a "restricted non-target person". A "non-restricted person" is a terminal user who does not frequently move his / her line of sight to the display unit 50 of the information terminal 1 and other places (direction of travel), and is less dangerous to operate the terminal. Means.

FIG. 2 is a diagram showing an image of a non-restricted person and a non-restricted person according to the first embodiment. FIG. 2A shows an image of a terminal user in a walking state. In FIG. 2A, the terminal user is a restricted person because he / she frequently moves his / her line of sight with respect to the display unit 50 of the information terminal 1 and the traveling direction.

FIG. 2B shows an image of a terminal user (driver) present in the driver's seat in a passenger car and a terminal user present in the passenger seat. In FIG. 2B, the terminal user in the driver's seat is subject to restriction because he / she frequently moves his / her line of sight with respect to the display unit 50 of the information terminal 1 and the traveling direction. On the other hand, since the terminal user in the passenger seat is gazing only at the display unit 50 of the information terminal 1 (because the line of sight does not move frequently), he / she is not subject to the restriction.

Next, when the terminal is moving, the content control unit 10 causes the terminal user of the restricted person to operate the terminal by the operation unit 60 or display the screen of the display unit 50 according to the classification of the content. Restrict. In addition, the restriction here is not only the restriction method of total prohibition that does not allow terminal operation at all or does not display the screen at all, but also allows only volume adjustment and screen enlargement / reduction in terminal operation, and warning text on screen display. It also includes limiting methods that allow some, such as displaying or sounding a warning sound.

In this embodiment, the content control unit 10 can flexibly limit each unit according to the classification of the content. For example, the content control unit 10 can perform control such that the operation and the screen display are restricted in the case of video content, but only the operation is restricted and the screen display is not particularly restricted in the case of audio content.

For example, in the case of FIG. 2B described above, the content control unit 10 provides only the content that assists driving to the terminal user (restricted person) in the driver's seat, and has a strong entertainment element. Restrict the display and operation of content. On the other hand, the content control unit 10 does not particularly limit the terminal user (non-restricted person) in the passenger seat.

In FIG. 2B, the display unit 50 of the information terminal 1 can simultaneously display two types of images having different contents depending on the viewing angle by one display device such as a so-called dual view display liquid crystal display. Such a dual view display liquid crystal display enables content control for each of the terminal user in the driver's seat and the terminal user in the passenger seat.

(A-2) Operation of the First Embodiment Next, the operation of the information terminal 1 according to the first embodiment will be described in detail with reference to the drawings. Since there are two characteristic operations of the information terminal 1 according to the first embodiment, a restriction target person determination process and a restriction process according to the content classification, each process will be described below. The information terminal 1 executes the restriction processing according to the content classification after the processing of the restriction target person determination processing is performed.

(A-2-1) Restricted Target Person Judgment Process FIG. 3 is a flowchart showing the operation of the restricted target person determination process according to the first embodiment.

The process of FIG. 3 is carried out according to the number of terminal users (S101). For example, the line-of-sight detection unit 11 and the terminal user detection unit 12 estimate the number of terminal users based on the image information from the camera 20.

In the content control unit 10, the line-of-sight detection unit 11 and the terminal user detection unit 12 allow the line-of-sight movement of a certain terminal user (the line-of-sight movement to the display unit 50 on the terminal and other places (for example, the traveling direction)). It is determined whether or not it exists frequently (S102). When the content control unit 10 determines that the line-of-sight movement is frequent, the content control unit 10 performs the process of the next step S103. On the other hand, when the content control unit 10 determines that the line-of-sight movement is not frequent, the content control unit 10 shifts to the process of step S104 described later.

The determination as to whether or not the line-of-sight movement frequently exists here is determined to determine that the line-of-sight movement frequently exists when the line-of-sight movement occurs more than a predetermined number of times within the latest predetermined time.

When the content control unit 10 determines that the line-of-sight movement frequently exists by the process of step S102 described above, the content control unit 10 determines that the user is a "restricted person" (S103).

On the other hand, when the content control unit 10 determines that the line-of-sight movement does not occur frequently by the process of step S102 described above, the content control unit 10 determines that the user is a "restricted non-target person" (S104).

(A-2-2) Restriction processing according to content classification FIG. 4 is a flowchart showing the operation of restriction processing according to the content classification according to the first embodiment. The process of FIG. 4 is executed on the premise that the data of the terminal user determined to be the restricted target person or the restricted non-target person by the above-mentioned restricted target person determination process exists. The following steps S201 to S204 are executed according to the number of terminal users.

The content control unit 10 determines, by the movement state detection unit 13, whether or not the information terminal 1 is in the forward (traveling direction) moving state (S201). When the content control unit 10 determines that the information terminal 1 is moving forward (in the traveling direction), the content control unit 10 performs the process of the next step S202. On the other hand, when the content control unit 10 determines that the information terminal 1 is not in the forward (traveling direction) moving state, the content control unit 10 shifts to the process of step S204 described later.

The content control unit 10 determines whether or not the terminal user is a restricted person (S202). When the content control unit 10 determines that the terminal user is the restricted person, the content control unit 10 performs the process of the next step S203. On the other hand, when the content control unit 10 determines that the terminal user is not the restricted person, the content control unit 10 shifts to the process of step S204 described later.

The content control unit 10 limits the content according to the classification of the content 40 currently being executed (S203).

On the other hand, when the content control unit 10 determines that the information terminal 1 is not in the forward (traveling direction) state by the process of step S201 described above (or by the process of step S202 described above, the user concerned If it is determined that the person is not the person to be restricted), the restriction processing according to the classification of the content is not performed (S204).

(A-2-3) Details of Content Restriction Processing (S203) According to Content Classification of Content 40 FIG. 5 is a diagram showing an example of content restriction according to content classification according to the first embodiment. In FIG. 5, the content restriction table T includes a “content classification” indicating the classification of the content 40, a “content example” indicating an example of the classified content 40, and an information terminal 1 for a person to be restricted while moving. "Input restriction for the person to be restricted while moving" indicating the operation restriction of the operation unit 60 of the above, and "restriction target during movement" indicating the display restriction of the display unit 50 of the information terminal 1 to the restricted person during movement. It has "output limitation for people" as an element. The content classification in the content restriction table T is an example, and other content classifications may be added or a part thereof may be deleted.

In FIG. 5, the content restriction table T shows five types of data (two types of driving assistance content) according to the classification of the content. For example, the data in the first row of the content restriction table T is classified as video content. The content 40 classified as video content corresponds to content such as television and movies. The content control unit 10 determines that there is a high risk of using the content 40 whose content classification is video content, and limits the output (display) of the display unit 50 and the input (operation) of the operation unit 60. ..

The data in the second row of the content restriction table T is the data whose content is classified as audio content. The content 40 classified as audio content includes radio, audio, and the like. The content control unit 10 limits the input of the operation unit 60 for the content 40 whose content classification is audio content. The content control unit 10 does not limit the output of the display unit 50 for the audio content, unlike the video content. Normally, as for audio content, since listening to audio is the main content, the terminal user rarely pays attention to the display unit 50. For example, in the case of a radio, the display unit 50 only displays information (frequency, etc.) about the radio station currently being listened to. However, the input of the operation unit 60 is restricted. For example, operations such as pressing a preset button for changing a radio station are restricted. This is because these operations reduce the attention in the direction of travel during movement and increase the risk. Further, the content control unit 10 does not have to limit the operation of changing the volume of the voice as a modification.

The data in the third row of the content restriction table T is the data in which the content is classified as interactive. The content 40 classified as interactive content corresponds to a game, a setting screen (a screen that accepts various settings of the information terminal 1), and the like. Interactive content, along with video content, is dangerous in terms of both display and operation. Therefore, the content control unit 10 limits the display on the display unit 50 and the input of the operation unit 60.

The data in the fourth row of the content restriction table T is the data whose content classification is driving assistance content 1. The content 40 classified into the driving assistance content 1 corresponds to car navigation, in-vehicle sensor information (data provided by the sensor 30 as the content 40), and road traffic information content. The content control unit 10 limits the input of the operation unit 60 for the content 40 whose content classification is driving assistance content 1. Further, the content control unit 10 measures the screen attention time to the display unit 50 by using the line-of-sight detection unit 11, and limits the output of the display unit 50 when the threshold value is exceeded. For example, in the case of a car navigation system, the function as a car navigation system cannot be fully exerted unless the navigation information including the map is displayed on the display unit 50. On the other hand, if the gaze time to the display unit 50 is long, carelessness will occur ahead and the risk will increase. Therefore, the content control unit 10 does not particularly limit the output of the content to the content display unit 50 within the screen attention time to the extent that the risk is low, and the content display unit 50 is sent to the content display unit 50 during the screen attention time to the extent that the risk increases. I decided to limit the output of.

The data in the fifth row of the content restriction table T is the data whose content classification is driving assistance content 2. The back monitor (image from the rear camera of the vehicle) corresponds to the content 40 classified into the driving assistance content 2. The content control unit 10 does not limit the output of the display unit 50 or the input of the operation unit 60 for the content 40 whose content classification is driving assistance content 2. It is expected to be used in situations where the rear of the vehicle is checked when the vehicle is moving backward for parking or turning, and since it is a function for safety confirmation, it is not necessary to limit the gaze of the image or the camera operation.

(A-3) Effect of First Embodiment As described above, according to the first embodiment, the content control unit 10 limits the terminal user according to the frequency of the line of sight to the display unit 50. If the person or the person who is not subject to the restriction is determined to be moving, the person who is subject to the restriction shall be restricted from the output of the display unit 50 and the input of the operation unit 60 according to the classification of the content 40 currently in use. bottom. As a result, the content control unit 10 can flexibly control the device according to the contents of the content, and can take necessary and sufficient safety measures for the terminal user.

(B) Second Embodiment Next, a second embodiment of the information terminal and the information terminal control program according to the present invention will be described in detail with reference to the drawings.

(B-1) Configuration of Second Embodiment (B-1-1) Configuration of Information Terminal 1A FIG. 6 is a block diagram showing a configuration of an information terminal according to a second embodiment, and is a block diagram of the first embodiment. The same and corresponding parts as those in FIG. 1 according to the form are shown with the same reference numerals. In the following, only configurations different from those in FIG. 1 will be described.

In FIG. 6, the information terminal 1A has a notification / operation control unit 70, a camera 20, a sensor 30, a display unit 50, an operation unit 60, and a speaker 80.

Although not shown, the hardware configuration of the information terminal 1A is, for example, a circuit device having a CPU, ROM, RAM, EEPROM, an input / output interface unit, and the like, and the CPU is a processing program (information terminal control program) stored in the ROM. ) Is executed, the function as the information terminal 1A is realized.

The information terminal 1A is an information processing terminal that can move together with a moving body (person, passenger car, bicycle, etc.) like the information terminal 1 of the first embodiment, and is, for example, a mobile phone, a smartphone, a tablet terminal, or an in-vehicle device. (Car navigation) etc. can be applied.

The notification / operation control unit 70 notifies the terminal user and restricts the operation based on the information on the position and line of sight of the terminal user and the information on the terminal obtained from each sensor 30. The notification / operation control unit 70 includes a line-of-sight detection unit 11, a movement state detection unit 13, and a dangerous use state detection unit 71.

The dangerous use state detection unit 71 detects (determines) whether the terminal user's use of the terminal is dangerous or safe based on the analysis information of the line-of-sight detection unit 11 and the movement state detection unit 13.

The speaker 80 is a device that outputs sound. For example, the speaker 80 outputs a warning sound according to the usage status of the terminal, along with changing the display content on the display unit 50 and restricting the operation of the operation unit 60, based on the information from the notification / operation control unit 70.

(B-1-2) Details of Notification / Operation Control Unit 70 (Dangerous Use State Detection Unit 71) The dangerous use state detection unit 71 is a terminal user's terminal based on the line-of-sight information detected by the line-of-sight detection unit 11. Determine if the usage is dangerous or safe. During movement, the time during which the line of sight is gaze at the screen (display unit 50) and the time during which the line of sight is off the screen are measured, and the time during which the line of sight is gaze at the screen and the frequency with which the line of sight is off the screen are used as determination criteria. It is judged that the longer the line of sight is directed to the screen, the more dangerous the usage situation is, and the longer the time the line of sight is off the screen, the safer the usage situation is. When making a judgment, the movement speed is taken into consideration, and it is judged that the faster the movement is, the more dangerous it is even if the time spent watching the screen is short.

In the case of a dangerous usage situation, the notification / operation control unit 70 displays a warning screen (including a pop-up) on the display unit 50, for example, in order to notify the terminal user of the danger (warning sound from the speaker 80). May be output for a predetermined time). Further, the notification / operation control unit 70 limits the input of the operation unit 60.

On the other hand, when the notification / operation control unit 70 switches from the dangerous usage status to the safe usage status, the warning screen to the display unit 50 is canceled and the input restriction of the operation unit 60 is released.

(B-2) Operation of the Second Embodiment Next, the operation of the information terminal 1A according to the second embodiment will be described in detail with reference to the drawings.

(B-2-1) Dangerous use state detection process FIG. 7 is a flowchart showing the operation of the dangerous use state detection process according to the second embodiment.

The notification / operation control unit 70 (dangerous use state detection unit 71) activates the camera 20 to detect the line of sight when the movement state detection unit 13 detects the movement state (S301). The processing of steps S302 to S319 described later is a loop processing, and it is determined whether the usage status of the information terminal 1 of the terminal user is "dangerous usage status" or "safe usage status".

The movement state detection unit 13 determines whether or not the information terminal 1 (terminal user) is in the moving state (S302). When the determination result by the moving state detecting unit 13 is determined to be the moving state, the dangerous use state detecting unit 71 performs the process of the next step S303. On the other hand, when the determination result by the moving state detecting unit 13 is determined to be the stopped state, the dangerous use state detecting unit 71 performs the process of step S314 described later.

When the terminal is determined to be in the moving state by the process of step S302 described above, the dangerous use state detection unit 71 initializes (clears) the continuous stop time for measuring the continuous stop time of the terminal. (S303).

The line-of-sight detection unit 11 determines whether or not the line of sight (line of sight) of the terminal user exists on the display unit 50 on the terminal (S304). When the determination result by the movement state detection unit 13 determines that the line of sight exists on the display unit 50, the dangerous use state detection unit 71 performs the process of the next step S305. On the other hand, when the determination result by the moving state detecting unit 13 determines that the line of sight does not exist on the display unit 50 (outside the screen), the dangerous use state detecting unit 71 performs the process of step S309 described later.

When it is determined by the process of step S304 described above that the line of sight is present on the display unit 50, the dangerous use state detection unit 71 continuously measures the time when the terminal user continuously gazes at the display unit 50. Add the gaze time (S305). Subsequently, the dangerous use state detection unit 71 adds the cumulative screen gaze time for measuring the time when the terminal user gazes at the display unit 50 (S306).

The dangerous use state detection unit 71 makes a comparison determination between the continuous screen gaze time and the threshold value (S307). When the continuous screen gaze time is determined to be equal to or longer than the threshold value, the dangerous use state detection unit 71 performs the process of the next step S308. On the other hand, when the continuous screen gaze time is determined to be less than the threshold value, the dangerous use state detection unit 71 performs the process of S311 described later.

When the continuous screen gaze time is determined to be equal to or longer than the threshold value by the process of step S308 described above, the dangerous use state detection unit 71 determines that the usage status of the information terminal 1 of the terminal user is a dangerous usage status.

Further, the dangerous use state detection unit 71 resets the continuous screen gaze time when it is determined by the process of step S304 described above that the line of sight does not exist on the display unit 50 (S309). Subsequently, hazardous use status detection unit 71, adds the off-screen time to measure how long the terminal user has removed the line of sight from the display unit 50 (S310).

The dangerous use state detection unit 71 performs a comparison determination between the screen gaze ratio and the threshold value (S311). The screen gaze ratio is calculated by, for example, the following equation (1).
Screen gaze ratio = Cumulative screen gaze time ÷ (cumulative screen gaze time + off-screen time)… (1)

When the screen gaze ratio is determined to be equal to or higher than the threshold value, the dangerous use state detection unit 71 performs the process of the next step S312. On the other hand, when the screen gaze ratio is determined to be less than the threshold value, the dangerous use state detection unit 71 performs the process of S313 described later.

When the screen gaze ratio is determined to be equal to or higher than the threshold value by the process of step S311 described above, the dangerous use state detection unit 71 determines that the usage status of the information terminal 1 of the terminal user is a dangerous usage status (S312). ..

Further, when the screen gaze ratio is determined to be less than the threshold value by the process of step S311 described above, the dangerous use state detection unit 71 determines that the usage status of the information terminal 1 of the terminal user is a safe usage status (). S313).

On the other hand, when the terminal (terminal user) is determined to be in the stopped state by the process of step S302 described above, the dangerous use state detection unit 71 adds the continuous stop time (S314).

The dangerous use state detection unit 71 performs a comparison determination between the continuous stop time and the threshold value (S315). When the continuous stop time is determined to be equal to or longer than the threshold value, the dangerous use state detection unit 71 performs the next step S316 or less. On the other hand, when the continuous stop time is determined to be less than the threshold value, the dangerous use state detection unit 71 performs the process of step S319 described later.

When the continuous stop time is determined to be equal to or longer than the threshold value by the process of step S315 described above, the dangerous use state detection unit 71 resets the continuous screen gaze time, the cumulative screen gaze time, and the off-screen time (S316 to S318). ).

When the dangerous use state detection unit 71 determines that the continuous stop time is less than the threshold value from the process of step S315 described above (or after the process of step S318 described above), the usage status of the information terminal 1 of the terminal user Is determined to be a safe usage situation (S319).

(B-2-2) Supplementary Explanation of Processes of Step S307 and Step S311 In the processes of Step S307 and Step S311, the dangerous use state detection unit 71 compares and determines the continuous screen gaze time (screen gaze ratio) and the threshold value. Was there. The threshold value (the boundary between the dangerous usage situation and the safe usage situation) may be set according to the moving speed, for example, as shown in FIG. 8 (the faster the moving speed, the lower the threshold value is set). For example, when the moving state is walking, the threshold value is set to several seconds to several tens of seconds.

(B-3) Effect of the Second Embodiment As described above, according to the second embodiment, the dangerous use state detection unit 71 is the information terminal 1 of the terminal user according to the screen gaze ratio and the like. It was determined whether the usage was dangerous or safe. For example, since these judgments are made by comparing the screen gaze ratio, which is statistical data, with the threshold value according to the moving speed, it is possible to judge the danger more accurately than in the past. ..

Then, in the case of a dangerous usage situation while the terminal user is driving, for example, the display unit 50 states that "the driver must not watch the screen while driving" specified in the Road Traffic Act. Can be displayed to call attention. In addition, when searching for a destination while walking using the map application, the map application can be used more safely than before by displaying a warning screen or the like.

As described above, it is possible to take necessary and sufficient safety measures for the terminal user in the second embodiment as in the first embodiment.

(C) Other Embodiments Although various modified embodiments have been mentioned in each of the above-described embodiments, the following modified embodiments can also be applied to the present invention.

(C-1) In each of the above-described embodiments, in order to facilitate the explanation, the case of walking or driving a passenger car has been described as an example, but the present invention is not limited to this, and for example, a bicycle is driven. The present invention can also be applied to such cases.

(C-2) As a modification, a part of the restriction processing according to the content classification of the first embodiment is used for the control of the device (display unit 50, operation unit 60, speaker 80) of the second embodiment. You may. For example, when it is determined by the dangerous usage state detection process of FIG. 7 that the usage status of the information terminal 1 of the terminal user is a dangerous usage status, the notification / operation control unit 70 is a device according to the classification of the contents. Control processing (processing in step S203 described above) may be performed.

1, 1A: Information terminal, 2: Driving assistance content, 10: Content control unit, 11: Line-of-sight detection unit, 12: Terminal user detection unit, 13: Movement state detection unit, 14: Input / output restriction unit, 20: Camera , 30: sensor, 40: content, 50: display unit, 60: operation unit, 70: notification / operation control unit, 71: dangerous use state detection unit, 80: speaker, T: content restriction table.

Claims (6)

It's an information terminal
A line-of-sight detection unit that analyzes the line-of-sight state of the user based on the image information of the user detected by the first sensor that targets the user who uses the information terminal.
A movement state detection unit that analyzes the movement state of the information terminal based on the information including the movement information of the information terminal detected by the second sensor that targets the information terminal.
An input / output restriction unit that restricts all or part of the output from the display unit that displays the content and the input to the operation unit that accepts predetermined operations for the content according to the classification of the content.
The moving state of the information terminal, the continuous screen gaze time, which is the time during which the user's line of sight was continuously gazed at the display unit, the first threshold value to be compared with the continuous screen gaze time, and a predetermined time. The usage status of the information terminal by the user based on the screen gaze ratio indicating the ratio of the user's gaze on the display unit and the second threshold value to be compared with the screen gaze ratio. Dangerous use state detector that determines the presence or absence of danger, and
When the line of sight of the user has moved to a place other than the display unit and the display unit a predetermined number of times or more, the user is determined to be a terminal restriction target person, and the dangerous use state detection unit further determines the user. When it is determined that the usage status of the information terminal by the user is in a dangerous state, it has a control unit that controls by the input / output restriction unit.
An information terminal characterized in that the first threshold value and the second threshold value are determined according to the moving speed of the information terminal. The information terminal according to claim 1, wherein the content classification includes at least video content, audio content, interactive content, and driving assistance content. Computers installed in information terminals
A line-of-sight detection unit that analyzes the line-of-sight state of the user based on the image information of the user detected by the first sensor that targets the user who uses the information terminal.
A movement state detection unit that analyzes the movement state of the information terminal based on the information including the movement information of the information terminal detected by the second sensor that targets the information terminal.
An input / output restriction unit that restricts all or part of the output from the display unit that displays the content and the input to the operation unit that accepts predetermined operations for the content according to the classification of the content.
The moving state of the information terminal, the continuous screen gaze time, which is the time during which the user's line of sight was continuously gazed at the display unit, the first threshold value to be compared with the continuous screen gaze time, and a predetermined time. The usage status of the information terminal by the user based on the screen gaze ratio indicating the ratio of the user's gaze on the display unit and the second threshold value to be compared with the screen gaze ratio. Dangerous use state detector that determines the presence or absence of danger, and
When the line of sight of the user has moved to a place other than the display unit and the display unit a predetermined number of times or more, the user is determined to be a terminal restriction target person, and the dangerous use state detection unit further determines the user. When it is determined that the usage status of the information terminal by the user is in a dangerous state, the information terminal is made to function as a control unit to be controlled by the input / output restriction unit.
An information terminal control program characterized in that the first threshold value and the second threshold value are determined according to the moving speed of the information terminal. The information according to claim 1 or 2, further comprising a notification / operation control unit that performs a predetermined alert process to the user depending on whether or not there is a danger in the usage status of the information terminal. Terminal. When the information terminal is in a moving state and the continuous screen gaze time is equal to or longer than the first threshold value, the dangerous use state detection unit determines that the usage status of the information terminal is a dangerous usage status. The information terminal according to claim 4. When the information terminal is in a moving state and the screen gaze ratio is equal to or higher than the second threshold value, the dangerous use state detection unit determines that the usage status of the information terminal is a dangerous usage status. The information terminal according to claim 4 or 5.

Images