JP7806549B2 - Information processing device, information processing method, and program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and a program.

In recent years, the spread of infectious diseases has led to an increasing demand for contactless operation panels. When a contactless operation panel is installed on a terminal used by an unspecified number of people, each user can operate the terminal without touching the operation panel, reducing the risk of infection via the operation panel. For example, as disclosed in Patent Document 1, a method of achieving contactless operation by using eye contact is also known.

JP 2015-87824 A

However, with contactless operation panels, there is a risk that the approach of a person's hand or body to the operation panel without intending to operate it may be mistakenly detected as an operation.

The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a new and improved information processing device, information processing method, and program that can prevent unintended user operations from being effectively handled.

In order to solve the above problem, according to one aspect of the present invention, a display device is provided which includes a determination result acquisition unit that acquires a determination result indicating whether a user is looking at an operation area operated by the user's hand, and a control unit that, based on the acquisition of a determination result indicating that the user is looking at the operation area, transitions an operation mode from a standby mode in which operations on the operation area are not handled validly to an operation valid mode in which operations on the operation area are handled validly, wherein a display surface is laminated on the operation area, and the control unit transitions the operation mode from the standby mode to the operation valid mode based on the acquisition of a determination result indicating that the user is looking at the operation area for a first time period or more in the standby mode, and transitions the operation mode from the standby mode to the operation valid mode in the operation valid mode An information processing device is provided that makes the screen displayed by the display surface brighter than the screen displayed by the display surface in the standby mode, transitions the operation mode to a paused mode in which operations on the operation area are temporarily not handled effectively based on a determination result indicating that the user is not looking at the operation area being obtained over a second period of time or more in the operation-enabled mode, transitions the operation mode to the operation-enabled mode based on a determination result indicating that the user is looking at the operation area being obtained within a third period of time in the paused mode, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area not being obtained within the third period of time in the paused mode.

In the pause mode, the control unit may display a prompt on the display surface to prompt the user to view the operation area before the third time period has elapsed.

The control unit may further include a detection information acquisition unit that acquires detection information of operations performed on the operation area, and the control unit may control an operation in accordance with the detection information acquired in the operation-enabled mode.

In the standby mode, the control unit may disable a function for detecting operation by the user's hand in the operation area.

The operation area may be one of multiple areas obtained by dividing the operation surface.

Further, in order to solve the above problem, according to another aspect of the present invention, there is provided an information processing method executed by a computer, including: acquiring a determination result indicating whether a user is looking at an operation area operated by the user's hand; and, based on the determination result indicating that the user is looking at the operation area being acquired for a first time period or more , transitioning an operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation valid mode in which operations on the operation area are handled effectively; making a screen displayed by a display surface superimposed on the operation area in the operation valid mode brighter than a screen displayed by the display surface in the standby mode; and, based on the determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode, transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not handled effectively; and, based on the determination result indicating that the user is looking at the operation area being acquired within a third time period in the pause mode, transitioning the operation mode to the operation valid mode;

Further, in order to solve the above-described problems, according to another aspect of the present invention, a computer is made to function as a determination result acquisition unit that acquires a determination result indicating whether or not a user is looking at an operation area operated by the user's hand, and a control unit that, based on the acquisition of a determination result indicating that the user is looking at the operation area, transitions the operation mode from a standby mode in which operations on the operation area are not handled validly to an operation valid mode in which operations on the operation area are handled validly, and the control unit transitions the operation mode from the standby mode to the operation valid mode based on the acquisition of a determination result indicating that the user is looking at the operation area for a first time period or more in the standby mode, and in the operation valid mode, A program is provided that makes a screen displayed by a superimposed display surface brighter than a screen displayed by the display surface in the standby mode, transitions the operation mode to a pause mode in which operations on the operation area are temporarily not handled effectively based on a determination result indicating that the user is not looking at the operation area being obtained over a second period of time or more in the operation valid mode, transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third period of time in the pause mode, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area not being obtained within the third period of time in the pause mode .

The present invention described above makes it possible to prevent unintended user operations from being effectively handled.

1 is an explanatory diagram showing the configuration of a control system according to an embodiment of the present invention; FIG. 2 is an explanatory diagram showing the configuration of a control server 20 according to an embodiment of the present invention. FIG. 4 is an explanatory diagram showing a display screen of the non-contact type operation panel 14 in a standby mode. 10 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 when the operation mode is transitioned from the standby mode to the operation valid mode. FIG. FIG. 10 is an explanatory diagram showing a display screen of the non-contact type operation panel 14 in an operation-enabled mode. FIG. 10 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in a pause mode. 4 is a flowchart illustrating the operation of the control server 20 according to one embodiment of the present invention. FIG. 2 is a block diagram showing the hardware configuration of a control server 20.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that in this specification and drawings, components that have substantially the same functional configuration will be assigned the same reference numerals, and redundant explanations will be omitted.

Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different letters after the same reference numeral. However, if there is no particular need to distinguish between multiple components having substantially the same functional configuration, only the same reference numeral will be used to distinguish each of the multiple components.

<Control system configuration>
One embodiment of the present invention relates to a control system that accepts contactless operation by a user. The control system according to one embodiment of the present invention can be used to provide a variety of services to an unspecified number of users. For example, the control system according to one embodiment of the present invention can be used for a cash processing service, a route guidance service, a seat reservation service, a ticket issuing service, or the like. First, the configuration of such a control system will be described with reference to FIG. 1 .

Figure 1 is an explanatory diagram showing the configuration of a control system according to one embodiment of the present invention. As shown in Figure 1, the control system according to one embodiment of the present invention comprises multiple user-operated terminals 10, a communication device 18, and a control server 20. While Figure 1 shows an example in which two user-operated terminals 10 are connected to one control server 20, only one user-operated terminal 10 may be connected to one control server 20, or three or more user-operated terminals 10 may be connected to one control server 20.

(User-operated terminal)
The user-operated terminal 10 is an information processing terminal operated by a user. The user-operated terminal 10 may be a tablet-type mobile terminal as shown in Fig. 1, a freestanding information terminal such as an ATM or a ticket vending machine, an information display terminal for signage, a printer, or a display operation terminal installed in an elevator.

As shown in FIG. 1, the user-operated terminal 10 has a non-contact operation panel 14 and a camera 16. The non-contact operation panel 14 functions as an operation surface (operation area) that detects non-contact operations by the user's hand, and as a display surface that is overlaid on the operation surface and displays various screens. The user-operated terminal 10 transmits detection information of operations on the non-contact operation panel 14 to the control server 20, receives the display screen from the control server 20 via the communication device 18, and displays the display screen on the non-contact operation panel 14.

The function of the operation surface may be realized using a method that uses infrared rays, a capacitance method, or any other method that can detect contactless operations. Furthermore, while this specification mainly describes examples in which the operation surface can detect contactless operations, the operation surface may also be capable of detecting contact operations in addition to contactless operations, or may be capable of detecting contact operations without detecting contactless operations.

The camera 16 is an example of an imaging unit that captures an image of a subject. For example, the camera 16 captures an image of the face of a user standing in front of the user-operated terminal 10, thereby acquiring a facial image of the user. The user-operated terminal 10 transmits the facial image of the user acquired by the camera 16 to the control server 20 via the communication device 18 in real time. The position of the camera 16 on the user-operated terminal 10 is not limited to the example shown in FIG. 1. Furthermore, multiple cameras 16 may be provided on one user-operated terminal 10.

(Communication device)
The communication device 18 communicates with the user-operated terminal 10 and the control server 20. For example, the communication device 18 receives operation detection information and a user's facial image from the user-operated terminal 10, and transmits the operation detection information and the user's facial image to the control server 20. The communication device 18 also receives display screens, control information, and the like from the control server 20, and transmits the display screens, control information, and the like to the user-operated terminal 10.

Note that the communication method between the communication device 18 and the user-operated terminal 10, and the communication method between the communication device 18 and the control server 20 are not particularly limited. For example, each communication method may be a wireless communication method such as a wireless LAN or cellular method, or a wired communication method.

(control server)
The control server 20 is an information processing device that controls the operation of the user-operated terminal 10. In particular, the control server 20 according to an embodiment of the present invention determines whether the user is looking at the non-contact operation panel 14 based on a facial image of the user received from the user-operated terminal 10, and controls the transition of operation modes based on the determination result. The detailed configuration of the control server 20 will be described below with reference to FIG. 2.

<Detailed configuration of the control server>
2 is an explanatory diagram showing the configuration of the control server 20 according to an embodiment of the present invention. As shown in FIG. 2, the control server 20 according to an embodiment of the present invention includes a communication unit 220 and a control unit 230.

(Communication unit 220)
The communication unit 220 communicates with a plurality of user-operated terminals 10 via the communication device 18. For example, the communication unit 220 functions as a detection information acquisition unit that acquires operation detection information from the user-operated terminal 10. The communication unit 220 also receives a face image of the user from the user-operated terminal 10.

(Control unit 230)
The control unit 230 controls the overall operation of the control server 20 and the user-operated terminal 10. In particular, the control unit 230 according to an embodiment of the present invention has the functions of an image processing unit 232, a mode control unit 234, and a display control unit 236.

The image processing unit 232 is an example of a determination result acquisition unit that acquires a determination result indicating whether the user is looking at the non-contact operation panel 14. The image processing unit 232 may, for example, detect the direction of the user's face and line of sight based on the user's facial image, and determine that the user is looking at the non-contact operation panel 14 if the user's line of sight is directed within a predetermined range.

The mode control unit 234 controls the transition of operation modes among the multiple operation modes of the user-operated terminal 10 or the control server 20. The multiple operation modes include a standby mode, an operation-enabled mode, and a pause mode. The standby mode and pause mode are operation modes in which operations on the non-contact operation panel 14 are not handled effectively, and the operation-enabled mode is an operation mode in which operations on the non-contact operation panel 14 are handled effectively.

When an operation on the non-contact type operation panel 14 is not treated effectively, this may mean that the operation performed on the non-contact type operation panel 14 is not reflected in the subsequent operation of the user-operated terminal 10. For example, in standby mode and pause mode, the function for detecting operations on the non-contact type operation panel 14 may be disabled, the user-operated terminal 10 may stop sending operation detection information, or the control server 20 may discard operation detection information received by the communication unit 220. On the other hand, in operation-effective mode, the function for detecting operations on the non-contact type operation panel 14 may be enabled, the user-operated terminal 10 may send operation detection information, and the control server 20 may perform processing to respond to the operation detection information received by the communication unit 220.

The mode control unit 234 controls the transition between these multiple operation modes based on the determination result acquired by the image processing unit 232. For example, the mode control unit 234 transitions the operation mode from the standby mode to the operation-enabled mode based on the determination result indicating that the user is looking at the non-contact type operation panel 14 being acquired. As a more restrictive condition, the mode control unit 234 may transition the operation mode from the standby mode to the operation-enabled mode based on the determination result indicating that the user is looking at the non-contact type operation panel 14 being acquired for a first time period or longer. The first time period is preferably a time period of one second or less, but may be a time period of more than one second.

Furthermore, the mode control unit 234 transitions the operation mode to a pause mode in which operations on the non-contact type operation panel 14 are temporarily not handled effectively based on the fact that a determination result indicating that the user is not looking at the non-contact type operation panel 14 is obtained in the operation-valid mode. As a more restrictive condition, the mode control unit 234 may transition the operation mode to a pause mode in which operations on the non-contact type operation panel 14 are temporarily not handled effectively based on the fact that a determination result indicating that the user is not looking at the non-contact type operation panel 14 is obtained for a second time period or longer in the operation-valid mode.

Furthermore, the mode control unit 234 transitions the operation mode to the operation-enabled mode when a determination result indicating that the user is looking at the non-contact operation panel 14 is obtained within a third time period in the pause mode, and transitions the operation mode to the standby mode when the time period during which the user is not looking at the non-contact operation panel 14 reaches the third time period in the pause mode.

The display control unit 236 controls the display on the non-contact type operation panel 14. The display control unit 236 functions as a detection information acquisition unit that acquires detection information of operations on the non-contact type operation panel 14, and generates a screen according to the detection information. The display control unit 236 also changes the display on the non-contact type operation panel 14 in accordance with the transition of the operating mode by the mode control unit 234. Specific examples of the display on the non-contact type operation panel 14 are described below with reference to Figures 3 to 6.

Figure 3 is an explanatory diagram showing the display screen of the contactless operation panel 14 in standby mode. In the example shown in Figure 3, the display screen of the contactless operation panel 14 in standby mode includes a number input area 51 for entering a number, a call button 52 for connecting to an operator, and a help button 53 for outputting operation guidance. Furthermore, as shown in Figure 3, the display screen of the contactless operation panel 14 in standby mode is dimmed overall. In this standby mode, as described above, operations on the contactless operation panel 14 are no longer valid, but the camera 16 continues to capture images in front of the user-operated terminal 10. Note that Figure 3 shows only an example of elements included on the display screen; the display screen may include other elements or have a layout different from that shown in Figure 3. Furthermore, the display screen need not be displayed on the contactless operation panel 14 in standby mode.

Figure 4 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 when the operation mode transitions from standby mode to operation-enabled mode. When the operation mode transitions from standby mode to operation-enabled mode, the mode control unit 234 causes the non-contact type operation panel 14 to display a message indicating that the system has responded to the user. In the example shown in Figure 4, the message in question is message 54 saying "Starting to accept operations."

Figure 5 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in the operation-validation mode. As shown in Figure 5, the mode control unit 234 makes the screen displayed by the non-contact type operation panel 14 in the operation-validation mode brighter than the screen displayed by the non-contact type operation panel 14 in the standby mode. In this operation-validation mode, as described above, operations on the non-contact type operation panel 14 are treated as valid, and the camera 16 continues to capture images in front of the user-operated terminal 10.

Figure 6 is an explanatory diagram showing the display screen of the contactless operation panel 14 in pause mode. In pause mode, the mode control unit 234 causes the contactless operation panel 14 to display a prompting message to prompt the user to look at the contactless operation panel 14 before the third time period has elapsed. In the example shown in Figure 6, the prompting message is a message 56 that reads, "Look at the screen to resume accepting operations. Less than 5 seconds remaining." The mode control unit 234 also causes the background of the screen displayed by the contactless operation panel 14 in pause mode to be darker than the screen displayed by the contactless operation panel 14 in the operation-enabled mode. In this standby mode, as described above, operations on the contactless operation panel 14 are no longer valid, but the camera 16 continues to capture images in front of the user-operated terminal 10.

<Operation>
The configuration of the control server 20 according to one embodiment of the present invention has been described above. Next, the operation of the control server 20 according to one embodiment of the present invention will be summarized with reference to FIG.

Figure 7 is a flowchart showing the operation of the control server 20 according to one embodiment of the present invention. As shown in Figure 7, after the control server 20 has completed startup, the control server 20 operates in standby mode (S304). Then, when the communication unit 220 receives a user's facial image from the user-operated terminal 10 (S308/Yes), the image processing unit 232 determines whether the user is looking at the non-contact type operation panel 14 (S312). Then, if the user has been looking at the non-contact type operation panel 14 for a first time period or longer (S316/Yes), the mode control unit 234 transitions the operation mode to the operation-enabled mode (S320).

The image processing unit 232 determines whether the user continues to look at the non-contact type operation panel 14 (S324). The mode control unit 234 maintains the operation enabled mode while the user is looking at the non-contact type operation panel 14 (S328/Yes), and transitions the operation mode to the pause mode when the user stops looking at the non-contact type operation panel 14 (S328/No, S332).

The image processing unit 232 continues to determine whether the user is looking at the non-contact type operation panel 14 (S336). If the user is looking at the non-contact type operation panel 14 (S340/Yes), the mode control unit 234 transitions the operation mode to the operation-enabled mode (S320). On the other hand, if the user is not looking at the non-contact type operation panel 14 (S340/No), the processing from S336 is repeated until the time during which the user has not looked at the non-contact type operation panel 14 reaches a third time (S344/No). When the time during which the user has not looked at the non-contact type operation panel 14 reaches the third time (S344/Yes), the mode control unit 234 transitions the operation mode to the standby mode (S304).

<Action and effect>
According to the embodiment of the present invention described above, various advantageous effects can be obtained. For example, according to the embodiment of the present invention, the mode control unit 234 transitions the operation mode from the standby mode to the operation-validating mode based on the acquisition of a determination result indicating that the user is looking at the non-contact type operation panel 14. Operations performed on the non-contact type operation panel 14 while the user is not looking at it may be operations unintended by the user. However, according to the above configuration, operations performed on the non-contact type operation panel 14 while the user is not looking at it are not treated as valid. Therefore, according to the embodiment of the present invention, it is possible to prevent operations unintended by the user from being treated as valid.

As a more restrictive condition, the mode control unit 234 transitions the operation mode from the standby mode to the operation-enabled mode based on the fact that a determination result indicating that the user is looking at the non-contact operation panel 14 has been acquired for a first time period or longer. This configuration makes it possible to prevent the operation mode from transitioning to the operation-enabled mode even when the user's line of sight simply passes over the non-contact operation panel 14.

In addition, the mode control unit 234 makes the screen displayed by the non-contact type operation panel 14 in the operation-enabled mode brighter than the screen displayed by the non-contact type operation panel 14 in the standby mode. This configuration makes it easier for the user to intuitively understand that operations on the non-contact type operation panel 14 are enabled in the operation-enabled mode.

Furthermore, the mode control unit 234 may transition the operation mode to a pause mode in which operations on the contactless operation panel 14 are temporarily not handled effectively, based on the fact that a determination result indicating that the user is not looking at the contactless operation panel 14 has been acquired for a second period of time or more in the operation-effective mode. With this configuration, it is possible to not handle effectively operations performed on the contactless operation panel 14 while the user is not aware of the contactless operation panel 14, such as when the user moves away from the user-operated terminal 10 or temporarily takes their eyes off the user-contactless operation panel 14.

Furthermore, the mode control unit 234 transitions the operation mode to the operation-enabled mode when a determination result indicating that the user is looking at the non-contact operation panel 14 is obtained within a third time period in the pause mode, and transitions the operation mode to the standby mode when the time period during which the user has not looked at the non-contact operation panel 14 reaches the third time period in the pause mode. If the time period during which the user has not looked at the non-contact operation panel 14 reaches the third time period in the pause mode, it is likely that the user has moved away from the user-operated terminal 10, and transitioning the operation mode to the standby mode allows the next user to start using the user-operated terminal 10.

In pause mode, the mode control unit 234 causes the non-contact type operation panel 14 to display a prompting message inviting the user to look at the non-contact type operation panel 14 before the third time period has elapsed. This configuration can prevent the user from feeling that the transition from pause mode to standby mode has occurred suddenly.

<Modification>
An embodiment of the present invention has been described above. Below, several modified examples of the above-described embodiment will be described. Note that each modified example described below may be applied alone to the above-described embodiment, or may be applied in combination with the above-described embodiment. Furthermore, each modified example may be applied in place of the configuration of the above-described embodiment, or may be applied in addition to the configuration of the above-described embodiment.

For example, in the above embodiment, an example was described in which the operation mode transitions to an operation-enabled mode in which operations on the entire non-contact operation panel 14 are valid based on whether the user is looking at any part of the non-contact operation panel 14. In this regard, for each operation area included in multiple operation areas obtained by dividing the non-contact operation panel 14, a determination may be made as to whether the user is looking at that operation area, and whether the operation mode should transition to an operation-enabled mode in which operations on that operation area are valid. With this configuration, when the user is looking at a certain operation area, the operation modes for the other operation areas can become standby mode or pause mode. This makes it possible to more reliably distinguish between operations intended by the user and unintended operations.

The control server 20 may also extract features from a user's facial image and store the extracted features. When a user looks at the non-contact operation panel 14 in pause mode, the control server 20 may determine, based on the stored features, whether the user is the same as the user who had been operating the non-contact operation panel 14 up until that point, and transition the operation mode to the operation-enabled mode if identity is confirmed. This configuration makes it possible to prevent the user using the user-operated terminal 10 from being replaced when the user enters pause mode.

The control server 20 may also store user facial images and operation detection information. This configuration makes it possible to verify after the fact whether the operations performed by each user were the operations intended by that user.

<Hardware configuration>
The above describes the embodiments of the present invention. The above-described information processing, such as the analysis of facial images and the control of operation modes, is realized by cooperation between software and the hardware of the control server 20, which will be described below.

Figure 8 is a block diagram showing the hardware configuration of the control server 20. The control server 20 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and a host bus 204. The control server 20 also includes a bridge 205, an external bus 206, an interface 207, an input device 208, a display device 209, an audio output device 210, a storage device (HDD) 211, a drive 212, and a network interface 215.

The CPU 201 functions as an arithmetic processing unit and control device, and controls the overall operation of the control server 20 in accordance with various programs. The CPU 201 may also be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, etc. The RAM 203 temporarily stores programs used in the execution of the CPU 201, and parameters that change as appropriate during execution. These are interconnected by a host bus 204, which is composed of a CPU bus, etc. The functions of the image processing unit 232, mode control unit 234, display control unit 236, etc. described above can be realized by the cooperation of the CPU 201, ROM 202, RAM 203, and software.

The host bus 204 is connected to an external bus 206, such as a PCI (Peripheral Component Interconnect/Interface) bus, via a bridge 205. Note that the host bus 204, bridge 205, and external bus 206 do not necessarily need to be configured separately; these functions may be implemented on a single bus.

The input device 208 is composed of input means for the user to input information, such as a mouse, keyboard, touch panel, buttons, microphone, sensors, switches, and levers, and an input control circuit that generates input signals based on user input and outputs them to the CPU 201. By operating the input device 208, the user of the control server 20 can input various data to the control server 20 and instruct processing operations.

The display device 209 includes display devices such as a liquid crystal display (LCD) device, a projector device, an OLED (organic light emitting diode) device, and a lamp. The audio output device 210 includes audio output devices such as a speaker and headphones.

The storage device 211 is a data storage device configured as an example of a storage unit of the control server 20 according to this embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, and a deletion device that deletes data recorded on the storage medium. The storage device 211 is configured, for example, as an HDD (Hard Disk Drive) or SSD (Solid Storage Drive), or memory with equivalent functionality. This storage device 211 drives storage and stores programs executed by the CPU 201 and various data.

The drive 212 is a reader/writer for storage media, and is either built into the control server 20 or externally attached. The drive 212 reads information recorded on a removable storage medium 24, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 203 or the storage device 211. The drive 212 can also write information to the removable storage medium 24.

The network interface 215 is a communication interface composed of, for example, a communication device for connecting to a network. The network interface 215 may also be a wireless LAN (Local Area Network) compatible communication device, or a wired communication device for wired communication.

<Additional Information>
Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

For example, the steps in the processing of the control server 20 in this specification do not necessarily have to be processed chronologically in the order depicted in the sequence diagram or flowchart. For example, the steps in the processing of the control server 20 may be processed in an order different from the order depicted in the flowchart, or may be processed in parallel.

It is also possible to create a computer program that causes the CPU, ROM, RAM, and other hardware built into the user-operated terminal 10 and control server 20 to perform functions equivalent to those of the above-mentioned components of the user-operated terminal 10 and control server 20. A non-transitory storage medium storing the computer program is also provided.

10 User-operated terminal 14 Non-contact type operation panel 16 Camera 18 Communication device 20 Control server 220 Communication unit 230 Control unit 232 Image processing unit 234 Mode control unit 236 Display control unit

Claims (7)

a determination result acquisition unit that acquires a determination result indicating whether a user is looking at an operation area operated by the user's hand;
a control unit that transitions the operation mode from a standby mode in which operations on the operation area are not treated as valid to an operation valid mode in which operations on the operation area are treated as valid, based on the acquisition of a determination result indicating that the user is looking at the operation area;
Equipped with
a display surface is laminated on the operation area;
the control unit transitions the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired for a first time period or more in the standby mode;
making the screen displayed on the display surface in the operation-enabled mode brighter than the screen displayed on the display surface in the standby mode;
transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode;
an information processing device that transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area in the pause mode being obtained within a third time period, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area in the pause mode not being obtained within the third time period. The information processing device of claim 1, wherein the control unit, in the pause mode, displays a prompt on the display surface to prompt the user to view the operation area before the third time period has elapsed. the control unit further includes a detection information acquisition unit that acquires detection information of an operation on the operation area;
The information processing device according to claim 1 , wherein the control unit controls an operation according to the detection information acquired in the operation-enabled mode. The information processing device according to any one of claims 1 to 3, wherein the control unit disables a function for detecting operation by the user's hand in the operation area in the standby mode. The information processing device described in any one of claims 1 to 4, wherein the operation area is one of multiple areas obtained by dividing the operation surface. Obtaining a determination result indicating whether or not a user is looking at an operation area operated by the user's hand;
transitioning an operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation effective mode in which operations on the operation area are handled effectively, based on the fact that a determination result indicating that the user is looking at the operation area has been acquired for a first time period or more;
making a screen displayed on a display surface stacked on the operation area in the operation valid mode brighter than a screen displayed on the display surface in the standby mode;
transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not handled as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode;
an information processing method executed by a computer, comprising: transitioning an operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third time period in the pause mode; and transitioning the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area being not obtained within the third time period in the pause mode. Computer,
a determination result acquisition unit that acquires a determination result indicating whether a user is looking at an operation area operated by the user's hand;
a control unit that transitions the operation mode from a standby mode in which operations on the operation area are not treated as valid to an operation valid mode in which operations on the operation area are treated as valid, based on the acquisition of a determination result indicating that the user is looking at the operation area;
It functions as
The control unit
transitioning the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired for a first time period or more in the standby mode;
a screen displayed on a display surface stacked on the operation area in the operation-enabled mode being brighter than a screen displayed on the display surface in the standby mode;
transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode;
A program that transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third time period in the pause mode, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area being not obtained within the third time period in the pause mode.