JP7749995B2 - Information processing device and information processing program - Google Patents

Description

The present invention relates to an information processing device and an information processing program.

Patent Document 1 discloses a display device that performs operations on setting items displayed on a display screen in response to user operations. The display device includes: an operation detection means that detects the position of a detection target relative to an operation surface used to perform the operation as a coordinate position on the operation surface and a distance from the operation surface, and outputs detection target position information indicating the position of the detection target; a setting item display means that displays on the display screen a display representing a setting item whose setting value can be adjusted; and a setting value update means that updates the setting value of the setting item displayed on the display screen in response to the distance between the detection target and the operation surface detected by the operation detection means.

JP 2011-118511 A

In recent years, touchless user interfaces have been introduced, allowing users to operate items displayed on a screen without touching them. When selecting an item without touching it, the user holds their finger over the display area of the item to be selected. In conventional touchless user interfaces, in order to determine whether the user's selection of an item is based on the user's intention, the interface recognizes that the pointed item has been selected if the user's finger continues to point over the display area of the item to be selected for a predetermined period of time (called the "confirmation time") or longer.

As a result, with conventional contactless user interfaces, it takes longer for the selection of an item to be confirmed than with user interfaces in which items displayed on the screen are operated by touching them.

The present invention aims to provide an information processing device and information processing program that, when a user operates items displayed on a screen without contact, can improve the user's operability when selecting items, compared to when a uniform confirmation time is set for each item, from the time a user's selection is detected until the time the detected selection is confirmed as being based on the user's intention.

The information processing device according to the first aspect includes a processor that accepts a user's operation performed without contact for each item displayed on the screen, and controls the confirmation time from when the user's operation on the item is detected until the operation is confirmed as a selection for the item for which the operation was detected, so that the confirmation time for a first item among the items is shorter than the confirmation time for a second item.

The information processing device according to the second aspect is the information processing device according to the first aspect, in which the first item and the second item are set according to the type of the item.

An information processing device according to a third aspect is the information processing device according to the second aspect, wherein the first item is an item that sets the operating conditions of a pre-associated function when the selection is confirmed, and the second item is an item that instructs the execution of the pre-associated function when the selection is confirmed.

In the information processing device of the fourth aspect, in the information processing device of the first aspect, the processor sets the confirmation time according to the size of the display area of the item.

In the information processing device of the fifth aspect, in the information processing device of the fourth aspect, the processor sets the confirmation time for the item to be longer as the display area for the item becomes larger, and sets the confirmation time for the item to be shorter as the display area for the item becomes smaller.

In an information processing device according to a sixth aspect, in the information processing device according to any one of the first to fifth aspects, the processor adjusts the confirmation time for the item for which a user operation has been detected, depending on the distance from the part of the user used to operate the item to the display surface of the screen.

In an information processing device according to a seventh aspect, in the information processing device according to the sixth aspect, the processor sets the confirmation time for the item for which a user operation is detected to become shorter as the distance from the part to the display surface of the screen becomes shorter, and sets the confirmation time for the item for which a user operation is detected to become longer as the distance from the part to the display surface of the screen becomes longer.

In an information processing device according to an eighth aspect, in the information processing device according to any one of the first to seventh aspects, the processor adjusts the confirmation time for the item for which a user operation is detected, depending on the detected position of the operation in the display area of the item for which the user operation is detected.

In an information processing device according to a ninth aspect, in the information processing device according to the eighth aspect, the processor sets the confirmation time for the item for which a user operation is detected to become shorter as the detection position for which a user operation is detected approaches the center of the display area of the item, and sets the confirmation time for the item for which a user operation is detected to become longer as the detection position for which a user operation is detected approaches the outline of the display area of the item.

In an information processing device according to a tenth aspect, in the information processing device according to any one of the first to ninth aspects, the processor adjusts the confirmation time for the item for which a user operation has been detected by changing the measurement speed of a threshold value that is a numerical representation of the length of the confirmation time that has been preset for the item.

An information processing device according to an eleventh aspect is the information processing device according to the tenth aspect, wherein when the determination time for the item is shortened, the processor sets the measurement speed per count of the threshold representing the determination time preset for the item to be faster than a predetermined reference measurement speed.

The information processing program according to the twelfth aspect is a program for causing a computer to receive a user's operation performed without contact for each item displayed on a screen, and execute control to make the confirmation time, from when the user's operation on one of the items is detected until the operation is confirmed as a selection for the item for which the operation was detected, shorter for a first item than for a second item.

The first and twelfth aspects have the advantage that, when a user operates an item displayed on the screen without contact, the user's operability in selecting an item can be improved compared to when a uniform confirmation time is set for each item from the time the user's selection is detected until the detected selection is confirmed as being based on the user's intention.

The second aspect has the advantage of improving user operability compared to when a confirmation time is set for each item without considering the role of the function associated with the item.

The third aspect has the advantage of being able to prevent a function different from the one the user is trying to execute by mistake, compared to when the confirmation time for the item that instructs execution of a function is shorter than the confirmation time for the item that sets the operating conditions of the function.

The fourth aspect has the advantage that the user can visually estimate the length of the confirmation time required to select an item.

The fifth aspect has the advantage that the larger the display area of an item, the more likely it is that the item will be set to reduce erroneous selections by the user.

According to the sixth aspect, the user can adjust the preset confirmation time for an item by adjusting the distance from the part of the body held over the display surface of the screen to the display surface of the screen.

According to the seventh aspect, by bringing a part of the user's body closer to the display surface of the screen, the user can select an item in a time shorter than the predetermined confirmation time for the item over which the user is holding the part of the user's body.

According to the eighth aspect, the user can adjust the preset confirmation time for an item by adjusting the position of the part of the body held over the item in a direction along the display surface of the screen.

According to the ninth aspect, by moving a user's body part closer to the center of the display area of an item, the user can select the item in a time shorter than the predetermined confirmation time for the item over which the user is holding their body part.

The tenth aspect has the advantage that the confirmation time can be adjusted to suit the user's desired confirmation time without having to change the threshold for each item.

The eleventh aspect has the advantage that the determination time can be adjusted by changing the measurement speed per count of the threshold.

FIG. 1 illustrates an example of the configuration of an information processing system. FIG. 1 is a perspective view illustrating an example of a main part of an image processing device. FIG. 10 is a diagram illustrating an example of an operation panel that is operated without contact. FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing apparatus. FIG. 10 is a diagram showing an example of screen transition. FIG. 10 is a diagram showing an example of selecting a copy button. FIG. 2 is a diagram illustrating an example of the configuration of a main part of an electrical system of the image processing apparatus. 10 is a flowchart showing an example of the flow of an operation process. 10 is a flowchart showing an example of the flow of an operation process for adjusting the confirmation time of an operation object in accordance with the operation mode of a user. 10A and 10B are diagrams illustrating differences in the locations of detected operation positions. 10 is a flowchart showing an example of the flow of an operation process for adjusting the confirmation time of an operation object in accordance with the detected position of the operation in a display area of the operation object. 10A and 10B are diagrams illustrating the size of the range of the detected operation position.

This embodiment will now be described with reference to the drawings. Note that the same components and processes will be assigned the same reference numerals throughout the drawings, and duplicate explanations will be omitted.

Figure 1 shows an example configuration of an information processing system 1 that includes an information processing device equipped with a contactless user interface that allows users to operate without contact. The information processing device in information processing system 1 may be a device applied to any field as long as it has a contactless user interface. Examples of information processing devices include ATMs (Automatic Teller Machines), vending machines, and ticket machines. The information processing device may be a device dedicated to an individual, or a device used by an unspecified number of users.

In the following, we will explain an image processing device 10 installed in a workplace, for example, as an example of an information processing device.

As will be explained later, the image processing device 10 is a device that executes image-related functions in accordance with user instructions. The image processing device 10 is connected, for example, via a communication line 2 to multiple terminals 4 used by each user.

The user transmits image data generated on the terminal 4 to the image processing device 10 via the communication line 2, causing the image processing device 10 to perform the desired image processing. Alternatively, the user may store the image data on a portable storage medium such as a USB (Universal Serial Bus) memory or a memory card, carry the image data to the image processing device 10, and connect the portable storage medium to the image processing device 10 to cause the image processing device 10 to perform the desired image processing. Furthermore, the user may carry an original 11 containing at least one of text and images to the image processing device 10, and have the image processing device 10 scan the original 11 to cause the image processing device 10 to perform the desired image processing.

There are no restrictions on the connection type of the communication line 2 connecting the image processing device 10 and the terminal 4, and it can be wired, wireless, or a combination of wired and wireless. There is also no restriction on the number of terminals 4 connected to the image processing device 10; for example, no terminals 4 may be connected to the image processing device 10.

Note that terminal 4 refers to an information device used by a user. Terminal 4 may be any type of information device as long as it has data storage and data communication functions. Terminal 4 includes, for example, computers that are not designed to be portable, as well as mobile terminals that are designed to be portable, such as smartphones and wearable devices.

Figure 2 shows a perspective view of the main parts of the image processing device 10. As an example, the image processing device 10 has a scanning function that reads an image recorded on a recording medium such as paper as image data, a printing function that forms an image represented by the image data on a recording medium, and a copying function that forms an image identical to the image formed on one recording medium on another recording medium. The copying function, printing function, and scanning function are examples of image processing in the image processing device 10.

The image processing device 10 shown in Figure 2 has, for example, a document reading unit 12 at the top, and an image forming unit 14 located below the document reading unit 12.

The document reading unit 12 is composed of an optical reading device (not shown) and a document transport device 18 inside the document cover 16. The document transport device 18 sequentially pulls in the documents 11 placed on the document table 16A provided in the document cover 16 and transports them onto a document transport reading glass (not shown). The document reading unit 12 reads the contents of the documents 11 transported onto the document transport reading glass (not shown) as image data using an optical reading device (not shown). The document transport device 18 then ejects the documents 11, after the contents have been read, onto an ejection tray 16B provided in the document cover 16.

On the other hand, the image forming unit 14 forms an image represented by image data on recording media stored in storage shelves 19, which are categorized by recording medium type and size. There are no restrictions on the color of the image formed on the recording medium by the image forming unit 14, and it may be a color image or a monochrome image.

An operation display unit 13 is provided on the front of the image processing device 10, which accepts operations from the user to execute various functions such as copy, print, and scan.

Specifically, the operation display unit 13 includes a reader device 17 that acquires information about the user performing the operation, and an operation panel 15 that accepts user operations.

The reader device 17 is a device that, for example, when a user's employee ID card is brought close to it, contactlessly reads identification information (referred to as a "user ID") that uniquely identifies the user from the IC chip built into the employee ID card.

The operation panel 15 is a display with a superimposed touch panel, and displays operation objects that the user can operate to execute desired functions. There are no restrictions on the type of operation object as long as it can be operated by the user, and operation objects include, for example, buttons, scroll bars, check boxes, and radio buttons. When the user operates an operation object, a process previously associated with the operation content is executed by the image processing device 10, and a response to the operation is displayed on the operation panel 15.

Operation panel 15 detects the position of the user's finger, i.e., operation position 6, without contact. "Detecting operation position 6 without contact" means that the position of the user's finger can be detected by simply holding a finger away from the display surface of operation panel 15 within the space above the display surface of operation panel 15 within the range of the display surface of operation panel 15. Hereinafter, the space extending in the normal direction to the display surface of operation panel 15 within the range of the display surface of operation panel 15 will be referred to as "above operation panel 15." Therefore, "above operation panel 15" does not mean the upper side of the operation panel based on the up, down, left, and right directions in real space, but refers to the space in a direction opposite to the display surface of the operation panel. Therefore, if the display surface of operation panel 15 is installed at an angle to the floor, the space diagonally perpendicular to the display surface of operation panel 15 will be above operation panel 15.

Furthermore, when a user "holds a finger" over the operation panel 15, it means that the user points their finger at the operation panel 15 without touching the display surface of the operation panel 15.

Figure 3 shows an example of an operation panel 15 that detects a user's operation position 6 in a non-contact manner. Figure 3(A) is a cross-sectional view of the operation panel 15, and Figure 3(B) is a plan view of the operation panel 15 when viewed in a direction opposite to the display surface of the operation panel 15.

Operation panel 15 is equipped with a so-called capacitive touch panel, which detects operation position 6 from changes in capacitance that occur when a user places a finger over operation panel 15. In operation panel 15 equipped with such a touch panel, the change in capacitance at the point closest to the user's finger is greater than the change in capacitance at other points. Therefore, operation panel 15 outputs the point within the range of operation panel 15 with the greatest change in capacitance as the user's operation position 6.

To identify the user's operation position 6 on the operation panel 15, an operation coordinate system is defined for the operation panel 15. The operation coordinate system is expressed as a three-dimensional coordinate system with the origin P set at a location on the operation panel 15. In the example of the operation panel 15 shown in Figures 3(A) and 3(B), the origin P is set at one of the vertices on the outline of the rectangular operation panel 15. Furthermore, in the example of the operation panel 15 shown in Figures 3(A) and 3(B), with respect to the origin P, the X axis is set along the horizontal direction of the operation panel 15, the Y axis is set along the vertical direction of the operation panel 15, and the Z axis is set so as to be perpendicular to the X axis and the Y axis. The Z axis direction is called the height direction of the operation panel 15, and the Z axis represents the normal direction to the display surface of the operation panel 15.

The user's operation position 6 on the operation panel 15 is represented by a coordinate point (x, y), which is a combination of the X coordinate value x and the Y coordinate value y at the point within the range of the operation panel 15 where the change in capacitance is greatest.

When operation objects are displayed on the operation panel 15, the operation object that is displayed to include the user's operation position 6 is recognized as the operation object that the user is operating. In the example of the operation panel 15 shown in FIG. 3(B), the user's operation position 6 is included within the display area of button 8 arranged on screen 30 displayed on the operation panel 15, so the user is recognized as operating button 8. Hereinafter, the operation object that is displayed to include the user's operation position 6 may be referred to as the "operation object corresponding to operation position 6." Furthermore, operation position 6 is an example of a "detection position where a user operation is detected" according to this embodiment.

As shown in Figure 3 (A), if the length of the perpendicular line from the user's part 3 (e.g., a finger) held over the operation panel 15 to the display surface of the operation panel 15, i.e., the distance in the height direction of the operation panel 15 from the user's part 3 to the operation panel 15, is defined as the "operation distance D," then, on the operation panel 15, the change in capacitance at the user's operation position 6 increases as the operation distance D decreases. Conversely, on the operation panel 15, the change in capacitance at the user's operation position 6 decreases as the operation distance D increases. Therefore, by previously associating the relationship between the operation distance D and the amount of change in capacitance, the operation distance D can be obtained from the amount of change in capacitance on the operation panel 15.

By using the correspondence between the operation distance D and the amount of change in capacitance, the operation panel 15 can recognize the user's operation position 6 not only as a two-dimensional operation position 6 along the display surface of the operation panel 15, but also as a three-dimensional operation position 6 that takes the operation distance D into consideration. In other words, when expressing the user's operation position 6 in three dimensions, the user's operation position 6 is represented by a coordinate point (x, y, z) that combines the coordinate value z, which represents the operation position 6 in the height direction of the operation panel 15, with the coordinate point (x, y). The coordinate value z is the Z-axis coordinate value at a position that is the operation distance D away from the origin P along the Z axis.

Note that when the coordinate value z = 0, this means that the user is operating the operation panel 15 by touching its display surface with their finger. Therefore, the image processing device 10 can also recognize differences in the user's operation style, such as whether the user is operating the operation panel 15 without touching it, or by touching their finger to the operation panel 15. In this way, the operation panel 15 supports both contact operations, in which the user operates by touching their finger to the display surface of the operation panel 15, and contactless operations, in which the user operates by holding their finger over the operation panel 15.

As described above, with the operation panel 15, the change in capacitance at the user's operation position 6 decreases as the operation distance D increases, so there is an upper limit to the operation distance D. Even if the user holds their finger over the operation panel 15 at a position beyond the upper limit of the operation distance D, the capacitance at the user's operation position 6 no longer changes, and the operation panel 15 does not respond to the user's operation. Therefore, a recommended operation distance D is predetermined for the operation panel 15. Hereinafter, the recommended operation distance D will be referred to as the "reference operation distance." The reference operation distance differs depending on the type of operation panel 15, but is set to 3 cm as an example.

Figure 4 is a diagram showing an example of the functional configuration of the image processing device 10. The image processing device 10 includes the following functional units: a control unit 20, a reception unit 21, a display unit 22, a document reading unit 23, and an image forming unit 24.

The reception unit 21 receives the user ID of the user operating the image processing device 10 from the reader device 17 of the operation display unit 13, and also receives the user's operation position 6 on the operation panel 15 from the operation panel 15 of the operation display unit 13. The reception unit 21 also receives image data from the terminal 4 or a portable storage medium connected to the image processing device 10.

The reception unit 21 notifies the control unit 20 of the received user ID, user operation position 6, and image data.

When the control unit 20 is notified of a user ID by the reception unit 21, it performs authentication processing to determine whether the user represented by the user ID is a user (referred to as a "registered user") who is authorized to use the image processing device 10. When the control unit 20 is notified of the user's operation position 6 on the operation panel 15 by the reception unit 21, it determines whether an operation object corresponding to the user's operation position 6 has been selected on the screen 30 displayed on the operation panel 15, and executes processing previously associated with the selected operation object. For example, if the operation object is button 8 that starts a print function, the control unit 20 starts the print function to form an image represented by the image data received by the reception unit 21 on a recording medium.

Since the image processing device 10 has copy, print, and scan functions, the control unit 20 includes a scan control unit 20A that controls the scan function, a print control unit 20B that controls the print function, and a copy control unit 20C that controls the copy function. Control is performed by either the scan control unit 20A, print control unit 20B, or copy control unit 20C depending on the content of the process associated with the operation object operated by the user.

If the user's operation via the operation object is an operation related to the scan function, the scan control unit 20A executes the scan function by controlling the document reading unit 23. If the user's operation via the operation object is an operation related to the print function, the print control unit 20B executes the print function by controlling the image forming unit 24. If the user's operation via the operation object is an operation related to the copy function, the copy control unit 20C generates image data of the document 11 by controlling the document reading unit 23. Thereafter, the copy control unit 20C forms an image represented by the generated image data on a recording medium by controlling the image forming unit 24.

The document reading unit 23 drives the document reading unit 12 under the control of the scan control unit 20A and copy control unit 20C, and performs, for example, transporting the document 11 placed on the document table 16A and generating image data of the transported document 11.

The image forming unit 24 drives the image forming unit 14 under the control of the print control unit 20B and the copy control unit 20C, for example, to transport recording media stored in the storage shelf 19 and form images represented by image data on the transported recording media.

In accordance with instructions from the control unit 20, the display unit 22 displays, for example, the results of the authentication process for the user and the results of the processing performed by the control unit 20 in response to the user's operation via the operation object on the operation panel 15 within the operation display unit 13.

Figure 5 is a diagram showing an example of how screen 30 displayed on operation panel 15 changes in response to user operation of operation panel 15. Note that display unit 22 displays screen 30 on operation panel 15, but because display unit 22 displays screen 30 in accordance with instructions from control unit 20, it can also be said that control unit 20 displays screen 30 on operation panel 15. Furthermore, the space along the Z axis with the display range of screen 30 displayed on operation panel 15 as its bottom surface is referred to as "on screen 30," and the space along the Z axis with the display range of an operation object displayed on screen 30 as its bottom surface is referred to as "on the operation object."

Like the term "on the operation panel 15," the terms "on the screen 30" and "on the operation object" do not refer to the upper side based on the up, down, left, and right directions in real space, but rather refer to the space in the direction relative to the screen 30 and the space in the direction relative to the operation object, respectively.

For ease of explanation, when different types of screens 30 are described separately, the alphabetical symbol associated with each type of screen 30 is added after "screen 30." When there is no need to describe different types of screens 30 separately, each type of screen 30 will be referred to collectively as "screen 30." Furthermore, when different types of buttons 8, which are an example of operation objects, are described separately, the alphabetical symbol associated with each type of button 8 is added after "button 8." When there is no need to describe different types of button 8 separately, each type of button 8 will be referred to collectively as "button 8."

If the control unit 20 determines through authentication processing that the user performing the operation is a registered user, it displays a start screen 30A on the operation panel 15. The start screen 30A displays instructions to the user, such as "Hold your hand over the screen to start Touch Less!"

When the user holds their finger over the start screen 30A, subsequent operations transition to a non-contact operation mode in which the user operates the operation panel 15 without touching it. On the other hand, when the user presses their finger on the operation panel 15 displaying the start screen 30A, subsequent operations transition to a contact operation mode in which the user operates by touching the operation panel 15 with their finger. Here, an example is described in which the user selects the non-contact operation mode. When the non-contact operation mode is entered, a cursor 5 is displayed at the user's operation position 6 on the start screen 30A. In the example of the start screen 30A shown in FIG. 5, a hand-shaped cursor 5 is displayed; however, the shape of the cursor 5 is merely an example; for example, a circular cursor 5 may also be displayed. For ease of explanation, the cursors 5 displayed on each screen 30 other than the start screen 30A are omitted from FIG. 5. When the user holds their finger over the start screen 30A, a home screen 30B is displayed. Instructions to the user on the start screen 30A also serve to teach the user how to operate the operation panel 15.

Note that the appearance of each screen 30, including the home screen 30B, differs between the contact operation mode and the non-contact operation mode. For example, at least one of the color, size, and arrangement of the control objects on the screen 30 differs between the contact operation mode and the non-contact operation mode.

Even if the user selects the non-contact operation mode, the operation mode can be switched to the contact operation mode if the user touches the operation panel 15 with their finger during operation. Even if the user selects the contact operation mode, the operation mode can be switched to the non-contact operation mode if the user holds their finger over the operation panel 15 for a predetermined period of time or longer. In addition, the user can switch between the contact operation mode and the non-contact operation mode during operation by selecting the operation mode switching button 8.

The home screen 30B displays, for example, buttons 8 for selecting various functions possessed by the image processing device 10, and a navigation bar 9 that displays information useful for the user when performing operations. Because the image processing device 10 has copy, print, and scan functions, the home screen 30B displays a copy button 8A for selecting the copy function, a print button 8B for selecting the print function, and a scan button 8C for selecting the scan function. The navigation bar 9 displays, for example, the name of the authenticated user, such as "User A," the name of the screen displayed on the operation panel 15, such as "Home," and information, such as "Touch Less," that informs the user that the operation panel 15 is in contactless operation mode.

When the user places their finger over the copy button 8A, the copy button 8A is selected. When the copy button 8A is selected, the copy screen 30D is displayed on the operation panel 15.

The copy screen 30D displays buttons 8D-8G for setting copy conditions and a start copy button 8H for starting copying using the set copy conditions.

The copy screen 30D shown in Figure 5 displays examples of buttons 8 for setting copy conditions, such as a color mode button 8D for selecting the copy color, a double-sided/single-sided selection button 8E for selecting the copy side, an N-up button 8F for selecting the image allocation method on the recording medium, and a number of copies button 8G for selecting the number of copies to make.

When the user places their finger over one of the buttons 8D-8G for setting copy conditions, the button 8 corresponding to the user's operation position 6 is selected, and a screen 30 for setting the copy conditions corresponding to the selected button 8 is displayed.

When the double-sided/single-sided selection button 8E is selected on the copy screen 30D, the double-sided/single-sided selection screen 30G, which allows the user to select the copy side, is displayed on the operation panel 15 superimposed on the copy screen 30D.

The double-sided/single-sided selection screen 30G shown in Figure 5 displays, for example, a double-sided → double-sided selection button 8S for sequentially copying the contents of both sides of the original 11 onto both sides of a recording medium, a single-sided → double-sided selection button 8T for sequentially copying the contents of an original 11 with text or the like written on only one side onto both sides of a recording medium, and a single-sided → single-sided selection button 8U for sequentially copying the contents of an original 11 with text or the like written on only one side onto one side of a recording medium.

When the user places their finger over any of the buttons 8S-8U on the double-sided/single-sided selection screen 30G, the button 8 corresponding to the user's operation position 6 is selected, and the copy side corresponding to the selected button 8 is set. The example of the double-sided/single-sided selection screen 30G shown in Figure 5 shows the state in which the user has selected the double-sided → double-sided selection button 8S.

When the copy side is set on the double-sided/single-sided selection screen 30G, the copy screen 30D is displayed on the operation panel 15. After the copy side is set, the copy side selected on the double-sided/single-sided selection screen 30G is displayed within the double-sided/single-sided selection button 8E on the copy screen 30D.

The above describes an example in which the user selects the double-sided/single-sided selection button 8E on the copy screen 30D. Even if the user selects the color mode button 8D, N-up button 8F, or number of copies button 8G on the copy screen 30D, a selection screen for selecting the copy conditions corresponding to each button 8, such as the double-sided/single-sided selection screen 30G, is displayed on the operation panel 15.

When the user places their finger over the copy start button 8H on the copy screen 30D, the copy start button 8H is selected. When the copy start button 8H is selected, a copy process is executed to copy the contents of the original 11 to a recording medium according to the set copy conditions.

Note that before setting copy conditions, buttons 8D to 8G on copy screen 30D display the initial settings for the copy conditions that have been set in advance.

On the other hand, when the user holds their finger over the print button 8B on the home screen 30B, the print button 8B is selected. When the print button 8B is selected, the print screen 30E is displayed on the operation panel 15.

Print screen 30E displays print information buttons 8J that display information about the image data to be printed, and an all print start button 8M that starts printing all of the image data corresponding to each print information button 8J. The example of print screen 30E shown in Figure 5 represents print screen 30E when two sets of image data to be printed have been accepted. In other words, print screen 30E displays print information buttons 8J corresponding to each set of image data, equal to the number of image data accepted from the user to be printed.

If there is more image data than can display all the corresponding print information buttons 8J on the print screen 30E at one time, when the user makes a gesture of moving their finger up or down on the print information buttons 8J, the operation panel 15 detects the movement of the operation position 6 and scrolls the print information buttons 8J. As a result, print information buttons 8J that cannot be displayed on the print screen 30E are also displayed on the print screen 30E. Note that the scrolling operation may also be achieved by the user selecting a movement button (not shown) that moves the display of an operation object such as the print information button 8J up or down on the screen 30E.

Each print information button 8J displays the file name of the image data to be printed and the print conditions that the user has set in advance for the image data. For example, if the user sends image data from terminal 4 to image processing device 10, the print conditions that the user set from terminal 4 are displayed on the print information button 8J.

When the user places their finger over the Print All Start button 8M, the Print All Start button 8M is selected. When the Print All Start button 8M is selected, a print process is executed to print the images represented by the image data onto a recording medium according to the set print conditions.

Furthermore, when the user places their finger over one of the print information buttons 8J, the print information button 8J is selected. When the print information button 8J is selected, a print editing screen 30H is displayed on the operation panel 15. The print editing screen 30H shown in Figure 5 represents an example of the display when the user selects the print information button 8J corresponding to the image data of "Document B.pdf."

The print edit screen 30H displays, for example, a delete button 8V for deleting image data corresponding to a selected print information button 8J, a change button 8W for changing the print conditions for the image data corresponding to the selected print information button 8J, and an individual print start button 8X for printing only the image data corresponding to the selected print information button 8J. In the print edit screen 30H shown in Figure 5, an example of a change button 8W is a change button 8W for changing the number of copies to be printed. Note that change buttons 8W for changing other print conditions, such as the color of the image to be printed, are also displayed on the print edit screen 30H, but are not shown in the figure.

On the other hand, when the user holds their finger over the scan button 8C on the home screen 30B, the scan button 8C is selected. When the scan button 8C is selected, the scan screen 30F is displayed on the operation panel 15.

The scan screen 30F displays a scan setting button 8N for setting scan conditions and a scan start button 8R for starting reading of the original 11 using the set scan conditions.

When the user places their finger over the scan setting button 8N, the scan setting button 8N corresponding to the user's operation position 6 is selected, and a selection screen (not shown) is displayed for selecting the scan conditions corresponding to the selected scan setting button 8N. In other words, the user sets the scan conditions associated with the scan setting button 8N in the same manner as setting copy conditions from the copy screen 30D.

When the user places their finger over the scan start button 8R, the scan start button 8R is selected. When the scan start button 8R is selected, a scan process is executed to convert the contents of the document 11 into image data according to the set scan conditions.

On the other hand, when the user holds their finger over navigation bar 9 on home screen 30B, navigation bar 9 is selected. When navigation bar 9 is selected, the authenticated user is logged out, and a message indicating that logout has been completed is displayed on navigation bar 9.

The user can return from the screen 30 currently displayed on the operation panel 15 to the previous screen 30 by performing a predetermined gesture such as flicking a finger from right to left on the operation panel 15, or by selecting the "back button" (not shown) displayed on the screen 30.

So far, we have explained an example in which button 8 is selected by the user holding their finger over it. However, in the case of non-contact operation, the finger does not come into contact with the operation panel 15, so the finger may wobble. Therefore, if the operation object that includes operation position 6 within the display area is simply selected as the operation object selected by the user just because operation position 6 is included within the display area, a wobbling finger may cause another operation object next to the operation object being attempted to be operated to be mistakenly selected. Furthermore, in the process of moving the finger over the operation object being attempted to be operated, the finger may pass over another operation object that is not the operation target, and in this case, the other operation object may also be mistakenly selected.

Therefore, when a finger is continuously held over an operation object for a predetermined period of time, it is preferable to determine that the operation object is the operation object intentionally selected by the user. In other words, when the user's operation position 6 remains within the display area of a specific operation object on the operation panel 15 for a predetermined period of time, it is determined that the user has selected that operation object.

Figure 6 shows an example of a user selecting the copy button 8A, an example of an operation object, on the home screen 30B.

When the user holds their finger over the copy button 8A, the operation position 6 is detected within the display area of the copy button 8A. This transition from a state in which the operation position 6 is not detected within the display area of the operation object to a state in which the operation position 6 is detected is called "selection start" or "hover." While the operation object is in the selection start state, the operation object is not yet selected.

When the user holds their finger over the copy button 8A and the detected operation position 6 remains within the display area of the copy button 8A for a predetermined period of time, the copy button 8A is selected as shown in FIG. 6, and the copy screen 30D is displayed on the operation panel 15. Confirming the selection of the operation object in this way is called "selection complete" or "hold." Completing the selection of the operation object is also called selecting the operation object.

Therefore, if the user moves their finger from the copy button 8A to another location while selection has begun, the selection of the copy button 8A is canceled. In this way, moving a finger from a control object to another location while selection has begun is called "deselection." When the selection of a control object is canceled, the user can continue to place their finger over the deselected control object for a predetermined period of time, which completes the selection of the deselected control object. Hereinafter, the predetermined time required from the start of selection to the completion of selection is referred to as the "confirmation time."

Note that each control object on the screen 30 is pre-associated with a process that will be executed when the control object is selected, so that a copy process is executed when the copy start button 8H is selected. To inform the user of the process that the control object will execute, information suggesting the process that will be executed when the control object is selected, such as "Start" on the copy start button 8H, is displayed on the control object. The user can understand the process that the control object will execute by looking at the information indicating the process that will be executed when the control object is selected, i.e., the item associated with the control object. In this way, the control objects are displayed on the screen 30 in association with the item indicating the process to be executed. Therefore, each control object is an example of an "item displayed on the screen" according to this embodiment.

Next, the main components of the electrical system of the image processing device 10 will be described with reference to Figure 7. The image processing device 10 is configured using, for example, a computer 40.

In the computer 40, a CPU (Central Processing Unit) 41, RAM (Random Access Memory) 42, ROM (Read Only Memory) 43, non-volatile memory 44, and input/output interface (I/O) 45 are each connected via a bus 46.

The CPU 41 is an example of a processor that handles the processing of each functional unit of the image processing device 10 shown in Figure 4. The RAM 42 is an example of a storage medium used as a temporary work area for the CPU 41. The ROM 43 is an example of a storage medium that stores information processing programs executed by the CPU 41. The non-volatile memory 44 is an example of a storage medium that maintains stored information even if the power supplied to the non-volatile memory 44 is cut off; for example, a semiconductor memory is used, but a hard disk may also be used. The non-volatile memory 44 does not necessarily have to be built into the computer 40, and may be a storage medium that is detachable from the computer 40, such as a memory card.

The I/O 45 is connected to, for example, the document reading unit 12, the image forming unit 14, the input unit 31, the display unit 32, and the communication unit 33.

The document reading unit 12 and image forming unit 14 are devices that operate as already described.

The input unit 31 is a device that accepts user instructions and user IDs and notifies the CPU 21. The touch panel and reader device 17 that make up the operation panel 15 are examples of the input unit 31.

The display unit 32 is a device that visually displays information processed by the CPU 41, and the display that constitutes the operation panel 15 is an example of the display unit 32.

The communication unit 33 is connected to the communication line 2 and has a communication protocol for communicating with the terminal 4.

Note that the units connected to the I/O 45 are not limited to those illustrated in Figure 7. Units required to implement functions of the image processing device 10 are connected to the I/O 45.

Next, the operation of the image processing device 10 will be described. Figure 8 is a flowchart showing an example of the flow of operation processing executed by the CPU 41 when a user performs a non-contact operation on the screen 30 displayed on the operation panel 15. An information processing program that defines the operation processing is stored in advance in, for example, the ROM 43 of the image processing device 10. The CPU 41 of the image processing device 10 reads the information processing program stored in the ROM 43 and executes the operation processing.

Note that a confirmation time is set in advance for each control object, and at least one control object has a confirmation time that is different from the other control objects.

First, in step S10, the CPU 41 determines whether any of the control objects displayed on the screen 30 has entered a selection start state. If it has not entered a selection start state, the CPU 41 repeatedly executes the determination process of step S10 until any of the control objects has entered a selection start state. On the other hand, if any of the control objects has entered a selection start state, the CPU 41 proceeds to step S20.

In step S20, the CPU 41 starts a timer, for example, using a timer function built into the CPU 41. If the CPU 41 does not have a built-in timer function, the CPU 41 may start the timer, for example, by controlling a timer unit connected to the I/O 45.

In step S30, the CPU 41 determines whether the time measured by the timer started in step S20 has reached the fixed time set for the control object that has entered the selection start state. If the time measured by the timer has not reached the fixed time, the process proceeds to step S40.

In step S40, the CPU 41 determines whether the user's operation position 6 is continuously detected within the display area of the operation object that was determined to have entered the selection start state in step S10. If the user's operation position 6 is continuously detected within the display area of the operation object that is in the selection start state, the process proceeds to step S30, where it is again determined whether the timer's measured time has reached the fixed time. In other words, the CPU 41 determines whether the user continues to hold their finger over the same operation object from the time the start of the user's operation is detected until the fixed time has elapsed.

If the user moves their finger from the control object before the confirmation time is reached, the control object in the selection start state is not the control object that the user is intentionally attempting to select. Therefore, if the determination process of step S40 determines that the user's operation position 6 has not been detected within the display area of the control object that was determined to be in the selection start state in step S10, the process proceeds to step S70.

In this case, in order to deselect the control object, in step S70, the CPU 41 resets the timer started in step S20 and ends the operation processing shown in FIG. 8. Note that "resetting the timer" means stopping the timer and returning the timer's measurement time to 0 seconds.

On the other hand, if the determination process in step S30 determines that the timer's measured time has reached the fixed time, i.e., if the user has continued to hold their finger over the same operation object since the selection start state was entered until the fixed time has elapsed, the process proceeds to step S50.

In this case, the selection of the control object determined to have entered the selection start state in step S10 has been confirmed and entered the selection completion state, so in step S50, the CPU 41 resets the timer started in step S20.

Then, in step S60, the CPU 41 executes the processing previously associated with the operation object whose selection has been completed, and ends the operation processing shown in Figure 8.

If a control object that has been selected has a confirmation time set that is shorter than that of other control objects, the user can select the control object to be operated in a shorter time than that of the other control objects. In other words, a control object that has a confirmation time set that is shorter than that of the other control objects is an example of a "first item" according to this embodiment, and a control object that has a confirmation time set that is longer than that of the other control objects is an example of a "second item" according to this embodiment.

In the above, we have explained an example in which a shorter confirmation time is set for the control object selected by the user than for other control objects, but it is preferable that the length of the confirmation time set for a control object be set according to the type of control object.

Operation objects include, for example, the copy start button 8H, all print start button 8M, individual print start button 8X, and scan start button 8R in Figure 5, which, when selected, instruct the execution of a pre-associated function. "Instructing the execution of a function" means that the CPU 41 drives at least one of the document reading unit 12 and the image forming unit 14 to instruct the execution of a process involving operations such as transporting the document 11 and forming an image on a recording medium.

On the other hand, there are operation objects that set the operating conditions of a pre-associated function when the selection is confirmed, such as the color mode button 8D and double-sided/single-sided selection button 8E on copy screen 30D in Figure 5. "Setting the operating conditions of a function" means that the CPU 41 stores the operating conditions of the document reading unit 12 and image forming unit 14 in a storage medium such as RAM 42 without operating either the document reading unit 12 or the image forming unit 14. In other words, "setting the operating conditions of a function" means executing a process that does not involve a physical operation.

Suppose a user is trying to select a specific control object, but due to a shaky finger, accidentally selects an adjacent control object instead of the control object they intended to select, resulting in a control object that is marked as selected. If the control object that is marked as selected by mistake is a control object that sets the operating conditions of a function, the user can cancel the process being executed by the control object that is marked as selected by mistake and reselect the control object that they intended to select, thereby setting the desired operating conditions. However, if the control object that is marked as selected by mistake is a control object that instructs the execution of a function, a process (e.g., a copy process) that involves an operation associated with the selected control object will begin.

Therefore, even if the user accidentally starts to select an operation object that instructs the execution of a function, it is more difficult to complete the selection than if the user accidentally starts to select an operation object that sets the operation conditions of the function. Therefore, it is preferable to set the confirmation time set for the operation object that instructs the execution of a function longer than the confirmation time set for the operation object that sets the operation conditions of the function. On the other hand, by setting the confirmation time set for the operation object that sets the operation conditions of the function shorter than the confirmation time set for the operation object that instructs the execution of the function, the time required to set the operation conditions of the function is reduced compared to when the confirmation time set for each operation object is the same as the confirmation time set for the operation object that instructs the execution of the function.

The above describes an example in which the length of the confirmation time set for a control object is set depending on the type of control object, but the factors that determine the confirmation time set for a control object are not limited to this. For example, the CPU 41 may set the confirmation time for each control object depending on the size of the display area of the control object displayed on the screen 30.

For example, operation objects associated with processes that are more important than other operation objects, and operation objects associated with processes that are operated more frequently, may be displayed larger than other operation objects on the screen 30. For example, on the copy screen 30D shown in FIG. 6, the copy start button 8H, which is operated more frequently than the other buttons 8, is displayed larger than the color mode button 8D, the double-sided/single-sided selection button 8E, the N-up button 8F, and the number of copies button 8G.

Therefore, the CPU 41 may set the confirmation time for the control object to be longer as the display area of the control object on the screen 30 becomes larger, and may set the confirmation time for the control object to be shorter as the display area of the control object on the screen 30 becomes smaller. Naturally, the CPU 41 may also set the relationship between the size of the display area of the control object and the length of the confirmation time for the control object in the opposite way to the above.

Note that even if the size of the display area for the operation objects is the same, for operation objects that are associated with processes that are more important than other operation objects, or operation objects that are associated with processes that are operated more frequently, the outline of the operation object may be made thicker, or the characters representing the item associated with the operation object (called the "operation object caption") may be made thicker.

Therefore, the CPU 41 may set the confirmation time for the control object to be longer as the thickness of at least one of the control object's outline and caption increases, and may set the confirmation time for the control object to be shorter as the thickness of at least one of the control object's outline and caption decreases. Naturally, the CPU 41 may set the relationship between the thickness of at least one of the control object's outline and caption and the length of the confirmation time for the control object in the opposite manner to that described above. Additionally, if the operation panel 15 supports color display, the CPU 41 may set the confirmation time for the control object according to the display color of the control object.

Incidentally, information relating to the attributes of the control objects on each screen 30, such as the type of control object, the size of the display area, the thickness of the outline, the thickness of the caption, and the display color of the control object, is stored in advance in, for example, the non-volatile memory 44. Therefore, the CPU 41 can obtain information relating to the attributes of the control objects on each screen 30 from the non-volatile memory 44 and set the confirmation time for each control object. The CPU 41 may also set the confirmation time for the control object by combining at least two of the information relating to the type of control object, the size of the display area for the control object, and the attribute of the control object.

In the above, we have described an example in which operation objects are classified into groups of operation objects that instruct the execution of a function and operation objects that set the operating conditions of the function, and different confirmation times are set for each group, but this is not the only example of classification of operation objects for which it is preferable to set different confirmation times.

For example, if an operation object that incurs charges upon selection is mistakenly marked as selected, an unexpected charge will be incurred. Therefore, it is preferable to set the confirmation time set for an operation object that incurs charges upon selection to be longer than the confirmation time set for an operation object that does not incur charges even when selection is completed.

For example, copying and printing, which consume paper, may be subject to charges, while scanning, which does not consume paper, may not be subject to charges. In such cases, even though all operation objects instruct the execution of a function, the confirmation time set for the copy start button 8H, all print start button 8M, and individual print start button 8X can be set longer than the confirmation time set for the scan start button 8R. Furthermore, if the image processing device 10 has a function for sending faxes, fax transmissions are subject to charges, so the confirmation time set for the fax send button (not shown) can be set longer than the confirmation time set for the scan start button 8R.

In addition, if an operation object that transmits data to a device other than the image processing device 10 (referred to as an "external device") upon selection is mistakenly marked as selected, a security problem may arise. Therefore, it is preferable to set the confirmation time for an operation object that transmits data to an external device upon selection completion longer than the confirmation time for an operation object that does not transmit data to an external device even upon selection completion.

For example, fax transmission sends data to an external device outside the image processing device 10. In such a case, even if all of these operation objects instruct the execution of a function, the confirmation time set for the fax transmission button (not shown) may be set longer than the confirmation times set for the copy start button 8H, all print start button 8M, individual print start button 8X, and scan start button 8R. Note that some models of image processing devices 10 have the function of converting images obtained by scanning, printing, and copying into digital data and transmitting them to an external device. In such cases, it is preferable to set the confirmation times set for the copy start button 8H, all print start button 8M, individual print start button 8X, and scan start button 8R longer than the predetermined confirmation time. Furthermore, even for operation objects that transmit data, if the data destination is an external device located within a predetermined range (e.g., within a company) as a trusted location, the confirmation time set for an operation object that transmits data to an external device upon selection completion may be set the same as the confirmation time set for an operation object that does not transmit data to an external device even upon selection completion.

Furthermore, when the operating conditions of functions are set hierarchically, there may be a large number of screens 30 to transition through before the screen 30 for setting the operating conditions of a specific function (for ease of explanation, referred to as the "destination screen 30") is displayed. When the operating conditions of a function are set on the destination screen 30, the screen transition is such that the user returns to the screen 30 corresponding to the root of the hierarchy rather than returning to the previous screen 30. If the operation object for setting the operating conditions of the function on the destination screen 30 is mistakenly marked as selected, the amount of operation required to correct the operation conditions and redisplay the destination screen 30 increases with the depth of the hierarchy. Therefore, by lengthening the confirmation time set for the operation object on each screen 30 as the screen 30 hierarchy deepens, the occurrence of a situation in which the operation object is mistakenly marked as selected and the user is returned to the screen 30 corresponding to the root of the hierarchy due to an erroneous operation is reduced.

For example, the CPU 41 may adjust the confirmation time set for the control object in accordance with the user's operation mode. Specifically, the CPU 41 adjusts the confirmation time for the control object corresponding to the operation position 6 in accordance with the operation distance D shown in Figure 3 (A).

For ease of explanation, the confirmation time that is preset for each control object may be referred to as the "reference confirmation time."

Figure 9 is a flowchart showing an example of the flow of operation processing for adjusting the confirmation time of an operation object in accordance with the user's operation mode. The information processing program that defines the operation processing is stored in advance in, for example, the ROM 43 of the image processing device 10. The CPU 41 of the image processing device 10 reads the information processing program stored in the ROM 43 and executes the operation processing.

The operation process shown in Figure 9 differs from the operation process shown in Figure 8 in that steps S22 and S24 have been added; the remaining processing is the same as the operation process shown in Figure 8. Therefore, the following explanation of the operation process shown in Figure 9 will focus on the differences from the operation process shown in Figure 8.

When any of the control objects enters a selection start state, the CPU 41 starts the timer in step S20, and then proceeds to step S22.

In step S22, the CPU 41 calculates the operation distance D from the amount of change in capacitance of the operation panel 15 at the user's operation position 6.

In step S24, the CPU 41 compares the operation distance D calculated in step S22 with the reference operation distance for the control object corresponding to operation position 6, thereby adjusting the confirmation time for the control object corresponding to operation position 6. Specifically, the CPU 41 adjusts the confirmation time for the control object corresponding to operation position 6 by multiplying the reference confirmation time for the control object corresponding to operation position 6 by the ratio of the operation distance D to the reference operation distance for that control object.

In other words, the CPU 41 adjusts the confirmation time for the control object corresponding to operation position 6 so that it becomes shorter than the reference confirmation time as the operation distance D becomes shorter than the reference operation distance, and adjusts the confirmation time for the control object corresponding to operation position 6 so that it becomes longer than the reference confirmation time as the operation distance D becomes longer than the reference operation distance.

When the image processing device 10 executes the operation process shown in FIG. 9, if the user wants to complete the selection of an operation object as quickly as possible, the user simply moves their finger as close as possible to the operation panel 15. In other words, even if the reference confirmation time for each operation object is the same, the confirmation time for the operation object whose selection has begun will be adjusted depending on the user's operation method.

The CPU 41 does not necessarily need to make the confirmation time corresponding to the operation distance D of the operation object proportional to the operation distance D, and may adjust it so that it is non-linear. Furthermore, the CPU 41 may obtain the confirmation time corresponding to the operation distance D by referencing a table that associates the operation distance D with the confirmation time, rather than calculating the confirmation time of the operation object using an arithmetic expression that uses the reference confirmation time and the operation distance D as explanatory variables and the confirmation time as the objective variable.

In the operation processing shown in Figure 9, an example was described in which the confirmation time of the operation object is adjusted according to the operation distance D, but examples in which the response speed of the operation panel 15 to a user operation is adjusted according to the operation distance D are not limited to this.

For example, the CPU 41 may adjust the response speed of the operation panel 15 according to the rate of change per unit time of the operation distance D. Specifically, the CPU 41 may shorten the confirmation time that is preset for the operation object being operated, as the rate of change per unit time of the operation distance D in the direction approaching the operation object increases. The rate of change per unit time of the operation distance D in the direction approaching the operation object is also called the "pressing degree." In other words, the CPU 41 detects an operation in which the user presses their finger on the operation object, and adjusts the response speed of the operation panel 15 according to the pressing degree.

Also, for example, the copy screen 30D in Figure 6 has a number of copies button 8G for selecting the number of copies to make. An operation method for selecting the number of copies may be used, such as the up/down buttons of a spin box, where the user sets the desired number of copies by operating an operation object (up button) that increases the number of copies by one and an operation object (down button) that decreases the number of copies by one. If the operation process shown in Figure 9 is applied to the up/down buttons, the number of copies increases faster the closer the user's finger is to the up button, which increases the number of copies by one. On the other hand, the number of copies decreases faster the closer the user's finger is to the down button, which decreases the number of copies by one.

Note that by using the operation distance D, the number of copies can also be increased or decreased using a single operation object. For example, when the user holds their finger over the operation object so that the operation distance D is shorter than the reference operation distance, the CPU 41 increases the number of copies by one. Conversely, when the user holds their finger over the operation object so that the operation distance D is longer than the reference operation distance, the CPU 41 decreases the number of copies by one. In this case, the CPU 41 may change the speed at which the number of copies is increased or decreased depending on the operation distance D. For example, the CPU 41 increases the speed at which the number of copies is increased or decreased as the distance from the reference operation distance to the operation distance D increases.

The above explains the operation of increasing or decreasing a setting value using the example of setting the number of copies, but it goes without saying that the above increase or decrease operations can be applied to any operation object that sets a numerical value, not just an operation object that sets the number of copies.

In addition to the example of adjusting the confirmation time of the operation object according to the operation distance D, there are various other methods for adjusting the confirmation time according to the user's operation style.

For example, the CPU 41 may adjust the confirmation time for the control object corresponding to the control position 6 depending on the location of the control position 6 in the display area of the control object, i.e., depending on which position on the control object the user operates.

Specifically, the CPU 41 sets the confirmation time for the copy start button 8H to be shorter as the operation position 6 approaches the center of the display area of the copy start button 8H, and sets the confirmation time for the copy start button 8H to be longer as the operation position 6 approaches the outline of the display area of the copy start button 8H.

Figure 10 is a diagram showing an example of an operation position 6 detected by the copy start button 8H on the copy screen 30D. Of the operation positions 6 detected by the copy start button 8H, operation position 6A is closer to the center of the copy start button 8H than operation position 6B. Therefore, even if the copy start button 8H is the same, the confirmation time for the copy start button 8H is shorter when the user places their finger over the position corresponding to operation position 6A than when they place their finger over the position corresponding to operation position 6B.

The center of the display area of a control object refers to, for example, the center of gravity of the control object. In the case of a rectangular control object such as the copy start button 8H, the center of the display area of the control object is the intersection of the diagonal lines of the control object. However, the CPU 41 may treat a location set in advance by the user as the center of the display area of the control object.

Figure 11 is a flowchart showing an example of the flow of operation processing that adjusts the confirmation time of a control object depending on the detected position of the operation in the display area of the control object. The information processing program that defines the operation processing is stored in advance in, for example, the ROM 43 of the image processing device 10. The CPU 41 of the image processing device 10 reads the information processing program stored in the ROM 43 and executes the operation processing.

The operation process shown in Figure 11 differs from the operation process shown in Figure 9 in that steps S22 and S24 in Figure 9 have been replaced with steps S26 and S28, respectively; the remaining processing is the same as the operation process shown in Figure 9. Therefore, the following explanation of the operation process shown in Figure 11 will focus on the differences from the operation process shown in Figure 9.

When any of the control objects enters a selection start state, the CPU 41 starts the timer in step S20, and then proceeds to step S26.

In step S26, the CPU 41 compares the coordinate point corresponding to the operation position 6 output from the operation panel 15 with the coordinate information representing the display area of the operation object on the screen 30, and identifies the detected position of the operation in the display area of the operation object.

In step S28, the CPU 41 adjusts the confirmation time of the control object corresponding to operation position 6 in accordance with the distance from the operation detection position identified in step S26 to the center of the control object corresponding to operation position 6 (referred to as the "detection distance of operation position 6"). Specifically, the CPU 41 sets the confirmation time of the control object corresponding to operation position 6 by multiplying the reference confirmation time for the control object corresponding to operation position 6 by the ratio of the detection distance of operation position 6 to the reference detection distance preset for the control object.

In other words, the CPU 41 sets the confirmation time for the control object corresponding to the operation position 6 so that it becomes shorter as the detection distance of the operation position 6 becomes shorter than the reference detection distance, and sets the confirmation time for the control object corresponding to the operation position 6 so that it becomes longer as the detection distance of the operation position 6 becomes longer than the reference detection distance. If the detection distance of the operation position 6 is the same as the reference detection distance, the CPU 41 sets the confirmation time for the control object corresponding to the operation position 6 to the reference confirmation time.

Of course, the CPU 41 may also set the relationship between the detection distance of the operation position 6 and the length of the confirmation time for the operation object corresponding to the operation position 6 in the opposite way to that described above.

Note that if the display area of the control object is small compared to the size of the finger, it will be difficult for the user to move the position of the finger closer to the center of the control object or closer to the outline of the control object. Therefore, the CPU 41 may control the operation panel 15 to display on the screen 30 a larger display area for the control object that has entered a selection start state than the display area of the control object before selection began. After selection of the control object is complete, the CPU 41 controls the operation panel 15 to display on the screen 30 the control object with its enlarged display area restored to the size of the display area of the control object before selection began. This improves operability for the user who adjusts the confirmation time by changing the operation position 6 of the control object, compared to when the size of the display area of the control object is not changed even after selection of the control object begins.

Furthermore, the CPU 41 may set the confirmation time for the operation object corresponding to the operation position 6 depending on the size of the range of the operation position 6 on the operation panel 15.

Figure 12 is a diagram showing an example of the operation position 6 detected by the copy start button 8H on the copy screen 30D. Operation position 6A indicates the operation position 6 when, for example, the user holds two fingers over the copy start button 8H, and operation position 6B indicates the operation position 6 when, for example, the user holds one finger over the copy start button 8H. In this case, the range over which the capacitance changes on the operation panel 15 changes depending on the size of the living body (a finger in the above example) held over the operation panel 15. Therefore, the range of operation position 6A is wider than the range of operation position 6B.

In response to this, the operation panel 15 outputs information regarding the size of the range of the detected operation position 6. The information regarding the size of the range of the detected operation position 6 includes, for example, information regarding a circumscribing circle that circumscribes the range of the detected operation position 6, or information regarding the area of a rectangle or square that circumscribes the range of the detected operation position 6. Specifically, the information regarding the size of the range of the detected operation position 6 includes, for example, the radius if it is a circumscribing circle, or the coordinate points of each vertex if it is a rectangle.

The CPU 41 may use information regarding the size of the range of the operation position 6 to, for example, set the confirmation time for the operation object corresponding to the operation position 6 to be shorter than the reference confirmation time as the range of the operation position 6 detected on the operation panel 15 becomes wider. The CPU 41 may also set the confirmation time for the operation object corresponding to the operation position 6 to be longer than the reference confirmation time as the range of the operation position 6 detected on the operation panel 15 becomes narrower. If the size of the range of the operation position 6 is the same as a predetermined reference area, the CPU 41 sets the confirmation time for the operation object corresponding to the operation position 6 to the reference confirmation time.

Naturally, the CPU 41 may set the relationship between the width of the range of the operation position 6 and the length of the confirmation time for the operation object corresponding to the operation position 6 in the opposite way to that described above. In this way, the CPU 41 may adjust the confirmation time previously set for the operation object by combining at least two of the operation distance D, the operation detection position, and the width of the range of the operation position 6.

The confirmation time preset for each operation object does not need to be the same for all registered users; a different confirmation time may be set for each registered user. For example, when user A operates the copy button 8A on the home screen 30B shown in FIG. 6, the CPU 41 may set the confirmation time for the copy button 8A to 1 second, and when user B operates the copy button 8A on the home screen 30B shown in FIG. 6, the CPU 41 may set the confirmation time for the copy button 8A to 1.5 seconds. The confirmation time for each user for each operation object displayed on each screen 30 is stored, for example, in non-volatile memory 44. The CPU 41 obtains from non-volatile memory 44 the confirmation time corresponding to the user represented by the user ID obtained in the authentication process, and sets it in advance in the operation object displayed on the screen 30.

The confirmation time preset for each control object can be set and changed by the user. If the user does not set a confirmation time in advance, the CPU 41 sets the confirmation time for each control object.

For example, the CPU 41 may refer to the standard confirmation time for each control object that is pre-stored in the non-volatile memory 44 and set it for each control object.

The CPU 41 may also set a confirmation time for an operation object using the usage history stored in the non-volatile memory 44 each time the user uses the image processing device 10. The usage history includes, for example, identification information that identifies the operation object selected by the user. Therefore, the CPU 41 can obtain the selection frequency for each operation object by referencing the usage history. By setting a shorter confirmation time for an operation object that is selected more frequently, the operability of the image processing device 10 for the user may be improved compared to when a shorter confirmation time is set for an operation object that is selected less frequently.

Note that operation objects that are selected more frequently than other operation objects are often operation objects for which the impact of incorrect operation is greater than that of other operation objects, such as button 8, which instructs the start of a process involving an action such as a copy process. Therefore, the CPU 41 may set a longer confirmation time for an operation object that is selected more frequently. In this case, the number of times a user mistakenly sets an operation object that has a greater impact than other operation objects when selected more frequently may be reduced compared to when the confirmation time is set shorter for an operation object that is selected more frequently.

When setting a confirmation time for an operation object, for example, if the confirmation time is 2 seconds, the CPU 41 sets the value (called the "threshold") that numerically represents the length of the confirmation time to "2." However, the CPU 41 can also change the confirmation time for an operation object without changing the threshold.

For example, if the timer's resolution is 1 second, the timer will count up by one every second, measuring real time. Therefore, if the threshold value is "2", it will take 2 seconds for the timer to count up to "2". In this way, the measurement speed that counts up to the threshold in the same time as the fixed time set for the control object is called the "reference measurement speed".

However, if a timer that counts up by one every 0.5 seconds is used, even if the threshold value is the same "2", it will take 1 second for the timer to count up to "2".

In this way, the CPU 41 may adjust the confirmation time for the operation object corresponding to the operation position 6 by changing the measurement speed of the timer's threshold.

For example, when the confirmation time for the control object is to be shorter than the reference confirmation time, the CPU 41 sets the measurement speed of the timer so that the measurement speed per count is shorter than the reference measurement speed. In other words, when the confirmation time for the control object is to be shorter than the reference confirmation time, the CPU 41 sets the timer so that the measurement time per count of the threshold value is shorter than the measurement time per count at the reference measurement speed.

Specifically, the CPU 41 changes the confirmed time for the controllable object by selecting a timer clock that affects the measurement time per count from among multiple clocks with different frequencies. Note that the CPU 41 may change the confirmed time for the controllable object by selecting a timer from multiple timers with different measurement times per count. Furthermore, the CPU 41 may adjust the confirmed time in accordance with the user's operation mode, and then further adjust the confirmed time set for the controllable object by selecting a threshold measurement speed for the timer.

The above describes one aspect of the image processing device 10 using an embodiment, but the disclosed form of the image processing device 10 is merely an example, and the form of the image processing device 10 is not limited to the scope described in the embodiment. Various modifications or improvements can be made to the embodiment without departing from the spirit of the present disclosure, and forms incorporating such modifications or improvements are also included in the technical scope of the disclosure. For example, the order of the operation processes shown in Figures 8, 9, and 11 may be changed without departing from the spirit of the present disclosure.

Furthermore, in the above embodiment, an example was described in which the operation processing was implemented by software. However, processing equivalent to the operation processing shown in Figures 8, 9, and 11 may also be performed by hardware. In this case, processing can be performed faster than when the operation processing is implemented by software.

In the above embodiment, the term "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU 41) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

Furthermore, the processor operations in the above embodiments may not only be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Furthermore, the order of the processor operations is not limited to the order described in the above embodiments, and may be changed as appropriate.

In the above embodiment, an example was described in which the information processing program is stored in ROM 43, but the storage location of the information processing program is not limited to ROM 43. The information processing program of the present disclosure can also be provided in a form recorded on a storage medium readable by computer 40. For example, the information processing program may be provided in a form recorded on an optical disc such as a CD-ROM (Compact Disk Read Only Memory) or a DVD-ROM (Digital Versatile Disk Read Only Memory). The information processing program may also be provided in a form recorded on portable semiconductor memory such as a USB memory or memory card.

ROM 43, non-volatile memory 44, CD-ROM, DVD-ROM, USB, and memory cards are examples of non-transitory storage media.

Furthermore, the image processing device 10 may download an information processing program from an external device connected to the communication unit 33 via a communication line and store the downloaded information processing program in a non-transitory storage medium. In this case, the CPU 41 of the image processing device 10 reads the information processing program downloaded from the external device from the non-transitory storage medium and executes the extraction process.

1 Information processing system, 2 Communication line, 3 Part, 4 Terminal, 5 Cursor, 6 (6A, 6B) Operation position, 8 Button, 8A Copy button, 8B Print button, 8C Scan button, 8D Color mode button, 8E Double-sided/single-sided selection button, 8F N-up button, 8G Number of copies button, 8H Copy start button, 8J Print information button, 8M Start all print button, 8N Scan setting button, 8R Scan start button, 8S Double-sided → Double-sided selection button, 8T Single-sided → Double-sided selection button, 8U Single-sided → Single-sided selection button, 8V Delete button, 8W Change button, 8X Individual print start button, 9 Navigation bar, 10 Image processing device, 11 Document, 12 Document reading unit, 13 Operation display unit, 14 Image forming unit, 15 Operation panel, 16 Document cover, 16A Document tray, 16B Discharge tray, 17 Reader device, 18 Document transport device, 19: Storage shelf, 20: Control unit, 20A: Scan control unit, 20B: Print control unit, 20C: Copy control unit, 21: Reception unit, 22: Display unit, 23: Document reading unit, 24: Image forming unit, 30: Screen, 30A: Start screen, 30B: Home screen, 30D: Copy screen, 30E: Print screen, 30F: Scan screen, 30G: Double-sided/single-sided selection screen, 30H: Print editing screen, 31: Input unit, 32: Display unit, 33: Communication unit, 40: Computer, 41: CPU, 42: RAM, 43: ROM, 44: Non-volatile memory, 45: I/O, 46: Bus, D: Operation distance, P: Origin

Claims (11)

a processor;
The processor:
For each item displayed on the screen, the user's touchless operation is accepted.
Regarding the confirmation time from when a user operation on the item is detected until the operation is confirmed as a selection for the item for which the operation is detected, control is performed to make the confirmation time for a first item among the items shorter than the confirmation time for a second item , and the confirmation time for the item for which a user operation is detected is adjusted according to the distance from the part of the user used to operate the item to the display surface of the screen.
Information processing device. The information processing device according to claim 1 , wherein the first item and the second item are set according to the type of the item. the first item is an item for setting an operating condition of a function associated with the first item when the selection is confirmed,
the second item is an item that instructs execution of a function associated with the second item when the selection is confirmed;
The information processing device according to claim 2 . The information processing device according to claim 1 , wherein the processor sets the confirmation time in accordance with a size of a display area of the item. The information processing device according to claim 4 , wherein the processor sets the confirmation time for the item to be longer as the display area of the item becomes larger, and sets the confirmation time for the item to be shorter as the display area of the item becomes smaller. the processor sets the confirmation time for the item for which a user operation is detected to be shorter as the distance from the part to the display surface of the screen becomes shorter;
The information processing device according to any one of claims 1 to 5, wherein the determination time for the item for which a user operation is detected is set to be longer as the distance from the part to the display surface of the screen becomes longer. The information processing device according to any one of claims 1 to 6, wherein the processor adjusts the confirmation time for the item for which a user operation is detected depending on the detected position of the operation in the display area of the item for which a user operation is detected. 8. The information processing device according to claim 7, wherein the processor sets the confirmation time for the item where the user operation is detected to be shorter as the detection position where the user operation is detected approaches the center of the display area of the item, and sets the confirmation time for the item where the user operation is detected to be longer as the detection position where the user operation is detected approaches the outline of the display area of the item . The information processing device according to any one of claims 1 to 8, wherein the processor adjusts the confirmation time for the item for which a user operation is detected by changing the measurement speed of a threshold value that represents the length of the confirmation time that is preset for the item as a numerical value. The information processing device according to claim 9 , wherein when the determination time for the item is shortened, the processor sets a measurement speed per count of the threshold representing the determination time preset for the item to be faster than a predetermined reference measurement speed. On the computer,
For each item displayed on the screen, the user's touchless operation is accepted.
An information processing program for executing control to make the confirmation time for a first item among the items shorter than the confirmation time for a second item from the time a user operation on the item is detected until the operation is confirmed as a selection for the item for which the operation was detected, and to adjust the confirmation time for the item for which a user operation was detected depending on the distance from the user's part used to operate the item to the display surface of the screen .