JP7115259B2 - Image forming apparatus and program - Google Patents

Description

The present invention relates to an image forming apparatus and program.

In recent years, an image forming apparatus (MFP: Multifunction Peripheral) equipped with a voice recognition function is being used. With this image forming apparatus, the user can cause the image forming apparatus to perform an operation intended by the user only by verbally transmitting an operation instruction to the image forming apparatus. The image forming apparatus extracts an operation instruction from the voice uttered by the user, and searches for a function (eg, COPY function, SCAN function) corresponding to the operation instruction. If the extracted operation instruction is clear, the image forming apparatus can search for a function that completely matches this operation instruction.

However, if the volume of the user's voice is low or there is noise in the surroundings, the image forming apparatus cannot accurately extract the operation instruction. In this case, the image forming apparatus performs a fuzzy search on the extracted part of the operation instruction, and searches for the function of the wording that includes the part of the operation instruction. The image forming apparatus then responds to the user with the retrieved function. This response is performed, for example, by sounding a message representing the function type from a speaker provided in the image forming apparatus, or by displaying the function type on the liquid crystal display device.

Techniques disclosed in Patent Documents 1 and 2 below are known as techniques for operating an image forming apparatus by such voice recognition.

In Patent Document 1, input speech is recognized, a candidate list of recognition results is output, differences between the candidates of the recognition results are extracted, difference information is added to the recognition results, and difference information added to the recognition results. Disclosed is a technique for generating a response in which the difference is clear based on and presenting the generated response.

Patent Document 2 discloses an operation display unit that determines the operation mode of a home appliance/equipment based on a command extracted from sound information, the state of the home appliance/equipment, etc., and displays the operation mode and state of the home appliance/equipment. A technique is disclosed for changing the display contents of according to the change of the operation mode.

JP-A-2006-23572 JP 2005-284492 A

Here, the candidate list of the recognition result of the input speech used in the technology described in Patent Document 1 lists the candidates of the recognition result judged to be valid as the recognition result. This candidate list is only used inside the interactive device described in Patent Document 1, and what the user can recognize is guidance or the like by presenting responses. When the user gives an unclear operation instruction, the guidance presented in response becomes long, and it takes time to start executing the function.

The operation display section described in Patent Literature 2 displays the operation modes and states of home appliances/equipment, but this is based on the premise that the user has correctly input the function type by voice. Therefore, if the user cannot remember the correct function type, the user cannot change the operation mode of the home appliance/equipment, and cannot perform voice input.

However, even if the user gives a clear operation instruction, if the operation screen is activated or the screen is changed every time the operation instruction is given, unnecessary power is consumed as the operation screen changes. In addition, the user is made to wait until the operation screen desired by the user is displayed before starting the execution of the function. In this case, it is not possible to take advantage of the voice recognition function that enables easy operation instructions, and there is no difference from input from a normal operation panel that has been used conventionally.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and it is an object of the present invention to appropriately execute a function even if an operation instruction input by voice is ambiguous.

In order to achieve at least one of the above objects, an image forming apparatus according to one aspect of the present invention provides an image forming apparatus that recognizes speech input to a speech input unit based on words extracted from text data. a dictionary database in which words, phrases, function types, operation screens, and setting items are associated with each other; and functions of functions for which operation instructions are given in order of words, phrases, and setting items. An operation display unit that displays an operation screen corresponding to the type and performs operation input on the operation screen, and the function type and operation screen for the words included in the operation instruction are acquired from the dictionary database and determined by the operation instruction determination unit. a function setting unit that sets a function selected based on the operation instruction and notifies the set function when the operation instruction is appropriate; and a control that executes the function set by the function setting unit. and an execution control unit that performs the following: when the operation instruction determined by the operation instruction determination unit is not appropriate, an operation screen corresponding to the operation instruction and an operation screen corresponding to another function type related to the operation instruction. Displayed on the operation display section, the function setting section sets the function according to the operation input from the selected operation screen .
Note that the image forming apparatus described above is one aspect of the present invention, and a program reflecting one aspect of the present invention also has the same configuration as the image forming apparatus described above.

According to the present invention, when the operation instruction is valid, the function selected based on the operation instruction is set, and the function is executed. Therefore, even if the operation instruction input by voice is ambiguous, it is possible to quickly start executing an appropriate function.
Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

1 is a schematic configuration diagram of an image forming apparatus according to an embodiment of the present invention; FIG. 1 is a block diagram showing a configuration example of a control system of an image forming apparatus according to an embodiment of the invention; FIG. FIG. 3 is an explanatory diagram showing a configuration example of a dictionary database according to one embodiment of the present invention; FIG. 4 is an explanatory diagram showing an operation example of the image forming apparatus when a user instructs the image forming apparatus to execute copy processing by voice according to the embodiment of the present invention; FIG. 5 is an explanatory diagram showing an operation example of the image forming apparatus when a user makes a network setting request to the image forming apparatus by voice according to the embodiment of the present invention; FIG. 10 is an explanatory diagram showing a display example of a candidate screen for executing an operation-instructed function according to an embodiment of the present invention; FIG. 10 is an explanatory diagram showing a display example of an operation screen in which an item lacking in order to execute an operation-instructed function is highlighted according to an embodiment of the present invention; 4 is a flow chart showing an example of speech recognition processing performed by the image forming apparatus according to one embodiment of the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same function or configuration are denoted by the same reference numerals, thereby omitting redundant description.

[One embodiment]
<Configuration of Image Forming System>
First, a configuration example of an image forming system according to an embodiment of the present invention will be described with reference to FIG.
FIG. 1 is a schematic configuration diagram of an image forming apparatus 1 according to one embodiment of the present invention. It should be noted that FIG. 1 describes the elements considered necessary for explaining the present invention or related elements, and the image forming system of the present invention is not limited to the example shown in FIG.

The image forming apparatus 1 is an example of an image forming apparatus that forms an image on a sheet by an electrophotographic method that forms an image using static electricity. The image forming apparatus 1 forms a color image on a sheet in a tandem format in which toner images of four colors of yellow (Y), magenta (M), cyan (C) and black (K) are superimposed, for example. The image forming apparatus 1 is connected to a PC 70 (see FIG. 2 to be described later) and the like operated by a user via a LAN (Local Area Network) (not shown). Various jobs such as a print job are input from the PC 70 to the image forming apparatus 1 via the LAN. The image forming apparatus 1 performs various types of processing such as image forming processing according to the input job.

The image forming apparatus 1 according to the present embodiment is equipped with a voice control function capable of controlling the execution of functions in accordance with user's vocalized operation instructions. Here, if the user's voice contains a clear keyword or an instruction phrase, the image forming apparatus 1 refers to the internal dictionary database 53 (see FIG. 2 described later) to determine the validity of the operation instruction. In other words, whether the instruction is valid as an instruction for job execution, and if it is valid, the operation instruction can be operated. Further, if the operation instruction is insufficient, the image forming apparatus 1 can display an operation screen related to the operation instruction, and guide the user to execute the intended function through this operation screen. . If there are a plurality of determined operation instructions, operation screens corresponding to a plurality of functions are displayed. Therefore, it is possible for the user to select an operation screen indicating a desired function from among the plurality of operation screens. Here, "guidance" means highlighting a button leading to an operation screen that is likely to be related to the commanded function, reducing multiple operation screens that are likely to be related to this function, or displaying the operation screen. It is to display them one by one or to let the user judge Yes or No.

The image forming apparatus 1 includes an image input unit 11 having an automatic document feeder (ADF) 12, an operation display unit 13, and a printer unit 10 having a paper feed tray 20 and an image forming unit 30. .

The image input unit 11 optically reads an image from a document on the document table of the automatic document feeder 12, and A/D converts the read image to generate image data (scan data). Note that the image input unit 11 can also read on the platen glass.

The operation display unit 13 includes a display unit such as a liquid crystal panel and an operation unit such as a touch sensor. The display unit and the operation unit are integrally formed as a touch panel, for example. The operation display unit 13 generates an operation signal representing the content of the operation input by the user to the operation unit, and supplies the operation signal to the control unit 50 (see FIG. 2 described later). Further, based on the display signal supplied from the control unit 50, the operation display unit 13 displays an operation screen including details of user's operation, setting information, and the like.

The operation display unit 13 according to the present embodiment displays an operation screen corresponding to the function type of the function for which the operation instruction is given by voice input from the user. Therefore, the user of the image forming apparatus 1 can confirm the voice recognition result based on the operation screen displayed on the operation display section 13 . Since the operation display unit 13 is formed as a touch panel, an operation input is performed on the operation screen. Therefore, the user can set functions through the operation screen.

It should be noted that it is also possible to configure the operation unit with a mouse, a tablet, or the like, and configure it separately from the operation display unit 13 . In this case, the user can select the operation screen displayed on the operation display unit 13 through the operation unit configured separately.

The paper feed tray 20 is a container that accommodates paper Sh (an example of a recording material) on which image formation is performed in the image forming section 30 . The image forming apparatus 1 can also form an image on a resin sheet, which is an example of a recording material. The paper feed trays 20 accommodate paper Sh having different paper types, basis weights, and the like. In this embodiment, an example in which two paper feed trays 20 are provided is given, but the number of paper feed trays 20 may be one, or three or more.

The image forming apparatus 1 is provided with a transport path 21 that transports the paper Sh fed from the paper feed tray 20 to a paper discharge tray 25 (an example of a paper discharge unit). The transport path 21 is provided with a plurality of transport rollers for transporting the sheet Sh.

The image forming section 30 includes four image forming units 31Y, 31M, 31C, and 31K for forming toner images of Y, M, C, and K colors, and forms images on paper Sh. The image forming units 31Y, 31M, 31C and 31K respectively include a charging section, an exposure section (none of which is shown), photosensitive drums 32Y, 32M, 32C and 32K as image carriers, and developing sections 33Y, 33M and 33C. , 33K.

The developing units 33Y, 33M, 33C, and 33K irradiate the surfaces (peripheries) of the photosensitive drums 32Y, 32M, 32C, and 32K with light according to the image, thereby electrostatically forming the circumferences of the photosensitive drums. form a latent image. The developing units 33Y, 33M, 33C, and 33K attach toner to the electrostatic latent images to form toner images on the photosensitive drums 32Y, 32M, 32C, and 32K.

The image forming section 30 also includes an intermediate transfer belt 34 , a secondary transfer section 35 and a fixing section 36 . The intermediate transfer belt 34 is a belt onto which the images formed on the photosensitive drums 32Y, 32M, 32C, and 32K are primarily transferred. The secondary transfer unit 35 is a roller that secondarily transfers the toner image of each color that has been primarily transferred onto the intermediate transfer belt 34 onto the paper Sh transported along the transport path 21 .

The fixing unit 36 is arranged downstream of the secondary transfer unit 35 in the sheet conveying direction, and performs a fixing process on the sheet Sh supplied from the image forming unit 30 and having the color toner image formed thereon. The fixing unit 36 heats and presses the transported paper Sh to fix the image transferred by the image forming unit 30 on the surface side of the paper Sh. On the downstream side of the fixing section 36 , the conveying path 21 is extended and connected to the discharge tray 25 . A reversing transport path 22 is connected to the transport path 21 . The reverse transport path 22 branches downstream of the fixing section 36 and merges with the transport path 21 upstream of the printer section 10 . The reversing transport path 22 is provided with a reversing section 23 for reversing the front and back of the sheet Sh. The paper Sh on which the image is fixed by the fixing section 36 is discharged to the paper discharge tray 25 through the transport path 21, or is reversed by the reversing section 23 through the reversing transport path 22, and then is transferred to the upstream side of the printer section 10. It is returned to the transport path 21 . The printer unit 10 forms an image on the back surface of the sheet Sh whose front and back sides are reversed. After that, the sheet Sh subjected to the fixing process by the fixing section 36 is discharged to the discharge tray 25 .

[Configuration of Control System of Image Forming Apparatus]
Next, a configuration example of the control system of the image forming apparatus 1 will be described with reference to FIG.
FIG. 2 is a block diagram showing a configuration example of a control system of the image forming apparatus 1. As shown in FIG.
The image forming apparatus 1 includes a communication I/F section 51 , a sheet conveying section 24 , an image input section 11 , an image forming section 30 , a control section 50 , a storage section 52 , a fixing section 36 and an operation display section 13 .

The communication I/F unit 51 is an interface that transmits and receives data to and from the PC 70, which is a terminal operated by a user, via a network or a dedicated line. A NIC (Network Interface Card), for example, is used as the communication I/F unit 51 .

The sheet conveying unit 24 drives each conveying roller (not shown) provided on the conveying path 21 and the reversing conveying path 22 shown in FIG.

The control unit 50 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an input image processing unit 504, an operation instruction determination unit 505, a function setting unit 506, and an execution control unit 507. Prepare.
The ROM 502 stores programs executed by the CPU 501 of the control unit 50 or data used when the programs are executed. The CPU 501 controls each unit that configures the image forming apparatus 1 by reading programs stored in the ROM 502 .
The RAM 503 is temporarily written with variables, parameters, etc. generated during the arithmetic processing of the CPU 501 .

The input image processing unit 504 performs predetermined image processing on the input image included in the job input from the PC 70 via the communication I/F unit 51, and creates image data for printing. The input image processing unit 504 also performs image processing on the image data acquired from the document read by the image input unit 11 or the image data acquired from the outside, and creates image data for printing. This print image data is sent to the image forming section 30 .

The control unit 50 controls the sheet conveying unit 24 to drive the conveying rollers and convey the sheet Sh on the conveying path 21 . The control unit 50 also outputs the image data for printing created by the input image processing unit 504 to the image forming unit 30 . Further, the control section 50 controls the image forming section 30 to form an image on the paper Sh. Further, the control section 50 controls the fixing section 36 to fix the image on the paper Sh.

Also, the control unit 50 receives an operation signal from the operation display unit 13 and performs control according to the operation signal. Further, the control unit 50 outputs a display signal to the operation display unit 13, and the operation display unit 13 displays an operation screen for displaying various setting items for inputting various operation instructions and setting information, various processing results, and the like. Display on the display.

The storage unit 52 stores parameters used when the CPU 501 executes the program, data obtained by executing the program, and the like. A program executed by the CPU 501 may be stored in the storage unit 52 . A dictionary database 53 that is referenced by the control unit 50 is configured in the storage unit 52 . The dictionary database 53 stores function types, operation screen names, setting items, etc. related to words uttered by the user. A detailed configuration of the dictionary database 53 will be described later with reference to FIG.

An operation instruction determination unit 505 included in the control unit 50 determines an operation instruction made by voice based on words extracted from text data recognized from the voice input to the voice input unit 14 . Here, processing for generating text data recognized from voice may be performed by the voice input unit 14 or may be performed by the operation instruction determination unit 505 .

Then, the operation instruction determination unit 505 refers to the dictionary database 53 and acquires the function type corresponding to the word/phrase extracted from the text data. Therefore, even if a phrase uttered by the user is ambiguous or insufficient, the operation instruction determination unit 505 acquires the function type related to this phrase and determines whether the operation instruction is appropriate. can be done. However, if there are multiple function types related to this phrase, multiple operation instructions may be determined as invalid.

If the operation instruction is not valid, the operation instruction determination unit 505 causes the operation display unit 13 to display an operation screen corresponding to the operation instruction and an operation screen corresponding to another function type related to the operation instruction. Then, the operation instruction determination unit 505 can determine whether the operation instruction is appropriate based on the operation screen selected by the user. Further, the operation instruction determination unit 505 displays the operation screen corresponding to the operation instruction and the operation screen corresponding to the other function type in substantially the same size as the display area of the operation display unit 13 and in a predetermined order. Further, the operation instruction determination unit 505 can reduce the display area of the operation display unit 13 and display the operation screen corresponding to the operation instruction and the operation screen corresponding to the other function type side by side.

When the operation instruction is not appropriate as described above, the operation instruction determination unit 505 displays a plurality of operation screens on the operation display unit 13, and the user selects one operation screen. The function setting unit 506 can set the function according to the operation input from the operation screen selected by the user.

A function setting unit 506 sets a function selected based on the operation instruction when the operation instruction determined by the operation instruction determination unit 505 is appropriate. Therefore, the function setting unit 506 acquires from the dictionary database 53 the function type and the operation screen for the words included in the operation instruction determined to be valid by the operation instruction determination unit 505 . Here, the function setting unit 506 can set the function when the word/phrase extracted from the text data recognized from the voice input to the voice input unit 14 satisfies the item. The function setting unit 506 causes the execution control unit 507 to execute the function corresponding to the operation screen selected through the operation display unit 13 .

In addition, the function setting unit 506 causes the operation display unit 13 to display an operation screen that emphasizes an item that is insufficient for setting the function, and if the operation input to the item selected through the operation display unit 13 satisfies the item, the function is set. can also be set.

The execution control unit 507 controls execution of functions set by the function setting unit 506 . A function of the image forming apparatus 1 executed by the execution control unit 507 is treated as, for example, a job.

FIG. 3 is an explanatory diagram showing a configuration example of the dictionary database 53. As shown in FIG.
The dictionary database 53 is composed of a table having fields of word/phrase, function type, operation screen name (operation screen), and setting item. This table associates function types, operation screen names, and setting items corresponding to words extracted from user-generated pronounciations.

For example, the word "copy" extracted from the user's pronounciation corresponds to the function type "COPY". The word "copy" extracted from the user's pronounciation also corresponds to the function type "COPY". In addition, words extracted from various pronounciations (for example, "copy") associated with the function type "COPY" are stored in the dictionary database 53 in association with the function type. In order to execute the "COPY" function, it is shown that the number of copies, document size, and single-sided and double-sided settings are required as setting items. Then, if the operation instruction by voice from the user is not valid, the operation display unit 13 displays a COPY setting screen for executing the "COPY" function.

Similarly, the word "fax" extracted from the user's pronounciation corresponds to the function type of "FAX". If the operation instruction by voice from the user is not valid, the operation display unit 13 displays a FAX setting screen for executing the "FAX" function.

Also, when the user calls "scan", the function type corresponds to the "SCAN" function. If the operation instruction by voice from the user is not valid, the operation display unit 13 displays a SCAN setting screen for executing the "SCAN" function. Note that when the appellation is "send", the function type corresponds to both "FAX" and "SCAN".

Also, the phrases "connect" and "want to connect" uttered by the user correspond to the "network connection" function. If the operation instruction by voice from the user is not valid, the operation display unit 13 displays a network setting screen for "network connection".

Next, an operation example of the image forming apparatus 1 will be described with reference to FIGS. 4 to 7. FIG.
FIG. 4 is an explanatory diagram showing an operation example of the image forming apparatus 1 when the user 60 instructs the image forming apparatus 1 to perform copy processing by voice.

(1) First, the user 60 utters "copy, 4 sheets, A4 size, single side". Here, the operation display unit 13 displays, as an initial screen, icons with which the user can instruct transition to setting screens for the respective functions of "COPY", "FAX", and "SCAN".

(2) The operation instruction determination unit 505 determines from the text data input from the voice input unit 14 that the operation instruction is "copy, 4 sheets, A4 size, single side". Then, the operation instruction determination unit 505 determines the validity of the user's 60 operation instruction. Here, the operation instruction determination unit 505 determines that “copy” indicates execution of the “COPY function”, “4 sheets” indicates that the “number of prints” is “4”, and “A4 size” indicates “document It is determined that "size" is set to "A4", and "single-sided" indicates that "print setting single-sided" is set to "single-sided". In this case, since all the settings of “COPY function”, “number of copies”, “original size”, and “print setting single-sided” that need to be set at the time of copying have been instructed, the operation instruction determination unit 505 determines that the user 60 It is determined that the operation instruction is appropriate.

(3) When it is determined that the operation instruction is valid, the function setting unit 506 performs predetermined settings for the instructed COPY function, and the execution control unit 507 immediately executes the COPY function. At this time, the image forming apparatus 1 does not switch the operation screen displayed on the operation display section 13 . In other words, the initial screen remains displayed on the operation display unit 13 . In FIG. 4, the operation instruction by voice for the copy processing has been described, but the operation instruction by voice is also possible for the FAX function and the SCAN function.

Here, even if the user 60 does not call "copy" but calls "copy", the operation instruction determination unit 505 can determine that execution of the "COPY function" has been instructed. Then, when all the items necessary for executing the "COPY function" are set, the execution control unit 507 can immediately execute the COPY function.

Note that, for example, if any of the items necessary for executing the “COPY function” is not set, the operation instruction determination unit 505 prompts the user 60 to make additional settings. For example, if the user 60 has not given an operation instruction for the "number of prints", the user 60 will not be able to set the "number of prints" by displaying or emitting a sound prompting the user to set the "number of prints" on the operation display unit 13. make you aware that Therefore, the user 60 can cause the image forming apparatus 1 to perform the function intended by the user 60 by setting the "number of prints".

FIG. 5 is an explanatory diagram showing an operation example of the image forming apparatus 1 when the user 60 makes a request for network setting to the image forming apparatus 1 by voice.

(1) First, the user 60 utters, "I want to connect the MFP to the personal computer."
(2) The operation instruction determination unit 505 determines from the text data input from the voice input unit 14 that the operation instruction includes the phrases "MFP", "PC", and "I want to connect". The operation instruction determination unit 505 then refers to the dictionary database 53 and determines that the function corresponding to the phrase "want to connect" is "network connection". Here, the operation instruction determination unit 505 determines that the operation instruction is not appropriate because the information of the PC 70 or the like required for "network connection" is insufficient. Therefore, the operation instruction determination unit 505 causes the operation display unit 13 to display an operation screen for network settings used for network connection between the image forming apparatus 1 and the PC 70 .

(3) The user 60 looks at the network setting operation screen displayed on the operation display unit 13 and utters "OK." When the operation instruction determination unit 505 determines the word “OK”, it causes the operation display unit 13 to continue displaying the operation screen for network settings. After that, the user 60 performs necessary operation inputs through the operation screen for network settings. The items that have been operated and input are set by the function setting unit 506, so that the execution control unit 507 can connect the image forming apparatus 1 and the PC 70 to a network.

FIG. 6 is an explanatory diagram showing a display example of a candidate screen for executing an operation-designated function.

(1) First, the user 60 utters, "I want to send this paper."
(2) The operation instruction determination unit 505 determines that the operation instruction includes the words “paper” and “send” from the text data input from the voice input unit 14 . Then, the operation instruction determination unit 505 refers to the dictionary database 53 and determines that the function corresponding to the pronunciation of "send" corresponds to "FAX" or "SCAN to Email". Here, "SCAN to Email" is a function of transferring image data of a document read by the image input unit 11 to a previously specified email address.
The operation instruction determination unit 505 controls the operation display unit 13 to sequentially display the FAX setting screen and the SCAN to Email setting screen.

(3) Assume that a FAX setting screen is displayed on the operation display unit 13 . At this time, if the operation screen is not the one intended by the user 60, the user 60 utters "No." The utterance “No” is determined by the operation instruction determination unit 505 as a negative response such as “NO”. Then, the operation instruction determination unit 505 determines that the operation instruction from the user 60 instructs switching of the operation screen. Then, the operation instruction determination unit 505 performs control to display the SCAN to Email setting screen on the operation display unit 13 .

(4) Next, the user 60 looks at the SCAN to Email setting screen displayed on the operation display unit 13 and utters, "This is it." The utterance “this is it” is determined by the operation instruction determination unit 505 as a positive response such as “YES”. Thereafter, the user 60 uses the function setting unit 506 to set the input e-mail address and the like through the SCAN to Email setting screen. As a result, it is possible to transmit an image file obtained by scanning characters, pictures, etc. printed on paper by the image forming apparatus 1 to a destination specified by a registered e-mail address.

FIG. 7 is an explanatory diagram showing a display example of a screen in which an item lacking in order to execute an operation-instructed function is highlighted.

(1) First, the user 60 utters, "Scan and send to XXX (destination)."
(2) The operation instruction determination unit 505 determines, from the text data input from the voice input unit 14, that the operation instruction includes the words “XXX” and “scan” indicating the destination. Then, the operation instruction determination unit 505 refers to the dictionary database 53 and causes the operation display unit 13 to display the SCAN setting screen.

On the SCAN setting screen, it is necessary to set resolution and format items in addition to the destination item. For this reason, the function setting unit 506 causes the operation display unit 13 to highlight the resolution and format items by, for example, highlighting them in a different display color from other items, or blinking them. Therefore, the user 60 can confirm which item is missing, and can utter or input the missing item again.

FIG. 8 is a flowchart showing an example of speech recognition processing performed by the image forming apparatus 1. As shown in FIG.
When the user performs voice input through the voice input unit 14, the operation instruction determination unit 505 starts the following processing based on the pronunciation (phrase) extracted from the text data.

First, the operation instruction determination unit 505 refers to the dictionary database 53 and compares the pronunciation (words) recognized by voice with the pronunciations (words) stored in the dictionary database 53 (S1). Based on the comparison result, the operation instruction determination unit 505 determines whether the operation screen to be displayed on the operation display unit 13 and the function to be executed by the execution control unit 507 are clear, that is, whether the operation instruction is appropriate ( S2).

If the operation screen and functions are clear (YES in S2), the process proceeds to step S5. On the other hand, if the operation screen or function is not clear (NO in S2), the operation instruction determination unit 505 causes the operation display unit 13 to display candidate screens corresponding to each function read from the dictionary database 53 (S3). At this time, the candidate screens are displayed in a predetermined order on the operation display unit 13, or reduced candidate screens are displayed side by side on the operation display unit 13. FIG.

Next, the user determines whether or not the screen is the operation screen for the function requested to be executed (S4). For example, when the user presses the next screen display button displayed in the operation screen, the operation instruction determination unit 505 can determine that the operation screen does not correspond to the function requested by the user. Conversely, when the user presses, for example, a screen icon displayed in the operation screen, the operation instruction determination unit 505 can determine that the operation screen is the function requested by the user. Therefore, if it is not the operation screen of the function requested by the user (NO in S4), the process returns to step S2 and repeats the process.

On the other hand, if it is an operation screen for the function requested by the user (YES in S4), the function setting unit 506 determines whether or not there are enough input items on the operation screen displayed on the operation display unit 13 (S5). . If the input items are sufficient (YES in S5), the job is set according to the input items, and the execution control unit 507 controls the execution of the job.

On the other hand, if the input items are insufficient (NO in S5), the function setting section 506 highlights the missing items on the operation display section 13 (S6). After that, when a value is input to the missing item, the function setting unit 506 returns to step S5 and again performs the process of determining whether or not the input item is sufficient. The processing of steps S5 to S7 is repeated until there are enough input items.

In the image forming apparatus 1 according to the embodiment described above, even if the words recognized from the voice input to the voice input unit 14 are unclear, the operation instruction is valid and necessary for this function. When the item is set, the function is started to be executed without switching the operation screen displayed on the operation display unit 13 or the like. Even if the user does not know the type of function that the user wants the image forming apparatus 1 to perform, the user only needs to speak a part of the type of function or a phrase associated with the type of function.
In addition, the time required for switching operation screens from the user's voice input to the start of job execution can be shortened, and the user's waiting time can be shortened. In addition, power consumption required for switching operation screens can be reduced.

If the operation instruction is not valid, the operation display unit 13 displays not only the operation screen corresponding to the operation instruction, but also the operation screen corresponding to another function type related to this operation instruction. Therefore, the user can select an operation screen representing a function to be executed from a plurality of operation screens displayed on the operation display unit 13 and instruct the image forming apparatus 1 to execute the function. Further, even if the user has little experience of using the image forming apparatus 1, the user's time to search for the operation screen and the functions of the image forming apparatus 1 can be minimized.

Here, when a plurality of operation screens are selected as candidates, the operation display unit 13 switches and displays the operation screens one by one, or reduces and displays a plurality of operation screens side by side. Thereby, the user can easily select the operation screen representing the function to be executed.

Further, when there are items for which settings are insufficient when executing a job, the items for which settings are insufficient are highlighted on the operation screen selected by the user. Therefore, the user can easily recognize the item for which the setting is insufficient, and can set the item again. As a result, the image forming apparatus 1 can reliably execute the job.

Note that even if the operation instruction is valid, the image forming apparatus 1 may notify the user of the function to be started by the execution control unit 507 by voice guidance or the like, or display the function on the operation display unit 13 .

Also, the function setting performed by the function setting unit 506 may be automated. For example, when execution of the COPY function is instructed, initial values may be set such that the number of prints is "1", the paper size is "A4", and the print setting is "single-sided". This makes it possible for the user to place a document on the automatic document feeder 12 and simply say "copy" to execute the COPY function with the initial values set.

The present invention is not limited to the above-described embodiments, and it goes without saying that various other application examples and modifications can be made without departing from the gist of the present invention described in the claims.
For example, the above-described embodiments are detailed and specific descriptions of the configuration of the image forming apparatus in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations. Moreover, it is possible to add, delete, or replace a part of the configuration of this embodiment with another configuration.
Further, the control lines and information lines indicate those considered necessary for explanation, and not all control lines and information lines are necessarily indicated on the product. In practice, it may be considered that almost all configurations are interconnected.

REFERENCE SIGNS LIST 1 image forming apparatus 10 printer unit 13 operation display unit 14 voice input unit 30 image forming unit 50 control unit 53 dictionary database 504 input image processing unit 505 operation instruction Determining unit 506 Function setting unit 507 Execution control unit

Claims (5)

an operation instruction determination unit that determines an operation instruction performed by the voice based on a phrase extracted from text data recognized from the voice input to the voice input unit;
a dictionary database in which the words and phrases, function types, operation screens, and setting items are associated;
an operation display unit for displaying the operation screen corresponding to the function type of the function for which the operation instruction is performed in the order of the word and the setting item, and performing an operation input on the operation screen;
obtaining from the dictionary database the function type and the operation screen corresponding to the words included in the operation instruction, and if the operation instruction determined by the operation instruction determination unit is appropriate, based on the operation instruction; a function setting unit that sets the function selected by the
an execution control unit that controls execution of the function set by the function setting unit ;
When the operation instruction determined by the operation instruction determination unit is not valid, the operation display unit displays the operation screen corresponding to the operation instruction and an operation screen corresponding to another function type related to the operation instruction. and the function setting unit sets the function according to the operation input from the selected operation screen.
Image forming device. The operation instruction determination unit displays the operation screen corresponding to the operation instruction and the operation screen corresponding to the other function type in substantially the same size as the display area of the operation display unit and in a predetermined order. The image forming apparatus according to claim 1 . 3. The operation instruction determination unit causes the operation screen corresponding to the operation instruction and the operation screen corresponding to the other function type to be displayed side by side in a smaller size than the display area of the operation display unit. The described image forming apparatus. The function setting unit causes the operation display unit to display the operation screen that emphasizes the items lacking in the setting of the function, and the operation input to the item selected through the operation display unit satisfies the item. 4. The image forming apparatus according to any one of claims 1 to 3 , wherein the setting of the function is performed at a time. a procedure for determining an operation instruction given by said voice based on a phrase extracted from text data recognized from voice input to a voice input unit;
a procedure of displaying an operation screen corresponding to the function type of the function for which the operation instruction is performed in the order of the phrase and the setting item on the operation display unit, and performing an operation input on the operation screen;
The function type and the operation screen for the word included in the operation instruction are acquired from a dictionary database in which the word, the function type, the operation screen, and the setting item are associated with each other, and the determined a procedure of setting a function selected based on the operation instruction and notifying the set function when the operation instruction is valid;
a procedure for controlling execution of the configured functions;
a procedure for displaying the operation screen corresponding to the operation instruction and an operation screen corresponding to another function type related to the operation instruction on the operation display unit when the determined operation instruction is not valid;
A program for causing a computer to execute a procedure for setting the function according to the operation input from the selected operation screen .

Images