JP7400593B2 - Information processing device and program - Google Patents

Description

The present application relates to a technology for controlling an image forming apparatus by voice.

Patent Document 1 describes an electronic device that performs operation processing based on instructions by touch operation on a panel section and instructions by voice.

Japanese Patent Application Publication No. 2019-139674

However, in the electronic device described in Patent Document 1, an instruction to change the value of a setting parameter of an image forming apparatus by voice is given by specifying the value of the setting parameter itself. If the relationship between the image forming result and the image forming result is not well understood, the image may not be formed as intended by the user even if the image forming apparatus forms the image using the setting parameter values specified by the user. There is a risk.

An object of the present application is to provide a technology for changing setting parameters by voice, which enables image formation as intended by the user.

In order to achieve the above object, the information processing device of the present application includes a communication interface and a control device, and the control device controls image formation from a smart speaker connected via the communication interface that inputs and outputs audio. The content of the voice input by the user of the device is recognized by pronunciation, and if the content of the recognized voice indicates the user's dissatisfaction with or request for the image formed by the image forming device, the recognized voice Based on the contents of the image forming apparatus, the image forming apparatus executes processing to determine the setting parameter items and values to be changed, generates a command including the determined setting parameter items and values, and executes the generated command. Send to image forming device.

Note that the technology disclosed in this specification can be realized in various forms, such as an information processing method, a method for controlling an image forming apparatus, a function of the apparatus, or a computer program for realizing the above method. , a recording medium on which the computer program is recorded, etc.

According to the present application, it is possible to perform image formation as intended by the user.

1 is a block diagram showing the configuration of an image forming system according to an embodiment of the present application. 2 is a sequence diagram of print control processing executed by the image forming system of FIG. 1. FIG. 3 is a sequence diagram that is a continuation of the sequence diagram in FIG. 2. FIG. FIG. 3 is a diagram showing an example of data stored as log information.

Hereinafter, embodiments of the present application will be described in detail based on the drawings.

FIG. 1 shows the configuration of an image forming system 1000 according to an embodiment of the present application. The image forming system 1000 mainly includes a repeater 100, a printer 200, a smart speaker 300, and an application server 400. Note that in the image forming system 1000 of this embodiment, the repeater 100, printer 200, and smart speaker 300 are used by the same user.

The access point 50 used in the image forming system 1000 realizes a function as a wireless LAN access point using a communication method according to the IEEE802.11a/b/g/n standard, for example. Access point 50 is connected to LAN 70. The LAN 70 is, for example, a wired network constructed in accordance with the Ethernet (registered trademark) standard. LAN 70 is connected to the Internet 80. Application server 400 is connected to the Internet 80.

The relay device 100 is a device that relays data sent and received between the application server 400 and the printer 200. The repeater 100 communicates with a CPU 110 for controlling the entire repeater 100, a memory 120 such as ROM, RAM, and NVM, a Bluetooth (registered trademark) IF 160 for P2P communication with the printer 200, and an application server 400. It mainly includes a wireless LAN IF 180. The repeater 100 is configured by, for example, a mobile terminal such as a smartphone. Note that NVM is an abbreviation for non-volatile memory, P2P is an abbreviation for Peer to Peer, and IF is an abbreviation for Interface.

Memory 120 includes a data storage area 122 and a control program area 124. The data storage area 122 is an area for storing data necessary for the CPU 110 to execute a control program and the like. Further, the control program area 124 is an area for storing an OS, control programs, firmware, and the like.

The Bluetooth IF 160 includes an antenna and is an interface for performing short-range wireless communication based on the Bluetooth method. The repeater 100 is communicably connected to the printer 200 via the Bluetooth IF 160. The wireless LAN IF 180 includes an antenna and performs wireless communication using a communication method according to, for example, the IEEE802.11a/b/g/n standard. Thereby, the repeater 100 is connected to the LAN 70 and the Internet 80 via the access point 50, and is communicably connected to the application server 400. Note that if the printer 200 includes a wireless LAN IF, the repeater 100 may be configured to be communicably connected to the printer 200 via the wireless LAN IF 180.

The printer 200 includes, for example, a control unit 210 including a CPU and a memory, a printing mechanism 250 that performs printing under the control of the control unit 210, and a Bluetooth IF 260. The printing mechanism 250 is a mechanism that prints an image on a sheet, and is a printing mechanism using an electrophotographic method, an inkjet method, a thermal method, or the like. The Bluetooth IF 260 includes an antenna and is an interface for performing short-range wireless communication based on the Bluetooth method, and is used for communication with the repeater 100 as described above. Note that the printer 200 may be configured to include a wireless LAN IF instead of the Bluetooth IF 260 and to be communicably connected to the repeater 100.

If the printer 200 is not equipped with a wireless LAN IF, it is communicably connected to the repeater 100, but cannot communicate directly with the application server 400.

The smart speaker 300 is a device that performs specific processing in response to audio uttered by a user. The specific process includes, for example, a process of generating audio data and transmitting it to the application server 400. The smart speaker 300 includes a control section 310 including a CPU and memory, an audio input/output section 350, a Bluetooth IF 360, and a wireless LAN IF 380.

The audio input/output unit 350 includes a speaker and a microphone, and executes processing related to audio input and audio output. For example, the voice input/output unit 350 detects the voice uttered by the user under the control of the control unit 310 and generates voice data representing the voice. Furthermore, the audio input/output unit 350 generates audio from a speaker according to the received audio data.

The wireless LAN IF 380 includes an antenna and performs wireless communication using a communication method according to, for example, the IEEE802.11a/b/g/n standard. Thereby, the smart speaker 300 is connected to the LAN 70 and the Internet 80 via the access point 50, and is communicably connected to the application server 400.

The application server 400 is, for example, a server operated by a company that provides a so-called cloud service. The application server 400 includes a CPU 410 that controls the entire application server 400, and a storage unit 420 that includes ROM, RAM, HDD, SSD, optical disk drive, and the like. The application server 400 further includes a network IF 480 for connecting to the Internet 80. Note that although the application server 400 is conceptually illustrated as one server in FIG. 1, it is actually a so-called cloud server that includes a plurality of servers that are communicably connected to each other.

The storage unit 420 includes a data storage area 422 and a program storage area 424. The data storage area 422 functions as a storage area for storing data required when the CPU 410 performs processing, and as a buffer area for temporarily storing various intermediate data generated when the CPU 410 performs processing. do. The program storage area 424 is an area that stores the OS, information processing programs, various other applications, firmware, and the like. The information processing program includes a voice analysis program 424a and a printing related program 424b. The audio analysis program 424a is provided by, for example, being uploaded to the application server 400 by the operator of the application server 400. The printing-related program 424b is provided by being uploaded to the application server 400, for example, by a business that provides printing services using the resources of the application server 400, such as a business that manufactures the printer 200. Note that all or part of the voice analysis program 424a may be provided by a business that manufactures the printer 200. Alternatively, all or part of the print-related program 424b may be provided by a business operator that operates the application server 400.

The application server 400, particularly the CPU 410, functions as a speech analysis processing section 424a' (see FIG. 2) by executing the speech analysis program 424a. The speech analysis processing unit 424a' executes speech recognition processing and morphological analysis processing. Speech recognition processing is processing that analyzes audio data and generates text data indicating the content of the utterance indicated by the audio data. The morphological analysis process analyzes the text data to extract constituent units such as words (called morphemes) included in the content of the utterance, and to identify the type of the extracted morpheme (for example, the type of part of speech). It is processing.

Furthermore, the application server 400, particularly the CPU 410, functions as a print-related processing unit 424b' (see FIG. 2) by executing a print-related program 424b. The print-related processing unit 424b' uses text data obtained by analyzing audio data to perform processing such as generating a command for instructing the printer 200 to operate.

2 and 3 show a sequence of print control processing executed by the image forming system 1000. The print control process is a process in which the smart speaker 300 and the application server 400 cooperate to cause the printer 200 to execute printing.

The print control processing in FIGS. 2 and 3 shows the processing after the predetermined pre-processing is executed. The pre-processing means that the user first accesses the smart speaker 300 using a terminal device not included in the image forming system 1000, such as a smartphone or a PC, and stores the user ID and voiceprint in the memory included in the control unit 310. Register. Next, the user configures the repeater 100, the printer 200, and the smart speaker 300 so that data is correctly transmitted and received between the application server 400 and the printer 200. Furthermore, the user instructs the printer 200 to print using the print application installed on the terminal device. By performing such pre-processing, the user receives the print result from the printer 200 and is dissatisfied with or has a request for the print result.

In FIG. 2, first in S2, the user speaks. The user feels that the print result is a little lighter in density than he or she intended, so he asks the smart speaker 300, for example, "Would you like it to be a little darker?" The print control process starts when the smart speaker 300 detects the spoken voice.

In S4, smart speaker 300 generates audio data representing the audio uttered by the user. In other words, when the voice "Would you like it to be a little darker?" is input to the smart speaker 300, the smart speaker 300 generates audio data representing the voice.

Next, in S6, the smart speaker 300 transmits the audio data and the registered user ID to the audio analysis processing unit 424a' of the application server 400. A known protocol such as HTTP is used to transmit the audio data.

When the application server 400 receives the voice data and user ID, the voice analysis processing unit 424a' of the application server 400 analyzes the received voice data in S8. Specifically, the voice analysis processing unit 424a' performs voice recognition processing on the voice data and generates text data representing the voice represented by the voice data. For example, when receiving voice data indicating the voice ``Would it be a little darker?'', the voice analysis processing unit 424a' generates text data indicating the content of the voice. The speech analysis processing unit 424a' further performs morphological analysis processing on the text data. As a result, words such as "a little more," "darker," and "naru?" are extracted from the generated text data, and the part of speech of these words (e.g., noun, verb) is identified. . The speech analysis processing unit 424a' generates a list in which extracted words are associated with part-of-speech types as a result of morphological analysis.

Next, in S10, the speech analysis processing section 424a' passes the generated text data, the morphological analysis result, and the user ID received from the smart speaker 300 to the printing-related processing section 424b'. Specifically, the speech analysis processing unit 424a' stores the text data, the morphological analysis result, and the user ID in a predetermined area within the data storage area 422, and calls the print-related program 424b.

Upon receiving the text data, morphological analysis results, and user ID from the speech analysis processing section 424a', in S12, the printing-related processing section 424b' uses the text data and the morphological analysis results to determine what to do next. Execute the process to determine. Specifically, the print-related processing unit 424b' determines that the setting parameter item for "a little more" is a small change, and the setting parameter item for "darkening" is a density parameter, and that there is no further change in the direction. It is recognized that the number is increasing, and that the question "Will it become?" is asking whether or not it is possible. Based on this recognition result, the print-related processing unit 424b' recognizes that the content of the user's utterance is to "increase the value of the density parameter in a direction slightly darker than the current value," and for this purpose, it first sends the message to the printer 200. Then, it is decided that the current setting value of the concentration parameter is to be queried. The print-related processing unit 424b' then generates a command (hereinafter referred to as "current setting request command") for inquiring about the current setting value of the density parameter.

Next, in S14, the print-related processing unit 424b' transmits a current setting request command to the repeater 100. In S16, the repeater 100 transmits the received current setting request command to the printer 200 as is.

When printer 200 receives the current setting request command, it transmits a response (hereinafter referred to as "current setting response") including the current setting value of the density parameter and the model name of printer 200 to repeater 100 in S18.

In S20, the repeater 100 transmits the received current setting response to the application server 400 as is. The print-related processing unit 424b' of the application server 400 executes processing based on the received current setting response in S22. Specifically, for example, assume that the current setting response includes "5" as the current setting value of the density parameter. For example, the application server 400 stores information on all setting parameters for each of various image forming apparatuses including the printer 200 in a data storage area 422. The print-related processing unit 424b' obtains the maximum value that can be set as the density parameter from information on all setting parameters of the image forming apparatus, that is, the printer 200, that matches the model name included in the current setting response. If the maximum value is, for example, "10", the print-related processing unit 424b' knows that the value of the density parameter can be further increased by "5" steps from the current value "5". Therefore, the print-related processing unit 424b' generates text data that is the basis of audio data to notify the user of this fact. For example, the print-related processing unit 424b' selects "5", "can be darkened" and "2" for the small degree, and then asks "you can make it darker by 5 more levels. Shall we print again by making it darker by 2 levels?" generate text data. Then, the print-related processing section 424b' passes the generated text data to the speech analysis processing section 424a' in S24.

Next, in S26, the voice analysis processing section 424a' creates voice data based on the text data. Then, the audio analysis processing unit 424a' transmits the created audio data to the smart speaker 300 in S28 of FIG.

Next, in S30, the smart speaker 300 generates the received audio data as audio. The user who has heard this voice utters, for example, "OK" in S32. Alternatively, for example, you may say, "Darken it by one level." In response to this, the smart speaker 300 and the audio analysis processing unit 424a' execute the same processing as the processing in S4 to S10 above in S32, generate text data, and pass it to the print-related processing unit 424b'. .

In S36, the print-related processing unit 424b' creates a command based on the text data. Specifically, in the case of 2-stage printing, the print-related processing unit 424b' generates a command instructing to change the density parameter value to the current setting value + 2, that is, 7, and to reprint. The application server 400 then transmits the generated command to the repeater 100 in S38. In S40, the repeater 100 transmits the received reprint command to the printer 200 as is. In S<b>42 , the printer 200 controls the printing mechanism 250 using the density parameter settings according to the received reprint command, and executes reprinting based on the print data used for the previous printing stored in the control unit 210 . do.

When the print-related processing unit 424b' sends the print command to the repeater 100 in S38, it generates text data that is the basis of the voice data for notifying the printer 200 that reprinting has been instructed, and outputs the voice data. It may also be passed to the analysis processing section 424a'. As a result, the smart speaker 300 generates a sound informing that the printer 200 has been instructed to reprint, so the user can know in advance that the printer 200 will output the reprint results.

Furthermore, if the user is dissatisfied with the reprint result, the user speaks again to the smart speaker 300 about the content of the dissatisfaction. In response, the processes of S4 to S42 are repeated, and the printer 200 outputs the print results again.

Note that although the printer 200 is configured so that the set value of the density parameter can be changed, there are models of other printers in which the set value of the density parameter cannot be changed. In that case, the print-related processing section 424b' may generate text data that is the basis of the audio data for informing that the settings cannot be changed, and pass it to the audio analysis processing section 424a'.

In addition, in this embodiment, in S2 above, the user asks, "Would you like it to be a little darker?", so in S30, the user asks, "You can make it 5 more shades darker. Shall we make it 2 shades darker and reprint?" is responding to. Alternatively, the processes of S22 to S34 described above are omitted, the process proceeds from S20 to S36 without replying to the user, and the current value of the density parameter determined from "Darker" is changed from "A little more" to a little more. A command may be generated to instruct reprinting by adding the determined value in the increasing direction.

Note that in this embodiment, the content uttered by the user and the content of the audio generated from the smart speaker 300 are merely examples. Furthermore, the determined setting parameter items are not limited to the density parameter, and various setting parameter items are determined depending on the content of the user's utterance. Furthermore, the parameter values are not limited to changes in the increasing direction, but may also be changed in the decreasing direction. It is also possible that it will not be changed.

As described above, in the image forming system 1000 of the present embodiment, a user who is dissatisfied with or has a request for the print result from the printer 200 can express his or her dissatisfaction by simply speaking the contents of the dissatisfaction or request to the smart speaker 300. Since the setting parameter items and their values are automatically determined and the printing control for the printer 200 is performed so as to produce the print result that resolves the problem or the print result that meets the request, the image can be formed as intended by the user. It becomes possible to do this. This is particularly useful for users who do not fully understand the relationship between setting parameter values to be changed and print results, since the user does not have to directly specify setting parameter items and parameter values.

Further, the user can change the print settings intuitively because the user can change the print settings and obtain the intended print result just by uttering his or her intuitive impression of the print result. As a result, the user does not need to search for print settings from the print application that will allow the print result as intended by the user to be obtained. Furthermore, it may be possible to change to new print settings that are not included in the print settings registered in advance in the print application.

In the image forming system 1000 of this embodiment, the application server 400 performs everything from analyzing the content of the user's utterances to generating commands to be sent to the printer 200, so various smart speakers 300 may be used. In other words, there is no model dependence. Further, since the relay device 100 simply relays the data sent and received between the application server 400 and the printer 200, it is sufficient that it can relay data, and there is no model dependence.

FIG. 4 shows an example of the format of log information stored in the storage unit 420 by the print-related processing unit 424b' of the application server 400. When the user speaks into the smart speaker 300, the print-related processing unit 424b' acquires log information every time the user speaks and stores it in the storage unit 420. As shown in FIG. 4, the log information includes 1. Utterance data and 2. It is stored in association with the printer information.

1. As speech data, 1-1: date and time, 1-2: region, 1-3: raw data, and 1-4: extracted data are acquired. “Date and time” is the date and time when the user spoke. The "region" is the region where the user is when he/she speaks. A region may be any unit, such as a national unit, a prefecture, a municipality, or a more detailed unit. For example, the smart speaker 300 may be equipped with a GPS, and the "region" may be determined based on position information obtained from the GPS. “Raw data” is the audio data itself input from the smart speaker 300. "Extracted data" refers to the text data generated from the "raw data" as described above, and the morphological analysis results generated by performing morphological analysis processing on this text data.

2. As printer information, 2-1: print application information, 2-2: print settings, and 2-3: model information are acquired. "Printing application information" is information about the printing application used in the pre-processing of the printing control processing shown in FIGS. 2 and 3 above. Information about the printing application can be obtained by inquiring the terminal device on which the printing application is installed, or, if the printer 200 stores information about the printing application used for printing, by requesting the current settings in S14 above. When sending a command, you can also inquire about the print application information. “Print settings” are print settings that are being set when the printer 200 speaks. In S14, only information on setting parameters related to the content of the utterance uttered in S2 is requested, but setting information on all setting parameters may be requested. “Model information” is the model name of the printer 200. In S18 above, the printer 200 generates a current setting response that also includes the model name, so this model name may be used. Note that the "print settings" may be all of the print settings being set in the printer 200, or may be some of them. A part may be one. In this case, one print setting closely related to the content of the utterance may be selected.

Furthermore, the log information is classified into log information whose utterance data includes terms related to the settings of the printer 200 and log information which does not include terms related to the settings of the printer 200, and is stored for each type. . If stored in this way, log information can be used for each type, which is convenient. Note that whether or not a term related to the settings of the printer 200 is included can be immediately determined based on 1-4: Extracted Data.

The log information acquired in this manner is used to learn about a wide range of user preferences and requests regarding the printer 200, and to utilize this information in future product development. Conventionally, user operations on the UI screen of a printing application have been stored as an operation log, but the range in which what the user wants to do has been limited. For example, when the setting value of the density parameter is set to the maximum, it is difficult for the user to determine from the operation log whether the setting value is acceptable or whether the user wants to make it darker. On the other hand, if the user's utterances are ``I want it to be darker'' or ``It's still lighter'' and this is collected as log information, it can be seen that the user's Want exceeds the range that can be set by the device. . In this way, from the log information of this embodiment, it is possible to know a wide range of user preferences and requests.

Note that it is conceivable to store information simply obtained by converting voice data into text as the log information, but in that case, it would be difficult to later determine on what basis the user made the utterance. Therefore, in this embodiment, information such as printer settings and utterance information are associated with each other and stored as log information. As a result, the accuracy of understanding what the user wants is greatly improved, and the usefulness as log information is also greatly improved.

Further, as a method of knowing the user's preferences and requests, for example, there is a method of setting up a request column for users on a printer support site, etc., and asking users to freely write in their requests. User preferences and requests obtained using this method may be biased. In other words, only the preferences and requests of users who are willing to write are obtained. On the other hand, from the log information obtained as in this embodiment, it is possible to obtain unbiased preferences and requests from a wide range of users. Therefore, it can be utilized for business expansion, such as providing services that meet the wants of a wide range of users, and for the development of the next product.

As explained above, the application server 400 of this embodiment includes the network IF 480 and the CPU 410. Then, the CPU 410 recognizes the contents of the voice input by the user of the printer 200 pronouncing it from the smart speaker 300 connected via the network IF 480 and inputting and outputting voice (S8). If the content of the voice indicates the user's dissatisfaction with or request for the image formed by the printer 200, the printer 200 determines the setting parameter items and values to be changed based on the recognized voice content ( S12), a command including the determined setting parameter items and values is generated (S36), and the generated command is sent to the printer 200 (S38).

In this manner, the application server 400 of this embodiment allows the user to form an image as intended by the user without directly instructing the setting parameter items and parameter values.

Incidentally, in this embodiment, the application server 400 is an example of an "information processing device." Network IF 480 is an example of a "communications interface." CPU 410 is an example of a "control device." Printer 200 is an example of an "image forming apparatus."

Further, the CPU 410 obtains the current setting value of the determined setting parameter item in the printer 200 from the printer 200 (S20), and based on the obtained current setting value and the content of the recognized voice, the CPU 410 The value of the setting parameter item is determined (S22).

This is convenient because the values of the setting parameters are automatically determined.

Furthermore, before determining the value of the determined setting parameter item, the CPU 410 compares the maximum or minimum value that can be set in the determined setting parameter item with the obtained current setting value, and Audio data that pronounces the range of values that can be added to or subtracted from the set value is transmitted to the smart speaker 300 via the network IF 480 (S28), and in response, the user selects the value to be added to or subtracted from the current set value. If the sound is generated, the value to be added or subtracted from the current setting value is recognized, and the value of the determined setting parameter item is determined to be the value obtained by adding or subtracting the current setting value by the recognized value (S36).

This is convenient because the user can specify the value of the setting parameter simply by pronouncing the value to be added to or subtracted from the current setting value.

Furthermore, when the CPU 410 is unable to obtain the current setting value from the printer 200, it transmits audio data that sounds that the current setting value could not be obtained to the smart speaker 300 via the network IF 480.

This is convenient because the user can hear via voice whether or not the printer 200 can change the setting value.

Further, if the content of the recognized voice is content that instructs the printer 200 to form an image again, the CPU 410 generates a command including a request to execute image formation (S36), and executes the generated command. The information is sent to the printer 200 (S38).

This is convenient because the user can instruct the printer 200 to form an image again simply by giving an instruction by voice.

Further, after transmitting the command, the CPU 410 transmits to the smart speaker 300 via the network IF 480 audio data that indicates that the printer 200 has been instructed to form an image again.

This is convenient because the user can hear by voice that the printer 200 has been instructed to perform the instruction.

Further, the CPU 410 transmits and receives data including commands to and from the printer 200 via the relay 100 that is connected via the network IF 480 and performs P2P communication with the printer 200 .

As a result, even if the printer 200 is not equipped with a network IF, the printer 200 can send and receive data to and from the application server 400 via the repeater 100.

Note that the present invention is not limited to the above embodiments, and various changes can be made without departing from the spirit thereof.

(1) In the above embodiment, the audio analysis processing unit 424a' of the application server 400 executes the process of analyzing audio data. Alternatively, part or all of the process of analyzing audio data may be executed by the smart speaker 300. Furthermore, part or all of the processing for analyzing audio data may be executed by the print-related processing unit 424b'. For example, the speech analysis processing section 424a' may perform only the processing of performing speech recognition processing to generate text data, and the printing-related processing section 424b' may perform the morphological analysis processing of extracting words.

(2) In the above embodiment, the printer 200 is used as the image forming apparatus, but the present invention is not limited to this, and a multifunction device that has a scanning function or a facsimile function in addition to a printing function may be used. In this case, for example, the multifunction device can be caused to print in response to audio input to the smart speaker 300.

(3) Although the application server 400 is a cloud server, it may be a local server connected to the LAN 70 and not connected to the Internet 80. In this case, only the audio data may be transmitted from the smart speaker 300 to the application server 400 without transmitting identification information such as a user ID.

(4) The interface for connecting the repeater 100 and the printer 200 is not limited to the Bluetooth IF 160, but may also be a wired interface such as a USB, or another wireless interface such as NFC (abbreviation for near field communication). It may be.

(5) In the above embodiment, the relay device 100 is configured to relay data sent and received between the application server 400 and the printer 200, but it is also configured to relay data between the application server 400 and the smart speaker 300. You may. In this case, communication using the Bluetooth IF 160 or wireless LAN IF 180 of the smart speaker 300 is performed with the repeater 100. Furthermore, if the printer 200 is equipped with a wireless LAN IF, the application server 400 may communicate directly with the printer 200 without going through the repeater 100, or the application server 400 may communicate with the printer 200 directly through the smart speaker 300. It may also be configured to communicate with the printer 200.

(6) In the above embodiment, a part of the configuration realized by hardware may be replaced with software, or conversely, a part of the configuration realized by software may be replaced by hardware. Good too.

50... Access point, 70... LAN, 80... Internet, 100... Repeater, 110... CPU, 120... Memory, 160, 260, 360... Bluetooth IF, 180, 380... Wireless LAN IF, 200... Printer, 210... Control unit , 250...Printing mechanism, 300...Smart speaker, 310...Control unit, 350...Audio input/output unit, 400...Application server, 410...CPU, 420...Storage unit, 424a...Audio analysis program, 424b...Printing related program, 424b '...Print-related processing unit, 424a'...Audio analysis processing unit, 480...Network IF, 1000...Image forming system.

Claims (7)

a communication interface;
a control device;
Equipped with
The control device includes:
Recognizing the content of the input voice when the user of the image forming apparatus pronounces it from a smart speaker connected via the communication interface that inputs and outputs voice,
When the content of the recognized voice is content indicating the user's dissatisfaction with or request for the image formed by the image forming apparatus,
executing processing for determining setting parameter items to be changed by the image forming apparatus based on the content of the recognized voice;
obtaining the current setting value of the determined setting parameter item in the image forming apparatus from the image forming apparatus;
A maximum value that can be set in the determined configuration parameter item before determining the value of the determined configuration parameter item based on the acquired current configuration value and the content of the recognized voice. or comparing the minimum value with the acquired current setting value, and transmitting audio data to the smart speaker via the communication interface to pronounce a range of values that can be added to or subtracted from the current setting value. ,
When the user pronounces a value to be added to or subtracted from the current setting value in response to the voice data received by the smart speaker being generated as voice;
Recognizing a value to be added to or subtracted from the current set value;
determining a value obtained by adding or subtracting the recognized value to the obtained current value of the determined configuration parameter item;
Generate a command including items and values of the determined configuration parameters,
transmitting the generated command to the image forming apparatus;
Information processing device. The control device includes:
If the current setting value cannot be acquired from the image forming apparatus, transmitting audio data that sounds that the current setting value could not be acquired to the smart speaker via the communication interface;
The information processing device according to claim 1 . The control device includes:
If the content of the recognized voice is content that instructs the image forming apparatus to form an image again,
generating a command including a request to execute the image formation;
transmitting the generated command to the image forming apparatus;
The information processing device according to claim 1 or 2 . The control device includes:
After transmitting the command, transmitting audio data to the smart speaker via the communication interface that indicates that the image forming apparatus is instructed to form an image again;
The information processing device according to claim 3 . The control device includes:
transmitting and receiving data including the command to and from the image forming apparatus via a repeater connected via the communication interface and performing P2P communication with the image forming apparatus;
The information processing device according to any one of claims 1 to 4 . If the text data of the input voice is " Would it be a little darker? ",
The control device includes:
Extracting “a little more”, “deeper” and “ naru? ” from the text data,
Recognize the degree from the extracted “a little more”,
Recognizing the concentration from the extracted “darkness”,
Recognizing that it is inquiring whether it is possible from the extracted " Naru? ",
Based on the content of the recognized voice, an image density item is determined as the item of the setting parameter, and a value that makes the density of the image darker is determined as the value of the setting parameter.
The information processing device according to any one of claims 1 to 5 . A program executable by a computer of an information processing device equipped with a communication interface,
to the computer;
a recognition process that recognizes the content of the voice input by a user of the image forming apparatus pronouncing it from a smart speaker connected via the communication interface that inputs and outputs voice;
When the content of the voice recognized by the recognition process is content indicating the user's dissatisfaction with or request for the image formed by the image forming apparatus,
a process for determining setting parameter items to be changed by the image forming apparatus based on the content of the recognized voice;
a process of acquiring the current setting value of the determined setting parameter item in the image forming apparatus from the image forming apparatus;
A maximum value that can be set in the determined configuration parameter item before determining the value of the determined configuration parameter item based on the acquired current configuration value and the content of the recognized voice. or comparing the minimum value with the acquired current setting value, and transmitting audio data to the smart speaker via the communication interface to pronounce a range of values that can be added to or subtracted from the current setting value. processing and
When the user pronounces a value to be added to or subtracted from the current setting value in response to the voice data received by the smart speaker being generated as voice;
a process of recognizing a value to be added to or subtracted from the current setting value;
a process of determining a value obtained by adding or subtracting the recognized value to the obtained current value of the determined setting parameter item;
a generation process that generates a command including the determined setting parameter items and values;
a transmission process of transmitting the command generated by the generation process to the image forming apparatus;
A program to run.

Images