JP6863792B2 - Terminal devices, product proposal methods, and programs - Google Patents

Description

The present invention relates to a terminal device or the like that makes a call with another terminal device.

Conventionally, when electronic money is sent from the mobile phone terminal A to the mobile phone terminal B via a server, when the mobile phone terminal A and the mobile phone terminal B are in a call, the mobile phone terminal A is the mobile phone terminal B. There was a payment system that could authenticate the user and subsequently transfer electronic money to the mobile phone terminal B (see, for example, Patent Document 1).

JP-A-2009-116628

However, with a conventional terminal device such as a mobile phone terminal in the above payment system, it is not possible to propose a product while making a call with another terminal device.

The terminal device of the first invention is based on a call unit that makes a call with another terminal, which is another terminal device, voice information transmitted from the other terminal, or one or more voice information of the received voice information. It is a terminal device including a product information acquisition unit that acquires product information searched using the acquired product specific information during a call with another terminal, and a product information output unit that outputs the product information.

With such a configuration, it is possible to propose a product while making a call with another terminal.

Further, in the terminal device of the second invention, with respect to the first invention, the product information acquisition unit voice-recognizes one or more voice information and acquires a character string, and a product from the character string. It is a terminal device including a product specific information acquisition means for acquiring the product specific information for specifying the product, and a search means for performing a search using the product specific information and acquiring the product information.

With such a configuration, it is possible to acquire product information and make a proposal while making a call with another terminal.

Further, the terminal device of the third invention is a terminal device for receiving the product information acquired by the other terminal from the other terminal with respect to the first invention.

With such a configuration, it is possible to acquire product information from another terminal and make a proposal while making a call with another terminal.

Further, in the terminal device of the fourth invention, in contrast to the first invention, the product information acquisition unit responds to the voice information transmitting means for transmitting one or more voice information to the server device and the transmission of the voice information. , A terminal device including a product information receiving means for receiving product information from a server device.

With such a configuration, it is possible to acquire product information from a server device and make a proposal while making a call with another terminal.

Further, the terminal device of the fifth invention includes a purchase instruction receiving unit that receives a purchase instruction of a product corresponding to the product information output by the product information output unit for any one of the first to fourth inventions. It is a terminal device further including a purchase processing unit that performs purchase processing for purchasing a product in response to acceptance of a purchase instruction.

With such a configuration, the purchase process of the proposed product can also be performed according to the instruction.

Further, the terminal device of the sixth invention is a terminal device for transmitting purchase information for purchasing a product to another terminal with respect to the fifth invention.

With such a configuration, it is possible to have another terminal perform the purchase process.

Further, the terminal device of the seventh invention is a terminal device in which payment processing for purchasing a product is performed on another terminal that has received purchase information in accordance with the sixth invention.

With such a configuration, it is possible to have another terminal perform payment processing as well. Further, since the payment process by the other terminal is not executed unless the purchase information is transmitted, it is possible to enhance the safety when the child or the like has the other terminal having the payment function.

Further, the terminal device of the eighth invention includes a purchase instruction receiving unit that receives a purchase instruction of a product corresponding to the product information searched from another terminal for any one of the first to seventh inventions. It is a terminal device further including a payment processing unit that performs payment processing for purchasing a product in response to receiving a purchase instruction.

With such a configuration, by performing payment processing according to an instruction from another terminal, it is possible to substitute for product purchase by another terminal that does not have a payment function.

According to the present invention, it is possible to propose a product while talking with another terminal device.

Block diagram of the information system according to the first embodiment Flow chart explaining the operation of the terminal device Flow chart explaining the product information acquisition process Data structure diagram of the product information Diagram showing an output example of the purchase screen Diagram showing other output examples of the purchase screen Block diagram of the information system according to the second embodiment Flow chart explaining the product information acquisition process Block diagram of the information system according to the third embodiment External view of the computer system Diagram showing an example of the internal configuration of the computer system

Hereinafter, three embodiments of the information system including the terminal device and the like will be described with reference to the drawings. In addition, since the components with the same reference numerals perform the same operation in each embodiment, the description may be omitted again.

In any of the embodiments, information that searches for product information to be proposed based on the call voice while the terminal device and another terminal, which is another terminal device, is in a call, and outputs one or more product information. The system will be described. However, the difference is that in the first embodiment, the search is performed by the terminal device, in the second embodiment, the search is performed by another terminal, and in the third embodiment, the search is performed by the server device.

(Embodiment 1)
FIG. 1 is a block diagram of the information system 100 according to the present embodiment. The information system 100 includes one or more terminal devices 1 and one or more other terminals 2.

In general, the other terminal is another terminal device. On the other hand, the terminal device may be called a own terminal. Further, for example, the terminal device may be a terminal device used by the parent, and the other terminal may be a terminal device used by the child. Further, the other terminal may have a configuration different from that of the terminal device, or may have the same configuration as the terminal device.

One or more terminal devices 1 and one or more other terminals 2 (hereinafter, may be simply referred to as terminal devices 1 and other terminals 2) are, for example, networks such as LAN and the Internet, wireless or wired. It is connected so that it can communicate via a communication line or the like.

Various server devices (not shown) are connected to the network or the like, and such server devices may, for example, perform communication control between terminals, information provision to the terminal device 1 and the like. Communication also usually includes a call. Further, it is preferable that the communication includes, for example, short-range wireless communication by Bluetooth (registered trademark), NFC, or the like, communication via a connection cable, a connector, or the like. However, these are merely examples, and various communications may be possible between the terminals. In addition, such matters are also common to each subsequent embodiment.

The terminal device 1 includes a storage unit 11, a processing unit 12, an output unit 13, a reception unit 14, a reception unit 15, and a transmission unit 16. The processing unit 12 includes a call unit 121, a product information acquisition unit 122, a purchase processing unit 123, and a payment processing unit 124. The product information acquisition unit 122 includes a voice recognition unit 1221, a product identification information acquisition unit 1222, and a search unit 1223. The output unit 13 includes a product information output unit 131. The reception unit 14 includes a purchase instruction reception unit 141. The receiving unit 15 includes a purchase instruction receiving unit 151.

The other terminal 2 includes another storage unit 21, another processing unit 22, another output unit 23, another reception unit 24, another reception unit 25, and another transmission unit 26.

The storage unit 11 constituting the terminal device 1 can store various types of information. The various types of information include, for example, the own terminal identifier, one or more other terminal identifiers, and one or more product information.

The own terminal identifier is information that identifies the terminal device 1. The own terminal identifier may be, for example, an address such as a MAC address or an IP address, a telephone number, or a user identifier that identifies a user of the terminal device 1. The user identifier is, for example, an e-mail address or an ID, but the type does not matter. As described above, the own terminal identifier may be any information as long as it can identify the terminal device 1 or its user.

The one or more other terminal identifiers are information that identifies one or more other terminals 2 corresponding to the terminal device 1. The corresponding other terminal 2 is a terminal used by another user who talks with the user of the terminal device 1. The other user is, for example, the user's family, friends, colleagues, etc., but can be anyone who can talk to the user. In the following, the corresponding other terminal 2 may be simply referred to as another terminal 2. Further, as a specific example, when the user is a parent and the corresponding other user is a child of the parent, the terminal device 1 of the parent may be referred to as a parent terminal, and the other terminal 2 of the child may be referred to as a child terminal. is there.

The other terminal identifier may also be an address, a telephone number, or a user identifier. In the following, the local terminal identifier and the other terminal identifier may be collectively referred to simply as the terminal identifier. It is preferable that one or more other terminal identifiers stored in the storage unit 11 are, for example, a pair of an address and a telephone number.

Product information refers to information about a product. Product information is usually information about a product that can be proposed. The product information may include, for example, one or more types of information among a product identifier, a type identifier, price information, and price range information.

The product identifier is information that identifies the product. The product identifier includes, for example, a product name, a manufacturer name, a product number, an ID, or the like, but any information that can identify the product may be used. The product name may be, for example, a general name such as "12 colors of paint", "24 color set of watercolor paint", "painting set", a unique name including a registered trademark, or a combination of the general name and the unique name. But it doesn't matter. The type identifier is information that identifies the type of product. The type identifier includes, for example, a type name and an ID, but any information that can identify the type of the product may be used. The type name may be, for example, "paint", "12 colors", "paintbrush", "painting set", or the like.

Price information is information about the price of a product. The price is, for example, the main unit price, but may be a price including the main unit price and one or more types of tax or shipping fee, or a set of the main unit price and one or more types of tax amount or shipping fee. It doesn't matter. Further, the price information is usually information indicating the price per unit quantity. The unit quantity is, for example, one piece, one box, one dozen, one liter, one time, one hour, one day, etc., but the type is not limited. The price information may include information indicating a unit quantity such as 100 yen / piece and 1000 yen per box, or simply does not include information indicating a unit quantity such as 100 yen and 1000 yen. It may be expressed in any form.

The band price range information is information indicating the price range of a product. The price range information includes, for example, a lower limit price, an upper limit price, a pair of a lower limit price and an upper limit price, an ID, and the like, but any information that can identify the price range of the product may be used.

The product identifier, type identifier, price information, and price range information may include information that overlaps with each other. Further, the product information may include, for example, a description of the product, an advertisement, and the like, and the data structure and contents thereof are not limited.

Note that one or more product information is usually stored in a server device (not shown). The server device is, for example, a product DB server, an EC server, or the like, but the type is not limited. However, one or more product information may be stored in the storage unit 11. In the present embodiment, for example, it is preferable that the receiving unit 15 described later receives one or more product information from the server device and stores it in the storage unit 11. The storage by the storage unit 11 may be a temporary memory.

Alternatively, one or more product information may be stored in, for example, another storage unit 21 constituting the other terminal 2, or may be stored in any recording medium that can be accessed by a computer. In addition, one or more product information stored in the recording medium that realizes the storage unit 11 and the like may be referred to as a product information group below.

The processing unit 12 performs various processes. The various processes include, for example, the call unit 121, the product information acquisition unit 122, the voice recognition unit 1221, the product specific information acquisition unit 1222, the search unit 1223, the purchase processing unit 123, the payment processing unit 124, and the like described below. It is a process.

The call unit 121 makes a call with the other terminal 2. The call is a process including one or more types of reception of voice information transmitted from another terminal 2 or transmission of voice information received via the microphone of the terminal device 1. The call is, for example, a call by a mobile phone, a landline phone, an IP phone, Skype (registered trademark), or the like, but the type is not limited.

The calling unit 121 normally makes a call with another terminal 2 identified by the other terminal identifier stored in the storage unit 11, but may talk with other terminals 2 regardless of the other party. .. When making a call with another terminal 2 other than the other terminal 2 identified by the stored other terminal identifier, the call unit 121 receives the call from, for example, the other terminal 2 or an external server at the start of the call. It is preferable to acquire the other terminal identifier of the other terminal 2.

The product information acquisition unit 122 acquires product information. The product information may be acquired by acquiring one product information or by acquiring two or more product information. The product information acquisition unit 122 acquires from one or more voice information (hereinafter, may be simply referred to as voice information) of the transmitted voice information or the received voice information during a call with the other terminal 2. Acquire the product information searched by using the product specific information obtained.

The transmitted voice information is usually voice information transmitted from another terminal 2 (hereinafter, may be simply referred to as another terminal 2) which is a call partner of the call unit 121, and is information on the utterance voice of another user. Is. The received voice information is usually voice information received via the microphone of the terminal device 1, and is information on the voice spoken by the user.

Product-specific information is information that identifies a product. The product identification information is usually information that identifies the product to be proposed. The product identification information is, for example, a product name, a type, a price, or the like, but any information that can identify the product may be used. It is preferable that the product specific information is acquired by, for example, voice recognition, morphological analysis, or the like, and it is more preferable that the product identification information is acquired by using machine learning, deep learning, or the like. Speech recognition, morphological analysis, machine learning, and deep learning are all known and the description thereof will be omitted. Voice recognition and the like may be performed by the terminal device 1, the other terminal 2, or a server device (not shown), or may be shared by any two or three of them.

The product information acquisition unit 122 acquires the product information searched by using the product identification information acquired in this way. The search is to identify the product information to be proposed from the product information group. The product information to be proposed may be one product information or two or more product information. The search may be, for example, specifying the product information to be proposed from the product information group stored in the storage unit 11 or the like by using the acquired product identification information. The search may also be performed on any of the terminal device 1, the other terminal 2, or the server device, and the search site may be used.

The product information acquisition unit 122 usually requests a search from the server device and acquires the product information. The request may be, for example, transmitting voice information to the server device. However, the product information acquisition unit 122 may receive, for example, the information searched by the server device in response to the request of the other terminal 2 from the other terminal 2. Alternatively, for example, when the server device also has a call control function, the product information acquisition unit 122 does not particularly request a search, and the server device searches for the product information using the voice information of the call on the server device. You may receive from. Alternatively, when the other terminal 2 has a search function, the information searched by the other terminal 2 may be received from the other terminal 2. Alternatively, the product information acquisition unit 122 itself may acquire the product information by performing a search. However, in the present embodiment, the case where the product information is acquired mainly by the product information acquisition unit 122 itself performing the search will be described.

The voice recognition means 1221 is a means for performing voice recognition. The voice recognition means 1221 recognizes voice information by voice and acquires a character string. That is, the voice recognition means 1221 voice-recognizes one or more voice information among the transmitted voice information or the received voice information, and acquires a character string which is the recognition result.

The voice recognition means 1221 recognizes one or more voice information among the voice information transmitted from the other terminal 2 which is the other party of the call unit 121 or the voice information received via the microphone of the terminal device 1. And get the character string corresponding to the call content. The call content is the content of a call between the call unit 121 and the other terminal 2. The content of the call usually includes one or more types of utterances of the user's utterance or another user's utterance. The character string corresponding to the content of the call is a character string indicating one or more kinds of utterances. The character string is usually represented by text data, but the representation format does not matter.

The product specific information acquisition unit 1222 is a means for acquiring product specific information. The product identification information acquisition unit 1222 acquires the product identification information from the character string acquired by the voice recognition unit 1221. A technique for acquiring product specific information from a character string is known. It is preferable that the product identification information acquisition unit 1222 acquires one or more nouns by, for example, performing a morphological analysis using the acquired character string. A technique for acquiring one or more nouns by morphological analysis is known, and the description thereof will be omitted. Further, it is more preferable that the product specific information acquisition means 1222 classifies the acquired one or more nouns into one or more classes such as product name, type, and price by machine learning or deep learning, for example. .. The technique of classifying nouns by machine learning or the like is well known, and the description thereof will be omitted.

In this way, the product identification information acquisition means 1222 is information for specifying the product information to be proposed, and for example, the product identification information including one or more types of information such as a product name, a type, and a price can be acquired.

The search means 1223 is a means for performing a search. The search means 1223 searches using the product specific information and acquires the product information. The search means 1223 usually identifies the product information to be proposed by searching the stored product information group using the product identification information acquired by the product identification information acquisition unit 1222 as a key, and identifies the specified product. Get information.

The search using the product specific information may be, for example, to acquire the product information including the product identifier corresponding to the product name possessed by the product specific information. Correspondence may be a match, similar enough to be considered a match, or a similarity greater than or greater than a threshold. The similarity may be calculated as, for example, the ratio of the number of consecutive characters matching the product name to the total number of characters constituting the product identifier. Alternatively, the similarity may be calculated by, for example, an increasing function having the number of consecutive characters matching the product name as a parameter, or a decreasing function using the number of characters not matching the product name as a parameter. The calculation method of is not limited. It should be noted that such a matter also applies to, for example, the correspondence between the type included in the product specific information and the type identifier included in the product information.

Alternatively, the search using the product specific information may be, for example, to acquire the product information including the type identifier corresponding to the type of the product specific information.

Alternatively, the search using the product specific information may be, for example, to acquire the product information including the price information corresponding to the price of the product specific information. Correspondence may be, for example, a match in price, close enough to be considered a match, or closest. Alternatively, the correspondence may be, for example, that the order when the prices are arranged in the order of closeness is within the predetermined order, or the order when the prices are arranged in the order of distant is lower than the predetermined order. I do not care.

Alternatively, the search using the product specific information may be, for example, to acquire the product information including the price range information to which the price of the product specific information belongs. Alternatively, the search using the product specific information means, for example, acquiring the product information including the type identifier corresponding to the type of the product specific information and the price range information to which the price of the product specific information belongs. It may be that.

That is, the search means 1223 calculates, for example, the degree of similarity between the product name included in the acquired product identification information and the product identifier included in the product information for each of one or more stored product information, and the product. You may acquire the product information including the product identifier having the highest degree of similarity to the name. Alternatively, the search means 1223 calculates one or more similarities with respect to the product name in the same manner as described above, and then, in order from the one with the highest similarity, a predetermined number (for example, 3, 10, etc.). Product information may be acquired.

Further, the search means 1223 calculates, for example, the degree of similarity between the type included in the acquired product identification information and the type identifier included in the product information for each of one or more stored product information, and the product name. You may acquire the product information including the type identifier having the highest degree of similarity with. Alternatively, the search means 1223 may acquire a predetermined number of product information in order from the one having the highest degree of similarity after calculating one or more degree of similarity regarding the type in the same manner as described above.

Further, the search means 1223 calculates, for example, the difference between the price included in the acquired product specific information and the price information included in the product information for each of the stored product information and the price. You may acquire the product information including the price information having the smallest difference. Alternatively, the search means 1223 may acquire a predetermined number of product information in order from the one with the smallest difference after calculating the difference of 1 or more in the same manner as described above.

Further, the search means 1223 compares, for example, the price included in the acquired product specific information and the price range information included in the product information for each of one or more stored product information, and the price to which the price belongs. You may acquire one or more product information including band information.

Further, the search means 1223 obtains one or more product information in this way, and then, in response to the acquisition of new product specific information by the product identification information acquisition means 1222, the search means 1223 refers to the acquired one or more product information. You may narrow down by the new product specific information. The narrowing down may be to select one or more product information corresponding to the new product specific information from the acquired one or more product information, or exclude one or more product information corresponding to the new product specific information. It may be to do.

As described above, it is preferable that the search means 1223 uses the voice information of a series of calls to perform narrowing down fully automatically without requiring an intentional operation by the user. However, for example, the user may manually input information such as a keyword with a keyboard or the like, the reception unit 14 accepts the input, and the search means 1223 may narrow down by using the accepted keyword. Alternatively, for example, the user inputs a keyword or the like by voice with a microphone, the reception unit 14 receives the voice information, and the voice recognition means 1221 performs voice recognition on the received voice information to acquire the keyword or the like. However, the search means 1223 may narrow down by the acquired keywords or the like, and the method for narrowing down is not limited.

As described above, in the present embodiment, the product information acquisition unit 122 includes the voice recognition means 1221, the product specific information acquisition means 1222, and the search means 1223, so that the product information to be proposed can be obtained by the terminal device 1. You can get it yourself.

However, the voice recognition means 1221, the product identification information acquisition means 1222, and the search means 1223 may be provided by, for example, another processing unit 22 constituting the other terminal 2, or a processing unit of a server device (not shown). You may have it. The former configuration will be described in the second embodiment, and the latter configuration will be described in the third embodiment. Alternatively, these three means may be distributed and provided in two or more types of the terminal device 1, the other terminal 2, or the server device.

The purchase processing unit 123 performs purchase processing. The purchase process refers to a process related to the purchase of a product. The purchase process is usually a process for purchasing the proposed product. The proposed product is, for example, product information acquired by the product information acquisition unit 122, and is a product corresponding to the product information output by the product information output unit 131, which will be described later.

The purchase process may be, for example, a payment process, or may be transmission of purchase information to another terminal 2 or a server device (not shown). Settlement processing refers to processing for settlement. The payment is, for example, payment by credit card, payment by electronic money, use of points, etc., but any method can be used as long as it is electronic payment. The process for settlement may or may not include the settlement itself. The settlement itself may be performed by, for example, the terminal device 1, another terminal 2, or a server device (not shown). The process for settlement may also include, for example, the transmission of purchase information to the device on which the settlement is performed. In this way, the content of the settlement process and the executing entity do not matter.

Purchase information is information for purchasing a product. The purchase information includes, for example, a product identifier, quantity information, price information, and the like. Information indicating the quantity of products to be purchased. The quantity information may be, for example, a numerical value such as "1" or "2", or may be a set of a numerical value and a unit. The set of numerical values and units may be "1 sheet", "2 boxes", or the like, and the combination thereof does not matter. In this way, the data structure of purchase information does not matter.

The payment process may be performed, for example, by another terminal 2 or a server device that has received such purchase information from the terminal device 1.

The purchase processing unit 123 normally performs purchase processing in response to the acceptance of a purchase instruction. The purchase instruction means an instruction regarding the purchase of a product. The purchase instruction is usually an instruction for purchasing the proposed product, and is received by the purchase instruction reception unit 141, which will be described later.

For example, the purchase processing unit 123 may perform payment processing by itself in response to the purchase instruction receiving unit 141 receiving the purchase instruction of the product corresponding to the product information output by the product information output unit 131 described later. Alternatively, the purchase information may be transmitted to another terminal 2 or a server device (not shown).

The settlement processing unit 124 performs settlement processing. The payment processing unit 124 normally performs payment processing in response to the reception of the purchase instruction by the purchase instruction receiving unit 151, which will be described later. It is preferable that the payment processing unit 124 performs payment processing corresponding to the purchase information received by the purchase instruction receiving unit 151 in response to the reception of the purchase instruction by the purchase instruction receiving unit 151, for example. ..

The output unit 13 outputs various information. The various types of information include, for example, product information. The output unit 13 normally outputs various types of information via an output device such as a display or a speaker, but for example, it may be printed out by a printer, stored in a recording medium, or transmitted to an external device. It may be handed over to another processing device or another program, and the mode of output does not matter. The output via an output device such as a display is usually the output of the terminal device 1, but may be, for example, an output via an external display or the like.

The product information output unit 131 outputs one or more product information. In the present embodiment, the product information output unit 131 normally outputs the product information acquired by the product information acquisition unit 122. However, the product information output unit 131 may output the product information searched by the search means 1223, for example, or the product information acquisition unit 122 outputs the product information received from another terminal 2 or a server device (not shown). It doesn't matter. The former is a normal operation in the second embodiment, and the latter is a normal operation in the third embodiment.

The product information output unit 131 normally outputs the product information on one or more of the terminal device 1 or the other terminal 2 of the other party. The output is usually an output via an output device such as a display or a speaker, but may be transmitted to another terminal 2, for example.

The output purchase information does not have to be the same as the acquired or received purchase information. For example, the product information output unit 131 holds the screen configuration information, and it is preferable to output the purchase screen by using the acquired or received purchase information and the screen configuration information.

The purchase screen is a screen for purchasing a product corresponding to the product information. The purchase screen has purchase information. Further, it is preferable that the purchase screen also has, for example, a "purchase" button, a "cancel" button, and the like. It is more preferable that the purchase screen also has, for example, a dialog box for selecting a payment method. However, the configuration of the purchase permission screen does not matter.

The screen configuration information includes, for example, an image, a character string, layout information, and the like. The image is, for example, an image of various buttons, dialog boxes, and the like. The character string is, for example, a character string corresponding to a button or the like. The layout information is information indicating the arrangement of purchase information, buttons, and the like on the purchase screen. However, the data structure of the screen configuration information does not matter.

The reception unit 14 receives various types of information. The various types of information include, for example, purchase instructions. Acceptance means accepting information input by input devices such as keyboards, touch panels, and microphones, receiving information transmitted via networks, and accepting information read from recording media such as disks and semiconductor memories. Is a concept that includes.

The purchase instruction reception unit 141 receives the purchase instruction. The purchase instruction receiving unit 141 normally receives a purchase instruction for a product corresponding to the product information output by the product information output unit 131.

The purchase instruction receiving unit 141 may receive the purchase instruction from, for example, the input device of the terminal device 1 or may be received from another terminal 2. Accepting the purchase instruction may be, for example, accepting the selection of the purchase button via the input device.

The receiving unit 15 receives various types of information. The various types of information include, for example, purchase instructions.

The purchase instruction receiving unit 151 receives the purchase instruction. The purchase instruction receiving unit 151 normally receives a purchase instruction of a product corresponding to the searched product information from the other terminal 2 during a call with the other terminal 2.

The transmission unit 16 transmits various types of information. The various types of information may include, for example, purchase information.

The other storage unit 21 constituting the other terminal 2 can store various types of information. The various types of information include, for example, a terminal identifier that identifies the other terminal 2, a terminal identifier that identifies the terminal device 1 corresponding to the other terminal 2, and the like. Further, for example, one or more product information may be stored in the other storage unit 21.

The other processing unit 22 performs various processes. The various processes include, for example, a telephone call. Specifically, the other processing unit 22 receives, for example, the voice information transmitted from the terminal device 1, transmits the voice information received via the microphone of the other terminal 2, and the like to the terminal device 1. The voice information transmitted from the terminal device 1 is the information of the utterance voice of the user, and the received voice information is the information of the utterance voice of another user. It should be noted that the various processes include, for example, various discriminations described in the flowchart. Further, the various processes may include, for example, one or more types of processes of purchase or settlement.

Further, the other processing unit 22 may include, for example, voice recognition means 1221, product identification information acquisition means 1222, and search means 1223. Further, it is preferable that the other processing unit 22 has the same function as the processing unit 11 of the terminal device 1.

The other output unit 23 outputs various information. The various types of information include, for example, voice information. The other output unit 23 outputs, for example, the voice information received from the terminal device 1 by the other processing unit 22 via the speaker. Further, the other output unit 23 may output, for example, the product information received by the other reception unit 25, which will be described later, via the display or the speaker.

The other reception unit 24 can receive various types of information. The various types of information include, for example, purchase instructions. The other reception unit 24 may, for example, receive a purchase instruction of a product corresponding to the product information output by the other output unit 23 via an input device such as a touch panel.

The other receiving unit 25 can receive various types of information. The various types of information include, for example, purchase information. The other receiving unit 25 may receive purchase information from the terminal device 1, for example. It is preferable that the other receiving unit 25 receives purchase information from the terminal device 1, for example, in pairs with the terminal identifier that identifies the terminal device 1.

The other transmission unit 26 can transmit various types of information. The various information may be, for example, a purchase instruction. The other transmission unit 26 may, for example, transmit the purchase instruction received by the other reception unit 24 to the terminal device 1 which is the other party of the other processing unit 22. Alternatively, the other transmission unit 26 is, for example, purchase information received by the other reception unit 25 in pairs with the terminal identifier that identifies the terminal device 1 from the terminal device 1, with respect to the purchase information output by the other output unit 23. Then, the purchase instruction received by the other reception unit 24 may be transmitted to the terminal device 1 identified by the received terminal identifier.

The above configuration is an example, and the other terminal 2 may have the same configuration as the terminal device 1. This also applies to other embodiments.

The storage unit 11 and the other storage unit 21 are preferably non-volatile recording media such as a hard disk or flash memory, but can also be realized by a volatile recording medium such as RAM.

The process in which the information is stored in the storage unit 11 or the like does not matter. For example, information may be stored in the storage unit 11 or the like via a recording medium, or information transmitted via a network, a communication line, or the like may be stored in the storage unit 11 or the like. Well, or the information input via the input device may be stored in the storage unit 11 or the like. The input device may be, for example, a keyboard, a mouse, a touch panel, a microphone, or the like. It should be noted that such a matter also applies to the server storage unit 31 described later.

The processing unit 12, the calling unit 121, the product information acquisition unit 122, the voice recognition means 1221, the product specific information acquisition unit 1222, the search means 1223, the purchase processing unit 123, the payment processing unit 124, and the other processing unit 22 are usually MPUs. It can be realized from or memory. The processing procedure of the processing unit 12 and the like is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, the processing procedure may be realized by hardware (dedicated circuit). It should be noted that such a matter also applies to the processing unit 12a, the other processing unit 22a, the processing unit 12b, the other processing unit 22, and the server processing unit 33, which will be described later.

The output unit 13, the product information output unit 131, and the other output unit 23 may or may not include an output device such as a display or a speaker. The output unit 13 and the like can be realized by the driver software of the output device, or by the output device and its driver software.

The reception unit 14, the purchase instruction reception unit 141, and the other reception unit 24 may or may not include the input device. The reception unit 14 and the like can be realized by the driver software of the input device or by the input device and its driver software.

The receiving unit 15, the purchase instruction receiving unit 151, and the other receiving unit 25 are usually realized by a wired or wireless communication means (for example, a communication module such as a network card or a modem), but the means for receiving the broadcast (for example, for example). , Broadcast reception module). It should be noted that such a matter also applies to the server receiving unit 32 described later.

The transmission unit 16 and the other transmission unit 26 are usually realized by a wired or wireless communication means, but may be realized by a broadcasting means (for example, a broadcasting module). It should be noted that such a matter also applies to the other transmission unit 26a and the server transmission unit 34, which will be described later.

Next, the operation of the information system 100 will be described with reference to the flowcharts of FIGS. 2 and 3. The explanations regarding the above-mentioned matters are omitted or simplified.

FIG. 2 is a flowchart illustrating the operation of the terminal device 1.

(Step S201) The processing unit 12 determines whether or not a call with another terminal 2 has been started by using, for example, information from a communication module that realizes the call unit 121. Note that the communication module may output, for example, a start flag indicating the start of a call according to the start of a call with the other terminal 2, and together with such a start flag, identifies the other terminal 2. It is preferable to output the terminal identifier as well. If the call with the other terminal 2 is started, the process proceeds to step S202, and if the call with the other terminal 2 is not started, the process returns to step S201.

(Step S202) The product information acquisition unit 122 executes a product information acquisition process, which is a process of acquiring product information using voice information of a call made between the terminal device 1 and another terminal. The product information acquisition process will be described with reference to the flowchart of FIG.

(Step S203) The processing unit 12 determines whether or not the product information can be acquired as a result of executing the product information acquisition process. If the product information can be acquired, the process proceeds to step S204, and if the product information cannot be acquired, the process proceeds to step S208.

(Step S204) The product information output unit 131 outputs the product information acquired by the product information acquisition unit 122 via an output device such as a display or a speaker.

(Step S205) The processing unit 12 determines whether or not there is a purchase instruction. The processing unit 12 receives a purchase instruction, for example, when the purchase instruction reception unit 141 receives the purchase instruction via an input device such as a touch panel, or when the purchase instruction reception unit 141 receives the purchase instruction from the other terminal 2. It is determined that there was. If there is a purchase instruction, the process proceeds to step S206, and if there is no purchase instruction, the process proceeds to step S207.

(Step S206) The purchase processing unit 123 performs a purchase process, which is a process of purchasing a product corresponding to the output product information. The purchase process will not be repeated as described above. Then, the process proceeds to step S208.

(Step S207) The processing unit 12 determines whether or not to cancel the purchase of the product corresponding to the output product information. The processing unit 12 determines that the purchase is canceled when a cancel operation such as pressing the "cancel" button is accepted. Alternatively, for example, the processing unit 12 measures the elapsed time from outputting the product information with the built-in clock of the MPU or the like, and makes a purchase when the purchase instruction is not accepted even if the elapsed time exceeds the predetermined time. You may decide to cancel. When canceling the purchase of the product corresponding to the output product information, the process returns to step S201, and when not canceling, the process returns to step S202.

(Step S208) The processing unit 12 determines whether or not the call with the other terminal 2 has been terminated, for example, by using information from the communication module. The communication module may output, for example, an end flag indicating the end of the call, depending on the end of the call with the other terminal 2. If the call with the other terminal 2 is terminated, the process returns to step S201, and if the call with the other terminal 2 is not terminated, the process returns to step S202.

In the flowchart of FIG. 2, the process starts when the power of the terminal device 1 is turned on or the program is started, and the process ends when the power is turned off or an interrupt for the end of the process occurs. However, the trigger for the start or end of processing does not matter.

Further, although not shown, normally, the call control process by the call unit 121 is performed in parallel with the process of the flowchart of FIG. Specifically, the call unit 121 determines whether or not to start a call based on, for example, a call operation to the other terminal 2 or the presence or absence of an incoming call signal from the other terminal 2, and when the call is started, the call unit 121 determines whether or not to start the call. Start processing a call with another terminal 2. Further, the call unit 121 determines whether or not to end the call based on, for example, the end-of-call operation for ending the call with the other terminal 2 or the presence or absence of the end-of-call signal from the other terminal 2, and makes a call. When terminating, the call processing is terminated.

FIG. 3 is a flowchart illustrating the product information acquisition process in step S202.

(Step S301) The voice recognition means 1221 stores the voice information of the call made by the call unit 121 to the other terminal 2 in, for example, the internal memory of the MPU. As described above, the voice information includes one or more types of the transmitted voice information and the received voice information.

(Step S302) The voice recognition means 1221 performs voice recognition on the voice information stored in the internal memory, and acquires a character string indicating the content of the call.

(Step S303) The product identification information acquisition unit 1222 performs morphological analysis or the like using the character string that is the recognition result, and acquires the product identification information.

(Step S304) The search means 1223 searches one or more product information stored in the storage unit 11 or the like using the acquired product identification information, and acquires the product information specified by the product identification information. .. However, for example, depending on the success or failure of voice recognition, morphological analysis, etc., the content of the call, etc., the search means 1223 may not be able to acquire the product information. After that, it returns to the upper processing.

In the flowcharts of FIGS. 2 and 3, one or more product information corresponding to the current call content is output by repeating the processes of steps S202 to 207 during the call. In other words, as the call progresses, one or more product information displayed on the display is updated. Updates also include narrowing down. For example, by searching using the product identification information acquired from the voice information up to a certain point in time, one or more product information is acquired and displayed, and new product identification information is obtained from the voice information after that point in time. When acquired, the one or more product information may be narrowed down using the new product specific information, and some product information may be deleted.

Hereinafter, a specific operation example of the information system 100 according to the present embodiment will be described. The following description can be changed in various ways and does not limit the present invention in any way. In addition, the explanations regarding the above-mentioned matters are omitted or simplified.

In this example, of one or more terminal devices 1 and one or more other terminals 2 constituting the information system 100, one terminal device 1 (hereinafter, terminal device 1) is an IP telephone installed at the home of user X. It is a PC with the ability. Further, one other terminal 2 (hereinafter referred to as another terminal 2) is a mobile terminal carried by a user Y who is a child of the user X.

For example, five or more product information as shown in FIG. 4 is stored in the storage unit 11 of the terminal device 1. It goes without saying that the product information group may be stored in, for example, a server storage unit of a server device (not shown), another storage unit 21 of another terminal 2, or the like, regardless of its location. However, it is preferable that the product information group is stored in the server storage unit, for example, in that a more diverse product information group can be proposed.

The product information group in this example is, for example, a part of various product information stored in the server storage unit, and may be received by the receiving unit 15 from the server device and stored in the storage unit 11. .. At that time, the receiving unit 15 holds one or more types of information of the reception history or the user attribute, selects the product information group corresponding to the information from the product information group of the server storage unit, and selects the selected product. It is preferable to receive the information group from the server device. The reception history is information related to one or more product information received in the past. The reception history may be, for example, a set of a set of a product identifier or a type identifier and a number of receptions or a reception frequency. The user attribute is information indicating the attribute of the user. Attributes may include, for example, one or more of age, gender, school or occupation. In this example, the user attribute is "elementary school student", and as a result of receiving the product information group such as paint corresponding to this from the server device, five or more product information as shown in FIG. 4 is stored in the storage unit 11. Has been done.

FIG. 4 is a data structure diagram of product information. The product information includes, for example, a product identifier, a type identifier, price information, price range information, and the like.

Each product information of 5 or more corresponds to an ID (for example, 1, 2, ...). For example, the product information corresponding to the ID "1" (hereinafter, may be referred to as product information 1) includes the product identifier "paint 12 colors, company A", the type identifier "paint, 12 colors", and the price information "600". It has "yen" and price range information "500 yen or more and 1000 yen or less". Similarly, the product information (product information 2) corresponding to the ID "2" includes the product identifier "paint 24 colors, company A", the type identifier "paint, 24 colors", the price information "1200 yen", and the price range. It has information such as "more than 1000 yen and less than 1500 yen".

Further, the product information 3 has a product identifier "watercolor paint 24 color set, company B", a type identifier "paint, 24 colors", price information "900 yen", price range information "1000 yen or less", and the like. Further, the price information 4 has a product identifier "painting set, company B", a type identifier "painting set, paint, paintbrush, palette", price information "2500 yen", price range information "over 2000 yen", and the like. Further, the price information 5 has a product identifier "pallet, company A", a type identifier "pallet", price information "300 yen", price range information "less than 500 yen", and the like.

Now, user Y is about to return home from school. It is assumed that the user wants to purchase paint at a stationery store on his way home, so he wants to consult with his parents, and makes a phone call to his home using another terminal 2. At home, it is assumed that a ringtone is output from the speaker of the terminal device 1 and the user X answers the telephone.

For example, user Y says, "I have run out of paint and want to buy it." In response, user X asks, for example, "What is the price?", And user Y answers, "A set of 12 colors is about 1000 yen."

When the call unit 121 starts a call with another terminal 2 in the terminal device 1, the communication module outputs a start flag indicating the start of the call together with the terminal identifier that identifies the other terminal 2 that is the source. In response to this, the product information acquisition unit 122 starts the product information acquisition process.

Specifically, the voice recognition means 1221 recognizes the voice information stored in the internal memory while accumulating the voice information of the above-mentioned call between the call unit 121 and the other terminal 2 in the internal memory. And get the character string "I'm out of paint, so I want to buy it. What is the price? About 1000 yen for 12 colors" that indicates the content of the call.

Next, the product specific information acquisition means 1222 performs morphological analysis using the acquired character string, and one or more nouns (hereinafter, may be referred to as a noun group) "paint", "price", "12 colors". "," Set ", and" 1000 yen "are acquired. Further, the product specific information acquisition means 1222 classifies the acquired noun group into one or more classes (hereinafter, class group) such as product name, type, and price by using, for example, machine learning or deep learning. Acquires product specific information including the product name "Null", the type "paint", the type "12 colors", and the price "1000 yen".

Next, the search means 1223 searches the product information group stored in the storage unit 11 using the acquired product identification information, and acquires the product information specified by the product identification information.

Specifically, the search means 1223 stores, for example, five or more products in which the similarity between the two types "paint" and "12 colors" included in the product specific information and the type identifier included in the product information is stored. The product information including the type identifier having the highest degree of similarity with the type may be acquired by calculating for each information.

In the case of the product information group of FIG. 4, the similarity between the two types "paint" and "12 colors" is 100% for the product information 1 because 2 consecutive characters and 3 consecutive characters match in all 5 characters. As for the product information 2, since two consecutive characters match in all five characters, it may be calculated as 40%. Similarly, the similarity may be calculated as 40% for the product information 3, 15% for the product information 4, and 0% for the product information 5.

The search means 1223 may select and acquire the product information 1 corresponding to the highest similarity 100% among the five similarity calculated as described above, or the search means 1223 may select and acquire the product information 1 in descending order of similarity. For example, three product information 1 to 3 may be selected and acquired.

Alternatively, the search means 1223 calculates, for example, the difference between the price "1000 yen" included in the acquired product identification information and the price information included in the product information for each of one or more stored product information. , The product information 3 including the price information "900 yen" having the smallest difference from the price may be selected and acquired. Alternatively, the search means 1223 may select and acquire, for example, three product information 3, 1 and 2 in ascending order of difference.

Alternatively, the search means 1223 compares, for example, the price "1000 yen" included in the acquired product specific information with the price range information included in the product information for each of one or more stored product information. Two product information 1 and 3 including the price range information to which the price "1000 yen" belongs may be selected and acquired.

Alternatively, the search means 1223 selects product information by, for example, two or more types of a method using a type, a method using a price, or a method using a price range as described above, and the selected product information. It is preferable to acquire one or more product information excluding duplicate product information from the group. For example, the search means 1223 selects product information 1 by a method using a type, selects product information 3 by a method using a price, and selects product information 1 and 3 by a method using a price range. Further, it is preferable that the search means 1223 acquires two product information 1 and 3 excluding the duplicate product information 1 and 3 among the four product information 1, 3, 1 and 3 selected in this way.

The product information acquisition process when the user Y says "I want to buy 12 colors of paints of company A" is as follows, for example.

The voice recognition means 1221 performs voice recognition on the voice information of the call including the above utterance, and acquires the character string "I want to buy 12 colors of the paint of company A". Next, the product specific information acquisition means 1222 performs morphological analysis using such a character string, acquires noun groups "Company A", "paint", and "12 colors", and classifies the acquired noun group into class groups. Then, the product identification information including the product name "12 colors of paint, company A" and the two types "paint" and "12 colors" is acquired. Next, the search means 1223 searches the product information group stored in the storage unit 11 using the acquired product identification information, and acquires the product information specified by the product identification information.

Specifically, the search means 1223 selects and acquires product information 1 that matches the product name "paint 12 colors, company A" included in the product identification information, for example, from the five or more stored product information. You may.

Alternatively, the search means 1223 selects and acquires three product information 1 to 3 in order from the one having the highest degree of similarity to the two types "paint" and "12 colors" included in the product specific information, for example. May be good.

Alternatively, the search means 1223 may select and acquire four product information 1 to 4 including one or more of the two types "paint" and "12 colors" included in the product specific information, for example.

Alternatively, the search means 1223 may use, for example, three product information 1, 2, and 5 including the character string "A company" consisting of the last two characters of the product name "paint 12 colors, company A" included in the product specific information. May be selected and obtained.

Alternatively, the search means 1223 selects product information by, for example, two or more types of the above four methods, and acquires one or more product information excluding duplicate product information from the selected product information group. That is preferable.

As a result of the above-mentioned product information identification processing, for example, when the product information can be acquired, the product information output unit 131 displays the acquired product information on the display of one or more terminals of the terminal device 1 or the other terminal 2. And output via an output device such as a speaker. This also applies when the product information is acquired by the other terminal 2 or a server device (not shown) and the acquired product information can be received.

For example, when two product information 1 to 3 can be acquired or received, the product information output unit 131 uses the three acquired or received purchase information 1 to 3 and the screen configuration information held by the product information output unit 131. For example, it is preferable to display the purchase screen as shown in FIG. 5 on the display.

FIG. 5 is a diagram showing an output example of the purchase screen. On this purchase screen, the character string "The following products are recommended. Please press one of the" Purchase "buttons or the cancel button. ", And the character string corresponding to the product information 1" (1) Product name: 12 colors of paint (manufactured by company A), price: 800 yen "and the first" purchase "button corresponding to the product information 1 , The character string corresponding to the product information 2 "(2) Product name: 24 colors of paint (manufactured by company A), price: 1200 yen", the second "purchase" button corresponding to the product information 2, and the product The character string "(3) Product name: 24 color set of watercolor paint (manufactured by Company B), price: 900 yen" corresponding to the information 3 and the third "purchase" button corresponding to the product information 3 It has a character string "search key: paint, 12 colors, 1000 yen" corresponding to the current product specific information, and a "cancel" button.

For example, if the user X selects the first "purchase" button via the input device of the terminal device 1, the purchase instruction receiving unit 141 receives the product "paint 12" corresponding to the selected product information 1. Upon receiving the purchase instruction of "color (manufactured by company A)", the purchase processing unit 123 processes the purchase of the product "12 colors of paint (manufactured by company A)". The purchase process will not be repeated as described above.

Alternatively, if the user Y selects the second "purchase" button via the input device of the other terminal 2, the other reception unit 24 receives the product "watercolor paint 24" corresponding to the selected product information 2. Upon receiving the purchase instruction of "color set (manufactured by company B)", the other transmission unit 26 transmits the purchase instruction to the terminal device 1. In the terminal device 1, the purchase instruction receiving unit 151 receives the purchase instruction, and the purchase processing unit 123 purchases the product "watercolor paint 24 color set (manufactured by Company B)".

Alternatively, if the user Y further utters "Company A is good" without selecting any of the buttons, the voice recognition means 1221 performs voice recognition on the voice information of this utterance and performs voice recognition on the voice information of this utterance, and the character string "A". Get "the company is good". The product identification information acquisition means 1222 performs morphological analysis or the like on the acquired character string, and acquires the product identification information including the product identifier “Company A”. The search means 1223 narrows down the three product information 1 to 3 which are the current search results by "Company A", and acquires two product information 1 and 2 as new search results. It is preferable that the product information output unit 131 updates the purchase screen as shown in FIG. 5 as shown in FIG. 6, using the product information 1 and 2 thus acquired, the screen configuration information, and the like.

FIG. 6 is a diagram showing another output example of the purchase screen. On this purchase screen, the character string "The following products are recommended. Please press one of the" Purchase "buttons or the cancel button. ", And the character string corresponding to the product information 1" (1) Product name: 12 colors of paint (manufactured by company A), price: 800 yen "and the first" purchase "button corresponding to the product information 1 , The character string corresponding to the product information 2 "(2) Product name: 24 colors of paint (manufactured by company A), price: 1200 yen", the second "purchase" button corresponding to the product information 2, and the current state It has a character string "search key: paint, 12 colors, 1000 yen, company A" corresponding to the product specific information of the above, and a "cancel" button.

If, for example, the user X further utters "for less than 1000 yen" without selecting any of the buttons on the purchase screen of FIG. 5, the voice recognition means 1221 responds to the voice information of this utterance. Perform voice recognition and acquire the character string "less than 1000 yen". The product identification information acquisition means 1222 performs morphological analysis or the like on the acquired character string, and acquires the product identification information including the price range information "less than 1000 yen". The search means 1223 narrows down the three product information 1 to 3 which are the current search results by "less than 1000 yen", and acquires two product information 1 and 3 as new search results. The product information output unit 131 may output other purchase screens (not shown) by using the product information 1 and 3 thus acquired, screen configuration information, and the like. This purchase screen corresponds to the character string "(2) product name: paint 24 colors (manufactured by company A), price: 1200 yen" corresponding to the product information 2 on the purchase screen of FIG. The second "buy" button has been deleted. In addition, among the character strings "search key: paint, 12 colors, 1000 yen" included in the purchase screen of FIG. 5, "1000 yen" corresponding to the price is changed to "less than 1000 yen" corresponding to the price range. It is preferable to be updated.

When the "Cancel" button is selected on the terminal device 1 or the other terminal 2, the product information acquisition process is restarted. When the end-of-call operation is performed on the terminal device 1 or the other terminal 2, the call is terminated.

As described above, according to the present embodiment, the terminal device 1 makes a call with another terminal 2 which is another terminal device, and is one or more of the voice information transmitted from the other terminal 2 or the received voice information. By acquiring the product information searched using the product specific information acquired from the voice information of the other terminal 2 during a call with the other terminal 2 and outputting the product information, the product proposal can be made while making a call with the other terminal 2. it can.

Further, the terminal device 1 voice-recognizes one or more voice information, acquires a character string, acquires product-specific information for identifying a product from the character string, performs a search using the product-specific information, and obtains the product information. By acquiring the product information, the product information can be acquired and proposed while talking with the other terminal 2.

In addition, the terminal device 1 also accepts the purchase instruction of the product corresponding to the output product information, and also performs the purchase process for purchasing the product in response to the acceptance of the purchase instruction, thereby performing the purchase process of the proposed product. , Can be done according to the instructions.

Further, the terminal device 1 can cause the other terminal 2 to perform the purchase process by transmitting the purchase information for purchasing the product to the other terminal 2.

Further, since the terminal device 1 performs the payment processing for the purchase of the product on the other terminal 2 that has received the purchase information, the other terminal 2 can also perform the payment processing. Further, since the payment process by the other terminal 2 is not executed unless the purchase information is transmitted, it is possible to enhance the safety when the child or the like has the other terminal 2 having the payment function.

Further, the terminal device 1 receives a purchase instruction of the product corresponding to the product information searched from the other terminal 2, and performs a payment process for purchasing the product in response to the receipt of the purchase instruction, thereby performing a payment function. It is possible to replace the purchase of products by another terminal 2 that does not have

Further, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated. This also applies to other embodiments herein. The software that realizes the information processing device according to the present embodiment is, for example, the following program.

That is, this program uses the computer of the terminal device 1 to have a call unit 121 that makes a call with another terminal 2 which is another terminal device, and voice information transmitted from the other terminal 2 or received voice information. Product information acquisition unit 122 that acquires product information searched using product specific information acquired from one or more voice information of the above during a call with another terminal 2, and product information output unit that outputs the product information. It is a program for functioning as 131. Here, the product information acquisition unit 122 has voice recognition means 1221 that voice-recognizes one or more voice information and acquires a character string, and product identification information that acquires product identification information that identifies a product from the character string. The acquisition means 1222 and the search means 1223 for acquiring the product information by performing a search using the product specific information are provided.

(Embodiment 2)
FIG. 7 is a block diagram of the information system 200 according to the present embodiment. The information system 200 includes one or more terminal devices 1a and one or more other terminals 2a.

The terminal device 1a is partially configured or partially different from the terminal device 1 of the first embodiment. Further, the other terminal 2a is partially configured or partially different from the other terminal 2 of the first embodiment. In the following, the description of the common configuration or common operation is omitted or simplified. It should be noted that such matters also apply to subsequent embodiments.

The terminal device 1a includes a storage unit 11, a processing unit 12a, an output unit 13, a reception unit 14, a reception unit 15, and a transmission unit 16. The processing unit 12a includes a call unit 121, a product information acquisition unit 122a, a purchase processing unit 123, and a payment processing unit 124.

The other terminal 2a includes another storage unit 21, another processing unit 22a, another output unit 23, another reception unit 24, another reception unit 25, and another transmission unit 26a. The other processing unit 22a includes voice recognition means 1221, product identification information acquisition means 1222, and search means 1223.

The processing unit 12a constituting the terminal device 1a performs various processes. The various processes are processes such as a call unit 121, a product information acquisition unit 122a, a purchase processing unit 123, and a payment processing unit 124.

Like the product information acquisition unit 122 described above, the product information acquisition unit 122a is acquired from one or more voice information of the transmitted voice information or the received voice information during a call with the other terminal 2a. Acquire the product information searched using the product specific information.

However, the product information acquisition unit 122 includes the voice recognition means 1221, the product specific information acquisition unit 1222, and the search means 1223, and normally acquires the product information to be proposed by itself, whereas the product information acquisition unit 122a Usually receives such product information from another terminal 2a.

The other processing unit 22a constituting the other terminal 2a performs various processes including a call with the terminal device 1a, similarly to the other processing unit 22 described above. In addition, the other processing unit 22a includes voice recognition means 1221, product identification information acquisition means 1222, and search means 1223, and also acquires product information. Since these means have been described above, they will not be repeated.

That is, the other processing unit 22a uses the voice recognition means 1221 to perform voice recognition of, for example, one or more voice information of the voice information transmitted from the terminal device 1a or the voice information received by the microphone of the other terminal 2a. , The product identification information is acquired by the product identification information acquisition means 1222 from the character string which is the recognition result. Further, the other processing unit 22a acquires the product information to be proposed by searching the stored product information with the search means 1223 using the acquired product identification information.

The other transmission unit 26a normally transmits the product information acquired by the other processing unit 22a to the terminal device 1a which is the other party of the other processing unit 22a.

Further, the other transmission unit 26a also transmits the received purchase instruction to the terminal device 1a, similarly to the other transmission unit 26 described above. That is, the other transmission unit 26a sends a purchase instruction received by the other reception unit 24 to one or more of the one or more purchase information received by the other transmission unit 26a, which is a terminal that is a call partner of the other processing unit 22a. It may be transmitted to the device 1a. Alternatively, the other transmission unit 26a is, for example, purchase information received by the other reception unit 25 in pairs with the terminal identifier that identifies the terminal device 1a from the terminal device 1a, with respect to the purchase information output by the other output unit 23. Then, the purchase instruction received by the other reception unit 24 may be transmitted to the terminal device 1a identified by the received terminal identifier.

Next, the operation of the information system 200 will be described with reference to the flowcharts of FIGS. 2 and 8. The operation of the terminal device 1a is the same as that of the flowchart of FIG. 2 except for the product information acquisition process in step S202.

FIG. 8 is a flowchart illustrating the product information acquisition process according to the second embodiment.

(Step S801) The product information acquisition unit 122 stores the voice information of the call made by the call unit 121 to the other terminal 2a in, for example, the internal memory of the MPU.

(Step S802) The product information acquisition unit 122 transmits the voice information stored in the internal memory to the other terminal 2a which is the call partner of the call unit 121.

In the other terminal 2a, the other receiving unit 25 receives the above-mentioned voice information, and the other processing unit 22 executes the same product information acquisition processing as that shown in FIG. 3 for the received voice information. .. Further, the other transmission unit 26 transmits the product information thus acquired to the terminal device 1a which is the transmission source of the voice information. When the other processing unit 22 cannot acquire the product information, it is preferable that the other transmitting unit 26 transmits, for example, a failure flag indicating that fact to the terminal device 1a.

(Step S803) The product information acquisition unit 122 determines whether or not information has been received from the other terminal 2a. When the product information acquisition unit 122 receives information such as product information or a failure flag from the other terminal 2a, it determines that the information has been received from the other terminal 2a. If the information is not received from the other terminal 2a, the process returns to step S803, and if the information is received from the other terminal 2a, the process returns to the higher-level processing.

Although omitted in the flowchart of FIG. 8, the product information acquisition unit 122 measures, for example, the elapsed time from the transmission of the voice information, and even if the elapsed time exceeds the predetermined time, the information is transmitted from the other terminal 2a. May be returned to the higher-level processing even when is not received.

A specific operation example of the information system 200 according to the present embodiment is the same as that of the first embodiment except that the product information acquisition process is performed by the other terminal 2a, and the description thereof will be omitted.

As described above, according to the present embodiment, the terminal device 1a makes a call with another terminal 2a, which is another terminal device, and is one or more of the voice information transmitted from the other terminal 2a or the received voice information. By acquiring the product information searched using the product specific information acquired from the voice information of the above during a call with the other terminal 2a and outputting the product information, the product proposal can be made while making a call with the other terminal 2a. it can.

Further, the terminal device 1a can acquire the product information from the other terminal 2a and propose it while talking with the other terminal 2a by receiving the product information acquired by the other terminal 2a from the other terminal 2a.

In addition, the terminal device 1a also accepts the purchase instruction of the product corresponding to the output product information, and also performs the purchase process for purchasing the product in response to the acceptance of the purchase instruction, thereby performing the purchase process of the proposed product. , Can be done according to the instructions.

Further, the terminal device 1a can cause the other terminal 2a to perform the purchase process by transmitting the purchase information for purchasing the product to the other terminal 2a.

Further, since the terminal device 1a performs the payment processing for the purchase of the product on the other terminal 2a that has received the purchase information, the other terminal 2 can also perform the payment processing. Further, since the payment process by the other terminal 2a is not executed unless the purchase information is transmitted, it is possible to enhance the safety when the child or the like has the other terminal 2a having the payment function.

Further, the terminal device 1a receives a purchase instruction of the product corresponding to the product information searched from the other terminal 2a, and performs a payment process for purchasing the product in response to the receipt of the purchase instruction, thereby performing a payment function. It is possible to substitute for the purchase of products by another terminal 2a that does not have.

Further, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated. This also applies to other embodiments herein. The software that realizes the information processing device according to the present embodiment is, for example, the following program.

That is, this program uses the computer of the terminal device 1a to talk with another terminal 2a, which is another terminal device, and the voice information transmitted from the other terminal 2a, or the received voice information. Product information acquisition unit 122a that acquires product information searched using the product identification information acquired from one or more voice information of the above during a call with another terminal 2a, and a product information output unit that outputs the product information. It is a program for functioning as 131. Here, the product information acquisition unit 122a receives the product information acquired by the other terminal 2a from the other terminal 2a.

(Embodiment 3)
FIG. 9 is a block diagram of the information system 300 according to the present embodiment. The information system 300 includes one or more terminal devices 1b, one or more other terminals 2, and a server device 3. The server device 3 can be communicably connected to each of one or more terminal devices 1b and one or more other terminals 2 via, for example, a network or a communication line.

The terminal device 1b includes a storage unit 11, a processing unit 12b, an output unit 13, a reception unit 14, a reception unit 15, and a transmission unit 16. The processing unit 12b includes a call unit 121, a product information acquisition unit 122b, a purchase processing unit 123, and a payment processing unit 124. The product information acquisition unit 122b includes a voice information transmitting means 1224 and a product information receiving means 1225.

The server device 3 includes a server storage unit 31, a server reception unit 32, a server processing unit 33, and a server transmission unit 34. The server processing unit 33 includes voice recognition means 1221, product identification information acquisition means 1222, and search means 1223.

The processing unit 12b constituting the terminal device 1b performs various processes. The various processes include the processes of the call unit 121, the product information acquisition unit 122b, the purchase processing unit 123, and the payment processing unit 124.

Like the product information acquisition unit 122 described above, the product information acquisition unit 122b is acquired from one or more voice information of the transmitted voice information or the received voice information during a call with the other terminal 2. Acquire the product information searched using the product specific information.

However, while the product information acquisition unit 122 usually acquires the product information to be proposed by itself, the product information acquisition unit 122b usually receives such product information from the server device 3. For example, it is preferable that the product information acquisition unit 122b requests the server device 3 to search by itself and acquires the product information from the server device 3. Requesting a search may be performed by, for example, transmitting voice information to the server device 3 by the voice information transmitting means 1224, and acquiring product information may be performed by, for example, a server processing unit 33 described later using the voice information. The product information obtained in the above may be received by the product information receiving means 1225.

The voice information transmitting means 1224 is a means for transmitting voice information. The voice information transmitting means 1224 usually transmits one or more voice information of the transmitted voice information or the received voice information to the server device 3. The voice information transmitting means 1224 may transmit, for example, one or more voice information of the voice information transmitted from the terminal device 1b or the voice information received by the microphone of the other terminal 2 to the server device 3. Suitable.

Further, the voice information transmitting means 1224 usually transmits such voice information in pairs with a terminal identifier that identifies the terminal device 1b.

The product information receiving means 1225 is a means for receiving the product information. The product information receiving means 1225 normally receives the product information from the server device 3 in response to the transmission of the voice information by the voice information transmitting means 1224.

The server storage unit 31 that constitutes the server device 3 can store various types of information. The various types of information are, for example, product information. Usually, one or more product information is stored in the server storage unit 31.

The server receiving unit 32 receives various types of information. The various types of information include, for example, voice information. The server receiving unit 32 normally receives voice information from the terminal device 1b in pairs with a terminal identifier that identifies the terminal device 1b.

The server processing unit 33 performs various processes. The various processes are, for example, processes of voice recognition means 1221, product identification information acquisition means 1222, search means 1223, and the like. Since these means have been described above, they will not be repeated.

The server processing unit 33 is, for example, voice information transmitted from the terminal device 1b, and the voice information received by the server receiving unit 32 is voice-recognized by the voice recognition means 1221, and the product identification information is obtained from the character string which is the recognition result. May be acquired by the product specific information acquisition means 1222. Further, the server processing unit 33 may acquire the product information to be proposed by searching the stored one or more product information with the search means 1223 using the product identification information acquired in this way.

The server transmission unit 34 transmits the product information thus acquired by the server processing unit 33 using the voice information to the terminal device 1b identified by the terminal identifier received by the server reception unit 32 in pairs with the voice information. ..

The operation of the information system 300 is the same as that of the first embodiment, except that the product information acquisition process is performed by the other terminal 2. That is, the operation of the terminal device 1b is the same as that in the flowchart of FIG. Further, the product information acquisition process in step S202 is obtained by replacing "other terminals" in steps S802 and S803 with "server devices" in the flowchart of FIG.

Further, a specific operation example of the information system 300 is the same as that of the first embodiment except that the product information acquisition process is performed by the server device 3, and the description thereof will be omitted.

As described above, according to the present embodiment, the terminal device 1b makes a call with another terminal 2 which is another terminal device, and is one or more of the voice information transmitted from the other terminal 2 or the received voice information. By acquiring the product information searched using the product specific information acquired from the voice information of the other terminal 2 during a call with the other terminal 2 and outputting the product information, the product proposal can be made while making a call with the other terminal 2. it can.

Further, the terminal device 1b transmits one or more voice information to the server device 3, and receives the product information from the server device 3 in response to the transmission of the voice information, so that the product information can be communicated with another terminal. Can be obtained from the server device and proposed.

In addition, the terminal device 1b also accepts the purchase instruction of the product corresponding to the output product information, and also performs the purchase process for the purchase of the product in response to the acceptance of the purchase instruction, thereby performing the purchase process of the proposed product. , Can be done according to the instructions.

Further, the terminal device 1b can cause the other terminal 2 to perform the purchase process by transmitting the purchase information for purchasing the product to the other terminal 2.

Further, since the terminal device 1b performs the payment processing for the purchase of the product on the other terminal 2 that has received the purchase information, the other terminal 2 can also perform the payment processing. Further, since the payment process by the other terminal 2 is not executed unless the purchase information is transmitted, it is possible to enhance the safety when the child or the like has the other terminal 2 having the payment function.

Further, the terminal device 1b receives a purchase instruction of the product corresponding to the product information searched from the other terminal 2, and performs a payment process for purchasing the product in response to the receipt of the purchase instruction, thereby performing a payment function. It is possible to substitute for the purchase of products by another terminal 2 that does not have.

Further, the processing in the present embodiment may be realized by software. The software that realizes the information processing device in this embodiment is, for example, the following program. That is, this program uses the computer of the terminal device 1b to talk with the other terminal 2 which is another terminal device, and the voice information transmitted from the other terminal 2 or the received voice information. Product information acquisition unit 122b that acquires product information searched using the product identification information acquired from one or more voice information of the above during a call with the other terminal 2, and product information output that outputs the product information. This is a program for functioning as a unit 131. Here, the product information acquisition unit 122b receives the product information from the voice information transmitting means 1224 for transmitting the one or more voice information to the server device 3 and the product information from the server device 3 in response to the transmission of the voice information. The product information receiving means 1225 is provided.

FIG. 10 is an external view of a computer system 900 that executes a program according to each of the above embodiments to realize a terminal device 1, a terminal device 1a, a terminal device 1b, or the like. Each embodiment may be implemented by computer hardware and a computer program running on it. In FIG. 10, the computer system 900 includes a computer 901 including a disk drive 905, a keyboard 902, a mouse 903, a display 904, and a microphone 917. The entire system including the keyboard 902, the mouse 903, the display 904, and the microphone 917 may be called a computer.

FIG. 11 is a diagram showing an example of the internal configuration of the computer system 900. In FIG. 11, the computer 901 is connected to the MPU 911, the ROM 912 for storing a program such as a boot-up program, and the MPU 911 in addition to the disk drive 905, and temporarily stores the instructions of the application program and temporarily. It provides a RAM 913 that provides a storage space, a storage 914 that stores application programs, system programs, and data, a bus 915 that interconnects the MPU 911, ROM 912, and the like, and a connection to a network such as an external network or an internal network. It includes a network card 916. The storage 914 is, for example, a hard disk, an SSD, a flash memory, or the like.

A program for causing the computer system 900 to execute a function of the terminal device 1 or the like may be stored in a disk 921 such as a DVD or a CD-ROM, inserted into a disk drive 905, and transferred to a storage 914. Alternatively, the program may be transmitted over the network to computer 901 and stored in storage 914. The program is loaded into RAM 913 at run time. The program may be loaded directly from disk 921 or the network. Further, the program may be read into the computer system 900 via another removable recording medium (for example, a DVD, a memory card, etc.) instead of the disc 921.

The program does not necessarily include an operating system (OS) for executing a function of the terminal device 1 or the like, a third-party program, or the like in 901 showing the details of the computer. The program may contain only parts of instructions that call the appropriate functions or modules in a controlled manner to achieve the desired result. It is well known how the computer system 900 works, and detailed description thereof will be omitted.

Although the computer system 900 described above is a PC, the terminal device 1 and the other terminal 2 and the like may be realized by a mobile terminal such as a smartphone, a tablet terminal, or a mobile phone. In this case, for example, it is desirable that the keyboard 902 and the mouse 903 are replaced with a touch panel, the disk drive 905 is replaced with a memory card slot, and the disk 921 is replaced with a memory card. The basic hardware configuration of the server device 3 may be the same as that of a PC or the like. However, the above is an example, and the hardware configuration of the computer that realizes the terminal device 1 and the like does not matter.

In the above program, in the transmission step of transmitting information and the receiving step of receiving information, processing performed by hardware, for example, processing performed by a modem or interface card in the transmission step (only performed by hardware). Processing that is not done) is not included.

Further, the number of computers that execute the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

In each of the above embodiments, the processing units (12, 12a, 12b) constituting the terminal device (1,1a, 1b) may further include, for example, a caller relationship acquisition unit (not shown). The caller relationship acquisition unit acquires the human relationship between the callers. The human relationship is, for example, a relationship between a parent and a child, a grandparent and a grandchild, a couple, and a lover, but the type does not matter. Such relationships can be obtained, for example, using the age and gender of each caller.

Therefore, it is preferable that the caller relationship acquisition unit is provided with, for example, an age acquisition means and a gender acquisition means. The age acquisition means acquires the age of the caller. The age acquisition means may acquire the age by using, for example, the result of voice recognition, or may directly receive the age from another terminal (2, 2a). The gender acquisition means acquires the gender of the caller. The gender acquisition means may also acquire the gender using, for example, the result of voice recognition, or may receive it directly from another terminal. It is preferable that the product information acquisition unit (122, 122a, 122b) acquires the product specific information by using the human relationship acquired by the caller relationship acquisition unit. The product information acquisition unit holds group information that is a set of a set of a human relationship identifier that identifies a human relationship and one or more product identifiers that identify a product suitable for the human relationship, and acquires the caller relationship. It is more preferable to acquire, for example, a product specific information group suitable for the human relationship by using the human relationship acquired by the department.

Further, in each of the above embodiments, the processing units (12, 12a, 12b) constituting the terminal device (1,1a, 1b) may further include, for example, a position information acquisition unit (not shown). The position information acquisition unit acquires the position information of one or more types of terminals (1,1a, 1b) or other terminals (2,2a). It is preferable that the search means 1223 performs a search using the position information acquired by the position information acquisition unit. The search means 1223 holds, for example, one or more inventory information regarding the inventory of each store, and uses the position information acquired by the inventory position information acquisition unit, for example, a product in stock in a store near each terminal. It is more preferable to search for a group.

Further, in each of the above embodiments, it goes without saying that the two or more communication means (transmitting unit 16, receiving unit 15, etc.) existing in one device may be physically realized by one medium.

Further, in each of the above-described embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be done.

It goes without saying that the present invention is not limited to the above embodiments, and various modifications can be made, and these are also included in the scope of the present invention.

As described above, the terminal device according to the present invention has an effect of being able to propose a product while talking with another terminal, and is useful as a terminal device or the like.

1, 1a, 1b Terminal device 2, 2a Other terminal 3 Server device 11 Storage unit 12, 12a, 12b Processing unit 13 Output unit 14 Reception unit 15 Reception unit 16 Transmission unit 21 Other storage unit 22, 22a Other processing unit 23 Other output Unit 24 Other reception unit 25 Other reception unit 26, 26a Other transmission unit 31 Server storage unit 32 Server reception unit 33 Server processing unit 34 Server transmission unit 100, 200, 300 Information system 121 Call unit 122, 122a, 122b Product information acquisition unit 123 Purchase processing unit 124 Payment processing unit 131 Product information output unit 141 Purchase instruction reception unit 151 Purchase instruction reception unit 1221 Voice recognition means 1222 Product specific information acquisition means 1223 Search means 1224 Voice information transmission means 1225 Product information receiving means

Claims (10)

A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
It is provided with a product information output unit that outputs the product information.
The product information acquisition department
A terminal device that receives product information acquired by the other terminal from the other terminal. A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
A product information output unit that outputs the product information and
A purchase instruction reception unit that receives purchase instructions for products corresponding to the product information output by the product information output unit, and a purchase instruction reception unit.
It is provided with a purchase processing unit that performs purchase processing for purchasing the product in response to the acceptance of the purchase instruction.
The purchase processing unit
A terminal device that transmits purchase information for purchasing the product to the other terminal. A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
A product information output unit that outputs the product information and
A purchase instruction receiving unit that receives a purchase instruction for a product corresponding to the product information searched from the other terminal.
A terminal device including a payment processing unit that performs payment processing for purchasing the product in response to receiving the purchase instruction. It is a product proposal method realized by the call unit, the product information acquisition unit, and the product information output unit.
A call step in which the call unit makes a call with another terminal, which is another terminal device,
The product information obtained by the product information acquisition unit using the product specific information acquired from the voice information transmitted from the other terminal or the voice information of one or more of the received voice information is obtained from the other. The product information acquisition step to be acquired during a call with the terminal, and
The product information output unit includes a product information output step for outputting the product information.
In the product information acquisition step
A product proposal method for receiving product information acquired by the other terminal from the other terminal. It is a product proposal method realized by a call unit, a product information acquisition unit, a product information output unit, a purchase instruction reception unit, and a purchase processing unit.
A call step in which the call unit makes a call with another terminal, which is another terminal device,
The product information obtained by the product information acquisition unit using the product specific information acquired from the voice information transmitted from the other terminal or the voice information of one or more of the received voice information is obtained from the other. The product information acquisition step to be acquired during a call with the terminal, and
A product information output step in which the product information output unit outputs the product information,
A purchase instruction reception step in which the purchase instruction reception unit receives a purchase instruction for a product corresponding to the product information output in the product information output step.
The purchase processing unit includes a purchase processing step of performing a purchase processing for purchasing the product in response to the acceptance of the purchase instruction.
In the purchase processing step
A product proposal method for transmitting purchase information for purchasing the product to the other terminal. It is a product proposal method realized by a call unit, a product information acquisition unit, a product information output unit, a purchase instruction receiving unit, and a payment processing unit.
A call step in which the call unit makes a call with another terminal, which is another terminal device,
The product information obtained by the product information acquisition unit using the product specific information acquired from the voice information transmitted from the other terminal or the voice information of one or more of the received voice information is obtained from the other. The product information acquisition step to be acquired during a call with the terminal, and
A product information output step in which the product information output unit outputs the product information,
A purchase instruction receiving step in which the purchase instruction receiving unit receives a purchase instruction of a product corresponding to the product information searched from the other terminal.
The payment processor, in response to reception of the purchase order, product proposals method of and a settlement processing step of performing a settlement process for the purchase of the product. Computer,
A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
A program for functioning as a product information output unit that outputs the product information.
The product information acquisition department
A program for operating the computer as a device for receiving product information acquired by the other terminal from the other terminal. Computer,
A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
A product information output unit that outputs the product information and
A purchase instruction reception unit that receives purchase instructions for products corresponding to the product information output by the product information output unit, and a purchase instruction reception unit.
It is a program for functioning as a purchase processing unit that performs purchase processing for purchasing the product in response to the acceptance of the purchase instruction.
The purchase processing unit
A program for operating the computer as a device for transmitting purchase information for purchasing the product to the other terminal. The program according to claim 8, wherein a settlement process for purchasing the product is performed on another terminal that has received the purchase information. Computer,
A call unit that makes a call with another terminal, which is another terminal device,
The product information searched by using the voice information transmitted from the other terminal or the product specific information acquired from one or more of the received voice information is acquired during a call with the other terminal. Product information acquisition department and
A product information output unit that outputs the product information and
A purchase instruction receiving unit that receives a purchase instruction for a product corresponding to the product information searched from the other terminal.
A program for functioning as a payment processing unit that performs payment processing for purchasing the product in response to receiving the purchase instruction.

Images