JP5116925B2 - Mobile terminal, image distribution server, and information display method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a mobile terminal suitable for an image distribution service using a network, an image distribution server, and an information display method.
[0002]
[Prior art]
Conventionally, an image distribution service that distributes moving images using a network has been performed. In this image distribution service, a moving image is encoded and transmitted, and a user's receiving terminal (for example, a portable terminal) decodes the received data and reproduces and displays it as a moving image. As the encoding of a moving image, a method of encoding an entire screen constituting a moving image for each determined pixel (for example, MPEG (Motion Picture Experts Group) 1/1 / an international standard for multimedia encoding) 2 is used.
[0003]
[Problems to be solved by the invention]
However, in the conventional image distribution service method, since the moving image is simply encoded, the user wears a specific object (an object such as a person who appears in the moving image) on the moving image of the receiving terminal. If you are interested in products (such as clothes and bags that you wear) and want to know information about them (for example, product names, prices, manufacturers, etc.), you need to contact the information distributor that provides the image distribution service. there were. In addition, when the information distribution source has no knowledge about the contents of the image information, information on those products cannot be obtained.
[0004]
The present invention has been made in view of the above circumstances, and a portable terminal, an image distribution server, and an image distribution server that can easily obtain additional information about an object in image information received from an image distribution server without inquiring of an information distribution source. An object is to provide an information display method.
[0005]
[Means for Solving the Problems]
In order to solve the above problems, the following means were adopted.
Mobile terminal according to the present invention, the connected image distribution server via the network, when receiving the object corresponding to the product of the additional information and the additional information is an association that includes information indicating a purchase possible effect Display control means for displaying the object; selection means for selecting the object; and additional information display control for extracting and displaying additional information associated with the object when the object is selected by the selection means When the means and the additional information are displayed and the purchase request for the product associated with the displayed additional information is transmitted, based on the information indicating that the purchase is included in the additional information, Purchase availability determination means for determining whether or not the product can be purchased.
[0006]
In addition, a second object that is not associated with the additional information is included.
[0007]
And a transmission unit configured to transmit a purchase request for the product to the image distribution server based on the determination made by the purchase permission determination unit.
[0008]
The display control means displays the object so as to be visually distinguishable from the second object.
[0009]
The image distribution server according to the present invention transmits the object to the portable terminal via a network.
[0010]
An image distribution server for transmitting an object corresponding to a product associated with additional information to the mobile terminal via a network, the encoding means for encoding the object, and the encoded object And an information adding means for adding the additional information.
[0011]
The object received from the image distribution server includes a second object that is not associated with the additional information, and the encoding means further encodes the second object.
[0012]
In addition, when a purchase request for a product indicated by the object corresponding to the additional information is received from the mobile terminal, a purchase process is performed based on the purchase request.
[0013]
The information always-on method according to the present invention is a case where additional information including information indicating that purchase is possible and an object corresponding to a product associated with the additional information are received from an image distribution server connected via a network. , A process for displaying the object, a process for selecting the object, a process for extracting and displaying additional information associated with the selected object, and the additional information displayed and displayed on the displayed additional information. And a process for determining whether or not the product can be purchased based on information indicating that the purchase is possible when transmitting the purchase request for the associated product. .
[0014]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a configuration of an entire image distribution system using a portable terminal and an image distribution server according to an embodiment of the present invention. In this figure, the image distribution system includes an image distribution server 1, a mobile terminal 2 owned by a user 20, and networks 50 and 51. The network 50 is, for example, the Internet, and connects the image distribution server 1 and a network 51 such as a wireless network, so that the mobile terminal 2 connected to the network 51 and the image distribution server 1 are communicably connected. .
[0015]
The image distribution server 1 is a server that encodes an image in response to a request from the mobile terminal 2 and transmits the image to the mobile terminal 2, and includes a database 11 and an information processing unit 12.
The database 11 includes product information 11a (additional information), product image information 11b associated with the product information 11a (object, hereinafter referred to as product image information), and products or background images that are not associated with product information. Stores pre-encoding image information consisting of information 11c (second object, hereinafter referred to as background image information) and fee payment information 11d for charging the product purchaser for payment. Here, the product information 11a is information such as the product name, price, and manufacturer of the product indicated by the product image information 11b, and is stored in the database 11 in association with the product image information 11b. If the product can be purchased, the product information 11a includes purchase information indicating that fact.
[0016]
The information processing unit 12 performs each process of the image distribution server 1, and includes an encoding processing unit 12a that encodes the product image information 11b, an encoding processing unit 12b that encodes the background image information 11c, and an encoding processing unit. It comprises a multiplexing unit 12c that multiplexes information encoded by 12a and 12b, an information addition unit 12d that adds product information 11c to the multiplexed information, a network interface unit 12e, and a database interface unit 12f. The network interface unit 12e is connected to the network 50 to transmit / receive various information. The database interface unit 12f accesses the database 11 to call or store data. Thus, by performing the encoding process in the information processing unit 12, there is an advantage that an image distributor who uses this system does not have to prepare image information encoded in advance.
[0017]
The portable terminal 2 decodes the merchandise image information 11b and the background image information 11c received from the image distribution server 1 connected via the network 51, and displays them on the control unit 21 (image display control means, additional information). Display control means, purchase possibility determination means), input device section (selection means) 22 for selecting displayed product image information 11b or background image information 11c, memory 23 for storing received product information, and network 51 The network interface unit 24 (transmission means) that transmits and receives various kinds of information, the image display unit 25 that displays the decoded image, and the audio output unit 26 are configured. The voice output unit 26 outputs the voice when calling with normal voice or when receiving voice information from the image distribution server 1.
[0018]
The control unit 21 controls each unit of the mobile terminal 2, and includes an information separation unit 21a that separates the product information 11a from the received image information, and an image decoding processing unit that decodes the image information from which the product information 11a is separated. 21b, an image / speech separation unit 21c, and a speech decoding unit 21d. When the encoded audio information is added to the received image information, the image / audio separation unit 21c outputs the encoded product image information 11b and the background image information 11c, and the encoded audio information. To separate. The audio decoder 21d decodes the encoded audio information output from the image / audio separator 21c.
[0019]
Here, the encoding process in the encoding processing units 12a and 12b will be described. As this encoding processing, for example, an object-based encoding processing method which is one of the techniques of MPEG4 (Moving Picture Experts Group phase 4), which is an international standard of multimedia encoding, can be used. In this object-based encoding process, the entire entire screen is not encoded collectively, but is encoded separately for each element (object) constituting one screen. Each element is encoded together with identification information for identifying each element and coordinate information on the screen. As a result, the decoding side can superimpose the decoded elements based on these pieces of information and restore the image as a one-screen image. In the present embodiment, unless otherwise specified, the encoding processing unit 12a applies the above object encoding processing, while the encoding processing unit 12b performs general encoding processing for encoding the entire one screen. Encoding is performed by applying each of them. In addition, the image decoding processing unit 21b performs the decoding process by a method corresponding to each of the above encoding processes.
[0020]
Note that the functions of the processing units of the information processing unit 12 and the functions of the control unit 21 may be realized by dedicated hardware, a memory such as a computer terminal, and a CPU (Central Processing Unit). ), And a program (not shown) for realizing the above function may be realized by loading the program into a memory and executing it. In addition, an input device, a display device, and the like (none of which are shown) are connected to the information processing unit 12 as peripheral devices. Here, the input device refers to an input device such as a keyboard and a mouse. The display device means a CRT (Cathode Ray Tube), a liquid crystal display device or the like.
[0021]
Next, the operation of this system will be described with reference to FIGS.
1) Image Information Transmission Operation in Image Distribution Server 1 FIG. 2 is a sequence diagram showing image information transmission operation in the image distribution server 1 of this system.
First, the user 20 makes a call from the mobile terminal 2 to the network 50 via the network 51, inputs a predetermined URL (Uniform Resource locator), and accesses the image distribution server 1 (step S1). Then, the user 20 transmits a desired image distribution request from the portable terminal 2 to the image distribution server 1 (step S2). In the image distribution server 1, the information processing unit 12 searches the database 11 based on the distribution request transmitted from the mobile terminal 2, and acquires corresponding product information 11a, product image information 11b, and background image information 11c (step). S3). The acquired product image information 11b and background image information 11c are encoded by the encoding processing units 12a and 12b (step S4) and multiplexed by the multiplexing unit 12c (step S5). The product information 11a is added to the multiplexed information by the information adding unit 12d (step S6). Then, the image information to which the product information 11a is added is transmitted from the network interface unit 12e to the mobile terminal 2 (step S7).
[0022]
2) Decoding operation of image information in portable terminal 2 FIG. 3 is a flowchart showing the decoding operation of image information in the portable terminal 2 of this system.
First, the mobile terminal 2 receives the image information distributed from the image distribution server 1 by the network interface unit 24 (step S11). The information separation unit 21a separates the product information 11a from the received image information (Step S12), and writes the separated product information 11a in the memory 23 (Step S13). The image decoding processing unit 21b performs a decoding process on the product image information 11b and the background image information 11c from which the product information 11a is separated (step S14), and identifies the decoded image included in each image information. Based on the information and the coordinate information, the information is superimposed and output to the image display unit 25 (step S15). The image display unit 25 displays the image output from the image decoding processing unit 21b (step S16). Thereby, the user 20 can browse the desired image on the screen of the portable terminal 2.
[0023]
3) Product Information Display Operation in the Mobile Terminal 2 FIG. 4 is a flowchart for causing the image information display unit 25 to display product information.
Now, on the image display unit 25 of the portable terminal 2, a product image (for example, clock A, magazine B) obtained by decoding the product image information 11b and a background image (for example, background C) obtained by decoding the background image information 11c are superimposed and displayed. Suppose that Here, when the user 20 presses the “↓” key from the input device unit 22 (step S21), the control unit 21 selects the product to which the product information 11a is added from the images displayed on the image display unit 25. Whether there is an image is searched (step S22). As a result of the search, if there is an image of the corresponding product, a specific image (for example, clock A) in the image is colored and highlighted (step S23). Subsequently, when the “↓” key is pressed by the user 20 (step S24), the control unit 21 highlights an image of another product (for example, magazine B) (step S25). In this way, each time the user 20 presses the “↓” key, the control unit 21 sequentially searches and highlights images of products to which product information is added. Thereby, the user 20 can easily know an image from which product information can be browsed.
[0024]
Here, when the user 20 wishes to browse the product information of the magazine B, the “determine” key is pressed from the input device unit 22 in a state where the image of the magazine B is highlighted (step S26). The control unit 21 acquires identification information included in the image information of the highlighted magazine B (step S27), and reads product information 11a corresponding to the acquired identification information from the memory 23 (step S28). The product information 11a read from the memory 23 is output to the image display unit 25 and displayed (step S29). Thereby, the user 20 can browse the product information 11 a corresponding to the product of the selected image on the screen display unit 25.
Note that the product information 11a may be displayed after waiting for the end of distribution of image information (end of image display), or even during the distribution of image information. May be displayed at the same time as selecting the product image.
[0025]
FIG. 5 is a diagram showing the transition of the display mode of the screen display unit 25 in the product information display operation. In this figure, the screen display unit 25 includes an image display area 25a for displaying a decoded image and an additional information display area 25b for displaying operation guidance and additional information. First, a product image (clock A, magazine B) and background image (background C) obtained by decoding the image information being distributed are superimposed and displayed on the image display unit 25a (FIG. 5A). When the user 20 presses the “↓” key, the image of the clock A in the image display area 25a is colored and highlighted (FIG. 5B). Further, when the user 20 presses the “↓” key, the image of the magazine B in the image display area 25a is highlighted (FIG. 5C). When the user 20 presses the “OK” key while the magazine B is highlighted, after the image display in the image display area 25a is completed (FIG. 5D), the magazine B is displayed in the image display area 25a. On the other hand, the product information 11a of the magazine B is displayed in the additional information display area 25b.
[0026]
4) Product Purchase Operation FIG. 6 is a sequence diagram showing a product purchase operation.
First, when the product information 11a is displayed on the image display unit 25 and the user 20 confirms the displayed product information, the user presses the “↑” key from the input device unit 22 to purchase the product. Is requested (step S31). Then, a purchase request for a product corresponding to the displayed product information 11a is transmitted to the image distribution server 1 (step S32). Here, the user 20 inputs fee payment information (for example, name, address, telephone number, account number, etc.) 11d necessary for the payment procedure of the purchased product from the input device unit 22 and transmits it to the image distribution server 1 ( Step S33). The information processing unit 12 stores the fee payment information 11d transmitted from the mobile terminal 2 in the database 11 (step S34). In addition, when the inventory information of the product is managed in the database 11, the information processing unit 12 updates the inventory information in response to the purchase request (step S34a). Then, the information processing unit 12 transmits a purchase request acceptance completion notification to the mobile terminal 2 (step S35), and performs a product shipping instruction to the user and a product fee collection process (step S36). Thereby, the purchase operation of the product is completed, and the product is shipped to the user 20, while the product charge is appropriately transferred to the seller of the product.
[0027]
In addition, this invention is not limited to embodiment mentioned above, Of course, it can change variously in the range which does not deviate from the summary of this invention. In this embodiment, the case of using the encoding process based on the MPEG4 object-based encoding method has been described. However, the present invention is not limited to this as long as it is an encoding method for each element (object) constituting one screen. There is nothing.
[0028]
In the present embodiment, the case where the information processing unit 12 performs the encoding process to generate the image information has been described. However, the information processing unit 12 does not perform the encoding process, and the data is encoded in advance in the database 11. The processed image information may be stored. By doing in this way, the structure of the information processing part 12 can be simplified.
[0029]
Further, a voice recognition device may be provided in the portable terminal 2 and operated by voice input instead of the key operation of the input device unit 22. Thereby, even if the user 20 cannot perform key operation, he can browse product information by voice.
[0030]
Further, the method for highlighting the image of the product may be any method as long as it can be distinguished from other images, for example, by thickening the contour, and a plurality of highlighting methods may be selected. By doing in this way, it is possible to make the highlighted display easy to see according to the number of display colors (color, black and white) of the screen display unit 25 of the mobile terminal 2. Further, instead of sequentially highlighting selectable product images, all selectable product images may be collectively highlighted.
[0031]
【Effect of the invention】
As described above, according to the mobile terminal of the present invention, the additional information of the object is displayed by selecting the object included in the received image information by the selection means. It is possible to easily browse information relating to the product displayed as an image from the distributed image information without making an inquiry.
[0032]
In the present invention, if the additional information includes information indicating that the product corresponding to the object can be purchased, it is determined that the product can be purchased based on the information, and the purchase request is sent to the image distribution server by the purchasing means. Therefore, the product corresponding to the object can be easily purchased.
[0033]
Further, in the present invention, if the additional information is added only to the necessary object by dividing it into the object associated with the additional information and the second object not associated with the additional information, the information of the entire image information is obtained. The amount can be reduced, and the image information can be efficiently distributed from the image distribution server to the portable terminal.
[0034]
Further, in the present invention, if the object and the second object are displayed so as to be identifiable, the wasteful operation due to selecting a product for which additional information cannot be browsed is eliminated, and the additional information can be browsed efficiently. You can browse.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of an entire image distribution system using a mobile terminal and an image distribution server according to an embodiment of the present invention.
FIG. 2 is a sequence diagram illustrating an image information transmission operation in the image distribution server 1;
FIG. 3 is a flowchart showing a decoding operation of image information in the mobile terminal 2;
FIG. 4 is a flowchart for displaying product information.
FIG. 5 is a diagram showing transition of display modes of the screen display unit 25. FIG.
FIG. 6 is a sequence diagram showing a product purchase operation.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Image distribution server 2 Portable terminal 21 Control part (Image display control means, additional information display control means, purchase possibility determination means)
22 Input device section (selection means)
24 Network interface section (transmission means)
11a Product information (additional information)
11b Product image information (object)
11c Background image information (second object)

Claims (9)

When receiving additional information including information indicating that purchase is possible and an object corresponding to the product associated with the additional information from the image distribution server connected via the network,
Display control means for displaying the object;
Selecting means for selecting the object;
Additional information display control means for extracting and displaying additional information associated with the object when an object is selected by the selection means;
When the additional information is displayed and a purchase request for the product associated with the displayed additional information is transmitted, the purchase of the product is performed based on information indicating that the purchase is included in the additional information. A purchase permission / rejection determination means for determining the permission / inhibition;
A portable terminal characterized by comprising:   The portable terminal according to claim 1, wherein the object received from the image distribution server includes a second object not associated with the additional information.   The mobile terminal according to claim 1, further comprising: a transmission unit configured to transmit a purchase request for the product to the image distribution server based on the purchase determination made by the purchase permission determination unit.   The portable terminal according to claim 2 or 3, wherein the display control means displays the object so as to be visually distinguishable from the second object. Storing the object,
An image distribution server that transmits the object to the portable terminal according to claim 1 through a network. An image distribution server for transmitting an object corresponding to a product associated with additional information to the mobile terminal according to any one of claims 1 to 4, via a network,
Encoding means for encoding the object;
6. The image distribution server according to claim 5, further comprising information adding means for adding the additional information to the encoded object. The object received from the image distribution server includes a second object that is not associated with the additional information,
The image distribution server according to claim 6, wherein the encoding unit further encodes the second object.   8. The purchase process according to claim 5, wherein when a purchase request for a product indicated by the object corresponding to the additional information is received from the mobile terminal, a purchase process is performed based on the purchase request. Image distribution server. When receiving additional information including information indicating that purchase is possible and an object corresponding to the product associated with the additional information from the image distribution server connected via the network,
Processing to display the object;
Processing to select the object;
Processing to extract and display additional information associated with the selected object;
When the additional information is displayed and a purchase request for the product associated with the displayed additional information is transmitted, the purchase of the product is performed based on information indicating that the purchase is included in the additional information. Processing to determine whether or not ,
An information display method characterized by comprising:

Images