JP7660312B2 - Distribution system, live distribution device, live distribution method and program - Google Patents

Description

The present invention relates to a distribution system, a live distribution device, a live distribution method, and a program.

Live streaming has been used to sell products in real time to users as viewers, by live broadcasting the procurement of products or live broadcasting used or new items owned at home in a manner similar to television shopping. For example, live streaming is carried out using the video distribution system described in Patent Document 1.

A distributor introduces a product through live streaming, and users who watch the broadcast can use the comment section during the live broadcast to leave comments indicating their intention to purchase the product. After the live broadcast ends, the distributor can then review the history of the comments and use, for example, the application's direct mail function to process the delivery of the product.

In this way, by using the video distribution system described in Patent Document 1, even individuals who do not have broadcasting facilities like a television station can easily sell products in a manner similar to television shopping.

Patent No. 6550549

However, the video distribution system described in Patent Document 1 has the problem that it is difficult for users to understand what products a distributor is selling during a live broadcast.

The present invention has been made in consideration of the above circumstances, and its purpose is to provide a distribution system, live distribution device, live distribution method, and program that enable users to easily view products sold by live distributors on their terminals with simple operations.

A live streaming system according to one aspect of the present invention includes a broadcaster terminal and a live streaming device. The broadcaster terminal has a first camera and a second camera, and acquires content for live streaming using the first camera. The live streaming device performs live streaming to a user terminal using the content acquired from the broadcaster terminal. The live streaming system includes an image processing unit that displays images on the user terminal. The image processing unit displays a video captured by the first camera on the user terminal as a video for live streaming, and displays an image of an item captured by the second camera together with the video for live streaming after assigning item information corresponding to the item.

A live streaming device according to one aspect of the present invention uses a broadcaster terminal having a first camera and a second camera to perform live streaming to a user terminal using content acquired via the first camera. The live streaming device has an image processing unit that causes the user terminal to display images. The image processing unit causes the user terminal to display a video captured by the first camera as a video for live streaming, and causes an image of an item captured by the second camera to be assigned item information corresponding to the item and then displayed together with the video for live streaming.

A live streaming method according to one aspect of the present invention is a live streaming method in which a distributor terminal having a first camera and a second camera performs live streaming to a user terminal using content acquired via the first camera. The live streaming method displays a video captured by the first camera on the user terminal as a video for live streaming, and displays an image of an item captured by the second camera together with the video for live streaming after assigning item information corresponding to the item.

A program according to one aspect of the present invention is a program that causes a computer to function as a distributor terminal having a first camera and a second camera, to perform live streaming to a user terminal using content acquired via the first camera. The program causes the computer to function as an image processing unit that displays images on the user terminal, and the processing unit displays a video captured by the first camera on the user terminal as a video for live streaming, and displays an image of an item captured by the second camera together with the video for live streaming after assigning item information corresponding to the item.

The distribution system, live distribution device, live distribution method, and program of the present invention have the advantage that the products sold by live distributors can be easily understood on a user terminal with simple operations.

FIG. 1 is a schematic diagram of a distribution system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a hardware configuration of the distribution system. FIG. 3 is a block diagram showing a functional configuration of the distribution system. FIG. 4 is a front view showing a user terminal during live distribution in the distribution system. FIG. 5 is a block diagram showing a functional configuration of an image processing unit of the distribution system. 6A and 6B are front views of a user terminal on which a purchase display section is displayed. FIG. 7 is a diagram illustrating a state in which a user terminal is notified of a purchase in the distribution system. FIG. 8 is a flow chart showing an example of the operation when creating a purchase button in the distribution system. FIG. 9 is a flow chart showing an example of an operation performed when a user makes a purchase in the distribution system.

(1) Implementation form

The distribution system 1 according to this embodiment is described in detail below.

(1.1) System configuration

Fig. 1 is a diagram showing an example of the configuration of a distribution system 1 according to this embodiment. As shown in Fig. 1, the distribution system 1 includes a live distribution device 2, a payment server 5, a distributor terminal 3, and multiple user terminals 4. The live distribution device 2, the payment server 5, the distributor terminal 3, and the multiple user terminals 4 are connected via a network 7 so as to be able to send and receive data to and from each other. The network 7 is composed of, for example, the Internet, a dedicated communication line (e.g., a CATV (Community Antenna Television) line), a mobile communication network (including base stations, etc.), a gateway, etc., or a combination of these.

The distributor terminal 3 is a communication terminal device owned by a person who is performing live distribution, and is used to obtain content for live distribution. The distributor terminal 3 is preferably a portable communication terminal. Examples of portable communication terminals include smartphones, tablet terminals, PDAs (Personal Digital Assistants), mobile phones, and notebook PCs (Personal Computers), as well as wearable terminals such as smart watches and smart glasses. The distributor terminal 3 in this embodiment is a smartphone.

The broadcaster terminal 3 is equipped with a first camera 321 (Fig. 3) and a second camera 322 (Fig. 3). The first camera 321 is a front camera (in-camera) and, in this embodiment, captures images in the thickness direction of the smartphone from the back to the front (the surface on the display side). The second camera 322 is a rear camera (main camera) and captures images in the direction from the front to the back. In the broadcaster terminal 3, image data captured by the first camera 321 and/or the second camera 322 is transmitted to the live broadcasting device 2 via the network 7.

In the distribution system 1, the live streaming device 2 performs live streaming to multiple user terminals 4 using content acquired from the distributor terminal 3. The live streaming device 2 is a server device. It is preferable that the live streaming device 2 is a server device for so-called cloud computing, using, for example, a PC (Personal Computer) such as a PC/AT compatible machine or a MAC standard machine, a dedicated machine, a blade server, etc.

In this specification, "live distribution" refers to a technology for distributing video images captured by a distributor terminal 3 to a user terminal 4 in real time by live streaming. The live distribution performed by the live distribution device 2 may employ a registration system that limits the target users to specific users, or may target an unlimited number of users.

The payment server 5 is a server device that checks whether the card information entered by the user terminal 4 is correct and executes the payment process. When the user terminal 4 instructs the purchase of a product, the payment server 5 checks the validity of the card information, such as a credit card or debit card, and executes the payment process. Card information refers to information such as the subscriber name, card number, expiration date, and security code. When the payment process is completed, the payment server 5 displays a payment completion page to the user terminal 4 that is attempting to make the purchase.

The user terminal 4 is a terminal device owned by a user who uses the distribution system 1 to watch live broadcasts. Examples of user terminals 4 include smartphones, tablet terminals, PDAs (Personal Digital Assistants), mobile phones, notebook PCs (Personal Computers), desktop PCs, and Internet TVs.

The user terminal 4 and the broadcaster terminal 3 store application programs (hereinafter sometimes referred to as apps) for using the service provided by the live broadcasting device 2. In the service, the apps perform, for example, displaying live broadcast video images, displaying purchase screens, and performing payment processing. By executing the apps, the user terminal 4 and the broadcaster terminal 3 access the live broadcasting device 2 and the payment server 5 and send and receive information used to run the apps.

(1.2) Hardware configuration

The live streaming device 2, the payment server 5, the broadcaster terminal 3, and the multiple user terminals 4 are each realized by a computer 6 as shown in FIG. 2. The computer 6 includes a processor 61, a memory 62, a storage 63, an input/output interface (input/output I/F 64), and a communication interface (communication I/F 65). The processor 61, the memory 62, the storage 63, the input/output I/F 64, and the communication I/F 65 are connected to each other via a bus 66. The streaming system 1 can realize various functions through cooperation between the processor 61, the memory 62, the storage 63, the input/output I/F 64, and the communication I/F 65. The live streaming device 2, the payment server 5, the broadcaster terminal 3, and the multiple user terminals 4 all have approximately the same hardware configuration.

The processor 61 executes various functions according to the programs stored in the storage 63. Examples of the processor 61 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and a microprocessor.

The memory 62 temporarily stores the programs read from the storage 63 and provides a working area for the processor 61. Examples of the memory 62 include a RAM (Random Access Memory) and a ROM (Read Only Memory).

Storage 63 stores programs. Examples of storage 63 include a hard disk drive (HDD), a solid state drive (SSD), and flash memory.

The input/output I/F 64 includes an input device that inputs various operations to the computer 6 and an output device that outputs the results of processing by the computer 6. The input/output I/F 64 may have the input device and output device housed in a single housing, or each may be housed in a separate housing.

The input device is a device for inputting information to the processor 61. Examples of input devices include a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera, a microphone, etc.

The output device is a device capable of outputting the results of processing performed by the processor 61. When the results of processing are output as an image or video, the output device is a device capable of displaying the display data according to the display data written in the frame buffer. Examples of output devices include a touch panel, a touch display, a liquid crystal display, a head-mounted display, a projector, a hologram, projection mapping, a speaker, a printer, etc.

The communication I/F 65 transmits and receives various data via the network 7. Communication by the communication I/F 65 is performed wired or wirelessly. For example, the communication I/F 65 of the user terminal 4 communicates with the live streaming device 2 and the payment server 5 via the network 7, and the communication I/F 65 of the broadcaster terminal 3 communicates with the live streaming device 2 via the network 7. The information received here is transmitted to the processor 61.

(1.3) Functional configuration

Figure 3 is a block diagram showing an example of the functional configuration of the distribution system 1 according to this embodiment. Below, the functional configurations of the live distribution device 2, the distributor terminal 3, the user terminal 4, and the payment server 5 will be described in order.

(1.3.1) Live streaming equipment

As shown in FIG. 3, the live streaming device 2 includes a communication unit 21, an image processing unit 22, a chat unit 23, a payment unit 24, a user information storage unit 25, and a distribution unit 26.

The communication unit 21 is connected to the distributor terminal 3, the user terminal 4, and the payment server 5 so that data can be transmitted in both directions (i.e., so that communication can be performed). The communication unit 21 is connected to the image processing unit 22, the chat unit 23, the payment unit 24, and the distribution unit 26 so that data can be input and output.

The image processing unit 22 processes image data captured by the distributor terminal 3 to generate a video for live streaming, and displays the video for live streaming on the display unit 44 of the user terminal 4. When information related to the content transmitted from the distributor terminal 3 is input via the communication unit 21, the image processing unit 22 converts the information into a bit rate and video file suitable for live streaming. The image processing unit 22 then obtains destination information of the user terminal 4 that should perform live streaming from the distribution unit 26, and transmits data of the video for live streaming via the communication unit 21 to the user terminal 4 that is requesting the live streaming.

The term "image" here refers to the image projected on the display by the processing of the processor 61, and includes both still images and moving images.

The chat unit 23 may carry out a chat between the user terminal 4 and the broadcaster terminal 3 while broadcasting the video for live streaming. The chat unit 23 displays text information input from the user terminal 4 or the broadcaster terminal 3 on the display unit 44 of the user terminal 4 and the display unit 34 of the broadcaster terminal 3. For example, as shown in FIG. 4, the chat unit 23 displays the text input by the user terminal 4 and the ID information of the user terminal 4 in a chat display area 81, and the chat display area 81 is superimposed on the video for live streaming. However, in the present invention, the display area 82 of the video for live streaming and the chat display area 81 may be displayed in separate locations.

The chats in the chat display area 81 are preferably displayed in chronological order in the vertical direction. In this embodiment, the most recently entered text information is displayed at the bottom. Also, rather than displaying all text displays, it is preferable to display the most recent first (in the figure, five columns are displayed). In this case, all text displays can be checked by swiping up or down on the chat display area 81 to scroll the chat. This allows the broadcaster to check the user's requests, comments, or questions while broadcasting live, and to communicate in real time.

Upon receiving a request from the user terminal 4 of the user who has decided to make a purchase, the payment unit 24 transmits user information and product price information to the payment server 5 and executes a payment request. Upon receiving a payment request from the payment unit 24, the payment server 5 checks the validity of the credit card and/or inquires about the credit balance.

The intention to purchase is expressed by pressing a purchase button 83 (Figure 4) displayed on the user terminal 4. The purchase button 83, which will be described later, is created using a product image captured by the second camera 322 of the broadcaster terminal 3 and is displayed on the display unit 44 of the user terminal 4. When the user presses the purchase button 83 displayed on the display unit 44 of the user terminal 4, the live broadcasting device 2 executes the payment for the product, and the payment server 5 displays a message indicating that the payment has been completed, and the payment is completed.

As used herein, "press" includes, for example, tapping the part corresponding to the purchase button 83, using a mouse to move the cursor over the part corresponding to the purchase button 83 and clicking (double-clicking or single-clicking), and using a directional key or the like to move the cursor over the purchase button 83 and press the enter key.

User information is stored in advance in the user information storage unit 25. The user information is information in which card information and ID information are associated. In response to a request from the user terminal 4, the payment unit 24 refers to the ID information corresponding to the user terminal 4, acquires the user information from the user information storage unit 25, and executes a payment request to the payment server 5.

The distribution unit 26 distributes the live streaming video generated by the image processing unit 22 and the chat displayed by the chat unit 23 to the user terminal 4 that has accessed the live streaming device 2. The distribution unit 26 distributes the live streaming video and chat via the communication unit 21. As described above, the user terminal 4 that accesses the live streaming device 2 may be registered or may be open to the public.

The live streaming device 2 according to this embodiment generates a video for live streaming using the image processing unit 22, and as shown in FIG. 4, a purchase button 83 generated by the broadcaster in real time can also be displayed in the video for live streaming. As a result, for example, in the past, a user would express their intention to purchase using chat, and after the live streaming, the broadcaster would check the chat history to confirm the intention to purchase, but with the live streaming device 2 according to this embodiment, payment processing can be performed in real time. The image processing unit 22 will be described in more detail below.

As shown in FIG. 5, the image processing unit 22 includes a distribution video generation unit 221, a purchase button generation unit 222, a product information acquisition unit 223, a purchase screen display unit 224, an alarm unit 225, and a purchaser number display unit 226.

The distribution video generation unit 221 processes the video transmitted from the distributor terminal 3 and converts it into a video for live distribution. The distribution video generation unit 221 can synthesize the video captured by the distributor terminal 3 via the first camera 321 and the audio captured by the microphone of the distributor terminal 3, and generate a video for live distribution that includes audio information. The distribution video generation unit 221 can adjust, for example, the file size, resolution, bit rate, brightness, saturation and/or hue of the video captured by the first camera 321 of the distributor terminal 3, and convert it into a video suitable for live distribution.

The purchase button generation unit 222 displays an image of an item captured by the broadcaster terminal 3 via the second camera 322 together with the video for live streaming after assigning item information corresponding to the item. When a trigger operation for image capture is performed on the broadcaster terminal 3, the purchase button generation unit 222 starts the second camera 322 of the broadcaster terminal 3. When the broadcaster captures an image of an item with the second camera 322 and the captured image data is input to the purchase button generation unit 222, the purchase button generation unit 222 detects the item using an object detection function and extracts a portion of the image data corresponding to the item. The purchase button generation unit 222 performs image recognition on the extracted item image to acquire item information corresponding to the item from the product information acquisition unit 223, assigns the item information to the item image, and generates a purchase button 83. The purchase button generation unit 222 displays the generated purchase button 83 together with the video for streaming.

The "trigger operation" here refers to an operation to activate the second camera 322. Examples of trigger operations include an operation to press a specific key, an operation to tap an icon on the screen, an operation to slide an image on the screen, an operation by voice (voice command), an operation such as tilting or turning the broadcaster terminal sideways using a gyro sensor or the like, an operation by a physical button on the broadcaster terminal, and the like. In addition, the image captured by the second camera 322 may be a still image or a moving image.

The purchase button generation unit 222 also generates the purchase button 83 by embedding a link that calls up the purchase display area 85 (FIG. 6A) in the image of the item. Thus, the image of the item is the purchase button 83, and when the image of the item is pressed, the purchase display area 85 is displayed. However, in the present invention, the image of the item and the purchase button 83 may be separate, and as long as the image of the item and the purchase button 83 are associated, this falls within the category of "assigning item information." For example, text with an embedded link, such as "Click here to purchase this item" or "Purchase button," may be displayed immediately next to the image of the item, and the purchase display area 85 may be called up by pressing the link.

The purchase button 83 is displayed together with the live streaming video, but in this embodiment, as shown in FIG. 4, the purchase button 83 is superimposed on the live streaming video. However, in the present invention, the purchase button 83 may be arranged below, below, left or right of the live streaming video, thereby displaying the purchase button 83 together with the live streaming video. Also, the purchase button 83 is superimposed on the live streaming video in the upper left part of the display unit 44 as shown in FIG. 4, but there is no particular limit to the position, and it may be in the upper right part, lower left part, lower right part or center part. Also, the distributor may be able to change the position of the purchase button 83. Also, the number of purchase buttons 83 displayed on one screen is not limited to one, and multiple types of purchase buttons 83 may be displayed.

The product information acquisition unit 223 acquires product information. The product information acquisition unit 223 may acquire the product information via the Internet, or may be information that has been registered in advance by the distributor. "Product information" here refers to information about the product, such as product attributes, product price, product name, manufacturer, etc.

When the purchase button 83 is pressed, the purchase screen display unit 224 calls up the purchase display field 85 as shown in FIG. 6A, and displays the purchase display field 85 on the display unit 44 of the user terminal 4. However, the purchase screen display unit 224 does not stop the playback of the live streaming video, but displays the purchase display field 85 superimposed on the live streaming video. In other words, when the user presses the purchase button 83 on the user terminal 4, the purchase screen display unit 224 does not transition from the live streaming video to a purchase screen, but displays the live streaming video as is, and displays the purchase display field 85 superimposed on the foreground of the live streaming video. This prevents the user from leaving the live streaming when making a purchase, and ensures that the user does not miss any product sales during the live streaming.

The purchase screen display unit 224 displays the purchase display field 85 only on the user terminal 4 on which the purchase button 83 has been pressed. As shown in FIG. 6A, the purchase display field 85 displays a field for selecting the quantity (here displayed as "Desired Quantity"), and when the "OK" button is pressed after entering the quantity, the unit price, quantity, and total amount are displayed as shown in FIG. 6B, and a "Purchase" or "Cancel" button is displayed. When the "Purchase" button is pressed, the user can purchase the product. Note that when the "Cancel" button is pressed, the purchase display field 85 disappears.

The notification unit 225 notifies a user terminal 4 other than the user terminal 4 that pressed the purchase button 83 that the product corresponding to the purchase button 83 has been purchased. For example, as shown in FIG. 7, the notification unit 225 chronologically displays in the chat that the product has been purchased by a specific user. In this embodiment, a notification display 84 is shown as an example in which a user "Roberto" purchases a product. The notification by the notification unit 225 may be enclosed in a frame different from other text parts in the chat so as to be noticeable, or may be displayed together with a sound. The notification by the notification unit 225 may also be displayed in a part other than the chat display.

The notification unit 225 can inform other users that a product has been purchased, encouraging them to buy. In addition, since the time of purchase of the product is notified in real time, other users can know the popularity of the product.

The purchaser number display unit 226 displays the total number of items purchased during the live broadcast. The purchaser number display unit 226 is linked to the payment unit 24, and counts the quantity of items for which payment has been completed. The purchaser number display unit 226 then displays the total number of items sold for each item on the user terminal 4. The total number of items sold may be displayed at all times on the user terminal 4, or may be displayed when the purchase button 83 is pressed. By displaying the total number of items sold, it is possible to inform other users that the item is popular, and to stimulate other users' desire to purchase.

(1.3.2) Streamer terminal

As shown in FIG. 3, the distributor terminal 3 includes a communication unit 31, an imaging unit 32, a processing unit 33, a display unit 34, and an input unit 35.

The communication unit 31 is connected to the live distribution device 2 so that data can be transmitted in both directions (i.e., so that communication can be performed). The communication unit 31 is connected to the processing unit 33 so that data can be input and output.

The processing unit 33 executes various processes of the broadcaster terminal 3, such as transmitting image data captured by the imaging unit 32 to the live streaming device 2 via the communication unit 31 and processing the display of the display unit 34. The processing unit 33 also controls the imaging unit 32 and the display unit 34 based on operations performed by the input unit 35. For example, the processing unit 33 can activate the second camera 322 of the imaging unit 32 and operate the shutter of the second camera 322 using a microphone serving as the input unit 35.

The imaging unit 32 obtains image data from the broadcaster terminal 3. The imaging unit 32 is composed of a first camera 321 and a second camera 322. The image data obtained by the imaging unit 32 is output to the processing unit 33 and transmitted to the live broadcasting device 2 via the communication unit 31.

The input unit 35 inputs information to the processing unit 33. In this embodiment, the input unit 35 is a touch panel and a microphone. The display unit 34 displays moving images for live streaming. The display unit 34 is configured, for example, by a display, a television, a monitor, etc.

(1.3.3) User terminal

As shown in FIG. 3, the user terminal 4 includes a communication unit 41, an input unit 42, a processing unit 43, and a display unit 44.

The communication unit 41 is connected to the live distribution device 2 so that data can be transmitted in both directions (i.e., so that communication can be performed). The communication unit 41 is connected to the processing unit 43 so that data can be input and output.

The input unit 42 inputs information to the processing unit 43. In this embodiment, the input unit 42 is a touch panel, a keyboard, and/or a pointing device such as a mouse.

The processing unit 43 executes various processes based on the information input by the input unit 42. The processing unit 43 also causes the display unit 44 to display the live streaming video transmitted from the live streaming device 2. The display unit 44 displays the live streaming video. The display unit 44 is configured by, for example, a display, a television, a monitor, etc.

(1.3.4) Payment server

As shown in FIG. 3, the payment server 5 includes a communication unit 51 and a query unit 52.

The communication unit 51 is connected to the live distribution device 2 so that data can be transmitted in both directions (i.e., so that communication can be performed). The communication unit 51 is connected to the query unit 52 so that data can be input and output.

In response to a request from the payment unit 24 of the live distribution device 2, the inquiry unit 52 checks the validity of the card information and executes the payment process. When the payment is completed, the inquiry unit 52 causes the display unit 44 of the user terminal 4 to display a message indicating that the payment has been completed.

(1.4) Operation

Next, an example of the operation for generating a purchase button 83 in this embodiment will be described using the flowchart in FIG. 8.

As shown in FIG. 8, the distributor operates the distributor terminal 3 and starts the live distribution function (e.g., an app) of the distributor terminal 3 (step 1). Then, the distributor uses the distributor terminal 3 to shoot video images for live distribution and obtain content for live distribution (step 2).

Then, the distributor issues a voice command to activate the purchase button 83 generation function (step 3). The processing unit 33 of the distributor terminal 3 then activates the second camera 322 (step 4). The distributor uses the distributor terminal 3 to capture an image of the item (i.e., the product) to be sold with the second camera 322 (step 5).

The processing unit 33 of the broadcaster terminal 3 transmits the image data captured by the second camera 322 to the live broadcasting device 2 via the communication unit 31, and the image processing unit 22 extracts a portion corresponding to the item from the image data (step 6). The live broadcasting device 2 then displays a message to the broadcaster terminal 3 asking whether the extracted image is acceptable (step 7).

When the broadcaster confirms the image extracted by the image processing unit 22, the broadcaster presses the "Confirm" button. The live broadcasting device 2 then assigns item information to the image. The live broadcasting device 2 displays the assigned item information on the broadcaster terminal 3 and asks whether there are any additions or changes to the item information (steps 8 and 9).

On the other hand, if the distributor wishes to retake the image extracted by the image processing unit 22, the distributor presses the "Cancel" button. Then, the process returns to step 5 again.

In step 8, when the generated purchase button 83 is selected, the live streaming device 2 causes the user terminal 4 to superimpose the purchase button 83 on the live streaming video (step 10). This generates the purchase button 83.

On the other hand, in step 8, if there is an addition or change to the item information assigned to the purchase button 83 ("No" in step 9), the live streaming device 2 displays a selection screen for the information to be added or changed, and once the broadcaster selects the item information to add or change, the process returns to step 8.

Next, an example of the operation performed when a user purchases a product will be described using the flowchart in Figure 9.

As shown in FIG. 9, during live streaming, if a user wishes to purchase a product, the user presses the corresponding purchase button 83 displayed on the user terminal 4 (step 11). The live streaming device 2 then causes the user terminal 4 to display a purchase display section 85 while displaying the live streaming video (step 12).

The user enters the quantity they wish to purchase in the "Desired Quantity" field in the purchase display area 85 (see Figure 6A) and presses the "OK" or "Cancel" button (step 14).

When the "OK" button is pressed, the live distribution device 2 causes the user terminal 4 to display purchase information showing the total amount (step 15). After checking this purchase information, if the user wishes to proceed with the purchase, the user presses the "Purchase" button, and if the user wishes to cancel the purchase, the user presses the "Cancel" button (step 16).

When the "Purchase" button is pressed, the live distribution device 2 requests the payment server 5 to perform payment processing and executes the payment processing (step 17). On the other hand, when the "Cancel" button is pressed in step 14 or step 16, the purchase display field 85 is cleared and the process returns to step 11.

When the payment process is complete, the live distribution device 2 notifies the other user terminals 4 that a purchase has been made by a specific user (step 18). At this time, it is preferable that the name of the user who made the purchase is also displayed, but this does not have to be the case.

Then, the live distribution device 2 counts the total quantity sold for the product and displays it on the user terminal 4 (step 19).

(2) Modified versions

The above embodiment is merely one of various embodiments of the present invention. Various modifications of the embodiment can be made depending on the design, etc., as long as the object of the present invention can be achieved. Below, we will list some variations of the embodiment. The variations described below can be applied in appropriate combinations.

At least some of the functional blocks in FIG. 3 may be implemented as a computer program (e.g., a live streaming viewing application) including modules corresponding to each functional block. The computer program may be stored on a recording medium such as a DVD or downloaded from the network 7 and installed in the memory 62.

In the above embodiment, payment was made online to the payment server 5 using a credit card or debit card, but the distribution system 1 may also be one that allows payment using electronic money.

In the above embodiment, the image (including video) captured by the second camera 322 is displayed as is as the purchase button 83, but in the present invention, for example, the image captured by the second camera 322 may be converted to a hand-drawn style image as the purchase button 83, or a CG image may be searched for from the image captured by the second camera 322 and the searched image may be used as the purchase button 83. Also, when multiple cameras are provided on the same surface (for example, when three cameras are provided on the back side of a smartphone or the like), one camera may capture content for live streaming and the other camera may capture an image for the purchase button.

In the above embodiment, the content for live streaming is captured by the rear camera, and the image for the purchase button 83 is captured by the front camera. However, in the present invention, the content for live streaming may be captured by the front camera, and the image for the purchase button 83 may be captured by the rear camera.

In the above embodiment, the live streaming device 2 is equipped with an image processing unit 22, but in the present invention, the image processing unit 22 may be realized by the processing unit 33 of the broadcaster terminal 3. That is, the purchase button 83 may be generated by the broadcaster terminal 3. Similarly, the processing unit 33 of the broadcaster terminal 3 may convert image data captured by the broadcaster terminal 3 before transmitting it to the live streaming device 2 to generate a moving image for live streaming, and then have the live streaming device 2 display it on the user terminal 4.

(3) Summary

As described above, the distribution system 1 according to the first aspect includes a distributor terminal 3 and a live distribution device 2. The distributor terminal 3 has a first camera 321 and a second camera 322, and acquires content for live distribution using the first camera 321. The live distribution device 2 performs live distribution to the user terminal 4 using the content acquired from the distributor terminal 3. The distribution system 1 includes an image processing unit 22 that displays images on the user terminal 4. The image processing unit 22 displays a moving image captured by the first camera 321 on the user terminal 4 as a moving image for live distribution, and displays an image of an item captured by the second camera 322 together with the moving image for live distribution after assigning item information corresponding to the item.

According to this aspect, while video is being shot for live streaming, the products for sale can be displayed together with the video for live streaming, so the products sold by the live streamer can be displayed clearly on the user terminal with simple operations. Furthermore, products for sale can be displayed and added to the user terminal 4 in real time without stopping the live stream. As a result, the streamer can prevent users from dropping out, and users can easily understand the products being sold during the live stream.

In addition, according to this aspect, since products for sale can be added to the user terminal during live distribution, for example, a foreigner can live-distribute products at a shopping mall, flea market, department store, or other store while introducing products to users (viewers) in his/her own country, and the distributor can purchase products purchased during the live distribution, take them back to his/her own country, and deliver them to users in his/her own country.

In the distribution system 1 according to the second aspect, in the first aspect, the distributor terminal 3 is a portable communication terminal having a front camera as the first camera 321 and a rear camera as the second camera 322.

This aspect allows distributors to easily perform live distribution and add products.

In the distribution system 1 according to the third aspect, in the first or second aspect, the image processing unit 22 superimposes an image of an item captured by the second camera 322 onto the moving image for live distribution.

According to this embodiment, the display area 82 for the live streaming video on the user terminal 4 can be made as large as possible.

In the fourth aspect of the distribution system 1, in any one of the first to third aspects, the image processing unit 22 displays an image of the item captured by the second camera 322 as a purchase button 83 together with the video image for live distribution.

According to this embodiment, an image of an item can be used as the purchase button 83, which provides users with good operability when purchasing a product.

In the distribution system 1 according to the fifth aspect, in the fourth aspect, when the user presses the purchase button 83 on the user terminal 4, the image processing unit 22 displays the live distribution video as is, without transitioning from the live distribution video to a purchase screen.

According to this embodiment, it is possible to prevent users who have proceeded to purchase from abandoning the live broadcast, thereby preventing them from missing out on an opportunity to purchase a product.

In the sixth aspect of the distribution system 1, in any one of the first to fifth aspects, the image processing unit 22 displays images of multiple items captured by the second camera 322 together with the video image for live distribution.

According to this aspect, multiple products for sale during live streaming can be displayed on one screen, making it easier for users to purchase products.

The live streaming device 2 according to the seventh aspect is a live streaming device 2 in which a broadcaster terminal 3 having a first camera 321 and a second camera 322 performs live streaming to a user terminal 4 using content acquired via the first camera 321 and the second camera 322. This live streaming device 2 has an image processing unit 22 that displays images on the user terminal 4. The image processing unit 22 displays a moving image captured by the first camera 321 on the user terminal 4 as a moving image for live streaming, and displays an image of an item captured by the second camera 322 together with the moving image for live streaming after assigning item information corresponding to the item.

According to this aspect, while the video is being shot for the live broadcast, the products for sale can be displayed together with the video for the live broadcast, so that the products for sale can be displayed and added to the user terminal 4 in real time without stopping the live broadcast. As a result, the broadcaster can prevent users from dropping out, and the users can easily understand the products for sale during the live broadcast.

The live streaming method according to the eighth aspect is a live streaming method in which a distributor terminal 3 having a first camera 321 and a second camera 322 performs live streaming to a user terminal 4 using content acquired via the first camera 321. In this live streaming method, a video captured by the first camera 321 is displayed on the user terminal 4 as a video for live streaming, and an image of an item captured by the second camera 322 is assigned item information corresponding to the item and then displayed together with the video for live streaming.

According to this aspect, while the video is being shot for the live broadcast, the products for sale can be displayed together with the video for the live broadcast, so that the products for sale can be displayed and added to the user terminal 4 in real time without stopping the live broadcast. As a result, the broadcaster can prevent users from dropping out, and the users can easily understand the products for sale during the live broadcast.

Reference Signs List 1 Distribution system 2 Live distribution device 22 Image processing unit 3 Distributor terminal 321 First camera 322 Second camera 34 Display unit 4 User terminal 83 Purchase button

Claims (7)

a purchase button generation unit that activates the second camera of a distributor terminal having a first camera and a second camera, assigns item information corresponding to an item to an image of the item captured by the second camera, generates a purchase button, and displays the generated purchase button in a superimposed manner on a display area of a moving image for live streaming captured by the first camera ,
When there is an addition or change to the product information assigned to the purchase button, the purchase button generation unit displays a selection screen for the information to be added or changed and accepts selection of the product information to be added or changed.
Live streaming system. the purchase button generation unit activates the second camera when a predetermined operation is performed on the distributor terminal;
The live distribution system according to claim 1 . The predetermined operation is an operation of pressing a specific key, an operation of tapping an icon on the screen, an operation of sliding an image on the screen, an operation by a voice command, an operation of tilting or turning the broadcaster terminal sideways using a gyro sensor, or an operation by a physical button provided on the broadcaster terminal.
The live distribution system according to claim 2 . When the image data captured by the second camera is input, the purchase button generation unit detects an item using an object detection function and extracts a portion of the image data corresponding to the item.
The live distribution system according to claim 1 . the purchase button generation unit performs image recognition on an image of an item captured by the second camera to acquire item information corresponding to the item, assigns the item information to the image of the item, and generates a purchase button;
The live distribution system according to claim 1 . A live streaming program,
A live distribution program for causing a computer to function as each part of the distribution system according to any one of claims 1 to 5. A live distribution method executed by a distribution system, comprising:
The distribution system according to any one of claims 1 to 5, further comprising:
How to live stream.