JP7188906B2 - Video distribution device and information processing program - Google Patents

Description

TECHNICAL FIELD Embodiments of the present invention relate to a video distribution device and an information processing program.

Printing an advertising image on a part of a receipt is widely practiced.
However, since the area in which the advertisement can be printed is limited and the image is a still image, it is often not an effective advertisement. It should be noted that if the amount of receipt paper used is increased, the amount of information that can be expressed can be increased, and advertising may be made more effective, but the cost of the receipt paper increases.
Under these circumstances, it has been desired to more effectively provide receipt-related information.

JP 2011-145855 A

A problem to be solved by the present invention is to provide a video distribution device and an information processing program that can more effectively provide receipt-related information.

A moving image distribution apparatus according to an embodiment includes identification means, selection means, and output means. The identifying means identifies a predetermined item related to the receipt reflected in the image based on the image. The selection means selects at least one of the plurality of moving images according to the identification result by the identification means. The output means outputs the video selected by the selection means to the information terminal. Further, the selecting means selects at least one of the plurality of moving pictures again according to the changed identification result if the identification result by the identifying means changes after the output of the selected moving pictures is finished. Then, when the moving image is selected again by the selecting means, the output means starts outputting the moving image to the information terminal.

The figure which shows the principal part circuit structure of the advertisement server which concerns on one Embodiment, and the schematic structure of the advertisement provision system containing the said advertisement server. FIG. 2 is a diagram showing an example of the data structure of a data record included in the logo management database in FIG. 1; FIG. 2 is a flowchart showing a procedure of information processing executed by a processor in FIG. 1; FIG. FIG. 4 is a diagram showing an example of a frame in a captured moving image; The figure which shows an example of the frame in a superimposition moving image. The figure which shows an example of the frame in a superimposition moving image.

An example of an embodiment will be described below with reference to the drawings. In addition, in the present embodiment, an advertisement server having a function as a video distribution device will be described as an example.
FIG. 1 is a diagram showing a main circuit configuration of an advertisement server 10 according to this embodiment and a schematic configuration of an advertisement providing system 100 including the advertisement server 10. As shown in FIG.
This advertisement providing system 100 is configured by enabling an advertisement server 10 to communicate with an information terminal 20 and a member server 30 via a communication network 40 . Although the advertisement providing system 100 typically includes a plurality of information terminals 20, only one is shown in FIG.

The advertisement server 10 performs information processing for distributing moving images for advertisement to the information terminal 20 . Note that in the present embodiment, the advertising server 10 distributes moving images to members of a point service that gives benefits according to the points possessed.

The information terminal 20 is an arbitrary information processing device that can be used by the members described above, accesses the advertisement server 10 via the communication network 40, and functions as a client. The information terminal 20 may be connected to the communication network 40 by either wired communication or wireless communication. The information terminal 20 incorporates or is externally equipped with a camera for capturing moving images. Various existing devices such as a smart phone, a tablet terminal, a mobile phone device, or a personal computer can be applied as the information terminal 20 . Therefore, detailed description of the information terminal 20 is omitted.

The communication network 40 can use the Internet, a VPN (virtual private network), a LAN (local area network), a public communication network, a mobile communication network, or the like, either singly or in combination. Communication network 40 is typically a combination of the Internet and a mobile communication network.

The member server 30 performs information processing for managing members of the point service. The member server 30 holds a member database DB1 in a built-in or external storage device. The member database DB1 stores, for example, member data such as a password for authentication, the name and address of the member, and the number of points possessed by the member, in association with the member code for identifying each member.

The advertisement server 10 has a processor 11 , a main memory 12 , an auxiliary storage device 13 , a communication interface 14 and a transmission line 15 . The processor 11 , main memory 12 , auxiliary storage device 13 and communication interface 14 are connected by a transmission line 15 . The processor 11 , main memory 12 and auxiliary storage device 13 are connected by a transmission line 15 to constitute a computer that performs information processing for controlling the advertisement server 10 .

The processor 11 corresponds to the central portion of the computer. The processor 11 executes information processing according to an information processing program such as an operating system, middleware, and application programs, thereby controlling each unit to realize various functions of the advertisement server 10 .

The main memory 12 corresponds to the main memory portion of the computer. Main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores the above information processing program in a nonvolatile memory area. The main memory 12 may also store data necessary for the processor 11 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 12 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 11 .

The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. The auxiliary storage device 13 can be, for example, an EEPROM (electric erasable programmable read-only memory), HDD (hard disc drive), SSD (solid state drive), or any other well-known storage device. Auxiliary storage device 13 stores data used by processor 11 in performing various processes and data generated by processes in processor 11 . The auxiliary storage device 13 may store the above information processing program.

The communication interface 14 performs data communication via the communication network 40 . As the communication interface 14, for example, a well-known interface configured to perform well-known processing for data communication via the Internet can be used.
The transmission line 15 includes an address bus, a data bus, a control signal line, etc., and transmits data and control signals exchanged between connected units.

For example, the advertisement server 10 can be realized by using a general-purpose computer device for servers as hardware and writing an information processing program describing information processing described later in the main memory 12 or the auxiliary storage device 13 . The information processing program may be stored in the main memory 12 or the auxiliary storage device 13 when the advertisement server 10 is transferred, or may be transferred separately from the general-purpose computer device. In the latter case, the information processing program is recorded on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or transferred via a network.

A part of the storage area of the auxiliary storage device 13 is used as the logo management database DB2. The data stored in the auxiliary storage device 13 includes a plurality of logo image data DA1 and a plurality of moving image files DA2. The logo image data DA1 is image data representing a logo image to be printed as a store logo on a receipt issued by a retail store or the like. The moving picture file DA2 is a moving picture file representing a moving picture distributed for advertisement.

FIG. 2 is a diagram showing an example of the data structure of a data record DR1 included in the logo management database DB2.
The logo management database DB2 is a set of data records DR1. Data record DR1 is associated with the logo represented by logo image data DA1. Data record DR1 contains fields FI1, FI2, FI3.

A predetermined logo code is set in field FI1 to identify the associated logo. A file name of logo image data representing the associated logo is set in field FI2. A field FI3 is set with data representing a condition for selecting a moving image to be distributed with respect to a receipt printed with an associated logo.
The data set in the fields FI1 to FI3 are determined by, for example, the person in charge of managing the advertisement server 10, and written by the processor 11 under the direction of the person in charge.

Next, the operation of the advertisement providing system 100 configured as above will be described.
When a member wants to view an advertisement distributed by the advertisement server 10, the member activates an application program for viewing the advertisement on the information terminal 20 possessed by the member. Then, the information terminal 20 accesses the advertisement server 10 via the communication network 40 and requests authentication together with notification of the membership code and password.

The processor 11 in the advertisement server 10 executes the information processing described below according to the information processing program stored in the main memory 12 or the auxiliary storage device 13 when accessed from the information terminal 20 as described above.
FIG. 3 is a flow chart showing the procedure of information processing executed by the processor 11. As shown in FIG. Note that the content of the processing described below is an example. Some processes may be replaced, deleted, added or reordered.

As Act 1, the processor 11 performs authentication processing that the user of the information terminal 20 is a member of the advertisement providing service. As a specific example, the processor 11 inquires of the member server 30 whether there is a member authenticated by the member code and password notified as described above. When the processor 11 receives the response from the member server 30 and confirms that the user is managed as a member by the member server 30, the processor 11 recognizes the user of the information terminal 20 as a member of the advertisement providing service. Authenticate as That is, the processor 11 treats the member of the point service as the member of the advertisement providing service. Note that the advertisement providing system 100 may include a plurality of member servers 30 corresponding to a plurality of different point services. Then, the processor 11 may inquire of each of the plurality of member servers 30 as to whether or not there is a member, and if any of the member servers 30 responds that the member exists, the processor 11 may authenticate the member as an advertisement providing member. Alternatively, the processor 11 may authenticate the user of the information terminal 20 based on member data prestored in the auxiliary storage device 13 regarding members of the advertisement providing service. Then, if the user of the information terminal 20 is authenticated as a member of the advertisement providing service, the processor 11 proceeds to Act2. It should be noted that the processor 11 does not proceed to Act 2 if the authentication of the member of the advertisement providing service fails. In this case, the processor 11 may obtain a new membership code and password to redo the authentication, or may end the processing shown in FIG. 3 as an error. The processor 11 thus authenticates the member who is the user of the information terminal 20 . In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as authentication means for performing the authentication described above.

Now, when the authentication is completed, the member activates the moving image shooting function of the information terminal 20 . Alternatively, the information terminal 20 activates the moving image shooting function by information processing based on an application program for viewing advertisements. The information terminal 20 transmits a moving image captured by the moving image capturing function (hereinafter referred to as a captured moving image) to the advertisement server 10 in real time. Then, the member positions the receipt that he or she has already received at an arbitrary product store or the like within the field of view of the moving image shooting function.

In Act 2, the processor 11 waits for the information terminal 20 to start photographing. Then, when the photographing is started as described above and the photographed moving image is sent, it is determined as Yes in Act2, and the process proceeds to Act3.

As Act 3, the processor 11 starts streaming transmission of the moving image. At this time, the processor 11 uses the captured video sent from the information terminal 20 as it is for streaming transmission.

As Act 4, the processor 11 starts identification processing. The identification processing is processing for identifying the logo appearing in the captured moving image sent from the information terminal 20 . In this logo identification process, as a specific example, the processor 11 confirms whether or not an image similar to any of the logo images represented by the plurality of logo image data DA1 is included in the captured moving image. If the corresponding image is included in the captured moving image, the processor 11 stores the data record DR1 in the logo management database, in which the file name of the logo image data representing the logo image similar to the image is set in the field FI2. Select from DB2. The processor 11 determines the logo code set in the field FI1 of the selected data record DR1 as the code of the logo appearing in the captured moving image. The processor 11 executes this identification processing in parallel with the information processing shown in FIG. Thus, in this identification process, the processor 11 identifies the logo as a predetermined item related to the receipt based on the image obtained by photographing the receipt. In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as identification means for performing such identification.

As Act 5, the processor 11 confirms whether or not the logo has been successfully identified by the identification process. Then, if the logo code cannot be determined by the identification processing, the processor 11 determines No, and proceeds to Act6.
As Act 6, the processor 11 confirms whether or not the photographing in the information terminal 20 has ended. The processor 11 determines No if the captured moving image is continuously sent, and returns to Act5.
Thus, in Acts 5 and 6, the processor 11 waits for logo identification to be successful or for photography to be completed. Then, if the logo code is determined by the identification processing, the processor 11 determines Yes in Act5, and proceeds to Act7.

In Act7, the processor 11 selects an advertisement moving image to be distributed from among the plurality of advertisement moving images. As a specific example, the processor 11 selects from the logo management database DB2 the data record DR1 in which the logo code determined by the identification process is set in the field FI1. The processor 11 selects at least one of the plurality of advertisement moving images based on the selection condition represented by the data set in the field FI3 of the selected data record DR1. An example of the selection condition is "select an advertisement video represented by a video file whose file name is XXX". Another example of the selection condition is "randomly select one advertisement video". Specific selection conditions are arbitrary, and may be determined by, for example, an advertisement distribution service manager, a point service manager, or an advertiser. Thus, processor 11 selects at least one of the plurality of moving images according to the identification result. In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as selection means for performing the above selection.

As Act8, the processor 11 starts superimposition processing. The superimposition process is a process of superimposing the advertisement moving image selected as described above on the captured moving image during streaming transmission. As a specific example, the processor 11 reproduces the selected advertisement video based on the corresponding video file DA2. Then, the processor 11 superimposes the advertisement moving image reproduced as described above on the photographed moving image sent from the information terminal 20 . Then, the processor 11 streams the moving image obtained by superimposing the advertisement moving image on the captured moving image (hereinafter referred to as a superimposed moving image). Note that, in the present embodiment, the processor 11 superimposes the advertisement moving image on the region in which the logo is reflected in the captured moving image.

FIG. 4 is a diagram showing an example of a frame FL1 in a captured moving image.
A receipt RE1 on which the logo LO1 is printed is reflected in the frame FL1.

FIG. 5 is a diagram showing an example of the frame FL2 in the superimposed moving image.
The frame FL2 is based on the frame FL1 shown in FIG. 4 and superimposed with the advertising moving image VI1. In addition, in FIG. 5, only the range of the advertisement moving image VI1 is shown, and illustration of the content of the image is omitted.
Furthermore, in this embodiment, the processor 11 calculates the inclination of the receipt reflected in the captured moving image, and changes the inclination of the advertisement moving image when superimposing.

FIG. 6 is a diagram showing an example of the frame FL3 in the superimposed moving image.
The frame FL3 is obtained by superimposing the advertising moving image VI1 in a similarly tilted state in response to the tilted state of the receipt RE1 reflected in the captured image.

In addition, when a plurality of advertisement videos are selected in Act7, the processor 11 starts superimposing another advertisement video after finishing superimposing one advertisement video to the end. The processor 11 executes the superimposition processing as described above in parallel with the information processing shown in FIG.

By transmitting the superimposed moving image as described above, the advertisement moving image selected in Act 7 is output to the information terminal 20 . In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as output means for performing the above output.
Also, the display form of the superimposed moving image output by the output means is changed in accordance with the change of the image in the captured moving image that has been acquired. In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as a changing means for making the above change.

As Act 9, the processor 11 confirms whether or not the image capturing by the information terminal 20 has ended. Then, the processor 11 determines No if the captured moving image is continuously sent, and proceeds to Act10.
As Act10, the processor 11 confirms whether or not all the selected advertisement moving images have been superimposed. If the processor 11 has not yet finished superimposing, it determines No, and returns to Act9.
Thus, in Act 9 and Act 10, the processor 11 waits for the end of shooting or the end of superimposing the advertising moving image.

Then, if the processor 11 has finished superimposing all of the advertisement moving images, it determines Yes in Act10, and proceeds to Act11.
As Act11, the processor 11 ends the superimposing process.

In Act 12, the processor 11 performs processing for awarding points. As a specific example, the processor 11 requests the member server 30 to add a predetermined point as a reward for watching the advertisement moving image to the end to the number of points possessed by the member authenticated in Act1. The member server 30 adds points according to this request. Thus, the processor 11 performs processing for adding points as predetermined information processing for giving benefits to members as authenticated users according to the display status of moving images on the information terminal 20. conduct. In other words, the processor 11 executes information processing based on the information processing program, so that the computer having the processor 11 as a central part functions as processing means for performing the above processing.

The processor 11 then returns to the standby state of Act5 and Act6. However, when the processor 11 returns to the standby state of Act 5 and Act 6 in this way, in Act 5, a logo code different from the logo code that was determined by the identification process when Act 5 was determined as Yes last time is displayed. If determined by the identification process, a new determination of Yes is made.

Now, when the information terminal 20 ends the shooting and does not transmit the shot moving image due to an instruction from the member or for some reason, the processor 11 determines Yes in Act 6 or Act 9 and proceeds to Act 13 .
As Act 13 , the processor 11 terminates the streaming transmission to the information terminal 20 . The processor 11 then terminates the information processing shown in FIG. That is, at these times, the processor 11 does not execute Act12 and does not award points.

As described above, the advertising server 10 identifies the logo printed on the receipt photographed by the information terminal 20 by the member, and transmits the advertising video associated with the logo to the information terminal 20 . Therefore, it is possible to allow members to view moving images related to receipts, and to provide information more effectively than conventional advertisements using receipts.

By the way, the logo printed on the receipt generally represents the issuer of the receipt. In other words, the advertisement server 10 identifies the issuer of the receipt by identifying the logo. Then, the advertisement server 10 is transmitting the animation associated with the issuer of the receipt. As a result, different moving images can be provided for each receipt issuer. In other words, for example, the member can be provided with a video desired by the issuer of the receipt. The member can view various videos by changing the receipt to be photographed.

The advertisement server 10 also transmits a superimposed moving image in which the advertisement moving image is superimposed on the captured moving image to the information terminal 20 . Further, the advertisement server 10 changes the inclination of the advertisement video in the superimposed video in accordance with the inclination of the receipt in the captured video. Therefore, if the member tilts the receipt photographed by the information terminal 20, the tilt of the advertisement video in the superimposed video changes accordingly. In other words, advertisements are provided in a form similar to virtual reality. Therefore, it is possible to increase the member's motivation for viewing advertisements, as compared with simple video playback.

Further, the advertisement server 10 gives a privilege by adding points to the member when the advertisement animation selected to be provided can be sent to the information terminal 20 to the end. This also makes it possible to increase the member's motivation for viewing advertisements.

This embodiment can be modified in various ways as follows.
The videos to be distributed are not limited to those for advertisement. Also, the item to be identified from the receipt is not limited to the logo. For example, changes can be made such as identifying whether a receipt shows a predetermined item as a purchased item and sending a video explaining how to use that item.

The form of superimposing the advertisement moving image on the captured moving image in the superimposed moving image can be arbitrarily changed. For example, an image representing the appearance of the display device may be displayed on a receipt, and then a moving image in which an advertisement moving image is inserted on the screen of the display device may be used as the superimposed moving image.

The advertisement server 10 may transmit only the advertisement moving image instead of the superimposed moving image.

Even if the user of the information terminal 20 is not registered as a member, the advertisement video may be transmitted from the advertisement server 10 to the information terminal 20 . Alternatively, the advertisement video may be transmitted from the advertisement server 10 to the information terminal 20 regardless of whether the user of the information terminal 20 is a member or a non-member.

The privilege given for viewing the advertisement video is not limited to the addition of points, and may be any other privilege such as issuing a coupon. Also, the condition for giving the privilege may be arbitrarily determined, for example, when 80% of the advertising video has been transmitted. Also, the privilege may not be given at all.

Each function realized by the processor 11 by information processing can also be partially or entirely realized by hardware that executes information processing not based on a program, such as a logic circuit. Further, each of the functions described above can be implemented by combining hardware such as the logic circuit described above with software control.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.
The following is a supplementary description of the inventions originally claimed in this application.
[Appendix 1] identification means for identifying a predetermined item related to the receipt based on an image obtained by photographing the receipt;
selection means for selecting at least one of a plurality of moving images according to the identification result by the identification means;
output means for outputting the video selected by the selection means to an information terminal;
A video distribution device equipped with
[Appendix 2] Changing means for changing the display form of the moving image output by the output means in accordance with a change in the image acquired by the acquisition means;
The video distribution device according to appendix 1, further comprising:
[Appendix 3] The identification means identifies the issuer of the receipt.
The moving image distribution device according to appendix 1 or appendix 2.
[Appendix 4] Authentication means for authenticating the user of the information terminal;
a processing means for performing predetermined information processing for granting a privilege to the user authenticated by the authentication means according to the display status of the moving image on the information terminal;
The moving picture distribution device according to any one of Appendices 1 to 3, further comprising:
[Appendix 5] The computer provided in the video distribution device
identification means for identifying a predetermined item related to the receipt based on an image obtained by photographing the receipt;
selection means for selecting at least one of a plurality of moving images according to the identification result by the identification means;
Control means for controlling an output device to output the video selected by the selection means to an information terminal;
Information processing program to function as

REFERENCE SIGNS LIST 1 0 advertisement server 11 processor 12 main memory 13 auxiliary storage device 14 communication interface 15 transmission line 20 information terminal 30 member server 40 communication network 100 advertisement provision system.

Claims (5)

identification means for identifying predetermined items related to the receipt reflected in the image based on the image;
selection means for selecting at least one of a plurality of moving images according to the identification result by the identification means;
an output means for outputting the video selected by the selection means to an information terminal;
and
The selecting means selects at least one of the plurality of moving pictures again according to the changed identification result if the identification result by the identifying means changes after the output of the selected moving picture is finished,
The output means starts outputting the moving image to the information terminal when the moving image is selected again by the selecting means.
Video distribution device. changing means for changing the display form of the moving image output by the output means according to a change in the state of the receipt reflected in the image;
The moving picture distribution device according to claim 1, further comprising: the identification means identifies an issuer of the receipt;
3. The moving image delivery device according to claim 1 or 2. authentication means for authenticating a user of the information terminal;
a processing means for performing predetermined information processing for granting a privilege to the user authenticated by the authentication means according to the display status of the moving image on the information terminal;
The moving picture distribution device according to any one of claims 1 to 3, further comprising: The computer provided in the video distribution device,
identification means for identifying predetermined items related to the receipt reflected in the image based on the image;
selection means for selecting at least one of a plurality of moving images according to the identification result by the identification means;
a control means for controlling an output device to output the video selected by the selection means to an information terminal;
to make it work,
causing the selecting means to select at least one of the plurality of moving pictures again according to the changed identification result if the identification result by the identifying means changes after the output of the selected moving picture is completed;
causing the control means to control the output device to start outputting the moving image to the information terminal when the moving image is selected again by the selecting means;
Information processing program for.

Images