JP7818210B2 - Signage system, signage distribution method, signage authentication system, signage authentication method, and signage authentication program - Google Patents

Description

This disclosure relates to a signage system, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program.

Patent Document 1 discloses a display system that includes a management server, a display unit that displays information related to lotteries, and multiple display devices that communicate with the terminal device and the management server, and that executes a lottery process corresponding to any of the unique information accumulated for the user information of the terminal device to determine lottery result information. In the display system, the management server registers the user information of the terminal device, accumulates the unique information for the user information of the terminal device based on the terminal device's acquisition of unique information corresponding to the display device, and executes a lottery process to determine lottery result information in response to the terminal device's acquisition of the unique information.

JP 2014-203414 A

In the configuration of Patent Document 1, a terminal device obtains unique information (store ID) assigned to a display device (digital signage device) by reading a QR code (registered trademark) displayed on the display unit of the display device. However, simply reading a QR code (registered trademark) makes it possible to reuse the image captured by the QR code (registered trademark), meaning that the store cannot know which users actually viewed the advertising information displayed on the display device, and therefore cannot determine whether the advertising information is effective.

The present disclosure was devised in light of the above-mentioned conventional circumstances, and aims to provide a signage system that collects viewing information about advertisements displayed on digital signage, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program.

The present disclosure provides a signage system configured with one or more computers that display images on a first digital signage and a second digital signage, wherein the computers display a first image on the first digital signage, in which a first mark is superimposed on the image, and display a second image on the second digital signage, in which a second mark different from the first mark is superimposed on the image.

The present disclosure also provides a signage distribution method performed by a signage system configured with one or more computers that displays images on a first digital signage and a second digital signage, the signage distribution method displaying a first image on the first digital signage, with a first mark superimposed on the image, and a second image on the second digital signage, with a second mark different from the first mark superimposed on the image.

The present disclosure also provides a signage authentication system comprised of one or more computers that authenticates digital signage based on a captured image of an image displayed on the digital signage. The computer records information about the digital signage in association with information about a plurality of different marks superimposed on the image displayed on each of the digital signages, acquires the captured image, extracts the marks that appear in the acquired captured image, and authenticates the digital signage corresponding to the image displayed in the captured image based on a comparison between the extracted marks and the recorded information about the different marks.

The present disclosure also provides a signage authentication method performed by a system comprised of one or more computers, which authenticates digital signage based on captured images of images displayed on the digital signage. The signage authentication method records information about multiple digital signages in association with information about multiple different marks superimposed on the images displayed on each of the digital signages, acquires the captured images, extracts the marks displayed in the acquired captured images, and authenticates the digital signage corresponding to the images displayed in the captured images based on a comparison between the extracted marks and the recorded information about the multiple different marks.

The present disclosure also provides a signage authentication program that causes a terminal device, which is a computer communicatively connected between a signage system and the signage system, to perform the following steps: capture an image displayed on digital signage; transmit the captured image to the signage system; extract a mark that appears in the captured image; compare the extracted mark with information about multiple pre-recorded marks; and obtain an authentication result that authenticates the digital signage corresponding to the image displayed in the captured image based on information about the digital signage associated with the information about the compared mark; and output the obtained authentication result.

This disclosure makes it possible to collect viewing information about advertisements displayed on digital signage.

FIG. 1 is a diagram illustrating an example of the overall configuration of a signage system according to a first embodiment. 1 is a block diagram showing an example of the internal configuration of an advertisement distribution server, a digital signage, and a user terminal according to a first embodiment; FIG. 1 is a block diagram showing an example of the internal configuration of a server and a service information management device according to a first embodiment. FIG. 1 is a sequence diagram illustrating an example of an operation procedure before content distribution in the signage system according to the first embodiment. FIG. 10 is a diagram illustrating an example of extraction processing and recording processing of video feature information by a server. FIG. 10 is a sequence diagram illustrating a modified example of an operation procedure before content distribution of the signage system according to the first embodiment. FIG. 10 is a sequence diagram illustrating an example of an operation procedure after content distribution starts in the signage system according to the first embodiment. A flowchart illustrating a modification of the example of the operation procedure after the start of content distribution of the user terminal according to the first embodiment. FIG. 1 is a diagram illustrating an example of the overall configuration of a signage system according to a modification of the first embodiment. FIG. 10 is a sequence diagram illustrating an example of an operation procedure after content distribution starts in a signage system according to a modification of the first embodiment.

Hereinafter, with reference to the drawings as appropriate, detailed descriptions will be provided of each embodiment that specifically discloses the configuration and operation of the signage system, signage distribution method, signage authentication system, signage authentication method, and signage authentication program according to the present disclosure. However, more detailed descriptions than necessary may be omitted. For example, detailed descriptions of already well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

(Embodiment 1)
First, use case examples and configuration examples of a signage system 100 according to embodiment 1 will be described with reference to Fig. 1 to Fig. 3. Fig. 1 is a block diagram showing an example of the internal configuration of the signage system 100 according to embodiment 1. Fig. 2 is a block diagram showing an example of the internal configuration of each of an advertisement delivery server S1, digital signage SN1, ..., SNN, and user terminals P1, ..., PM according to embodiment 1. Fig. 3 is a block diagram showing an example of the internal configuration of each of a server S2 and a service information management device S3 according to embodiment 1.

Note that the signage system 100 shown in Figures 1 to 3 is an example and is not limited to this. For example, the advertisement distribution server S1 and server S2 may be realized by a single computer configured as an integrated unit. Furthermore, server S2 and service information management device S3 may be realized by a single computer configured as an integrated unit. Furthermore, the advertisement distribution server S1, server S2, and service information management device S3 may each be realized by a single computer configured as an integrated unit.

The signage system 100, which is an example of a signage authentication system, includes an advertising distribution server S1, one or more digital signage devices SN1, ..., SNN, one or more user terminals P1, ..., PM, a server S2, a service information management device S3, and one or more networks NW1, NW2. Note that in Figures 1 to 3, the networks NW1, NW2 are shown as separate entities to make the explanation of the signage system 100 easier to understand, but this is not limiting.

Each of one or more digital signage devices SN1, ..., SNN distributes advertising videos or images (hereinafter referred to as "content"). Based on user operation, each user terminal P1, ..., PM captures the content (monitor 23) distributed (displayed) by each digital signage device SN1, ..., SNN and transmits each of the captured images PIC1, ..., PICM to server S2. Server S2 detects marks Mk1, Mk2, Mk3, ..., MkM appearing in each of the captured images PIC1, ..., PICM and identifies the digital signage device from which each of the captured images PIC1, ..., PICM was distributed. If server S2 determines that a user has viewed content distributed by each digital signage device SN1, ..., SNN, it grants the user a service corresponding to the content viewing result (e.g., points, coupons, etc. that can be used for a specified service).

For example, in the example shown in FIG. 1, server S2 identifies captured image PIC1 as a captured image of content distributed by "Signage A" based on mark Mk1, captured image PIC2 as a captured image of "Signage A" based on mark Mk2, captured image PIC3 as a captured image of "Signage B" based on mark Mk3, and captured image PIC1 as a captured image of content distributed by "Signage C" based on mark MkM.

The advertising distribution server S1 is a server that distributes content (advertising images, advertising videos) to each of the digital signage SN1, ..., SNN. The advertising distribution server S1 is connected via the network NW1 to each of one or more digital signage SN1, ..., SNN via wireless or wired communication, and transmits (distributes) content and information related to marks added to the content. The advertising distribution server S1 includes a communication unit 10, a processor 11, and a memory 12.

Note that wireless communication here refers to communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark).

The communication unit 10 is connected to each of the multiple digital signages SN1, ..., SNN via networks NW1 and NW2 so that they can communicate with server S2. Note that Figure 1 does not show the connection between the advertising distribution server S1 and server S2.

The communication unit 10 acquires (receives) various control commands (electrical signals) transmitted from each digital signage SN1, ..., SNN or server S2, and outputs them to the processor 11. The communication unit 10 also transmits various control commands and information related to content output from the processor 11 to the corresponding digital signage SN1, ..., SNN or server S2.

Processor 11 is configured using, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), DSP (Digital Signal Processor), or FPGA (Field Programmable Gate Array), and controls the operation of each component of processor 11. Processor 11 works in conjunction with memory 12 to reference programs and data stored in memory 12 and execute those programs to realize each function of processor 11.

The processor 11 superimposes marks on the content distributed by each of the digital signages SN1, ..., SNN based on distribution schedule information for the content distributed by each of the digital signages SN1, ..., SNN (e.g., the time periods when content is distributed by each of the digital signages SN1, ..., SNN), mark information (e.g., mark characteristics), and mark schedule information (e.g., mark information to be superimposed on each content).

The mark superimposition process may be performed by each digital signage SN1, ..., SNN. In such a case, the processor 11 associates distribution schedule information, mark information, and mark schedule information with the content data distributed by each digital signage SN1, ..., SNN, and transmits the content data to each digital signage SN1, ..., SNN.

Memory 12 includes, for example, RAM (Random Access Memory) as work memory used when processor 11 executes each process, and ROM (Read Only Memory) that stores programs and data that define the operation of processor 11. Memory 12 may also include a storage device such as an SSD (Solid State Drive) or HDD (Hard Disk Drive). Data or information generated or acquired by processor 11 is temporarily stored in RAM. Programs that define the operation of processor 11 are written in ROM. Memory 12 includes a video recording unit 121 and a mark information recording unit 122.

The video recording unit 121 records information (data) related to the content, which is advertising video or advertising images. The video recording unit 121 records each of the multiple pieces of content. The video recording unit 121 may record content information (which allows each of the multiple recorded pieces of content to be identified) in association with digital signage information on which each piece of content will be distributed, and distribution schedule information on which the content will be distributed (e.g., distribution time slots, etc.).

The mark information recording unit 122 records mark information and mark schedule information as information about marks that are distributed by each digital signage and superimposed on content for each specified time period. The mark information recording unit 122 records mark information and mark schedule information for each piece of content information.

Note that mark information includes information about the characteristics of the mark (e.g., placement, color, pattern, shape, etc.). Also, mark schedule information includes information about the time periods during which the mark will be superimposed on the content.

Each of the digital signage SN1, ..., SNN distributes content on which a mark is superimposed. Each of the digital signage SN1, ..., SNN has at least one monitor 23 and may be capable of distributing multiple different pieces of content independently and simultaneously. Each of the digital signage SN1, ..., SNN includes a communication unit 20, a processor 21, a memory 22, and a monitor 23.

The communication unit 20 is connected to the advertisement delivery server S1 via the network NW1 so that it can communicate with them. The communication unit 20 acquires (receives) various control commands (electrical signals), information about content (e.g., content data, delivery schedule information, etc.), or information about marks (e.g., mark data, mark information, mark schedule information, etc.) transmitted from the advertisement delivery server S1, and outputs this to the processor 21. The communication unit 20 also transmits various control commands output from the processor 21 to the advertisement delivery server S1.

Processor 21 is configured using, for example, a CPU, GPU, DSP, or FPGA, and controls the operation of each part of processor 21. Processor 21 works in cooperation with memory 22 to reference programs and data stored in memory 22 and execute those programs, thereby realizing each function of processor 21.

The processor 21 distributes content on which a mark has been superimposed in advance by the advertising distribution server S1 based on distribution schedule information included in the information about the content, or superimposes a mark on the content and distributes it based on mark schedule information included in the information about the mark.

The marks superimposed on each piece of content are generated so that marks with identical characteristics are not superimposed on the same content distributed at the same time by two or more digital signage devices. This allows server S2, described below, to identify the digital signage device that distributed the content and the time period during which the image was captured, based on the marks superimposed on the content displayed in the captured image.

Furthermore, multiple marks may be superimposed on a single piece of content. This makes it possible to identify the digital signage that distributed the content or the time period in which the content was distributed based on the combination of the characteristics of each of the multiple marks, even if there are many digital signages distributing the same content at the same time.

The mark superimposed on each piece of content may be generated so that marks with exactly the same characteristics are not superimposed on all content distributed at the same time by each digital signage. In such cases, server S2, described below, can identify the content on which the mark is superimposed, the digital signage on which the content was distributed, and the time period during which the captured image was taken, based on the mark.

Here, we will explain the effects obtained by superimposing a mark. Specifically, when a mark is superimposed on content as shown in Embodiment 1, the reading distance of the mark is determined based on the size of the digital signage monitor, the size of the display area for each content, the size of the superimposed mark, etc., and is therefore not limited to the readable distance of a typical QR code (registered trademark), which is approximately a few centimeters to 1 meter. As a result, the signage system 100 can enable simultaneous imaging (viewing) of content displayed on the digital signage by more user terminals than when a QR code (registered trademark) is displayed on the digital signage.

Memory 22 includes, for example, RAM as a work memory used when processor 21 executes each process, and ROM for storing programs and data that define the operation of processor 21. Note that memory 22 may also include a storage device such as an SSD or HDD. Data or information generated or acquired by processor 21 is temporarily stored in RAM. Programs that define the operation of processor 21 are written in ROM. Memory 22 records information related to content (e.g., content data, distribution schedule information, etc.) and information related to marks (e.g., mark data, mark information, mark schedule information, etc.) in association with each other.

The monitor 23 is configured using a display such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display. The monitor 23 displays the content output by the processor 21 based on the distribution schedule information.

Each of the user terminals P1, ..., PM, which are examples of terminal devices, is a terminal device (e.g., a smartphone, tablet device, smart glasses, etc.) owned by each of multiple users who view content, and captures the content displayed on each of the digital signages SN1, ..., SNN. Each of the user terminals P1, ..., PM also receives service information corresponding to the captured image. Each of the user terminals P1, ..., PM includes a communication unit 30, a processor 31, a memory 32, a camera 33, and a monitor 34.

The communication unit 30 is connected to the server S2 or the service information management device S3 via the network NW2 so that it can communicate with them. The communication unit 30 acquires various control commands (electrical signals) and service information sent from the server S2 or the service information management device S3 and outputs them to the processor 31. The communication unit 30 also associates the captured image output from the processor 31 with user information and sends it to the server S2 or the service information management device S3.

Processor 31 is configured using, for example, a CPU, GPU, DSP, or FPGA, and controls the operation of each part of processor 31. Processor 31 works in cooperation with memory 32 to reference programs and data stored in memory 32 and execute those programs to realize the functions of application 311, etc.

Application 311 is started and terminated based on user operation. Based on user operation, application 311 starts camera 33 and captures images of the content displayed (distributed) on each of digital signage SN1, ..., SNN.

Application 311 associates the captured image output from camera 33 with user information and transmits them to server S2. Application 311 may also associate the captured image and user information with the time information at which the captured image was captured as a timestamp and transmit them to server S2.

The application 311 also generates a result notification screen (not shown) based on the result information sent from the server S2 or the service information management device S3, and outputs and displays it on the monitor 34. The application 311 also acquires the service information sent from the server S2 or the service information management device S3.

Memory 32 includes, for example, RAM as a work memory used when processor 31 executes each process, and ROM for storing programs and data that define the operation of processor 31. Note that memory 32 may also include a storage device such as an SSD or HDD. Data or information generated or acquired by processor 31 is temporarily stored in RAM. Programs that define the operation of processor 31 are written in ROM. Memory 32 records images captured by camera 33.

The camera 33 is configured with at least a lens (not shown) and an image sensor (not shown). The image sensor is a solid-state imaging element such as a CCD (Charged-Coupled Device) or CMOS (Complementary Metal-Oxide-Semiconductor), and converts the optical image formed on the imaging surface into an electrical signal.

Camera 33 captures an image of at least the area of the monitor 23 of digital signage SN1, ..., SNN on which content including the mark is being distributed (displayed), including the mark superimposed on the content. Camera 33 outputs the captured image or video to processor 31.

The monitor 34 is configured using a display such as an LCD or organic EL. The monitor 34 displays a result notification screen (not shown) generated and output by the processor 31.

The monitor 34 may be configured using a touch panel and accepts user operations from the user. The monitor 34 converts the accepted user operations into electrical signals and outputs them to the processor 31.

Server S2 detects marks superimposed on content from each of the captured images PIC1, ..., PICM transmitted from each of user terminals P1, ..., PM. Server S2 identifies the digital signage from which the detected mark was distributed based on information about the content distributed by each of pre-recorded digital signages SN1, ..., SNN (e.g., content data, distribution schedule information, etc.) and information about the mark (e.g., mark data, mark information, mark schedule information, etc.). Server S2 includes a communication unit 40, a processor 41, and a memory 42.

The communication unit 40 is communicatively connected to the advertisement distribution server S1, each of the multiple user terminals P1, ..., PM, and the service information management device S3 via the network NW2. The communication unit 40 outputs each of the captured images PIC1, ..., PICM transmitted from each of the multiple user terminals P1, ..., PM to the processor 41, and acquires and outputs to the processor 41 various control commands (electrical signals) and service information transmitted from the server S2 or the service information management device S3. The communication unit 40 also transmits various control commands (electrical signals) and various information (specified digital signage information, result information, service information, etc.) output from the processor 41 to the advertisement distribution server S1, each of the multiple user terminals P1, ..., PM, or the service information management device S3.

Processor 41 is configured using, for example, a CPU, GPU, DSP, or FPGA, and controls the operation of each component of processor 41. Processor 41 works in conjunction with memory 42 to reference programs and data stored in memory 42 and execute those programs to realize functions such as feature extraction unit 411.

The feature extraction unit 411 acquires at least one piece of content transmitted from the advertising distribution server S1 and extracts video feature information from the acquired content. Note that the video feature information here refers to data indicating the features and characteristics of the content, such as at least one advertising image included in the content, each of multiple advertising images corresponding to each scene in the content, partial images in which at least a partial area is extracted from each of the multiple advertising images that make up the content, metadata, or feature parameters. The feature extraction unit 411 records the extracted video feature information in the video feature recording unit 421.

The feature extraction unit 411 detects marks from each of the captured images PIC1, ..., PICM transmitted from each of the multiple user terminals P1, ..., PM, and extracts mark information from the detected marks. The feature extraction unit 411 references the mark information recording unit 422, compares the mark schedule information with the capture time information of each of the captured images PIC1, ..., PICM, and compares the extracted mark information with the mark information stored in the mark information recording unit 422 and corresponding to the capture time information, to identify the digital signage SN1, ..., SNN corresponding to each of the captured images PIC1, ..., PICM.

Memory 42 includes, for example, RAM as a work memory used when processor 41 executes each process, and ROM for storing programs and data that define the operation of processor 41. Note that memory 42 may also include a storage device such as an SSD or HDD. Data or information generated or acquired by processor 41 is temporarily stored in RAM. Programs that define the operation of processor 41 are written in ROM. Memory 42 records information related to content (e.g., content data, etc.), and includes a video feature recording unit 421 and a mark information recording unit 422.

The video feature recording unit 421 records information (features) about each piece of content, and records the video feature information for each piece of content distributed by each digital signage SN1, ..., SNN.

The mark information recording unit 422 records information related to marks and records the mark information and mark schedule information to be superimposed on the content distributed by each digital signage SN1, ..., SNN for each piece of content.

The service information management device S3 manages service information corresponding to each content. The service information management device S3 includes a communication unit 50, a processor 51, and a memory 52.

The communication unit 50 is connected to the server S2 or each of the multiple user terminals P1, ..., PM via the network NW2 so that it can communicate with them. Based on various control commands (electrical signals) transmitted from the server S2 or each of the multiple user terminals P1, ..., PM, the communication unit 50 transmits and provides service information corresponding to the user's viewing results to each of the multiple user terminals P1, ..., PM.

Processor 51 is configured using, for example, a CPU, DSP, GPU, or FPGA, and controls the operation of each part of processor 51. Processor 51 works in cooperation with memory 52, references the programs and data stored in memory 52, and executes the programs to realize the functions of processor 51.

Memory 52 includes, for example, RAM as a work memory used when processor 51 executes each process, and ROM for storing programs and data that define the operation of processor 51. Note that memory 52 may also include a storage device such as an SSD or HDD. Data or information generated or acquired by processor 51 is temporarily stored in RAM. Programs that define the operation of processor 51 are written in ROM. Memory 52 records a service information recording unit 521 and a viewing result recording unit 522.

The service information recording unit 521 records service information corresponding to each piece of content. Note that, if multiple different pieces of service information are assigned in response to the user's viewing results, the service information recording unit 521 may further record the conditions under which each of the multiple different pieces of service information is assigned.

The viewing result recording unit 522 records the user information sent from server S2, the identified signage information, and the image capture time information in association with each other.

Next, an example of the operational procedure before content distribution of signage system 100 will be described with reference to Figures 4 and 5. Figure 4 is a sequence diagram illustrating an example of the operational procedure before content distribution of signage system 100 according to embodiment 1. Figure 5 is a diagram illustrating an example of the extraction process and recording process of video feature information by server S2. Note that, for ease of understanding, Figures 4 and 5 describe an example in which content A is distributed by digital signage SN1, but it goes without saying that the present invention is not limited to this.

Processor 11 of advertising distribution server S1 generates distribution schedule information for distributing content A on each of digital signage SN1, ..., SNN (St11). Processor 11 transmits the generated distribution schedule information to at least one digital signage SN1 that will distribute content A (St12). Processor 11 generates a control command requesting the transmission of content A data to digital signage SN1, and transmits it to the video recording unit 121 (St13).

Based on the control command, the video recording unit 121 of the advertising distribution server S1 extracts content A data (advertising video data, advertising image data, etc.) (St14), outputs it to the communication unit 10, and transmits it to the digital signage SN1 (St15).

Processor 11 generates mark information to be superimposed on content A based on the distribution schedule information for content A (St16). For example, processor 11 generates "mark A1" for content A distributed during time slot A1, and "mark A2" for content A distributed during time slot A2. Note that the "mark A1" and "mark A2" generated here may be marks that differ in any of the characteristics of the marks, such as placement, color, or shape.

The processor 11 associates the generated mark information ("Mark A1", "Mark A2") with the mark schedule information on which each mark is displayed, and records the association in the mark information recording unit 122 (St17), and also transmits the mark information and mark schedule information to the digital signage SN1 that distributes content on which each of "Mark A1" and "Mark A2" is superimposed (St18).

The mark information recording unit 122 records the mark information and mark schedule information corresponding to content A in association with the content information of content A (St19).

The processor 11 generates a feature extraction command requesting feature extraction of content A and sends it to the server S2 (St20).

Server S2 acquires the feature extraction command sent from advertising distribution server S1 (St21), and based on this feature extraction command, generates a control command requesting advertising distribution server S1 to send content A data (advertising video data, advertising image data, etc.), and sends this control command to advertising distribution server S1 (St22).

Based on the control command sent from server S2, the video recording unit 121 of advertising distribution server S1 extracts data for content A (St23), outputs it to the communication unit 10, and transmits it to server S2 (St24).

Server S2 extracts video feature information from content A and records it in the video feature recording unit 421 (St25). Note that the feature extraction unit 411 may extract and record at least one of the matching image, matching partial image, metadata, or feature parameters as video feature information (features).

Specifically, the feature extraction unit 411 of server S2 extracts image data for matching (hereinafter referred to as "matching image") from the acquired data of content A, or extracts partial image data for matching (hereinafter referred to as "matching partial image") by extracting a portion from the image data of content A. In the example shown in Figure 5, the feature extraction unit 411 extracts matching images Img1 and Img2 corresponding to each scene in content A, and extracts matching partial images Pt1 and Pt2 by partially extracting each person appearing in content A.

The feature extraction unit 411 also extracts metadata Dt1 from the acquired content A data and extracts feature parameters that indicate the similarity of content A.

In this way, by extracting features, server S2 can reduce the amount of matching data used for matching in the digital signage identification process and reduce the amount of calculations required for the matching process.

The mark information recording unit 122 of the advertising distribution server S1 extracts the mark information and mark schedule information corresponding to content A sent to server S2 and sends them to server S2 (St26).

Server S2 associates the mark information corresponding to content A transmitted from advertising distribution server S1 with the mark schedule information and records them in the mark information recording unit 422 (St27).

Digital signage SN1 starts distributing content based on the distribution schedule information (St28). For example, digital signage SN1 superimposes mark A1 on content A and distributes it based on the distribution schedule information, and then superimposes mark A2, which has at least one different mark characteristic from mark A1, on content A and distributes it (St28). Note that the mark superimposition process may be performed in advance by advertising distribution server S1.

Next, a modified example of the operational procedure before advertisement distribution of the signage system 100 will be described with reference to FIG. 6. FIG. 6 is a sequence diagram illustrating a modified example of the operational procedure before advertisement distribution of the signage system 100 according to embodiment 1. Note that, for ease of understanding, FIG. 6 describes an example in which content A is distributed by digital signage SN1, similar to the explanation in FIG. 4, but it goes without saying that the present invention is not limited to this.

Processor 11 of advertising distribution server S1 generates distribution schedule information for distributing content A on each of digital signage SN1, ..., SNN (St31). Processor 11 transmits the generated distribution schedule information to at least one digital signage SN1 that will distribute content A (St32).

The processor 11 generates mark information corresponding to content A based on the distribution schedule information for content A (St33). The processor 11 associates the generated mark information ("mark A1", "mark A2") with the mark schedule information in which each mark is displayed, records the information in the mark information recording unit 122 (St34), and transmits it to the digital signage SN1 (St35).

The mark information recording unit 122 records the mark information and mark schedule information corresponding to content A in association with the content information of content A (Step 36).

Digital signage SN1 generates a control command requesting the transmission of content A data to digital signage SN1 and transmits it to advertising distribution server S1 (St37).

Based on the control command transmitted from digital signage SN1, processor 11 of advertising distribution server S1 requests video recording unit 121 to transmit data for content A (St38). Video recording unit 121 extracts data for content A (advertising video data, advertising image data, etc.) (St39), outputs it to communication unit 10, and transmits it to digital signage SN1 (St40).

The processor 11 generates a feature extraction command requesting feature extraction of content A and sends it to the server S2 (St41).

Server S2 acquires the feature extraction command sent from advertising distribution server S1 (St42), and based on this feature extraction command, generates a control command requesting advertising distribution server S1 to send content A data (advertising video data, advertising image data, etc.), and sends this control command to advertising distribution server S1 (St43).

Based on the control command sent from server S2, the video recording unit 121 of advertising distribution server S1 extracts data for content A (St44), outputs it to the communication unit 10, and transmits it to server S2 (St45).

Server S2 extracts video feature information from content A and records it in the video feature recording unit 421 (St46).

The mark information recording unit 122 of the advertising distribution server S1 extracts the mark information and mark schedule information corresponding to content A sent to server S2 and sends them to server S2 (St47).

Server S2 associates the mark information corresponding to content A transmitted from advertising distribution server S1 with the mark schedule information and records them in the mark information recording unit 422 (St48).

Digital signage SN1 starts distributing content based on the distribution schedule information (St49). For example, digital signage SN1 superimposes mark A1 on content A and distributes it based on the distribution schedule information, and then superimposes mark A2, which has at least one different mark characteristic from mark A1, and distributes it (St49). Note that the mark superimposition process may be performed in advance by advertising distribution server S1.

As a result, before content distribution, signage system 100 transmits content A's distribution schedule information, mark information, mark schedule information, and content A to the corresponding digital signage SN1, ..., SNN, making the content available for distribution.

Furthermore, the signage system 100 transmits mark information, mark schedule information, and content A to the server S2 before content distribution and performs pre-extraction of video feature information corresponding to content A, thereby identifying which digital signage transmitted images of content A transmitted from each of multiple user terminals P1, ..., PM. Although not shown in the sequences shown in Figures 4 and 7, the server S2 may also obtain and record distribution schedule information for each digital signage SN1, ..., SNN from the advertising distribution server S1.

Next, referring to Figure 7, an example of the operational procedure after content distribution by the signage system 100 will be described. Figure 7 is a sequence diagram illustrating an example of the operational procedure after content distribution by the signage system 100 according to embodiment 1 begins. Note that, for ease of understanding, Figure 7 describes an example of providing service information to the user terminal P1, but it goes without saying that the present invention is not limited to this.

Based on user operation, the processor 31 of the user terminal P1 instructs the application 311 to perform imaging processing (St50). The application 311 activates the camera 33 and causes it to capture an image of the content being distributed by one of the digital signages SN1, ..., SNN (St51).

The application 311 acquires an image captured by the camera 33 (Step 52) and performs data volume reduction processing on the captured image (Step 53). Note that the processing of Step St53 is not essential and may be omitted.

The data volume reduction process referred to here may be any of the following processes: image cutout process to cut out a necessary area from the captured image (for example, an area that includes something other than content A, such as the background); resolution reduction process to reduce the resolution of the captured image; high-compression encoding process; feature extraction process to extract features from the captured image; etc.

User terminal P1 generates a timestamp indicating the time information when the captured image was captured, associates the user information with the captured image after data volume reduction processing, and transmits the timestamp to server S2 (St54). Note that the user information here is information that can identify and specify the user who owns user terminal P1, and may be, for example, the user's user ID, email address, or terminal ID assigned to user terminal P1. User information may also include user attribute information (e.g., age, gender, etc.).

Server S2 acquires the user information, the captured image after data volume reduction processing, and the timestamp sent from user terminal P1 (St55). Server S2 performs image processing on the acquired captured image and acquires multiple pieces of video feature information and mark information from the captured image (St56). Note that if the digital signage identification process is performed using only mark information, server S2 may omit the process of acquiring video feature information.

The server S2 references the timestamp corresponding to the captured image and narrows down the video feature information of each of the multiple contents recorded in the video feature recording unit 421 to video feature information that may correspond (St57). The server S2 may also compare the timestamp corresponding to the captured image with the mark schedule information to narrow down the mark information that may correspond, and further narrow down the video feature information to be compared based on the narrowed down mark information.

Furthermore, the potentially corresponding video feature information and mark information referred to here refers, for example, to video feature information and mark information extracted from content that was distributed at a capture time a predetermined time (e.g., 1 minute, 3 minutes, etc.) before the capture time indicated by the timestamp.

Furthermore, if server S2 has pre-recorded distribution schedule information for each of the digital signages SN1, ..., SNN, it may further narrow down the video feature information to be compared based on the capture time indicated by the timestamp and the distribution schedule information.

Server S2 compares the multiple pieces of video feature information after the narrowing process, the mark information corresponding to these pieces of video feature information, and the captured image, and identifies the digital signage from which the content shown in the captured image was distributed (St58). Note that if server S2 determines that the digital signage cannot be identified, it may generate a notification that the digital signage cannot be identified and send it to user terminal P1.

Furthermore, when the content is video, server S2 acquires different captured images depending on the timing at which the user acquires (captures) the captured image, even for the same content. In such cases, server S2 identifies the content using video feature information. This allows server S2 to more appropriately identify the digital signage from which the content shown in the captured image was distributed, even when the content is video.

In addition, the video feature recording unit 421 may store multiple match images Img1, Img2, multiple pieces of metadata Dt1, or multiple feature parameters for one piece of content. By storing different match images, metadata, or feature parameters corresponding to scenes with different video features within a single piece of content, the server S2 can use the video feature information to more appropriately identify the digital signage to which the content was distributed, even when the content is video.

The server S2 associates the user information, digital signage information indicating the identified digital signage, and the capture time information of the captured image based on the timestamp, and transmits this as the user's viewing result to the service information management device S3 (St59).

The service information management device S3 acquires service information to be granted to the user in accordance with the user's viewing results (user information, digital signage information, capture time information, etc.) transmitted from the server S2 (St60). The service information management device S3 associates the user information, digital signage information, and capture time information transmitted from the server S2 as the user's viewing results and records them for each user in the viewing result recording unit 522. The service information management device S3 transmits the service information to be granted to the user to the server S2 based on the user's viewing results (St61).

The service information referred to here is information indicating the content of the service, such as coupons or points that are awarded to users in accordance with their viewing results. Furthermore, if service information is awarded only when certain conditions are met, the service information management device S3 may generate information on the current user's viewing performance (history) for these certain conditions instead of the service information, and transmit this information to the user terminal P1.

The server S2 generates result information based on the service information (St62). For example, if the service information includes information about any service (e.g., coupons, points, etc.), the server S2 generates result information indicating the content of the service information and transmits it to the user terminal P1 (St63).

Based on the result information transmitted from server S2, user terminal P1 generates a result notification screen (not shown) that notifies the user of the result information, and outputs and displays it on monitor 34 (St64).

As a result, the signage system 100 can identify the digital signage that distributed the content shown in the image captured by the user terminal P1, and can provide (provide) the user with service information corresponding to the user's viewing results based on the identified digital signage. This allows the signage system 100 to obtain more accurate user viewing results and achieve more accurate advertising effectiveness for the content. Furthermore, the signage system 100 can support advertisers in more detailed analysis of advertising effectiveness and demand analysis for content content, based on the user's personal information (e.g., age, gender, etc.) included in or associated with the user information.

(Modification of the first embodiment)
In the first embodiment, an example is shown in which service information is assigned to each of the user terminals P1, ..., PM by the server S2. In the modified example of the first embodiment, an example is described in which service information is assigned to each of the user terminals P1, ..., PM when the server S2 and the service information management device S3 are managed by different businesses and the server S2 does not have the authority to assign service information.

Note that the signage system 100A according to the variation of embodiment 1 has a configuration substantially similar to that of the signage system 100 according to embodiment 1. In the following description of the variation of embodiment 1, differences in configuration and functions from the signage system 100 according to embodiment 1 will be explained.

Referring to Figure 8, this is a diagram showing an example of the overall configuration of a signage system 100A according to a modified example of embodiment 1.

Signage system 100A, an example of a signage authentication system, includes an advertising distribution server S1, one or more digital signage devices SN1, ..., SNN, one or more user terminals P1, ..., PM, a server S2A, a service information management device S3A, and one or more networks NW1, NW2. Note that in Figure 8, networks NW1, NW2 are shown as separate entities to make the explanation of signage system 100A easier to understand, but this is not limiting.

Server S2A detects marks superimposed on content from each of the captured images PIC1, ..., PICM transmitted from each of user terminals P1, ..., PM. Server S2 identifies the digital signage from which the detected mark was distributed based on information about the content distributed by each of pre-recorded digital signages SN1, ..., SNN (e.g., content data, distribution schedule information, etc.) and information about the mark (e.g., mark data, mark information, mark schedule information, etc.).

Server S2A transmits information about the identified digital signage, user information corresponding to user terminals P1, ..., PM, and the capture time when the captured image was captured (such as a timestamp generated by application 111 or server time information assigned by server S2A) to service information management device S3A.

The service information management device S3A is connected to each of multiple user terminals P1, ..., PM and server S2A via network NW2 so that data communication is possible between them. The service information management device S3A manages service information corresponding to each content. The service information management device S3 records information about the identified digital signage sent from server S2A, user information corresponding to user terminals P1, ..., PM, and the capture time of the captured image. The service information management device S3 also acquires service information assigned to the user who owns the user terminal P1, ..., PM based on user viewing result information sent from the user terminal P1, ..., PM, and transmits it to the user terminal P1, ..., PM.

Next, with reference to Figures 9 and 10, a modified example of the operational procedure after content distribution of signage system 100A will be described. Figure 9 is a sequence diagram illustrating a modified example of the operational procedure after content distribution of signage system 100A according to embodiment 1 begins. Figure 10 is a flowchart illustrating a modified example of the operational procedure after content distribution of user terminal P1 according to embodiment 1 begins. Note that, for ease of understanding, Figures 9 and 10 describe an example of assigning service information to user terminal P1, as in Figure 7, but it goes without saying that the present invention is not limited to this.

Based on user operation, the processor 11 of the user terminal P1 instructs the application 111 to perform imaging processing (St50). The application 111 activates the camera 13 and causes it to capture an image of the content being distributed by one of the digital signages SN1, ..., SNN (St51).

The application 111 acquires the captured image captured by the camera 13 (Step 52) and performs data volume reduction processing on the captured image (Step 53). Note that the processing of Step St53 is not essential and may be omitted.

User terminal P1 generates a timestamp indicating the capture time information for the captured image, associates the user information with the captured image after data volume reduction processing, and transmits it to server S2A (St54A).

Server S2A acquires (receives) the user information sent from user terminal P1 and the captured image after data volume reduction processing (St55A). Server S2A acquires the time information within server S2A at the time of this acquisition (reception) (hereinafter referred to as "server time information") as the capture time information of the captured image (St55A). Server S2A performs image processing on the acquired captured image and acquires multiple pieces of video feature information and mark information from the captured image (St56).

The server S2A references the server time information corresponding to the captured image and narrows down the video feature information of each of the multiple contents recorded in the video feature recording unit 421 to video feature information that may correspond (St57A). The server S2A may also compare the server time information corresponding to the captured image with the mark schedule information to narrow down the mark information that may correspond, and then narrow down the video feature information based on the narrowed down mark information.

Furthermore, the potentially corresponding video feature information and mark information referred to here refers, for example, to video feature information and mark information extracted from content that was distributed at a capture time that was a predetermined time (e.g., 3 minutes, 5 minutes, etc.) before the capture time indicated by the server time information.

Furthermore, if server S2A has pre-recorded distribution schedule information for each of the digital signages SN1, ..., SNN, it may narrow down the video feature information based on the capture time indicated by the server time information and the distribution schedule information.

Server S2A compares the multiple pieces of video feature information obtained after the narrowing process with the mark information corresponding to these pieces of video feature information and the captured image, and identifies the digital signage from which the content shown in the captured image was distributed (St58).

The server S2A associates the user information, the identified digital signage information, and the capture time information of the captured image based on the timestamp, and transmits this to the service information management device S3A (St59). The server S2A also generates viewing result information based on the digital signage identification results and transmits it to the user terminal P1 (St65).

The user terminal P1 acquires the viewing result information transmitted from the server S2A (Step 65A) and determines whether the acquired viewing result information is successful (i.e., whether the digital signage has been identified by the server S2A) (Step 65B). The user terminal P1 then transmits the acquired viewing result information to the service information management device S3A (Step 66).

The service information management device S3A associates the user information, digital signage information, and image capture time information transmitted from the server S2A and records them in the viewing result recording unit 522. Based on the viewing result information transmitted from the user terminal P1, the service information management device S3A acquires service information to be provided to the user that corresponds to the user's viewing result (St67). The service information management device S3A transmits the service information to be provided to the user to the server S2A (St68).

The user terminal P1 acquires the service information transmitted from the service information management device S3A (St69), generates a result notification screen (not shown) based on the determination result of the processing in step St65B, and outputs and displays it on the monitor 34 (St69A, St69B).

As a result, signage system 100A can individually add content viewing information (effects) based on user information collected from each of multiple user terminals P1, ..., PM, digital signage information, and server time information (i.e., image capture time information), and service information to each user terminal P1, ..., PM where viewing of the corresponding content has been confirmed. This allows signage system 100A to provide service information to users even if the operator of server S2A and the business providing the service information are different.

Note that the signage systems 100 and 100A described above have been described primarily as an example of use in which corresponding service information is assigned (provided) based on the identification of the digital signage displayed in the captured images sent from each of the user terminals P1, ..., PM (i.e., the user's content viewing results), but it goes without saying that this is not limited to this. Other uses will be described below.

Signage systems 100 and 100A may provide service information based on the user's viewing results following the identification of the digital signage, or may provide service information based on whether conditions other than the identification of the digital signage are met.

For example, signage systems 100 and 100A may accumulate user viewing results and provide service information corresponding to conditions such as when the user has viewed a predetermined number of times or more, when the user has viewed a predetermined number of times or more within a predetermined period (e.g., in a points format), or when the user has viewed all digital signage displaying the same content (e.g., in a stamp rally format). Signage systems 100 and 100A may also provide different service information depending on the degree to which the conditions have been met.

As described above, signage systems 100, 100A according to embodiment 1 and a variant of embodiment 1 are signage systems configured with one or more computers that display content (an example of an image) on a first digital signage and a second digital signage. The computers display a first image on the first digital signage, in which a first mark is superimposed on the content, and display a second image on the second digital signage, in which a second mark different from the first mark is superimposed on the content.

Note that the computer referred to here is a device equipped with a communications unit, processor, and memory, and may include, for example, an advertising distribution server S1.

As a result, the signage systems 100 and 100A according to the first embodiment and the variant of the first embodiment can collect viewing information about the content displayed on each of the multiple digital signage displays based on the marks that appear in the captured image.

Furthermore, the computer in the signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 associates information about the first mark with information about the first digital signage, and associates information about the second mark with information about the second digital signage, and records these. This allows the signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 to collect information about the digital signage viewed by the user based on the marks displayed in the captured image.

Furthermore, the computer in signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 further records information relating to a third mark displayed on the first digital signage that is different from the first mark, and information relating to a fourth mark displayed on the second digital signage that is different from the second mark, and after displaying the first content, displays the third content in which the third mark is superimposed on the content on the first digital signage, and after displaying the second content, displays the fourth content in which the fourth mark is superimposed on the content on the second digital signage. This allows signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 to more accurately collect viewing information on content viewed by a user, even if the user views content distributed by the same digital signage multiple times.

Furthermore, the computer in signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 records the first time period during which the first content is displayed and the third time period during which the third content is displayed on the first digital signage, and records the second time period during which the second content is displayed and the fourth time period during which the fourth content is displayed on the second digital signage. This allows signage systems 100, 100A according to embodiment 1 and the modified embodiment 1 to collect information about the digital signage viewed by the user and information about the time period during which this content was displayed (the time period during which the user viewed it) based on marks displayed in the captured image.

As described above, signage systems 100, 100A (examples of signage authentication systems) according to embodiment 1 and a variant of embodiment 1 are configured with one or more computers that authenticate digital signage based on captured images of content (examples of images) displayed by the digital signage. The computer records information about multiple digital signages in association with information about multiple different marks superimposed on the content displayed on each digital signage, acquires the captured images, extracts the marks that appear in the acquired captured images, and authenticates the digital signage corresponding to the content displayed in the captured images based on a comparison between the extracted marks and the recorded information about the multiple different marks.

Note that the computer referred to here is a device equipped with a communications unit, processor, and memory, and may include, for example, server S2.

As a result, the signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment can identify which of the multiple digital signages has been viewed by the user based on the mark displayed in the captured image. Therefore, the signage systems 100 and 100A can collect content viewing information for each digital signage.

Furthermore, the computer in signage systems 100 and 100A according to embodiment 1 and a variant thereof stores information about multiple digital signages, information about multiple pieces of content displayed on the multiple digital signages (e.g., content data, distribution schedule information, etc.), and information about multiple different marks superimposed on the content (e.g., mark data, mark information, mark schedule information, etc.), in association with each other. Based on the information about the multiple pieces of content and the content displayed in the captured image, the computer extracts information about content similar to the content displayed in the captured image (i.e., video characteristic information). The computer authenticates the digital signage based on the mark displayed in the captured image and the information about the mark associated with the extracted information about the content. This allows signage systems 100 and 100A according to embodiment 1 and a variant thereof to identify content and the digital signage to which the content was distributed based on the mark displayed in the captured image. Furthermore, signage systems 100 and 100A extract video feature information (an example of information related to content) that is similar to the content shown in the captured image. In other words, by narrowing down the video feature information used (matched) in the digital signage authentication process, the processing load required for the digital signage authentication process can be reduced and the processing time can be shortened. Therefore, signage systems 100 and 100A can more efficiently collect content viewing information for each digital signage.

In addition, the information related to the marks in signage systems 100, 100A according to embodiment 1 and a variant of embodiment 1 includes multiple different marks superimposed on the content and information about the time period during which the marks are superimposed on the content. The computer authenticates the time period during which the captured image was captured and the digital signage based on the marks appearing in the captured image and the information about the marks associated with the extracted information about the content. As a result, signage systems 100, 100A according to embodiment 1 and a variant of embodiment 1 can identify the digital signage viewed by a user and the time period during which this content was displayed (the time period during which the user viewed it) based on the marks appearing in the captured image. Therefore, signage systems 100, 100A can collect content viewing information more accurately, even if a user views content distributed by the same digital signage multiple times.

In addition, the information about the mark in the signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment includes any one of the following mark characteristics: mark shape, mark pattern, mark color, or mark placement. This allows the signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment to identify the digital signage viewed by the user based on the mark characteristics.

In addition, the information related to content in signage systems 100, 100A according to embodiment 1 and the modified version of embodiment 1 includes partial content extracted from any area of the entire content, content features, or content metadata. As a result, signage systems 100, 100A according to embodiment 1 and the modified version of embodiment 1 can reduce the load of the matching process and shorten the time required for the matching process in the content matching process.

As described above, this is a signage authentication program that realizes the following steps: capturing content (an example of an image) displayed on digital signage on signage systems 100, 100A according to embodiment 1 and a variant of embodiment 1, and user terminals P1, ..., PM (an example of a terminal device), which are computers communicably connected between signage systems 100, 100A; transmitting the captured image to the signage system; extracting a mark that appears in the captured image, comparing the extracted mark with information about multiple marks recorded in advance, and obtaining an authentication result that authenticates the digital signage corresponding to the content displayed in the captured image based on information about the digital signage associated with the information about the compared mark; and outputting the obtained authentication result.

As a result, user terminals P1, ..., PM in embodiment 1 and the modified example of embodiment 1 can capture images that identify the digital signage to which the content viewed by the user was distributed. Therefore, signage systems 100, 100A can collect content viewing information for each digital signage.

Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner as long as they do not deviate from the spirit of the invention.

This disclosure is useful as a signage system that collects viewing information for advertisements displayed on digital signage, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program.

10, 20, 30, 40, 50 Communication unit 11, 21, 31, 41, 51 Processor 12, 22, 32, 42, 52 Memory 23, 34 Monitor 33 Camera 100, 100A Signage system 121 Video recording unit 122, 422 Mark information recording unit 311 Application 421 Video feature recording unit 521 Service information recording unit 522 Viewing result recording unit Mk1, Mk2, Mk3, MkM Mark NW1, NW2 Network P1, PM User terminal PIC1, PIC2, PIC3, PICM Captured image S1 Advertisement distribution server S2, S2A Server S3, S3A Service information management device SN1, SNN Digital signage

Claims (7)

A signage authentication system including one or more computers that authenticates a digital signage based on a captured image of an image displayed by the digital signage,
The computer
Recording information about the plurality of digital signages in association with information about a plurality of different marks superimposed on the images displayed on the respective digital signages;
Acquire the captured image;
extracting a mark appearing in the acquired captured image;
authenticating the digital signage corresponding to the image shown in the captured image based on a comparison between the extracted mark and the recorded information relating to the different plurality of marks;
Signage authentication system. The computer
information on the plurality of digital signages, information on the plurality of images displayed on the plurality of digital signages, and information on the plurality of different marks superimposed on the images are recorded in association with each other;
extracting information about an image similar to the image shown in the captured image from the information about the plurality of images based on the information about the plurality of images and the image shown in the captured image;
authenticating the digital signage based on a mark appearing in the captured image and information about the mark associated with information about the extracted image;
The signage authentication system according to claim 1 . the information about the marks includes the different marks to be superimposed on the image and information about a time period during which the marks are superimposed on the image;
The computer
authenticating the time period when the captured image was captured and the digital signage based on the mark appearing in the captured image and information related to the mark associated with the extracted information about the image;
The signage authentication system according to claim 2 . The information about the mark is
The mark includes any one of the features of the mark, the shape of the mark, the pattern of the mark, the color of the mark, or the arrangement of the mark.
The signage authentication system according to claim 1 . The information about the similar images includes:
a partial image obtained by cutting out any region of the entire image, a feature amount of the image, or metadata of the image;
The signage authentication system according to claim 2 . A signage authentication method performed by a system configured with one or more computers, which authenticates a digital signage based on a captured image of an image displayed on the digital signage,
Recording information about the plurality of digital signages in association with information about a plurality of different marks superimposed on the images displayed on the respective digital signages;
Acquire the captured image;
extracting a mark appearing in the acquired captured image;
authenticating the digital signage corresponding to the image shown in the captured image based on a comparison between the extracted mark and the recorded information relating to the different plurality of marks;
Signage authentication method. Signage system and
A terminal device that is a computer connected to the signage system so as to be able to communicate with the signage system,
capturing an image displayed on the digital signage;
transmitting the captured image to the signage system;
extracting a mark appearing in the captured image, comparing the extracted mark with information about a plurality of pre-recorded marks, and acquiring an authentication result of authenticating the digital signage corresponding to the image appearing in the captured image based on information about the digital signage associated with the information about the compared mark;
outputting the obtained authentication result;
Signage Certification Program.