Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
US11308516B2 - Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product - Google Patents
[go: Go Back, main page]

US11308516B2 - Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product - Google Patents

Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product Download PDF

Info

Publication number
US11308516B2
US11308516B2 US16/651,675 US201816651675A US11308516B2 US 11308516 B2 US11308516 B2 US 11308516B2 US 201816651675 A US201816651675 A US 201816651675A US 11308516 B2 US11308516 B2 US 11308516B2
Authority
US
United States
Prior art keywords
advertisement
product
image
information processing
criterion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US16/651,675
Other languages
English (en)
Other versions
US20200273066A1 (en
Inventor
Yaeko Yonezawa
Kaito HORITA
Akira Yajima
Mizuto SEKINE
Yoshinori EHARA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Assigned to NEC CORPORATION reassignment NEC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EHARA, Yoshinori, HORITA, KAITO, SEKINE, Mizuto, YAJIMA, AKIRA, YONEZAWA, YAEKO
Publication of US20200273066A1 publication Critical patent/US20200273066A1/en
Application granted granted Critical
Publication of US11308516B2 publication Critical patent/US11308516B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements
    • G06Q30/0246—Traffic
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0272—Period of advertisement exposure
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47F—SPECIAL FURNITURE, FITTINGS, OR ACCESSORIES FOR SHOPS, STOREHOUSES, BARS, RESTAURANTS OR THE LIKE; PAYING COUNTERS
    • A47F5/00—Show stands, hangers, or shelves characterised by their constructional features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras

Definitions

  • the present invention relates to a technology for analyzing an advertisement used by a store or the like.
  • POP advertisement Point of purchase advertising: POP advertisement
  • Patent Document 1 to Patent Document 3 disclose examples of a technology of checking whether or not a work of displaying a product is correctly performed.
  • Patent Document 1 discloses a technology of preparing association information indicating a correspondence relation between product information and an electronic shelf label, in advance, and determining whether or not a correspondence relation between a product and an electronic shelf label, which is determined based on the position of the product and the position of the electronic shelf label in an image, coincides with the correspondence relation in the association information.
  • Patent Document 2 discloses a technology of generating association information in which the nearest product and the nearest electronic shelf label are associated with each other, based on the position of the product and the position of the electronic shelf label in an image and transmitting product information to the electronic shelf label on the basis of the association information.
  • Patent Document 3 discloses a technology of determining whether or not an error is present in a relation between the number of types of products recognized from an image and the number of shelf labels or in a relation between the position of the product of each type recognized from the image and the position of the shelf label recognized from the image.
  • Patent Document 1 International Publication No. WO2016/052379
  • Patent Document 2 International Publication No. WO2016/052382
  • Patent Document 3 International Publication No. WO2016/052383
  • the present invention has been made in view of the above problems.
  • One object of the present invention is to save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined.
  • an information processing apparatus includes an image processing unit that acquires a position of an advertisement and a position of a product by analyzing an image in which the product and the advertisement are disposed on a shelf rack are captured, a determination unit that determines whether or not a relation between the position of the product and the position of the advertisement satisfies a criterion, and an output unit that outputs information indicating a determination result obtained by the determination unit.
  • an information processing method executed by a computer includes acquiring a position of an advertisement associated with a product and a position of the product by analyzing an image in which the product and the advertisement are disposed on a shelf rack are captured, determining whether or not a relation between the position of the product and the position of the advertisement satisfies a criterion, and outputting information indicating the determination result.
  • a program causes a computer to perform processing of a control method of the present invention.
  • FIG. 1 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus according to a first example embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a computer that realizes the information processing apparatus.
  • FIG. 3 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus according to a second example embodiment.
  • FIG. 4 is a flowchart illustrating a flow of processing performed by the information processing apparatus in the second example embodiment.
  • FIG. 5 is a diagram illustrating a first example of a criterion used in a determination unit.
  • FIG. 6 is a diagram illustrating a second example of the criterion used in the determination unit.
  • FIG. 7 is a diagram illustrating a third example of the criterion used in the determination unit.
  • FIG. 8 is a diagram illustrating processing performed by an information processing apparatus according to a third example embodiment.
  • FIG. 9 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus according to a fourth example embodiment.
  • FIG. 1 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus 10 according to a first example embodiment.
  • the information processing apparatus 10 in the present example embodiment includes an image processing unit 110 , a determination unit 120 , and an output unit 130 .
  • the information processing apparatus 10 refers to a portable information processing apparatus such as a smartphone or a tablet, but the example embodiment is not limited thereto.
  • the information processing apparatus 10 may be a server apparatus.
  • the information processing apparatus 10 acquires “an image in which a product and an advertisement are disposed on a shelf rack are captured” (described later) from a portable terminal such as a smartphone or a tablet, and transmits a result of processing (described later) performed with the image, to the portable terminal.
  • the image processing unit 110 acquires a position of an advertisement and a position of a product by analyzing an image in which the product and the advertisement are disposed on a shelf rack are captured.
  • the determination unit 120 determines whether or not a relation between the position of the product and the position of the advertisement satisfies a criterion.
  • the output unit 130 outputs information indicating a determination result obtained by the determination unit 120 .
  • Each functional constituent unit of the information processing apparatus 10 may be realized by hardware (for example, hard-wired electronic circuit or the like) that realizes each functional constituent unit, or may be realized by a combination of hardware and software (for example, combination of an electronic circuit and a program for controlling the electronic circuit).
  • hardware for example, hard-wired electronic circuit or the like
  • software for example, combination of an electronic circuit and a program for controlling the electronic circuit.
  • the computer 1000 is a personal computer (PC), a server machine, a tablet terminal, or a smartphone.
  • the computer 1000 may be a dedicated computer designed for realizing the information processing apparatus 10 or may be a general-purpose computer.
  • FIG. 2 is a diagram illustrating a configuration of the computer 1000 that realizes the information processing apparatus 10 .
  • the computer 1000 includes a bus 1020 , a processor 1040 , a memory 1060 , a storage device 1080 , an input and output interface 1100 , and a network interface 1120 .
  • the bus 1020 is a data transmission path for causing the processor 1040 , the memory 1060 , the storage device 1080 , the input and output interface 1100 , and the network interface 1120 to transmit and receive data to and from each other.
  • a method of connecting the processor 1040 and the like to each other is not limited to a bus connection.
  • the processor 1040 is a processor configured with a central processing unit (CPU), a graphics processing unit (GPU), and the like.
  • the memory 1060 is a main storage configured with a random access memory (RAM) and the like.
  • the storage device 1080 is an auxiliary storage configured with a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.
  • HDD hard disk drive
  • SSD solid state drive
  • ROM read only memory
  • the input and output interface 1100 is an interface for connecting the computer 1000 and input and output devices to each other.
  • an input device such as a keyboard or an output device such as a display device is connected to the input and output interface 1100 .
  • the network interface 1120 is an interface for connecting the computer 1000 to a network.
  • the network is a local area network (LAN) or a wide area network (WAN), for example.
  • a method of connecting the network interface 1120 to the network may be a wireless connection or a wired connection.
  • the storage device 1080 stores program modules for implementing the functions (image processing unit 110 , determination unit 120 , and output unit 130 ) of the information processing apparatus 10 .
  • the processor 1040 executes each program module to realize the function corresponding to the program module.
  • the determination unit 120 determines whether or not the position of an advertisement when the position of a product is used as a basis satisfies a criterion. Thus, it is possible to save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined.
  • FIG. 3 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus 10 according to a second example embodiment.
  • the information processing apparatus 10 in the present example embodiment has a configuration similar to that of the information processing apparatus 10 according to the first example embodiment except for communicating with a storage unit 20 .
  • the storage unit 20 is a memory or a storage and is provided outside of the information processing apparatus 10 .
  • the storage unit 20 may be mounted in the information processing apparatus 10 .
  • the storage unit 20 stores a criterion used when the determination unit 120 performs determination, for each type of product, each product, each type of advertisement, or each advertisement.
  • Plural types of POP advertisements are provided.
  • the POP advertisement includes a type disposed on the front of a display shelf in a transverse direction, a type disposed on a post of a display shelf rack in a vertical direction, and a type disposed above a display shelf.
  • the storage unit 20 stores the criterion used when the determination unit 120 performs determination, along with information (advertisement type information) indicating the type.
  • the storage unit 20 may store the criterion for each POP advertisement (for each piece of advertisement identification information).
  • the POP advertisement may be prepared in a unit including plural types of products such as “food” and “household items”.
  • a POP advertisement dedicated for a specific product may be prepared.
  • the storage unit 20 may store a criterion used when the determination unit 120 performs determination, along with information (product type information) indicating the type of the product.
  • the storage unit 20 may store the criterion for each product (each piece of product identification information). It should be noted that, the criterion used here varies depending on the type of advertisement, the type of product, or the like. Specific examples thereof will be described later with reference to FIGS. 5 to 7 .
  • the storage unit 20 also stores various types of information used in image processing.
  • the storage unit 20 stores information (for example, feature value) required for determining a product by image processing, in association with product identification information for identifying the product.
  • the storage unit 20 stores information (for example, feature value) required for determining an advertisement by image processing, in association with advertisement identification information for identifying the advertisement.
  • the storage unit 20 may store a feature value for identifying the type of advertisement, for each type of advertisement (each piece of advertisement type information).
  • the storage unit 20 further stores advertisement type information corresponding to advertisement identification information and identification information of a product (product identification information) as a target of the advertisement, in association with the advertisement identification information.
  • the advertisement identification information may include information for determining the type of advertisement.
  • FIG. 4 is a flowchart illustrating a flow of processing performed by the information processing apparatus 10 in the second example embodiment.
  • the image processing unit 110 in the information processing apparatus 10 acquires an image to be processed (S 10 ).
  • the image is an image generated by imaging a display shelf rack.
  • the information processing apparatus 10 includes an imaging unit
  • the image may be generated by the imaging unit.
  • the image may be generated by an external imaging apparatus outside of the information processing apparatus 10 .
  • the image may be transmitted from the imaging apparatus to the information processing apparatus 10 or may be transmitted to the information processing apparatus 10 through a storage.
  • the image processing unit 110 determines the position of a product by analyzing the acquired image (S 20 ).
  • An example of analysis processing performed here is matching processing of a feature value.
  • the position determined in the analysis includes both a position in a height direction and a position in a horizontal direction.
  • the image processing unit 110 may further determine the type of product with information stored in the storage unit 20 .
  • the image processing unit 110 may further determine information regarding the product with information stored in the storage unit 20 .
  • the information regarding the product may include at least any of types of information such as a product name, an identifier (Japanese article number (JAN) code or the like), the name (for example, brand name) of a group to which the product belongs, a product category to which the product belongs, a content (for example, 350 ml) of the product, the size of the product, and a standard price and a maker (manufacturer or sales maker) of each product.
  • JAN Japanese article number
  • the image processing unit 110 determines the position of an advertisement by analyzing the acquired image (S 30 ).
  • An example of analysis processing performed here is matching processing of a feature value.
  • the position determined in the analysis also includes both a position in a height direction and a position in a horizontal direction.
  • the image processing unit 110 further determines the type of advertisement (advertisement identification information) or a product (product identification information) as a target of the advertisement, using information stored in the storage unit 20 .
  • the image processing unit 110 may determine the type of advertisement with information stored in the storage unit 20 .
  • the determination unit 120 determines whether or not the position of the advertisement when the position of the product is used as a basis satisfies a criterion, using an analysis result of the image processing unit 110 and information stored in the storage unit 20 (S 40 ). Specifically, the determination unit 120 reads a criterion associated with advertisement identification information determined by the image processing unit 110 or a criterion associated with advertisement type information determined by the image processing unit 110 . The determination unit 120 determines whether or not a relation between the position of the product and the position of the advertisement, which are determined by the image processing unit 110 satisfies the read criterion.
  • the output unit 130 outputs a determination result obtained by the determination unit 120 (S 50 ).
  • the output means, for example, that the determination result is output to a display apparatus included in the information processing apparatus 10 .
  • the output unit 130 may output an image in which information (for example, border line or arrow) for recognizing an advertisement which does not satisfies the criterion is superimposed on the image acquired by the image processing unit 110 .
  • the output unit 130 may transmit the determination result to the server or the storage unit 20 , so as to cause the server or the storage unit 20 to store the determination result.
  • the output unit 130 may perform the output only in a case where the criterion is not satisfied or may also perform the output in a case where the criterion is satisfied.
  • the determination unit 120 determines product identification information corresponding to the advertisement identification information determined by the image processing unit 110 , using information stored in the storage unit 20 .
  • the determination unit 120 preferably uses the position of a product corresponding to the determined product identification information, in the position of the product, which is determined by the image processing unit 110 , for the above-described determination.
  • the determination unit 120 preferably uses the position of the advertisement and the position of the product as the target of the advertisement, for the determination. It should be noted that, the determination unit 120 may determine whether or not the product identification information of the product as the target of the determination coincides with the product identification information corresponding to the advertisement identification information determined by the image processing unit 110 , instead of the above processing.
  • FIG. 5 is a diagram illustrating a first example of the criterion used in the determination unit 120 .
  • a product 210 is disposed on a display shelf rack 200
  • an advertisement 220 is attached to the front of the display shelf rack 200 .
  • the criterion used by the determination unit 120 is a distance between the product 210 and the advertisement 220 (for example, a distance between the center of the product 210 and the center of the advertisement 220 ).
  • the determination unit 120 determines that the advertisement is disposed at a correct position.
  • the determination unit 120 determines that the advertisement is disposed at an incorrect position.
  • FIG. 6 is a diagram illustrating a second example of the criterion used in the determination unit 120 .
  • the positions of the product 210 and the advertisement 220 are identical to those in the first example. Therefore, the advertisement 220 extends in a width direction.
  • the criterion used by the determination unit 120 means, for example, whether or not a one-dimensional position of the product 210 in a width direction of an image acquired by the image processing unit overlaps a one-dimensional position of the advertisement 220 in the width direction of the same image.
  • the determination unit 120 determines whether or not an area indicated by w M in FIG. 6 (one-dimensional position of the product 210 in the width direction of the image) overlaps an area indicated by w A in FIG.
  • the determination unit 120 determines that the advertisement is disposed at a correct position. In a case where the areas do not overlap each other, the determination unit 120 determines that the advertisement is disposed at an incorrect position.
  • FIG. 7 is a diagram illustrating a third example of the criterion used in the determination unit 120 .
  • the advertisement 220 extends vertically (in a height direction) along the post of the display shelf rack 200 .
  • the criterion used by the determination unit 120 means, for example, whether or not a one-dimensional position of the product 210 in a height direction of an image acquired by the image processing unit overlaps a one-dimensional position of the advertisement 220 in the height direction of the same image.
  • the determination unit 120 determines whether or not an area indicated by h M in FIG. 7 (one-dimensional position of the product 210 in the height direction of the image) overlaps an area indicated by h A in FIG.
  • the determination unit 120 determines that the advertisement is disposed at a correct position. In a case where the areas do not overlap each other, the determination unit 120 determines that the advertisement is disposed at an incorrect position.
  • the criterion used by the determination unit 120 is not limited to the examples illustrated in FIGS. 5 to 7 .
  • the image processing unit 110 may determine the number of advertisements per one shelf, and the determination unit 120 may determine whether or not the determined number satisfies the specified number.
  • the image processing unit 110 may determine an inclination of the advertisement. In this case, the determination unit 120 may determine whether or not the inclination exceeds a predetermined value.
  • the product 210 is placed on the display shelf rack 200 , but the product 210 may be placed on a wagon. In this case, for example, the criterion illustrated in FIG. 5 may be used.
  • the determination unit 120 may determine whether or not the position of the advertisement is disposed at a correct position.
  • a degree of coincidence (score) between the image of the display shelf rack and the image acquired by the image processing unit 110 may be computed, and it may be determined whether or not the degree of coincidence is equal to or more than a criterion value.
  • the output unit 130 outputs the determination result.
  • the determination unit 120 may determine whether or not the advertisement is posted in an accurate period.
  • the output unit 130 also outputs the determination result.
  • the storage unit 20 stores a period in which the advertisement is to be posted, in association with advertisement identification information.
  • the image processing unit 110 acquires information indicating date and time on which an image to be processed is captured, along with the image.
  • the determination unit 120 determines whether or not the date and time acquired by the image processing unit 110 are included in the period stored by the storage unit 20 . It should be noted that, the output unit 130 may perform the output only in a case of being out of the period.
  • the determination unit 120 also determines whether or not the position of an advertisement when the position of a product is used as a basis satisfies a criterion. Thus, it is possible to save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined.
  • FIG. 8 is a diagram illustrating processing performed by an information processing apparatus 10 according to a third example embodiment.
  • the information processing apparatus 10 performs processing as follows, in addition to the processing described in the second example embodiment.
  • a shelf label 230 is attached to the display shelf rack 200 .
  • the image processing unit 110 determines the position of the shelf label 230 .
  • the image processing unit 110 determines a product as a target of the shelf label 230 in image processing.
  • the image processing used here is, for example, character recognition processing, but may be processing of reading a code (for example, a barcode or a two-dimensional code) included in the shelf label 230 .
  • the image processing unit 110 determines product determination information of the product.
  • the product determination information is not particularly limited.
  • the product determination information includes the name of a product, which is acquired by character recognition processing, product identification information read from a code (JAN code or the like), an image feature value that can be extracted from an image area recognized as a product in image processing.
  • the determination unit 120 determines whether or not product identification information of the product as the target of the advertisement 220 coincides with product identification information in the shelf label 230 nearest to the advertisement 220 .
  • the output unit 130 outputs the determination result. It should be noted that, the output unit 130 may perform the output only in a case where the pieces of information do not coincide with each other.
  • the determination unit 120 also determines whether or not the position of an advertisement when the position of a product is used as a basis satisfies a criterion. Thus, it is possible to save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined. The determination unit 120 further determines whether or not the product as the target of the shelf label coincides with the product as the target of the advertisement. Thus, it is possible to further save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined.
  • FIG. 9 is a block diagram conceptually illustrating a functional configuration of an information processing apparatus 10 according to a fourth example embodiment.
  • the information processing apparatus 10 has a configuration similar to the configuration of the information processing apparatus 10 according to the second example embodiment or the third example embodiment except that information stored by a sales storage unit 22 can be read, and an analysis unit 140 is provided.
  • the sales storage unit 22 stores sales data in a store providing the advertisement 220 .
  • the data may be summed up as sales data for each product identification information and for each period.
  • the storage unit 20 stores information indicating a period in which an advertisement is posted, for each advertisement, in association with product determination information as a target of the advertisement. Further, the storage unit 20 stores information indicating whether or not the position of the advertisement satisfies the criterion, in order words, information indicating a determination result obtained by the determination unit 120 , for each advertisement.
  • the analysis unit 140 generates information indicating a relation between the determination result obtained by the determination unit 120 for a certain advertisement and sales of the product on the date and time on which the advertisement is posted. For example, the analysis unit 140 reads a period in which a certain advertisement is provided, and product determination information of a product as a target of the advertisement, by using information stored in the storage unit 20 . The analysis unit 140 computes the summed value of sales corresponding to the read product determination information in the read period and associates the computation result with the information indicating the determination result obtained by the determination unit 120 . The output unit 130 outputs the summed value and the information indicating a determination result obtained by the determination unit 120 .
  • the determination unit 120 also determines whether or not the position of an advertisement when the position of a product is used as a basis satisfies a criterion. Thus, it is possible to save labor of checking whether an advertisement is disposed on a shelf rack or the like as defined.
  • the output unit 130 outputs the sales in the period in which the advertisement is posted and information (determination result obtained by the determination unit 120 ) indicating whether or not the advertisement is correctly posted. Therefore, it is possible to verify a sales promotion effect by an advertisement with high accuracy.
  • An information processing apparatus including:
  • an image processing unit that acquires a position of an advertisement and a position of a product by analyzing an image in which the product and the advertisement are disposed on a shelf rack are captured;
  • a determination unit that determines whether or not a relation between the position of the product and the position of the advertisement satisfies a criterion
  • an output unit that outputs information indicating a determination result obtained by the determination unit.
  • the determination unit reads the criterion from a storage unit that stores the criterion for each type of the product, each product, each type of the advertisement, or each advertisement.
  • the criterion indicates a distance between the product and the advertisement.
  • the shelf rack includes a plurality of tiers
  • the determination unit determines whether or not a one-dimensional position of the product in a height direction of the image overlaps a one-dimensional position of the advertisement in the height direction of the image, or whether or not a one-dimensional position of the product in a width direction of the image overlaps a one-dimensional position of the advertisement in the width direction of the image.
  • the image processing unit determines a type of the product and a type of a product as a target of the advertisement, by analyzing the image, and
  • the determination unit determines whether or not the type of the product and the type of the product as the target of the advertisement, which are determined by the image processing unit, coincide with each other, in addition to the determination of the criterion.
  • the image processing unit further determines a position of a shelf label provided on the shelf rack and a type of a product as a target of the shelf label
  • the determination unit determines whether or not a type of a product as a target of the advertisement coincides with a type of a product as a target of a shelf label nearest to the advertisement.
  • the determination unit determines whether or not the position of the advertisement satisfies a second criterion different from the criterion.
  • the determination unit reads a period in which the advertisement is to be posted for each type of the advertisement, from a storage unit that stores the period, and determines whether or not date and time on which the image is captured is included in the period.
  • an analysis unit that generates information indicating a relation between a determination result obtained by the determination unit and sales of the product in a period in which the advertisement is posted
  • the output unit outputs the information generated by the analysis unit.
  • An information processing method executed by a computer including:
  • the criterion indicates a distance between the product and the advertisement.
  • the shelf rack includes a plurality of tiers
  • the method including:
  • a program causing a computer to perform the information processing method according to any one of 10. to 18.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Resources & Organizations (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Display Racks (AREA)
  • Image Analysis (AREA)
US16/651,675 2017-09-29 2018-08-03 Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product Active US11308516B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2017-191792 2017-09-29
JPJP2017-191792 2017-09-29
JP2017191792 2017-09-29
PCT/JP2018/029188 WO2019064926A1 (ja) 2017-09-29 2018-08-03 情報処理装置、情報処理方法、およびプログラム

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/029188 A-371-Of-International WO2019064926A1 (ja) 2017-09-29 2018-08-03 情報処理装置、情報処理方法、およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/693,529 Continuation US11842368B2 (en) 2017-09-29 2022-03-14 Information processing apparatus, information processing method,and program for identifying whether an advertisement is positioned in association with a product

Publications (2)

Publication Number Publication Date
US20200273066A1 US20200273066A1 (en) 2020-08-27
US11308516B2 true US11308516B2 (en) 2022-04-19

Family

ID=65903075

Family Applications (3)

Application Number Title Priority Date Filing Date
US16/651,675 Active US11308516B2 (en) 2017-09-29 2018-08-03 Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product
US17/693,529 Active US11842368B2 (en) 2017-09-29 2022-03-14 Information processing apparatus, information processing method,and program for identifying whether an advertisement is positioned in association with a product
US18/481,535 Active US12248961B2 (en) 2017-09-29 2023-10-05 Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product

Family Applications After (2)

Application Number Title Priority Date Filing Date
US17/693,529 Active US11842368B2 (en) 2017-09-29 2022-03-14 Information processing apparatus, information processing method,and program for identifying whether an advertisement is positioned in association with a product
US18/481,535 Active US12248961B2 (en) 2017-09-29 2023-10-05 Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product

Country Status (3)

Country Link
US (3) US11308516B2 (ja)
JP (3) JP7167926B2 (ja)
WO (1) WO2019064926A1 (ja)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7259754B2 (ja) * 2017-09-29 2023-04-18 日本電気株式会社 情報処理装置、情報処理方法、およびプログラム
US11514665B2 (en) * 2020-04-01 2022-11-29 Scandit Ag Mapping optical-code images to an overview image
JP7360660B1 (ja) 2022-09-09 2023-10-13 株式会社マーケットヴィジョン 情報処理システム
JP7592252B1 (ja) * 2023-09-15 2024-12-02 株式会社マーケットヴィジョン 情報処理システム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080306787A1 (en) * 2005-04-13 2008-12-11 Craig Hamilton Method and System for Automatically Measuring Retail Store Display Compliance
US20090063307A1 (en) * 2007-08-31 2009-03-05 Groenovelt Robert Bernand Robin Detection Of Stock Out Conditions Based On Image Processing
JP2014008682A (ja) 2012-06-29 2014-01-20 Teraoka Seiko Co Ltd 印刷装置
US20160063519A1 (en) 2014-08-27 2016-03-03 Nec Corporation Data analysis apparatus, data analysis system, commodity exchange forecasting apparatus, commodity exchange forecasting system, data analysis method, commodity exchange forecasting method, and computer-readable medium
WO2016052383A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、制御方法、及びプログラム
WO2016052379A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、棚札管理システム、制御方法、及びプログラム
WO2016052382A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、棚札管理システム、制御方法、及びプログラム
US20170178226A1 (en) * 2015-12-18 2017-06-22 Ricoh Co., Ltd. Suggestion Generation Based on Planogram Matching

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4862145B2 (ja) 2005-03-30 2012-01-25 株式会社Ｊｖｃケンウッド 広告画像表示装置
JP5125445B2 (ja) * 2007-11-26 2013-01-23 株式会社寺岡精工 印字システム
JP2011059890A (ja) * 2009-09-08 2011-03-24 Canon It Solutions Inc 情報処理システム及びその制御方法、プログラム
JP6263046B2 (ja) * 2014-02-26 2018-01-17 東芝テック株式会社 情報処理装置及びプログラム
US20150262116A1 (en) * 2014-03-16 2015-09-17 International Business Machines Corporation Machine vision technology for shelf inventory management
JP2016194833A (ja) * 2015-03-31 2016-11-17 富士通株式会社 商品陳列位置の判定処理方法、商品陳列位置の判定処理プログラム、及び商品陳列位置の判定処理装置
KR102216498B1 (ko) * 2016-05-19 2021-02-17 심베 로보틱스 인코포레이션 상점의 선반 상의 제품의 배치를 추적하기 위한 방법
WO2018002709A2 (en) * 2016-06-29 2018-01-04 Adato Yair Identifying products using a visual code
CA2975835A1 (en) * 2016-08-23 2018-02-23 Wal-Mart Stores, Inc. System and method for managing retail products

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080306787A1 (en) * 2005-04-13 2008-12-11 Craig Hamilton Method and System for Automatically Measuring Retail Store Display Compliance
US20090063307A1 (en) * 2007-08-31 2009-03-05 Groenovelt Robert Bernand Robin Detection Of Stock Out Conditions Based On Image Processing
JP2014008682A (ja) 2012-06-29 2014-01-20 Teraoka Seiko Co Ltd 印刷装置
US20160063519A1 (en) 2014-08-27 2016-03-03 Nec Corporation Data analysis apparatus, data analysis system, commodity exchange forecasting apparatus, commodity exchange forecasting system, data analysis method, commodity exchange forecasting method, and computer-readable medium
JP2016048409A (ja) 2014-08-27 2016-04-07 日本電気株式会社 データ解析装置、データ解析システム、売上予測装置、売上予測システム、データ解析方法、売上予測方法、プログラムおよび記録媒体
WO2016052383A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、制御方法、及びプログラム
WO2016052379A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、棚札管理システム、制御方法、及びプログラム
WO2016052382A1 (ja) 2014-09-30 2016-04-07 日本電気株式会社 情報処理装置、棚札管理システム、制御方法、及びプログラム
US20170278056A1 (en) 2014-09-30 2017-09-28 Nec Corporation Information processing apparatus, control method, and program
US20170178226A1 (en) * 2015-12-18 2017-06-22 Ricoh Co., Ltd. Suggestion Generation Based on Planogram Matching

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
International Search Report for PCT/JP2018/029188, dated Oct. 30, 2018.

Also Published As

Publication number Publication date
US20200273066A1 (en) 2020-08-27
JP2022183305A (ja) 2022-12-08
JP7167926B2 (ja) 2022-11-09
JP7476938B2 (ja) 2024-05-01
WO2019064926A1 (ja) 2019-04-04
JP2024086930A (ja) 2024-06-28
US11842368B2 (en) 2023-12-12
US20240029104A1 (en) 2024-01-25
US12248961B2 (en) 2025-03-11
JPWO2019064926A1 (ja) 2020-11-26
US20220198512A1 (en) 2022-06-23
JP7652315B2 (ja) 2025-03-27

Similar Documents

Publication Publication Date Title
US12248961B2 (en) Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product
US12412150B2 (en) Information processing apparatus, control method, and program
JP7662088B2 (ja) 情報処理装置、情報処理方法、およびプログラム
US20180315065A1 (en) Method and apparatus for extracting and processing price text from an image set
CN108629318B (zh) 一种基于图像识别技术的货架陈列识别方法、装置和系统
US20160063519A1 (en) Data analysis apparatus, data analysis system, commodity exchange forecasting apparatus, commodity exchange forecasting system, data analysis method, commodity exchange forecasting method, and computer-readable medium
JP2018131331A (ja) 物品管理装置及び物品管理方法
WO2016052382A1 (ja) 情報処理装置、棚札管理システム、制御方法、及びプログラム
US20190333004A1 (en) Processing system, processing method, and non-transitory storage medium
US11710386B2 (en) Processing apparatus, and accounting apparatus
JP7200487B2 (ja) 精算システム、精算方法及びプログラム
TWI651669B (zh) 依物品保存期限降價折扣系統及其方法
US20190328157A1 (en) Inspection system, information collection apparatus, inspection method, information collection method, and non-transitory storage medium
JP7697587B2 (ja) 商品数特定装置、商品数特定方法、及びプログラム
JP7831488B2 (ja) 商品管理装置、商品管理方法、及びプログラム
US20250157016A1 (en) Product quantity determination apparatus, product quantity determination method, and non-transitory computer-readable medium
US20220148017A1 (en) Processing apparatus, and processing method

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: NEC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YONEZAWA, YAEKO;HORITA, KAITO;YAJIMA, AKIRA;AND OTHERS;REEL/FRAME:052256/0298

Effective date: 20200121

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4