JP7273313B2 - Information processing system, information processing method, and information processing program - Google Patents

Description

The present invention relates to an information processing system, an information processing method, and an information processing program capable of providing information to users of ticket vending machines and the like.

Conventionally, in a ticket vending machine that sells meal tickets, etc., when a user operates a product selection button, a photographic image representing the content of the product or service (product, etc.) corresponding to the selection button is displayed on the display. It has been proposed (see Patent Document 1, for example).

JP-A-10-232955

Here, when a user purchases a meal ticket from a ticket vending machine, the user finds and selects a selection button for a product that the user wishes to purchase from among a plurality of selection buttons. In this case, if the user cannot quickly find the selection button for the desired product, not only will it take time to purchase the meal ticket, but other users will be kept waiting. Such problems are caused by various vending machines, such as ticket vending machines that issue various tickets such as restaurant tickets, facility usage tickets, and transportation tickets, and vending machines that sell products (goods) such as beverages. can occur in

An object of the present invention is to provide an information processing system, an information processing method, and an information processing program capable of improving operability when selecting an operation unit in a vending machine.

According to one aspect of the present invention, an acquisition processing unit is provided in a vending machine and acquires a captured image of a plurality of operation units each of which is assigned a product that can be purchased using the vending machine; a display processing unit that causes a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the processing unit; a first product corresponding to the first product selected by the user based on the captured image acquired by the acquisition processing unit; Information processing comprising: a specification processing unit that specifies a position of an operation unit; and a presentation processing unit that presents, to the user terminal, identification information that enables identification of the position of the first operation unit specified by the specification processing unit. System.

Another aspect of the present invention is an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine, each of which is assigned an item that can be purchased using the vending machine, and the acquisition step. a display step of displaying on a user terminal the product information of the product assigned to each of the plurality of operation units based on the captured image acquired by; and in the product information displayed on the user terminal, a receiving step of receiving a selection operation of a first product from a user; and a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step. An information processing method in which one or a plurality of processors execute a specifying step of specifying and a presenting step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step. is.

Another aspect of the present invention is an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine, each of which is assigned an item that can be purchased using the vending machine, and the acquisition step. a display step of displaying on a user terminal the product information of the product assigned to each of the plurality of operation units based on the captured image acquired by; and in the product information displayed on the user terminal, a receiving step of receiving a selection operation of a first product from a user; and a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step. Information for causing one or a plurality of processors to execute a specifying step of specifying and a presenting step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step processing program.

ADVANTAGE OF THE INVENTION According to this invention, the information processing system, the information processing method, and the information processing program which can improve the operability at the time of selecting an operation part in a vending machine are provided.

FIG. 1 is a block diagram showing the configuration of an information processing system according to an embodiment of the invention. FIG. 2 is a front view showing the appearance of the ticket vending machine according to the embodiment of the present invention. FIG. 3 is a diagram showing how the ticket vending machine according to the embodiment of the present invention is photographed by a user terminal. FIG. 4 is a diagram showing an example of product information used in the information processing system according to the embodiment of the present invention. FIG. 5 is a diagram showing an example of layout information used in the information processing system according to the embodiment of the present invention. FIG. 6 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 7 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 8 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 9 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 10 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 11 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 12 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 13 is a diagram showing an example of a selection method of selection buttons of the ticket vending machine according to the embodiment of the present invention. FIG. 14 is a flow chart showing an example of information provision processing executed by the information processing system according to the embodiment of the present invention. FIG. 15 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention. FIG. 16 is a diagram showing a display example of the user terminal in the information processing system according to the embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings for understanding of the present invention. It should be noted that the following embodiment is an example that embodies the present invention, and does not limit the technical scope of the present invention.

[Information processing system 1]
As shown in FIG. 1, an information processing system 1 according to an embodiment of the present invention includes an information providing device 2, one or more ticket vending machines 3, and one or more user terminals 4. FIG. The information providing device 2, the ticket vending machine 3, and the user terminal 4 can communicate via a communication network N1 such as the Internet, LAN, WAN, or public telephone line.

The information providing device 2 presents product information (product pages) of products that can be purchased using the ticket vending machine 3 to the user terminal 4, and performs information processing capable of receiving an operation to select a desired product from the user terminal 4. It is a device. Hereinafter, in the present embodiment, the case where the vending machine of the present invention is a ticket vending machine that is installed in a restaurant and issues food tickets for products (menu such as food and drink) that the restaurant can provide will be taken as an example. explain. The vending machine of the present invention may be, for example, a ticket vending machine that issues facility use tickets (entrance tickets, etc.), transportation tickets, etc. It may be a vending machine. The user terminal 4 is an information processing device operated by a user who uses the ticket vending machine 3 .

In this embodiment, the information providing device 2 alone corresponds to the information processing system according to the present invention, but the information processing system according to the present invention includes one or more of the information providing device 2, the ticket vending machine 3, and the user terminal 4. It may contain a plurality of components. For example, when a plurality of components among the information providing device 2, the ticket vending machine 3, and the user terminal 4 work together to share and execute an information providing process (see FIG. 14), which will be described later, the process A system including a plurality of executing components can be regarded as an information processing system according to the present invention. For example, the information providing device 2 and the ticket vending machine 3 may configure the information processing system according to the present invention, or the ticket vending machine 3 alone may configure the information processing system according to the present invention.

[Ticket vending machine 3]
As shown in FIG. 1, the ticket vending machine 3 includes a control section 31, a storage section 32, an operation section 33, a communication I/F 34, and the like. FIG. 2 is an external view of the ticket vending machine 3. As shown in FIG. The ticket vending machine 3 may be a device as shown in FIG. 2, or may be an information processing device such as a tablet terminal or a personal computer.

As shown in FIG. 2, the ticket vending machine 3 is provided with a selection button B1 (operation unit 33) for each product (food and drink) provided at the restaurant. The plurality of selection buttons B1 are arranged in a matrix at equal intervals in the vertical and horizontal directions, for example. The product is assigned to each selection button B1. The selection button B1 is an example of the operating section of the present invention.

For example, when a user visits a restaurant and decides which product to purchase (purchased product) at the ticket vending machine 3 installed near the entrance of the restaurant, the user inserts the necessary money into the money slot 35 and The user selects (presses) the selection button B1 on which the purchased product is displayed. When receiving a selection operation from the user, the ticket vending machine 3 performs settlement processing and issues a meal ticket for the purchased product from the outlet 36 . For example, when the user inserts "300 yen" into the money slot 35 and presses the "soba" selection button B1, the ticket vending machine 3 issues a "soba" meal ticket. The user can also insert necessary money into the money slot 35 and continuously select the respective selection buttons B1 for a plurality of purchased products.

Note that the ticket vending machine 3 may issue a meal ticket made of paper media, or may issue a meal ticket made of electronic data such as a two-dimensional code. For example, the ticket vending machine 3 may display the two-dimensional code on a display unit (not shown) of the ticket vending machine 3 and cause the user terminal 4 to read the two-dimensional code. You may send.

The communication I/F 34 connects the ticket vending machine 3 to the communication network N1 by wire or wirelessly, and performs data communication according to a predetermined communication protocol with an external device such as the information providing device 2 via the communication network N1. It is a communication interface for

The operation unit 33 is a selection button B1 that receives a selection operation for purchasing a product from the user. The operation unit 33 may be buttons realized by physical hard keys, or may be buttons realized by electronic images displayed on a touch panel.

The storage unit 32 is a non-volatile storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various types of information. Specifically, the storage unit 32 stores product information that associates a product that can be provided at the restaurant with the selection button B1 assigned to the product. For example, the storage unit 32 stores product information such as individual products such as “udon” and “soba” and combination products (topping products) combined with individual products such as “rice” and “large portion”. The storage unit 32 also stores layout information indicating the layout of the selection buttons B1. In the ticket vending machine 3 shown in FIG. 2, product information of products (menus) corresponding to 16 selection buttons B1 arranged in four rows in the vertical direction and four columns in the horizontal direction, and layout information (coordinates) of the layout of the selection buttons B1. information) is stored in the storage unit 32 .

When the ticket vending machine 3 is a device for issuing facility use tickets, the storage unit 32 stores "admission ticket", "admission ticket + 5 rides ticket", "admission ticket + unlimited rides", "rides Merchandise information such as 1-ride ticket, 5-ride ticket, etc. is stored.

For example, the manager of the restaurant refers to the arrangement layout at a facility terminal (not shown) connected to the ticket vending machine 3 via the communication network N1, and sets the product and the price of the product to each selection button B1. perform the setting operation. Also, when there is a change in the product or the price of the product provided at the restaurant, the administrator performs a change operation to change the setting content. The control unit 31 stores the product information in the storage unit 32 according to the setting operation and the change operation. Further, the control section 31 causes the selection button B1 to display the product name, the price, etc. according to the product information and the layout information.

Moreover, the storage unit 32 may store the product information in a plurality of languages. As a result, the product information corresponding to the language used by the user of the ticket vending machine 3 can be displayed on the selection button B1.

The storage unit 32 may also store data such as images of the products, history information such as purchase history, and sales information. The image of the product may be displayed on the selection button B1. The image of the product may be a captured image (photographic image) or an illustration image. When an image is displayed on the selection button B1, it becomes easier for the user of the ticket vending machine 3 to visually grasp the product (menu).

The storage unit 32 also stores a control program for causing the control unit 31 to execute various processes. For example, the control program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and read by a reading device (not shown) such as a CD drive or DVD drive provided in the ticket vending machine 3. It is stored in the storage unit 32 .

The control unit 31 has control devices such as a CPU, ROM, and RAM. The CPU is a processor that executes various kinds of arithmetic processing. The ROM is a non-volatile storage unit in which control programs such as BIOS and OS for causing the CPU to execute various arithmetic processes are stored in advance. The RAM is a volatile or nonvolatile storage unit that stores various information, and is used as a temporary storage memory (work area) for various processes executed by the CPU. The control unit 31 controls the ticket vending machine 3 by causing the CPU to execute various control programs pre-stored in the ROM or storage unit 32 .

The control unit 31 functions as the various processing units by executing various types of processing according to the control program by the CPU. Also, part or all of the processing unit may be configured by an electronic circuit. Note that the control program may be a program for causing a plurality of processors to function as the processing unit.

Specifically, the control unit 31 receives the setting operation and the change operation, stores the product information in the storage unit 32, and updates the stored product information. Further, the control unit 31 displays the product information (product name, price, etc.) on the selection button B1. The control unit 31 may display the product image on the selection button B1.

The control unit 31 also executes settlement processing for purchased products, ticket issuing processing for meal tickets corresponding to purchased products, and the like.

In addition, in the present invention, the ticket vending machine 3 can apply a well-known configuration. For example, an existing ticket vending machine in the facility can be used as the ticket vending machine of the present invention.

[Information providing device 2]
As shown in FIG. 1, the information providing device 2 is an information processing device (for example, a server) including a control unit 21, a storage unit 22, an operation display unit 23, a communication I/F 24, and the like. The information providing device 2 is not limited to one computer, and may be a computer system in which a plurality of computers operate in cooperation. Various types of processing executed by the information providing device 2 may be distributed and executed by one or more processors.

The communication I/F 24 connects the information providing device 2 to the communication network N1 by wire or wirelessly, and communicates with external devices such as the ticket vending machine 3 and the user terminal 4 via the communication network N1 according to a predetermined communication protocol. It is a communication interface for executing data communication.

The operation display unit 23 is a user interface that includes a display unit such as a liquid crystal display or an organic EL display that displays various information, and an operation unit such as a mouse, keyboard, or touch panel that receives operations.

The storage unit 22 is a nonvolatile storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various types of information. Specifically, the storage unit 22 stores data such as product information D1 and layout information D2. Based on a captured image (described later) acquired from the user terminal 4, the control unit 21 identifies and identifies the product to be assigned to each of the plurality of selection buttons B1 and the position of each of the plurality of selection buttons B1. The information on the product and the position is recorded and registered in the product information D1 of the storage unit 22 . Further, the control unit 21 updates the product and the position of the product information D1 each time the captured image is acquired. Further, the control unit 21 specifies the layout of the plurality of selection buttons B1 based on the captured image, and stores the layout information D2 of the specified layout in the storage unit 22 .

FIG. 3 shows an example of how the user takes an image of the selection button B1 of the ticket vending machine 3 using the user terminal 4. As shown in FIG. For example, the user activates the camera 45 mounted on the user terminal 4, adjusts the positions so that all the selection buttons B1 provided on the ticket vending machine 3 are included in the photographing range, and photographs. FIG. 3 shows a captured image CP captured by the user terminal 4. As shown in FIG. The user terminal 4 transmits image data of the captured image CP to the information providing device 2 . Note that the captured image CP may be captured by an administrator terminal (not shown) of an administrator of the restaurant. In this case, the administrator terminal transmits the image data of the captured image CP to the information providing device 2 .

FIG. 4 is a diagram showing an example of product information D1. FIG. 5 is a diagram showing an example of the layout information D2.

As shown in FIG. 4, the product information D1 includes "product ID", "product name", and "product ID" for each product (food and drink) that can be provided by a restaurant (for example, "G Shokudo") where the ticket vending machine 3 is installed. ", "image ID", "price", "position", and the like. "Product ID" is identification information for identifying the product. The “product name” is the name of the product and is specified by image analysis of the captured image CP. For example, the control unit 21 identifies the product name by recognizing characters included in the captured image CP by OCR (Optical Character Recognition). "Image ID" is identification information for identifying a product image (captured image) of the product. For example, the control unit 21 extracts the product image of each product from the captured image CP, assigns identification information (image ID) to each product image, and stores the image data of each product image in the storage unit 22 . Image data of product images provided by the restaurant may be stored in the storage unit 22 . The "price" is the amount of money for purchasing the product, and is specified by image analysis of the captured image CP.

"Position" is position information indicating the position of the selection button B1 assigned to the product. Here, as shown in FIG. 5, the layout information D2 includes a layout image corresponding to the arrangement layout of the plurality of selection buttons B1 provided in the ticket vending machine 3 installed in a restaurant (for example, "G dining room"), Position information (coordinate information) of each selection button B1 is included. For example, in the ticket vending machine 3 shown in FIG. 2, 16 selection buttons B1 are arranged in four rows in the vertical direction and four columns in the horizontal direction. Registered in information D2. The position information (coordinate information) of the layout information D2 is registered in the "position" of the product information D1. The control unit 21 identifies the arrangement of the 16 selection buttons B1 based on the captured image CP, and assigns coordinates to each selection button B1. The control unit 21 registers a layout image (matrix image) corresponding to the layout of the 16 selection buttons B1 and the coordinates of each selection button B1 in the layout information D2.

The control unit 21 refers to the layout information D2 and registers the position (coordinates) corresponding to each product in the product information D1. For example, when specifying “udon” from the captured image CP, the control unit 21 acquires the position information “x1, y1” corresponding to the position of “udon” in the captured image CP from the layout information D2, and obtains the product “udon”. Register in association with Further, for example, when specifying “B set meal” from the captured image CP, the control unit 21 obtains position information “x2, y3” corresponding to the position of “B set meal” in the captured image CP from the layout information D2, and Register in association with "B set meal".

Here, since the number of selection buttons B1 provided in the ticket vending machine 3 is limited (the upper limit is 16 in the example of FIG. 2), there are products that can be provided to the user but cannot be assigned to the selection buttons B1. Sometimes. Such products may be registered in the product information D1. The product is, for example, a product (set product) configured by combining a plurality of products corresponding to a plurality of selection buttons B1. For example, "kitsune udon" consisting of a combination of "udon" and "fried tofu", "tsukimi udon" consisting of a combination of "udon" and "raw egg", "udon" and "rice" Such as the "udon rice set" that consists of. For example, the control unit 21 identifies a product assigned to each selection button B1 based on the captured image CP, and identifies a set product that can be combined with the specified products. After specifying the set product, the control unit 21 registers the product name of the set product in the "product name" of the product information D1. In addition, the information of the said set goods may be separately provided from a restaurant. The identification information of the image of the set product is registered in the "image ID" of the product information D1. In the "price" of the product information D1, the price of the set product, for example, the total price of the price of "udon" and the price of "fried bean curd" is registered. Further, in the "position" of the product information D1, the position information of each position of the plurality of products constituting the set product is registered. For example, "kitsune udon" is registered in association with the position "x1, y1" of "udon" and the position "x2, y4" of "fried tofu". The position "x1, y1" of "udon" and the position "x1, y4" of "raw egg" are associated with "tsukimi udon" and registered.

In this way, even if the product information D1 contains not only the information of the single product corresponding to each selection button B1 of the ticket vending machine 3 of the restaurant, but also the information of the set product composed of a plurality of selection buttons B1 is registered. good.

The storage unit 22 also stores layout data and image data for generating various web pages such as product pages and layout image pages included in the product information providing site displayed on the user terminal 4. there is In this embodiment, the control unit 21 of the information providing device 2 generates the various web pages and transmits the information of the web pages to the user terminal 4, thereby allowing the user terminal 4 to receive the various web pages. A web page can be displayed. Further, as another embodiment, the control unit 21 of the information providing device 2 transmits data necessary for displaying the various web pages to the user terminal 4, thereby causing the control unit 41 of the user terminal 4 to may be caused to display the various web pages.

The product information providing site may be a set of web pages belonging to one domain set in advance, but for example, a set of web pages belonging to a plurality of domains stored in the same information providing device 2 The body may be regarded as the product information providing site. Further, various pages included in the product information providing site may be distributed and stored in a plurality of servers.

As another embodiment, part or all of the information such as the product information D1 and the layout information D2 is stored in the ticket vending machine 3 or another server accessible from the information providing device 2 via the communication network N1. good too.

Further, the storage unit 22 stores a control program such as an information providing program (an example of the information processing program of the present invention) for causing the control unit 21 to execute an information providing process (see FIG. 14), which will be described later. For example, the information providing program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and read by a reading device (not shown) such as a CD drive or DVD drive provided in the information providing device 2. and stored in the storage unit 22 .

The control unit 21 has control devices such as a CPU, ROM, and RAM. The CPU is a processor that executes various kinds of arithmetic processing. The ROM is a non-volatile storage unit in which control programs such as BIOS and OS for causing the CPU to execute various arithmetic processes are stored in advance. The RAM is a volatile or nonvolatile storage unit that stores various information, and is used as a temporary storage memory (work area) for various processes executed by the CPU. The control unit 21 controls the information providing device 2 by causing the CPU to execute various control programs pre-stored in the ROM or storage unit 22 .

By the way, when the user purchases a meal ticket from the ticket vending machine 3, the user finds the selection button B1 of the product that the user wishes to purchase from among the plurality of selection buttons B1 and selects it. In this case, if the user cannot quickly find the selection button B1 for the desired product, it will not only take time to purchase the meal ticket, but also other users will have to wait. On the other hand, in the information providing device 2 according to the present embodiment, it is possible to improve the operability when selecting the selection button B1 on the ticket vending machine 3, as described below.

Specifically, the control unit 21 includes various processing units such as an acquisition processing unit 211, a display processing unit 212, a reception processing unit 213, a specific processing unit 214, and a presentation processing unit 215, as shown in FIG. The control unit 21 functions as the various processing units by executing various types of processing according to the information providing program by the CPU. Also, part or all of the processing unit may be configured by an electronic circuit. The information providing program may be a program for causing a plurality of processors to function as the processing unit.

The acquisition processing unit 211 acquires a captured image CP of a plurality of selection buttons B1 provided in the ticket vending machine 3 and each of which is assigned a product that can be purchased using the ticket vending machine 3 . For example, the acquisition processing unit 211 acquires the captured image CP (see FIG. 3) captured by the user terminal 4 . The acquisition processing unit 211 may acquire the captured image CP captured by the manager terminal of the facility (restaurant) in which the ticket vending machine 3 is installed.

Also, the acquisition processing unit 211 identifies the product assigned to each of the plurality of selection buttons B1 and the position of each of the plurality of selection buttons B1 based on the captured image CP. Then, the acquisition processing unit 211 stores the product and the position specified based on the captured image CP in the product information D1 (see FIG. 4) of the storage unit 22, and acquires the product information each time the captured image CP is acquired. Update the item and the location in D1.

Specifically, the acquisition processing unit 211 performs image analysis on the captured image CP, identifies product information (product name, price, etc.) for each product, assigns an arbitrary product ID, and registers the information in the product information D1. . In addition, the acquisition processing unit 211 performs image analysis on the captured image CP, extracts the product image for each product, stores the image data of the product image in the storage unit 22, and assigns an arbitrary image ID. Register in product information D1. Further, the acquisition processing unit 211 acquires position information (coordinate information) corresponding to the position of the product in the captured image CP from the layout information D2 (see FIG. 5) for each product specified from the captured image CP, and It is registered in the product information D1 in association with the product.

In addition, when identifying the products assigned to the plurality of selection buttons B1, the acquisition processing unit 211 identifies set products that can be combined with the identified plurality of products. For example, when specifying "udon" and "fried tofu" assigned to the two selection buttons B1, the acquisition processing unit 211 specifies a set product "kitsune udon" that can be combined with these products. In this way, based on the captured image CP, the acquisition processing unit 211 selects a set product in which a plurality of products assigned to each of the plurality of selection buttons B1 are combined, and a plurality of products constituting the set product. position of each of the plurality of selection buttons B1. Then, the acquisition processing unit 211 registers the identified set product and the position of each selection button B1 in the product information D1 of the storage unit 22 (see FIG. 4). It should be noted that when the acquisition processing unit 211 acquires product information from the ticket vending machine 3 or the restaurant, the acquisition processing unit 211 registers the product information in the product information D1.

The display processing unit 212 causes the user terminal 4 to display various web pages. Specifically, the display processing unit 212 uses the product information (product page) data of the product assigned to each of the plurality of selection buttons B1 based on the captured image CP acquired by the acquisition processing unit 211. to the user terminal 4 to display the product page on the user terminal 4.例文帳に追加For example, when the user logs in to the product information providing site, selects "G Shokudo" when using "G Shokudo," and photographs the selection button B1 of the ticket vending machine 3 with the camera 45 (see FIG. 3), an image is taken. The product page P1 of the product specified by the acquisition processing unit 211 based on the image CP is displayed on the user terminal 4 of the user. That is, the display processing unit 212 causes the user terminal 4 of the user to display the product page P1 of the product registered in the product information D1.

FIG. 6 shows an example of the product page P1 displayed on the user terminal 4. As shown in FIG. FIG. 6 shows a product page P1 of products that "G Shokudo" can provide. Specifically, based on the information included in the product information D1, the display processing unit 212 generates product information data including the product name, price, and product image, and template (display layout) data for displaying each product information. to the user terminal 4 to display the product page P1 shown in FIG. The product page P1 shown in FIG. 6 includes a category column R1 (tab), and each product information is classified by category (“udon/soba”, “rice bowl”, “set meal”, “curry”, “other”). displayed. The user scrolls the product page P1 or switches the categories on the user terminal 4 to browse the products and search for the desired product. Note that the product page P1 may include not only the product corresponding to each selection button B1, but also a set product (such as "kitsune udon" and "udon rice set") composed of a plurality of selection buttons B1. .

In addition, the display processing unit 212 displays each product on the product page P1 so that the user can select it. The display processing section 212 is an example of the display processing section of the present invention.

The reception processing unit 213 receives a product selection operation from the user on the product page P<b>1 displayed on the user terminal 4 . For example, as shown in FIG. 7, when the user selects (touches) the image (or product name) of “soba” with a finger on the product page P1, the reception processing unit 213 uses information corresponding to the touch position. obtained from the user terminal 4. The reception processing unit 213 is an example of the reception processing unit of the present invention.

The identification processing unit 214 identifies the selected product (corresponding to the first product of the present invention) selected by the user from among the plurality of selection buttons B1 provided on the ticket vending machine 3, and selects the selected product corresponding to the identified selected product. The position of the button B1 (corresponding to the first operation section of the present invention) is specified. For example, in the example shown in FIG. 7, the identification processing unit 214 identifies the selected product “soba” based on the information according to the touch position acquired by the reception processing unit 213 . Further, the identification processing unit 214 acquires the position “x2, y1” associated with the selected product “soba” from the product information D1 (see FIG. 4), and selects the selection button B1 corresponding to the selected product “soba”. Identify the location of

Further, for example, as shown in FIG. 8, when the user selects “kitsune udon” on the product page P1, the specific processing unit 214 selects the above-mentioned Identify the selected product "kitsune udon". Further, the identification processing unit 214 acquires the arrangement positions “x1, y1” and “x2, y4” associated with the selected product “kitsune udon” from the product information D1 (see FIG. 4), and acquires the selected product “ The position of the selection button B1 corresponding to "kitsune udon" is specified.

In this way, the identification processing unit 214 refers to the product information D1 stored in association with the product that can be purchased using the ticket vending machine 3 and the position of the selection button B1 assigned to the product, and selects the selected product. The position of the selection button B1 (an example of the first operation unit of the present invention) corresponding to is specified. The specific processing unit 214 is an example of the specific processing unit of the present invention.

Here, when the user presses a "determine button" (not shown) or the like on the product page P1 to end the product selection operation, the display processing unit 212 changes the layout of the selection button B1 on the ticket vending machine 3 to The data of the layout page P2 (see FIG. 9) for presenting the corresponding position information is transmitted to the user terminal 4, and the layout page P2 is displayed on the user terminal 4. FIG. Further, as shown in FIG. 9, the display processing unit 212 displays information of the selected product M1 (product name, price, product image, etc.) and a layout image corresponding to the arrangement layout of the plurality of selection buttons B1 on the layout page P2. S1 is displayed. The layout image S1 corresponds to the arrangement layout of the selection buttons B1 of the ticket vending machine 3 (see FIG. 4).

The layout image S1 displayed on the user terminal 4 may be a grid image (matrix image) obtained by reducing the size of the selection button B1 of the ticket vending machine 3 as shown in FIG. Alternatively, it may be an image representing the appearance of the selection button B1 of the ticket vending machine 3 (captured image CP (see FIG. 3), an illustration image, or the like). A layout image S1 shown in FIG. 10 is composed of a plurality of selection button images (an example of the operation section image of the present invention) respectively corresponding to the plurality of selection buttons B1 included in the captured image CP. In the layout image S1 shown in FIG. 10, the selection button image of the selection button B1 corresponding to the selected product corresponds to the first operation section image of the present invention.

The presentation processing unit 215 presents to the user terminal 4 identification information that enables identification of the position of the selection button B<b>1 specified by the specifying processing unit 214 . Specifically, the presentation processing unit 215 presents the user terminal 4 with position information (an example of the identification information of the present invention) indicating the position of the selection button B1 specified by the specifying processing unit 214 . More specifically, the presentation processing unit 215 transmits position information indicating the position of the selection button B1 corresponding to the selected product selected by the user on the product page P1 to the user terminal 4, and displays the layout page P2. The position information is displayed on the layout image S1.

For example, when the user selects "soba" on the product page P1 shown in FIG. The identification information is displayed at the position corresponding to the position. Specifically, the presentation processing unit 215 selects an object corresponding to the selection button B1 corresponding to the selected product "soba" among the plurality of object images S11 corresponding to the plurality of selection buttons B1 included in the layout image S1. The image S11 (corresponding to the first object image of the present invention) is displayed in a display mode different from that of the other object images S11. For example, the presentation processing unit 215 lights, blinks, or highlights the object image S11 corresponding to the selection button B1 corresponding to the selected product “soba”. The presentation processing unit 215 may synthesize a specific image with the object image S11, or synthesize an animation in which the display mode of the object image changes. In FIG. 9, for the sake of convenience, the object image S11 corresponding to the selection button B1 corresponding to the selected product "soba" is shaded.

Further, for example, when the user selects "Kitsune Udon" on the product page P1 shown in FIG. Identification information is displayed at a position corresponding to the position of B1 and at a position corresponding to the position of the "fried tofu" selection button B1 on the ticket vending machine 3.例文帳に追加Specifically, the presentation processing unit 215 selects an object corresponding to the selection button B1 corresponding to one of the "udon noodles" constituting the selected product "kitsune udon" among the plurality of object images S11 included in the layout image S1. The image S11 and the object image S11 corresponding to the selection button B1 corresponding to the other "deep-fried tofu" constituting the selected product "kitsune udon" are displayed in a display mode different from that of the other object images S11. The presentation processing unit 215 may display the two object images S11 in the same display mode or in different display modes.

Further, for example, when the user selects “soba” and “large serving” on the product page P1, the presentation processing unit 215 displays the “soba” selection button B1 on the ticket vending machine 3 in the layout image S1 as shown in FIG. and the position corresponding to the position of the "Large" selection button B1 on the ticket vending machine 3, the identification information is displayed. Specifically, the presentation processing unit 215 selects the object image S11 corresponding to the selection button B1 corresponding to the selected product “Soba” among the plurality of object images S11 included in the layout image S1, and the selected product “Large serving”. is displayed in a display mode different from that of the other object images S11. Note that when the user selects a plurality of products, the display processing unit 212 may cause the layout page P2 to display the total amount of money for each of the plurality of products (see FIG. 12).

In this way, the presentation processing unit 215 acquires the layout image S1 from the layout information D2 storing the layout image S1 corresponding to the arrangement layout of the plurality of selection buttons B1, and selects the selection button B1 specified by the specification processing unit 214. The layout image S1 including the corresponding position information is displayed on the user terminal 4 . That is, the presentation processing unit 215 causes the user terminal 4 to display the position of the selection button B1 specified by the specifying processing unit 214 in an identifiable manner. The presentation processing unit 215 is an example of the presentation processing unit of the present invention.

Also, the presentation processing unit 215 may present to the user terminal 4 a text message C1 indicating the position of the selection button B1 corresponding to the selected product. For example, as shown in FIG. 9, the presentation processing unit 215 generates a text message C1 indicating the position of the selection button B1 corresponding to the selected product "soba" on the layout page P2 "first row from top, second column from left". ” is displayed. Note that the presentation processing unit 215 may cause the user terminal 4 to display the text message C1 in a display mode according to the attribute of the user. For example, when the language used by the user is acquired based on the login information of the user, the presentation processing unit 215 displays the text message C1 in the language used. Further, when it is determined that the user is an elderly person based on the user's login information, the presentation processing unit 215 adjusts the size, color, etc. of the characters of the text message C1 to display in an easy-to-recognize display mode. to display. Note that the display processing unit 212 displays the text information (product information, etc.) to be displayed on the layout page P2 in a display mode according to the attributes of the user (language used, age, etc.), similarly to the text message C1. good too.

[User terminal 4]
As shown in FIG. 1, the user terminal 4 includes a control section 41, a storage section 42, an operation display section 43, a communication I/F 44, a camera 45, and the like. The user terminal 4 is, for example, an information processing device such as a mobile phone, smart phone, tablet terminal, or personal computer.

The camera 45 is a digital camera that takes an image of the ticket vending machine 3 as a subject and outputs it as digital image data. The camera 45 is provided in the user terminal 4 so as to be able to photograph a subject located on the opposite side of the display screen of the user terminal 4 . For example, when using a restaurant, the user activates the camera 45 and adjusts the position so that all the selection buttons B1 provided on the ticket vending machine 3 are included in the photographing range (see FIG. 3). ). Image data of the captured image CP captured by the camera 45 is transmitted to the information providing device 2 by the control section 41 .

The communication I/F 44 connects the user terminal 4 to the communication network N1 by wire or wirelessly, and communicates with external devices such as the information providing device 2 and the ticket vending machine 3 via the communication network N1 according to a predetermined communication protocol. It is a communication interface for executing data communication.

The operation display unit 43 is a user interface that includes a display unit such as a liquid crystal display or an organic EL display that displays information such as various web pages, and an operation unit such as a mouse, keyboard, or touch panel that receives operations. .

The storage unit 42 is a nonvolatile storage unit such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that stores various types of information. For example, the storage unit 42 stores a control program such as a browser program. Specifically, the browser program is a control program for causing the control unit 41 to execute communication processing with external devices such as the information providing device 2 and the ticket vending machine 3 according to a communication protocol such as HTTP (Hypertext Transfer Protocol). be. Also, the browser program may be a dedicated application for executing communication processing according to a predetermined communication protocol with the information providing device 2 .

The control unit 41 has control devices such as a CPU, ROM, and RAM. The CPU is a processor that executes various kinds of arithmetic processing. The ROM is a non-volatile storage unit in which control programs such as BIOS and OS for causing the CPU to execute various processes are stored in advance. The RAM is a volatile or nonvolatile storage unit that stores various information, and is used as a temporary storage memory (work area) for various processes executed by the CPU. The control unit 41 controls the user terminal 4 by causing the CPU to execute various control programs pre-stored in the ROM or storage unit 42 .

Specifically, the control unit 41 functions as a browser processing unit 411 by executing various processes according to the browser program stored in the storage unit 42 . The browser processing unit 411 causes the operation display unit 43 to display a web page provided from the information providing device 2 via the communication network N1, and executes browser processing for inputting an operation for the operation display unit 43 to the information providing device 2. Is possible. That is, the user terminal 4 can function as an operation terminal for the information providing apparatus 2 by executing the browser program by the control unit 41 . Part or all of the processing units included in the control unit 41 may be configured by electronic circuits.

For example, in the user terminal 4, when a user operation is performed to request access to a predetermined URL corresponding to the product information providing site provided by the information processing system 1, the control unit 41 outputs the information The web page data of the product information providing site is acquired from the providing device 2 and the web page is displayed on the operation display unit 43 . For example, the access request to the predetermined URL is made by a selection operation from a list of pre-registered websites, a text input operation, or the like. Further, when a dedicated application corresponding to the information providing apparatus 2 is installed in the user terminal 4, the user of the user terminal 4 performs an operation to activate the dedicated application, and the operation display section 43 displays the The web page of the product information providing site is displayed.

Further, as described above, in the user terminal 4, when the data of the product page P1 (see FIG. 6, etc.) generated based on the captured image CP is acquired from the information providing device 2, the control unit 41 causes the user The product page P1 is displayed on the terminal 4. - 特許庁Further, in the user terminal 4, when the data of the layout page P2 (see FIG. 9, etc.) is obtained from the information providing device 2, the control section 41 causes the user terminal 4 to display the layout page P2. Further, the control unit 41 acquires from the information providing device 2 identification information (positional information) capable of identifying the selection button B1 corresponding to the selected product selected by the user on the product page P1, and displays it on the user terminal 4. (See FIG. 9, etc.).

When the identification information (position information) of the selection button B1 corresponding to the selected product selected by the user on the product page P1 is displayed on the user terminal 4, the user can access the user terminal 4 as shown in FIG. While looking at the display screen (layout page P2) of the ticket vending machine 3, the selection button B1 corresponding to the identification information is selected (depressed). In the example shown in FIG. 13, the user presses the selection button B1 in the ticket vending machine 3 at the same position as the position “first row from the top, second column from the left” displayed on the user terminal 4 . When the captured image CP and the identification information are displayed on the user terminal 4 (see FIG. 10), the user can easily find the selection button B1 to select. As a result, the ticket vending machine 3 issues a meal ticket for the selected product "soba" selected by the user on the product page P1.

[Information provision processing]
The information provision processing executed in the information processing system 1 will be described below with reference to FIG. 14 . Specifically, in this embodiment, the information providing process is executed by the control unit 21 of the information providing device 2 . In addition, the control unit 21 can execute information provision processing in parallel according to access from each of the plurality of user terminals 4 .

The present invention can be regarded as an invention of an information providing method (an example of an information processing method of the present invention) that executes one or more steps included in the information providing process. Also, one or more steps included in the information providing process described here may be omitted as appropriate. The execution order of the steps in the information providing process may be different as long as the same effects are produced. Furthermore, here, a case where each step in the information providing process is executed by the control unit 21 will be described as an example. are also contemplated as other embodiments.

First, in step S11, the control unit 21 determines whether or not a start operation has been accepted. Specifically, the control unit 21 determines whether or not a login operation for the product information providing site has been received from the user terminal 4 . When it is determined that the login operation has been accepted (S11: Yes), the process proceeds to step S12, and the process waits in step S11 until it is determined that the login operation has been accepted (S11: No).

In step S12, the control unit 21 determines whether or not the captured image CP has been obtained. Specifically, the control unit 21 determines whether or not the user has acquired the captured image CP of the selection button B1 of the ticket vending machine 3 captured by the camera 45 of the user terminal 4 . If it is determined that the captured image CP has been acquired (S12: Yes), the process proceeds to step S13, and the process waits in step S12 until it is determined that the captured image CP has been acquired (S12: No ).

In step S13, the control unit 21 identifies the product assigned to each of the plurality of selection buttons B1 and the position of each of the plurality of selection buttons B1 based on the captured image CP.

In step S14, the control unit 21 determines whether or not the product information of the product identified based on the captured image CP is registered in the product information D1 of the storage unit 22 (see FIG. 4). If it is determined that the product information is not registered in the product information D1 (S14: Yes), the process proceeds to step S15, and if it is determined that the product information is registered in the product information D1 (S14 : No), the process proceeds to step S16.

In step S15, the control unit 21 newly registers the product information in the product information D1.

In step S16, the control unit 21 updates the product information registered in the product information D1. The processing of steps S12 to S16 is executed by the acquisition processing section 211 of the control section 21. FIG. Steps S12 to S16 are examples of acquisition steps of the present invention.

In step S17, the control unit 21 transmits data of product information (product page P1) of products that can be purchased using the ticket vending machine 3 at the restaurant to the user terminal 4, and sends the product page to the user terminal 4. P1 is displayed (see FIG. 6, etc.). Specifically, the control unit 21 identifies the product (single product, set product, etc.) based on the captured image CP, and generates the product page P1 based on the information registered in the product information D1. The process of displaying the product page P1 is executed by the display processing unit 212 of the control unit 21 . Step S17 is an example of the display step of the present invention.

In step S18, the control unit 21 determines whether or not product selection has been received from the user on the product page P1. When it is determined that the product selection has been received (S18: Yes), the process proceeds to step S19, and the process waits in step S18 until it is determined that the product selection has been received (S18: No). For example, when the user selects (touches) the product image on the product page P1, the control unit 21 acquires information corresponding to the touch position from the user terminal 4 . In this case, the control unit 21 determines that the product selection has been accepted (S18: Yes), and the process proceeds to step S19. The processing of step S<b>18 is executed by the reception processing unit 213 of the control unit 21 . Step S18 is an example of a receiving step of the present invention.

In step S19, the control unit 21 identifies the selected product. Specifically, the control unit 21 identifies the selected product based on the information corresponding to the touch position acquired in step S18.

In step S20, the control section 21 identifies the position of the selection button B1 (corresponding to the first operation section of the present invention) corresponding to the identified selected product. Specifically, the control unit 21 acquires the position associated with the selected product from the product information D1 (see FIG. 4), and specifies the position of the selection button B1 corresponding to the selected product. The process of specifying the selected product and the process of specifying the position of the selection button B<b>1 are executed by the specifying processing section 214 of the control section 21 . Steps S19 and S20 are examples of specific steps of the present invention.

In step S<b>21 , the control unit 21 presents the user terminal 4 with identification information that enables identification of the position of the specified selection button B<b>1 . Specifically, the control unit 21 presents the user terminal 4 with position information indicating the position of the specified selection button B1. More specifically, the control unit 21 transmits position information indicating the position of the selection button B1 corresponding to the selected product selected by the user on the product page P1 to the user terminal 4, and displays the layout page P2. The position information is displayed on the layout image S1 (see FIG. 9, etc.). For example, the control unit 21 selects the object image S11 corresponding to the selection button B1 corresponding to the selected product among the plurality of object images S11 corresponding to the plurality of selection buttons B1 included in the layout image S1 (the object image S11 of the present invention). 1 object image) is displayed in a display mode different from that of the other object image S11. The process of presenting the identification information is executed by the presentation processing section 215 of the control section 21 . Step S21 is an example of the presenting step of the present invention.

When the identification information (position information) of the selection button B1 corresponding to the selected product is displayed on the user terminal 4, as shown in FIG. In 3, the selection button B1 corresponding to the identification information is selected (depressed) to issue a meal ticket for the selected product.

As described above, the information processing system 1 according to the present embodiment is provided in the ticket vending machine 3, and an image of a plurality of selection buttons B1 to which products that can be purchased using the ticket vending machine 3 are assigned is captured. Get the image CP. Further, the information processing system 1 causes the user terminal 4 to display the product information (product page P1) of the product assigned to each of the plurality of selection buttons B1 based on the acquired captured image CP. In addition, the information processing system 1 receives a product selection operation from the user in the product information displayed on the user terminal 4 . Further, the information processing system 1 specifies a selection button B1 (first operation unit) corresponding to the selected product selected by the user, among the plurality of selection buttons B1. Then, the information processing system 1 presents the user terminal 4 with identification information that can identify the specified selection button B1. As a result, as shown in FIG. 13, for example, the user can make a selection ( It is possible to easily grasp the selection button B1 to be pressed. By pressing the selection button B1 corresponding to the selected product on the ticket vending machine 3, the user can issue a meal ticket corresponding to the selected product. Therefore, it is possible to improve the operability when selecting the selection button B1 in the ticket vending machine 3 . In addition, since the position of the selection button B1 of the ticket vending machine 3 can be grasped in advance by selecting the product on the product page P1 corresponding to the past captured image CP before visiting the facility, the ticket vending machine 3 after visiting the facility Operation time can be shortened.

Also, the product page P1 presented to the user is generated based on the captured image CP of the selection button B1 of the ticket vending machine 3 . Therefore, even if the product assigned to the selection button B1, the arrangement and quantity of the selection button B1, etc. are changed, the product assigned to each selection button B1 and the selection button B1 corresponding to each product are changed. can be accurately identified. Therefore, in the present invention, the existing ticket vending machine 3 can be used without modification. In addition, the user can appropriately press the selection button B1 of the selected product in the ticket vending machine 3 to issue the desired meal ticket.

Further, the information providing device 2 can generate and update the product page P1 without acquiring registration data such as product information from the ticket vending machine 3 . For this reason, the amount of data communication between the information providing device 2 and the ticket vending machine 3 can be suppressed, and communication traffic can be reduced, and computer resources can be effectively used.

The invention is not limited to the embodiments described above. As another embodiment of the present invention, in the information processing system 1, the display processing unit 212 causes the first display area of the user terminal 4 to display the product information (product page P1), and the second display of the user terminal 4. The layout page P2 (layout image S1) is displayed in the area, and the presentation processing unit 215 displays the layout page P2 in the second display area in accordance with the user's selection operation on the product page P1 in the first display area. Identification information may be displayed.

For example, as shown in FIG. 15 , when the user logs in to the product information providing site when using “Dining Room G” and then photographs the ticket vending machine 3 in “Dining Room G”, the display processing unit 212 The product page P1 of the product provided by "G cafeteria" is displayed in the first display area (upper area) of the user terminal 4 of the user, and the ticket vending machine 3 is displayed in the second display area (lower area) of the user terminal 4. A layout page P2 including a layout image S1 of a plurality of selection buttons B1 provided in . Further, when the user selects (touches) the image of "B set meal" on the product page P1 in the first display area, the presentation processing unit 215 displays the layout image in the second display area as shown in FIG. Among the plurality of object images S11 corresponding to the plurality of selection buttons B1 included in S1, the object image S11 corresponding to the selection button B1 corresponding to the selected product "B set meal" is displayed differently from the other object images S11. displayed in a manner. As a result, the user selects (presses) one selection button B1 showing the position information on the ticket vending machine 3 while looking at the display screen (see FIG. 15) of the user terminal 4 to select "B set meal". issue a meal ticket for

Further, for example, when the user selects "B set meal" and subsequently selects "Large serving", the presentation processing unit 215 displays the selected product "B set meal" in the second display area as shown in FIG. and the two selection buttons B1 corresponding to "Large serving" are displayed in a display mode different from that of the other object images S11. As a result, the user selects (presses) the two selection buttons B1 indicating the position information on the ticket vending machine 3 while looking at the display screen (see FIG. 16) of the user terminal 4 to select "B set meal". ” and “Large serving” meal tickets are issued.

1: information processing system 2: information providing device 3: ticket vending machine 4: user terminal 211: acquisition processing unit 212: display processing unit 213: reception processing unit 214: specific processing unit 215: presentation processing unit

Claims (8)

an acquisition processing unit that acquires a captured image of a plurality of operation units provided in the vending machine and each of which is assigned an item that can be purchased using the vending machine;
a display processing unit that causes a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition processing unit;
a reception processing unit that receives a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying processing unit that specifies a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquisition processing unit;
a presentation processing unit that presents, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying processing unit;
with
The acquisition processing unit specifies the product assigned to each of the plurality of operation units based on the captured image, stores the product information of the specified product in a storage unit, and acquires the captured image. an information processing system that updates the product information in the storage unit each time . an acquisition processing unit that acquires a captured image of a plurality of operation units provided in the vending machine and each of which is assigned an item that can be purchased using the vending machine;
a display processing unit that causes a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition processing unit;
a reception processing unit that receives a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying processing unit that specifies a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquisition processing unit;
a presentation processing unit that presents, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying processing unit;
with
(1) causing the user terminal to display a plurality of operation unit images corresponding to the plurality of operation units included in the captured image; a process of displaying a first operation unit image corresponding to the operation unit in a display mode different from that of the other operation unit images; and (2) sending a text message indicating the position of the first operation unit to the user terminal. An information processing system that executes at least one of the presented processes . The display processing unit displays the product information in a first display area of the user terminal, and displays the product information in a second display area of the user terminal. Display the operation part image of ,
The presentation processing unit causes the identification information to be displayed in the second display area in accordance with the user's selection operation in the product information in the first display area.
The information processing system according to claim 1 or 2 . The presentation processing unit causes the user terminal to display the identification information in a display mode according to the attribute of the user.
The information processing system according to any one of claims 1 to 3 . an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine and each having an assigned product that can be purchased using the vending machine;
a display step of causing a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition step;
a receiving step of receiving a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying step of specifying a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step;
a presentation step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step;
An information processing method in which one or more processors execute
In the acquiring step, the product assigned to each of the plurality of operation units is specified based on the captured image, the product information of the specified product is stored in a storage unit, and each time the captured image is acquired. and updating the product information in the storage unit . an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine and each having an assigned product that can be purchased using the vending machine;
a display step of causing a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition step;
a receiving step of receiving a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying step of specifying a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step;
a presentation step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step;
An information processing method in which one or more processors execute
In the presenting step, (1) causing the user terminal to display a plurality of operation unit images corresponding to the plurality of operation units included in the captured image, and performing the first operation among the plurality of operation unit images. and (2) presenting a text message indicating the position of the first operation unit to the user terminal. An information processing method that executes at least one of the processes to an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine and each having an assigned product that can be purchased using the vending machine;
a display step of causing a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition step;
a receiving step of receiving a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying step of specifying a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step;
a presentation step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step;
An information processing program for causing one or more processors to execute
In the acquiring step, the product assigned to each of the plurality of operation units is specified based on the captured image, the product information of the specified product is stored in a storage unit, and each time the captured image is acquired. an information processing program for updating the product information in the storage unit to a new one . an acquisition step of acquiring a captured image of a plurality of operation units provided in a vending machine and each having an assigned product that can be purchased using the vending machine;
a display step of causing a user terminal to display product information of the product assigned to each of the plurality of operation units based on the captured image acquired by the acquisition step;
a receiving step of receiving a selection operation of a first product from a user in the product information displayed on the user terminal;
a specifying step of specifying a position of a first operation unit corresponding to the first product selected by the user based on the captured image acquired by the acquiring step;
a presentation step of presenting, to the user terminal, identification information capable of identifying the position of the first operation unit specified by the specifying step;
An information processing program for causing one or more processors to execute
In the presenting step, (1) causing the user terminal to display a plurality of operation unit images corresponding to the plurality of operation units included in the captured image, and performing the first operation among the plurality of operation unit images. and (2) presenting a text message indicating the position of the first operation unit to the user terminal. An information processing program that causes at least one of the processes to be executed.

Images