JP7734126B2 - Information processing system, information processing method, and program - Google Patents

Description

Patent Act Article 30, Paragraph 2 applies. On April 12, 2021, TIS Inc. uploaded and published the claimed invention at https://www.tis.co.jp/news/2021/tis_info/20210412_1.html.

The present invention relates to an information processing system, an information processing method, and a program.

A system that allows you to purchase products in a virtual space has been disclosed (Patent Document 1
).

JP 2019-79439 A

The system described in Patent Document 1 allows users to place objects in a virtual space into a virtual cart (
The system is configured to allow users to perform actions such as adding items to their cart or expressing their preference for a product (like). The system also allows users to purchase products by adding them to their virtual cart, in cooperation with an EC (Electronic Commerce) site. However, when making a purchase in a virtual space, it is generally necessary to
The system employs a mechanism whereby purchase procedures are completed in a browser tab on an e-commerce site. However, since the purchase procedure cannot be completed in the virtual space, the user must take off or put on a terminal device such as goggles. This creates a problem in that the user loses their sense of immersion in the virtual space every time they complete a purchase procedure in the virtual space.

Therefore, in order to solve the above-mentioned problems, an object of the present invention is to provide a system for completing payment-related operations in an augmented reality space or a virtual reality space.

An information processing system according to one aspect of the present invention comprises a display processing unit that executes processing to display on a display unit of a display device a user interface relating to a three-dimensionally displayed payment method available to a user for making payment for a selected commodity, which is a commodity selected by a selection operation by a user wearing a display device that displays the augmented reality space or the virtual reality space for a three-dimensionally displayed commodity object placed in the augmented reality space or the virtual reality space, and a payment unit that completes an operation relating to payment for the selected commodity in the augmented reality space or the virtual reality space in accordance with a selection operation by the user on the user interface relating to the payment method.

An information processing method according to one aspect of the present invention includes:
In a virtual reality space, which is a three-dimensional space, a user wearing a display device that displays the augmented reality space or the virtual reality space performs a process to display on a display unit of the display device a user interface related to a three-dimensionally displayed payment means available to the user for making payment for selected goods, which are goods selected by a selection operation by the user of a three-dimensionally displayed product object placed in the augmented reality space or the virtual reality space, and completes an operation related to payment for the selected goods in the augmented reality space or the virtual reality space in accordance with a selection operation by the user on the user interface related to the payment means.

A program according to one aspect of the present invention causes a computer to execute processing to display on a display unit of a display device a user interface relating to a three-dimensionally displayed payment method available to a user, for making payment for a selected commodity, which is a commodity selected by a selection operation by a user wearing a display device displaying the augmented reality space or the virtual reality space, for a three-dimensionally displayed commodity object placed in the augmented reality space or the virtual reality space, and to complete an operation relating to payment for the selected commodity in the augmented reality space or the virtual reality space in accordance with a selection operation by the user on the user interface relating to the payment method.

According to the present invention, payment can be completed in an augmented reality space or a virtual reality space, thereby preventing the user from losing their sense of immersion in the virtual space.

FIG. 1 is a diagram illustrating an example of the configuration of a virtual space payment system 10. FIG. 1 is a diagram showing an example of an overview of the processing of the virtual space payment system 10. FIG. 2 is a diagram showing an example of the configuration of a wallet providing server 100. FIG. 10 is a diagram showing the configuration of user information D111. FIG. 10 is a diagram showing the configuration of retail store information D112. FIG. 11 is a diagram showing the configuration of UI information D113. FIG. 10 is a diagram illustrating an example of a store identification UI in a virtual space. FIG. 10 is a diagram illustrating an example of a product confirmation UI in a virtual space. FIG. 10 is a diagram illustrating an example of a product selection UI in a virtual space. FIG. 10 is a diagram illustrating another example of a product selection UI in a virtual space. FIG. 10 is a diagram illustrating an example of a menu UI in a virtual space. A figure showing an example of a first wallet UI in a virtual space. A figure showing an example of a second wallet UI in a virtual space. A figure showing an example of a third wallet UI in a virtual space. A figure showing an example of a fourth wallet UI in a virtual space. A figure showing another example of the fifth wallet UI in the virtual space. FIG. 10 is a diagram illustrating an example of a purchase product confirmation UI in a virtual space. FIG. 2 is a diagram illustrating an example of the configuration of a virtual space management server 200. FIG. 10 is a diagram showing an example of store space information D211. FIG. 10 is a diagram showing an example of product placement information D212. FIG. 10 is a diagram showing an example of product information D213. FIG. 10 is a diagram showing an example of action information D214. FIG. 2 illustrates an example of the configuration of a user terminal 300. FIG. 1 is a flow chart showing an example of processing of the virtual space payment system 10. FIG. 2 illustrates an example of a hardware configuration of a computer.

A virtual space payment system 10 according to one embodiment of the present invention will be described in detail below with reference to the drawings. However, the embodiment described below is merely an example, and is not intended to exclude various modifications or applications of technologies not explicitly stated below. In other words, the present invention can be implemented by various modifications or combinations of the embodiments without departing from the spirit of the invention. Furthermore, in the following description of the drawings, identical or similar parts are denoted by the same or similar reference numerals.

Overview of Virtual Space Payment System 10
The virtual space payment system 10 is a system that allows a user to complete a purchase of a product or the like in an augmented reality space (hereinafter referred to as "augmented reality space") or a virtual three-dimensional space (hereinafter referred to as "virtual reality space") projected onto a terminal device such as goggles worn by the user, without losing the sense of immersion in the space. Hereinafter, for convenience, augmented reality space and virtual reality space may be collectively referred to as "virtual space." In other words, the virtual space payment system 10 allows a user to complete a purchase of a 3D avatar without having to leave the virtual space (e.g., without removing a terminal device such as goggles). This prevents the user from losing the sense of immersion in the virtual space.

Augmented reality space is, for example, a space including images that are displayed as if projected onto real space when a user wears a terminal device that is a transparent head-mounted display. Virtual reality space is, for example, a virtual space configured with images displayed on a terminal device that is a non-transparent head-mounted display worn by a user. Virtual reality space also includes so-called mixed reality space (a space in which real-world information is reflected in a digital space). Images displayed on a terminal device are, for example, images that a user can view as three-dimensional images. Hereinafter, among the images displayed on a terminal device, objects that a user can view in a virtual space as if they were real objects may be referred to as "virtual objects."

First, with reference to FIG. 1, an outline of the configuration of a virtual space payment system 10 will be described.
FIG. 1 is a diagram showing an example of the configuration of a virtual space payment system 10. As shown in FIG.
The virtual space payment system 10 may include, for example, a wallet providing server 100, a virtual space management server 200, a user terminal 300, and a retail store terminal 400.

The wallet providing server 100 is a server that processes information for realizing a user's purchasing procedure in a virtual space. The wallet providing server 100 processes information for a retailer to open a store in a virtual space (e.g., information about virtual objects of the store, information about virtual objects of products, etc.), and processes information about a user interface for realizing a user's purchasing procedure in the virtual space (e.g., information about virtual objects related to payment). The wallet providing server 100 processes the information for opening a store and the information about the user interface via a software development kit (hereinafter, "SDK"
") to the virtual space management server 200, which will be described later.

As a result, the virtual space payment system 10 can easily enable retailers to open stores and users to complete purchase procedures in the virtual space. Furthermore, operators of virtual spaces can easily use the SDK to enable retailers to open stores and users to complete purchase procedures, thereby attracting retailers and encouraging consumer participation.
As a result, the virtual space payment system 10 can provide the business operator with the economic benefit of being able to expand their business area.

The virtual space management server 200 is, for example, a server for providing a virtual space to a user. The user terminal 300 provides a virtual space to the user based on information provided from the virtual space management server 200. The virtual space management server 200 controls the user terminal 300 based on information about a user interface provided from the wallet providing server 100, for example.
to display a predetermined user interface.

The user terminal 300 is, for example, a non-transparent head-mounted display or a transparent head-mounted display, and is a device that displays virtual objects in a virtual space so that the user can visually recognize them. The user terminal 300 has a function of recognizing the user's actions.

The retail store terminal 400 is, for example, a device that transmits information about a store opened in a virtual space and products to be displayed. The retail store terminal 400 generates various information by, for example, accepting operation input from a retail store manager.

Although the wallet providing server 100 and the virtual space management server 200 are described above as being provided separately, this is not limiting. The wallet providing server 100 and the virtual space management server 200 may be configured as a single server or a cloud server. Furthermore, the wallet providing server 100 may be configured as multiple servers divided by function, for example.

Next, an overview of the processing of the virtual space payment system 10 will be described with reference to FIG.
2 is a diagram showing an example of an outline of the processing of the virtual space payment system 10. First, in step S1, the retail store terminal 400 accepts, for example, a user's operation input to a web page provided by the wallet providing server 100, and transmits information about the store (hereinafter referred to as "store information") and information about the product (hereinafter referred to as "product information") to the wallet providing server 100. Although not shown here, the wallet providing server 100
For example, store information and product information may be provided to a business operator that creates three-dimensional data, thereby acquiring the three-dimensional data of the store and the product from the business operator. Note that the wallet providing server 100 may or may not automatically acquire the three-dimensional data of the store and the product from the business operator by providing the store information and the product information to the business operator.

Next, in step S2, the wallet providing server 100 transmits, for example, store information and product information to the e-commerce server 500.
00 allows a user to transfer funds to a retail store when the user completes the procedure to purchase a product offered by the retail store in the virtual space.

Next, in step S3, the wallet providing server 100 transmits, for example, store information, product information, and three-dimensional data of the store and the products to the virtual space management server 200. This allows the retailer to open a store in the virtual space and display products by simply inputting operations.
This eliminates the barrier that retailers have had to prepare three-dimensional data of their stores and products when opening stores in virtual space.

Next, in step S4, the user terminal 300 displays the virtual space on the user terminal 3
00's display unit 1007 (hereinafter referred to as "virtual space APP") is installed.
Regardless of the above, the virtual space may be displayed on the display unit 1007 through a web browser.

Next, in step S5, the user terminal 300 executes, for example, application software (hereinafter referred to as "application software") that allows the user to use a payment method for purchasing products in the virtual space.
Install the "Wallet APP".

Next, in step S6, the user terminal 300 transmits information about the user (hereinafter referred to as "user information"), acquired based on user input via the wallet APP, to the wallet providing server 100. The user information may include, for example, information about the payment method used by the user (hereinafter referred to as "payment method information").

Next, in step S7, the wallet providing server 100 identifies a user interface (hereinafter referred to as a "wallet UI") corresponding to the payment method used by the user, for example, based on the user information. The wallet providing server 100 transmits the user information and information related to the wallet UI to the virtual space management server 200. This allows the user to purchase products in the virtual space using the desired payment method.

Next, in step S8, the user terminal 300 accepts, for example, a user operation input to add a product from a store in the virtual space to the cart. The user terminal 300 accepts, for example, a user operation input to select a product in the cart, and executes the purchase procedure. For convenience, the operations from the user selecting a product to the execution of the purchase procedure will be referred to below as a "purchase operation."
The information for executing payment by a purchase operation is referred to as “payment execution information.” The user interface provided to the user through the user terminal 300 during the purchase operation will be described later.

Next, in step S9, the virtual space management server 200 transmits information about the purchased product (hereinafter referred to as "purchase information") to the wallet providing server 100. The purchase information includes, for example, information about the product that the user has purchased. Next, in step S10, the wallet providing server 100 transmits the purchase information to the e-commerce server 500. This allows the user to complete the purchase procedure without removing the user terminal 300.

Next, in step S11, the electronic commerce server 500 transfers the sales proceeds of the product purchased by the user to the retail store, thereby enabling the retail store to obtain the sales proceeds in the virtual space.

In this way, in the virtual space payment system 10, even if there are multiple virtual space management servers 200, each virtual space management server 200 is connected to the wallet providing server 10.
0 to transmit the purchase information to the appropriate e-commerce server 500.
The user can use, for example, a VR (Virtual Reality) SNS (Social Networking Service) without having to attach or detach the user terminal 300.
Since transactions can be completed within the Virtual Networking Service, the problem of users losing their sense of immersion in the virtual space can be resolved.

===Configuration of Wallet Providing Server 100===
Next, the configuration of the wallet providing server 100 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the wallet providing server 100. As shown in Fig. 3, the wallet providing server 100 includes, for example, a storage unit 110, an acquisition unit 120, and a UI information providing unit 130.
The system includes functional units such as a display processing unit 1003, a payment unit 150, and a product classification unit 160. Each functional unit is realized, for example, by the processor 1001 reading out a program stored in the memory 1002.

The storage unit 110 stores user information D111, retail store information D112, and UI information D113.

First, the user information D111 will be described with reference to Fig. 4.
4 is a diagram showing the configuration of the user information D111. As shown in FIG. 4, the user information D111 includes, for example, [user ID], [name], [email address], [address], [telephone number], [payment method],
It may include the items [Purchased Items] and [UI ID]. [User ID] stores a user ID that can uniquely identify the user. [Name] stores the user's name. [Email Address] stores the email address used by the user. [Address] stores the user's current address. [Phone Number] stores the user's phone number. [Payment Method] stores the payment method used by the user in the virtual space. Here, the user with user ID "U0001" has registered credit card A, bank account B, virtual currency C, and electronic money D as payment methods. The wallet providing server 100 generates information about the wallet UI linked to the user with user ID "U0001". [Purchased Items] stores data about items the user has previously purchased in the virtual space. [UI ID] stores UI IDs that can uniquely identify various UIs.

Next, the retail store information D112 will be described with reference to FIG. 5.
5 is a diagram showing the configuration of the retail store information D112. As shown in FIG. 5, the retail store information D112 includes, for example, [retail store ID], [retail store name], [email address], [address], [telephone number], [store 3D
The data may include the following items: [Retailer ID], [Product 3D Data], and [Sales History].
] stores a retail store ID that can uniquely identify a retail store. [Retail store name] stores the name of the retail store. [Email address] stores the email address used by the retail store. [Address] stores the current location of the retail store. [Phone number] stores the telephone number of the retail store. [Store 3D data] stores three-dimensional data related to the retail store. [Product 3D data] stores three-dimensional data related to products linked to the retail store. [Sales history] stores the sales history of the retail store's products in the virtual space.

Next, the UI information D113 will be described with reference to FIG.
6 is a diagram showing the configuration of UI information D113. As shown in FIG.
[UI Name], [UI Type], [UI Data], and [Virtual Space ID] may be included. [UI ID] stores a UI ID that can uniquely identify each UI. [UI Name]
stores the names of various UIs. [UI type] stores the type of UI, such as a UI for identifying a store, a UI for checking products, a UI for executing a payment method, a UI for checking purchased products, a UI related to a menu, etc. [UI data] stores data for displaying the UI in a virtual space. [Virtual space ID] stores a virtual space ID that can uniquely identify the virtual space corresponding to the UI.

The acquisition unit 120 acquires information from other devices such as the virtual space management server 200 , the user terminal 300 , the retail store terminal 400 , and the e-commerce server 500 .

The UI information providing unit 130 provides information about the UI related to the purchase operation by the user (hereinafter, “
The UI for the purchase operation is generated, for example, in the virtual space.
A UI for identifying a store (hereinafter referred to as "store identification UI"), a UI for checking products,
I (hereinafter referred to as "product confirmation UI"), a UI for selecting products in the cart (hereinafter referred to as "
The UI information providing unit 130 generates a UI for selecting a product, a wallet UI for executing a payment method, a UI for checking purchased products (hereinafter referred to as a "purchase product confirmation UI"), and a UI for menus (hereinafter referred to as a "menu UI"). Information about the UI generated by the UI information providing unit 130 is sent to the virtual space management server 200. As a result, the virtual space management server 2
00 can provide a UI that suits the user to the user terminal 300 in the virtual space.
For convenience, when we say "user's hand," we mean the hand of an avatar corresponding to the user in the virtual reality space, and the user's actual hand in the augmented reality space.

First, an example of a store identification UI will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of a store identification UI in a virtual space. As shown in FIG. 7, the store identification UI includes an identification object U1 that is displayed in the virtual space for a store where payment by a payment means is available. The identification object U1 is displayed when the user is, for example, within a predetermined distance (here,
The identification object U1 is displayed when the user approaches within the specified range ("L"). The identification object U1 is an object that indicates, for example, a logo or a type of payment method. This allows the virtual space payment system 10 to easily find stores that accept the user's payment method, thereby improving user convenience.

Next, an example of a product confirmation UI will be described with reference to FIG. 8. FIG. 8 is a diagram showing an example of a product confirmation UI in a virtual space. As shown in FIG. 8, the product confirmation UI includes a linear object (hereinafter referred to as a "line object U2") that is displayed in the virtual space in response to the user's hand gesture recognized by the user terminal 300. Furthermore, when the user makes a pinching gesture (hereinafter referred to as a "pinch gesture") by overlapping their index finger and thumb with the line object U2 overlapping or intersecting with the product, the product confirmation UI brings the product closer to the user and displays the product in a manner that allows it to be rotated and transformed. This allows the virtual space payment system 1 to operate smoothly.
The product confirmation UI U3 may include a price display object U3 that displays the price and specifications of a product when the product is designated by a line object U2. This allows the virtual space payment system 10 to easily check the price and specifications of a product, thereby improving user convenience.

8, the product confirmation UI may include a display object U4 that displays, in a predetermined area, each of a plurality of products related to the product designated by the user. For example, the product designated by the user may be "Bag A."
In this case, in relation to the bag A, the display object U4 is a bag of the same brand, a bag of a similar shape, a bag of a similar color, a bag of a similar purpose, etc.
is an object having a spherical shape and displaying three-dimensional image data of a product in the inner area of the spherical shape. The plurality of display objects U4 may be displayed in a line away from the user so that at least a portion of the display objects U4 overlap each other. This improves the user's visibility of the product in the virtual space. Furthermore, the product confirmation UI may be displayed to move in response to the user's hand movements relative to the plurality of display objects U4. This allows the user to view the product through intuitive operations.

Next, an example of a product selection UI will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of a product selection UI in a virtual space. As shown in Fig. 9, the product selection UI includes, for example,
The system includes a cart object U5 and a product display object U6 that displays selected products. The cart object U5 is a three-dimensional object for storing selected products. The cart object U5 is displayed so as to cover one of the user's palms.
The product display object U6 moves in accordance with the movement of the palm. The product display object U6 is an object that displays a reduced product within a predetermined area when the product is moved to the cart object U5.
The product display object U6 is an object that displays three-dimensional image data of a product in the inner area of a sphere in response to the user's pinching action of the product with the other hand. The product display object U6 is displayed so as to be movable by the user while accepting the user's pinching action. This allows the user to select a product through an intuitive operation.

Another example of the product selection UI will be described with reference to Fig. 10. Fig. 10 is a diagram showing another example of the product selection UI in a virtual space. As shown in Fig. 10, the product selection UI includes, for example, a product display object U7 that displays a plurality of products added to a cart by a user. The product display object U7 is, for example, a cart object U7 shown in Fig. 9.
The product selection UI is an area in which each product moved to the product selection area U5 is displayed in a reduced size within a predetermined area.
The product display objects U7 may be displayed in a line surrounding the product display object U7. This makes it easier for the user to view the selected product, thereby improving user convenience. The product selection UI also cancels the selected state of the product in response to a user's hand gesture to remove the product display object U7 from the line. This allows the user to cancel the selected state of the product through an intuitive operation. The product selection UI also moves the product along the line in response to a user's hand gesture to move the product display object U7 along the line. This allows the user to view the selected product through an intuitive operation.

Next, an example of a menu UI will be described with reference to FIG. 11. FIG. 11 is a diagram showing an example of a menu UI in a virtual space. As shown in FIG. 11, the menu UI includes, for example, an icon U8 arranged so as to surround the user's hand with the thumb pointed forward. Surrounding the hand includes, for example, arranging the icon U8 in a circle or arc shape around the wrist. The icon U8 represents a menu item (for example,
(Items that transition to checkout, cart, or inventory). This allows the user to easily understand the items included in the menu, improving user convenience. The menu UI may also include a pointing object U9 that points to one of the multiple icons U8. The pointing object U9 is displayed so as to point in the direction indicated by the tip of the user's thumb, for example. The menu UI may be, for example,
The icon U8 pointed to by the pointing object U9 may be changed in response to the user's wrist twisting in one direction, thereby enabling the user to select a menu item through an intuitive operation.

Next, an example of the first wallet UI will be described with reference to Fig. 12. Fig. 12 is a diagram showing an example of the first wallet UI in the virtual space. As shown in Fig. 12, the first wallet UI includes, in the virtual space, a card-shaped object U10 corresponding to a payment method in the real space. The first wallet UI includes a plurality of card-shaped objects U
The first wallet UI is displayed in a row in one direction so that some of the first wallet UIs 10 overlap. This allows the user to select a payment method through an intuitive operation.
The display position may be changed depending on the frequency of use by the user. Specifically, the first wallet UI may display the card-shaped objects U10 stacked on top of each other in descending order of frequency of use (for example, in FIG. 12, "Credit Card A" is the most frequently used). This allows the user to easily select the payment method that is most frequently used.
The first wallet UI displays a limit display object U that includes the usage limit of each payment method.
11 may be displayed. This allows the user to easily grasp the available balance for each payment method, thereby improving user convenience.

Next, an example of the second wallet UI will be described with reference to FIG. 13. FIG. 13 is a diagram showing an example of the second wallet UI in a virtual space. As shown in FIG. 13, the second wallet UI includes an object U12 in the virtual space, shaped according to the type of asset related to the payment method. The second wallet UI may include, for example, a wallet-shaped object corresponding to a regular account, a piggy bank-shaped object corresponding to a savings account, and a three-dimensional polygonal object corresponding to crypto assets. This allows the user to select a payment method through intuitive operations.

Next, an example of the third wallet UI will be described with reference to FIG. 14 . FIG. 14 is a diagram showing an example of the third wallet UI in a virtual space. As shown in FIG. 14 , the third wallet UI includes an input object U13 that allows a user to input secret information in the virtual space. The input object U13 is, for example, a combination lock. The input object U13 is an object that accepts input of secret information in response to the user's hand gripping and rotating the combination lock. Upon confirming the validity of the secret information, the third wallet UI causes the wallet providing server 100 to transmit payment execution information for executing a payment. This allows the user to execute a payment using an intuitive operation. Note that the third wallet UI may be an input object representing a pin pad, a signature pad, or a keyboard.

Next, an example of the fourth wallet UI will be described with reference to Fig. 15. Fig. 15 is a diagram showing an example of the fourth wallet UI in a virtual space. As shown in Fig. 15, the fourth wallet UI includes a slide object U14 that slides in response to the movement of the user's hand. The slide object U14 may be provided on a plate-shaped object U15. The fourth wallet UI may also display the slide object U14 on one of the user's palms. The fourth wallet UI includes a slide object U14 that slides in response to the movement of the user's hand.
The payment execution information is transmitted in response to the sliding action of the display 4. This allows the user to execute the payment by an intuitive operation.

Another example of the fifth wallet UI will be described with reference to Fig. 16.
16 is a diagram showing another example of the fifth wallet UI in the virtual space. As shown in FIG. 16, the fifth wallet UI may include a card-shaped slide object U16 and a gate object U17 that allows the slide object U16 to pass through. In this case,
The wallet UI transmits payment execution information in response to the movement of the user's hand sliding the slide object U16, thereby allowing the user to execute payments through intuitive operations.

Next, an example of a purchased product confirmation UI will be described with reference to FIG. 17 . FIG. 17 is a diagram showing an example of a purchased product confirmation UI in a virtual space. As shown in FIG. 17 , the purchased product confirmation UI includes icons U18 (e.g., in a folder format) corresponding to product categories (e.g., clothing, games, etc.) classified by a product classification unit (described later). The purchased product confirmation UI may, for example, display products associated with the icons U18 selected by the user in a predetermined format. This can improve user operability. The user can easily find three-dimensional image data of purchased products. Furthermore, the predetermined format may include, for example, in the case of an icon U18 corresponding to the clothing category, a format in which three-dimensional image data of the purchased clothing is displayed hanging from a wardrobe U19. This allows
Since the purchased items can be viewed as if they were being viewed in real space, user convenience can be improved. Furthermore, the purchased item confirmation UI may display, for example, a combination of multiple purchased items. Specifically, as shown in FIG. 17 , the purchased item confirmation UI may display clothing items hung in a wardrobe U19, and clothing items selected by the user may be applied to a human-shaped object U20. This allows the user to shop while checking how the items coordinate with the clothes they currently own, improving user convenience. Furthermore, even for large, highly customizable items with complex mechanisms, such as cars, motorcycles, and bicycles, user convenience can be improved by considering combinations and previewing functions at the time of purchase.

The display processing unit 140, for example, controls the virtual space management server 200 to display various UIs generated by the UI information providing unit 130 on the display unit 1007 of the user terminal 300.
The display processing unit 140 of the wallet providing server 100 displays various UIs on the display unit 100 of the user terminal 300.
The information about the various UIs may be sent directly to the user terminal 300 so that the information about the various UIs is displayed on the display unit 1007 of the user terminal 300. The information about the various UIs may include a program for displaying the various UIs on the display unit 1007 of the user terminal 300.

The settlement unit 150 may be, for example, a user interface (e.g., first to
In response to a selection operation by the user on the fourth wallet UI, the user terminal 30 completes an operation related to payment for the product selected by the user in the virtual space.
The settlement unit 150 transmits settlement execution information to the virtual space management server 200 based on a user's selection operation on the first or second wallet UI, for example, a user's operation on the third, fourth, or fifth wallet UI, regarding the settlement method.
The payment unit 150 executes the payment process based on the purchase information transmitted from the payment unit 150 based on the payment execution information. The payment process is, for example, a process of transmitting purchase information including information about the product purchased by the user to the e-commerce server 500. When the payment unit 150 executes the payment process, the payment by the user in the virtual space is completed.

The product classification unit 160 classifies information about purchased products, which are products paid for by the payment settlement unit 150, into one of a plurality of categories. The product classification unit 160 stores the classified information about the purchased products in the user information D111.

===Configuration of Virtual Space Management Server 200===
Next, the configuration of the virtual space management server 200 will be described with reference to FIG.
18 is a diagram showing an example of the configuration of the virtual space management server 200. As shown in FIG. 18, the virtual space management server 200 includes, for example, a storage unit 210, an acquisition unit 220, and a display processing unit 230.
and a purchase information transmission unit 240. Each of the functional units includes, for example, a processor 1001
is a function that is realized by reading out a program stored in the memory 1002.

The storage unit 110 stores, for example, store space information D211, product placement information D212, product information D
The UI information D215 and the user information D216 are stored in the UI information D113, the action information D214, the UI information D215, and the user information D216. Note that the UI information D215 and the user information D216 are similar to the UI information D113 and the user information D111, and therefore a description thereof will be omitted.

First, the store space information D211 will be described with reference to Fig. 19. Fig. 19 is a diagram showing an example of the store space information D211. The store space information D211 contains three types of store information in a virtual space.
The store space information D211 is a database that stores three-dimensional data. The three-dimensional data of a store includes data regarding the three-dimensional shape of a room consisting of walls, floors, ceilings, product display shelves, etc. As shown in FIG. 19, the store space information D211 may include items such as [Store Space ID], [Store Space Name], and [Update History]. [Store Space ID] stores a store space ID that can uniquely identify a store in the virtual space. [Store Space Name] stores the name of the store space. The name of the point p space may be, for example, the name of the store. [Update History] stores the history of updates to the store space.

Next, the product placement information D212 will be described with reference to FIG. 20. FIG. 20 is a diagram showing an example of the product placement information D212. The product placement information D212 stores the placement of objects. Objects are objects in the virtual space that the user focuses on. As shown in FIG. 20, the product placement information D212 may include, for example, the following items: [Store Space ID], [Object ID], [3D Coordinates], [Scale], and [Update Date and Time]. [Store Space ID] stores the store space ID. [Object ID] stores the object ID of the object placed in the virtual space. [3
[Dimensional coordinates] stores the coordinates (x, y, z) that indicate the position of an object placed in a store in virtual space. [Scale] stores the scale when displaying an object in virtual space. [Update date and time] stores the update date and time of each record.

Next, the product information D213 will be described with reference to FIG.
The product information D213 stores attributes of the target object.
As shown in FIG. 1, the product information D213 includes, for example, [object ID], [product name], and [price].
The [Object ID] may include the item [Update Date].
D. [Product Name] stores the product name. [Price] stores the product price. [Update Date] stores the update date and time of each record.

Next, the action information D214 will be described with reference to FIG. 22 . FIG. 22 is a diagram illustrating an example of the action information D214. The action information D214 stores actions corresponding to user actions. As illustrated in FIG. 22 , the action information D214 may include, for example, the following fields: [Action ID], [Action Name], [Recognized Action], [UI ID], and [Execution Date and Time]. [Action ID] stores an action ID that can uniquely identify the type of action. [Action Name] stores the name of the action. [Recognized Action] stores information corresponding to the user action recognized by the user terminal 300. Specifically, the recognized user action includes, for example, the user's hand movements shown in FIGS. 8 , 9 , 10 , 14 , 15 , 16 , and 11 . [UI ID] stores a UI ID that can uniquely identify various UIs. [Execution Date and Time] stores the date and time when the action was performed by the user.

The acquisition unit 220 acquires information from other devices such as the wallet providing server 100 and the user terminal 300. The various information acquired by the acquisition unit 220 is stored in the storage unit 210.

The display processing unit 230 executes a process for displaying, for example, three-dimensional image data relating to the virtual space stored in the storage unit 210 on the display unit 1007 of the user terminal 300. Specifically, the display processing unit 230 displays, on the display unit 1007 of the user terminal 300, a U-shaped image such as those shown in FIGS.
A virtual space including I is displayed.

For example, the purchase information sending unit 240 identifies the product that is the target of the purchase operation when it receives payment execution information from the user terminal 300. The purchase information sending unit 240 sends purchase information about the product that is the target of the purchase operation to the wallet providing server 100.

===User Terminal 300===
Next, the configuration of the user terminal 300 will be described with reference to Fig. 23. Fig. 23 is a diagram showing an example of the configuration of the user terminal 300. As shown in Fig. 23, the user terminal 300 includes:
For example, the functional units include a storage unit 310, an acquisition unit 320, an action recognition unit 330, and a display processing unit 340. Each functional unit is a function that is realized when the processor 1001 reads out a program stored in the memory 1002, for example.

The storage unit 310 stores, for example, user information D311 and action information D312. The user information D311 is similar to the user information D111, and therefore a description thereof will be omitted. The action information D312 is similar to the action information D214, and therefore a description thereof will be omitted. The storage unit 310 may also store information similar to the UI information D215.
The acquisition unit 320 is, for example, a wallet providing server 100 and a virtual space management server 200.
The various information acquired by the acquisition unit 320 is stored in the storage unit 31
The action recognition unit 330 stores the action information in the sensor group 100 of the user terminal 300.
The user terminal 300 recognizes the user's action based on the information acquired in step D312. Specifically, the action recognition unit 330 generates information related to the action (hereinafter referred to as "action information") by referring to the action information D312. The user terminal 300 transmits the action information to the virtual space management server 200. This makes it possible to display a UI corresponding to the user's action on the display unit 1007. The display processing unit 340 displays, for example, three-dimensional image data related to the virtual space acquired from the virtual space management server 200 and three-dimensional image data related to various UIs on the display unit 1007.

Processing of Virtual Space Payment System 10
An example of the processing of the virtual space payment system 10 will be described with reference to FIG.
4 is a flow diagram showing an example of the processing of the virtual space payment system 10. The following describes an example of the processing flow from a retail store opening a store in a virtual space to a user finding the retail store in the virtual space, purchasing clothes at the retail store, and completing the payment processing. The following description also refers to Figures 7 to 17 as appropriate.

In step S100, the retail store terminal 400 of the retail store receives the wallet providing server 10
The wallet providing server 100 may generate three-dimensional image data of the store and the product based on the store information and the product information. The wallet providing server 100 associates the store information, the product information, and the three-dimensional image data of the store and the product with the store ID and stores them in the storage unit 110.

Next, in step S101, the wallet providing server 100 transmits store information, product information, and three-dimensional image data of the store and products to the virtual space management server 200. At this time, the wallet providing server 100 may transmit the store information, product information, and three-dimensional image data of the store and products together with a program for applying the information to the virtual space provided by the virtual space management server 200. In other words, the wallet providing server 100 may transmit the store information, product information, and three-dimensional image data of the store and products to the virtual space management server 200 using an SDK. This allows retailers to easily open stores in virtual space.

Next, in step S102, the virtual space management server 200 stores the store information, product information, and three-dimensional image data of the store and the product in the storage unit 210. The virtual space management server 200 reflects the store and the product in the virtual space.

Next, in step S200, the wallet providing server 100
In response to a request from the user terminal 300, the virtual space management server 200 transmits a wallet APP that enables various UIs to be used in the virtual space. In addition, in response to a request from the user terminal 300, the virtual space management server 200 transmits a virtual space APP that displays the virtual space.

Next, in step S201, the user terminal 300 accepts an operation input from the user and transmits the user information and payment method information to the wallet providing server 100. The wallet providing server 100 stores the user information and payment method information in the storage unit 110.

Next, in step S202, the wallet providing server 100 associates UI information corresponding to the payment method information with the user information and transmits it to the virtual space management server 200. This allows the virtual space management server 200 to provide a wallet UI to the user.
In step S203, the virtual space management server 200 adds a wallet UI to the user information.
are associated with each other and stored in the storage unit 210.

Next, in step S300, the user terminal 300 transmits authentication information to the virtual space management server 200. In step S301, the virtual space management server 200 transmits information about the virtual space to the user terminal 300. In step S302, the user terminal 300 displays the virtual space on the display unit 1007. The user terminal 300 recognizes the user's actions by referring to the action information D312, and transmits the action information to the virtual space management server 20.
In step S303, the virtual space management server 200 transmits to the user terminal 300 UI information relating to various UIs corresponding to the user's actions based on the action information.
Next, in step S304, the user terminal 300 displays various UIs on the display unit 1007.

The following describes the process of displaying various UIs by the user terminal 300. Note that, in the following, the virtual space management server 200 refers to the UI information 215 and displays the UIs on the display unit 10 of the user terminal 300.
For example, if UI information is stored in the user terminal 300, the user terminal 300 refers to the UI information and displays various UIs on the display unit 1007.
I may be displayed.

7, when the virtual space management server 200 determines that the distance between the avatar and a store in the virtual space has reached a predetermined distance, it refers to the UI information D215 and displays a store identification UI on the display unit 1007. This allows the user to easily recognize stores that accept the registered payment method, thereby improving user convenience.

As shown in FIG. 8 , when a user checks a product in a store, the virtual space management server 200 references UI information D215 to display a product confirmation UI (here, a line object U2) on the display unit 1007 of the user terminal 300, allowing the user to pull the product toward them. The virtual space management server 200 acquires motion information related to the user's hand movement recognized by the user terminal 300 through action information D312, thereby rotating, shrinking, and enlarging the product as it is pulled toward the user's hand. The virtual space management server 200 also references product information D213 to identify products related to the product specified by the line object U2. The virtual space management server 200 displays three-dimensional image data of each of the identified products within the area of a spherical display object U4. Based on the motion information related to the user's hand movement recognized by the user terminal 300, the virtual space management server 200 moves the spherical display object U4 in accordance with the hand movement. This allows the user to check related products in a list, and the virtual space payment system 10 allows the user to browse products intuitively.

As shown in FIG. 9 , the virtual space management server 200 displays a product selection UI (here, a cart object U5 and a product display object U6) for the user to add products in the store to the cart on the display unit 1007 of the user terminal 300.
The virtual space management server 200 acquires action information relating to the action of thrusting out the palm of the user's left hand, which is recognized by referring to the action information D312 on the user terminal 300. The virtual space management server 200 displays the cart object U5 on the display unit 1007 of the user terminal 300 based on the UI information D215. This allows the virtual space payment system 10 to display the cart through an intuitive action, thereby improving user convenience. ...
The virtual space management server 200 refers to the UI information D215 and displays a product display object U6 including three-dimensional image data of the product on the display unit 1007 of the user terminal 300.
When the virtual space management server 200 acquires the operation information regarding the operation of moving the product display object U6 to the cart object U5, the virtual space management server 200 adds the product to a purchase list (hereinafter referred to as a "purchase list"). The purchase list is, for example, a list stored in the storage unit 210 of the virtual space management server 200. This allows the in-virtual space payment system 10 to add products to the cart through intuitive operations, thereby improving user convenience.

10, the virtual space management server 200 displays a product selection UI (here, a product display object U7) for viewing products stored in the purchase list on the display unit 1007 of the user terminal 300. The virtual space management server 200
When the virtual space management server 200 acquires information about an operation of selecting, for example, an icon U8 indicating a cart on the menu UI, the virtual space management server 200 displays the product display object U7 on the display unit 1007. When the virtual space management server 200 acquires information about an operation of removing the product display object U7 from the queue, the virtual space management server 200
The product displayed on the product display object U7 is removed from the purchase list. This allows the virtual space payment system 10 to easily view the products in the cart and to remove products from the cart with an intuitive operation, thereby improving user convenience.

As shown in Fig. 11, the virtual space management server 200 displays a menu UI for selecting an item on the display unit 1007 of the user terminal 300.
The user terminal 300 refers to the action information D312 and acquires action information relating to the action of thrusting out one hand with the thumb facing forward, which is recognized.
The virtual space management server 200 displays icons U8 included in the menu UI on the display unit 1007 of the user terminal 300 so as to surround the user's outstretched hand. This allows the user to easily check the menu items, improving user convenience.
When operation information relating to an operation of selecting a predetermined icon U8 of the menu UI is acquired from the user terminal 300, the display unit 1007 of the user terminal 300 displays an object corresponding to the icon U8.

12 and 13 , virtual space management server 200 displays a wallet UI (here, a first wallet UI or a second wallet UI) on display unit 1007 of user terminal 300, which allows the user to select a payment method when purchasing a product. For example, when virtual space management server 200 acquires operation information related to an operation for paying for a product in a purchase list recognized by user terminal 300 with reference to action information D312, virtual space management server 200 displays the first wallet UI or the second wallet UI on display unit 1007. Virtual space management server 200 generates purchase information based on a purchase operation for a payment method (e.g., a credit card U10 or a wallet object U12) selected by the user from the first wallet UI or the second wallet UI.

14, 15, and 16, virtual space management server 200 displays a wallet UI (here, the third wallet UI, the fourth wallet UI, or the fifth wallet UI) on display unit 1007 of user terminal 300, which accepts an operation to confirm a purchase when making a payment with a predetermined payment method. For example, when virtual space management server 200 acquires operation information related to an operation to select a payment method as shown in FIGS. 12 and 13, virtual space management server 200 displays the third wallet UI, the fourth wallet UI, or the fifth wallet UI on display unit 1007 of user terminal 300. When user terminal 300 recognizes, by referring to action information D312, an operation to execute a user's payment for the third wallet UI, the fourth wallet UI, or the fifth wallet UI, it transmits payment execution information to virtual space management server 200 to execute the payment.

Next, in step S305, purchase information is generated based on the payment execution information and transmitted to the wallet providing server 100. Next, in step S306, the wallet providing server 100 transmits the purchase information to the e-commerce server 500 to settle the product that is the subject of the payment. This allows the user to complete payment-related operations in the virtual space by operating the user terminal 300 without removing the user terminal 300.

Next, in step S306, the wallet providing server 100 identifies the e-commerce server 500 corresponding to the purchased product based on the purchase information, and transmits the purchase information to the e-commerce server 500. This allows the e-commerce server 500 to execute payment processing to the retail store linked to the purchase information. This allows the user to make payments to the retail store, for example, through a VR (Virtual Reality) SNS (Social Networking Service).
Transactions can be completed within the calling service.

Next, in step S307, the user terminal 300
The electronic commerce server 500 then receives a payment availability notification regarding whether or not payment is possible. This allows the user to know whether or not payment in the virtual space is possible.
This improves user convenience.

Next, in step S308, the virtual space management server 200 checks the user information D216
17 , the virtual space management server 200 may refer to the user information D216 and cause the display unit 1007 of the user terminal 300 to display a purchased product confirmation UI that displays, as a three-dimensional image, three-dimensional image data related to the product for which the purchase procedure has been completed.

====Modifications====
The virtual space payment system 10 may further include a configuration for issuing a token number that is encrypted (anonymized) based on confidential information (e.g., card number) of a payment method, such as a credit card. Specifically, for example, after step S6 in FIG. 2, the user terminal 300 transmits information about the card number to the service provider that issues the token number, based on a user's operation input. The user terminal 300 acquires the token number corresponding to the card number. The user terminal 300 stores the token number in cooperation with the virtual space APP. When the user terminal 300 receives an action to purchase a product from the user in the virtual space, it transmits payment execution information to the virtual space management server 200. The virtual space management server 200 transmits purchase information including the token number to the wallet providing server 100 (see FIG. 2).
(Step S9) This allows the user to enjoy a secure purchasing process.

Furthermore, the virtual space payment system 10 may manage three-dimensional data relating to purchased products on a blockchain platform. Specifically, a purchase certificate for the purchased product is issued to the user, and the three-dimensional data relating to the product is stored in distributed storage.
The transaction history of the product is stored on a blockchain platform, which allows users to prove that they are legitimate buyers of the product and allows data to be used even if the content distributor's service is suspended.

===Hardware Configuration===
The wallet providing server 100 and the virtual space management server 200 that realize the functions related to the above-described embodiment may be implemented, for example, by a server computer or a personal computer (e.g.,
The computing device may be a desktop, laptop, tablet, etc.), a media computing platform (e.g., cable, satellite set-top box, digital video recorder), a handheld computing device (e.g., PDA, email client, etc.), or any other type of computing or communications platform.

The user terminal 300 and the retail terminal 400 that realize the functions related to the above-described embodiments may be, for example, a smartphone, a mobile phone (feature phone), a personal computer (e.g., desktop, laptop, tablet, etc.), a media computer platform (e.g., cable, satellite set-top box, digital video recorder, etc.).
, handheld computing devices (e.g., PDAs (Personal Digital Assistants)
, email client, etc.), a wearable device (glasses-type device, watch-type device, etc.), other types of computers, or communication platforms. Note that the user terminal 300 is preferably a transparent head-mounted display or a non-transparent head-mounted display.

25, an example of a hardware configuration in which the wallet providing server 100, virtual space management server 200, user terminal 300, and retailer terminal 400 are implemented by a computer 1000 will be described. Note that the various functions of the wallet providing server 100, virtual space management server 200, user terminal 300, and retailer terminal 400 can be implemented by dividing them into multiple devices.

25 is a diagram showing an example of the hardware configuration of a computer. As shown in FIG. 25, a computer 1000 includes, for example, a processor 101, a memory 1002, a storage device 1003, an input I/F unit 1004, a data I/F unit 1005, and a communication I/F unit 1006.
06, a display unit 1007, and a group of sensors 1008. The group of sensors 1008 is hardware provided in the user terminal 300, and does not necessarily have to be provided in the wallet providing server 100, the virtual space management server 200, the user terminal 300, or the retailer terminal 400.

The processor 1001 is a control unit that controls various processes in the computer 1000 by executing programs stored in the memory 1002 .

The memory 1002 is a storage medium such as a RAM (Random Access Memory), etc. The memory 1002 temporarily stores the program code of the program executed by the processor 1001 and data required when the program is executed.

The storage device 1003 is a non-volatile storage medium such as a hard disk drive (HDD), flash memory, etc. The storage device 1003 stores an operating system and various programs for realizing the above-mentioned components.

The input I/F unit 1004 is a device for receiving input from a user. Specific examples of the input I/F unit 1004 include a keyboard, a mouse, a touch panel, various sensors,
The input I/F unit 1004 is, for example, a USB (Universal
The computer 1000 may be connected via an interface such as a serial bus.

The data I/F unit 1005 is a device for inputting data from outside the computer 1000. A specific example of the data I/F unit 1005 is a drive device for reading data stored in various storage media. The data I/F unit 1005 may be provided outside the computer 1000. In this case, the data I/F unit 100
5 is connected to the computer 1000 via an interface such as a USB.

The communication I/F unit 1006 communicates with external devices of the computer 1000 via wired or wireless connections.
A device for performing data communication via the Internet N. Communication I/F unit 100
6 may be provided outside the computer 1000. In that case, the communication I/F
The F unit 1006 is connected to the computer 1000 via an interface such as a USB.

The display unit 1007 is a device for displaying various types of information. Specific examples of the display unit 1007 include a liquid crystal display, an organic EL (Electro-Luminescence) display, and a display of a wearable device. The display unit 1007 may be provided outside the computer 1000. In this case, the display unit 1007 is connected to the computer 1000 via, for example, a display cable. The input I/F unit 10
When a touch panel is used as the input I/F unit 1004, the display unit 1007
4 can be integrated into the structure.

In the above, when referring to the display unit 1007 of the user terminal 300, it refers to the display unit 10
1007 includes a liquid crystal display panel. If the user terminal 300 is a transparent head-mounted display, the real space is not displayed on the display unit 1007. If the user terminal 300 is a non-transmissive head-mounted display or a smartphone, an image in which a captured image of the real space and an image of the virtual reality space are superimposed may be generated and displayed on the display unit 1007. If the user terminal 300 is a transparent head-mounted display or a non-transmissive head-mounted display, the display unit 1007 may include two display panels and display a stereo image.

The sensor group 1008 includes various sensors. The sensor group 1008 includes sensors for grasping the space around the user, sensors for grasping the user's position, posture, and hand movements, and sensors for detecting the user's viewpoint and line of sight. The sensors for grasping the space around the user include an RGB image sensor and a depth sensor. The sensors for detecting the user's position, posture, hand movements, and line of sight include a gyro sensor, a digital compass,
These include acceleration sensors, proximity sensors, and motion tracking sensors.

===Summary===
The virtual space payment system 10 of this embodiment includes: a display processing unit 140 that executes processing for displaying, on the display unit 1007 of the user terminal 300 (display device), a user interface related to three-dimensionally displayed payment methods available to the user for making a payment for selected commodities, which are commodities selected by a selection operation by a user wearing a user terminal 300 (display device) that displays the augmented reality space or the virtual reality space, for three-dimensionally displayed product objects located in the augmented reality space or the virtual reality space, in the augmented reality space or the virtual reality space, and a payment unit 150 that completes an operation related to payment for the selected commodities in the augmented reality space or the virtual reality space in response to a selection operation by the user on the user interface related to the payment method. This allows the operation related to payment to be completed in the augmented reality space or the virtual reality space, thereby preventing the user from losing their sense of immersion in the virtual space.

In addition, in the virtual space payment system 10 of this embodiment, the settlement unit 150 completes the operation related to the payment of the selected product by the user in the augmented reality space or the virtual reality space based on a token number (identification information) that conceals the identification code that identifies the payment method, thereby providing the user with a secure purchase process.

In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing to display an identification object U1 (a predetermined identification mark) for stores that accept payment methods in the augmented reality space or virtual reality space. This allows users to easily find stores that accept their own payment methods, thereby improving user convenience.

Furthermore, in the virtual space payment system 10 of this embodiment, the display processing unit 140 displays a linear object U2 (linear object) that moves in response to the user's hand movements recognized by the user terminal 300 (display device) in the augmented reality space or virtual reality space, and if there is a designated product object that overlaps or intersects with the linear object U2 (linear object), executes processing to bring the designated product object closer to the user in response to the user's pinch operation. This allows the user to view the product from various angles at hand without getting close to it, improving user convenience.

Furthermore, in the virtual space payment system 10 of this embodiment, the display processing unit 140 displays, in the augmented reality space or virtual reality space, display objects U4 that display multiple related products related to the product of the designated product object in a predetermined display area, each of the multiple related products. The multiple display objects U4 are displayed in a row away from the user so that at least a portion of each of the multiple display objects U4 overlaps, and executes processing to move the multiple display objects U4 in response to the user's hand movement relative to the multiple display objects U4. This improves the user's visibility of the products in the virtual space. Furthermore, the user can view the products through intuitive operations.

In the virtual space payment system 10 of this embodiment, the display processing unit 140 performs processing to reduce and display the selected product object (product display object U6 in this case) within a predetermined area in response to a user's pinching action of the selected product object, which is recognized on the user terminal 300 (display device), in the augmented reality space or virtual reality space. This allows the user to select products through intuitive operations.

In the virtual space payment system 10 according to the present embodiment, the display processing unit 140 displays a plurality of selected products set as candidates for purchase by a user's selection operation on the selected product object in the augmented reality space or the virtual reality space as a product display object U
The product display objects U7 are displayed in a row surrounding the torso of the user or the user's avatar, and a process for moving the product display objects U7 is executed in response to the user's hand movements relative to the product display objects U7. This makes it easier for the user to view the selected product, thereby improving user convenience.

In the virtual-space payment system 10 of this embodiment, the display processing unit 140 executes processing to hide the product display object U7 on which the selected product is displayed so that the selected product is removed from the list of purchase candidates in response to a user action such as moving the selected product displayed on the product display object U7 recognized on the user terminal 300 (display device) out of a predetermined range in the augmented reality space or virtual reality space. This allows the user to deselect the product through an intuitive operation.

In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing for displaying, in the augmented reality space or virtual reality space, a plurality of icons U8 constituting a menu UI (menu object) that is displayed so as to surround at least one hand of the user as recognized by the user terminal 300 (display device). This allows the user to easily grasp the items included in the menu, thereby improving user convenience.

Furthermore, in the virtual-space payment system 10 of this embodiment, the display processing unit 140 displays, in the augmented reality space or virtual reality space, an instruction object U9 that indicates one of the icons U8 included in the menu UI (menu object), and executes processing to change the icon U8 indicated by the instruction object U9 in response to the user's wrist twisting action in one direction, as recognized by the user terminal 300 (display device). This allows the user to select a menu item through an intuitive operation.

In the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing to display, in the augmented reality space or virtual reality space, user interfaces related to payment methods in the shape of cards corresponding to those payment methods in the real space, and to display multiple card-shaped objects U10 (user interfaces) in a row in one direction so that some of the objects overlap, thereby enabling the user to select a payment method through intuitive operations.

In the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing to display a user interface for payment methods in the augmented reality space or virtual reality space in a shape (here, object U12) corresponding to the type of asset, thereby enabling the user to select a payment method through intuitive operations.

In the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing for displaying an input object U13 representing a combination lock for allowing the user to input secret information in the augmented reality space or virtual reality space, and the settlement unit 150 executes the user's payment based on information input to the input object in response to the user's hand movements recognized on the display device. This allows the user to execute payment through intuitive operations.

Furthermore, in the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing for displaying a slide object U16 that slides in the augmented reality space or the virtual reality space in response to the user's hand movements recognized on the user terminal 300 (display device), and the settlement unit 150 executes the user's payment based on information input to the slide object U16 in response to the user's hand movements recognized on the user terminal 300 (display device). This allows the user to execute payment through intuitive operations.

In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 performs processing to display a slide object U14 on one of the user's palms, as recognized by the user terminal 300 (display device), in the augmented reality space or virtual reality space.
This allows the user to make payments through intuitive operations.

Furthermore, the virtual space payment system 10 of this embodiment further includes a product classification unit 160 that classifies information about purchased products, which are products paid for by the payment unit 150, into one of a plurality of categories, and the display processing unit 140 displays a plurality of folders corresponding to the plurality of categories in the augmented reality space or virtual reality space, and, in response to a user's selection operation for one of the plurality of folders, executes processing to display a purchased product object (here, 3D image data of clothing), which is a purchased product classified into the category corresponding to the folder that received the selection operation. This improves user operability.

Furthermore, in the virtual space payment system 10 of this embodiment, the display processing unit 140 executes processing for combining and displaying, in the augmented reality space or virtual reality space, a plurality of purchase item objects (here, 3D image data of clothing) according to product categories, based on information about the purchase item objects (here, 3D image data of clothing) stored in the product classification unit 160. This allows the user to view the purchase items as if they were in real space, thereby improving user convenience.

In addition, in the virtual space payment system 10 of this embodiment, the product classification unit 160 stores information about the user's clothing, which is the purchased product, and the display processing unit 140 executes processing to hang and display clothing objects, which are clothing, in the wardrobe U19 so that they can be seen by the user in the augmented reality space or virtual reality space.
When shopping, users can check how the new items coordinate with their current clothes, improving convenience for users.

10... Virtual space payment system, 100... Wallet providing server, 200... Virtual space management server, 300... User terminal, 400... Retail store terminal.

Claims (9)

a display processing unit that executes processing to display, in a three-dimensional display space that is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for a selected commodity, which is a commodity selected by a selection operation by the user, for a three-dimensionally displayed commodity object arranged in the three-dimensional display space that is the augmented reality space or the virtual reality space;
a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e- commerce server corresponding to the selected product ;
the display processing unit executes a process for displaying, in the three-dimensional display space, a predetermined identification sign for a store where payment can be made by the payment means.
Information processing system. the payment unit completes an operation related to payment for the selected product by the user in the three-dimensional display space based on identification information obtained by concealing an identification code that identifies the payment means.
The information processing system according to claim 1 . a display processing unit that executes processing to display, in a three-dimensional display space that is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for a selected commodity, which is a commodity selected by a selection operation by the user, for a three-dimensionally displayed commodity object arranged in the three-dimensional display space that is the augmented reality space or the virtual reality space;
a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e-commerce server corresponding to the selected product;
the display processing unit displays, in the three-dimensional display space, a user interface relating to the payment means in the shape of a card corresponding to the payment means in the real space, so that a plurality of the card-shaped user interfaces partially overlap each other;
Execute the process to display them in a row in one direction.
Information processing system. a display processing unit that executes processing to display, in a three-dimensional display space that is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for a selected commodity, which is a commodity selected by a selection operation by the user, for a three-dimensionally displayed commodity object arranged in the three-dimensional display space that is the augmented reality space or the virtual reality space;
a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e-commerce server corresponding to the selected product;
the display processing unit executes processing for displaying a user interface relating to the payment means in a shape corresponding to the type of asset in the three-dimensional display space.
Information processing system. a display processing unit that executes processing to display, in a three-dimensional display space that is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for a selected commodity, which is a commodity selected by a selection operation by the user, for a three-dimensionally displayed commodity object arranged in the three-dimensional display space that is the augmented reality space or the virtual reality space;
a payment unit that, when receiving payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected products in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected products to an e-commerce server corresponding to the selected products;
a product classification unit that classifies information about purchased products that are products paid for by the payment unit into one of a plurality of categories,
the display processing unit displays a plurality of folders corresponding to the plurality of categories in the three-dimensional display space;
executes a process for displaying, in response to a selection operation by the user on one of the plurality of folders, a purchase item object that is the purchase item classified into a category corresponding to the folder for which the selection operation has been accepted;
Information processing system. the display processing unit executes a process for combining and displaying the plurality of purchase item objects in the three-dimensional display space according to the item categories based on the information about the purchase item objects stored in the item classification unit.
The information processing system according to claim 5 . The product classification unit stores information about the user's clothes, which are the purchased products; and the display processing unit executes processing to display clothing objects, which are the clothes, in the three-dimensional display space by hanging them in a wardrobe so that they are visible to the user.
The information processing system according to claim 6 . The computer
Executing a process for displaying in the three-dimensional display space a user interface relating to payment methods available to the user for making payment for a selected product, which is a product selected by a selection operation by the user, for a three-dimensionally displayed product object arranged in the three-dimensional display space, which is an augmented reality space or a virtual reality space;
Executing a process for displaying a predetermined identification sign for a store where payment can be made using the payment means in the three-dimensional display space;
when payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means is acquired, purchase information indicating that the user will purchase the selected products is transmitted to an electronic commerce server corresponding to the selected products, thereby completing an operation related to payment for the selected products in the three-dimensional display space;
An information processing method that performs the above. On the computer,
Executing a process for displaying in the three-dimensional display space a user interface relating to payment methods available to the user for making payment for a selected product, which is a product selected by a selection operation by the user, for a three-dimensionally displayed product object arranged in the three-dimensional display space, which is an augmented reality space or a virtual reality space;
Executing a process for displaying a predetermined identification sign for a store where payment can be made using the payment means in the three-dimensional display space;
when payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means is acquired, purchase information indicating that the user will purchase the selected products is transmitted to an electronic commerce server corresponding to the selected products, thereby completing an operation related to payment for the selected products in the three-dimensional display space;
A program that executes the following.