JP7522439B2 - Information processing method and information processing device - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act (1) Publication address: https://remeet.live/ Publication date: May 5, 2020 (Reiwa 2) (2) Publication address: https://prtimes.jp/main/html/rd/p/000000001.000057781.html Publication date: May 7, 2020 (Reiwa 2) (3) Publication address: https://nagasaki-keizai.co.jp/ jp/wordpress/wp-content/uploads/2020/05/06_%E6%B8%8B%E8%B0%B7%E4%BE%BF%E3%82%8A_%E8%97%A4%E4%BA%95%E6%A7%98. pdf Publication date/May 26, 2020 (Reiwa 2) (4) Publication address/https://prtimes. jp/main/html/rd/p/000000006.000057781. html Publication date / May 27, 2020 (5) Publication name / Nagasaki Keizai June 2020 issue Published date / May 29, 2020 (6) Meeting name / Re: Meet LIVE CHANNEL UP!! #1 Date held / May 29, 2020 (7) Published address / https://playground. remeet. live/ Published date / June 2, 2020 (8) Published address / https://prtimes. jp/main/html/rd/p/000000007.000057781. html Date of publication / June 3, 2020 (Reiwa 2) (9) Meeting name / QWS Stage # 02 Date held / June 19, 2020 (Reiwa 2) (10) Meeting name / CHANNEL UP! ONLINE Date held / June 20, 2020 (Reiwa 2)

This disclosure relates to an information processing method and an information processing device.

Events that attract large audiences, such as concerts, live shows, handshake events, and autograph sessions, are usually held in the real world. Event participants, such as fans, receive fan service from event performers, such as celebrities and singers, at the event venue. Particularly at today's events, such as idol handshake events and celebrity autograph sessions, performers and participants often share a physical space and face each other.

There is a known method for increasing the motivation of performers and participants at an event venue by having each performer and participant have a terminal and using each terminal during the event. For example, Patent Document 1 discloses a method for transmitting identification information between the terminals of performers and participants of an event in an environment where the performers and participants face each other.

On the other hand, there are many fans who are unable to attend face-to-face events with their preferred audience due to various constraints, including financial reasons, living in a remote area, and time constraints. Furthermore, amid the impact of the COVID-19 pandemic that began in 2020, social circumstances have made it difficult to hold events where performers and participants can meet in person.

In such a situation, fans have few opportunities to interact with people who are the object of their desires, and find it difficult to find the people they are looking for. In addition, those people are unable to provide sufficient fan service to their fans, and are unable to expand the scope of their activities. Furthermore, event organizers may suffer economic losses due to being forced to suddenly cancel events.

JP 2020-27373 A

It would be desirable to enable real-time communication between enthusiasts and those who are the object of their preferences online, without the physical constraints associated with traditional one-to-one events. It would also be desirable to provide a user experience with added value beyond that of traditional one-to-one events through such communication.

The present disclosure aims to solve the above problems. Specifically, the present disclosure aims to enable real-time communication between enthusiasts and those who are the target of their preferences online, without the physical constraints of traditional events.

According to an embodiment of the present disclosure, an information processing method is provided. The information processing method includes the steps of: requesting issuance of a ticket for an event related to a second user by a terminal of a first user; accessing the event in response to the issuance of the ticket, in which the ticket is added to a queue associated with the event; establishing real-time communication between the terminal of the first user and the terminal of the second user based on the ticket being removed from the queue; displaying a video image of the first user and a video image of the second user side-by-side for a certain period of time in the real-time communication; and displaying a composite image including an image of the first user and an image of the second user acquired at a specific timing within the period of time after the real-time communication.

According to an embodiment of the present disclosure, an information processing device is provided. The information processing device includes a ticket issuing unit that issues tickets associated with an event of a second user in response to requests from multiple terminals of a first user, a queue management unit that sequentially adds tickets to a queue associated with the event in response to the issuance of each ticket, and sequentially removes tickets one by one from the queue as a certain period of time passes, and a communication control unit that, based on the removal of a ticket from the queue, allows real-time communication between the terminal of the first user to which the ticket was issued and the terminal of the second user for the period of time.

According to an embodiment of the present disclosure, real-time communication between a lover and the target of that lover's preference is activated online. It is possible to provide users with new entertainment value through online events and to improve the user experience.

FIG. 1 is a schematic configuration diagram of an information processing system. FIG. 2 is a hardware configuration diagram of an information processing device included in the information processing system. FIG. 2 is a hardware configuration diagram of a user terminal included in the information processing system. FIG. 1 is an exemplary functional block diagram of an information processing system. FIG. 1 is an example process flow diagram. FIG. 13 is an exemplary screen image diagram. FIG. 13 is an exemplary screen image diagram. FIG. 1 is an example process flow diagram. FIG. 13 is an exemplary screen image diagram.

Below, an embodiment of an information processing method and an information processing device according to the present disclosure will be described with reference to the accompanying drawings. In the accompanying drawings, identical or similar elements are given identical or similar reference symbols. In the description of the embodiments, duplicated descriptions of identical or similar elements may be omitted. Furthermore, features shown in the embodiments may be applicable to other embodiments as long as they are not mutually inconsistent.

In this disclosure, "fan" is a collective term for fans who favor performers (e.g., idols, talents, celebrities, athletes, actors, actresses, influencers, etc.) of various events in which concerts, live shows, idol handshake events, sports, games, and local characters appear, characters, or groups of these. Furthermore, "target" is a collective term for performers, characters, or groups of these of events that are the subject of the fan's preference or support. A "target" may be a specific individual, or a group or team that includes multiple individuals or characters.

Figure 1 is an overall schematic diagram of an information processing system 1. The information processing system 1 comprises a server 100 and multiple user terminals 200, 300 used by tasters and target persons at the event. The server 100 is connected to the user terminals 200, 300 via a network 400. Here, for simplicity of explanation, only two user terminals are shown in Figure 1, but those skilled in the art will understand that this is not limited to this and that when multiple tasters participate, there will be three or more. In addition, the user terminals 200, 300 are not limited to personal computers and smartphones as shown in the figure, and electronic devices such as laptop computers, feature phones, PDAs (Personal Digital Assistants), or tablet terminals may be used.

The information processing device and information processing method according to the embodiment are realized by information processing system 1. In the following description of the embodiment, it is assumed, but not limited to, that the target person uses user terminal 200 and the taster uses user terminal 300. Specifically, information processing system 1 enables online one-to-one video call communication between the target person and the taster via network 400, which can stimulate communication between the target person and the taster and provide the taster with an unprecedented user experience.

The network 400 is composed of the Internet and various mobile communication systems constructed by wireless base stations (not shown). Those skilled in the art will understand that mobile communication systems include so-called 3G, 4G, and 5G mobile communication systems, LTE (Long Term Evolution), and wireless networks (e.g., WiFi (registered trademark)) that can be connected to the Internet via a specified access point.

The hardware configuration of the server 100 and the user terminals 200, 300 will be described with reference to Figures 2 and 3. Figure 2 is a hardware configuration diagram of the server 100. The server 100 is an information processing device for providing a service for holding an event online. The information processing device may be realized, for example, by a general-purpose computer such as a workstation or a personal computer, or may be realized logically by a cloud server. Also, Figure 3 is a hardware configuration diagram of the user terminals 200, 300. The example of Figure 3 shows, but is not limited to, a smartphone with a touch screen, and the smartphone may be applied not only to the user terminal 300 owned by the hobbyist, but also to the user terminal 200 owned by the target person.

As shown in FIG. 2, the server 100 includes a processor 10, memory 11, storage 12, a communication interface (IF) 13, and an input/output interface (IF) 14, which are electrically connected to each other via a bus 19. As shown in FIG. 3, the user terminals 200 and 300 include a processor 20, memory 21, storage 22, a communication IF 23, an input/output IF 24, a touch screen 25, an audio interface (IF) 26, and a camera 27, which are electrically connected to each other via a bus 29. The touch screen 25 further includes an input unit 251 and an output unit 252.

The processors 10 and 20 are computing devices that control the operation of the server 100 and the user terminals 200 and 300, control the transmission and reception of data between each element, and perform information processing required to execute applications. For example, the processors 10 and 20 are CPUs (Central Processing Units) and/or GPUs (Graphical Processing Units), and execute programs stored in the storages 12 and 22 and deployed in the memories 11 and 21 to perform various information processing operations.

Memories 11 and 21 include a main memory consisting of a volatile storage device such as a dynamic random access memory (DRAM) and an auxiliary memory consisting of a non-volatile storage device such as a flash memory or a hard disk drive (HDD). Memories 11 and 21 are used as work areas for processors 10 and 20, and also store a basic input/output system (BIOS) executed when server 100 and user terminals 200 and 300 are started up, as well as various setting information. Storages 12 and 22 may store various programs such as authentication programs and billing programs in addition to storing application programs for providing online event services. A database storing data used in each process of online event services may also be constructed in storage 12.

The communication IF 13 connects the server 100 to the network 400 and communicates with the user terminals 200 and 300. The communication IF 23 connects the user terminals 200 and 300 to the network 400 and communicates with the server 100. The communication IF 23 also includes short-range communication interfaces such as Bluetooth (registered trademark) and BLE (Bluetooth Low Energy). The input/output IFs 14 and 24 are information input devices such as a mouse and keyboard, and output devices such as a display. In particular, the input IF 24 may include an information input device such as a pen tablet.

The input unit 251 of the touch screen 25 of the user terminal 200, 300 detects that a user has operated the touch panel 25. The output unit 252 is composed of a liquid crystal display or the like. The audio IF 26 has a microphone and a speaker, and allows the user to input and output voice. The camera 27 includes a web camera if the user terminal is a PC, and includes an in-camera and an out-camera if the user terminal is a smartphone or tablet. The user can use the camera 27 to take a picture of himself (selfie), and can also take a video in cooperation with the audio interface 26. Video data acquired by the audio IF 26 and/or the camera 27 may be stored in the storage 22, or may be stored in the storage 12 of the server 100 via the network 400.

Buses 19 and 29 are commonly connected to each of these elements and transmit, for example, address signals, data signals, and various control signals. In addition to these elements, user terminals 200 and 300 may also include a detection unit (not shown) such as a built-in sensor. For example, the detection unit may include an acceleration sensor, a vibration sensor, a gyro sensor, a geomagnetic sensor, a proximity sensor, an illuminance sensor, a pressure sensor, and a GPS.

The functional configuration of the information processing system 1 for realizing the information processing device and information processing method according to the embodiment will be described with reference to FIG. 4. FIG. 4 is an example functional block diagram implemented in the server 100 and the user terminals 200 and 300 corresponding to FIGS. 1 to 3, respectively.

The server 100 comprises an event registration unit 110, a ticket issuing unit 120, a queue management unit 130, a communication control unit 140, and a composite image generation unit 150. The server 100 also stores event ticket information 180 and a user image 181. The user terminal 200 owned by the subject comprises a communication unit 210, a display unit 220, an image processing/manipulation unit 230, and a timing unit 240. The user terminal 300 owned by the hobbyist comprises a communication unit 310, a ticket request/use unit 320, a display unit 330, and a designation/selection unit 340.

The event registration unit 110 of the server 100 registers and manages events related to the target person. The ticket issuing unit 120 issues tickets associated with the target person's events in response to requests from the user terminals 300 owned by multiple hobbyists. The queue management unit 130 sequentially adds each ticket to a queue associated with the event in response to the issuance of the ticket. In addition, the queue management unit 130 sequentially removes tickets one by one from the queue as a certain period of time passes. The queue is a waiting queue for issued tickets, and tickets are processed sequentially for each ticket. The operations of adding to and removing from the queue may be a first-in, first-out (FIFO) method or other methods. For example, a specific ticket may be added to the top of the queue so as to cut in and be removed preferentially. The event information and ticket information generated by the event registration unit 110 and the ticket issuing unit 120, as well as the queue information managed by the queue management unit 130, are preferably stored as event ticket information 180.

When a ticket is taken out of the queue, the communication control unit 140 allows real-time communication between the user terminal 300 of the hobbyist to whom the ticket was issued and the user terminal 200 of the target user for a certain period of time. The period is 30 seconds, for example, and may be preset or dynamically determined. The communication control unit 140 may also monitor the established real-time communication and control it to forcibly disconnect the communication depending on the communication situation. The real-time communication is preferably implemented, for example, by WebRTC (Web Real-Time Communication), although this is not limited thereto. More specifically, it is preferably possible to execute real-time communication by text chat, video chat, voice chat, etc., using a Web browser and/or a dedicated application. The real-time communication may include communication using characters and images, video images, and/or voice.

In this way, the queue management unit 130 and the communication control unit 140 execute one-to-one communication for a specific target person by sequentially switching between ticket holders, who are the preferences, based on the ticket queue. In other words, real-time communication based on the queue is executed by sequentially switching between its establishment and disconnection.

The composite image generating unit 150 generates a composite image including an image of the hobbyist and an image of the target person, which are acquired at a specific timing within the period of real-time communication. The images may be taken by the camera 27 (particularly the in-camera), or may be captured by the user terminals 200 and 300. It is preferable that the composite image can be further processed. Note that information such as still images and/or videos of the hobbyist and the target person captured during the real-time communication, as well as information of the composite image, are preferably stored as a user image 181.

The communication unit 210 of the user terminal 200 establishes real-time communication with the user terminal 300 owned by the hobbyist, enabling communication between the target and the hobbyist over a certain period of time. The display unit 220 displays video footage of the hobbyist and the target captured by the camera 27 side by side over the period during which real-time communication is established. Here, the images are displayed side by side in the orientation specified by the user terminal 300, and video-processed footage of the hobbyist may also be displayed.

The image processing/manipulation unit 230 identifies the facial area included in the video of the enthusiast through image recognition processing, and performs video processing on the areas other than the facial area of the enthusiast. It also performs processing on the composite image generated by the server 100. The image recognition processing may be implemented using a known pattern recognition technique. The video processing may be implemented using a known video processing technique, and a good example of the video processing is mosaic processing. The image processing/manipulation unit 230 is preferably provided only on the target person's terminal 200.

The timing unit 240 provides a specific timing for acquiring an image of the enthusiast and an image of the target person during the real-time communication. An example of the timing is the target person pressing a shooting button (or a capture button) via the input unit 251. Alternatively, the timing may be provided automatically, such as after a preset period has elapsed after the start of the real-time communication. It is preferable that the timing is provided multiple times.

The communication unit 310 of the user terminal 300 establishes real-time communication with the user terminal 200 owned by the target person, enabling communication between the preference and the target person for a certain period of time. The ticket request/use unit 320 requests the ticket issuing unit 120 to issue a ticket for an event, and receives the ticket. The ticket is also used to access the event in response to the ticket being issued. The display unit 330 displays video footage of the preference and the target person side by side for the period during real-time communication. Also, after real-time communication, a composite image is displayed that includes an image of the preference and an image of the target person taken at a timing within that period.

The designation/selection unit 340 receives designation by the hobbyist regarding the orientation of the images of the hobbyist and the target person that are displayed side by side. For example, when the user terminal 300 is a smartphone and the hobbyist holds the user terminal 300 vertically (i.e., the longitudinal direction is the vertical direction of the line of sight), it is preferable to designate the image orientation to be vertical. On the other hand, when the hobbyist holds the user terminal 300 horizontally (i.e., the longitudinal direction is the horizontal direction of the line of sight), it is preferable to designate the image orientation to be horizontal. In addition, the designation/selection unit 340 receives selection of the acquired images of the hobbyist and the target person after real-time communication. In other words, when there are multiple aforementioned timings, it is preferable to receive one selection from the multiple captured images of the hobbyist and one selection from the multiple captured images of the target person.

The elements in the hardware configurations of the server 100 and the user terminals 200, 300 shown in Figures 2 and 3, and the functional blocks shown in Figure 4 are merely examples and are not limited to these. Furthermore, the functional blocks shown in Figure 4 may be implemented as part of the hardware and/or as part of the software. Furthermore, at least a portion of the functional blocks of the server 100 shown in Figure 4 may be configured to be possessed by the user terminals 200, 300. Conversely, at least a portion of the functional blocks of the user terminals 200, 300 may be configured to be possessed by the server 100.

Below, an information processing method according to one embodiment will be described with reference to Figs. 5 to 9. Figs. 5 and 8 are exemplary flow diagrams implemented in the information processing method according to one embodiment. Here, interaction occurs between the server 100, a user terminal 200 owned by a target person (talent #a), and a user terminal 300 owned by a fan (fan #1). Of these, Fig. 5 is a flow diagram showing the process from issuing a ticket for an event to be held to establishing real-time communication between talent #a and fan #1. Also, Fig. 8 is a flow diagram showing the process during and after real-time communication.

Furthermore, Figures 6, 7 and 9 are examples of screen images of the user terminal 300 owned by Fan #1, generated in an information processing method according to one embodiment. Of these, Figure 6 is an example of a series of screen transitions from when a ticket is issued until the start of real-time communication becomes a standby state. Figure 7 is an example of a series of screen transitions from when the standby state is cleared until actual real-time communication begins. Figure 9 is an example of a series of screen transitions from when real-time communication is in progress until after the real-time communication ends. Note that, in the following, it is assumed that a one-to-one video call is conducted between Fan #1 and Talent #a during real-time communication.

I. From event registration to establishment of real-time communication In FIG. 5, first, in step S11, the event registration unit 110 registers an event related to talent #a. This is mainly a registration task by the event organizer. The registered event is then stored as event ticket information 180. In step S31, fan #1 accesses the URL for the event. If the event has not yet started, a pre-opening screen d1 is displayed. If the event is in progress, a ticket issuing screen d2 is displayed. Next, fan #1 presses the "ticket issue" button b21 on the ticket issuing screen d2, and as a result, in step S32, the ticket request/use unit 320 requests the server 100 to issue a ticket for the event related to talent #a.

In response to a ticket issuance request from the user terminal 300, in step S12, the ticket issuing unit 120 of the server 100 performs a ticket issuing process (Ticket A). Then, in step S13, the queue management unit 130 adds Ticket A to a queue associated with the ongoing event. The queue management unit 130 determines the waiting status of Ticket A according to the queue information. Also, in step S14, the queue management unit 130 sequentially takes out the tickets from the queue one by one at a time for each certain period, and updates the queue each time.

Note that while the tickets in the queue are being processed, in step S21, talent #a is making one-to-one video calls with other fans #2 to #n one after another via communication unit 210.

In response to the ticket issuing process (step S12) in the server 100, in step S33, the ticket request/use unit 320 on the fan #1 side receives the ticket from the server 100 and uses the ticket. Specifically, the event related to the talent #a is accessed. At that time, the waiting screen d3 is displayed on the user terminal 300. The waiting screen d3 displays the talent's content b31 and waiting information i32. The waiting information i32 displays waiting information that is dynamically determined based on the queue information, such as "150 people are currently waiting/3 people left until you", as a message. The waiting information i32 is updated each time in synchronization with the update of the queue in the server 100 (S14). In addition, the content b31 presented in the waiting state may include any of still images, videos, and audio of the talent #a related to the event. This makes the waiting time of the fan #1 attractive, and the fan #1 can maintain high motivation even during the waiting state.

In step S15, when the queue management unit 130 of the server 100 removes ticket A from the queue (Yes), a procedure for establishing real-time communication between the user terminal 300 of fan #1 and the user terminal 200 of talent #a is executed based on this. Specifically, first, in response to the end of the waiting state of fan #1, an entry screen d4 is displayed on the user terminal 300. On the entry screen d4, the display of the waiting information i32 on the waiting screen d3 is changed to entry prompting information i41, and the "enter" button b42 is newly activated and displayed. Then, when the "enter" button b42 is pressed by fan #1, the screen transitions to the item selection screen d5.

In step S34, the designation/selection unit 340 selects an item displayed on the item selection screen d5. In the example of the item selection screen d5, two items, it1 and it2, are displayed, but the present invention is not limited to this, and any number of items may be displayed. The items it1 and it2 are contents presented by the fan #1 to the talent #a and shared between the fan #1 and the talent #a when the fan #1 and the talent #a make a video call through real-time communication. The contents here may be stamp images, text messages, or a combination of these. The contents may be either pre-created or dynamically created by the fan #1 on the item selection screen d5. The selection of an item by the fan #1 on the item selection screen d5 is optional. When the "Next" button b51 is pressed by the fan #1 on the item selection screen d5, the screen transitions to a video call start screen d6.

In step S35, the communication unit 310 executes various preparations for real-time communication. Specifically, the user terminal 300 of the fan #1 is set to be capable of video communication. In particular, the audio IF 26 and the camera 27 are set to be activated for the video call. In addition, the designation/selection unit 340 designates the orientation of the images of the fan #1 and the talent #a during the video call. For example, when the fan #1 holds the user terminal 300 vertically to make a video call, it is preferable to designate the orientation of the images to be up and down (e.g., talent #a on top and fan #1 on the bottom) through the operation of the "orientation designation" button b61 on the video call start screen d6. On the other hand, when the fan #1 holds the user terminal 300 horizontally, it is preferable to designate the orientation of the images to be left and right (e.g., talent #a on the left and fan #1 on the right). Once the various preparations for real-time communication are complete and fan #1 presses the "Start video call" button b62 on the video call start screen d6, the communication unit 310 supplies a trigger to start real-time communication to the server 100.

When a trigger for establishing real-time communication is supplied to the server 100, in step S16, the communication control unit 140 permits real-time communication. In response, in step S22, the communication unit 210 of the user terminal 200 of the talent #a accepts the real-time communication. In this way, real-time communication between the user terminal 200 of the talent #a and the user terminal 300 of the fan #1 is established.

II. From the establishment of real-time communication to the end of real-time communication, as a result of steps S35, S16, and S22 in Fig. 5, the process proceeds to Fig. 8, where real-time communication is established between the user terminal 200 of talent #a and the user terminal 300 of fan #1 by steps S23 and S36. This allows one-to-one video calling to be carried out between talent #a and fan #1 for a certain period of time.

During the video call by real-time communication (steps S24, S37), in steps S241 and S371, respectively, the display units 220, 330 display the video image of talent #a and the video image of fan #1 in the same image order. Also, in steps S242 and S372, respectively, the display units 220, 330 display the item selected in step S34. This creates a sense of unity and realism between fan #1 and talent #a.

Specifically, the video call screen d7 of the user terminal 300 of the fan #1 displays the video image m71 of the talent #a and the video image m72 of the fan #1 under a time limit of 30 seconds, allowing the fan #1 to freely communicate with the talent #a. Items it1 and it2 are also displayed on the video call screen d7 to support communication. Note that on the user terminal 200 of the talent #a, the video image m71 of the talent #a and the video image m72 of the fan #1 are displayed side by side in the same orientation as on the video call screen d7, and items it1 and it2 are also displayed (not shown).

In addition, in step S243, in the user terminal 200 of the talent #a, the image processing/manipulation unit 230 may perform image processing on the video image m72 of the fan #1. Specifically, the image processing/manipulation unit 230 may perform image recognition processing on the video image m72 of the fan #1 to identify the facial area included in the image of the fan #1, and perform image processing (e.g., mosaic processing) on the areas other than the facial area of the fan #1. This prevents the talent #a from seeing, for example, an unscrupulous fan engaging in an act that violates public order and morals, allowing for sound event management and appropriate protection of the talent #a from such acts.

In step S244, an image of fan #1 and an image of talent #a displayed by the display unit 220 during the video call are acquired at one or more specific timings. Each image of fan #1 and talent #a may be acquired separately, or may be acquired as one image displayed side by side. The specific timing here may be provided any number of times by the timing unit 240. By talent #a providing the timing, it is possible to enhance the sense of unity between fan #1 and talent #a, and it is possible to provide a more interactive fan service. Alternatively, the timing may be provided by fan #1 or automatically by the server 100. The images acquired here may be stored in the server 100 as user images 181.

When a predetermined period of time has passed and the real-time communication has ended, the user terminal 300 of Fan #1 transitions from the video call screen d7 to the commemorative photo screen d8. Specifically, a composite image including an image of Fan #1 and an image of Talent #a is generated based on the stored user image 181, and is displayed on the display unit 330 of the user terminal 300 of Fan #1. More specifically, in step S38, the designation/selection unit 340 receives a selection of one each of the stored images of Fan #1 and Talent #a, based on Fan #1's preferences. The composite image is generated using each of the selected images.

In addition, in step S25, the image processing/manipulation unit 230 on the talent #a's side performs image processing on the selected image. For example, talent #a may add visualized information such as a handwritten signature, message, or date to the image. Furthermore, various decoration processes may be performed on the image. Alternatively, talent #a may create the information to be added in advance and store it in the server 100, and the processing may be performed automatically on the server 100 side.

Through step S38 on the user terminal 300 of Fan #1 and step 24 on the user terminal 200 of Talent #a, finally in step S17, the composite image generation unit 150 of the server 100 generates a composite image and presents it to the user terminal 300 of Fan #1. In this way, since the composite image is generated through the collaborative work of Fan #1 and Talent #a, Fan #1 receives a commemorative photo of his participation in the event.

In step S39, the display unit 330 of the user terminal 300 of fan #1 that has received the commemorative photo from the server 100 displays the composite image. Specifically, the commemorative photo screen d8 is displayed on the user terminal 300 of fan #1, and the generated commemorative photo p81 is displayed. The commemorative photo p81 displays an image i81 of the message and date added by the talent #a in step S25. The commemorative photo p81 is also displayed in a decorated form. Fan #1 can download the commemorative photo p81 for a fee or free of charge. The commemorative photo screen d8 may be in the form of an EC site where fan #1 can purchase goods related to the talent #a.

In this way, according to the information processing method and information processing device of the embodiment of the present disclosure, real-time communication between a lover and a target person who is the object of that lover's preference is activated online. It is possible to provide users with new entertainment value through online events, and to improve the user experience. For lover, it is possible to increase opportunities to communicate with the target person in real time. For the target person, it is possible to build a good relationship with the lover, making it possible to effectively acquire lover, and to expand the range of activities. Furthermore, for event organizers, it is possible to plan and hold events flexibly and at low cost, without being bound by physical constraints such as preparing the event venue.

<Example of change>
In the above embodiment, a one-to-one video call is performed between Fan #1 and Talent #a in real-time communication. In a modified example, in addition to Fan #1 and Talent #a, an event manager may also participate in the video call, and thus the video call between Fan #1 and Talent #a may be monitored. The event manager can warn Fan #1 and take emergency measures if Fan #1 acts against public order and morals. For example, the event manager may access the server 100 and force the communication control unit 140 to terminate the real-time communication.

In the above embodiment, the video call screen d7 mainly displays the video image m71 of talent #a, the video image m72 of fan #1, and items it1 and it2. In contrast, in a modified example, the audio information of the video call may be subtitled and displayed, or may be automatically translated and displayed in multiple languages. This allows fans to receive even more user-friendly fan service, and also allows the target person to acquire more fans.

At least the following technical ideas can be understood from the above-described embodiments.
[Mode 1] According to mode 1, an information processing method is provided, which includes the steps of requesting issuance of a ticket for an event related to a second user by a terminal of a first user, accessing the event in response to the issuance of the ticket, the ticket being added to a queue associated with the event, establishing real-time communication between the terminal of the first user and the terminal of the second user based on the ticket being removed from the queue, displaying a video image of the first user and a video image of the second user side-by-side for a certain period of time in the real-time communication, and displaying a composite image including an image of the first user and an image of the second user acquired at a specific timing within the period of time after the real-time communication.

[Form 2] According to Form 2, the method according to Form 1 further includes a step of identifying a facial area included in a video image of the first user through image recognition processing by the terminal of the second user in real-time communication, and image processing an area other than the facial area of the first user, and the image-processed video image of the first user and the video image of the second user are displayed side by side on the terminal of the second user.

[Mode 3] According to mode 3, in the method according to mode 1 or mode 2, the timing includes a timing provided by the second user.

[Mode 4] According to mode 3, the method according to any one of modes 1 to 3 further includes a step of receiving, by the terminal of the first user, a selection of an image of the first user and an image of the second user after the real-time communication, and the composite image includes the selected images of the first user and the second user.

[Form 5] According to form 5, in the method according to any one of forms 1 to 4, the composite image can be processed by the terminal of the second user.

[Form 6] According to Form 6, an information processing device is provided. The information processing device includes a ticket issuing unit that issues tickets associated with an event of a second user in response to requests from multiple terminals of a first user, a queue management unit that sequentially adds tickets to a queue associated with the event in response to the issuance of each ticket, and sequentially removes tickets one by one from the queue as a certain period of time passes, and a communication control unit that, based on the removal of a ticket from the queue, allows real-time communication between the terminal of the first user to which the ticket was issued and the terminal of the second user for the period of time.

The above-described embodiment is merely an example to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit of the present invention, and it goes without saying that the present invention includes equivalents.

Claims (6)

An information processing method executed in an information processing system in which a first user terminal having a camera, an audio interface, and a screen, a second user terminal having a camera, an audio interface, and a screen, and a server are connected via a network, the method comprising:
requesting the server to issue a ticket for an event related to the second user from a terminal of the first user;
accessing the event from a terminal of the first user in response to the issuance of the ticket by the server , the ticket being added to a queue associated with the event ;
the server establishing a real-time communication between the terminal of the first user and the terminal of the second user based on the ticket being removed from the queue;
a step in which the terminal of the first user displays, during a certain period of time in the real-time communication, a video image of the first user taken by a camera of the terminal of the first user and a video image of the second user taken by a camera of the terminal of the second user and acquired via the server, side by side on a screen of the terminal of the first user ;
a step in which the terminal of the first user displays, after the real-time communication, a composite image including an image of the first user taken by a camera of the terminal of the first user acquired at a specific timing within the period and an image of the second user taken by a camera of the terminal of the second user on a screen of the terminal of the first user ;
A method comprising: 2. The method of claim 1, further comprising the steps of:
A step in which the terminal of the second user identifies a facial area included in the video image of the first user displayed on a screen of the terminal of the second user through image recognition processing, and performs image processing on an area other than the facial area of the first user ;
a step of displaying the processed video image of the first user and the video image of the second user side by side on a screen of the terminal of the second user ;
A method comprising : The method of claim 1 or 2, wherein the timing includes timing provided by the second user. The method according to any one of claims 1 to 3, further comprising:
a step of receiving , by a terminal of the first user , a selection by the first user of an image of the first user and an image of the second user, respectively, after the real-time communication;
The method, wherein the composite image includes images of the selected first and second users. The method according to any one of claims 1 to 4, wherein the composite image can be processed by the terminal of the second user. a ticket issuing unit that issues tickets associated with an event of a second user in response to requests from terminals of a plurality of first users;
a queue manager that sequentially adds the tickets to a queue associated with the event in response to the issuance of each of the tickets, and sequentially removes the tickets one by one from the queue in response to the passage of a certain period of time;
a communication control unit that, based on the fact that one of the tickets has been taken out of the queue, permits real-time communication between the terminal of the first user to which the one of the tickets has been issued and the terminal of the second user for the period;
An information processing device comprising: