JP7708699B2 - Conversation control device, conversation system, and conversation control method - Google Patents

Description

The present invention relates to technology for enabling online conversations.

Systems for holding conversations and conferences over a network have been proposed for some time now. In these systems, it is common to display facial images of participants captured by a camera, icons of the participants, and the like. For example, Patent Document 1 describes a method of extracting an image of the facial region of a captured user and displaying it with a blurred background. By visually checking the displayed facial image icons, users can understand which people are participating.

JP 2012-213013 A

Conventionally, online conferences were held by determining the members who would participate in the meeting in advance and issuing URLs and conference IDs for the online conference to each participating member. Therefore, a situation in which multiple online conferences were held in parallel and participants entered and left multiple online conferences was not anticipated in the first place. In the future, multiple online conferences may be held in parallel. For example, a mechanism may be provided in which the status of multiple online conferences held in parallel, not just the online conference in which one is participating, is displayed in a visible state, and the online conferences can be moved back and forth by operating on the screen without using information for access (e.g., URLs). In the future, it is necessary to further improve the convenience of such a system. For example, a mechanism in which only authorized users who have been registered in advance can participate in an online conference would be inconvenient. Therefore, a mechanism is required that allows unauthorized users who have not been registered to temporarily participate in an online conference.

In light of the above, the present invention aims to provide technology that allows non-authorized users to temporarily participate in online conferences.

One aspect of the present invention is a virtual conference room for conversations over a network, comprising: a display information generation unit that generates display data required for displaying on a user terminal a conference room area image, which is an image showing the multiple conference rooms currently installed, and an icon image showing the user; a conference room control unit that controls participation in the conference room in response to user operations; and a conversation control unit that controls conversations between users participating in the same conference room, and the conference room control unit is a conversation control device that performs different processing when a pre-registered authorized user among the users participates in the conference room and when a guest user among the users who has been approved by the authorized user to participate temporarily participates in the conference room.

In one aspect of the present invention, the conversation control device further includes a message control unit that controls a conversation between users using text messages in the conference room, and the display information generation unit generates display data that further includes messages of the conversation in the conference room.

One aspect of the present invention is a conversation system that is a virtual conference room for conversations over a network, and includes an image data generation unit that generates image data including a conference room area image, which is an image showing a plurality of currently installed conference rooms, and an icon image showing a user, a conference room control unit that controls participation in the conference room in response to a user's operation, and a conversation control unit that controls conversations between users participating in the same conference room, and the conference room control unit performs different processing when a pre-registered regular user among the users participates in the conference room and when a guest user among the users who has been approved by the regular user to participate temporarily participates in the conference room participates in the conference room, and the image data generation unit generates different image data for a regular user terminal, which is a user terminal operated by the regular user, and a guest user terminal, which is a user terminal operated by the guest user.

In one aspect of the present invention, the chat system further includes a message control unit that controls a conversation between users using text messages in the conference room, and the image data generation unit generates image data that further includes messages of the conversation in the conference room.

One aspect of the present invention is a conversation control method that includes a display information generation step in which a computer generates display data required for displaying on a user terminal a conference room area image, which is an image showing a plurality of currently installed conference rooms, and an icon image showing a user, as a virtual conference room for conversations over a network; a conference room control step in which the computer controls participation in the conference room in response to a user's operation; and a conversation control step in which the computer controls conversations between users participating in the same conference room, and in which, in the conference room control step, the computer performs different processing depending on whether a pre-registered regular user among the users participates in the conference room or a guest user who has been approved by a regular user to temporarily participate among the users participates in the conference room.

One aspect of the present invention is the above conversation control method, further comprising a message control step in which the computer controls a conversation between users using text messages in the conference room, and in the display information generation step, generates display data that further includes messages of the conversation in the conference room.

One aspect of the present invention is a conversation control method that includes an image data generation step in which a computer generates image data including a conference room area image, which is an image showing a plurality of currently installed conference rooms for conversations over a network, and an icon image showing a user; a conference room control step in which the computer controls participation in the conference room in response to a user's operation; and a conversation control step in which the computer controls conversations between users participating in the same conference room, in which, in the conference room control step, the computer performs different processing when a pre-registered authorized user among the users participates in the conference room and when a guest user among the users who has been allowed to participate temporarily by the authorized user participates in the conference room, and in the image data generation step, the computer generates different image data for an authorized user terminal that is a user terminal operated by the authorized user and a guest user terminal that is a user terminal operated by the guest user.

One aspect of the present invention is the above conversation control method, further comprising a message control step in which the computer controls a conversation between users using text messages in the conference room, and in the image data generation step, the computer generates image data that further includes messages of the conversation in the conference room.

This invention allows non-authorized users to temporarily participate in online conferences.

1 is a schematic block diagram showing a system configuration of a first embodiment of a chat system 100 of the present invention. A schematic block diagram showing a specific example of the functional configuration of a user terminal 10. 2 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20. [0023] FIG. 1A and 1B are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. FIG. 13 is a diagram showing a specific example of a user state setting image. FIG. 4 is a diagram showing a specific example of an icon image 41. 1A and 1B are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. 1A and 1B are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. 1A and 1B are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. 1A and 1B are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. FIG. 13 is a diagram showing a specific example of a conference room area image 30 of a conference room to which a listening user is connected. FIG. 13 is a diagram showing a specific example of an operation screen for setting a conference room to an open state. FIG. 13 is a diagram showing a specific example of an image displayed when a guest user accesses a conference room. FIG. 13 is a diagram showing a specific example of an image after a guest user has entered a conference room. FIG. 11 is a diagram showing a specific example of an image displayed on the user terminal 10 of an authorized user. FIG. 11 is a diagram showing a specific example of an image displayed on the user terminal 10 of a guest user. A schematic block diagram showing a specific example of the functional configuration of a user terminal 10 in the second embodiment. FIG. 11 is a schematic block diagram showing a specific example of the functional configuration of a conversation control device 20 in a second embodiment. 13A and 13B are diagrams showing specific examples of a message display area in a message notification mode. 13A and 13B are diagrams showing specific examples of a message display area in a message notification mode. 13A and 13B are diagrams showing specific examples of a message display area in a message history mode. 13A and 13B are diagrams showing specific examples of a message display area in a message history mode.

Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings.
[First embodiment]
FIG. 1 is a schematic block diagram showing the system configuration of a first embodiment of a conversation system 100 of the present invention. The conversation system 100 is a system in which users operating user terminals 10 can converse with each other via a network 90. The conversation system 100 includes a plurality of user terminals 10 and a conversation control device 20. The plurality of user terminals 10 and the conversation control device 20 are communicatively connected via the network 90. The network 90 may be a network using wireless communication or a network using wired communication. The network 90 may be configured by combining a plurality of networks.

Figure 2 is a schematic block diagram showing a specific example of the functional configuration of a user terminal 10. The user terminal 10 is configured using information devices such as a smartphone, tablet, personal computer, portable game console, stationary game console, and dedicated device. The user terminal 10 includes a communication unit 11, an operation unit 12, a display unit 13, an audio input unit 14, an audio output unit 15, a memory unit 16, and a control unit 17.

The communication unit 11 is a communication device. The communication unit 11 may be configured as, for example, a network interface. The communication unit 11 communicates data with other devices via the network 90 in accordance with the control of the control unit 17. The communication unit 11 may be a device that performs wireless communication or a device that performs wired communication.

The operation unit 12 is configured using existing input devices such as a keyboard, a pointing device (mouse, tablet, etc.), buttons, a touch panel, etc. The operation unit 12 is operated by the user when inputting the user's instructions to the user terminal 10. The operation unit 12 may be an interface for connecting the input device to the user terminal 10. In this case, the operation unit 12 inputs an input signal generated in the input device in response to the user's input to the user terminal 10. The operation unit 12 may be configured using a microphone and a voice recognition device. In this case, the operation unit 12 performs voice recognition on words spoken by the user, and inputs character string information of the recognition result to the user terminal 10. The operation unit 12 may be configured in any way as long as it is configured to input the user's instructions to the user terminal 10.

The display unit 13 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 13 displays image data used when having a conversation. The display unit 13 may be an interface for connecting an image display device to the user terminal 10. In this case, the display unit 13 generates a video signal for displaying the image data and outputs the video signal to the image display device connected to the display unit 13.

The voice input unit 14 is configured using a microphone. The voice input unit 14 may be configured as a microphone itself, or may be configured as an interface for connecting a microphone to the user terminal 10 as an external device. The microphone acquires the speech of a user who is having a conversation. The voice input unit 14 outputs data of the voice acquired by the microphone to the control unit 17.

The audio output unit 15 is configured using an audio output device such as a speaker, headphones, or earphones. The audio output unit 15 may be configured as the audio output device itself, or may be configured as an interface for connecting the audio output device to the user terminal 10 as an external device. It is desirable for the audio output device to output audio so that the user having a conversation can hear the audio. The audio output unit 15 outputs audio corresponding to the audio signal output by the control unit 17.

The storage unit 16 is configured using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The storage unit 16 stores data used by the control unit 17. The storage unit 16 may function as a user information storage unit 161, for example. The user information storage unit 161 stores information about the user who operates the user terminal 10 (hereinafter referred to as "user information"). The user information may include, for example, the user's handle name, the user's icon data, and the user's attribute information. The handle name is the name (nickname or real name) that the user uses when having a conversation in the conversation system 100. The icon data is image data that the user uses when having a conversation in the conversation system 100. The attribute information may include, for example, information about the user's age, sex, and affiliation.

The control unit 17 is configured using a processor such as a CPU (Central Processing Unit) and a memory. The control unit 17 functions as a display control unit 171, a conference control unit 172, and a conversation control unit 173 by the processor executing a program. All or part of the functions of the control unit 17 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. Examples of computer-readable recording media include portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, and a semiconductor storage device (e.g., an SSD: Solid State Drive), and storage devices such as a hard disk and a semiconductor storage device built into a computer system. The above program may be transmitted via a telecommunications line.

The display control unit 171 receives display information from the conversation control device 20 via the communication unit 11. The display control unit 171 generates an image signal based on the acquired display information and displays it on the display unit 13. The display information may be, for example, image data indicating the image itself to be displayed. In this case, the entity that generates the image data (image data generation unit) is the display information generation unit 233 of the conversation control device 20. The display information may be, for example, data indicating information required to generate the image to be displayed (for example, information indicating the position, size, and display mode of the conference room to be displayed, or the position and icon image of the user). In this case, the display control unit 171 generates image data to be displayed on the display unit 13 based on the display data. In this case, the entity that generates the image data (image data generation unit) is the display control unit 171.

The conference control unit 172 controls the conferences that are virtually established in the conversation control device 20. For example, when a user operates the operation unit 12 to instruct the establishment of a new conference room, the conference control unit 172 performs processing to establish the new conference room.

The conversation control unit 173 controls conversations held with users of other user terminals 10. A conversation with a user of another user terminal 10 may be held, for example, as a conversation between one or more users participating in an installed conference room (hereinafter referred to as a "conference room conversation"). The conversation control unit 173 transmits voice data input from, for example, the voice input unit 14 to the conversation control device 20 via the communication unit 11. When the conversation control unit 173 receives voice data from the conversation control device 20, it outputs the received voice data from the voice output unit 15.

Figure 3 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20. The conversation control device 20 is configured using an information processing device such as a personal computer or a server device. The conversation control device 20 includes a communication unit 21, a storage unit 22, and a control unit 23.

The communication unit 21 is a communication device. The communication unit 21 may be configured as, for example, a network interface. The communication unit 21 communicates data with other devices via the network 90 in accordance with the control of the control unit 23. The communication unit 21 may be a device that performs wireless communication or a device that performs wired communication.

The storage unit 22 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 22 stores data used by the control unit 23. The storage unit 22 may function, for example, as a regular user information storage unit 221, a guest user information storage unit 222, and a conference room information storage unit 223.

The authorized user information storage unit 221 stores information (authorized user information) about multiple authorized users who operate the user terminal 10. An authorized user is a person who has completed a predetermined procedure and been registered in advance as a user who can use the chat system 100. An authorized user can use one or more functions (hereinafter referred to as "authorized user functions") provided for authorized users in the chat system 100, for example, by logging in using a user ID and password.

Authorized users can voluntarily log in to the conversation system 100 without receiving an invitation from another authorized user. By logging in to the conversation system 100, authorized users can converse online with other users who are logged in to the conversation system 100. Authorized user information for multiple authorized users may be registered in advance in the conversation control device 20. The authorized user information may include, for example, the handle name of the authorized user, icon data of the authorized user, and attribute information of the authorized user.

The guest user information storage unit 222 stores information about guest users (guest user information). A guest user is someone who can access the conversation system 100 by receiving an invitation from a legitimate user. A guest user receives information for accessing the conversation system 100 (hereinafter referred to as "guest access information"), for example, as an invitation from a legitimate user, and accesses the conversation system 100 as a guest user by using the guest access information. For example, a character string such as a URL (Uniform Resource Locator) or an ID may be used as the guest access information.

In the conversation system 100, a guest user can use one or more functions (hereinafter referred to as "guest user functions") provided for guest users. However, the guest user functions are limited compared to the regular user functions. In other words, the functions provided as guest user functions are part of the regular user functions. Note that functions that are not provided as regular user functions may be included in the guest user functions. The guest information may include, for example, the guest user's handle name and the guest user's attribute information. The handle name is the name (nickname or real name) that the guest user uses when having a conversation in the conversation system 100. The attribute information may include, for example, information regarding the guest user's age, gender, and affiliation. Note that the concept of a user includes both regular users and guest users.

The conference room information storage unit 223 stores information about conference rooms (hereinafter referred to as "conference room information"). A conference room is a virtual room set up in the conversation system 100 for users to have conversations. The conference room information may include, for example, information indicating the name set for the conference room and information about the attributes of the conference room. The information about the attributes of the conference room may include, for example, information indicating whether the conference room is in a state where guests are allowed to enter (hereinafter referred to as "public state") or in a state where guests are not allowed to enter (hereinafter referred to as "private state"). The conference room information may further include information indicating the regular users and guest users currently in the conference room.

The control unit 23 is configured using a processor such as a CPU and a memory. The control unit 23 functions as a user control unit 231, a conference room control unit 232, a display information generation unit 233, and a conversation control unit 234 by the processor executing a program. All or part of the functions of the control unit 23 may be realized using hardware such as an ASIC, a PLD, or an FPGA. The above program may be recorded on a computer-readable recording medium. Examples of computer-readable recording media include portable media such as flexible disks, optical magnetic disks, ROMs, CD-ROMs, and semiconductor storage devices (e.g., SSDs), and storage devices such as hard disks and semiconductor storage devices built into a computer system. The above program may be transmitted via a telecommunications line.

The user control unit 231 performs control processing related to regular users and guest users. For example, the user control unit 231 may perform processing for logging in (e.g., authentication processing) for regular users who access the conversation control device 20. The user control unit 231 may register regular user information received from the user terminal 10 in the regular user information storage unit 221. The user control unit 231 may request guest users who access the conversation control device 20 to input guest user information, and register the input guest user information (e.g., handle name, attribute information, etc.) in the guest user information storage unit 222.

The conference room control unit 232 performs control processing related to the conference room. For example, when the conference room control unit 232 receives an instruction from the user terminal 10 to set up a new conference room, it may generate conference room information based on the received information and register it in the conference room information storage unit 223. When a predetermined operation is performed by a user to join a conference room, the conference room control unit 232 performs processing to allow the user to join the conference room if predetermined conditions are met. For example, the conference room control unit 232 updates the conference room information storage unit 223 to register that a new user has joined the conference room. At this time, the conference room control unit 232 may perform different processing depending on whether the request to join is made by a regular user or a guest user.

For example, when an authorized user who is logged in to the chat system 100 requests entry into a specific conference room, the conference room control unit 232 determines whether or not the authorized user is qualified to enter the conference room. For example, if it is a normal conference room, it may be determined that any authorized user is qualified to enter. For example, if it is a conference room with restricted entry, it may be determined whether or not a user is qualified to enter the room, provided that the user is an authorized user who has been registered in advance.

For example, for a guest user who has accessed the chat system 100 using specific guest access information, the conference room control unit 232 determines whether the conference room specified as the access destination is in a public state. If the conference room specified as the access destination is in a private state, the conference room control unit 232 does not allow the guest user to enter. If the conference room specified as the access destination is in a public state, the conference room control unit 232 allows the guest user to enter. At this time, instead of allowing the guest user to enter, the conference room control unit 232 may allow the guest user to enter a waiting room set up in the conference room. After the guest user enters the waiting room, if an operation is performed by a regular user to allow the guest user to enter the conference room, the conference room control unit 232 may allow the guest user to enter the conference room.

The display information generation unit 233 generates information (display information) required to generate an image to be displayed on the user terminal 10. The display information may include, for example, information about the currently installed conference room and information about the user of each user terminal 10 accessing the conversation control device 20. The display information generation unit 233 transmits the generated display information to the user terminal 10.

The images displayed on each user terminal 10 differ depending on whether the user is a regular user or a guest user, even if the user terminals 10 belong to users who have entered the same conference room. The amount of information shown in the image displayed on the user terminal 10 operated by the guest user (guest user terminal) is less than the amount of information shown in the image displayed on the user terminal 10 operated by the regular user (regular user terminal).

For example, the user terminal 10 operated by the authorized user may be configured to display information about conference rooms other than the conference room the authorized user is in, but the user terminal 10 operated by the guest user may be configured to not display information about conference rooms other than the conference room the guest user is in. If the guest user is invited to multiple conference rooms, the guest user terminal may be configured to display information about the multiple conference rooms to which the guest user is invited, but not display information about conference rooms to which the guest user is not invited. For example, the user terminal 10 operated by the authorized user may be configured to display information about conference rooms other than the conference room the authorized user is in, but the user terminal 10 operated by the guest user may be configured to not display information about conference rooms other than the conference room the guest user is in.

The conversation control unit 234 receives voice data from the user terminal 10. The conversation control unit 234 generates voice data to be output to each user terminal 10 (hereinafter referred to as "conversation voice data") and transmits the conversation voice data to each user terminal 10. The conversation control unit 234 may generate conversation voice data, for example, based on the type of conversation in which the user of each user terminal 10 is participating. For example, the conversation control unit 234 may transmit to each user's user terminal 10 conversation voice data including voices received from the user terminals 10 of all users participating in the conference room in which that user is present.

Next, we will explain the relationship between the images displayed on the user terminal 10 and the conversational voice data that is output when each image is displayed.

Figure 4 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In Figure 4, the display unit 13 displays a conference room area image 30, a conversation area 31, a listening area 32, an icon image 41, and an operation area image 51. The display unit 13 displays an image of a virtual space in which a conference room can be set up. The virtual space is mainly composed of a conference room area and an area outside the conference room. The conference room area is displayed as the conference room area image 30. The area outside the conference room (hereinafter referred to as the "outdoor area") is the area represented by the symbol 91, and is an area in which icon images 41 of users who are not in the conference room are displayed.

The conference room area image 30 includes a conversation area 31 and a listening area 32. A user whose icon image 41 is displayed in the conversation area 31 can converse with other users whose icon image 41 is displayed in the conversation area 31 of the same conference room. That is, the voices of the users whose icon images 41 are displayed in the conversation area 31 are transmitted and received between them. In the following explanation, entering a conference room means that an icon image 41 is displayed in the conversation area 31. That is, entering a conference room means that a user is in a state in which they can converse with other users in the room.

A user whose icon image 41 is displayed in the listening area 32 (hereinafter referred to as a "listening user") can listen to the conversation of the user whose icon image 41 is displayed in the conversation area 31 of the conference room (a user who has entered the conference room). However, the listening user cannot speak in the conference room. In other words, the voice uttered by the listening user is not output on the user terminals 10 of other users who have entered the conference room, or on the user terminals 10 of other listening users in the conference room.

The conference room area image 30 is represented as a geometrically shaped image showing an area of a predetermined size. In this embodiment, the conference room area image 30 is represented as a circular image. The name of the conference room 311 is displayed near the center of the conference room area image 30. In the example of FIG. 4, the name of the conference room is "Chat." By displaying the name of the conference room, even a user (authorized user) located in the outdoor area 91 can roughly guess what kind of conversation is taking place in the conference room without entering the conference room.

An entry button 312 and a details button 313 may be displayed inside the conference room area image 30. The entry button 312 is a button for requesting entry to the conference room. In response to the entry button 312 being operated by a user located in the outdoor area 91, the conference room control unit 232 determines that the user is requesting entry to the conference room. In response to the request, the conference room control unit 232 determines whether or not to permit entry, and controls the user's entry in accordance with the determination result.

The details button 313 is a button for displaying detailed information about the conference room. In response to the operation of the details button 313, a details display area is displayed on the screen. The details display area displays detailed information about the conference room, as well as buttons and input boxes for performing operations on the conference room. For example, a button for issuing guest access information, an area for displaying the guest access information, a button for changing the status to public or private, the name of the conference room, a button for changing the name of the conference room, an input box for entering the changed name of the conference room, etc. may be displayed.

The icon image 41 is an image that indicates the user's virtual location and information about the user. The icon image 41 may be displayed, for example, according to icon data included in the user information.

Figure 5 shows a specific example of a user status setting image. In response to a specified operation, a user status setting image 511 is displayed on the screen. In Figure 5, the user status setting image 511 shows examples of icon images and character strings for three user statuses: "Welcome", "Flat", and "Zone".

"Welcome" indicates, for example, that the user is accessing the conversation control device 20 and is available for conversation, and is actively interested in having a conversation. "Flat" indicates, for example, that the user is accessing the conversation control device 20 and is available for conversation, and is either willing to have a conversation or not. "Zone" indicates, for example, that the user is accessing the conversation control device 20 and is browsing the screen, but is not going to operate the device for a while, or is not interested in having a conversation. The specific examples of user states described above are merely examples, and user states may be defined in other ways.

FIG. 6 is a diagram showing a specific example of an icon image 41. The icon image 41 may be configured to indicate a user state. In the specific example shown in FIG. 6, the icon image 41 includes a user state image 42 that indicates a user state. The user state image 42 is an image that indicates a user state. The user state image 42 may be configured to indicate a user state, for example, by a shape or a color. As the user state image 42, for example, an icon image of each user state shown in the user state setting image 511 may be displayed.

The manner in which the user status is indicated in the icon image 41 does not need to be limited to the manner in which the user status image 42 is used. For example, the user status may be indicated in such a manner that the color of the icon image 41 itself changes depending on the user status. For example, if the status is welcome, the icon image 41 may be displayed in a normal color, if the status is flat, the icon image 41 may be displayed in a sepia-toned color, and if the status is zone, the icon image 41 may be displayed as a black and white image (e.g., a binary image).

Figure 7 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of Figure 7, icon images 41 (41_1 and 41_2) of two users and a conference room area image 30 of one conference room are displayed. No user has yet participated in the conference room indicated by the conference room area image 30. The two users have not participated in any conference room. Therefore, icon image 41_1 and icon image 41_2 are displayed in the exterior area 91, not inside the conference room area image 30.

A user who wishes to participate in a conference room can do so (enter) the conference room by performing a specific operation. For example, a user can join the conference room by operating the entry button 312 in the conference room area image 30 in which the user wishes to participate. Note that the operation for entering the room does not have to be limited to the above. If entry restrictions are set for a conference room, only users who are permitted to enter according to the entry restrictions can enter the conference room.

Figure 8 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of Figure 8, one user is participating in a conference room with the theme of chatting. Therefore, an icon image 41 (41_2) of one user is displayed inside the conference room area image 30 that shows the conference room with the theme of chatting. At this point, there are no other users participating in the same conference room as the user of icon image 41_2. Therefore, the user of icon image 41_2 cannot converse with other users in the conference room with the theme of chatting.

When a user of icon image 41_1 in the outdoor area 91 performs an operation to join a conference room with a chat theme, the users participating in the conference room are notified that another user wishes to join. For example, a predetermined sound (e.g., a knock on the door) may be output on each user's user terminal 10. The users to be notified may be all users participating in the conference room, or only a predetermined portion of users (e.g., the user who is the administrator of the conference room).

After the notification, if a certain condition is met, the user of icon image 41_1 can participate in the conference room with a chat theme. The certain condition may be, for example, simply that a certain amount of time (e.g., 1 second, 3 seconds, 5 seconds, etc.) has passed, or that participation has been permitted by a certain user (e.g., the administrator or participant of the conference room), or that a participation condition previously set for the conference room has been met.

Figure 9 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of Figure 9, two users are participating in a conference room with the theme of chatting. Therefore, icon images 41 (41_1 and 41_2) of the two users are displayed inside the conference room area image 30 indicating the conference room with the theme of chatting. At this point, the user of icon image 41_1 and the user of icon image 41_2 are participating in the same conference room. Therefore, the user of icon image 41_1 and the user of icon image 41_2 can have a conversation in the conference room with the theme of chatting. In other words, users participating in the same conference room can have a conversation using the user terminal 10.

More specifically, it is as follows. The user terminal 10 of a user participating in a conference room receives and outputs voice data spoken by other users participating in the same conference room. In addition, the user terminal 10 of a user participating in a conference room transmits the voice data spoken by that user to the conversation control device 20. This transmission causes the voice data to be output at the user terminals 10 of the other users participating in the same conference room. When a user of icon image 41_3 in the outdoor area 91 performs an operation to participate in a conference room with a chat theme, after certain conditions are met, the user of icon image 41_3 can participate in the conference room with a chat theme.

Figure 10 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of Figure 10, three users are participating in a conference room with the theme of chatting. Therefore, icon images 41 (41_1, 41_2, and 41_3) of the three users are displayed inside the conference room area image 30 that shows the conference room with the theme of chatting. At this point, the user of icon image 41_1, the user of icon image 41_2, and the user of icon image 41_3 are participating in the same conference room. Therefore, the user of icon image 41_1, the user of icon image 41_2, and the user of icon image 41_3 can have a conversation in the conference room with the theme of chatting. The same applies when four or more users participate in the same conference room.

Figure 11 is a diagram showing a specific example of a conference room area image 30 of a conference room to which a listening user is connected. A listening user cannot speak, but can hear what is being said by other users in the conference room. In other words, the speech of the listening user is not output to other users connected to the same conference room, but the speech of other users who are in the same conference room is output to the listening user.

In the example of FIG. 11, a listening user is connected to a conference room with a chatting theme. The listening user's icon image 41_3 is displayed in the listening area 32. The listening user's icon image 41_3 may be displayed in a manner different from the icon images 41 (e.g., icon image 41_1 and icon image 41_2) of users who are not listening users.

Next, a specific example of a procedure for notifying the guest access information to those to be invited to the chat system 100 (candidates for guest users) will be described. FIG. 12 is a diagram showing a specific example of an operation screen for setting a conference room to a public state. In response to an authorized user operating the details button 313, a details display area 512 is displayed. The details display area 512 includes a conference room name setting area 513 and a public setting area 514.

The conference room name setting area 513 displays the current conference room name (e.g., "Chat") and a button to change the conference room name. The conference room name change button may be displayed as a string of characters that reads, for example, "Change conference room name."

In the public setting area 514, a character string indicating the current state (e.g., "guest public") and a guest access information display area 515 are displayed. In the example of FIG. 12, "guest public" is displayed as the character string indicating the current state. This indicates that the state is public. The current public state may transition to a private state in response to an authorized user operating the public setting area 514. For example, when an authorized user performs a predetermined operation such as clicking or tapping in the public setting area 514, the conference room control unit 232 may transition from the public state to a private state, or from the private state to the public state. In addition, when an authorized user transitions the state of the conference room from the public state to the private state, the conference room control unit 232 may force all guest users who have entered the conference room to leave the conference room.

Guest access information is displayed in guest access information display area 515. In the specific example of FIG. 12, the guest access information is a URL. For example, a regular user sets the conference room to public by operating public setting area 514, and sends the guest access information displayed in guest access information display area 515 to the person to be invited. By performing such an operation, the person to be invited can be invited to the "Chat" conference room of conversation system 100 as a guest user.

When the conference room control unit 232 receives an instruction from a user to issue guest access information (URL or ID), it may issue new guest access information and transition the status of the conference room from a private state to a public state.

In this embodiment, the guest access information is different for each conference room. Therefore, even if a guest user is invited to a first conference room, the guest user cannot enter other conference rooms using the guest access information at that time. A validity period may be set for the guest access information. For example, after the guest access information is issued by an operation on the public setting area 514, the time during which the guest user can access a conference room using the guest access information may be limited. Such control may be executed, for example, by the conference room control unit 232. Guest access information that allows access to a specific number of conference rooms may be issued as guest access information.

The conference room area image 30 of a conference room in a public state may be displayed in a manner different from the conference room area image 30 of a conference room in a private state. For example, the image of the conference room area image 30 itself may remain unchanged, but an image indicating that it is in a public state (hereinafter referred to as a "public notification image") 516 may be displayed near the conference room area image 30. For example, the color or decoration of the conference room area image 30 itself may be displayed differently, or the public notification image may be displayed inside the conference room area image 30.

Figure 13 is a diagram showing a specific example of an image displayed when a guest user accesses a conference room. When a guest user accesses a conference room of the chat system 100 using guest access information, a screen for entering a name is displayed on the user terminal 10 of the guest user. The guest user enters his/her name (handle name). In the example of Figure 13, the guest user enters the handle name "Patent Taro". In response to this, part of the handle name "Patent" is displayed in the icon image 44 of the guest user. In this way, the icon image 44 of the guest user may be generated in a manner different from the icon image 41 of the regular user. For example, the color of the inside or frame may be different, or a restriction may be set so that the icon image 44 of the guest user is generated with only text. The same applies to the icon image 43 and image 518 described above. By configuring in this way, it is possible to easily determine which icon belongs to the guest user.

When a guest user has entered a waiting room and is waiting, an image such as that shown in FIG. 13 is displayed on the user terminal 10 of a legitimate user who has entered the conference room. That is, a waiting notification image 517 is displayed. The waiting notification image 517 displays a predetermined image 518 indicating that the user is waiting, the handle name of the waiting guest user, and an allow/reject button. The allow/reject buttons displayed include an allow button for allowing the guest user to enter the room, and a reject button for denying the guest user's entry. The legitimate user allows or rejects the guest user's entry by operating either of the allow/reject buttons.

When a guest user has entered a waiting room and is waiting in this manner, a predetermined image indicating that the user is waiting may be displayed as an icon image 43 in the conversation area 31. By displaying the image in this manner, an authorized user can easily understand which conference room the guest user is waiting in. Furthermore, the image 518 and the icon image 43 may be the same image or different images. For example, an image showing a bell may be used for the image 518 and the icon image 43.

Figure 14 is a diagram showing a specific example of an image after a guest user has entered a conference room. An icon image representing a guest user may be displayed in a different manner from an icon image representing a regular user. For example, in the example of Figure 14, an image set for a regular user or an image set as a default is displayed as an icon image for a regular user, but text is displayed on the icon image of a guest user. This text may be, for example, part or all of the guest user's handle name. By displaying the images in different manners in this way, each user who has entered the conference room can easily determine which users are guest users and which users are regular users.

Figure 15 is a diagram showing a specific example of an image displayed on the user terminal 10 of an authorized user. The image in Figure 15 shows a specific example of an image displayed on the user terminal 10 of an authorized user (user of icon image 41_4) of conference room area image 30_1 in the upper right corner of the screen. Images of conference rooms other than the conference room the user himself/herself is in are also displayed on the authorized user's user terminal 10. For example, images of other conference rooms (the "New OS Development Project" and "Meditation" conference rooms) and icon images 41 of users who have entered those conference rooms are displayed.

16 is a diagram showing a specific example of an image displayed on the user terminal 10 of a guest user. The image in FIG. 16 shows a specific example of an image displayed on the user terminal 10 of a guest user (user of icon image 44_1) of the conference room area image 30_1 in the upper right corner of the screen. Images of conference rooms other than the conference room in which the guest user himself/herself is present are not displayed on the user terminal 10 of the guest user. For example, images of other conference rooms (the "New OS Development Project" and "Meditation" conference rooms) and icon images 41 of users present in those conference rooms are not displayed. By performing such control, the guest user cannot obtain any information about conference rooms other than the conference room to which he/she is invited (the "Chat" conference room in the case of FIG. 16). Furthermore, the details button 313 is not displayed on the user terminal 10 of the guest user. Therefore, the guest user cannot perform operations using the details button 313. This makes it possible to maintain security for guests.

Also, as shown in FIG. 16, an image showing the conference room in which the guest user is present (conference room area image 30 and images of other users present in the conference room, etc.) may be displayed in the center of the screen on the guest user's user terminal 10. At this time, the image may be displayed as large as possible depending on the size of the display frame on the user terminal 10. For example, the conference room area image 30 may be enlarged and displayed to the extent that the entire conference room area image 30 can be displayed. However, a predetermined margin may be provided in the vertical and/or horizontal directions.

In the conversation system 100 configured in this way, it is possible for non-regular users to temporarily participate in an online conference (conversation in a conference room) as guest users. Specifically, by setting the conference room to a public state and notifying the invited non-regular users of guest access information, the non-regular users can enter the public conference room as guest users.

In addition, the amount of information displayed on the user terminal 10 of a guest user is less than the amount of information displayed on the user terminal 10 of a regular user. For example, the user terminal 10 of a guest user does not display information about conference rooms other than the conference room in which the guest user is participating or multiple conference rooms to which the guest user has been invited. Therefore, in the chat system 100, which is premised on the display of images showing multiple conference rooms, it is possible to realize the participation of guest users while maintaining a certain level of security.

[Second embodiment]
Next, a second embodiment of the chat system 100 of the present invention will be described. In the chat system 100 of the second embodiment, a user can exchange text information with other users who belong to the same conference room by operating the operation unit 12 of the user terminal 10. Specifically, a message display area showing text information (hereinafter referred to as "message") entered by users who belong to the same conference room is displayed on the display unit 13 of the user terminal 10. Below, devices and configurations of the second embodiment that differ from the first embodiment will be described.

Figure 17 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10 in the second embodiment. The user terminal 10 in the second embodiment differs from the first embodiment in that the control unit 17 further functions as a message control unit 174.

The message information storage unit 174 transmits the character string input by the user via the operation unit 12 or the voice input unit 14 as a message to the conversation control device 20.

Figure 18 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20 in the second embodiment. The conversation control device 20 in the second embodiment differs from the first embodiment in that the storage unit 22 further functions as a message information storage unit 224 and the control unit 23 further functions as a message control unit 235.

The message information storage unit 224 stores information about messages sent from each user terminal 10. For example, for each message, the message information storage unit 224 may store, in association with each other, the content of the message (character strings constituting the message), identification information indicating the user who sent the message, information indicating the date and time when the message was entered, and information indicating the conference room to which the message was sent.

When the message control unit 235 receives a message from a user terminal 10, it registers information about the received message in the message information storage unit 224. The message control unit 235 instructs the display information generation unit 233 to display the contents of the received message in the message display area of the user terminal 10 of the user who belongs to the conference room to which the message was sent. In this instruction, the message control unit 235 specifies the user terminal 10 on which each message is to be displayed. For example, the contents of the message are displayed only on the user terminals 10 of users (including guest users) who belong to the same conference room, and are not displayed on the user terminals 10 of users who are not in the conference room.

When a specified status change occurs regarding a conference room, the message control unit 235 is notified of the details from the conference room control unit 232. The message control unit 235 instructs the display information generation unit 233 to display a string indicating the status change in the message display area of the user terminal 10 of the user who belongs to the conference room in which the specified status change occurred. Specific examples of specified status changes may include, for example, a change in the settings of the conference room (for example, changing from a private state to a public state). Specific examples of specified status changes may include, for example, a user entering the conference room, a user leaving the conference room, and a user outside the conference room being invited (called to enter the conference room).

The message control unit 235 deletes messages that satisfy a predetermined condition among the messages stored in the message information storage unit 224. The predetermined condition may be, for example, that all users have left the conference room to which the message was sent. In this case, all messages in a conference room from which all users have left may be deleted at that time, or may be deleted after a predetermined time (e.g., 1 minute, 1 hour, 24 hours, etc.) has elapsed since all users have left. The predetermined condition may be, for example, that even if users remain in the conference room to which the message was sent, that the message may be deleted after a predetermined period of time (e.g., 1 hour, 24 hours, 48 hours, etc.) has elapsed since the message was posted, or that the message may be deleted at a predetermined time (e.g., 12:00 a.m., 1:00 a.m., etc.) after a predetermined period of time (e.g., 1 hour, 24 hours, 48 hours, etc.) has elapsed since the message was posted.

The message control unit 235 may cause the user terminal 10 to display the message display area in a number of different modes. For example, a message notification mode and a message history mode may be defined, and the message display area may be displayed in a different mode in each mode. Specific examples of the display mode of the message display area in each mode are described below.

Figures 19 and 20 are diagrams showing specific examples of the message display area in the message notification mode. In the message notification mode, a message display area 61 and a message operation area 70 are displayed in part of the operation area image 51. A message input field 71, a message posting button 72, and a mode change button 73 are displayed in the message operation area 70. The message input field 71 displays the character string of a message input by the user via the operation unit 12 or the voice input unit 14. The message posting button 72 is a button for posting the character string displayed in the message input field 71 as a message when operated. The mode change button 73 is a button for switching between the message notification mode and the message history mode.

For example, messages may be posted only by users who are in the conference room. Users who are participating in the conference room as listener users may also be controlled to be able to post messages. Users who are participating in the conference room as guest users may also be controlled to be able to post messages. Users who are not in the conference room and are not participating as listener users or guest users may be controlled so that they cannot post messages to the conference room or see messages (they are not displayed).

The size of the message display area 61 displayed in the message notification mode is relatively smaller than the message display area 62 displayed in the message history mode. Therefore, the number of messages displayed in the message display area 61 in the message notification mode is relatively smaller than the number of messages displayed in the message display area 62 displayed in the message history mode. By configuring in this way, the message notification mode can ensure a field of view for sharing workspaces and documents. In other words, the message notification mode makes it possible to ensure a large space for displaying characters and images other than messages.

In message notification mode, a message is displayed in the message display area 61 immediately after it is posted. When a predetermined time (e.g., a few seconds, 5 seconds, 10 seconds, etc.) has passed since the message was posted, the message is no longer displayed in the message display area 61 (the display is deleted) even if there is space in the message display area 61 to display the message. The predetermined time is shorter than the end of a typical conversation, and may be a few seconds as described above, or 5 to 10 seconds. By configuring it in this way, old messages disappear from the screen one after another, providing a lively and dynamic appearance.

Five messages are displayed in the message display area 61 of FIG. 19. Each message is displayed in the order in which it was posted. For example, the message "Patent-san, I'll call you" displayed at the top is a message posted by the user of icon image 41_1, and is the oldest message among the five messages. The message "Patent-san has been called" displayed below is a message displayed in response to a predetermined change in the situation in the conference room, and is the second oldest message among the five messages. The message "Patent-san has entered the room" displayed below is a message displayed in response to a predetermined change in the situation in the conference room, and is the third oldest message among the five messages. The message "This is Patent, Nice to meet you" displayed below is a message posted by the guest user of icon image 44, and is the fourth oldest message among the five messages. The message "Patent-san, Nice to meet you" displayed below (at the bottom) is a message posted by the user of icon image 41_4, and is the fifth oldest (newest) message among the five messages.

Figure 20 is a screen that is displayed a predetermined time (e.g., several seconds) after the screen shown in Figure 19 is displayed. In Figure 20, of the five messages that were displayed at the time of Figure 19, two messages that were posted a predetermined time ago are not displayed.

Figures 21 and 22 are diagrams showing specific examples of the message display area in the message history mode. In the message history mode, a message display area 62 is displayed in part of the operation area image 51. The size of the message display area 62 displayed in the message history mode is relatively larger than the message display area 61 displayed in the message notification mode. Therefore, more messages are displayed. By configuring it in this way, in the message history mode, a field of view for checking the message history can be secured.

In message history mode, all message history recorded in the message information storage unit 224 for that conference room is displayed in the message display area 62. However, the number of messages displayed in the message display area 62 at one time is determined by the size and resolution of the display unit 13 of the user terminal 10, the size of the operation area image 51, etc. Therefore, it may not be possible to display all messages recorded in the message information storage unit 224 at once. In such cases, a scroll bar 621 is displayed as shown in FIG. 21, and all messages can be viewed by scrolling the screen.

A guest user can only view, among the messages recorded for the conference room they are in, messages that were posted while the conference room was in a public state. Therefore, images showing messages posted when the conference room was in a private state are not sent to the guest user's user terminal 10. Only images showing messages posted when the conference room was in a public state are sent to the guest user's user terminal 10.

Eleven messages are displayed in the message display area 62 in FIG. 21. Of these messages, the messages before (above) the sixth message, "Chat is now public," are messages posted when the conference room was private. Of these messages, the messages after (below) the sixth message, "Chat is now public," are messages posted when the conference room was public. Therefore, the image shown in FIG. 21 is displayed on the user terminal 10 of a user who is not a guest user. On the other hand, the messages posted when the conference room was private are not displayed on the user terminal 10 of a guest user, as shown in FIG. 22.

The above describes an embodiment of the present invention in detail with reference to the drawings, but the specific configuration is not limited to this embodiment, and includes designs that do not deviate from the gist of the present invention.

100...conversation system, 10...user terminal, 20...conversation control device, 11...communication unit, 12...operation unit, 13...display unit, 14...audio input unit, 15...audio output unit, 16...storage unit, 161...user information storage unit, 17...control unit, 171...display control unit, 172...conference control unit, 173...conversation control unit, 21...communication unit, 22...storage unit, 221...regular user information storage unit, 222...guest user information storage unit, 223...conference room information storage unit, 23...control unit, 231...user control unit, 232...conference room control unit, 233...display information generation unit, 234...conversation control unit, 30...conference room area image, 31...conversation area, 311...name of conference room, 312...entry button, 313...details button, 32...listening area, 41...Icon image, 42...User status image, 91...Outdoor area

Claims (8)

a display information generating unit that generates display data required for displaying on a user terminal an image including a conference room area image, which is an image showing a currently installed conference room, and an icon image showing a user , the image including multiple conference room area images corresponding to the number of conference rooms installed when multiple conference rooms are installed; and
A conference room control unit that controls participation in the conference room in response to a user's operation;
A conversation control unit that controls conversations between users participating in the same conference room;
Equipped with
The conference room control unit performs different processes depending on whether a regular user who is registered in advance among the users participates in the conference room or whether a guest user who is allowed to temporarily participate by the regular user among the users participates in the conference room ;
The display information generation unit generates the display data so that information about conference rooms other than the conference room the authorized user is in is displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room the guest user is in is not displayed on the user terminal of the guest user. A message control unit controls a conversation between users using text messages in the conference room,
The conversation control device according to claim 1 , wherein the display information generating unit generates display data further including a message of the conversation in the conference room. an image data generating unit that generates image data including a conference room area image, which is an image showing a currently installed virtual conference room for conversations via a network, and an icon image showing a user, and when multiple conference rooms are installed, the image data includes multiple conference room area images according to the number of the conference rooms ;
A conference room control unit that controls participation in the conference room in response to a user's operation;
A conversation control unit that controls conversations between users participating in the same conference room;
Equipped with
The conference room control unit performs different processes depending on whether a regular user who is registered in advance among the users participates in the conference room or whether a guest user who is allowed to temporarily participate by the regular user among the users participates in the conference room;
the image data generation unit generates different image data for a regular user terminal which is a user terminal operated by the regular user and a guest user terminal which is a user terminal operated by the guest user;
the image data generation unit generates the image data such that information about conference rooms other than the conference room in which the authorized user is present is also displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room in which the guest user is present is not displayed on the user terminal of the guest user .
Conversation system. A message control unit controls a conversation between users using text messages in the conference room,
The chat system according to claim 3 , wherein the image data generating unit generates image data further including a message of the conversation in the conference room. a display information generating step in which the computer generates display data necessary for displaying on a user terminal an image including a conference room area image, which is an image showing a currently installed conference room, and an icon image showing a user, as a virtual conference room for conversations via a network, and a plurality of conference room area images according to the number of conference rooms installed when a plurality of conference rooms are installed ;
a conference room control step in which a computer controls participation in the conference room in response to an operation by a user;
A conversation control step in which the computer controls a conversation between users participating in the same conference room;
In the conference room control step, the computer performs different processes depending on whether a pre-registered regular user among the users participates in the conference room or whether a guest user who is permitted to temporarily participate by a regular user among the users participates in the conference room ;
A conversation control method, in which, in the display information generation step, the computer generates the display data so that information about conference rooms other than the conference room in which the authorized user is present is displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room in which the guest user is present is not displayed on the user terminal of the guest user. The method further comprises a message control step of controlling a conversation between users using text messages in the conference room,
6. The conversation control method according to claim 5, wherein said display information generating step generates display data further including a message of said conversation in said conference room. an image data generating step in which the computer generates image data including a conference room area image, which is an image showing a currently installed virtual conference room for conversations via a network, and an icon image showing a user, and when multiple conference rooms are installed, the image data includes multiple conference room area images according to the number of the conference rooms;
a conference room control step in which a computer controls participation in the conference room in response to an operation by a user;
A conversation control step in which the computer controls a conversation between users participating in the same conference room;
Equipped with
In the conference room control step, the computer performs different processes depending on whether a pre-registered regular user among the users participates in the conference room or whether a guest user who is permitted to temporarily participate by a regular user among the users participates in the conference room;
In the image data generating step, the computer generates different image data for a regular user terminal which is a user terminal operated by the regular user and a guest user terminal which is a user terminal operated by the guest user;
In the image data generating step, the image data is generated so that information about conference rooms other than the conference room in which the authorized user is present is also displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room in which the guest user is present is not displayed on the user terminal of the guest user .
Conversation control methods. The method further comprises a message control step of controlling a conversation between users using text messages in the conference room,
8. The conversation control method according to claim 7, wherein in said image data generating step, said computer generates image data further including a message of said conversation in said conference room.