JP7574565B2 - COMMUNICATION TERMINAL, COMMUNICATION SYSTEM, COMMUNICATION METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to a communication terminal, a communication system, a communication method, and a program.

There is known a conferencing system in which multiple communication terminals share content data, such as video data, image data, and document data, via a communication network such as the Internet.

For example, a conference system is known in which an information processing terminal transmits a second image, which is a first image of shared material data and in which address information of the shared material data is embedded, to another information processing terminal, thereby sharing the shared material data with the other information processing terminal (see, for example, Patent Document 1).

There is a demand for using such a conference system to hold conferences in which content data recorded from multiple angles of a three-dimensional object, such as a model or prototype, can be shared.

However, for example, when video data (an example of content data) of a three-dimensional object photographed from multiple directions is shared among multiple communication terminals, it may take some time before sharing can begin depending on the size of the video data, the communication environment, etc.

One embodiment of the present invention has been made in consideration of the above problems, and enables a communication terminal that communicates with other communication terminals via a communication network to quickly share content data that has been recorded of a three-dimensional object from multiple directions with the other communication terminals.

In order to solve the above problems, a communication terminal according to one embodiment of the present invention is a communication terminal that communicates with other communication terminals via a communication network, and has a content data acquisition unit that acquires content data recorded from multiple directions of a three-dimensional object, an operation receiving unit that receives a designation of a display position of the content data, an image sharing unit that shares an image corresponding to the display position of the content data with the other communication terminals, and a display control unit that causes a display screen including the image shared by the image sharing unit to be displayed on a display unit , wherein the content data includes electronic data that models the three-dimensional object, and the display position information includes information indicating the position of the viewpoint from which the modeled three-dimensional object is displayed.

According to one embodiment of the present invention, in a communication terminal that communicates with other communication terminals via a communication network, content data recorded from multiple directions of a three-dimensional object can be quickly shared with the other communication terminals.

FIG. 1 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of a communication terminal according to an embodiment. FIG. 11 is a diagram illustrating another example of a hardware configuration of a communication terminal according to an embodiment. FIG. 2 is a diagram illustrating an example of a functional configuration of a communication terminal according to the first embodiment. FIG. 11 is a sequence diagram illustrating an example of a sharing process according to the first embodiment. FIG. 4 is a diagram showing an image of a display screen according to the first embodiment. FIG. 11 is a sequence diagram illustrating an example of an operation authority acquisition process according to the second embodiment. FIG. 11 is a diagram showing an image of a display screen according to the second embodiment. FIG. 13 is a diagram illustrating an example of a functional configuration of a communication terminal according to a third embodiment. FIG. 13 is a sequence diagram illustrating an example of a sharing process according to the third embodiment. FIG. 13 is a diagram for explaining model data according to the third embodiment. FIG. 13 is a sequence diagram illustrating an example of a sharing process according to the fourth embodiment. FIG. 13 is a diagram showing an image of a display screen according to a fourth embodiment.

The following describes an embodiment of the present invention with reference to the attached drawings.

<System Configuration>
1 is a diagram showing an example of a system configuration of a communication system according to an embodiment. The communication system 100 includes a plurality of communication terminals 110 that are communicably connected to each other via a communication network 101 such as the Internet or a LAN (Local Area Network).

The communication terminal 110 is used in a video conference to transmit and receive, for example, video data and audio data for calls, content data for sharing, and the like, with other communication terminals 110 via the communication network 101. Note that a "video conference" is also called a "television conference," a "remote conference," and the like. The communication terminal 110 may include, for example, an electronic whiteboard 110a, a video conference terminal 110b, an information terminal 110c, and the like.

The communication terminal 110 holds a video conference with one or more other communication terminals 110, for example, via a server such as the communication management system 120. However, this is not limited to this, and the communication terminal 110 may hold a video conference with other communication terminals 110 without going through the communication management system 120.

The electronic whiteboard 110a is a communication terminal 110 that communicates, for example, video data and audio data for calls, content data for sharing, stroke data, etc., and is also called an IWB (Interactive White Board). The video data and audio data for calls include, for example, a video of the user captured by a camera and the user's voice picked up by a microphone.

Content data refers to data that includes text, graphics, audio, images, video, or a combination of at least one of these. As an example, content data may include document data, video data, still image data, etc., that are shared among multiple communication terminals 110. In addition, in this embodiment, content data includes video data of a three-dimensional object photographed from multiple directions, or model data (electronic data) that is a three-dimensional model of the video data, etc.

Stroke data is electronic data (coordinate information, line type information, etc.) that represents an image (hereafter referred to as a stroke image) drawn by a user touching and moving an electronic pen, a human hand, etc. on the display of the electronic whiteboard 110a. For example, when a stroke image is drawn on one electronic whiteboard 110a, this stroke data is sent to the other electronic whiteboard 110a, and the same stroke image is drawn on the other electronic whiteboard 110a as well.

The video conference terminal 110b is, for example, a communication terminal 110 that communicates video data and audio data for calls, shared content data, and the like. The video conference terminal 110b may also have a function for transmitting and receiving stroke data by connecting, for example, an electronic whiteboard that does not have a video conference function. Furthermore, the video conference terminal 110b may also have a function for connecting a PC (Personal Computer) or the like and acquiring shared content data from the PC.

The information terminal 110c is, for example, a general-purpose information processing device such as a PC, a tablet terminal, or a smartphone. The information terminal 110c functions as a communication terminal 110 that transmits and receives video data and audio data for calls, content data for sharing, stroke data, etc., by executing an application program corresponding to the communication system 100, for example.

The electronic whiteboard 110a, the video conference terminal 110b, the information terminal 110c, etc. are examples of the communication terminal 110. For example, the communication terminal 110 may be various electronic devices having communication functions, display functions, etc., such as a PJ (Projector), an output device such as digital signage, a HUD (Head Up Display) device, industrial machinery, medical equipment, etc.

The communication management system 120 is, for example, an information processing device having a computer configuration, or a system including multiple information processing devices, and performs login authentication for the communication terminal 110, management of communications (sessions), relaying communication data, etc. In this embodiment, the communication management system 120 is optional and not essential. Also, since it is assumed that the communication management system 120 will be an existing communication management system, a detailed description of the communication management system 120 will be omitted here.

In the above-described communication system 100, there is a demand for holding a conference among multiple communication terminals 110 by sharing video data (an example of content data) captured from multiple directions of a three-dimensional object such as a model or prototype.

However, in conventional technology such as that shown in Patent Document 1, in order to share multiple pieces of information that a three-dimensional object possesses, such as top/bottom, left/right, front/back, etc., there is a problem in that the capture and sharing process must be repeated while changing the positional relationship between the camera that captures the three-dimensional object and the three-dimensional object.

For example, a method could be considered in which video data of a three-dimensional object is shared and the three-dimensional object is explained while the shared video data is played back, but with this method, the viewpoint (side, etc.) viewed by the person explaining and the person receiving the explanation may not match.

Furthermore, for example, when video data of a three-dimensional object captured from multiple directions is shared among multiple communication terminals 110, it may take some time before sharing can begin depending on the size of the video data, the communication environment, etc. Therefore, for example, as the amount of video data increases, there is a problem in that the variation in the time it takes for each communication terminal 110 to finish sending/receiving the video data (e.g., a video file, etc.) increases.

To solve this problem, the communication terminal 110 according to this embodiment does not transmit video data that continuously records a three-dimensional object from multiple directions to the other communication terminals 110, but instead shares an image (still image) that corresponds to a specified display position with the other communication terminals 110.

Preferably, the communication terminal 110 displays on the display screen a seek bar (an example of a display element) that specifies the playback position (an example of a display position) of the above-mentioned video data, and shares the image corresponding to the playback position specified by the seek bar with the other communication terminals 110. This allows each communication terminal 110 participating in the same video conference to quickly display, for example, an image of a three-dimensional object viewed from the same angle.

In this way, according to this embodiment, in a communication terminal 110 that communicates with other communication terminals 110 via a communication network 101, content data that records a three-dimensional object from multiple directions can be quickly shared with the other communication terminals 110.

<Hardware Configuration>
Next, an example of the hardware configuration of each device according to this embodiment will be described.

(Hardware configuration of information terminal and communication management system)
The information terminal 110c and the communication management system 120 have, for example, the hardware configuration of a computer 200 as shown in Fig. 2. Alternatively, the communication management system 120 is configured by a plurality of computers 200.

Figure 2 is a diagram showing an example of the hardware configuration of a computer according to an embodiment. The computer 200 includes, for example, a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a HD (Hard Disk) 204, a HDD (Hard Disk Drive) controller 205, a display 206, an external device connection I/F (Interface) 207, a network I/F 208, a keyboard 209, a pointing device 210, a DVD-RW (Digital Versatile Disk ReWritable) drive 212, a media I/F 214, and a bus line 215.

Of these, the CPU 201 is a calculation device that controls the overall operation of the computer 200. The ROM 202 is a non-volatile memory that stores programs used to start up the computer 200, such as an IPL (Initial Program Loader). The RAM 203 is a volatile memory used as a work area for the CPU 201. The HD 204 is a large-capacity storage device that stores programs such as the OS (Operating System) and applications, as well as various types of data. The HDD controller 205 controls the reading and writing of various types of data from and to the HD 204 under the control of the CPU 201.

The display 206 displays various information such as a cursor, a menu, a window, text, or an image. The external device connection I/F 207 is an interface for connecting various external devices. For example, if the computer 200 is an information terminal 110c, a camera, a speaker, etc. are connected to the external device connection I/F 207. Alternatively, the information terminal 110c may have a built-in camera and speaker.

The network I/F 208 is a communication interface for data communication using the communication network 101. The keyboard 209 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 210 is a type of input means for selecting and executing various instructions, selecting a processing target, moving the cursor, etc.

The DVD-RW drive 212 controls the reading and writing (storage) of data from the DVD-RW 211. The DVD-RW drive 212 may also control the reading and writing (storage) of data from a disk other than the DVD-RW 211. The media I/F 214 controls the reading and writing (storage) of data from a medium 213 such as a flash memory. The bus line 215 includes an address bus, a data bus, and various control signals for electrically connecting each component such as the CPU 201 shown in FIG. 2.

(Hardware configuration 1 of communication terminal)
3 is a diagram illustrating an example of a hardware configuration of a communication terminal according to an embodiment. Here, an example of the hardware configuration of a video conference terminal 110b, which is an example of the communication terminal 110, will be described.

The video conference terminal 110b includes a computer configuration, such as a CPU 301, a ROM 302, a RAM 303, a flash memory 304, and an SSD (Solid State Drive) 305. The video conference terminal 110b also includes a media I/F 307, an operation button 308, a power switch 309, a network I/F (Interface) 311, a camera 312, an image sensor I/F 313, a microphone 314, a speaker 315, and an audio input/output I/F 316. The video conference terminal 110b also includes a display I/F 317, an external device connection I/F 318, a short-range communication circuit 319, an antenna 319a for the short-range communication circuit 319, and a bus 310. The camera 321, microphone 314, speaker 315, etc. may be provided outside the video conference terminal 110b, or may be provided inside the video conference terminal 110b.

The CPU 301 is a computing device that realizes each function of the video conference terminal 110b by reading programs and data from, for example, the ROM 302 or the flash memory 304 and executing processing. The ROM 302 is a non-volatile memory that stores in advance programs and the like used to start up the video conference terminal 110b, such as IPL. The RAM 303 is a volatile memory that is used as a work area for the CPU 301, etc.

Flash memory 304 is a storage device that stores, for example, an OS, application programs, and various data. SSD 305 controls the reading and writing of various data from flash memory 304 under the control of CPU 301. Media I/F 307 controls the reading and writing (storing) of data from media 306 such as a memory card.

The operation button 308 is an input device that accepts input operations from the user of the video conference terminal 110b. The power switch 309 is a switch for switching the power of the video conference terminal 110b on and off. The network I/F 311 is a communication interface for communicating using the communication network 101.

The camera 312 is an imaging device for capturing an image of a subject under the control of the CPU 301. The imaging element I/F 313 controls the imaging by the camera 312 and converts the captured data into predetermined image data (video data). The microphone 314 converts acquired sound into an electrical signal. The speaker 315 converts the sound signal into sound and outputs it. The sound input/output I/F 316 controls the input and output of sound by the microphone 314 and the speaker 315.

The display I/F 317 outputs image data to the display 320 under the control of the CPU 301. The external device connection I/F 318 is an interface for connecting various external devices. For example, an electronic whiteboard (IWB) without a video conferencing function may be connected to the display I/F 317 or the external device connection I/F 318. This allows, for example, an electronic whiteboard connected to the video conferencing terminal 110b to display video conferencing images, shared images, stroke images, etc. in the same way as an electronic whiteboard with a video conferencing function.

The short-range communication circuit 319 is a communication circuit that performs short-range wireless communication via an antenna 319a. The bus 310 is commonly connected to each of the above components and transmits address signals, data signals, various control signals, etc.

(Hardware configuration 2 of communication terminal)
4 is a diagram illustrating another example of the hardware configuration of a communication terminal according to an embodiment. Here, an example of the hardware configuration of an electronic whiteboard 110a, which is another example of the communication terminal 110, will be described.

The electronic whiteboard 110a includes a CPU 401, a ROM 402, a RAM 403, an SSD 404, a network I/F 405, and an external device connection I/F 406. Of these, the CPU 401 is a calculation device that controls the operation of the entire electronic whiteboard 110a. The ROM 402 is a non-volatile memory that stores programs used to start the electronic whiteboard 110a, such as IPL. The RAM 403 is a volatile memory used as a work area for the CPU 401. The SSD 404 is a large-capacity storage device that stores programs and various data for the electronic whiteboard 110a.

The network I/F 405 is a communication interface for connecting the electronic whiteboard 110a to the communication network 101 and communicating with it. The external device connection I/F 406 is an interface for connecting various external devices. In the example of FIG. 4, the external devices include, for example, a USB (Universal Serial Bus) memory 431, a microphone 432, a speaker 433, a camera 434, and the like.

The electronic whiteboard 110a also includes a capture device 411, a GPU (Graphics Processing Unit) 412, a display controller 413, a contact sensor 414, a sensor controller 415, an electronic pen controller 416, a short-range communication circuit 419, an antenna 419a for the short-range communication circuit 419, a power switch 417, and selection switches 418.

Of these, the capture device 411 captures (obtains) a display screen or the like displayed on a display or the like of the external PC 450 as a still image or a moving image. The capture device 411 also captures video data and the like captured by the camera 434.

The GPU 412 is a semiconductor chip (processor) that specializes in graphics. The display controller 413 controls and manages the screen display in order to output an output image from the GPU 412 to the display 460, etc. The contact sensor 414 detects contact of the electronic pen 440, the user's hand H, etc., on the display 460. The sensor controller 415 controls the processing of the contact sensor 414.

The contact sensor 414 performs input of coordinates and detection of coordinates, for example, by an infrared blocking method. The method of inputting coordinates and detecting coordinates is a method in which two light receiving/emitting devices installed at both ends of the upper side of the display 460 emit multiple infrared rays parallel to the display 460, and receive the light that is reflected by a reflecting member provided around the display 460 and returns along the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 414 outputs the ID of the infrared rays emitted by the two light receiving/emitting devices that are blocked by an object to the sensor controller 415, and the sensor controller 415 specifies the coordinate position that is the contact position of the object. The electronic pen controller 416 communicates with the electronic pen 440 to determine whether the pen tip or the pen tail has touched the display 460. The short-distance communication circuit 419 is a communication circuit that performs short-distance wireless communication via the antenna 419a.

The power switch 417 is a switch for switching the power of the electronic whiteboard 110a on and off. The selection switches 418 are, for example, a group of switches for adjusting the brightness and color of the display 460.

Furthermore, the electronic whiteboard 110a is equipped with a bus line 420. The bus line 420 includes an address bus, a data bus, and various control signals for electrically connecting each component such as the CPU 401 shown in FIG. 4.

The contact sensor 414 is not limited to an infrared blocking type, and may be a capacitive touch panel that identifies the contact position by detecting changes in capacitance, or a resistive film touch panel that identifies the contact position by voltage changes across two opposing resistive films. The contact sensor 414 may also use various detection means, such as an electromagnetic induction type touch panel that identifies the contact position by detecting electromagnetic induction caused by a contacting object touching the display unit. Furthermore, the electronic pen controller 416 may determine whether or not there has been a touch not only on the tip and end of the electronic pen 440, but also on the part of the electronic pen 440 that the user holds, or on other parts of the electronic pen.

[First embodiment]
<Functional configuration>
Fig. 5 is a diagram showing an example of a functional configuration of the communication terminal 110 according to the first embodiment. As shown in Fig. 5, the communication terminal 110 includes, for example, a communication unit 501, a conference control unit 502, a content data acquisition unit 503, an operation reception unit 504, an image sharing unit 505, a display control unit 506, and a storage unit 507.

For example, when the communication terminal 110 is the electronic whiteboard 110a, the electronic whiteboard 110a realizes each of the above functional configurations by executing a predetermined program with the CPU 401 in FIG. 4. When the communication terminal 110 is the video conference terminal 110b, the video conference terminal 110b realizes each of the above functional configurations by executing a predetermined program with the CPU 301 in FIG. 3. When the communication terminal 110 is the information terminal 110c, the information terminal 110c realizes each of the above functional configurations by executing an application program corresponding to the communication system 100 with the CPU 201 in FIG. 2. At least a part of the above functional configurations may be realized by hardware. In addition, the following description will be given assuming that the communication terminal 110 is the video conference terminal 110b as an example, but this does not limit the scope of the present invention.

The communication unit 501 connects the communication terminal 110 to the communication network 101 using, for example, the network I/F 405 in FIG. 4, and communicates with other communication terminals 110, the communication management system 120, etc.

The conference control unit 502 performs various controls related to conferences such as video conferences, for example, in response to user operations or request information received from other communication terminals 110. For example, the conference control unit 502 controls the start and end of a conference, the sending and receiving of video data and audio data for calls, the sending and receiving of stroke data, etc.

The content data acquisition unit 503 acquires video data of a three-dimensional object captured from multiple directions, for example, using the camera 434 in FIG. 4. Note that video data of a three-dimensional object captured from multiple directions is an example of content data of a three-dimensional object recorded from multiple directions. For example, the content data recorded from multiple directions may be model data of a three-dimensional object modeled in three dimensions. The content data acquisition unit 503 may also acquire content data (e.g., captured video data, modeled model data, etc.) from an external device other than the camera 312, for example, using the external device connection I/F 318, network I/F 311, etc. in FIG. 3.

The operation reception unit 504 receives various operations by the user using, for example, the contact sensor 414 and the sensor controller 415 in FIG. 4. For example, the operation reception unit 504 receives a specification operation for specifying a display position of content data in which a three-dimensional object is recorded from multiple directions. As an example, if the content data is video data in which a three-dimensional object is photographed from multiple directions, the operation reception unit 504 receives a specification of a playback position of the video data specified by the user using a display element such as a seek bar displayed on a display screen that displays the photographed video.

Preferably, the operation reception unit 504 also receives operations based on designation information, etc., that designates the display position of content data that is recorded from multiple directions of a three-dimensional object and that is received by the communication unit 501 from another communication terminal 110.

The image sharing unit 505 shares an image (still image) corresponding to the display position of the content data accepted by the operation accepting unit 504 with another communication terminal 110 in communication with the communication terminal 110. For example, when the operation accepting unit 504 accepts a designation of a display position of content data in which a three-dimensional object is recorded from multiple directions, the image sharing unit 505 transmits an image corresponding to the designated display position of the content data to the other communication terminal 110 in communication with the communication terminal 110.

Preferably, when the image sharing unit 505 receives an image from another communication terminal 110 with which it is communicating that corresponds to a specified display position of content data acquired by the other communication terminal 110, it shares the received image with the other communication terminal 110.

The display control unit 506 displays on a display screen an image that the image sharing unit 505 shares with other communication terminals 110 in communication. For example, the display control unit 506 causes a display screen including an image corresponding to the display position of the content data accepted by the operation acceptance unit 504 to be displayed on a display unit such as the display in FIG. 4.

The storage unit 507 is realized, for example, by a program executed by the CPU 401, the SSD 404, the RAM 403, etc., and stores various information and data including content data shared with other communication terminals 110, information on display position, etc.

Note that the functional configuration of the communication terminal 110 shown in FIG. 5 is an example. For example, some or all of the operation reception unit 504, image sharing unit 505, and display control unit 506 may be included in the conference control unit 502.

<Processing flow>
Next, a process flow of the communication method according to the first embodiment will be described.

FIG. 6 is a sequence diagram showing an example of a sharing process according to the first embodiment. This diagram shows an example of a sharing process in which, for example, when communication terminals 110-1 and 110-2 having the functional configuration shown in FIG. 5 are communicating (conferenced) with each other, user A using communication terminal 110-1 shares images of a three-dimensional object captured from multiple directions with another communication terminal 110-2.

It is assumed that at the start of the process shown in FIG. 6, communication terminal 110-1 and communication terminal 110-2 are communicating (conference) to send and receive video data and audio data via communication network 101. It is also possible for communication terminal 110-1 and communication terminal 110-2 to communicate with each other via communication management system 120, or to communicate with each other without via communication management system 120.

In step S601, when user A, who uses communication terminal 110-1, performs a sharing start operation on communication terminal 110-1 during communication between communication terminal 110-1 and communication terminal 110-2, the processing from step S602 onwards is executed.

In steps S602 and S603, when the operation reception unit 504 of the communication terminal 110-1 receives a sharing start operation by user A, it requests the content data acquisition unit 503 to start and end the capture of video data captured by the camera 312 or the like. At this time, user A, for example, continuously moves the camera 312 or the three-dimensional object so that the target three-dimensional object is captured from multiple directions.

Here, it is desirable that the time from the start to the end of the capture be relatively short, for example, about 10 seconds, in order to make it easier to specify the display position, as described below. However, in this embodiment, since the captured video data is not sent or received, even if the time from the start to the end of the capture is relatively long, such as 10 seconds or more, the display of the shared image can be started quickly.

The processes in steps S602 and S603 are merely examples. For example, the content data acquisition unit 503 may acquire video data and the like that is stored in advance in the storage unit 507 or an external device, etc.

In step S604, the operation reception unit 504 of the communication terminal 110-1 sends a completion notification to the display control unit 506, etc., indicating that acquisition of the video data has been completed.

In step S605, the display control unit 506 of the communication terminal 110-1 uses the video data acquired by the content data acquisition unit 503 to display a shared screen, for example, as shown in FIG. 7.

Figure 7 is a diagram showing an image of a display screen according to the first embodiment. In step S605 in Figure 6, the display control unit 506 of the communication terminal 110-1 displays, for example, a display screen 710 as shown in Figure 7 on a display unit such as the display 460. In the example of Figure 7, the display screen 710 displays a shared screen 711, an image 712 of a user of another communication terminal such as the communication terminal 110-2, and an image 713 of a user of the communication terminal 110-1.

On the shared screen 711, for example, an image of a three-dimensional object 714 based on the video data captured in steps S602 and S603 in FIG. 6 and a seek bar 715 for specifying the playback position of the video data are displayed. Note that the seek bar 715 is an example of a display element for specifying the playback position (display position) of the video data (content data).

Now, let's return to Figure 6 and continue explaining the sequence diagram.

For example, in step S605, when the display control unit 506 of the communication terminal 110-1 displays the shared screen 711, the communication terminal 110-1 repeatedly executes the processes of steps S611 to S618 until a sharing end operation is received in step S621.

In step S611, when the operation reception unit 504 of the communication terminal 110-1 receives an operation by user A to specify a playback position, the processing from step S612 onward is executed. Note that user A can specify the playback position of the video data, for example, by moving the position of the seek bar 715 left or right on the shared screen 711 as shown in FIG. 7.

In step S612, the operation reception unit 504 of the communication terminal 110-1 notifies the image sharing unit 505 of the received playback position information.

In step S613, the image sharing unit 505 of the communication terminal 110-1 acquires an image (still image) corresponding to the notified playback position from the video data acquired by the content data acquisition unit 503.

In step S614, the image sharing unit 505 of the communication terminal 110-1 notifies the display control unit 506 of the communication terminal 110-1 of the image acquired in step S613. In response, in step S615, the display control unit 506 displays the notified image on a shared screen 711 included in the display screen 710 of the communication terminal 110-1, for example, as shown in FIG. 7.

In steps S616 and S617, the image sharing unit 505 transmits the image acquired in step S613 to the other communication terminal 110-2 via the communication unit 501.

Preferably, the image sharing unit 505 transmits, together with the acquired image, information on the playback position (e.g., the time from the start point to the playback position, the number of frames, etc.), information on the playback range (e.g., the time from the start point to the end point, the number of frames, etc.) and the like to the other communication terminal 110-2.

In step S618, the display control unit 506 of the communication terminal 110-2 displays the image (still image) received from the communication terminal 110-1 on a shared screen 721 included in the display screen 720 of the communication terminal 110-2 as shown in FIG. 7. As a result, the shared screen 711 of the communication terminal 110-1 and the shared screen 721 of the communication terminal 110-2 display the three-dimensional object 714 viewed from the same direction as shown in FIG. 7.

When communication terminal 110-3 is participating in a conference in which communication terminals 110-1 and 110-2 are also participating, communication terminal 110-1 (or communication management system 120) transmits images and the like transmitted to communication terminal 110-2 to communication terminal 110-3 also participating in the conference. As a result, for example, as shown in FIG. 7, a shared screen 731 similar to shared screen 721 displayed by communication terminal 110-2 is displayed on display screen 730 displayed by communication terminal 110-3.

In step S621, for example, when the operation reception unit 504 of the communication terminal 110-1 receives an operation to end sharing, the communication terminal 110-1 ends the processing of steps S611 to S618.

By performing the above process, the communication terminal 110-1 can share a still image showing the three-dimensional object 714 from a specified position with the other communication terminals 110-2, etc., without transmitting content data that records the three-dimensional object 714 from multiple directions to the other communication terminals 110-2, etc.

In addition, user A using communication terminal 110-1 can hold a conference while sharing multiple pieces of information about the three-dimensional object 714, such as top and bottom, left and right, front and back, by moving the position of the seek bar 715 left and right, etc.

As described above, according to this embodiment, a communication terminal 110-1 that communicates with another communication terminal 110-2 via a communication network 101 can quickly share content data that records a three-dimensional object from multiple directions with the other communication terminal 110-2.

Second Embodiment
In the second embodiment, an example of processing will be described in which the playback position of video data acquired by communication terminal 110-1 is specified from another communication terminal 110-2 participating in the conference.

Figure 8 is a sequence diagram showing an example of the process of acquiring operation authority according to the second embodiment. Note that it is assumed that at the start of the process shown in Figure 8, the processes of steps S601 to S605 and steps S611 to S616 in Figure 6 have already been executed.

In step S801, it is assumed that user B using communication terminal 110-2 performs an operation to obtain operation rights. For example, user B performs an operation to obtain operation rights by displaying menu screen 901 on display screen 720 displayed by communication terminal 110-2 as shown in FIG. 9(A) and selecting "seek operation" 902.

In step S802, when the operation reception unit 504 of the communication terminal 110-2 receives an operation to obtain operation rights by user B, the operation reception unit 504 transmits a request to obtain operation rights to the communication terminal 110-1 via the communication unit 501 of the communication terminal 110-2.

In step S803, the communication unit 501 of the communication terminal 110-1 notifies the image sharing unit 505 of the request to obtain operation rights received from the communication terminal 110-2.

At this time, if the image sharing unit 505 of the communication terminal 110-1 is currently processing a request from another communication terminal 110-3 or the like, the processing of steps S811 to S813 is executed. On the other hand, if the image sharing unit 505 of the communication terminal 110-1 is not currently processing a request from another communication terminal 110-3 or the like, the processing of steps S821 and thereafter is executed.

For example, if a request from another communication terminal 110-3 or the like is being processed, the image sharing unit 505 of the communication terminal 110-1 sends a refusal notice to the requesting communication terminal 110-2 in steps S811 and S812, refusing to obtain the operation authority. Also, in step S813, upon receiving the refusal notice, the display control unit 506 of the communication terminal 110-2 displays a display screen indicating that the acquisition of the operation authority has failed.

On the other hand, if a request from another communication terminal (e.g., 110-3) is not being processed, the image sharing unit 505 of the communication terminal 110-1 notifies the display control unit 506 in step S821 of an acceptance notification of the request to obtain operation rights, indicating that the request to obtain operation rights has been accepted.

In step S822, the display control unit 506 of the communication terminal 110-1 displays, for example, an inquiry screen 903 as shown in FIG. 9(B) on the display screen 710. In the example of FIG. 9(B), the display screen 710 displayed by the display control unit 506 of the communication terminal 110-1 displays an inquiry screen 903 that selectively displays an "OK" button that allows the acquisition of operation rights and an "NG" button that rejects the acquisition of operation rights.

In step S823, if user A performs a permission operation (presses the "OK" button), the processing from step S824 onwards is executed. On the other hand, if user A performs a refusal operation (presses the "NG" button), a refusal notification is sent to the requesting communication terminal 110-2 by processing similar to steps S811 to S813.

In step S824, when the operation reception unit 504 of the communication terminal 110-1 receives the permission operation, it notifies the image sharing unit 505 of a permission notification indicating that the permission operation has been received.

In steps S825 and S826, the image sharing unit 505 of the communication terminal 110-1 transmits a permission notification to the communication terminal 110-2 via the communication unit 501. This permission notification may include information indicating, for example, the current display position, the playback range, etc.

In step S827, when the display control unit 506 of the communication terminal 110-2 receives the permission notification transmitted from the communication terminal 110-1, the display control unit 506 displays, for example, a display screen 720 including a shared screen 904 as shown in FIG. 9(C) on a display unit such as the display 460. On this shared screen 904, for example, a seek bar 905 for specifying the playback position of the video data is displayed as shown in FIG. 9(C).

This seek bar 905 is displayed based on, for example, playback position information (time from the start point, number of frames, etc.) and playback range information (for example, time from the start point to the end point, number of frames, etc.) notified from communication terminal 110-1. Note that the playback position information and playback range information are assumed to be included in, for example, the data received in step S617 in FIG. 6 or the notification received in step S826 in FIG. 8.

In step S828, when user B uses the seek bar 905 on the shared screen 904 to specify a playback position, the processing from step S829 onwards is executed.

In step S829, the operation reception unit 504 of the communication terminal 110-2 transmits information about the playback position specified by the specification operation by user B to the communication terminal 110-1 via the communication unit 501 of the communication terminal 110-2.

In step S830, the communication unit 501 of the communication terminal 110-1 notifies the image sharing unit 505 of the communication terminal 110-1 of the playback position information received from the communication terminal 110-2.

In step S831, the image sharing unit 505 of the communication terminal 110-1 acquires an image (still image) corresponding to the notified playback position from the video data acquired by the content data acquisition unit 503.

In step S832, the image sharing unit 505 of the communication terminal 110-1 notifies the display control unit 506 of the communication terminal 110-1 of the image acquired in step S831. In response, in step S833, the display control unit 506 displays the notified image on the shared screen 906 included in the display screen 710 of the communication terminal 110-1, for example, as shown in FIG. 9(C).

In steps S834 and S835, the image sharing unit 505 notifies the other communication terminal 110-2 of the image acquired in step S831 via the communication unit 501, for example, in parallel with the processing of step S832.

Preferably, the image sharing unit 505 transmits the aforementioned playback position information, playback range information, etc., along with the acquired image to other communication terminals 110-2, etc.

In step S836, the display control unit 506 of the communication terminal 110-2 updates the shared screen 721 of the display screen 720, for example, as shown in FIG. 9(C), with the image received from the communication terminal 110-1. As a result, the shared screen 906 of the communication terminal 110-1 and the shared screen 904 of the communication terminal 110-2 display the three-dimensional object 714 viewed from the same direction, as shown in FIG. 9(C).

When communication terminal 110-3 is also participating in a conference in which communication terminals 110-1 and 110-2 are participating, communication terminal 110-1 (or communication management system 120) transmits the image transmitted to communication terminal 110-2 to communication terminal 110-3 also participating in the conference. As a result, for example, as shown in FIG. 9(C), a shared screen 907 similar to shared screen 721 displayed by communication terminals 110-1 and 110-2 is displayed on display screen 730 displayed by communication terminal 110-3.

As described above, according to the second embodiment, the playback position of the video data acquired by the communication terminal 110-1 can be specified from other communication terminals participating in the conference, such as the communication terminal 110-2.

[Third embodiment]
In the third embodiment, an example will be described in which content data, which is recorded from a plurality of directions of a three-dimensional object and is shared by a plurality of communication terminals 110, is model data (electronic data) that is a three-dimensional model of the three-dimensional object.

<Functional configuration>
Fig. 10 is a diagram showing an example of a functional configuration of a communication terminal according to the third embodiment. As shown in Fig. 10, the communication terminal 110 according to the third embodiment has a model generation unit 1001 in addition to the functional configuration of the communication terminal 110 according to the first embodiment described in Fig. 5.

The model generation unit 1001 generates three-dimensional model data (electronic data) representing the shape of a three-dimensional object from video data of the three-dimensional object photographed from multiple directions, acquired by the content data acquisition unit 503. The three-dimensional model data created by the model generation unit 1001 may be an existing three-dimensional model such as a "wireframe," "surface," or "solid." The method of creating the model data may be the same as any existing method of three-dimensional modeling.

In this embodiment, the image sharing unit 505 shares with other communication terminals 110 in communication with the image viewed from a specified display position based on the model data of a three-dimensional model of a three-dimensional object generated by the model generation unit 1001. Also, in this embodiment, information indicating the position of the viewpoint from which the modeled three-dimensional object is displayed (coordinate information, etc.) is used as information on the display position of the three-dimensional object.

Note that other functional configurations of the communication terminal 110 according to the third embodiment may be similar to the functional configuration of the communication terminal 110 according to the first embodiment described in FIG. 5.

<Processing flow>
Fig. 11 is a sequence diagram showing an example of a sharing process according to the third embodiment. This diagram shows an example of a sharing process in the case where, for example, when communication (conference) is being held between communication terminals 110-1 and 110-2 having the functional configurations shown in Fig. 10, user A using communication terminal 110-1 shares model data of a three-dimensional object.

It is assumed that at the start of the process shown in FIG. 11, communication terminal 110-1 and communication terminal 110-2 are communicating (conference) to transmit and receive video data and audio data via communication network 101. Also, detailed explanations of the same processes as those in the first embodiment will be omitted here.

In step S1101, when user A, who uses communication terminal 110-1, performs a sharing start operation on communication terminal 110-1 during communication between communication terminal 110-1 and communication terminal 110-2, the processing from step S1102 onwards is executed.

In steps S1102 and S1103, when the operation reception unit 504 of the communication terminal 110-1 receives a sharing start operation from user A, it requests the content data acquisition unit 503 to start and end the capture of video data captured by the camera 312 or the like. Note that the processing in steps S1101 to S1103 may be similar to the processing in steps S601 to S603 in the first embodiment.

Here, if the model sharing setting of the communication system 100 is set to enabled, the processing from step S1111 onwards is executed. On the other hand, if the model sharing setting of the communication system 100 is set to disabled, the processing from step S604 onwards in FIG. 6 is executed.

In step S1111, the operation reception unit 504 of the communication terminal 110-1 uses the model generation unit 1001 to generate model data that is a 3D model of the solid object from the video data captured in steps S1102 and S1103.

Figure 12 (A) shows an image of three-dimensionally modeled model data. For example, if the three-dimensional object is a die 1201, then as one example, the model generation unit 1001 three-dimensionally models each face of the die 1201 using a surface model to create model data 1202. However, this is not limited to the above, and the model generation unit 1001 may also three-dimensionally model the die 1201 using a wireframe model or a solid model to create model data 1202.

In step S1116, the operation reception unit 504 of the communication terminal 110-1 sends a completion notification to the display control unit 506, etc., indicating that modeling of the three-dimensional object has been completed.

In step S1117, the display control unit 506 of the communication terminal 110-1 displays a shared screen on the display screen displayed by the communication terminal 110-1 based on the model data of the three-dimensional model of the three-dimensional object 714. Note that in the shared screen 711 according to the first embodiment, the playback position of the video data is specified by the seek bar 715. On the other hand, in the shared screen according to the third embodiment, the display position of the three-dimensional object is specified by, for example, coordinate information indicating the position of the viewpoint 1211 at which the modeled three-dimensional object is displayed in a spherical coordinate system as shown in FIG. 12(B).

When the display control unit 506 of the communication terminal 110-1 displays the shared screen in step S1117, the processing in steps S1121 to S1128 is repeatedly executed, for example, until an operation to end sharing is received in step S1131.

In step S1121, the operation reception unit 504 of the communication terminal 110-1 receives an operation by user A to specify the display position. For example, user A rotates the three-dimensional object displayed on the shared screen up, down, left, and right by dragging the three-dimensional object to specify the display position of the three-dimensional object.

In step S1122, the operation reception unit 504 of the communication terminal 110-1 notifies the image sharing unit 505 of the coordinate information of the received display position.

In step S1123, the image sharing unit 505 of the communication terminal 110-1 acquires (creates) an image of the three-dimensional object as seen from the specified display position based on the model data generated by the model generation unit 1001 and the coordinate information of the display position notified in step S1122.

In step S1124, the image sharing unit 505 of the communication terminal 110-1 notifies the display control unit 506 of the communication terminal 110-1 of the image acquired in step S1123.

In step S1125, the display control unit 506 of the communication terminal 110-1 displays the image notified by the image sharing unit 505 on a shared screen included in the display screen of the communication terminal 110-1.

In steps S1126 and S1127, the image sharing unit 505 of the communication terminal 110-1 transmits the image acquired in step S1123 to other communication terminals with which it is communicating, such as the communication terminal 110-2, via the communication unit 501 of the communication terminal 110-1.

In step S1128, the display control unit 506 of communication terminal 110-2 displays the image received from communication terminal 110-1 on a shared screen included in the display screen of communication terminal 110-2.

In this way, content data that records a three-dimensional object from multiple directions is not limited to video data that captures the three-dimensional object, but may also be model data that models the three-dimensional object in three dimensions.

The process shown in FIG. 11 is an example. For example, in steps S1102, S1103, and S1111 in FIG. 11, the conference control unit 502 may acquire model data of a three-dimensional object that has been previously modeled in three dimensions from the storage unit 507 or an external device, instead of generating model data of the three-dimensional object.

[Fourth embodiment]
In the fourth embodiment, an example of processing will be described in which an area including a three-dimensional object is selected and shared from an image captured by a camera having a wider angle of view than a general camera, such as a 360-degree camera. Here, the 360-degree camera is a camera capable of capturing video of 360 degrees up, down, left, right, and right, and is also called, for example, a spherical camera or an omnidirectional camera.

The functional configuration of the communication terminal 110 according to the fourth embodiment may be similar to the functional configuration of the communication terminal 110 according to the first embodiment shown in FIG. 5, for example.

<Processing flow>
Fig. 13 is a sequence diagram showing an example of a sharing process according to the fourth embodiment. Note that the basic flow of the process is similar to that of the sharing process according to the first embodiment described in Fig. 1, so the following description will focus on the differences from the first embodiment.

In steps S601 to S603, when the operation reception unit 504 of the communication terminal 110-1 receives a sharing start operation from user A, it uses the content data acquisition unit 503 to capture the video data taken by the camera 312, as in the first embodiment. However, in the fourth embodiment, it is assumed that the camera 312 is a camera with a wider angle of view than a general camera, such as a 360-degree camera.

In step S1301, the operation reception unit 504 of the communication terminal 110-1 sends a capture completion notification to the display control unit 506, indicating that the capture has been completed.

In step S1302, the display control unit 506 of the communication terminal 110-1 displays a shared area selection screen, for example, as shown in FIG. 14.

Fig. 14 is a diagram showing an image of a display screen according to the fourth embodiment. In the example of Fig. 14, a display screen 1400 displayed by the display control unit 506 of the communication terminal 110-1 displays a shared area selection screen 1401 that displays the images captured in steps S602 and S603. From this shared area selection screen 1401, user A can select a shared area 1402 that includes a three-dimensional object 714 to be shared, for example, by a drag operation or the like.

In step S1303, when user A performs a selection operation to select shared area 1402 from shared area selection screen 1401 as shown in FIG. 14, the processing from step S1304 onwards is executed.

In steps S1304 and S1305, the operation reception unit 504 of the communication terminal 110-1 notifies the image sharing unit 505 and the display control unit 506 of information about the selected area (e.g., coordinate range, etc.).

In step S1306, the display control unit 506 of the communication terminal 110-1 displays the shared screen using the video data in the selected shared area 1402. As a result, the shared screen 711 is displayed on the display screen 710 displayed by the communication terminal 110-1, similar to the first embodiment.

When the display control unit 506 of the communication terminal 110-1 displays the shared screen 711 in step S1306, the processes in steps S1311 to S1318 are repeatedly executed until, for example, a sharing end operation is received in step S1321.

In step S1311, when the operation reception unit 504 of the communication terminal 110-1 receives an operation to specify a playback position by user A, the processing from step S1312 onward is executed. As in the first embodiment, user A can specify the playback position of the video data by, for example, moving the position of the seek bar 715 to the left or right on the shared screen 711 as shown in FIG. 7.

In step S1312, the operation reception unit 504 of the communication terminal 110-1 notifies the image sharing unit 505 of the received playback position information.

In step S1313, the image sharing unit 505 of the communication terminal 110-1 acquires an image corresponding to the specified playback position within the selected area from the video data acquired by the content data acquisition unit 503.

In step S1314, the image sharing unit 505 of the communication terminal 110-1 notifies the display control unit 506 of the communication terminal 110-1 of the image acquired in step S1313. In response to this, in step S1315, the display control unit 506 displays the notified image on a shared screen 711 included in the display screen 710 of the communication terminal 110-1, for example, as shown in FIG. 7.

In steps S1316 and S1317, the image sharing unit 505 transmits the image acquired in step S1313 to the other communication terminal 110-2 with which it is communicating via the communication unit 501.

Preferably, the image sharing unit 505 transmits, together with the acquired image, information on the playback position (e.g., the time from the start point to the playback position, the number of frames, etc.), information on the playback range (e.g., the time from the start point to the end point, the number of frames, etc.) and the like to the communication terminal 110-2.

In step S1318, the display control unit 506 of the communication terminal 110-2 displays the image received from the communication terminal 110-1 on a shared screen 721 included in the display screen 720 of the communication terminal 110-2, for example, as shown in FIG. 7. As a result, the shared screen 711 of the communication terminal 110-1 and the shared screen 721 of the communication terminal 110-2 display the three-dimensional object 714 viewed from the same direction, as in the first embodiment.

In step S1321, for example, when the operation reception unit 504 of the communication terminal 110-1 receives an operation to end sharing, the communication terminal 110-1 ends the processing of steps S1311 to S1318.

In the above example, the camera 312 is described as a 360-degree camera, but this embodiment is not limited to video data from a 360-degree camera and can be widely applied to cases where a portion of the shooting range of video data is selectively shared.

As described above, according to each embodiment of the present invention, a communication terminal that communicates with other communication terminals via a communication network can quickly start sharing content data recorded from multiple directions of a three-dimensional object with the other communication terminals.

<Additional Information>
Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and devices such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), and a conventional circuit module designed to execute each function described above.

The program for the communication terminal 110 may be distributed, for example, as a file in an installable or executable format, recorded on a computer-readable recording medium. The program for the communication terminal 110 may not only be recorded on a recording medium, but may also be, for example, downloaded from a server (cloud or on-premise) and installed on the communication terminal 110.

Furthermore, the communication management system 120 is not limited to the computer 400 shown in FIG. 4, but may be realized by electronic devices such as, for example, a mobile phone, a smartphone, a tablet terminal, a wearable terminal, a PDA (Personal Data Assistant), and an image forming device.

100 Communication system 101 Communication network 110 Communication terminal 503 Content data acquisition unit 504 Operation reception unit 505 Image sharing unit 506 Display control unit 710 Display screen 715 Seek bar (an example of a display element)

JP 2015-52896 A

Claims (12)

A communication terminal that communicates with other communication terminals via a communication network,
a content data acquisition unit that acquires content data recorded from a plurality of directions of a three-dimensional object;
an operation receiving unit that receives a designation of a display position of the content data;
an image sharing unit that shares an image corresponding to the display position of the content data with the other communication terminal;
a display control unit that causes a display screen including the image shared by the image sharing unit to be displayed on a display unit;
having
the content data includes electronic data that models the three-dimensional object,
The display position information includes information indicating a viewpoint position from which the modeled three-dimensional object is displayed . A communication terminal that communicates with other communication terminals via a communication network,
a content data acquisition unit that acquires content data recorded from a plurality of directions of a three-dimensional object;
an operation receiving unit that receives a designation of a display position of the content data;
an image sharing unit that shares an image corresponding to the display position of the content data with the other communication terminal;
a display control unit that causes a display screen including the image shared by the image sharing unit to be displayed on a display unit;
having
the content data includes video data obtained by photographing the three-dimensional object from a plurality of directions;
A communication terminal, wherein the display position information includes information indicating a playback position of the video data. the display control unit displays a display element for designating the display position on the display screen;
The communication terminal according to claim 1 , wherein the image sharing unit transmits an image corresponding to the display position of the content data to the other communication terminal when the display position is specified by the display element. The image sharing unit includes:
sharing an image of the display position of the content data and information about the display position with the other communication terminal;
A communication terminal according to any one of claims 1 to 3, wherein when designation information for designating the display position is received from the other communication terminal, an image of the display position of the content data and information about the display position are transmitted to the other communication terminal. The communication terminal according to claim 4 , wherein the image sharing unit permits the other communication terminal to specify the display position in response to a request from the other communication terminal, and accepts the specification information from the other communication terminal that has been permitted to specify the display position. The communication terminal according to any one of claims 1 to 5, wherein when the image sharing unit receives from the other communication terminal an image corresponding to one display position of content data acquired by the other communication terminal, the image sharing unit shares the image corresponding to the one display position with the other communication terminal, and the display control unit displays the image corresponding to the one display position on the display screen. A communication system including a plurality of communication terminals that communicate with other communication terminals via a communication network,
The communication terminal includes:
a content data acquisition unit that acquires content data recorded from a plurality of directions of a three-dimensional object;
an operation receiving unit that receives a designation of a display position of the content data;
an image sharing unit that shares an image of the display position of the content data with the other communication terminal;
a display control unit that causes a display screen including the image shared by the image sharing unit to be displayed on a display unit;
having
the content data includes electronic data that models the three-dimensional object,
A communication system, wherein the display position information includes information indicating a viewpoint position from which the modeled three-dimensional object is displayed . A communication system including a plurality of communication terminals that communicate with other communication terminals via a communication network,
The communication terminal includes:
a content data acquisition unit that acquires content data recorded from a plurality of directions of a three-dimensional object;
an operation receiving unit that receives a designation of a display position of the content data;
an image sharing unit that shares an image of the display position of the content data with the other communication terminal;
a display control unit that causes a display screen including the image shared by the image sharing unit to be displayed on a display unit;
having
the content data includes video data obtained by photographing the three-dimensional object from a plurality of directions;
A communication system, wherein the display position information includes information indicating a playback position of the video data. A communication terminal that communicates with other communication terminals via a communication network,
A process of acquiring content data recorded from a plurality of directions of a three-dimensional object;
A process of receiving a designation of a display position of the content data;
a process of sharing an image of the display position of the content data with the other communication terminal;
displaying a display screen including an image to be shared with the other communication terminal;
Run
the content data includes electronic data that models the three-dimensional object,
A communication method , wherein the display position information includes information indicating a viewpoint position from which the modeled three-dimensional object is displayed . A communication terminal that communicates with other communication terminals via a communication network,
A process of acquiring content data recorded from a plurality of directions of a three-dimensional object;
A process of receiving a designation of a display position of the content data;
a process of sharing an image of the display position of the content data with the other communication terminal;
displaying a display screen including an image to be shared with the other communication terminal;
Run
the content data includes video data obtained by photographing the three-dimensional object from a plurality of directions;
A communication method, wherein the display position information includes information indicating a playback position of the video data. A communication terminal that communicates with other communication terminals via a communication network,
A process of acquiring content data recorded from a plurality of directions of a three-dimensional object;
A process of receiving a designation of a display position of the content data;
a process of sharing an image of the display position of the content data with the other communication terminal;
displaying a display screen including an image to be shared with the other communication terminal;
Run the command ,
the content data includes electronic data that models the three-dimensional object,
A program, wherein the display position information includes information indicating a viewpoint position from which the modeled three-dimensional object is displayed . A communication terminal that communicates with other communication terminals via a communication network,
A process of acquiring content data recorded from a plurality of directions of a three-dimensional object;
A process of receiving a designation of a display position of the content data;
a process of sharing an image of the display position of the content data with the other communication terminal;
displaying a display screen including an image to be shared with the other communication terminal;
Run the command,
the content data includes video data obtained by photographing the three-dimensional object from a plurality of directions;
A program, wherein the display position information includes information indicating a playback position of the video data.

Images