JP5370962B2 - Data exchange system and data exchange method - Google Patents

Description

  The present invention relates to a data exchange system and a data exchange method for exchanging data.

  Currently, data is exchanged by various methods. For example, when data such as a telephone number or an e-mail address is exchanged between devices such as mobile phones, wireless communication using infrared rays can be used (see, for example, Patent Document 1).

JP 2001-177786 A

  Wireless communication using infrared rays as described above is effective when the user is at a relatively short distance so that the other user can directly face the user. However, when one user is away from the other user, infrared wireless communication cannot be used for data exchange.

  When the devices used by both are connected to a network, data can be exchanged via the network. However, in this case, data cannot be exchanged by a simple operation like the above-described wireless communication using infrared rays. In addition, it is difficult to exchange data intuitively by facing each other like exchanging business cards.

  An object of the present invention is to provide a data exchange system and a data exchange method that enable users existing at different points to exchange data with an intuitive operation without performing a complicated operation.

  (1) A data exchange system according to a first invention is a data exchange system for exchanging data between a first user at a first point and a second user at a second point, Data exchange between the first data exchange device provided at the first point, the second data exchange device provided at the second point, and the first data exchange device and the second data exchange device And a first data exchange device, the first data display device for displaying video, the first data holding device for holding data, and the first of the first video display device. First determination means for determining whether or not the first user holding the first data holding device within the predetermined range has performed an operation for exchanging data, and the first of the first video display device A first image capturing the first user holding the first data holding device within a predetermined range of The second data exchange device includes a second video display device for displaying video, a second data holding device for holding data, and a second predetermined of the second video display device. Second determining means for determining whether or not a second user holding the second data holding device within the range has performed an operation for data exchange; and a second predetermined unit of the second video display device Second imaging means for imaging a second user holding the second data holding device within the range, and the control means displays the video obtained by the first imaging means as a second video display device. And the first image display device displays the video obtained by the second imaging means on the first video display device and grips the first data holding device within the first predetermined range of the first video display device. It was determined by the first determining means that the user of the user performed an operation for data exchange The second use of providing the second data holding device with the data held by the first data holding device and holding the second data holding device within the second predetermined range of the second video display device. When the second determining means determines that the user has performed an operation for exchanging data, the data held by the second data holding device is given to the first data holding device.

  In the data exchange system according to the first aspect of the present invention, the first data exchange device is provided at the first point, the second data exchange device is provided at the second point, and the first data exchange is performed by the control means. Data exchange between the device and the second data exchange device is controlled.

  In the first data exchange device, the first user holding the first data holding device within the first predetermined range of the first video display device is imaged by the first imaging means. On the other hand, in the second data exchange device, the second user who holds the second data holding device within the second predetermined range of the second video display device is imaged by the second imaging means.

  The video obtained by the first imaging means at the first point is given to the second video display device at the second point by the control means. As a result, an image of the first user holding the first data holding device at the first point is displayed on the second image display device. Further, the video obtained by the second imaging means at the second point is given to the first video display device at the first point by the control means. Thereby, the image of the second user holding the second data holding device at the second point is displayed on the first image display device.

  In this state, whether or not the first user has performed an operation for exchanging data is determined by the first determining means, and whether or not the second user has performed an operation for exchanging data is the first. 2 is discriminated by the discriminating means. When the first user performs an operation for exchanging data, the data held by the first data holding device is given to the second data holding device by the control means, and the second user When an operation for exchange is performed, data held by the second data holding device is given to the first data holding device by the control means.

  Accordingly, the first user at the first point and the second user at the second point can respectively grasp the first and second grips while confirming the actions of the other party in a state of facing each other in a pseudo manner. The data of the two data holding devices can be exchanged. As a result, users existing at different points can exchange data through intuitive operations without performing complicated operations.

(2) The first determination means includes first person detection means for detecting whether or not the first user is within a first predetermined range of the first video display device, and first use. A first grip detecting means for detecting whether or not the user is holding the first data holding device, and a first operation for detecting whether or not the first user has performed an operation for data exchange. A second person detecting means for detecting whether or not the second user is within a second predetermined range of the second video display device, and a second judging means . A second grip detecting means for detecting whether or not the second user is holding the second data holding device; and a second detecting means for detecting whether or not the second user has performed an operation for exchanging data. 2 operation detection means.

  In this case, it is detected by the first person detection means whether or not the first user is within the first predetermined range of the first video display device, and the first user holds the first data. Whether or not the apparatus is gripped is detected by the first grip detection means, and whether or not the first user has performed an operation for exchanging data is detected by the first operation detection means. As a result, it is determined whether or not the first user holding the first data holding device within the first predetermined range of the first video display device has performed an operation for exchanging data at the first point. It becomes possible to discriminate.

  On the other hand, whether or not the second user is within the second predetermined range of the second video display device is detected by the second person detection means, and the second user holds the second data holding device. Is detected by the first grip detection means, and whether the second user has performed an operation for exchanging data is detected by the second operation detection means. As a result, whether or not the second user holding the second data holding device within the second predetermined range of the second video display device has performed an operation for exchanging data at the second point. It becomes possible to discriminate.

  (3) The first person detection means detects whether or not the first user is within the first predetermined range of the first video display device based on the video obtained by the first imaging means. The second person detecting means detects whether or not the second user exists within the second predetermined range of the second video display device based on the video obtained by the second imaging means. May be.

  In this case, it is possible to detect whether or not the first user is within the first predetermined range of the first video display device based on the video obtained by the first imaging means. Thus, since the first user can use the first imaging means to detect whether or not the first user is within the first predetermined range of the first video display device, The cost of the data exchange device can be reduced.

  On the other hand, it is possible to detect whether or not the second user is within the second predetermined range of the second video display device based on the video obtained by the second imaging means. In this way, the second imaging means can be used to detect whether or not the second user is within the second predetermined range of the second video display device. The cost of the data exchange device can be reduced.

  (4) The first grip detection unit detects whether or not the first user is gripping the first data holding device based on the image obtained by the first imaging unit, and the second grip The detecting means may detect whether or not the second user is holding the second data holding device based on the video obtained by the second imaging means.

  In this case, it is possible to detect whether or not the first user is holding the first data holding device based on the video obtained by the first imaging means. Thus, since the first imaging means can be used to detect whether or not the first user is holding the first data holding device, the cost of the first data exchange device can be reduced. Can be realized.

  On the other hand, it is possible to detect whether or not the second user is holding the second data holding device based on the video obtained by the second imaging means. In this way, since the second imaging means can be used to detect whether or not the second user is holding the second data holding device, the low cost of the second data exchange device. Can be realized.

  (5) The first operation detecting means detects whether or not the first user has performed an operation for data exchange based on the video obtained by the first imaging means, and the second operation detecting means. May detect whether or not the second user has performed an operation for data exchange based on the video obtained by the second imaging means.

  In this case, it is possible to detect whether or not the first user has performed an operation for exchanging data based on the video obtained by the first imaging means. In this way, since the first imaging means can be used to detect whether or not the first user has performed an operation for data exchange, the cost of the first data exchange apparatus can be reduced. It becomes possible.

  On the other hand, it is possible to detect whether the second user has performed an operation for exchanging data based on the video obtained by the second imaging means. Thus, since the second imaging means can be used to detect whether or not the second user has performed an operation for data exchange, the cost of the second data exchange apparatus can be reduced. It becomes possible.

  (6) The first person detection means includes first contact detection means for detecting that the first user has touched the first video display device, and is based on the detection result of the first contact detection means. The first user detects whether or not the first user is within the first predetermined range of the first video display device, and the second person detecting means is configured so that the second user can detect the second video display device. Second contact detection means for detecting that the second user is touched, and the second user is within a second predetermined range of the second video display device based on the detection result of the second contact detection means. It may be detected whether or not.

  In this case, based on whether or not the first user has touched the first video display device, whether or not the first user is within the first predetermined range of the first video display device. Can be easily detected.

  On the other hand, based on whether or not the second user has touched the second video display device, whether or not the second user is within the second predetermined range of the second video display device. It can be easily detected.

  (7) The first grip detection unit includes a third contact detection unit that detects that the first user has contacted the first data holding device, and is based on a detection result of the third contact detection unit. And detecting whether or not the first user is holding the first data holding device, and the second holding detection means detects that the second user has touched the second data holding device. And a fourth contact detection unit that detects whether the second user is holding the second data holding device based on a detection result of the fourth contact detection unit.

  In this case, it is easy to detect whether or not the first user is holding the first data holding device based on whether or not the first user has contacted the first data holding device. Is possible.

  On the other hand, it is possible to easily detect whether or not the second user is holding the second data holding device based on whether or not the second user has touched the second data holding device. It becomes possible.

  (8) The first data holding device includes a third video display device that displays video based on the held data, and the second data holding device displays fourth video based on the held data. The video display device may be included.

  In this case, the video is displayed on the third video display device held by the first user at the first point, and the fourth video display device held by the second user at the second point. An image is displayed. The third video display device at the first point and the video displayed on the third video display device are displayed on the second video display device at the second point, and the fourth video display device at the second point and the video displayed on the second video display device. Is displayed on the first video display device at the first point. In this state, when the first user performs an operation for exchanging data and the second user performs an operation for exchanging data, data held by the third video display device is stored. Data supplied to the fourth video display device and held by the fourth video display device is supplied to the third video display device. Thereby, the video displayed on the third video display device and the video displayed on the fourth video display device are exchanged. As a result, it is possible for users present at different points to exchange videos with intuitive operations without performing complicated operations.

  (9) The data held in the first data holding device and the data held in the second data holding device may include at least one of video data, audio data, and text data.

  In this case, at least one of video data, audio data, and text data can be exchanged by an intuitive operation without a complicated operation by a user present at a different point.

  (10) A data exchange method according to a second invention is a data exchange method for exchanging data between a first user at a first point and a second user at a second point, Imaging a first user holding a first data holding device holding data within a first predetermined range of the first video display device by a first imaging means at a first point; The step of imaging the second user holding the second data holding device holding data within the second predetermined range of the second video display device by the second imaging means at the second point. Displaying the video obtained by the first imaging means on the second video display device, displaying the video obtained by the second imaging means on the first video display device, Holding first data within a first predetermined range of the video display device Determining whether or not the first user holding the device has performed an operation for exchanging data, and holding the second data holding device within the second predetermined range of the second video display device A step of determining whether or not the second user has performed an operation for exchanging data; and if it is determined that the first user has performed an operation for exchanging data, the first data holding device The data held by the second data holding device is given to the second data holding device, and when it is determined that the second user has performed an operation for data exchange, the data held by the second data holding device is changed to the first data. And a step of giving to the holding device.

  In the data exchange method according to the second invention, the first user holding the first data holding device within the first predetermined range of the first video display device is imaged by the first imaging means, A second user who holds the second data holding device within the second predetermined range of the second video display device is imaged by the second imaging means.

  The video obtained by the first imaging means at the first point is given to the second video display device at the second point. As a result, an image of the first user holding the first data holding device at the first point is displayed on the second image display device. In addition, the video obtained by the second imaging means at the second point is given to the first video display device at the first point. Thereby, the image of the second user holding the second data holding device at the second point is displayed on the first image display device.

  In this state, it is determined whether or not the first user has performed an operation for exchanging data, and it is determined whether or not the second user has performed an operation for exchanging data. When the first user performs an operation for exchanging data, the data held by the first data holding device is given to the second data holding device, and the second user performs data exchange. When the above operation is performed, the data held by the second data holding device is given to the first data holding device.

  Accordingly, the first user at the first point and the second user at the second point can respectively grasp the first and second grips while confirming the actions of the other party in a state of facing each other in a pseudo manner. The data of the two data holding devices can be exchanged. As a result, users existing at different points can exchange data through intuitive operations without performing complicated operations.

  According to the present invention, it is possible for users existing at different points to exchange data by an intuitive operation without performing a complicated operation.

It is typical explanatory drawing which shows the data exchange method using the data exchange system which concerns on one embodiment of this invention. It is a typical external view which shows the structure of a data exchange apparatus. It is a block diagram which shows the structure of the control system of the data exchange system of FIG. It is typical explanatory drawing which shows the identification method of the relative positional relationship of a flat display, a three-dimensional display, and a user. It is a typical external view which shows the structure of a three-dimensional display. It is typical sectional drawing which shows the element display surface which comprises a three-dimensional display surface. It is a figure for demonstrating the production method of the stereo image data for displaying stereo data. It is a figure for demonstrating the data displayed on the spatial light modulator of a three-dimensional display based on three-dimensional video data. It is a flowchart which shows operation | movement of the main-control part of a control apparatus. It is a flowchart which shows operation | movement of the main-control part of a control apparatus. It is a flowchart which shows operation | movement of the main-control part of a control apparatus. It is a block diagram which shows the other example of a structure of a flat display.

  Hereinafter, a data exchange system and a data exchange method according to embodiments of the present invention will be described.

(1) Data Exchange Method First, an example of a data exchange method using a data exchange system will be described in order to facilitate understanding of the present invention.

  FIG. 1 is a schematic explanatory view showing an example of a data exchange method using a data exchange system according to an embodiment of the present invention.

  As shown in FIGS. 1A to 1C, the data exchange system 1 includes a data exchange device 100A provided at a point PA and a data exchange device 100B provided at a point PB. The data exchange device 100A includes a flat display 20A and a stereoscopic display 30A. On the other hand, the data exchange device 100B includes a flat display 20B and a stereoscopic display 30B.

  As shown in FIG. 1A, the stereoscopic video G is displayed on the stereoscopic display 30A at the point PA. The user S stands in front of the flat display 20A and holds the stereoscopic display 30A on which the stereoscopic video G is displayed. On the other hand, the stereoscopic video H is displayed on the stereoscopic display 30B at the point PB. The user R stands in front of the flat display 20B and holds the stereoscopic display 30B on which the stereoscopic video H is displayed.

  In this case, the image of the user R at the point PB and the stereoscopic display 30B is displayed on the flat display 20A. On the other hand, the image of the user S at the point PA and the three-dimensional display 30A is displayed on the flat display 20B.

  Next, as shown in FIG. 1B, at the point PA, the user S approaches the flat display 20A and performs an operation for exchanging video data using the grasped three-dimensional display 30A. On the other hand, at the point PB, the user R approaches the flat display 20B and performs an operation for exchanging data using the three-dimensional display 30B being held. Here, the operation for exchanging data is an operation of moving the three-dimensional displays 30A and 30B by a predetermined method. For example, the operation for exchanging data is an operation of moving the stereoscopic displays 30A and 30B so as to draw an arc, or an operation of bringing the stereoscopic displays 30A and 30B into contact with the flat displays 20A and 20B.

  Thereby, the shape data corresponding to the stereoscopic image G displayed on the stereoscopic display 30A at the point PA is transmitted to the stereoscopic display 30B at the point PB. In addition, shape data corresponding to the stereoscopic video H displayed on the stereoscopic display 30B at the point PB is transmitted to the stereoscopic display 30A at the point PA. As a result, as shown in FIG. 1C, the stereoscopic video G is displayed on the stereoscopic display 30B at the point PB, and the stereoscopic video H is displayed on the stereoscopic display 30B at the point PB.

  In this way, the shape data is exchanged between the stereoscopic display 30A at the point PA and the stereoscopic display 30B at the point PB.

  In this case, the user S at the point PA and the user R at the point PB perform an operation for exchanging data while viewing the other party's video displayed on the flat display 20A and the flat display 20B and the images on the three-dimensional displays 30A and 30B, respectively. It can be performed. Accordingly, as in the case where the user S and the user R are directly facing each other, the video data can be exchanged by an intuitive operation.

(2) Configuration of Data Exchange Device Next, the configuration of the data exchange devices 100A and 100B will be described. FIG. 2 is a schematic external view showing the configuration of the data exchange apparatuses 100A and 100B.

  As shown in FIG. 2, the data exchange device 100A includes a control device 10A, a flat display 20A, a stereoscopic display 30A, and a plurality of observation devices 41A, 42A, 43A.

  The data exchange device 100B includes a control device 10B, a flat display 20B, a three-dimensional display 30B, and a plurality of observation devices 41A, 42A, and 43A.

  The flat displays 20A and 20B have a rectangular screen for displaying a flat image. Elements (hereinafter, referred to as infrared elements) 23A and 24A that emit infrared light are attached in the vicinity of corners at both upper ends of the front surface of the flat display 20A. Similarly, infrared elements 23B and 24B are attached in the vicinity of the corners at the upper ends of the front surface of the flat display 20B, respectively.

  The stereoscopic displays 30A and 30B have a cubic shape and display a stereoscopic image. An infrared element 34A is attached in the vicinity of one corner of the three-dimensional display 30A. A touch sensor 33 (see FIG. 3) is provided on the surface of the stereoscopic display 30A. Similarly, an infrared element 34B is attached near one corner of the stereoscopic display 30B. In addition, a touch sensor is provided on the surface of the stereoscopic display 30B.

  The three-dimensional displays 30A and 30B have a size that the users S and R can easily carry. In the present embodiment, the length of one side of the three-dimensional displays 30A and 30B is smaller than the vertical and horizontal lengths of the screens of the flat displays 20A and 20A.

  An infrared element 51A is attached to the user S, and an infrared element 51B is attached to the user R.

  A plurality of observation devices are arranged above the front side of the flat display 20A so as to image the infrared elements 23A and 24A. In the present embodiment, two observation devices 41A and 42A are used. The observation devices 41A and 42A image the infrared elements 34A and 51A when the three-dimensional display 30A is located within a predetermined range in front of the flat display 20A.

  An observation device 43A is attached to the center of the upper portion of the flat display 20A. The observation device 43A images the stereoscopic display 30A and the user S when the stereoscopic display 30A and the user S are within a predetermined range in front of the flat display 20A.

  Similarly, a plurality of observation devices are arranged above the front side of the flat display 20B so as to image the infrared elements 23B and 24B. In the present embodiment, two observation devices 41B and 42B are used. In addition, the observation devices 41B and 42B image the infrared elements 34B and 51B when the stereoscopic display 30B is located within a predetermined range in front of the flat display 20B.

  An observation device 43B is attached to the center of the upper part of the flat display 20B. The observation device 43B images the stereoscopic display 30B and the user R when the stereoscopic display 30B and the user R are located within a predetermined range in front of the flat display 20B.

  The observation devices 41A, 42A, 43A, 41B, 42B, and 43B are composed of cameras that can detect infrared rays, for example.

  The control device 10A and the control device 10B are connected to each other by wired communication, wireless communication, or a network.

  The control device 10A stores shape data for displaying a stereoscopic image, and gives part or all of the stored shape data to the stereoscopic display 30A. In addition, the control device 10A receives the shape data transmitted from the control device 10B and gives it to the three-dimensional display 30A. The 3D display 30A displays a 3D image based on the shape data given from the control device 10A. Further, the control device 10A receives the video data transmitted from the control device 10B and gives it to the flat display 20A. The flat display 20A displays a flat image based on video data given from the control device 10A.

  Further, the control device 10A determines the relative three-dimensional display of the stereoscopic display 30A and the user S relative to the flat display 20A based on the images of the emission points of the infrared elements 23A, 24A, 34A, 51A obtained by the observation devices 41A to 43A. Coordinates can be specified. Thereby, the control device 10A indicates that the user S and the three-dimensional display 30A are present within a predetermined range in front of the flat display 20A, that the user S is holding the three-dimensional display 30A, and that the user S has data. Detects that an operation for replacement has been performed.

  Similarly, the control device 10B stores shape data for displaying a stereoscopic image, and gives part or all of the stored shape data to the stereoscopic display 30B. In addition, the control device 10B receives the shape data transmitted from the control device 10A and gives it to the three-dimensional display 30B. The stereoscopic display 30B displays a stereoscopic video based on the shape data given from the control device 10B. In addition, the control device 10B receives the video data transmitted from the control device 10A and gives it to the flat display 20B. The flat display 20A displays a flat image based on the video data given from the control device 10B.

  In addition, the control device 10B has a three-dimensional display relative to the three-dimensional display 30B and the user R with respect to the flat display 20B based on the images of the emission points of the infrared elements 23B, 24B, 34B, 51B obtained by the observation devices 41B to 43B. Coordinates can be specified. Thereby, the control device 10B indicates that the user R and the three-dimensional display 30B are within a predetermined range in front of the flat display 20B, that the user R is holding the three-dimensional display 30B, and that the user R has data. Detects that an operation for replacement has been performed.

(3) Control System of Data Exchange System FIG. 3 is a block diagram showing the configuration of the control system of the data exchange system 1 of FIG. FIG. 3 shows detailed configurations of the control device 10A, the flat display 20A, and the three-dimensional display 30A of the data exchange device 100A. The configurations of the control device 10B, the flat display 20B, and the stereoscopic display 30B of the data exchange device 100B are the same as the configurations of the control device 10A, the flat display 20A, and the stereoscopic display 30A of the data exchange device 100A.

  In the present embodiment, data exchange apparatuses 100A and 100B have control apparatuses 10A and 10B, respectively, but the present invention is not limited to this. For example, the data exchange devices 100A and 100B may be configured to be controlled by one common control device.

  The control device 10A includes a main control unit 11, a shape data storage unit 12, a memory 13, an input / output circuit 14, a communication unit 15, and a connection unit 16. The flat display 20A includes a display unit 21, a flat display control unit 22, and an input / output circuit 25. The stereoscopic display 30 </ b> A includes a stereoscopic display surface 31, a stereoscopic display control unit 32, a touch sensor 33, and a communication unit 35.

  The main control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 13 stores a data exchange program for performing a data exchange process described later. The memory 13 is used as a work area for the main control unit 11. The shape data storage unit 12 stores shape data.

  The input / output circuit 14 of the control device 10A is connected to the input / output circuit 25 of the flat display 20A.

  The main control unit 11 of the control device 10 </ b> A gives the shape data stored in the shape data storage unit 12 to the flat display 20 </ b> A via the input / output circuit 14. Further, the main controller 11 gives a control signal for controlling the light emission of the infrared elements 23A, 24A to the flat display 20A via the input / output circuit 14.

  The communication unit 15 of the control device 10A and the communication unit 35 of the stereoscopic display 30A transmit and receive data and signals by wireless communication.

  The main control unit 11 of the control device 10A transmits the shape data stored in the shape data storage unit 12 or the shape data transmitted from the data exchange device 100B to the three-dimensional display 30A via the communication unit 15. In addition, the main control unit 11 transmits a control signal for controlling the light emission of the infrared element 34 </ b> A to the three-dimensional display 30 </ b> A via the communication unit 15. Further, the main control unit 11 receives the detection signal of the touch sensor 33 transmitted from the stereoscopic display 30 </ b> A via the communication unit 15. Thereby, the main control unit 11 detects that the user S is holding the three-dimensional display 30A.

  The main control unit 11 of the control device 10 </ b> A acquires video data obtained by the observation devices 41 </ b> A to 43 </ b> A via the input / output circuit 14. Thereby, the main control unit 11 specifies the relative three-dimensional coordinates of the user S and the three-dimensional display 30A with respect to the flat display 20A from the video data obtained by the observation devices 41A and 42A. Thereby, it is detected that the user S and the three-dimensional display 30A exist within a predetermined range in front of the flat display 20A.

  In the present embodiment, the presence of the user S and the three-dimensional display 30A is detected based on video data obtained by the observation devices 41A and 42A, but instead of this, video data obtained by the observation device 43A. The presence of the user S and the three-dimensional display 30A may be detected based on the above.

  The main control unit 11 of the control device 10A transmits video data obtained by the observation device 43A to the data exchange device 100B via the connection unit 16. Further, the main control unit 11 receives the video data transmitted from the data exchange device 100 </ b> B via the connection unit 16.

  Furthermore, when the user S performs an operation for exchanging data, the main control unit 11 transmits shape data corresponding to the stereoscopic video displayed on the stereoscopic display 30A to the data exchange device 100B via the connection unit 16. To do. In addition, the main control unit 11 receives shape data corresponding to the stereoscopic video displayed on the stereoscopic display 30B from the data exchange device 100B via the connection unit 16.

  The display unit 21 of the flat display 20A includes, for example, a liquid crystal display or a plasma display. The flat display control unit 22 is composed of a CPU, for example.

  The flat display control unit 22 acquires the video data given from the control device 10 </ b> A via the input / output circuit 25. The flat display control unit 22 holds the acquired video data and gives it to the display unit 21. Thereby, an image within a predetermined range in front of the flat display 20B is displayed on the display unit 21.

  Further, the flat display control unit 22 acquires a control signal given from the control device 10 </ b> A via the input / output circuit 25. Based on the acquired control signal, the flat display control unit 22 causes the infrared elements 23A and 24A to emit light.

  In the present embodiment, the infrared elements 23A and 24A emit light under the control of the control device 10A. However, the infrared elements 23A and 24A may emit light during operation of the flat display 20A without being controlled by the control device 10A. .

  The configuration of the stereoscopic display surface 31 of the stereoscopic display 30A will be described later. The stereoscopic display control unit 32 is constituted by a CPU, for example.

  The stereoscopic display control unit 32 acquires shape data given from the control device 10 </ b> A via the communication unit 35. The stereoscopic display control unit 32 converts the acquired shape data into stereoscopic video data and gives it to the stereoscopic display surface 31. As a result, a stereoscopic image is displayed on the stereoscopic display surface 31.

  In addition, the stereoscopic display control unit 32 receives a control signal given from the control device 10 </ b> A via the communication unit 35. Based on the received control signal, the stereoscopic display control unit 32 causes the infrared element 34A to emit light.

  In the present embodiment, the infrared element 34A emits light under the control of the control device 10A. However, the infrared element 34A may emit light during operation of the three-dimensional display 30A without being controlled by the control device 10A.

  When the user S holds the three-dimensional display 30A, a detection signal is output by the touch sensor 33. The stereoscopic display control unit 32 gives a detection signal acquired from the touch sensor 33 to the control device 10 </ b> A via the communication unit 35.

(4) Method for specifying relative positional relationship among flat display, three-dimensional display, and user FIG. 4 is a schematic illustration showing a method for specifying the relative positional relationship among flat display 20A, three-dimensional display 30A, and user S. FIG.

  In FIG. 4A, the light emitting points of the infrared elements 23A and 24A of the flat display 20A, the light emitting point of the infrared element 34A of the three-dimensional display 30, and the infrared element 51A of the user S are imaged by the two observation devices 41A and 42A. State. 4B shows the field of view of the observation apparatus 41A, and FIG. 4C shows the field of view of the observation apparatus 42A.

  In FIG. 4A, the visual fields of the observation devices 41A and 42A are indicated by virtual planes VP1 and VP2, respectively. A point where a straight line L1 connecting the observation center point C1 of the observation device 41A and the light emitting point of the infrared element 34A of the stereoscopic display 30A intersects the virtual plane VP1 is defined as I1c. Further, a point where a straight line L2 connecting the observation center point C2 of the observation device 42A and the light emitting point of the infrared element 34A of the stereoscopic display 30 intersects the virtual plane VP2 is defined as I2c.

  The two-dimensional coordinates of the point I1c on the virtual plane VP1 shown in FIG. 4B are specified from the video obtained by the observation device 41A. The two-dimensional coordinates of the point I2c on the virtual plane VP2 shown in FIG. 4C are specified from the video obtained by the observation device 42A.

  Based on the positions and orientations of the observation devices 41A and 42A and the two-dimensional coordinates of the points I1c and I2c, the relative three-dimensional coordinates of the infrared element 34A can be specified.

  Similarly, I1a is a point where a straight line connecting the observation center point C1 of the observation device 41A and the light emitting point of the infrared element 23A of the flat display 20A intersects the virtual plane VP1, and the observation center point C2 of the observation device 42A and the flat display 20A. Let I2a be a point where a straight line connecting the light emitting point of the infrared element 23A intersects the virtual plane VP2.

  Further, I1b is a point where a straight line connecting the observation center point C1 of the observation device 41A and the light emitting point of the infrared element 24A of the flat display 20A intersects the virtual plane VP1, and the observation center point C2 of the observation device 42A and the infrared light of the flat display 20A. A point where a straight line connecting the light emitting point of the element 24A intersects the virtual plane VP2 is defined as I2b.

  Furthermore, I1d is a point where a straight line connecting the observation center point C1 of the observation apparatus 41A and the light emitting point of the infrared element 51A of the user S intersects the virtual plane VP1, and the observation center point C2 of the observation apparatus 42A and the infrared rays of the user S A point where a straight line connecting the light emitting point of the element 51A intersects the virtual plane VP2 is defined as I2d.

  The two-dimensional coordinates of the points I1a, I1b, I1d on the virtual plane VP1 shown in FIG. 4B are specified from the video obtained by the observation device 41A. The two-dimensional coordinates of the points I2a, I2b, I2d on the virtual plane VP2 shown in FIG. 4C are specified from the video obtained by the observation device 42A.

  Based on the positions and orientations of the observation devices 41A and 42A and the two-dimensional coordinates of the points I1a and I2a, the relative three-dimensional coordinates of the infrared element 23A can be specified. Further, the relative three-dimensional coordinates of the infrared element 24A can be specified based on the positions and orientations of the observation devices 41A and 42A and the two-dimensional coordinates of the points I1b and I2b. Based on the positions and orientations of the observation devices 41A and 42A and the two-dimensional coordinates of the points I1d and I2d, the relative three-dimensional coordinates of the infrared element 51A can be specified.

  The screen of the flat display 20A is provided perpendicular to the installation surface. Further, the vertical length of the screen of the flat display 20A is known. In this case, the position in the three-dimensional space of the screen of the flat display 20A can be uniquely specified from the three-dimensional coordinates of the infrared elements 23A and 24A.

  In this way, the control device 10A detects that the three-dimensional display 30A and the user S are within a predetermined range in front of the flat display 20A based on the images obtained by the observation devices 41A and 42A. The relative three-dimensional coordinates of the stereoscopic display 30A with respect to 20A can be specified.

  In addition, when the screen of the flat display 20A is not provided vertically or when the vertical length of the flat display 20A is not known, it is preferable to attach three or more infrared elements to the flat display 20A.

(5) Configuration of stereoscopic display Next, the configuration of the stereoscopic display 30A will be described. FIG. 5 is a schematic external view showing the configuration of the three-dimensional display 30A.

  As shown in FIG. 5, the stereoscopic display 30 </ b> A includes a stereoscopic display surface 31 having a stereoscopic outer surface. The three-dimensional display surface 31 is configured by combining a plurality of element display surfaces 31a. In the present embodiment, the three-dimensional display surface 31 is formed in a cube by six square element display surfaces 31a. A stereoscopic video G is displayed inside the virtual space V surrounded by the stereoscopic display surface 31.

  FIG. 6 is a schematic cross-sectional view showing an element display surface 31 a constituting the stereoscopic display surface 31. As shown in FIG. 6, the element display surface 31a includes a planar spatial light modulator 31c, a planar light controller 31d, and a transparent outer skin layer 31e.

  The spatial light modulator 31c includes a matrix display element that can display colors in a matrix. The spatial light modulator 31c has a plurality of pixels arranged in a matrix. As the spatial light modulator 31c, for example, a liquid crystal display or an organic electroluminescence display can be used.

  The light beam controller 31d is composed of an optical element that can control the direction of the light beam, and has a function of reproducing the state of light traveling in various directions from the spatial light modulator 31c. In the present embodiment, a lens array including a plurality of lenses is used as the light beam controller 31d. Instead of the lens array, a diffraction grating array including a plurality of diffraction gratings may be used. Further, as the light beam controller 31d, a pinhole array having a plurality of pinholes or a prism array including a plurality of prisms can be used.

  The direction of the light beam from the plurality of pixels of the spatial light modulator 31c is controlled by each lens of the light beam controller 31d. Each lens corresponds to a pixel group located below the lens. Even if a light shielding member 31f for partitioning adjacent lenses is provided between the spatial light modulator 31c and the light controller 31d so that the direction of light from only the pixel group to which each lens corresponds can be controlled. Good. In addition, you may comprise so that each lens may control the direction of the light ray only from the pixel group located in the lower part by adjusting the distance of a lens and a pixel group.

  The number of light rays and the direction of the light rays that can be controlled by the light ray controller 31d are determined by the number of pixels located under each lens, the distance between the lenses, the optical design of the lens such as the refractive index of the lens, and the like. .

  As shown in FIG. 6, the lens L of the light beam controller 31d controls the light traveling in various directions from the pixels Pa, Pb, Pc, Pd of the spatial light modulator 31c in directions indicated by dotted lines.

  A touch sensor 33 is provided along the element display surface 31a. The touch sensor 33 is composed of, for example, a tactile sensor array. The tactile sensor array includes a plurality of tactile sensor elements arranged in a matrix. As the tactile sensor element, various tactile sensors that can detect contact of a person or an object can be used.

  In the present embodiment, the touch sensor 33 is composed of a plurality of tactile sensor elements embedded between the lenses of the lens array. For example, as the tactile sensor element, a piezoelectric element (piezo element) that detects a voltage change due to the piezoelectric effect, a strain gauge that detects strain, and a variable capacitance element that detects a change in capacitance can be used. It is also possible to use a light detection element such as a photodiode that detects light blocked by a finger, a heat detection element that detects a temperature change, or the like.

  Further, as the touch sensor 33, a sheet-like transparent touch sensor may be used instead of the touch sensor array. In that case, the transparent tactile sensor is disposed so as to overlap the light beam controller 31d. For example, as a tactile sensor element, a sheet-like light detection element that detects a change in a light transmission state to an optical fiber, a sheet-like variable capacitance element that detects a change in capacitance at a contact portion, or a state of conduction between electrodes. A conductive sheet or the like that detects contact can be used.

  In the present embodiment, the touch sensor 33 outputs a detection signal when the user S touches the element display surface 31a. The light beam controller 31d and the touch sensor 33 are embedded in a transparent outer skin layer 31e made of, for example, a transparent resin.

(6) Method for Creating Stereoscopic Video Data A method for creating stereoscopic video data for displaying the stereoscopic video G on the stereoscopic display 30A will be described. FIG. 7 is a diagram for explaining a method of creating stereoscopic video data for displaying the stereoscopic video G. In FIG. 7, the illustration of the touch sensor 33 is omitted.

  A stereoscopic image G to be viewed in the virtual space V inside the element display surface 31a is defined. This stereoscopic image G is represented by shape data. Consider a light ray traveling in an arbitrary direction at an arbitrary point on the surface of the stereoscopic image G. The positional relationship between the element display surface 31a and the stereoscopic video G is uniquely determined by the definition of shape data.

  The position (coordinates) of the intersection when each light ray intersects the element display surface 31a, the angle between the light ray and the element display surface 31a, and the color are obtained. Further, it is determined at which position of which element display surface 31a each light ray intersects. Finally, stereoscopic image data for displaying the color of the intersection point on each pixel of the spatial light modulator 31c is created so as to reproduce the light beam traveling in the direction of the angle by the light beam controller 31d.

  Ideally, the position, angle, and color of the above intersection are obtained for light rays traveling in all directions from the entire surface of the stereoscopic image G, and stereoscopic image data representing the image to be displayed on each element display surface 31a is created. Actually, the virtual space V surrounded by the stereoscopic display surface 31 is discretized into a plurality of voxels, and the directions of the light rays emitted from the respective voxels are discretized. In the present embodiment, the direction of the light beam emitted from each voxel is controlled to a discretized direction by the light beam controller 31d.

  If one voxel in the virtual space V inside the element display surface 31a is a part of the stereoscopic image G, a light ray traveling in a discretized direction from the voxel is obtained. In this way, the intersections between the element display surface 31a and the ray directed to the plurality of directions discretized from each of the plurality of voxels on the surface of the stereoscopic image G are obtained, and the angle between the ray and the element display surface 31a, Then, voxel colors are obtained, and stereoscopic video data is created based on their intersections, angles, and colors.

  For example, as shown in FIG. 7, the light beam emitted from one voxel b1 on the surface of the stereoscopic image G is controlled by the lens L of the light beam controller 31d so as to be directed in the direction of the dotted arrow. Stereoscopic image data is created so that the color of the voxel b1 is displayed at the pixel at the intersection of these rays and the element display surface 31a.

  Further, light rays emitted from the other voxels b2 on the surface of the stereoscopic image G are controlled so as to be directed in the direction of solid arrows by the lens L of the light ray controller 31d. Stereoscopic image data is created so that the color of the voxel b2 is displayed at the pixel at the intersection of these rays and the element display surface 31a.

  The above description has been made to facilitate understanding, but in practice, the reproducible light beam is limited by the relationship between each lens L of the light beam controller 31d and the number of pixels of the spatial light modulator 31c. The reverse algorithm to that described above is used. That is, the light beam reproducible by each lens L of the light beam controller 31d is traced back through the pixels of the spatial light modulator 31c to obtain the color of the voxel at the intersection with the stereoscopic image G to be displayed. The color to be displayed on the pixel is determined.

  When one light beam reproducible by the lens L of the light beam controller 31d intersects a plurality of voxels of the stereoscopic image G, the color of the voxel closer to the element display surface 31a is determined as the color to be displayed on the pixel. The This is because the point located in the back as viewed from the user is hidden by the point located in front. For example, as shown in FIG. 7, when one light beam reproducible by the lens L of the light beam controller 31d intersects a plurality of voxels b2 and b3 of the stereoscopic image G, the voxel closer to the element display surface 31a. The color of b3 is determined as the color to be displayed on the pixel.

  In this way, stereoscopic video data for displaying the color of each voxel on the surface of the stereoscopic video G on a plurality of pixels on the stereoscopic display surface 31 is created. By displaying an image on a plurality of pixels of the spatial light modulator 31c based on the stereoscopic image data, the light rays from the stereoscopic image G are reproduced as a result.

  FIG. 8 is a diagram for explaining data displayed on the spatial light modulator 31c of the stereoscopic display 30A based on the stereoscopic video data.

  For example, data when the stereoscopic shape is viewed from the observation point V1 is displayed on the pixel “A” of the spatial light modulator 31c. Further, an image when the stereoscopic shape is viewed from the observation point V2 is displayed on the pixel “B” of the spatial light modulator 31c. Thereby, the user can see the three-dimensional shape from different angles when the eye is moved from the observation point V1 to the observation point V2.

(7) Operation of Data Exchange System Next, the operation of the data exchange system 1 according to the present embodiment will be described. 9 to 11 are flowcharts showing the operation of the main control unit 11 of the control device 10A at the point PA.

  The main control unit 11 of the control device 10 </ b> A executes data exchange processing according to the data exchange program stored in the memory 13.

  First, the main control unit 11 acquires shape data from the shape data storage unit 12, transmits it to the stereoscopic display 30A, and sends video data corresponding to the video obtained by the observation device 43A to the data exchange device 100B at another point PB. Transmit (step S1). Thereby, as shown to Fig.1 (a), the three-dimensional image G is displayed on the three-dimensional display 30A of the point PA.

  Next, the main controller 11 determines whether or not video data has been received from the data exchange device 100B at another point PB (step S2). When video data is received from the data exchange device 100B at another point PB, the main control unit 11 gives the received video data to the flat display 20A (step S3).

  Thereby, as shown to Fig.1 (a), the image | video in the predetermined range ahead of the flat display 20B of the other point PB is displayed on the flat display 20A. On the other hand, when video data is not received from the data exchange device 100B at another point PB, the main control unit 11 stands by.

  Next, the main control unit 11 determines whether or not the user S is within a predetermined range in front of the flat display 20A (step S4). When the user S exists within a predetermined range in front of the flat display 20A, the main control unit 11 notifies the data exchange apparatus 100B at another point PB of the presence of the user S (step S5).

  Next, the main control unit 11 determines whether or not the presence of the user R is notified from the data exchange device 100B at another point PB (step S6).

  When the presence of the user R is notified from the data exchange device 100B at another point PB, the main control unit 11 determines whether or not the user S is holding the three-dimensional display 30A (step S7).

  When the user S is holding the three-dimensional display 30A, the main control unit 11 notifies the data exchange device 100B at another point PB of the holding of the three-dimensional display 30A (step S8).

  Next, the main control unit 11 determines whether or not the data exchange device 100B at another point PB has notified the user R to hold the 3D display 30B (step S9).

  When the data exchange device 100B at the other point PB is notified of the holding of the three-dimensional display 30B, the main control unit 11 determines whether or not the user S is performing an operation for data exchange (step S10). .

  When the user S is performing an operation for data exchange, the main control unit 11 notifies the data exchange device 100B at another point PB of the operation for data exchange (step S11).

  Next, the main control unit 11 determines whether or not an operation for data exchange by the user R is notified from the data exchange device 100B at another point PB (step S12).

  When an operation for data exchange is notified from the data exchange device 100B at the other point PB, the main control unit 11 transmits the shape data corresponding to the stereoscopic video G displayed on the stereoscopic display 30A to the other point PB. The data is transmitted to the data exchange device 100B (step S13).

  Next, the main control unit 11 determines whether or not shape data corresponding to the stereoscopic image H displayed on the stereoscopic display 30B is received from the data exchange device 100B at another point PB (step S14).

  When the shape data corresponding to the stereoscopic image displayed on the stereoscopic display 30B is received from the data exchange device 100B at another point PB, the main control unit 11 transmits the received shape data to the stereoscopic display 30A ( Step S15).

  Thereby, as shown in FIG.1 (c), the three-dimensional image H currently displayed on the three-dimensional display 30B of the other point PB is displayed on the three-dimensional display 30A.

  In the above processing, for example, a flag indicating whether or not the user S is within a predetermined range in front of the flat display 20A (hereinafter referred to as presence flag), whether or not the user S has gripped the three-dimensional display 30A. A flag indicating whether or not (hereinafter referred to as a gripping flag) and a flag indicating whether or not the user S has performed an operation for data exchange (hereinafter referred to as an operation flag) are set in advance. The initial values of the presence flag, the grip flag, and the operation flag are “0”.

  The main control unit 11 sets the presence flag to “1” when the user S exists within a predetermined range in front of the flat display 20A in step S4, and sets the presence flag to data of another point PB in step S5. The data is transmitted to the exchange device 100B, and the presence flag is received from the data exchange device 100B at another point PB in step S6.

  Further, the main control unit 11 sets the grip flag to “1” when the user S is gripping the three-dimensional display 30A in step S7, and sets the grip flag to the data exchange device at another point PB in step S8. In step S9, the presence flag is received from the data exchange device 100B at another point PB.

  Further, when the user S performs an operation for data exchange in step S10, the main control unit 11 sets the operation flag to “1”, and in step S11, the main control unit 11 exchanges the operation flag with another point PB. In step S12, the operation flag is received from the data exchange device 100B at another point PB.

  If the user S does not exist within the predetermined range in front of the flat display 20A in step S4, the presence of the user R is not notified from the data exchange device 100B at another point PB in step S6. If the user S does not hold the 3D display 30A in step S7, if the data exchange device 100B at another point PB has not been notified of the holding of the 3D display 30B in step S9, the user S receives data in step S10. When the operation for exchange is not performed, when the operation for data exchange is not notified from the data exchange device 100B at the other point PB at step S12, and when the operation for exchange is not performed at step S14, the data exchange device 100B at the other point PB. When the shape data from is not received, the main control unit 11 returns to the process of step S4.

  In the data exchange device 100B at another point PB, the same operation as that of the data exchange device 100A is performed. In this way, the data exchange shown in FIG. 1 is performed between the data exchange device 100A at the point PA and the data exchange device 100B at the point PB.

(8) Effects of the present embodiment As described above, according to the data exchange system 1 according to the present embodiment, at the first point PA, the user S holding the stereoscopic display 30A is in front of the flat display 20A. Then, an operation for exchanging data is performed while viewing the video of the user R at the second point PB. Further, at the second point PA, the user R holding the stereoscopic display 30B performs an operation for exchanging data while viewing the video of the user S at the second point PB in front of the flat display 20A.

  Thereby, the shape data corresponding to the stereoscopic image G displayed on the stereoscopic display 30A at the first point PA and the shape data corresponding to the stereoscopic image H displayed on the stereoscopic display 30B at the second point PB are exchanged. The As a result, the stereoscopic video G displayed on the stereoscopic display 30A at the first point PA is displayed on the stereoscopic display 30B at the second point PB, and the stereoscopic video H displayed on the stereoscopic display 30B at the second point PB is displayed. It is displayed on the three-dimensional display 30A of the first point PA. Therefore, it is possible to exchange shape data by an intuitive operation without performing a complicated operation in a state where a user who is present at a different point faces in a pseudo manner.

(9) Other Embodiments (a) In the above embodiment, when the user S at the point PA and the user R at the point PB perform an operation for data exchange, the shape data of the stereoscopic display 30A The shape data of the 3D display 30B is exchanged with each other, but the present invention is not limited to this. For example, when the user S at the point PA performs an operation for exchanging data, the shape data of the stereoscopic display 30A may be transmitted to the stereoscopic display 30B. In this case, step S13 in FIG. 11 is provided between step S10 and step S11.

  (B) FIG. 12 is a block diagram showing another example of the configuration of the flat display 20A. In the above embodiment, the infrared elements 23A, 24A, 34A, 51A and the observation devices 41A, 42A are used to detect that the user S is within a predetermined range in front of the flat display 20A. It is not limited to.

  For example, as shown in FIG. 12, a touch sensor 26A or a proximity sensor 27A may be attached to the flat display 20A.

  When the user S touches the flat display 20A, the touch sensor 26A outputs a detection signal. The flat display control unit 22 transmits a detection signal output from the touch sensor 26A to the control device 10A via the input / output circuit 25. Thereby, 10 A of control apparatuses discriminate | determine that the user S exists in the predetermined range ahead of the flat display 20A.

  The proximity sensor 27A outputs a detection signal when the user S approaches a predetermined range in front of the flat display 20A. The flat display control unit 22 transmits the detection signal output from the proximity sensor 27A to the control device 10A via the input / output circuit 25. Thereby, 10 A of control apparatuses discriminate | determine that the user S is approaching within the predetermined range ahead of the flat display 20A.

  Further, an RFID (high frequency identification) tag 29A may be attached to the user S, and a tag reader 28A may be attached to the flat display 20A.

  When the tag reader 28A detects a high-frequency signal from the RFID tag 29A, it outputs a detection signal. The flat display control unit 22 transmits a detection signal output from the tag reader 28 </ b> A to the control device 10 </ b> A via the input / output circuit 25. Thereby, 10 A of control apparatuses discriminate | determine that the user S exists in the predetermined range ahead of the flat display 20A.

  Moreover, you may detect that the user S exists in the predetermined range ahead of the flat display 20A using the infrared elements 23A, 24A, 34A, 51A and the observation device 43A.

  Further, by processing the image obtained by the observation devices 41A, 42A or the observation device 43A without detecting infrared rays, it is detected that the user S is within a predetermined range in front of the flat display 20A. Also good. The data exchange apparatus 100B can be replaced in the same manner as described above.

  (C) In the above embodiment, the touch sensor 33 is used to detect that the user S is holding the three-dimensional display 30A. However, the present invention is not limited to this.

  For example, the infrared elements 23A, 24A, 34A, 51A and the observation devices 41A, 42A may be used to detect that the user S is holding the stereoscopic display 30A, or the infrared elements 23A, 24A, 34A, 51A and observation device 43A may be used.

  Specifically, the three-dimensional position of the hand of the user S and the three-dimensional position of the three-dimensional display 30A are measured in time series. When the three-dimensional position of the hand of the user S and the three-dimensional position of the three-dimensional display 30A are moving at the same time and in the same direction, the user S is holding the three-dimensional display 30A. Can be determined.

  Further, it may be detected that the user S is holding the three-dimensional display 30A by processing an image obtained by the observation devices 41A and 42A or the observation device 43A without detecting infrared rays. The data exchange apparatus 100B can be replaced in the same manner as described above.

  (D) In the above embodiment, the infrared elements 23A, 24A, 34A, 51A and the observation devices 41A, 42A are used to detect that the user S is performing an operation for data exchange. It is not limited to this.

  For example, as shown in FIG. 12, at least one of the touch sensor 26A and the proximity sensor 27A may be attached to the flat display 20A. In this case, the operation for exchanging data is a movement in which the user S or the three-dimensional display 30A touches or approaches the flat display 20A.

  The touch sensor 26A outputs a detection signal when the user S or the three-dimensional display 30A contacts the flat display 20A. The flat display control unit 22 transmits a detection signal output from the touch sensor 26A to the control device 10A via the input / output circuit 25. Thereby, 10 A of control apparatuses discriminate | determine that the user S is performing operation for data exchange.

  The proximity sensor 27A outputs a detection signal when the user S or the three-dimensional display 30A approaches a predetermined range in front of the flat display 20A. The flat display control unit 22 transmits the detection signal output from the proximity sensor 27A to the control device 10A via the input / output circuit 25. Thereby, 10 A of control apparatuses discriminate | determine that the user S is performing operation for data exchange.

  Further, it may be detected that the user S is performing an operation for data exchange using the infrared elements 23A, 24A, 34A, 51A and the observation device 43A.

  Furthermore, it may be detected that the user S is performing an operation operation for data exchange by processing an image obtained by the observation devices 41A, 42A or the observation device 43A without detecting infrared rays. . The data exchange apparatus 100B can be replaced in the same manner as described above.

  (E) In the embodiment described above, a camera capable of detecting infrared rays is used as the observation devices 41A, 42A, 43A, 41B, 42B, and 43B. However, an infrared sensor, a magnetic sensor, or an ultrasonic sensor is used instead of the camera. It may be used. As a three-dimensional position measuring apparatus using a magnetic sensor, for example, a three-dimensional magnetic sensor (http://www.kbk.co.jp/cesd/polhemus.htm) manufactured by Polhemus can be used. For a three-dimensional position measurement apparatus using an ultrasonic sensor, for example, Intersense's ultrasonic motion tracking system (http://www.intersense.com/uploadedFiles/Products/IS900.pdf) can be used.

  Further, the data exchange devices 100A and 100B include the flat displays 20A and 20A having a large screen and the portable stereoscopic displays 30A and 30B, but are not limited thereto. For example, a three-dimensional display may be used instead of the flat displays 20A and 20B.

  Further, a portable flat display may be used instead of the three-dimensional displays 30A and 30B. In this case, video data is exchanged between flat displays.

  Furthermore, other mobile devices such as a mobile phone may be used instead of the three-dimensional displays 30A and 30B. In this case, voice data is exchanged.

  The exchanged data is not limited to video data and audio data, but may be other data such as text data.

(10) Correspondence between each component of claim and each part of embodiment The following describes an example of a correspondence between each component of the claim and each part of the embodiment. It is not limited.

  In the above embodiment, the point PA is an example of the first point, the point PB is an example of the second point, the user S is an example of the first user, and the user R is the first point. The data exchange device 100A is an example of a first data exchange device, the data exchange device 100B is an example of a second data exchange device, and the control devices 10A and 10B are control means. For example, the flat display 20A is an example of the first video display device, the flat display 20B is an example of the second video display device, and the three-dimensional display 30A is the first data holding device or the third video display. This is an example of a device, and the three-dimensional display 30B is an example of a second data holding device or a fourth video display device.

  The observation devices 41A, 42A, 43A, the infrared elements 23A, 24A, 34A, 51A and the control device 10A are examples of the first discriminating means or the first operation detecting means, and the observation devices 41B, 42B, 43B, the infrared element 23B. , 24B, 34B, 51B and the control device 10B are examples of second discriminating means or second operation detecting means. The observation devices 41A, 42A, and 43A are examples of first imaging means, and the observation devices 41B, 42B, and 43B are examples of second imaging means.

  The observation devices 41A, 42A, 43A, the infrared elements 23A, 24A, 34A, 51A and the control device 10A are examples of the first person detection means, and the touch sensor 26A or the proximity sensor 27A is another example of the first person detection means. The RFID tag 29A and the tag reader 28A are still other examples of the first person detection means. The observation devices 41B, 42B, and 43B, the infrared elements 23B, 24B, 34B, and 51B and the control device 10B are examples of the second person detection means, and the touch sensor 26A or the data exchange device 100B provided in the data exchange device 100B is provided. The proximity sensor 27A is another example of the second person detection means, and the RFID tag 29A provided in the data exchange apparatus 100B and the tag reader 28A provided in the data exchange apparatus 100B are still another example of the second person detection means. It is.

  The observation devices 41A, 42A, 43A, the infrared elements 23A, 24A, 34A, 51A and the control device 10A are examples of the first grip detection means, and the touch sensor 33 is another example of the first grip detection means. The observation devices 41B, 42B, and 43B, the infrared elements 23B, 24B, 34B, and 51B and the control device 10B are examples of the second gripping detection unit, and the touch sensor 33 provided in the data exchange device 100B is the second gripping detection unit. It is another example.

  The touch sensor 26A or the proximity sensor 27A is an example of the first contact detection means, and the touch sensor 26A provided in the data exchange device 100B or the proximity sensor 27A provided in the data exchange device 100B is an example of the first contact detection means. is there. The touch sensor 33 is an example of a third contact detection unit, and the touch sensor 33 provided in the data exchange device 100B is an example of a fourth contact detection unit.

  As each constituent element in the claims, various other elements having configurations or functions described in the claims can be used.

(11) Application examples (a) In a conference held between remote locations, a stereoscopic image such as a prototype displayed on the stereoscopic display 30A owned by the user S is displayed on the stereoscopic display 30B that the user R has at hand. It can be received and displayed, and examined from various perspectives.

  (B) In daily life, a stereoscopic image displayed on the stereoscopic display 30A owned by the user S in a remote place can be received and displayed on the stereoscopic display 30B that the user R has at hand and viewed. .

  The present invention can be effectively used for exchanging various data between different points.

DESCRIPTION OF SYMBOLS 1 Data exchange system 10A, 10B Control apparatus 11 Main control part 12 Shape data storage part 13 Memory 14, 25 Input / output circuit 15, 35 Communication part 16 Connection part 20A, 20B Flat display 21 Display part 22 Flat display control part 23A, 24A , 34A, 51A, 23B, 24B, 34B, 51B Infrared element 26A, 33 Touch sensor 27A Proximity sensor 28A Tag reader 29A RFID tag 30A, 30B 3D display 31 3D display surface 32 3D display control unit 41A, 42A, 43A, 41B, 42B , 43B Observation device 100A, 100B Data exchange device 31a Element display surface 31c Spatial light modulator 31d Light controller 31e Transparent skin layer 31f Light shielding member C1, C2 Observation center point G, H Stereo image R, S User L Lens L1, L2 Straight line PA, PB point Pa, Pb, Pc, Pd Pixel V Virtual space V1, V2 Observation point VP1, VP2 Virtual plane b1, b2, b3 Voxel

Claims (10)

A data exchange system for exchanging data between a first user at a first point and a second user at a second point,
A first data exchange device provided at the first point;
A second data exchange device provided at the second point;
Control means for controlling data exchange between the first data exchange device and the second data exchange device;
The first data exchange device includes:
A first video display device for displaying video;
A first data holding device for holding data;
First determination for determining whether or not the first user holding the first data holding device within the first predetermined range of the first video display device has performed an operation for data exchange. Means,
First imaging means for imaging the first user holding the first data holding device within the first predetermined range of the first video display device;
The second data exchange device includes:
A second video display device for displaying video;
A second data holding device for holding data;
A second determination for determining whether or not the second user holding the second data holding device within the second predetermined range of the second video display device has performed an operation for data exchange. Means,
Second imaging means for imaging the second user holding the second data holding device within the second predetermined range of the second video display device;
The control means causes the second video display device to display the video obtained by the first imaging means, and causes the first video display device to display the video obtained by the second imaging means. When the first user holding the first data holding device within the first predetermined range of the first video display device performs an operation for exchanging data, the first discriminating means When it is determined, the data held by the first data holding device is supplied to the second data holding device, and the second data holding is performed within the second predetermined range of the second video display device. When the second determination means determines that the second user holding the device has performed an operation for exchanging data, the data held by the second data holding device is the first data. To give the holding device Data exchange system to be butterflies. The first discrimination means includes
First person detecting means for detecting whether or not the first user is within the first predetermined range of the first video display device;
First grip detection means for detecting whether or not the first user is gripping the first data holding device;
First operation detecting means for detecting whether or not the first user has performed an operation for exchanging data;
The second determining means includes
Second person detecting means for detecting whether or not the second user is within the second predetermined range of the second video display device;
Second grip detection means for detecting whether or not the second user is gripping the second data holding device;
2. The data exchange system according to claim 1, further comprising second operation detecting means for detecting whether or not the second user has performed an operation for data exchange. The first person detecting means determines whether or not the first user is within the first predetermined range of the first video display device based on the video obtained by the first imaging means. Detect
The second person detection means determines whether or not the second user is within the second predetermined range of the second video display device based on the video obtained by the second imaging means. 3. The data exchange system according to claim 2, wherein the data exchange system is detected. The first grip detection unit detects whether or not the first user is gripping the first data holding device based on an image obtained by the first imaging unit.
The second grip detection unit detects whether or not the second user is gripping the second data holding device based on an image obtained by the second imaging unit. The data exchange system according to claim 2 or 3. The first operation detecting means detects whether or not the first user has performed an operation for data exchange based on an image obtained by the first imaging means,
The second operation detection unit detects whether or not the second user has performed an operation for data exchange based on an image obtained by the second imaging unit. The data exchange system in any one of 2-4. The first person detection means includes first contact detection means for detecting that the first user has contacted the first video display device, and the detection result of the first contact detection means is included in the detection result. Based on whether the first user is present within the first predetermined range of the first video display device,
The second person detection means includes second contact detection means for detecting that the second user has touched the second video display device, and the detection result of the second contact detection means is included in the detection result. 6. The data according to claim 2, wherein whether or not the second user is within the second predetermined range of the second video display device is detected based on the second user. Exchange system. The first grip detection means includes third contact detection means for detecting that the first user has touched the first data holding device, and the detection result of the third contact detection means Based on whether the first user is holding the first data holding device,
The second grip detection means includes fourth contact detection means for detecting that the second user has touched the second data holding device, and the detection result of the fourth contact detection means The data exchange system according to any one of claims 2 to 6, wherein it is detected whether or not the second user is holding the second data holding device. The first data holding device includes a third video display device that displays a video based on the held data,
The data exchange system according to any one of claims 1 to 7, wherein the second data holding device includes a fourth video display device that displays a video based on the held data. 2. The data held in the first data holding device and the data held in the second data holding device include at least one of video data, audio data, and text data. The data exchange system in any one of -8. A data exchange method for exchanging data between a first user at a first point and a second user at a second point,
At the first point, the first imaging unit captures an image of the first user holding the first data holding device that holds data within the first predetermined range of the first video display device. Steps,
At the second point, the second imaging means captures the second user holding the second data holding device that holds data within the second predetermined range of the second video display device. Steps,
Displaying the video obtained by the first imaging means on the second video display device;
Displaying the video obtained by the second imaging means on the first video display device;
Determining whether the first user holding the first data holding device within the first predetermined range of the first video display device has performed an operation for data exchange;
Determining whether or not the second user holding the second data holding device within the second predetermined range of the second video display device has performed an operation for exchanging data;
When it is determined that the first user has performed an operation for exchanging data, the data held by the first data holding device is given to the second data holding device, and the second user Providing data to be held by the second data holding device to the first data holding device when it is determined that an operation for data exchange has been performed. .

Images