JP7369898B2 - Vibration regeneration device, vibration regeneration system, and vibration regeneration method - Google Patents

Description

The present invention relates to a technique for reproducing vibration information acquired by a vibration information acquisition device using a vibration reproducing device. For example, it relates to technology that senses vibrations at a certain point, transmits the vibration information to a remote location, reproduces the vibration information at the remote location, and reproduces the vibrations at a certain location at the remote location.

BACKGROUND ART Conventionally, Non-Patent Document 1 is known as a technique for transmitting vibration information to a remote point. Here, the data measured by 8 sensors at the transmitting point is compressed into 2 channels and transmitted, and the data received at the receiving point is regenerated by 10 transducers, thereby transmitting vibration information from the transmitting point to the receiving point. do.

Hirohiko Hayakawa, Yoichi Kamiyama, Toshishi Matsuzono, Moe Suh, Kaijin Tanaka, Takuto Motoyama, Noriyuki Suzuki, Kota Minamisawa: "Practice of live feeling of basketball with haptic transmission", Proceedings of the 23rd Virtual Reality Society , September 2018, 34E-6

However, Non-Patent Document 1 has a problem in that a large number of devices are required to reproduce the vibration information at the receiving destination. Furthermore, it is difficult to properly reproduce the spatial location of vibrations and sounds that are actually perceived at the source location. In other words, there is a problem in that the accuracy of the localization position decreases and the sense of localization is unstable.

In view of the above problems, an object of the present invention is to provide a technique for reproducing vibrations with a high sense of localization using a small number of devices.

In order to solve the above problems, according to one aspect of the present invention, a vibration reproducing device reproduces vibration information acquired by a vibration information acquisition device. The vibration information acquisition device includes a plate-shaped first information presentation material, a vibration sensor attached near the center of gravity of the first information presentation material, and a vibration sensor attached to the first information presentation material so as to sandwich the vibration sensor therebetween. Contains two microphones, mounted in the same position. The vibration reproducing device includes an input section that receives vibration information acquired by a vibration sensor and two acoustic signals respectively picked up by two microphones, a plate-shaped second information presentation material, and a second information presentation material. A vibrator is attached near the center of gravity of the presentation material and vibrates according to the vibration information, and two vibrators are attached to the second information presentation material at opposite positions sandwiching the vibrator and reproduce two acoustic signals, respectively. including a speaker. The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material, and the two acoustic signals are transmitted between the two microphones. Playback is performed using two speakers located in positions corresponding to each other.

In order to solve the above problems, according to another aspect of the present invention, a vibration reproduction system includes a vibration information acquisition device and a vibration reproduction device. The vibration information acquisition device includes a plate-shaped first information presentation material, a vibration sensor attached near the center of gravity of the first information presentation material, and a vibration sensor attached to the first information presentation material so as to sandwich the vibration sensor therebetween. The device includes two microphones attached to positions where the sound is generated, an output unit that outputs vibration information acquired by the vibration sensor, and two acoustic signals respectively picked up by the two microphones. The vibration reproducing device includes an input section that receives vibration information and two acoustic signals as input, a plate-shaped second information presentation material, and is attached near the center of gravity of the second information presentation material. It includes a vibrating vibrator, and two speakers that are attached to opposite positions across the vibrator in the second information presentation material and reproduce two acoustic signals, respectively. The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material, and the two acoustic signals are transmitted between the two microphones. Playback is performed using two speakers located in positions corresponding to each other.

According to the present invention, it is possible to reproduce vibrations with a high sense of localization with a small number of devices.

FIG. 1 is a diagram showing a configuration example of a vibration regeneration system according to a first embodiment. FIG. 1 is a diagram showing a configuration example of an information transmission device according to a first embodiment. The figure which shows the example of the process flow of the vibration regeneration system based on 1st embodiment. The figure which shows the example of a structure of the computer to which this method is applied.

Embodiments of the present invention will be described below. In the drawings used in the following explanation, components having the same functions and steps that perform the same processing are denoted by the same reference numerals, and redundant explanation will be omitted.

<First embodiment>
FIG. 1 shows a configuration example of a vibration reproduction system according to the first embodiment. Here, a case where information is transmitted bidirectionally between point A and point B will be explained as an example.

The vibration reproduction system includes information transmission devices 100A and 100B, and the information transmission device 100A and the information transmission device 100B can communicate with each other via the network 10.

FIG. 2 shows an example of the configuration of information transmission devices 100A and 100B placed at points A and B, respectively.

The information transmission device 100A at point A includes one vibrator 110A, one vibration sensor 120A, a plate-shaped information presentation material 170A that transmits the vibration of the vibrator 110A, two speakers 131A and 132A, and two speakers 131A and 132A. It includes microphones 141A and 142A, an output section 150A, and an input section 160A.

Similarly, the information transmission device 100B at point B includes one vibrator 110B, one vibration sensor 120B, a plate-shaped information presentation material 170B that transmits the vibration of the vibrator 110B, and two speakers 131B and 132B. It includes two microphones 141B and 142B, an output section 150B, and an input section 160B.

The output section and the input section of the information transmission device are, for example, a special program loaded into a known or dedicated computer having a central processing unit (CPU), a main memory (RAM), etc. This is a special device configured with The input section is connected to two speakers and a vibrator placed on the information presentation material, and the output section is connected to two microphones and a vibration sensor placed on the information presentation material. The output section and input section of the information transmission device execute various processes under the control of, for example, a central processing unit. The data input to the output section and input section of the information transmission device and the data obtained through each process are stored in the main memory, for example, and the data stored in the main memory is transferred to the central processing unit as necessary. and used for other processing. Each processing section of the output section and the input section of the information transmission device may be configured at least in part by hardware such as an integrated circuit. Each storage unit included in the output unit and the input unit of the information transmission device can be configured by, for example, a main storage device such as a RAM (Random Access Memory), or middleware such as a relational database or a key-value store. However, each storage section does not necessarily have to include the output section and the input section of the information transmission device, but may be an auxiliary storage device composed of a hard disk, an optical disk, or a semiconductor memory element such as a flash memory. The information transmitting device may have a configuration and be provided outside the output section and input section of the information transmission device.

<Arrangement of each part>
The vibrator 110A is attached near the center of gravity of the information presentation material 170A. In other words, the vibrator 110A is attached at a position suitable for transmitting the vibrations generated by the vibrator 110A to the outside via the information presentation material 170A. The speakers 131A and 132A are arranged at opposite positions with the vibrator 110A sandwiched therebetween. For example, the speakers 131A and 132A are arranged at positions where the speakers 131A and 132A are line symmetrical with respect to the axis passing through the vibrator 110A. The microphones 141A, 142A are arranged near the speakers 131A, 132A so as to form a pair with the speakers 131A, 132A, respectively. Furthermore, the vibration sensor 120A is arranged near the vibrator 110A (near the center of gravity of the information presentation material 170A). In other words, the vibration sensor 120A is placed at a position suitable for sensing vibrations applied to the information presentation material 170A from the outside.

In addition, the arrangement of the vibrator 110A, vibration sensor 120A, speakers 131A, 132A, microphones 141A, 142A with respect to the information presentation material 170A of the information transmission device 100A at point A, and the vibration with respect to the information presentation material 170B of the information transmission device 100B at point B. It is preferable that the child 110B, the vibration sensor 120B, the speakers 131B, 132B, and the microphones 141B, 142B have the same or similar arrangement. With this arrangement, the positional relationship between the vibration sensor 120A and the microphones 141A, 142A in the information presentation material 170A and the positional relationship between the vibrator 110B and the speakers 131B, 132B in the information presentation material 170B are the same or similar. It becomes a relationship.

With such a configuration, the localization of transmitted information can be improved. Similarity here means that the positional relationship is similar. For example, even if the information presentation material 170A and the information presentation material 170B are different in size, the difference in size (difference in scale) is taken into account. This also includes cases where the microphone, speaker, vibrator, and vibration sensor are in a similar positional relationship.

<Information presentation material 170A>
The information presentation material 170A may be a flat plate as described in Non-Patent Document 1, or may be a plate-like material having a predetermined size and thickness and a material capable of transmitting vibrations such as plastic or glass instead of wood. Anything is fine. In short, the information presenting material 170A may be any material as long as it can transmit vibrations applied to the information presenting material 170A from the outside to the vibration sensor 120A and transmit vibrations generated by the vibrator 110A to the outside. The size of the information presentation material 170A may be designed according to the space in which information is to be transmitted or reproduced to a remote point.

The surface on which the recipient touches the information presentation material 170A and perceives vibration is the front surface, and FIG. The vibrator 110A may be attached to the surface of the information presentation material 170A as long as it does not interfere with the information presentation material 170A.

<Vibration sensor 120A>
The vibration sensor 120A detects vibrations transmitted to the information presentation material 170A from the outside, and outputs vibration information as a detection result. For example, the vibration information is an electrical signal indicating displacement, velocity, and acceleration of vibration.

<Vibrator 110A>
The vibrator 110A receives vibration information as input and vibrates according to the vibration information. For example, the vibrator 110A is composed of an actuator or the like.

<Output section 150A>
The output unit 150A transmits the two acoustic signals picked up by the microphones 141A and 142A and the vibration information acquired by the vibration sensor 120A to an information transmission device at another point (for example, information at point B) via the network 10. transmission device 100B).

<Input section 160A>
The input unit 160A receives as input two acoustic signals and vibration information transmitted from an information transmission device at another point (for example, the information transmission device 100B at point B) via the network 10, and inputs the two acoustic signals. It outputs to each speaker 131A, 132A, and outputs vibration information to vibrator 110A. For example, vibration information acquired by the vibration sensor 120B of the information transmission device 100B at point B is transmitted to the vibrator 110A, an acoustic signal picked up by the microphone 141B of the information transmission device 100B is transmitted to the speaker 131A, and a microphone 142B of the information transmission device 100B is transmitted to the speaker 131A. The collected acoustic signals are output to each speaker 132A.

<Processing example>
Using FIG. 3, specific processing will be described using an example in which the acoustic signal and vibration information acquired by the information transmission device 100A at point A are transmitted to the information transmission device 100B at point B and reproduced.

The microphones 141A and 142A of the information transmission device 100A collect sound and acquire acoustic signals (S1), and output the acquired acoustic signals to the output unit 150A at each time. The vibration sensor 120A acquires vibration information given to the information presentation material 170A (S2), and outputs the acquired vibration information at each time to the output unit 150A.

The output unit 150A outputs the acoustic signals acquired by the microphones 141A and 142A and the vibration information acquired by the vibration sensor 120A as signals for each channel, and outputs multi-channel time-series information, which is a collection of these signals, via the network 10. and transmits it to the information transmission device 100B at point B (S3).

The input unit 160B of the information transmission device 100B receives as input the multi-channel time series information sent from the output unit 150A of the information transmission device 100A (S4), and outputs it to the output device corresponding to each channel given in advance. do. Specifically, the vibration information of the channel corresponding to the vibration sensor 120A is sent to the vibrator 110B, the information (acoustic signal) of the channel corresponding to the microphone 141A is sent to the speaker 131B, and the information (acoustic signal) of the channel corresponding to the microphone 142A is sent to the speaker 131B. are output to the speakers 132B, respectively.

The vibrator 110B receives the vibration information and vibrates according to the vibration information (S5), and the two speakers 131B and 132B reproduce the received acoustic signals (S6).

<Effect>
With this configuration, it is possible to transmit vibration information with a high sense of localization using a small number of output devices, such as one vibrator and two speakers. This is because when the sounds collected by the two microphones 141A and 142A located at opposite positions with the vibrator 110A in between are reproduced from the corresponding speakers 131B and 132B in the information transmission device 100B as the transmission destination, each By reproducing the volume of the speakers 131B and 132B and the magnitude relationship of low frequencies (vibrations), the fixed position of the vibration presented from the vibrator 110B near the center of gravity is changed to the actual vibrator position (vibration generation position). ), which takes advantage of the effect of being perceived (illusioned) as being deviated from the image. Thereby, the vibration at point A can be reproduced including the spatial position at a different point B using a small number of vibrators 110B.

In this embodiment, since the information transmission apparatuses 100A and 100B have the same configuration, the information transmission apparatus 100B transmits acoustic signals and vibration information to the information transmission apparatus 100A using the same method, and the vibrations at point B are transmitted from the information transmission apparatus 100B to the information transmission apparatus 100A. can be reproduced, and bidirectional transmission is possible.

<Modified example>
In the case of one-way transmission, one of the information transmission devices (for example, the information transmission device 100A) does not need to include vibration output equipment (speakers and vibrators), and such information transmission devices are also referred to as vibration information acquisition devices. Further, the other information transmission device (for example, information transmission device 100B) does not need to include information acquisition equipment (microphone and vibration sensor), and such information transmission device is referred to as a vibration reproducing device.

Further, although the present embodiment shows the case of transmission between two points, the transmission may be extended to three or more points.

Furthermore, in this embodiment, vibrations are sensed at a certain point, the vibration information is transmitted to a remote location in real time, and the vibration information is reproduced at the remote location to reproduce the vibration at a certain point at the remote location. There is no need to process in real time. For example, the collected sound signal and the detected vibration information are stored in a recording medium, and the vibrations are reproduced at a different time from the time when the sound was collected and sensed using a vibration reproducing device placed at the same or a different location. You may.

For example, vibration information and acoustic signals acquired by a vibration information acquisition device may be stored in a server device and distributed in response to a request from a client device. At this time, the client device functions as a vibration reproducing device.

For example, a tablet PC can be used as a vibration reproducing device. In this case, the tablet PC includes an actuator that functions as a vibrator near the center of gravity of the tablet PC, and stereo speakers are provided at both ends of the entire casing of the tablet PC so as to sandwich the actuator. The entire casing of the tablet PC, including the touch panel, functions as an information presentation material. The tablet PC has a certain size so that it can be perceived (illusioned) as being deviated from the actual position of the actuator (vibration generation position) through stereo speaker playback.

<Other variations>
The present invention is not limited to the above-described embodiments and modifications. For example, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capacity of the device executing the process or as needed. Other changes may be made as appropriate without departing from the spirit of the present invention.

<Program and recording medium>
The processing of the output section and input section described above is performed by loading a program for executing each step of the above method into the storage section 2020 of the computer shown in FIG. It can be implemented by

A program describing the contents of this process can be recorded on a computer-readable recording medium. The computer-readable recording medium may be of any type, such as a magnetic recording device, an optical disk, a magneto-optical recording medium, or a semiconductor memory.

Further, this program is distributed by, for example, selling, transferring, lending, etc. a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, this program may be distributed by storing the program in the storage device of the server computer and transferring the program from the server computer to another computer via a network.

A computer that executes such a program, for example, first stores a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing a process, this computer reads a program stored in its own recording medium and executes a process according to the read program. In addition, as another form of execution of this program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and furthermore, the program may be transferred to this computer from the server computer. The process may be executed in accordance with the received program each time. In addition, the above-mentioned processing is executed by a so-called ASP (Application Service Provider) type service, which does not transfer programs from the server computer to this computer, but only realizes processing functions by issuing execution instructions and obtaining results. You can also use it as Note that the program in this embodiment includes information that is used for processing by an electronic computer and that is similar to a program (data that is not a direct command to the computer but has a property that defines the processing of the computer, etc.).

Further, in this embodiment, the present apparatus is configured by executing a predetermined program on a computer, but at least a part of these processing contents may be realized by hardware.

Claims (4)

A vibration reproducing device that reproduces vibration information acquired by a vibration information acquisition device,
The vibration information acquisition device includes a plate-shaped first information presentation material, a vibration sensor attached near the center of gravity of the first information presentation material, and a vibration sensor in the first information presentation material. Including two microphones installed at opposing positions,
The vibration reproducing device is
an input unit that receives as input vibration information acquired by the vibration sensor and two acoustic signals respectively picked up by the two microphones;
a plate-shaped second information presentation material;
a vibrator attached near the center of gravity of the second information presentation material and vibrating according to the vibration information;
The second information presentation material includes two speakers that are installed at opposing positions so as to sandwich the vibrator, and that reproduce the two acoustic signals, respectively;
The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material,
reproducing the two acoustic signals with the two speakers located in a positional relationship corresponding to the two microphones, respectively;
Vibration regenerator. A vibration regeneration system including a vibration information acquisition device and a vibration regeneration device,
The vibration information acquisition device includes:
a plate-shaped first information presentation material;
a vibration sensor attached near the center of gravity of the first information presentation material;
In the first information presentation material, two microphones are mounted at opposing positions so as to sandwich the vibration sensor;
an output unit that outputs vibration information acquired by the vibration sensor and two acoustic signals respectively picked up by the two microphones,
The vibration regenerator includes:
an input unit that receives the vibration information and the two acoustic signals as input;
a plate-shaped second information presentation material;
a vibrator attached near the center of gravity of the second information presentation material and vibrating according to the vibration information;
The second information presentation material includes two speakers that are installed at opposing positions so as to sandwich the vibrator, and that reproduce the two acoustic signals, respectively;
The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material,
reproducing the two acoustic signals with the two speakers located in a positional relationship corresponding to the two microphones, respectively;
Vibration playback system. A vibration regeneration method for reproducing vibration information acquired by a vibration information acquisition device using a vibration regeneration device, the method comprising:
The vibration information acquisition device includes a plate-shaped first information presentation material, a vibration sensor attached near the center of gravity of the first information presentation material, and a vibration sensor in the first information presentation material. Including two microphones installed at opposing positions,
The vibration reproducing device includes a plate-shaped second information presentation material, a vibrator attached near the center of gravity of the second information presentation material, and a vibrator sandwiched between the second information presentation material. two speakers mounted in positions relative to each other;
an input step in which the vibration reproducing device receives as input vibration information acquired by the vibration sensor and two acoustic signals respectively collected by the two microphones;
a reproduction step in which the vibrator vibrates according to the vibration information, and the two speakers reproduce the two acoustic signals, respectively;
The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material,
In the reproduction step, the two acoustic signals are reproduced by the two speakers located in a positional relationship corresponding to the two microphones, respectively.
Vibration reproduction method. A vibration regeneration method for reproducing vibration information acquired by a vibration information acquisition device using a vibration regeneration device, the method comprising:
The vibration information acquisition device includes a plate-shaped first information presentation material, a vibration sensor attached near the center of gravity of the first information presentation material, and a vibration sensor installed in the first information presentation material. Including two microphones installed at opposing positions,
The vibration reproducing device includes a plate-shaped second information presentation material, a vibrator attached near the center of gravity of the second information presentation material, and a vibrator sandwiched between the second information presentation material. two speakers mounted in positions relative to each other;
an acquisition step in which the two microphones collect sound and acquire two acoustic signals, and the vibration sensor acquires vibration information given to the first information presentation material;
an output step in which the vibration information acquisition device outputs the two acoustic signals and the vibration information;
an input step in which the vibration reproducing device receives the two acoustic signals and the vibration information as input;
a reproduction step in which the vibrator vibrates according to the vibration information, and the two speakers reproduce the two acoustic signals, respectively;
The positional relationship between the vibration sensor and the two microphones in the first information presentation material is similar to the positional relationship between the vibrator and the two speakers in the second information presentation material,
In the reproduction step, the two acoustic signals are reproduced by the two speakers located in a positional relationship corresponding to the two microphones, respectively.
Vibration reproduction method.

Images