JPH0833729B2 - Voice / performance information transmission system and transceiver - Google Patents

Description

Description: TECHNICAL FIELD The present invention relates to a voice / performance information transmission method and a transmission / reception device, and in particular, enables synchronous combination of digitally encoded voice information and compression-coded performance information. It is a thing.

[Prior Art] Conventionally, a method of collecting sound and transmitting (recording) it as an electric voice signal and reproducing an original sound by a speaker and the like, and extracting and transmitting (recording) performance information from a keyboard instrument such as a piano. , There is a method of reproducing the performance by driving the musical instrument again based on this information, but there was no suitable method of transmitting or recording / reproducing in synchronization with these two methods in relation to each other in time.

Conventionally, when it is attempted to reproduce audio information and performance information at the same time, it is necessary to reproduce them independently by using individual transmission media or recording media, so that both are precisely synchronized in time. I couldn't play it.

In particular, when the time information of the performance information is encoded and the information is compressed, the reproduction is performed with a time relationship different from the original time relationship, so that the synchronous reproduction with the audio information is completely impossible. In addition, it is expected that it will be very complicated to transmit (including recording / reproducing) the voice information and the performance information to be reproduced in synchronization with each other by using different transmission media (including a recording medium).

[Problems to be Solved by the Invention] An object of the present invention is to eliminate the above-mentioned problems and to use one transmission medium (including a recording medium) while maintaining the synchronization between voice information and performance information. Transmission (including recording / playback)
An object of the present invention is to provide a voice / performance information transmitting method and a transmitting / receiving device that can be performed.

[Means for Solving the Problems] In order to achieve such an object, in the present invention, the transmitting side transmits a signal obtained by mixing voice information and performance information via a transmission medium. Then, on the receiving side, in the voice / performance information transmitting method of separating / reproducing the voice information and the performance information from the received signal, the transmitter side encodes the voice information to extract the voice signal, The collected performance information is encoded to extract a performance signal, the encoded voice signal is delayed by a fixed time longer than the time required for the transmission / reception processing of the performance signal, and the encoded performance signal is delayed for a predetermined time. Segmented by intervals,
A block marker signal indicating a block number generated based on the timing of the division is generated, the block marker signal is added to the performance signal, and the segmented performance signal to which the block marker signal is added is an information amount. Converting to a compression code, generating a sync marker signal indicating a block number with reference to the timing, mixing the delayed voice signal, the compression code converted performance signal and the sync marker signal, and The signals arranged according to the format are transmitted through the transmission medium, the receiving side receives the signal transmitted through the transmission medium, and the audio signal, the performance signal and the synchronization marker are received from the received signal. The signal is separated, the block number is detected based on the sync marker signal, and the separated voice is detected. Signal is decoded, the separated performance signal is decoded in block units in accordance with the block number, and then decoded, and the decoded audio signal and the decoded performance signal are decoded. Is reproduced in synchronization with the block number.

The present invention further includes a first encoding means for encoding voice information to extract a voice signal, a second encoding means for encoding performance information collected from a musical instrument and extracting a performance signal, and the first encoding means. Delay means for delaying the voice signal extracted from the encoding means by a constant time longer than the time required for the transmission / reception processing of the performance signal, and the performance signal extracted from the second encoding means at predetermined time intervals. Segmented,
A segmentation means for adding a block marker signal indicating a block number generated based on the timing of the segmentation to the performance signal, and an information amount compression for the performance signal segmented by the segmentation means and to which the block marker signal is added. Compression code conversion means for code conversion, sync marker generation means for generating a sync marker signal indicating a block number based on the timing, an audio signal taken out from the delay means and a performance signal taken out from the compression means. And a synchronization marker signal generated from the synchronization marker generation means, arranged in accordance with a predetermined format, and arranged to transmit through the transmission medium.

Further, the present invention provides means for receiving a signal transmitted via a transmission medium, means for separating a voice signal, a performance signal and a sync marker signal from the received signal, and a block based on the sync marker signal. , A means for decoding the separated audio signal, a means for decoding the separated audio signal, and a decoding processing for the separated performance signal in block units according to the block number after inverse conversion of information amount compression code conversion. Means and means for reproducing the decoded voice signal and performance signal in synchronization with the block number.

Here, for example, the performance information is divided into blocks, a block timing signal is added, the block number is designated based on the signal, and this is used as a synchronization signal for data arrangement with the audio signal for transmission. To

[Operation] According to the present invention, a voice signal picked up by a microphone and a signal of performance information of an electric musical instrument can be efficiently transmitted or recorded at the same time. When receiving or reproducing, the voice signal and the performance are played. It is possible to reproduce in synchronization with the information signal.

[Examples] Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing the configuration on the transmission (recording) side of an embodiment according to the present invention.

In FIG. 1, 1 is a microphone for collecting sound,
2 is a voice PCM encoder. Reference numeral 3 is an electric musical instrument capable of electrically extracting performance information, and 4 is a MIDI encoder, which encodes performance information in accordance with the Musical Instrument Digital Interface (MIDI) standard.

Reference numeral 5 is a simultaneous recorder capable of simultaneously recording PCM signals and MIDI signals, 6 is a synchronous marker sending circuit, and 7 is a block marker adding circuit for MIDI signals.

Reference numeral 8 is a delay circuit, 9 is a performance information compression encoding circuit, and 10 is a data array circuit.

Next, the operation of each unit in this embodiment will be described with reference to FIG.

The sound picked up by the microphone 1 is input to the voice encoder 2 as a voice signal. PCM as the voice encoder 2
An audio digital encoder such as an encoder, a DPCM encoder, or a delta modulation encoder is used. An encoding clock is supplied from the timing generation circuit 88 to the voice encoder 2.

The musical instrument 3 is a musical instrument that is equipped with sensors such as electrical contacts, a photodetector, and a frequency detector, and can extract the pitch and length of the performance sound.
It is encoded by the encoder 4 and outputs a MIDI signal. This MIDI
The encoding clock is also supplied from the timing generation circuit 88 to the encoder 4.

A simultaneous recorder 5 capable of simultaneously recording a voice signal and performance information simultaneously records a digital voice signal output from the voice encoder 2 and a MIDI signal output from the MIDI encoder 4 if necessary.

When the musical instrument 3 is played, the playing sound or singing voice of the other musical instruments playing at the same time is acoustically separated from the playing sound of the musical instrument 3, and is picked up by the microphone 1.
Only the performance information from the performance of musical instrument 3 is recorded in microphone 1.
Other musical sounds or singing voices can be acoustically taken out as audio signals from.

The voice signal thus obtained from the microphone 1 is encoded by the voice encoder 2, and the output from the voice encoder 2 is sent to the delay circuit 8, while the output from the MIDI encoder 4 is sent to the block marker addition circuit 7. Supply each.

Once these output signals are recorded in the simultaneous recorder 5, the reproduced voice coded signal and MIDI coded signal are supplied to the delay circuit 8 and the block marker adding circuit 7, respectively. Further, the timing generating circuit 88 is connected to the synchronization marker sending circuit 6 and the block marker adding circuit 7.
From a block timing signal.

The sync marker sending circuit 6 generates a block number based on this timing signal and supplies it to the data array circuit 10 as a sync marker. The block marker addition circuit 7
Similarly, the block marker signal is added to the MIDI signal at the above timing, and the output is supplied to the compression encoding circuit 9.

The delay circuit 8 performs a delay operation for a fixed time that is at least the time obtained by adding the processing time in the decompression decoding circuit 16 on the receiving side, which will be described later, to the processing time in the compression encoding circuit 9.
If there is a delay in the operation of the musical instrument during reception or reproduction, the time corresponding to the delay time is also added.

The output of the delay circuit 8, that is, the audio data delayed by a fixed time and the performance data obtained by adding the block marker signal to the MIDI signal and performing compression encoding are supplied to the data array circuit 10. The data array circuit 10 performs data array and transmission so as to fit the transmission path or the recording medium 11.

FIG. 2 is a layout diagram showing the mutual relationship between the block timing signal and the voice PCM data and MIDI data according to the embodiment of the present invention.

FIG. 2A shows a block timing signal (indicated by an arrow) supplied from the timing generating circuit 88 to the block marker adding circuit 7. FIG. 2 (B) shows the corresponding audio PCM data signal, and FIG. 2 (C) shows that the block marker adding circuit 7 adds a timing marker signal to the MIDI data signal corresponding to the block timing signal. It shows the state of being performed.

FIGS. 3A and 3B are layout diagrams showing an example of each data signal array corresponding to a block number according to the present invention.

FIG. 3A shows a transmission data signal array on the transmission side. Corresponding to the transmission block number, the transmission voice data is given a predetermined delay time from the voice signal,
The MIDI signal is compressed and indicates that the blocks are intermittently arranged and transmitted as transmission performance data.

FIG. 4 is a block diagram showing the configuration of the receiving side of an embodiment according to the present invention.

In the figure, 11 is a data transmission path and 12 is a data separation circuit. Reference numeral 13 is a voice decoder, 14 is a performance data memory, and 15 is a sync marker receiving circuit. 16 is a decompression / decoding circuit for compressed performance information, 17 is a MIDI sending circuit, 18 is a loudspeaker,
19 is an electric musical instrument.

The data received or reproduced via the transmission line or the recording medium 11 is supplied to the data separation circuit 12, and the data separation circuit 12
The audio data and performance data are separated into sync markers including the block number, the audio data is supplied to the audio decoder 13, the performance data is supplied to the performance data memory 14, and the sync marker is supplied to the sync marker receiving circuit 15.

The voice decoder 13 decodes a voice signal from voice data and supplies it to the loudspeaker 18. The synchronization marker receiving circuit 15 detects the block number and supplies it to the decompression decoding circuit 16 and the MIDI transmission circuit 17.

The performance data memory 14 temporarily stores the data before the expansion decoding circuit 16 expands and decodes the performance information so that the expansion and decoding operation can be performed continuously in time.

The decompression / decoding circuit 16 extracts the performance data from the data memory 14 according to the block number, expands the performance data in block units, and supplies this to the MIDI sending circuit 17. The MIDI sending circuit 17 sends a MIDI signal in synchronization with the block number supplied from the synchronous marker receiving circuit 15.

The voice signal combined by the voice decoder 13 is reproduced by the loudspeaker 18. Also, the MIDI signal from the MIDI sending circuit 17 is supplied to the electric musical instrument 19 which meets the MIDI standard for performance.

FIG. 3 (B) shows an arrangement in which performance data and voice data are synchronized and sounded corresponding to the block number on the receiving side according to the present invention.

In this way, the audio signal and the performance information to be reproduced synchronously can be transmitted through one transmission path or the recording medium while compressing the performance information, and both can be reproduced in synchronization. .

Regarding the compression and decoding of the performance information, as the present inventors have already proposed in Patent Application 61-129720, based on the performance information extracted as a MIDI signal, the pitch of each performance sound unit, The basic method is to encode the strength and length and the timing of the sound as the difference information between the performance timing of the previous sound and the block marker signal added in the MIDI signal. It is handled and encoded as one event information. The block marker signal is removed during reproduction.

An example of application to satellite television broadcasting will be shown as an example in which voice and performance information are transmitted through one transmission path.

FIG. 5 is an array diagram of each signal in the B mode of the audio transmission frame in the satellite television broadcasting system.

In the figure, A is a sync code, B is a control code, C is a range code, E is voice data, F is unique data, G is each part of error control, and D is an undefined part. The undefined part D is
FIG. 6 shows the format of the sync marker signal and the performance data when the present invention is applied to the satellite television broadcasting system by utilizing 16 bits.

In the figure, I indicates an information bit, 5 bits, P indicates a check bit, 11 bits, and the information bit I and the check bit P form a BCH (16,5) error correction detection code. J is the channel of the synchronization marker signal, K
Is a performance information channel.

As is well known, since the voice transmission frame is transmitted at a rate of 1000 frames per second, the synchronization marker channel J is used.
Is 1000 bits / sec and channel K for performance information is 4000 bits / sec. Channel J of synchronization marker
Then, for example, a block number consisting of 0 to 15 is represented by 4 bits, and 1 delimiter bit is added to this and transmitted.

Further, since these channels JK and P are protected by the BCH code, even if the voice transmitted by the portion E shown in FIG. 5 is disturbed by the deterioration of C / N, the disturbance is subjective. The performance information can be reliably transmitted within the allowable range.

FIG. 7 is an array diagram of data bits in another embodiment of satellite television broadcasting.

In this embodiment, the voice may be transmitted in either the A mode or the B mode, and the synchronization marker and the performance information are data using extra bits not used in the voice transmission of the digital subcarrier of satellite television broadcasting. Transmission is carried out using a transmission method (so-called data channel: a provisional method was established in March 1986 by the Telecommunications Technology Council for this technical method).

FIG. 7 shows a packet of a data channel. SI ₁ and SI ₂ are service identifications, L is a transmission bit of a sync marker and performance information, and 16 16-bits each are arranged. M is an unused bit, L and M are information bits, and Q is a check bit to form a (256,174) shortened difference set cyclic code.
For each L, the synchronization marker and the performance information are arranged by the bit arrangement shown in FIG. 6 and transmitted.

The packets shown in FIG. 7 are transmitted at a rate of 1 per 9 mS (data channel superframe). Therefore, the transmission rates of the synchronization marker channel and the performance information channel are the same as those in the previous embodiment.

As yet another embodiment, an application example to a compact disc (CD) will be shown.

FIG. 8 is an array diagram of bits in a frame in the signal format of the compact disc.

In the CD signal format, 8 user bits (P, Q, R ...
W) is prepared.

By using 1 bit (for example, R) per frame for this user's bit, a capacity of 7350 bits / sec can be obtained, and this is used to transmit the above-mentioned synchronization marker and performance information.

Since the user's bit has no protection against errors, the 7th bit is set for a series of R bits of each frame.
Blocks corresponding to L, M and Q of the packet shown in the figure are formed, and similarly, (256,174) shortened difference set cyclic code is applied to protect against errors.

In CDs, there are concentrated errors that occur due to dust and scratches. Therefore, for the blocks described above, an interleaved array of appropriate length is performed to prevent error concentration in the blocks and to improve error correction capability. Improve.

[Effects of the Invention] As is apparent from the above, according to the present invention, it is possible to easily reproduce the voice and the electric performance of the musical instrument, which have been difficult in the past, in synchronization with each other.

Even if the musical performance information of the musical instrument is compressed and encoded, it can be synchronously coupled, so that it can be applied to satellite television broadcasting and a recording medium such as a compact disc.

Further, according to the present invention, since the performance information is coded in blocks, it is possible to reproduce without losing the synchronization between the voice and the performance information even if reception or reproduction is performed from the middle.

Since it can be transmitted or recorded / reproduced by one transmission path or recording medium, it is easy to handle and economical.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a transmitting side of an embodiment according to the present invention, FIG. 2 is an arrangement diagram of blocked timing signals of an embodiment according to the present invention, and FIGS. 3 (A) and 3 (B) are FIG. 4 is a block diagram showing the arrangement of the receiving side of one embodiment of the present invention, and FIG. 5 is the audio in the satellite television broadcasting system. 6 is an arrangement diagram of a transmission frame (B mode), FIG. 6 is an explanatory diagram of a sync and performance data signal format in another embodiment according to the present invention, and FIG. 7 is another embodiment in which the present invention is applied to satellite television broadcasting. FIG. 8 is an array diagram of the data of FIG. 8, and FIG. 8 is an array diagram showing the signal format of the compact disc. 1 ... Microphone, 2 ... Voice PCM encoder, 3,19 ...
… Electric musical instrument, 4 …… MIDI encoder, 5 …… Simultaneous recorder, 6
...... Synchronous marker sending circuit, 7 ...... Block marker adding circuit, 8 ...... Delay circuit, 9 ...... Compression coding circuit, 10 ...
… Data array circuit, 11 …… Transmission path, 12 …… Data separation circuit, 13 …… Voice decoder, 14 …… Performance data memory, 15…
… Synchronous marker receiving circuit, 16 …… Expansion decoding circuit, 17…
… MIDI sending circuit, 18 …… Loudspeaker, 88 …… Timing generating circuit.

Claims (3)

[Claims] 1. A transmission side transmits a signal obtained by mixing voice information and performance information via a transmission medium, and a reception side separates the voice information and the performance information from the received signal. In the voice / performance information transmitting method for reproducing, on the transmitting side, the voice information is encoded to extract a voice signal, the performance information collected from a performance musical instrument is encoded to extract a performance signal, and the encoded voice signal is reproduced. Is delayed by a fixed time longer than the time required for transmitting and receiving the performance signal, the encoded performance signal is segmented at predetermined time intervals, and a block marker indicating a block number generated based on the timing of the segmentation. A signal is generated, the block marker signal is added to the performance signal, the segmented and block marker signal-added performance signal is used as information To a quantity compression code, generate a sync marker signal indicating a block number with reference to the timing, mix the delayed audio signal, the compression code converted performance signal and the sync marker signal, and The signal arranged according to the format is transmitted through the transmission medium, and the receiving side receives the signal transmitted through the transmission medium, and synchronizes the audio signal and the performance signal from the received signal. A marker signal is separated, the block number is detected based on the synchronization marker signal, the separated audio signal is decoded, and the separated performance signal is compressed in blocks according to the block number. And then decodes the decoded voice signal and the decoded performance signal in synchronization with the block number. A method for transmitting voice / performance information, which is characterized in that the information is reproduced by playing. 2. A first encoding means for encoding voice information to extract a voice signal, a second encoding means for encoding performance information collected from a musical instrument and extracting a performance signal, the first encoding means. Delay means for delaying the voice signal extracted from the encoding means by a fixed time longer than the time required for transmitting and receiving the performance signal; and the performance signal extracted from the second encoding means at predetermined time intervals. Partitioning means for adding a block marker signal indicating a block number generated based on the timing of the partitioning to the performance signal; and a performance signal partitioned by the partitioning means and having the block marker signal added thereto. Compression code conversion means for converting information amount compression code, and a synchronization marker for generating a synchronization marker signal indicating a block number based on the timing Generating means, mixing the audio signal taken out from the delay means, the performance signal taken out from the compression means, and the sync marker signal generated from the sync marker generating means, and arranging them according to a predetermined format, A transmitting device, comprising: an arranging means for transmitting via a transmission medium. 3. A means for receiving a signal transmitted via a transmission medium, a means for separating a voice signal, a performance signal and a sync marker signal from the received signal, and a block number based on the sync marker signal. Means for detecting the separated audio signal, means for decoding the separated audio signal, means for decoding the separated performance signal in block units according to the block number, after inverse conversion of information amount compression code conversion A receiving device comprising means for reproducing the decoded voice signal and performance signal in synchronization with the block number.