JP6668503B2 - Voice data transfer method, voice data transfer system and receiving device - Google Patents

Description

  The present invention relates to a method and a system for transferring audio data.

  As a protocol for transferring audio data, an RTP / RTCP (Real-time Transport Protocol / RTP Control Protocol) protocol used on UDP (User Datagram Protocol) is known. In the UDP protocol of the transport layer including the RTP protocol, there is no function of guaranteeing the integrity of data transfer by data retransmission or the like unlike TCP, in order to improve data transfer efficiency.

  For example, Japanese Patent Application Laid-Open Publication No. HEI 11-64131 discloses a technique for preventing data loss even when a failure occurs on a communication path and realizing fault-tolerant data transfer. In Patent Literature 1, a transmission device divides transmission data into a plurality of pieces, generates parity data from actual data of the transmission data, and transmits the parity data through different communication paths. Then, in the receiving device, when the divided real data or the real data is lost on the communication path, the data restored from the parity data is combined and transferred to the subsequent device.

JP-A-2005-149647

  However, the state of the communication path is not always bad, and it is conceivable that actual data communication is performed stably and parity data is not used. In this case, there is a problem in that the calculation of the parity data that is not actually used and the transmission of the parity data cause pressure on the network band, and the network resources are constantly wasted.

  Therefore, the present invention has been made in view of the above problems, and controls the necessity of transmission of parity data according to the transfer state of audio data, thereby minimizing audio disturbance due to deterioration of the communication state. It is another object of the present invention to provide a voice data transfer system capable of reducing the consumption of network resources.

The present invention relates to a transmitting device including a processor and a memory, a receiving device including a processor and a memory, a first communication path , a second communication path, and a third communication path connecting the transmitting device and the receiving device. A voice data transfer method for transmitting voice data between the transmitting device and the receiving device, wherein the transmitting device generates a plurality of divided data obtained by dividing the voice data, and the first communication A first step of transmitting the divided data via a path and a second communication path , respectively, and the receiving device stores the divided data received from the first communication path and the second communication path in the memory, respectively. And a third step of determining whether the receiving apparatus is in the data transmission mode for restoration or the data suspension mode for restoration. The receiving apparatus further comprises: A fourth step of determining whether or not the divided data stored in the memory is missing; and if the divided data stored in the memory has no loss, the receiving apparatus combines the divided data to form the audio data. A fifth step of restoring and outputting data; and if the receiving apparatus is in the restoration data stop mode and the divided data stored in the memory has a defect, the audio data restored immediately before A sixth step of supplementing and outputting the audio data as substitute data , and the receiving apparatus monitors the reception state of the divided data, and when the reception state satisfies a predetermined start condition, Shifting to a data transmission mode and requesting the transmitting device to start transmission of the data for restoration. When requested a transmission start generates a recovery data of the divided data includes transmitting from the third communication path, said second step, said recovered received from the third communication path Storing the data for use in the memory when the receiving device is in the data transmission mode for restoration and the divided data stored in the memory has a defect. An eighth step of restoring and outputting audio data from the data and the divided data;
including.

  According to the present invention, it is not always necessary to ensure the integrity of voice data in the transfer of voice data for the purpose of human recognition of voice data. By controlling the necessity of transmitting the restoration data (parity data) in this way, it is possible to minimize the disturbance of the voice due to the deterioration of the communication quality and reduce the consumption of network resources.

BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a block diagram illustrating an example of a voice data transfer system according to an embodiment of the present invention. FIG. 6 is a sequence diagram illustrating an example of the present invention and illustrating an example of communication processing of audio data performed in the audio data transfer system. 5 is a flowchart illustrating an example of the present invention and illustrating an example of a data combining process performed by the receiving device. 6 is a flowchart illustrating an example of the present invention and illustrating an example of a data compensation process performed by the receiving device. 6 is a flowchart illustrating an example of the present invention and illustrating an example of a path control process performed by the receiving device. 6 is a flowchart illustrating an example of the present invention and illustrating an example of a mode control process performed by the receiving device.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a block diagram illustrating an embodiment of the present invention and an example of a voice data transfer system. The audio data transfer system includes a transmitting device 1 that transmits divided data obtained by dividing audio data, a receiving device 2 that combines and outputs the divided audio data (divided data), and an independent network 3 that transfers the divided data. -1, 3-2 and an independent network 3-3 for transferring the parity data DP generated by the transmitting device 1 according to the communication state. The networks 3-1 to 3-3 are configured with different communication paths. Note that, for all pairs of networks, reference numeral “3”, in which “-” and thereafter are omitted, is used. The same applies to the reference numerals of the other components.

  The transmission device 1 includes a processor 11 for performing arithmetic processing, a memory 12 for storing programs and data, a network I / F (interface) unit 13 connected to the network 3, and an I / F unit 14 for receiving audio data. including.

  The memory 12 includes a data dividing unit 110 that generates divided data D1 and D2 obtained by dividing audio data as described later, and a restoration data generation that generates parity data DP of the divided data in response to a request from the receiving device 2. The unit 120 is loaded and executed by the processor 11.

  Each functional unit of the data division unit 110 and the restoration data generation unit 120 is loaded into the memory 12 as a program. The processor 11 operates as a function unit that provides a predetermined function by processing according to a program of each function unit. For example, the processor 11 functions as the data division unit 110 by performing processing according to a data division program. The same applies to other programs. Further, the processor 11 also operates as a functional unit that provides each function of a plurality of processes executed by each program. The computer and the computer system are devices and systems including these functional units.

  Information such as programs and tables for realizing the functions of the data division unit 110 and the restoration data generation unit 120 is stored in a storage device such as a storage, a non-volatile semiconductor memory, a hard disk drive, an SSD (Solid State Drive), or an IC. It can be stored in a computer-readable non-transitory data storage medium such as a card, an SD card, and a DVD.

  The receiving device 2 includes a processor 21 for performing arithmetic processing, a memory 22 for storing programs and data, a network I / F (interface) unit 23 connected to the network 3, and an I / F unit 24 for outputting audio data. And

  In the memory 22, a reception buffer 210 for temporarily storing the received divided data D1 and D2 and the parity data DP is set. The memory 22 includes a data combining unit 220 that combines the divided data of the reception buffer 210 as described later, and data that generates supplementary data when the divided data is missing and requests transmission of parity data to be started. A compensating unit 230, a path control unit 240 that detects a reception state and requests transmission or stop of parity data according to the reception state, and a restoration data control that requests the transmission apparatus 1 to start or stop transmission of parity data. The unit 250 is loaded and executed by the processor 21.

  Each functional unit of the data combining unit 220, the data supplementing unit 230, the route control unit 240, and the restoration data control unit 250 is loaded into the memory 22 as a program. The processor 21 operates as a functional unit that provides a predetermined function by performing processing according to a program of each functional unit. For example, the processor 21 functions as the data combining unit 220 by performing processing according to a data combining program. The same applies to other programs. Further, the processor 21 also operates as a functional unit that provides each function of a plurality of processes executed by each program. The computer and the computer system are devices and systems including these functional units.

  Information such as a program and a table for realizing each function of the data combining unit 220 to the restoration data control unit 250 is stored in a storage device such as a storage, a nonvolatile semiconductor memory, a hard disk drive, a SSD (Solid State Drive), or an IC card. , An SD card, a DVD, or other computer-readable non-transitory data storage medium.

  The reception buffer 210 stores the divided data received from the network 3-1; the reception buffer 210-2 stores the divided data received from the network 3-2; A reception buffer 210-3 for storing parity data.

  The I / F unit 14 of the transmission device 1 receives audio data from a device (not shown). The data division unit 110 divides the audio data received by the I / F unit 14 into divided data D1 and divided data D2, and outputs the divided data to the network I / F unit 13 and the restoration data generation unit 120.

  The data division unit 110 assigns a sequence number obtained by adding a predetermined increment value to each received audio data, and assigns the same sequence number (or ID) to the divided data D1 and D2 and the parity data DP.

  When there is a transmission request of the parity data DP from the receiving device 2, the restoration data generation unit 120 generates the parity data DP of the divided data D1 and D2 and outputs the parity data DP to the network I / F unit 13 as described later. I do.

  The network I / F unit 13 transmits the divided data D1 and D2 and the parity data DP from different networks 3-1 to 3-3, respectively. However, when the parity data DP is not generated, the network I / F unit 13 transmits the divided data D1 and D2 from the networks 3-1 and 3-2, respectively. In this embodiment, an example is shown in which the divided data D1, D2 and the parity data DP are transmitted by UDP.

  In the receiving device 2, the network I / F unit 23 transmits the divided data D1 and D2 and the parity data DP received from the plurality of communication paths (networks 3-1 to 3-3) to the reception buffers 210-1 to 210-3. Store each.

  The data combining unit 220 combines the divided data D1 and D2 having the same sequence number, restores the audio data, generates audio data, and outputs the audio data to the I / F unit 24 and the data supplementing unit 230.

  When at least one of the divided data D1 and D2 is lost and the parity data DP having the same sequence number as that of the audio data is present in the reception buffer 210-3, the data combining unit 220 outputs the parity data DP and the divided data. The audio data is restored and output to the I / F unit 24 and the data compensation unit 230.

  The data supplementing unit 230 holds the restored audio data as the immediately preceding (previous) audio data. When at least one of the divided data D1 and D2 is missing and there is no parity data DP, the data supplementing unit 230 generates supplemented data.

  The supplementary data generated by the data supplementing unit 230 can substitute, for example, previously restored audio data as data restored this time. However, when the data supplementing unit 230 generates supplementary data for a predetermined number of times (for example, 100 times) or more within a predetermined time (for example, several tens of seconds), the reception state satisfies a predetermined start condition and deteriorates. And requests the restoration data control unit 250 to start transmission of parity data. It should be noted that the substitute restoration data is not limited to the previous audio data, and a known or well-known method such as silent data can be used.

  The path control unit 240 monitors the reception state of the reception buffer 210 and, when detecting the deterioration of the reception state or a sign of a failure, requests the restoration data control unit 250 to start transmission of parity data. When the reception state is improved (recovered), the path control unit 240 requests the restoration data control unit 250 to stop transmitting the parity data.

  The path control unit 240 according to the present embodiment monitors the amount of data received within a predetermined time for each of the reception buffers 210-1 and 210-2, and fluctuates the data amount within a predetermined time (for example, 1 second) ( (Reception fluctuation) is calculated, and a reception state is determined by comparing the reception fluctuation with a preset threshold value.

  The path control unit 240 compares the amount of data in the reception buffers 210-1 and 210-2 within a predetermined time period with two preset threshold values (however, first threshold value <second threshold value). It is determined that the reception state has deteriorated when the amount of data in the area becomes less than the first threshold. In this case, it can be estimated that the data amount within a predetermined time has decreased due to the occurrence of a failure in the communication network 3-1 or 3-2.

  In addition, when the data amount within the predetermined time exceeds the second threshold, the route control unit 240 detects a deterioration of the reception state or a sign of a failure. In this case, it can be estimated that the data temporarily stays due to a failure in the network 3-1 or 3-2 of the communication path, and that the staying data is transferred at a stretch.

  When the fluctuation of the data amount within a predetermined time exceeds the range between the first threshold value and the second threshold value, the transmission quality of the networks 3-1 and 3-2 deteriorates (or a sign of the deterioration). ) Can be detected, and the possibility that the divided data D1 and D2 become a burst loss (a state in which packets are continuously lost) increases. For this reason, by transmitting the transmission start request of the parity data to the restoration data control unit 250, the route control unit 240 can suppress the deterioration of the audio data.

  In addition, after the reception state has once deteriorated, if the reception state in which the data amount within the predetermined time is equal to or more than the first threshold and equal to or less than the second threshold elapses again for a predetermined period (for example, several tens of seconds), the route control unit 240 , It can be determined that the reception state has been restored (improved). In this case, by transmitting a request to stop transmission of parity data to the restoration data control unit 250, the path control unit 240 can reduce consumption of resources of the audio data transfer system.

  By the above processing, the receiving apparatus 2 requests the transmitting apparatus 1 to start transmission of parity data when detecting the deterioration of the receiving state (a sign of deterioration), and transmits the parity data to the transmitting apparatus 1 when the receiving state improves. Request a stop. Further, by transferring the divided data D1 and D2 and the parity data DP via different networks 3-1 to 3-3, redundancy of audio data transfer can be achieved.

  FIG. 2 is a sequence diagram illustrating an example of audio data communication processing performed in the audio data transfer system. First, the transmitting device 1 transmits the divided data D1 and D2 obtained by dividing the audio data to the receiving device 2 (S1).

  The receiver 2 shifts to the parity data transmission mode when the divided data D1 and D2 are lost and cannot be compensated, or when the reception state is deteriorated (increase in reception fluctuation) (S2). S3) A transmission start request of the parity data is transmitted to the transmission device 1 (S4).

  Upon receiving the parity data transmission start request, the transmission device 1 shifts to the parity data transmission mode (S5), and starts generating and transmitting the parity data DP (S6).

  When there is no loss of the divided data D1 and D2 for a certain period of time and when the receiving apparatus 2 detects an improvement in the reception state (reduction of fluctuation) (S7), the receiving apparatus 2 shifts to the parity data stop mode (S8). ), A transmission stop request of the parity data is transmitted to the transmission device 1 (S9).

  When the transmission device 1 receives the request to stop transmission of parity data (S10), it shifts to the parity data stop mode, stops generation and transmission of parity data DP, and generates and transmits divided data D1 and D2 ( S11).

  The receiving apparatus 2 has two criteria for determining transition to the parity transmission mode. One is a case in which the receiving device 2 cannot combine the divided data D1 and D2, and performs data compensation more than a predetermined number of times (threshold of frequency, for example, 100 times) within a fixed time (several tens of seconds). . The other is a case where the receiving apparatus 2 detects an excessive change in the amount of data in the receiving buffer 210.

  If a packet loss occurs at a certain probability in the communication path networks 3-1 and 3-2, the probability that the receiving apparatus 2 cannot combine the divided data is the sum of the two communication paths. By starting the transmission of the parity data, the quality of the audio data can be maintained.

  Further, if the fluctuation of the data reception amount in one communication path (networks 3-1 and 3-2) increases, it is a sign of deterioration of the quality of the communication path, and there is a possibility that packets may be burst-lossed. By starting the transmission of the parity data, it is possible to suppress a rapid deterioration of the voice quality.

  FIG. 3 is a flowchart illustrating an example of the data combining process performed by the data combining unit 220 of the receiving device 2. This process is executed at a predetermined cycle (for example, several tens msec).

  The data combining unit 220 identifies the divided data D1 and D2 to be combined next by the sequence number, and acquires data from the respective reception buffers 210-1 and 210-2 (S21). The sequence number is calculated by adding a predetermined value to the previous sequence number.

  The data combining unit 220 determines whether or not the divided data D1 and D2 to be combined are aligned in the reception buffers 210-1 and 210-2 (S22). If the divided data D1 and D2 are available, the process proceeds to step S26, and the data combining unit 220 combines the divided data D1 and D2 to restore the audio data. The restored audio data is recorded as the immediately preceding audio data in the data supplementing unit 230, and transmitted from the I / F unit 24 to a subsequent device (not shown) (S27).

  On the other hand, when the divided data D1 and D2 are not arranged in the reception buffer 210, the data combining unit 220 determines whether or not the parity data DP has been received (S23). If the parity data DP corresponding to the sequence number exists in the reception buffer 210-3, the data combining unit 220 proceeds to step S25, and if not, proceeds to step S24.

  When the parity data DP has been received, the data combining unit 220 restores the missing divided data D1 and D2 from the other received divided data and the parity data DP (S25). Thereafter, the data combining unit 220 restores the audio data using the divided data restored in step S25 (S26).

  Then, as described above, the restored audio data is recorded as the immediately preceding audio data by the data supplementing unit 230 and output from the I / F unit 24.

  On the other hand, when the divided data D1 and D2 are not prepared and the parity data DP is not received, the data combining unit 220 determines that the data is missing and notifies the data compensating unit 230 of the missing data. In this case, the output of the audio data to the subsequent device is not performed.

  FIG. 4 is a flowchart illustrating an example of the data compensation processing performed by the data compensation unit 230 of the receiving device 2. This process is executed after step S24 in FIG.

  The data compensation unit 230 determines whether data loss has been detected (S31). That is, if the data supplementing unit 230 receives the notification of the data loss from the data combining unit 220, the data supplementing unit 230 determines that the data combining unit 220 has detected the data loss, and proceeds to step S32. Proceed to S36.

  When the data loss is detected, the data supplementing unit 230 replaces the audio data restored immediately before as the audio data of the current sequence number (S32), and transmits it to the I / F unit 24 (S33). Next, the data compensation unit 230 determines whether or not the data compensation has been performed a predetermined number of times (for example, 100 times) or more within a fixed time (for example, several tens of seconds) (S34).

  When data has been supplemented a predetermined number of times (frequency threshold) within a certain period of time, the data supplementing unit 230 determines that the state of the communication path (networks 3-1 and 3-2) has deteriorated, and It requests the restoration data control unit 250 to shift to the transmission mode, resets the number of data supplements, and ends the processing (S35).

  On the other hand, if the data supplement has not been performed a predetermined number of times or more within the fixed time, the data supplementing unit 230 increments the data supplement number and ends the process.

  If no data loss has been detected in the determination in step S31, the data supplementing unit 230 determines whether data loss has been detected within a predetermined time (S36). If no data loss has been detected within a certain period of time, the data compensation unit 230 determines that a predetermined stop condition has been satisfied, and shifts to a parity data stop mode. Therefore, the data supplementing unit 230 requests the restoration data control unit 250 to shift to the parity data stop mode, resets the number of times of data supplementation, and ends the processing (S37).

  According to the above processing, if data has been compensated a predetermined number of times or more within a certain period of time, the frequency of the data compensation becomes equal to or greater than a predetermined compensation threshold, and the reception state deteriorates. Is satisfied, and requests the restoration data control unit 250 to shift to the parity data transmission mode.

  If no data loss has been detected for a certain period of time, the data supplementing unit 230 determines that the predetermined stop condition has been satisfied, and requests the restoration data control unit 250 to shift to the parity stop mode. Note that, when detecting data loss within a predetermined time, the data compensation unit 230 does not shift to the parity data stop mode and maintains the parity data transmission mode.

  The audio data does not necessarily need to be completely restored, and if it is restored to some extent, the user on the receiving side can estimate the audio data based on the contents of the preceding and following audio data. That is, in the audio streaming transfer, it is not always necessary to ensure the integrity of the transferred audio data.

  Therefore, the receiving device 2 detects the loss of data and then performs a process of compensating for data with the immediately preceding audio data, so that it is not always necessary to request a transmission request of parity data that is data for restoration. As a result, the transmitting device 1 can reduce the number of transmissions of the parity data, so that unnecessary communication can be reduced.

  Note that, if the data loss is not detected within a certain time, the receiving device 2 requests the restoration data control unit 250 to shift to the parity data stop mode. Thus, after the transmission quality of the communication path is recovered, the transmission of the parity data is stopped, so that the resource consumption of the audio data transfer system can be reduced.

  FIG. 5 is a flowchart illustrating an example of a route control process performed by the route control unit 240 of the reception device 2. This process is executed at a predetermined cycle (for example, one second).

  The path control unit 240 calculates a data amount (reception fluctuation) within a predetermined time (for example, 1 second) for each of the reception buffers 210-1 and 210-2, and calculates two thresholds (first threshold <first threshold). 2 threshold). If the reception fluctuation is equal to or more than the first threshold and equal to or less than the second threshold, the path control unit 240 determines that the reception state is normal, and otherwise determines that an abnormality (a sign of failure) is detected.

  If the reception state is normal, the path control unit 240 determines that the predetermined stop condition is satisfied, proceeds to step S42, and requests the restoration data control unit 250 to stop transmission of parity data. On the other hand, if the reception state is abnormal (or a sign of a failure) (if the reception state is deteriorated by satisfying the predetermined start condition), the path control unit 240 proceeds to step S43, and the restoration data control unit 250 Request transmission start.

  Note that, in the above description, an example in which the reception fluctuation is determined by comparing the reception fluctuations with the two thresholds is described. However, the reception state may be determined only by the first threshold. In this case, if the data amount (reception fluctuation) within the predetermined time is less than the first threshold (fluctuation threshold), the route control unit 240 determines that the predetermined start condition is satisfied, and determines that the predetermined start condition is satisfied. If there is, it is determined that a predetermined stop condition is satisfied.

  FIG. 6 is a flowchart illustrating an example of a mode control process performed by the restoration data control unit 250 of the receiving device 2. This process is executed at a predetermined cycle (for example, one second).

  The restoration data control unit 250 determines whether or not the current mode is the parity data transmission mode. If the current mode is the parity data transmission mode, the process proceeds to step S52; if the current mode is the parity data stop mode, the process proceeds to step S55.

  In step S52 of the parity data transmission mode, the restoration data control unit 250 determines whether a request to stop the parity data has been received from both the path control unit 240 and the data compensation unit 230, and a request to stop the parity data has been received from both. Is received, the process proceeds to step S53. Otherwise, the process is terminated while maintaining the parity data transmission mode.

  In step S53, the restoration data control unit 250 transmits a transmission stop request of the parity data to the transmission device 1. Then, in step S54, the restoration data control unit 250 shifts to the parity data stop mode and ends the processing.

  On the other hand, if the current mode is the parity data stop mode, in step S55, it is determined whether a request to start transmission of parity data has been received from one of the path control unit 240 and the data compensation unit 230. If the transmission start request of the parity data has been received, the process proceeds to step S56; otherwise, the process ends while maintaining the parity data stop mode.

  In step S56, the restoration data control unit 250 transmits a transmission start request of the parity data to the transmission device 1. Then, in step S57, the restoration data control unit 250 shifts to the parity data transmission mode and ends the processing.

  With the above processing, the restoration data control unit 250 receives the request to start or stop the transmission of the parity data from the data compensation unit 230 and the path control unit 240, and sets the parity data mode based on a preset criterion. Control. That is, when the restoration data control unit 250 receives a transition to the parity transmission mode from one of the path control unit 240 and the data compensation unit 230, the restoration data control unit 250 transitions to the parity transmission mode. On the other hand, the restoration data control unit 250 shifts to the parity data stop mode when receiving the shift to the parity data stop mode from both the path control unit 240 and the data compensation unit 230.

  According to the above control, when a deterioration of the reception state or a sign of a failure is detected, the mode is immediately shifted to the parity data transmission mode, and loss of audio data is suppressed. The parity data transmission mode can be maintained until the reception state is stabilized by reducing the frequency of data supplementation and shifting to the parity data stop mode after the reception state returns to normal.

  The audio data does not necessarily need to be completely restored, and if it is restored to some extent, the user on the receiving side can estimate the audio data based on the contents of the preceding and following audio data. In the transfer of audio data, it is not always necessary to ensure the integrity of the audio data.

  Therefore, in the present embodiment, data loss of the divided data D1 and D2 is detected, and when there is no data for restoration (parity data), the immediately preceding audio data is substituted for the restored data, so that the data for restoration is not necessarily required. It is not necessary to send a parity transmission request. This allows the transmitting device 1 to reduce the number of times parity data is transmitted, thereby reducing unnecessary communication.

  When the reception state is monitored and the reception state satisfies a predetermined condition and deteriorates (when the frequency of data loss increases or a deterioration of the reception state or a sign of a failure is detected), transmission of the restoration data is performed. It requests the transmission device 1 to start, shifts to the parity data transmission mode, restores the audio data from the parity data, and secures the quality of the audio data. Then, the frequency of data compensation is reduced, and the mode is shifted to the parity data stop mode after the reception state is restored to normal, so that the consumption of resources of the audio data transfer system can be reduced.

  Note that the present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-described embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described above. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of one embodiment can be added to the configuration of another embodiment. In addition, for a part of the configuration of each embodiment, addition, deletion, or replacement of another configuration can be applied alone or in combination.

  In addition, each of the above-described configurations, functions, processing units, processing means, and the like may be partially or entirely realized by hardware, for example, by designing an integrated circuit. In addition, the above-described configurations, functions, and the like may be implemented by software by a processor interpreting and executing a program that implements each function. Information such as a program, a table, and a file for realizing each function can be stored in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

  In addition, control lines and information lines are shown as necessary for the description, and do not necessarily indicate all control lines and information lines on a product. In fact, it can be considered that almost all components are connected to each other.

Claims (14)

A transmitting device including a processor and a memory, a receiving device including a processor and a memory, a first communication path , a second communication path, and a third communication path connecting the transmitting device and the receiving device; An audio data transfer method for transferring audio data between the transmitting device and the receiving device,
A first step in which the transmitting device generates a plurality of divided data obtained by dividing audio data, and transmits the divided data via the first communication path and the second communication path , respectively;
A second step in which the receiving device stores the divided data received from the first communication path and the second communication path in the memory, respectively;
A third step in which the receiving device determines which of a data transmission mode for restoration and a data suspension mode for restoration;
A fourth step in which the receiving device determines whether or not the divided data stored in the memory is missing;
A fifth step of, when the receiving device has no loss in the divided data stored in the memory, combining the divided data and restoring and outputting the audio data;
When the receiving device is in the restoration data stop mode and the divided data stored in the memory has a defect, the sound data restored immediately before is used as substitute data to supplement the audio data and output. The sixth step,
The receiving apparatus monitors the reception state of the divided data, and when the reception state satisfies a predetermined start condition, shifts to the restoration data transmission mode and requests the transmission apparatus to start transmission of restoration data. A seventh step of:
The first step is
When receiving a request to start transmission of restoration data from the receiving device, the method includes generating restoration data of the divided data and transmitting the restoration data from a third communication path,
The second step is
Storing the restoration data received from the third communication path in a memory,
The receiving apparatus, in the restoration data transmission mode, and when there is a defect in the divided data stored in the memory, restores audio data from the restoration data and the divided data stored in the memory. An eighth step of outputting
A voice data transfer method comprising: The audio data transfer method according to claim 1, wherein
When the receiving device is in the restoration data transmission mode and the reception state satisfies a predetermined stop condition, the receiving device shifts to the restoration data stop mode and requests the transmission device to stop transmission of the restoration data. A voice data transfer method, further comprising a ninth step of: The audio data transfer method according to claim 1, wherein
The seventh step is:
If the frequency of supplementing the audio data with the substitute data is equal to or higher than a predetermined frequency threshold, it is determined that the reception state satisfies a predetermined start condition. The audio data transfer method according to claim 2, wherein
The ninth step is:
If the substitute data does not supplement the audio data within a predetermined time, it is determined that the reception state satisfies a predetermined stop condition. The audio data transfer method according to claim 1, wherein
The seventh step is:
If the data amount of the divided data stored in the memory within a predetermined time is less than a predetermined fluctuation threshold, it is determined that the reception state satisfies a predetermined start condition. The audio data transfer method according to claim 2, wherein
The ninth step is:
When the data amount of the divided data stored in the memory within a predetermined time is equal to or greater than a predetermined fluctuation threshold, it is determined that the reception state satisfies a predetermined stop condition. The audio data transfer method according to claim 1, wherein
The seventh step is:
If the frequency of supplementing the audio data with the substitute data is equal to or greater than a predetermined frequency threshold, or if the data amount of the divided data stored in the memory within a predetermined time is less than a predetermined fluctuation threshold, the reception state Is determined to satisfy a predetermined start condition. The audio data transfer method according to claim 2, wherein
The ninth step is:
If the audio data is not supplemented with the substitute data within a predetermined time, and if the data amount of the divided data stored in the memory within a predetermined time is equal to or larger than a predetermined fluctuation threshold, the reception state is set to a predetermined value. And determining that the stop condition is satisfied. A transmitting device including a processor and a memory, a receiving device including a processor and a memory, a first communication path , a second communication path, and a third communication path connecting the transmitting device and the receiving device; An audio data transfer system that transfers audio data between the transmitting device and the receiving device,
The transmission device,
A data dividing unit that generates a plurality of divided data obtained by dividing the audio data;
When requested to start transmission of restoration data from the receiving device, a restoration data generation unit that generates restoration data of the divided data,
A network interface unit that transmits the divided data and the restoration data via the first communication path , the second communication path, and the third communication path , respectively.
The receiving device,
A network interface unit that stores the divided data and the restoration data received from the first communication path , the second communication path, and the third communication path in the memory,
It is determined whether there is any loss in the divided data stored in the memory, and if there is no loss in the divided data stored in the memory, the divided data is combined and the audio data is restored and output. It is determined whether the mode is the data transmission mode or the restoration data stop mode. If the restoration data transmission mode is used and the divided data stored in the memory has a defect, the data is stored in the memory. A data combining unit that restores and outputs audio data from the restored data and the divided data,
The restore data halt mode, and if there is a defect in the divided data stored in said memory, a data interpolator for outputting audio data restored just prior to compensate for the audio data as a substitute data,
A path control unit that monitors a reception state of the divided data and determines whether the reception state satisfies a predetermined start condition;
When the reception state satisfies a predetermined start condition, a restoration data control unit that shifts to the restoration data transmission mode and requests the transmission device to start transmission of restoration data.
An audio data transfer system comprising: The audio data transfer system according to claim 9, wherein
The restoration data control unit includes:
In the restoration data transmission mode, and when the reception state satisfies a predetermined stop condition, the mode shifts to the restoration data stop mode, and requests the transmission device to stop transmission of restoration data. Voice data transfer system. The audio data transfer system according to claim 9, wherein
The restoration data control unit includes:
If the frequency of supplementing the audio data with the substitute data is equal to or greater than a predetermined frequency threshold, or if the data amount of the divided data stored in the memory within a predetermined time is less than a predetermined fluctuation threshold, the reception state Is determined to satisfy a predetermined start condition. The audio data transfer system according to claim 10, wherein
The restoration data control unit includes:
If the audio data is not supplemented with the substitute data within a predetermined time, and if the data amount of the divided data stored in the memory within a predetermined time is equal to or larger than a predetermined fluctuation threshold, the reception state is set to a predetermined value. A voice data transfer system, which determines that the stop condition is satisfied. A receiving device for receiving audio data including a processor and a memory,
A network interface unit that receives the divided data and the restoration data received from the first communication path , the second communication path, and the third communication path, and stores the data in the memory;
It is determined whether there is any loss in the divided data stored in the memory, and if there is no loss in the divided data stored in the memory, the divided data is combined and the audio data is restored and output. It is determined whether the mode is the data transmission mode or the restoration data stop mode. If the restoration data transmission mode is used and the divided data stored in the memory has a defect, the data is stored in the memory. A data combining unit that restores and outputs audio data from the restored data and the divided data,
The restore data halt mode, and if there is a defect in the divided data stored in said memory, a data interpolator for outputting audio data restored just prior to compensate for the audio data as a substitute data,
A route control unit that monitors a reception state of the divided data and determines whether the reception state satisfies a predetermined start condition;
When the reception state satisfies a predetermined start condition, a restoration data control unit that requests the start of transmission of restoration data by shifting to the restoration data transmission mode,
A receiving device comprising: The receiving device according to claim 13,
The restoration data control unit includes:
Wherein in restoration data transmission mode, and, when said reception state satisfies a predetermined stop condition, and wherein the requesting the transmission stop of the recovery data to the migration to transmit device to the restoration data stop mode Receiving device.

Images