EP3103116B1 - Extension ameliorée de bande de fréquence dans un décodeur de signaux audiofréquences - Google Patents
Extension ameliorée de bande de fréquence dans un décodeur de signaux audiofréquences Download PDFInfo
- Publication number
- EP3103116B1 EP3103116B1 EP15705687.0A EP15705687A EP3103116B1 EP 3103116 B1 EP3103116 B1 EP 3103116B1 EP 15705687 A EP15705687 A EP 15705687A EP 3103116 B1 EP3103116 B1 EP 3103116B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- band
- decoded
- frequency
- extension
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K3/00—Apparatus for stamping articles having integral means for supporting the articles to be stamped
- B41K3/54—Inking devices
- B41K3/56—Inking devices using inking pads
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/02—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with one or more flat stamping surfaces having fixed images
- B41K1/04—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with one or more flat stamping surfaces having fixed images with multiple stamping surfaces; with stamping surfaces replaceable as a whole
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/08—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with a flat stamping surface and changeable characters
- B41K1/10—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with a flat stamping surface and changeable characters having movable type-carrying bands or chains
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/08—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with a flat stamping surface and changeable characters
- B41K1/12—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor with a flat stamping surface and changeable characters having adjustable type-carrying wheels
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/36—Details
- B41K1/38—Inking devices; Stamping surfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/36—Details
- B41K1/38—Inking devices; Stamping surfaces
- B41K1/40—Inking devices operated by stamping movement
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41K—STAMPS; STAMPING OR NUMBERING APPARATUS OR DEVICES
- B41K1/00—Portable hand-operated devices without means for supporting or locating the articles to be stamped, i.e. hand stamps; Inking devices or other accessories therefor
- B41K1/36—Details
- B41K1/38—Inking devices; Stamping surfaces
- B41K1/40—Inking devices operated by stamping movement
- B41K1/42—Inking devices operated by stamping movement with pads or rollers movable for inking
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0212—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using orthogonal transformation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/21—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being power information
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/26—Pre-filtering or post-filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
Definitions
- the present invention relates to the field of coding / decoding and processing of audio-frequency signals (such as speech, music or other signals) for their transmission or their storage.
- audio-frequency signals such as speech, music or other signals
- the invention relates to a method and a frequency band extension device in a decoder or a processor performing an audio-frequency signal improvement.
- Classical coding methods for conversational applications are generally classified into waveform coding (PCM for "Pulse Modulation and Coding", ADPCM for “Pulse Modulation and Adaptive Differential Coding", transform coding, etc.) , parametric coding (LPC for "Linear Predictive Coding” in English, sinusoidal coding 7) and hybrid parametric coding with a quantization of the parameters by "analysis by synthesis” including CELP coding (for "Code Excited Linear Prediction” in English) is the best known example.
- the limitation of the coded band of the AMR-WB codec to 7kHz is essentially linked to the fact that the transmission frequency response of the wideband terminals was approximated at the time of standardization (ETSI / 3GPP then UIT- T) according to the frequency mask defined in standard ITU-T P.341 and more precisely by using a so-called "P341" filter defined in standard ITU-T G.191 which cuts frequencies above 7 kHz (this filter respects the mask defined in P.341).
- the 3GPP AMR-WB speech codec was standardized in 2001 primarily for circuit mode (CS) telephony applications over GSM (2G) and UMTS (3G). This same codec was also standardized in 2003 at the ITU-T as recommendation G.722.2 "Wideband coding speech at around 16kbit / s using Adaptive Multi-Rate Wideband (AMR-WB)".
- the principle of band extension in the AMR-WB codec is quite rudimentary. Indeed, the high band (6.4-7 kHz) is generated by shaping a white noise through a temporal envelope (applied in the form of gains per subframe) and frequency (by the application of a linear prediction synthesis filter or LPC for "Linear Predictive Coding").
- This tape extension technique is illustrated in figure 1 .
- correction information is transmitted by the AMR-WB encoder and decoded (blocks 107, 108) in order to refine the estimated gain per subframe (4 bits every 5ms, i.e. 0.8 kbit / s) .
- the AMR-WB decoding algorithm was improved in part with the development of the scalable ITU-T G.718 codec which was standardized in 2008.
- the ITU-T G.718 standard includes a so-called interoperable mode, for which the core coding is compatible with the G.722.2 (AMR-WB) coding at 12.65 kbit / s; moreover, the G.718 decoder has the particularity of being able to decode an AMR-WB / G.722.2 bit stream at all the possible bit rates of the AMR-WB codec (from 6.6 to 23.85 kbit / s).
- the interoperable G.718 decoder in low delay mode (G.718-LD) is illustrated on figure 2 .
- the band extension (described for example in clause 7.13.1 of recommendation G.718, block 206) is identical to that of the AMR-WB decoder, except that the 6-7 kHz bandpass filter and the synthesis 1 / AHB (z) (blocks 111 and 112) are in reverse order.
- the 4 bits transmitted by sub-frames by the AMR-WB encoder are not used in the interoperable G.718 decoder; the synthesis of high frequencies (HF) at 23.85 kbit / s is therefore identical to 23.05 kbit / s which avoids the known problem of quality of AMR-WB decoding at 23.85 kbit / s.
- HF high frequencies
- the 7 kHz low-pass filter (block 113) is not used, and the specific decoding of the 23.85 kbit / s mode is omitted (blocks 107 to 109).
- a 16 kHz synthesis post-processing (see clause 7.14 of G.718) is implemented in G.718 by "noise gate” in block 208 (to “improve” the quality of the silences by reducing the level) , high-pass filtering (block 209), low-frequency post-filter (called “ bass posfilter ”) in block 210 attenuating inter-harmonic noise at low frequencies and conversion to 16-bit integers with saturation control (with control gain or AGC) in block 211.
- band extension in the AMR-WB and / or G.718 codecs is still limited in several aspects.
- the synthesis of high frequencies by shaped white noise is a very limited model of the signal in the band of frequencies above 6.4 kHz.
- ABET Audio Bandwidth Extension Toolkit
- ASR Accurate Spectral Replacement
- FSSM Fractal Self Similarity Model
- MBTAC Multi-Band Temporal Amplitude Amplitude Coding. Coding
- the present invention improves the situation.
- the invention proposes a method for extending the frequency band of an audio-frequency signal during a decoding or improvement process comprising a step of obtaining the decoded signal in a first frequency band called the low band.
- the method is as it comprises the steps of claim 1.
- band extension will be taken in the broad sense and will include not only the case of the extension of a sub-band at high frequencies but also the case of a replacement of sub-bands placed. to zero (of the “noise filling” type in transform coding).
- both the taking into account of tonal components and of a surround signal extracted from the signal resulting from the decoding of the low band makes it possible to carry out the band extension with a signal model adapted to the true nature of the sound. signal unlike the use of artificial noise.
- the quality of the band extension is thus improved and in particular for certain types of signals such as music signals.
- the decoded signal in the low band includes a part corresponding to the sound environment which can be transposed to high frequency so that a mixing of the harmonic components and the existing environment makes it possible to ensure a reconstructed high band. consistent.
- the band extension is performed in the field of excitation and the decoded low band signal is a decoded low band excitation signal.
- the advantage of this embodiment is that a transformation without windowing (or equivalently with an implicit rectangular window of the length of the frame) is possible in the field of the excitation. In this case no artifact (block effects) is then audible.
- this control factor allows the combining step to adapt to the characteristics of the signal to optimize the relative proportion of surround signal in the mixture.
- the energy level is thus controlled so as to avoid audible artifacts.
- the decoded low-band signal undergoes a step of decomposition into sub-bands by transform or by bank of filters, the extraction and combination steps then being carried out in the frequency domain or in sub-bands.
- the implementation of the band extension in the frequency domain makes it possible to obtain a precision of frequency analysis which is not available with a temporal approach, and also makes it possible to have a frequency resolution sufficient to detect the tonal components. .
- this function includes a resampling of the signal by adding samples to the spectrum of this signal.
- Other ways of extending the signal are however possible, for example by translation in a sub-band processing.
- the present invention also relates to a device for extending the frequency band of an audiofrequency signal, the signal having been decoded in a first frequency band called the low band.
- the device is such that it comprises the characteristics of claim 6.
- This device has the same advantages as the method described above, which it implements.
- the invention relates to a decoder comprising a device as described.
- the invention relates to a storage medium, readable by a processor, integrated or not into the tape extension device, possibly removable, storing a computer program implementing a tape extension method as described above.
- the figure 3 illustrates an example of a decoder, compatible with the AMR-WB / G.722.2 standard in which there is a post-processing similar to that introduced in G.718 and described with reference to figure 2 and an improved tape extension according to the extension method of the invention, implemented by the tape extension device illustrated by block 309.
- CELP decoding (BF for low frequencies) always operates at the internal frequency of 12.8 kHz, as in AMR-WB and G.718, and the band extension (HF for high frequencies) which is the subject of the invention operates at the frequency of 16 kHz, the LF and HF syntheses are combined (block 312) at the frequency fs after adequate resampling (blocks 307 and 311).
- the combination of the low and high bands can be done at 16 kHz, after having resampled the low band from 12.8 to 16 kHz, before resampling the combined signal at the frequency fs .
- This example of a decoder operates in the field of excitation and therefore comprises a step of decoding the low band excitation signal.
- the band extension device and the band extension method within the meaning of the invention also operate in a field different from the field of excitation and in particular with a direct signal decoded in low band or a signal weighted by a filter. perceptual.
- the decoder described allows the decoded low band to be extended (50-6400 Hz taking into account the high-pass filtering at 50 Hz at the decoder, 0-6400 Hz in the general case ) to an extended band whose width varies, ranging from approximately 50-6900 Hz to 50-7700 Hz depending on the mode implemented in the current frame.
- the excitation for the high frequencies is generated in the frequency domain in a band from 5000 to 8000 Hz, to allow band-pass filtering of width 6000 to 6900 or 7700 Hz, the slope of which is not too steep in the upper rejected band.
- the high band synthesis part is carried out in block 309 representing the band extension device according to the invention and which is detailed at figure 5 in one embodiment.
- a delay (block 310) is introduced to synchronize the outputs of blocks 306 and 309 and the high band synthesized at 16 kHz is resampled from 16 kHz to the frequency fs (output of block 311).
- the extension method of the invention implemented in block 309 according to the first embodiment preferentially does not introduce any additional delay with respect to the low band reconstructed at 12.8 kHz; however, in variants of the invention (for example using a time / frequency transformation with overlap), a delay may be introduced.
- the low and high bands are then combined (added) in block 312 and the synthesis obtained is post-processed by high-pass filtering at 50 Hz (IIR type) of order 2, the coefficients of which depend on the frequency fs (block 313) and output post-processing with optional application of the "noise gate” similar to G.718 (block 314).
- the band extension device according to the invention illustrated by the block 309 according to the embodiment of the decoder of the figure 5 , implements a band extension method (in the broad sense) described now with reference to figure 4 .
- This extension device can also be independent of the decoder and can implement the method described in figure 4 to perform a band extension of an existing audio signal stored or transmitted to the device, with an analysis of the audio signal to extract, for example, an excitation and an LPC filter.
- This device receives as input a decoded signal in a first frequency band called the low band u ( n ) which may be in the field of excitation or in that of the signal.
- a step of decomposition into sub-bands (E401b) by time-frequency transform or bank of filters is applied to the decoded low-band signal to obtain the spectrum of the decoded low-band signal U ( k ) for a setting. implemented in the frequency domain.
- a step E401a of extending the low-band decoded signal into a second frequency band greater than the first frequency band, to obtain an extended low-band decoded signal U HB 1 ( k ), can be performed on this decoded low-band signal before or after the analysis step (decomposition into sub-bands).
- This extension step can include both a resampling step and an extension step or simply a frequency translation or transposition step as a function of the signal obtained at the input. It will be noted that in variants, step E401a could be carried out at the end of the processing described in figure 4 ,, that is to say on the combined signal, this processing then being mainly carried out on the low band signal before extension, the result being equivalent.
- a step E402 of extracting a surround signal ( U HBA ( k )) and tonal components (y (k)) is performed from the decoded ( U ( k )) or decoded and extended ( U HB 1 ( k )) .
- the ambience is defined here as the residual signal which is obtained by removing the main (or dominant) harmonics (or tonal components) from the existing signal.
- the high band (> 6 kHz) contains surround information which is generally similar to that present in the low band.
- step E403 The tonal components and the surround signal are then adaptively combined using energy level control factors in step E403 to obtain a so-called combined signal ( U HB2 ( k )).
- the extension step E401a can then be implemented if it has not already been performed on the decoded low band signal.
- the combination of these two types of signals makes it possible to obtain a combined signal with characteristics more suited to certain types of signals such as musical signals and richer in frequency content and in the extended frequency band corresponding to the entire frequency band. frequency including the first and the second frequency band.
- the band extension according to the method improves the quality for this type of signals compared to the extension described in the AMR-WB standard.
- a synthesis step which corresponds to the analysis in 401b, is performed in E404b to bring the signal back into the time domain.
- a step of adjusting the energy level of the high band signal can be carried out in E404a, before and / or after the synthesis step, by applying a gain and / or by suitable filtering. This step will be explained in more detail in the embodiment described in section figure 5 for blocks 501 to 507.
- the tape extender 500 is now described with reference to figure 5 illustrating both this device but also processing modules suitable for implementation in a decoder of the interoperable type with AMR-WB coding.
- This device 500 implements the band extension method described above with reference to the figure 4 .
- the processing block 510 receives a decoded low band signal ( u ( n )).
- the band extension uses the excitation decoded at 12.8 kHz (exc2 or u ( n )) at the output of block 302 of the figure 3 .
- This signal is broken down into frequency sub-bands by the sub-band decomposition module 510 (which implements step E401b of the figure 4 ) which generally performs a transform or applies a bank of filters, to obtain a decomposition into sub-bands U (k) of the signal u ( n ) .
- a transformation without windowing (or equivalently with an implicit rectangular window of the length of the frame) is possible when the processing is carried out in the domain of the excitation, and not the domain of the signal. In this case, no artifact (block effects) is audible, which constitutes an important advantage of this embodiment of the invention.
- the DCT-IV transformation is implemented by FFT according to the so-called “Evolved DCT (EDCT)” algorithm described in the article by DM Zhang, HT Li, A Low Complexity Transform - Evolved DCT, IEEE 14th International Conference on Computational Science and Engineering (CSE), Aug. 2011, pp. 144-149 , and implemented in ITU-T G.718 Annex B and G.729.1 Annex E.
- EDCT Evolved DCT
- the DCT-IV transformation can be replaced by other short-term time-frequency transformations of the same length and in the field of excitation or in the field of the signal, like an FFT (for "Fast Fourier Transform” in English ) or a DCT-II ( Discrete Cosine Transform - Type II).
- FFT Fast Fourier Transform
- DCT-II Discrete Cosine Transform - Type II
- MDCT for "Modified Discrete Cosine Tranform” in English
- the delay T in the block 310 of the figure 3 should be adjusted (reduced) adequately as a function of the additional delay due to the analysis / synthesis by this transform.
- the decomposition into sub-bands is carried out by applying a bank of filters, for example of the real or complex PQMF (Pseudo-QMF) type.
- a bank of filters for example of the real or complex PQMF (Pseudo-QMF) type.
- PQMF Pseudo-QMF
- the preferred embodiment in the invention can be applied by performing for example a transform of each sub-band and by calculating the ambient signal in the domain of absolute values, the tonal components always being obtained by difference between the signal (in absolute value) and the surround signal.
- the complex modulus of the samples will replace the absolute value.
- the invention will be applied in a system using two sub-bands, the low band being analyzed by transform or by bank of filters.
- Block 511 implements step E401a of figure 4 , that is to say the extension of the decoded low band signal.
- the original spectrum is preserved, in order to be able to apply a progressive attenuation response of the high-pass filter to it in this frequency band and also not to introduce audible defects. during the step of adding the low frequency synthesis to the high frequency synthesis.
- the generation of the oversampled extended spectrum is carried out in a frequency band ranging from 5 to 8 kHz therefore including a second frequency band (6.4-8 kHz) greater than the first frequency band. (0-6.4 kHz).
- the extension of the decoded low band signal takes place at least over the second frequency band but also over part of the first frequency band.
- the 6000-8000 Hz band of U HB 1 ( k ) is defined here by copying the 4000-6000 Hz band of U (k) since the value of start_band is preferably set at 160.
- start_band could be made adaptive around the value of 160, without modifying the nature of the invention.
- the details of the adaptation of the start_band value are not described here because they go beyond the scope of the invention without changing its scope.
- the high band (> 6 kHz) contains surround information which is naturally similar to that present in the low band.
- the ambience is defined here as the residual signal which is obtained by removing the main (or dominant) harmonics from the existing signal. Harmonicity level in the 6000-8000 Hz band generally correlates with that of the lower frequency bands.
- This decoded and extended low-band signal is supplied at the input of the extension device 500 and in particular at the input of the module 512.
- the block 512 for extracting tonal components and a surround signal implements the step E402 of the figure 4 in the frequency domain.
- this ambient signal can be extracted from a low frequency signal or possibly another frequency band (or several frequency bands). The detection of peaks or tonal components can be done differently. The extraction of this ambient signal could also be done on the decoded excitation but not extended, that is to say before the step of spectral extension or translation, that is to say for example on a portion of the low frequency signal rather than directly on the high frequency signal.
- the absolute value of the spectral values will be replaced, for example the square of the spectral values, without changing the principle of the invention; in this case a square root will be necessary to return to the signal domain, which is more complex to achieve.
- the combining module 513 performs a combining step by adaptive mixing of the surround signal and the tonal components.
- an energy level control factor is calculated based on the total energy of the decoded (or decoded and extended) low band signal and tonal components.
- ⁇ makes it possible to avoid an overestimation of the energy.
- ⁇ is calculated so as to keep the same level of the ambient signal with respect to the energy of the tonal components in the consecutive bands of the signal.
- N ( k 1 , k 2 ) is the set of indices k for which the coefficient of index k is classified as being associated with the tonal components. This set can be for example obtained by detecting the local peaks in U ' ( k ) verifying
- the calculation of ⁇ may be replaced by other methods.
- we can extract (calculate) various parameters (or “features” in English) characterizing the signal in low band, including a “tilt” parameter similar to that calculated in the AMR-WB codec, and we will estimate the postman ⁇ as a function of a linear regression from these different parameters by limiting its value between 0 and 1.
- the linear regression can for example be estimated in a supervised way by estimating the factor ⁇ by giving the original high band in a base d 'learning. It will be noted that the method of calculating ⁇ does not limit the nature of the invention.
- ⁇ and ⁇ are possible within the framework of the invention.
- the block 501 in a particular embodiment optionally performs a double operation of applying the band-pass filter frequency response and de-emphasis (or de-emphasis) filtering ) in the frequency domain.
- the de-emphasis filtering can be carried out in the time domain, after block 502 or even before block 510; however, in this case, the bandpass filtering performed in block 501 may leave some low frequency components of very low levels which are amplified by de-emphasis, which may slightly noticeably alter the decoded low band. For this reason, it is preferred here to carry out the de-emphasis in the frequency domain.
- ⁇ k can be adjusted (for example for even frequencies).
- the HF synthesis is not de-emphasized.
- the high-frequency signal is on the contrary de-emphasized so as to bring it back into a domain coherent with the low-frequency signal (0-6.4 kHz) which leaves block 305 of the figure 3 . This is important for the estimation and subsequent adjustment of the energy of the HF synthesis.
- the de-emphasis may be performed in an equivalent manner in the time domain after reverse DCT.
- bandpass filtering is applied with two separate parts: one fixed high pass, the other adaptive low pass (rate dependent).
- This filtering is performed in the frequency domain.
- the band-pass filtering can be adapted by defining a single filtering step combining the high-pass and low-pass filtering.
- the band-pass filtering could be performed in an equivalent manner in the time domain (as in block 112 of the figure 1 ) with different filter coefficients depending on the flow, after a reverse DCT step.
- it is advantageous to carry out this step directly in the frequency domain because the filtering is carried out in the domain of the LPC excitation and therefore the problems of circular convolution and of edge effects are very limited in this domain. .
- the block 502 carries out the synthesis corresponding to the analysis carried out in the block 510.
- the signal sampled at 16 kHz is then optionally scaled by gains defined by subframe of 80 samples (block 504).
- block 503 differs from that of block 101 of figure 1 , because the energy at the level of the current frame is taken into account in addition to that of the sub-frame. This makes it possible to have the ratio of the energy of each sub-frame compared to the energy of the frame. We therefore compare energy ratios (or relative energies) rather than absolute energies between low band and high band.
- this scaling step makes it possible to keep the energy ratio between the sub-frame and the frame in the high band in the same way as in the low band.
- Blocks 505 and 506 are useful for adjusting the level of the LPC synthesis filter (block 507), here as a function of the tilt of the signal. Other methods of calculating the gain g HB 2 ( m ) are possible without changing the nature of the invention.
- this filtering could be carried out in the same way as what is described for block 111 of the figure 1 of the AMR-WB decoder, however, the order of the filter changes to 20 at the rate of 6.6, which does not significantly change the quality of the synthesized signal.
- the LPC synthesis filtering could be carried out in the frequency domain, after having calculated the frequency response of the filter implemented in the block 507.
- the encoding of the low band (0-6.4 kHz) could be replaced by a CELP encoder other than that used in AMR-WB, such as for example the CELP encoder in G.718 to 8 kbit / s.
- a CELP encoder other than that used in AMR-WB, such as for example the CELP encoder in G.718 to 8 kbit / s.
- other wideband encoders or encoders operating at frequencies above 16 kHz in which the low band encoding operates at an internal frequency of 12.8 kHz could be used.
- the invention can obviously be adapted to sampling frequencies other than 12.8 kHz, when a low frequency encoder operates at a sampling frequency lower than that of the original or reconstructed signal.
- the low-band decoding does not use linear prediction, there is no excitation signal to extend, in this case an LPC analysis of the signal reconstructed in the current frame can be performed and an LPC excitation will be calculated. so as to be able to apply the invention
- the excitation or the low band signal ( u ( n )) is resampled, for example by linear interpolation or cubic "spline", of 12.8 to 16 kHz before transformation (for example DCT-IV) of length 320.
- This variant has the drawback of being more complex, because the transform (DCT-IV) of the excitation or of the signal is then calculated on a larger length and resampling is not performed in the transform domain.
- the figure 6 shows an exemplary hardware embodiment of a tape extension device 600 according to the invention. This can be an integral part of an audio-frequency signal decoder or of equipment receiving audio-frequency signals, whether or not decoded.
- This type of device comprises a processor PROC cooperating with a memory block BM comprising a storage and / or working memory MEM.
- a device comprises an input module E capable of receiving a decoded or extracted audio signal in a first frequency band called the low band brought back to the frequency domain ( U ( k )) . It comprises an output module S capable of transmitting the extension signal in a second frequency band ( U HB 2 ( k )) for example to a filtering module 501 of the figure 5 .
- the memory block can advantageously comprise a computer program comprising code instructions for the implementation of the steps of the band extension method within the meaning of the invention, when these instructions are executed by the processor PROC, and in particular the steps extracting (E402) tonal components and a surround signal from a signal from the decoded low-band signal ( U ( k )) , combining (E403) tonal components (y (k)) and the surround signal (U HBA ( k )) by adaptive mixing using energy level control factors to obtain an audio signal, called the combined signal ( U HB 2 ( k )), of extension (E401a) on at least a second frequency band greater than the first frequency band of the low-band decoded signal before the extraction step or of the combined signal after the combining step.
- the description of the figure 4 repeats the steps of an algorithm of such a computer program.
- the computer program can also be stored on a memory medium readable by a reader of the device or downloadable in the memory space of the latter.
- the memory MEM generally records all the data necessary for the implementation of the method.
- the device thus described can also include the low-band decoding functions and other processing functions described for example in figure 5 and 3 in addition to the band extension functions according to the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Stereophonic System (AREA)
- Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
Priority Applications (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP17206567.4A EP3330967B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| SM20210395T SMT202100395T1 (it) | 2014-02-07 | 2015-02-04 | Estensione migliorata di banda di frequenza in un decodificatore si segnali ad audiofrequenza |
| SI201531646T SI3103116T1 (sl) | 2014-02-07 | 2015-02-04 | Izboljšana razširitev frekvenčnega pasu v dekoderju zvočnega signala |
| EP17206569.0A EP3327722B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| RS20210945A RS62160B1 (sr) | 2014-02-07 | 2015-02-04 | Poboljšana ekstenzija frekvencijskog opsega u dekoderu audio frekventnih signala |
| DK17206563.3T DK3330966T3 (da) | 2014-02-07 | 2015-02-04 | Forbedret udvidelse af frekvensbånd i en dekoder for audiofrekvenssignaler |
| EP17206563.3A EP3330966B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| HRP20211187TT HRP20211187T1 (hr) | 2014-02-07 | 2015-02-04 | Poboljšana ekstenzija frekvencijskog opsega u dekoderu audio frekventnih signala |
| PL15705687T PL3103116T3 (pl) | 2014-02-07 | 2015-02-04 | Ulepszone rozszerzanie pasma częstotliwości w dekoderze sygnałów o częstotliwości akustycznej |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR1450969A FR3017484A1 (fr) | 2014-02-07 | 2014-02-07 | Extension amelioree de bande de frequence dans un decodeur de signaux audiofrequences |
| PCT/FR2015/050257 WO2015118260A1 (fr) | 2014-02-07 | 2015-02-04 | Extension ameliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
Related Child Applications (6)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17206563.3A Division EP3330966B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206563.3A Division-Into EP3330966B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206569.0A Division EP3327722B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206569.0A Division-Into EP3327722B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206567.4A Division EP3330967B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206567.4A Division-Into EP3330967B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3103116A1 EP3103116A1 (fr) | 2016-12-14 |
| EP3103116B1 true EP3103116B1 (fr) | 2021-05-05 |
Family
ID=51014390
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP15705687.0A Active EP3103116B1 (fr) | 2014-02-07 | 2015-02-04 | Extension ameliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206563.3A Active EP3330966B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206569.0A Active EP3327722B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206567.4A Active EP3330967B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
Family Applications After (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17206563.3A Active EP3330966B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206569.0A Active EP3327722B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
| EP17206567.4A Active EP3330967B1 (fr) | 2014-02-07 | 2015-02-04 | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
Country Status (22)
| Country | Link |
|---|---|
| US (5) | US10043525B2 (sr) |
| EP (4) | EP3103116B1 (sr) |
| JP (4) | JP6625544B2 (sr) |
| KR (5) | KR102380205B1 (sr) |
| CN (4) | CN105960675B (sr) |
| BR (2) | BR122017027991B1 (sr) |
| DK (2) | DK3103116T3 (sr) |
| ES (4) | ES2978878T3 (sr) |
| FI (1) | FI3330966T3 (sr) |
| FR (1) | FR3017484A1 (sr) |
| HR (2) | HRP20211187T1 (sr) |
| HU (2) | HUE062979T2 (sr) |
| LT (2) | LT3103116T (sr) |
| MX (2) | MX363675B (sr) |
| PL (4) | PL3103116T3 (sr) |
| PT (2) | PT3103116T (sr) |
| RS (2) | RS64614B1 (sr) |
| RU (4) | RU2763848C2 (sr) |
| SI (2) | SI3103116T1 (sr) |
| SM (2) | SMT202100395T1 (sr) |
| WO (1) | WO2015118260A1 (sr) |
| ZA (4) | ZA201606173B (sr) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6082126B2 (ja) * | 2013-01-29 | 2017-02-15 | フラウンホーファーゲゼルシャフト ツール フォルデルング デル アンゲヴァンテン フォルシユング エー.フアー. | 音声信号を合成するための装置及び方法、デコーダ、エンコーダ、システム及びコンピュータプログラム |
| FR3017484A1 (fr) | 2014-02-07 | 2015-08-14 | Orange | Extension amelioree de bande de frequence dans un decodeur de signaux audiofrequences |
| EP2980794A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder and decoder using a frequency domain processor and a time domain processor |
| EP3382703A1 (en) * | 2017-03-31 | 2018-10-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and methods for processing an audio signal |
| TWI684368B (zh) * | 2017-10-18 | 2020-02-01 | 宏達國際電子股份有限公司 | 獲取高音質音訊轉換資訊的方法、電子裝置及記錄媒體 |
| EP3518562A1 (en) | 2018-01-29 | 2019-07-31 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio signal processor, system and methods distributing an ambient signal to a plurality of ambient signal channels |
| IL313348B2 (en) * | 2018-04-25 | 2025-08-01 | Dolby Int Ab | Integration of high frequency reconstruction techniques with reduced post-processing delay |
| JP7150996B2 (ja) * | 2019-01-13 | 2022-10-11 | 華為技術有限公司 | ハイレゾリューションオーディオ符号化 |
| KR102308077B1 (ko) * | 2019-09-19 | 2021-10-01 | 에스케이텔레콤 주식회사 | 학습 모델 기반의 인공 대역 변환장치 및 방법 |
| CN113192517B (zh) * | 2020-01-13 | 2024-04-26 | 华为技术有限公司 | 一种音频编解码方法和音频编解码设备 |
| CN113593586B (zh) * | 2020-04-15 | 2025-01-10 | 华为技术有限公司 | 音频信号编码方法、解码方法、编码设备以及解码设备 |
| CN113539281B (zh) * | 2020-04-21 | 2024-09-06 | 华为技术有限公司 | 音频信号编码方法和装置 |
Family Cites Families (52)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6427134B1 (en) | 1996-07-03 | 2002-07-30 | British Telecommunications Public Limited Company | Voice activity detector for calculating spectral irregularity measure on the basis of spectral difference measurements |
| SE9700772D0 (sv) * | 1997-03-03 | 1997-03-03 | Ericsson Telefon Ab L M | A high resolution post processing method for a speech decoder |
| TW430778B (en) * | 1998-06-15 | 2001-04-21 | Yamaha Corp | Voice converter with extraction and modification of attribute data |
| JP4135240B2 (ja) * | 1998-12-14 | 2008-08-20 | ソニー株式会社 | 受信装置及び方法、通信装置及び方法 |
| US6226616B1 (en) * | 1999-06-21 | 2001-05-01 | Digital Theater Systems, Inc. | Sound quality of established low bit-rate audio coding systems without loss of decoder compatibility |
| JP4792613B2 (ja) * | 1999-09-29 | 2011-10-12 | ソニー株式会社 | 情報処理装置および方法、並びに記録媒体 |
| US6704711B2 (en) * | 2000-01-28 | 2004-03-09 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for modifying speech signals |
| DE10041512B4 (de) * | 2000-08-24 | 2005-05-04 | Infineon Technologies Ag | Verfahren und Vorrichtung zur künstlichen Erweiterung der Bandbreite von Sprachsignalen |
| JP4106624B2 (ja) * | 2001-06-29 | 2008-06-25 | 株式会社ケンウッド | 信号の周波数成分を補間するための装置および方法 |
| KR100935961B1 (ko) * | 2001-11-14 | 2010-01-08 | 파나소닉 주식회사 | 부호화 장치 및 복호화 장치 |
| KR20040066835A (ko) * | 2001-11-23 | 2004-07-27 | 코닌클리즈케 필립스 일렉트로닉스 엔.브이. | 대역폭 확장기 및 광대역 오디오 신호 생성 방법 |
| US20030187663A1 (en) * | 2002-03-28 | 2003-10-02 | Truman Michael Mead | Broadband frequency translation for high frequency regeneration |
| JP2005531456A (ja) * | 2002-06-28 | 2005-10-20 | ピレリ・プネウマティチ・ソチエタ・ペル・アツィオーニ | タイヤの特性パラメーターの監視システム |
| US6845360B2 (en) * | 2002-11-22 | 2005-01-18 | Arbitron Inc. | Encoding multiple messages in audio data and detecting same |
| US8260611B2 (en) * | 2005-04-01 | 2012-09-04 | Qualcomm Incorporated | Systems, methods, and apparatus for highband excitation generation |
| EP1895516B1 (en) * | 2005-06-08 | 2011-01-19 | Panasonic Corporation | Apparatus and method for widening audio signal band |
| FR2888699A1 (fr) * | 2005-07-13 | 2007-01-19 | France Telecom | Dispositif de codage/decodage hierachique |
| US7546237B2 (en) * | 2005-12-23 | 2009-06-09 | Qnx Software Systems (Wavemakers), Inc. | Bandwidth extension of narrowband speech |
| CN101089951B (zh) * | 2006-06-16 | 2011-08-31 | 北京天籁传音数字技术有限公司 | 频带扩展编码方法及装置和解码方法及装置 |
| JP5141180B2 (ja) * | 2006-11-09 | 2013-02-13 | ソニー株式会社 | 周波数帯域拡大装置及び周波数帯域拡大方法、再生装置及び再生方法、並びに、プログラム及び記録媒体 |
| KR101379263B1 (ko) * | 2007-01-12 | 2014-03-28 | 삼성전자주식회사 | 대역폭 확장 복호화 방법 및 장치 |
| US8229106B2 (en) * | 2007-01-22 | 2012-07-24 | D.S.P. Group, Ltd. | Apparatus and methods for enhancement of speech |
| US8489396B2 (en) * | 2007-07-25 | 2013-07-16 | Qnx Software Systems Limited | Noise reduction with integrated tonal noise reduction |
| US8041577B2 (en) * | 2007-08-13 | 2011-10-18 | Mitsubishi Electric Research Laboratories, Inc. | Method for expanding audio signal bandwidth |
| EP2186087B1 (en) * | 2007-08-27 | 2011-11-30 | Telefonaktiebolaget L M Ericsson (PUBL) | Improved transform coding of speech and audio signals |
| WO2009039897A1 (en) * | 2007-09-26 | 2009-04-02 | Fraunhofer - Gesellschaft Zur Förderung Der Angewandten Forschung E.V. | Apparatus and method for extracting an ambient signal in an apparatus and method for obtaining weighting coefficients for extracting an ambient signal and computer program |
| US8688441B2 (en) * | 2007-11-29 | 2014-04-01 | Motorola Mobility Llc | Method and apparatus to facilitate provision and use of an energy value to determine a spectral envelope shape for out-of-signal bandwidth content |
| WO2009078681A1 (en) * | 2007-12-18 | 2009-06-25 | Lg Electronics Inc. | A method and an apparatus for processing an audio signal |
| ATE518224T1 (de) * | 2008-01-04 | 2011-08-15 | Dolby Int Ab | Audiokodierer und -dekodierer |
| US8560307B2 (en) * | 2008-01-28 | 2013-10-15 | Qualcomm Incorporated | Systems, methods, and apparatus for context suppression using receivers |
| DE102008015702B4 (de) * | 2008-01-31 | 2010-03-11 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zur Bandbreitenerweiterung eines Audiosignals |
| US8831936B2 (en) * | 2008-05-29 | 2014-09-09 | Qualcomm Incorporated | Systems, methods, apparatus, and computer program products for speech signal processing using spectral contrast enhancement |
| KR101381513B1 (ko) * | 2008-07-14 | 2014-04-07 | 광운대학교 산학협력단 | 음성/음악 통합 신호의 부호화/복호화 장치 |
| WO2010028292A1 (en) * | 2008-09-06 | 2010-03-11 | Huawei Technologies Co., Ltd. | Adaptive frequency prediction |
| US8352279B2 (en) * | 2008-09-06 | 2013-01-08 | Huawei Technologies Co., Ltd. | Efficient temporal envelope coding approach by prediction between low band signal and high band signal |
| PL4231295T3 (pl) * | 2008-12-15 | 2024-05-06 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Sposób dekodowania powiększania szerokości pasma audio oraz program komputerowy |
| US8463599B2 (en) * | 2009-02-04 | 2013-06-11 | Motorola Mobility Llc | Bandwidth extension method and apparatus for a modified discrete cosine transform audio coder |
| RU2452044C1 (ru) * | 2009-04-02 | 2012-05-27 | Фраунхофер-Гезелльшафт цур Фёрдерунг дер ангевандтен Форшунг Е.Ф. | Устройство, способ и носитель с программным кодом для генерирования представления сигнала с расширенным диапазоном частот на основе представления входного сигнала с использованием сочетания гармонического расширения диапазона частот и негармонического расширения диапазона частот |
| CN101990253A (zh) * | 2009-07-31 | 2011-03-23 | 数维科技(北京)有限公司 | 一种带宽扩展方法及其装置 |
| JP5493655B2 (ja) * | 2009-09-29 | 2014-05-14 | 沖電気工業株式会社 | 音声帯域拡張装置および音声帯域拡張プログラム |
| JP5619177B2 (ja) * | 2009-11-19 | 2014-11-05 | テレフオンアクチーボラゲット エル エムエリクソン(パブル) | 低域オーディオ信号の帯域拡張 |
| JP5589631B2 (ja) * | 2010-07-15 | 2014-09-17 | 富士通株式会社 | 音声処理装置、音声処理方法および電話装置 |
| US9047875B2 (en) * | 2010-07-19 | 2015-06-02 | Futurewei Technologies, Inc. | Spectrum flatness control for bandwidth extension |
| KR101826331B1 (ko) * | 2010-09-15 | 2018-03-22 | 삼성전자주식회사 | 고주파수 대역폭 확장을 위한 부호화/복호화 장치 및 방법 |
| KR101613673B1 (ko) * | 2011-02-14 | 2016-04-29 | 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. | 불활성 위상 동안에 잡음 합성을 사용하는 오디오 코덱 |
| US20140019125A1 (en) * | 2011-03-31 | 2014-01-16 | Nokia Corporation | Low band bandwidth extended |
| US9251800B2 (en) | 2011-11-02 | 2016-02-02 | Telefonaktiebolaget L M Ericsson (Publ) | Generation of a high band extension of a bandwidth extended audio signal |
| TWI591620B (zh) | 2012-03-21 | 2017-07-11 | 三星電子股份有限公司 | 產生高頻雜訊的方法 |
| US9228916B2 (en) * | 2012-04-13 | 2016-01-05 | The Regents Of The University Of California | Self calibrating micro-fabricated load cells |
| KR101897455B1 (ko) * | 2012-04-16 | 2018-10-04 | 삼성전자주식회사 | 음질 향상 장치 및 방법 |
| US9666202B2 (en) * | 2013-09-10 | 2017-05-30 | Huawei Technologies Co., Ltd. | Adaptive bandwidth extension and apparatus for the same |
| FR3017484A1 (fr) * | 2014-02-07 | 2015-08-14 | Orange | Extension amelioree de bande de frequence dans un decodeur de signaux audiofrequences |
-
2014
- 2014-02-07 FR FR1450969A patent/FR3017484A1/fr active Pending
-
2015
- 2015-02-04 FI FIEP17206563.3T patent/FI3330966T3/fi active
- 2015-02-04 CN CN201580007250.0A patent/CN105960675B/zh active Active
- 2015-02-04 EP EP15705687.0A patent/EP3103116B1/fr active Active
- 2015-02-04 PT PT157056870T patent/PT3103116T/pt unknown
- 2015-02-04 EP EP17206563.3A patent/EP3330966B1/fr active Active
- 2015-02-04 KR KR1020167024350A patent/KR102380205B1/ko active Active
- 2015-02-04 PL PL15705687T patent/PL3103116T3/pl unknown
- 2015-02-04 HU HUE17206563A patent/HUE062979T2/hu unknown
- 2015-02-04 ES ES17206567T patent/ES2978878T3/es active Active
- 2015-02-04 KR KR1020177037706A patent/KR102380487B1/ko active Active
- 2015-02-04 HR HRP20211187TT patent/HRP20211187T1/hr unknown
- 2015-02-04 SI SI201531646T patent/SI3103116T1/sl unknown
- 2015-02-04 SM SM20210395T patent/SMT202100395T1/it unknown
- 2015-02-04 ES ES17206569T patent/ES2978967T3/es active Active
- 2015-02-04 CN CN201711459701.1A patent/CN108022599B/zh active Active
- 2015-02-04 LT LTEP15705687.0T patent/LT3103116T/lt unknown
- 2015-02-04 RU RU2017144521A patent/RU2763848C2/ru active
- 2015-02-04 EP EP17206569.0A patent/EP3327722B1/fr active Active
- 2015-02-04 SI SI201531958T patent/SI3330966T1/sl unknown
- 2015-02-04 PL PL17206567.4T patent/PL3330967T3/pl unknown
- 2015-02-04 RU RU2017144522A patent/RU2763481C2/ru active
- 2015-02-04 CN CN201711459695.XA patent/CN108109632B/zh active Active
- 2015-02-04 BR BR122017027991-2A patent/BR122017027991B1/pt active IP Right Grant
- 2015-02-04 JP JP2016549732A patent/JP6625544B2/ja active Active
- 2015-02-04 PT PT172065633T patent/PT3330966T/pt unknown
- 2015-02-04 KR KR1020227007471A patent/KR102510685B1/ko active Active
- 2015-02-04 LT LTEP17206563.3T patent/LT3330966T/lt unknown
- 2015-02-04 CN CN201711459702.6A patent/CN107993667B/zh active Active
- 2015-02-04 WO PCT/FR2015/050257 patent/WO2015118260A1/fr not_active Ceased
- 2015-02-04 RU RU2017144523A patent/RU2763547C2/ru active
- 2015-02-04 RU RU2016136008A patent/RU2682923C2/ru active
- 2015-02-04 KR KR1020177037700A patent/KR20180002906A/ko not_active Ceased
- 2015-02-04 HU HUE15705687A patent/HUE055111T2/hu unknown
- 2015-02-04 RS RS20230844A patent/RS64614B1/sr unknown
- 2015-02-04 ES ES17206563T patent/ES2955964T3/es active Active
- 2015-02-04 EP EP17206567.4A patent/EP3330967B1/fr active Active
- 2015-02-04 BR BR112016017616-2A patent/BR112016017616B1/pt active IP Right Grant
- 2015-02-04 MX MX2016010214A patent/MX363675B/es unknown
- 2015-02-04 RS RS20210945A patent/RS62160B1/sr unknown
- 2015-02-04 DK DK15705687.0T patent/DK3103116T3/da active
- 2015-02-04 SM SM20230335T patent/SMT202300335T1/it unknown
- 2015-02-04 MX MX2017015657A patent/MX381498B/es unknown
- 2015-02-04 PL PL17206569.0T patent/PL3327722T3/pl unknown
- 2015-02-04 DK DK17206563.3T patent/DK3330966T3/da active
- 2015-02-04 KR KR1020177037710A patent/KR102426029B1/ko active Active
- 2015-02-04 PL PL17206563.3T patent/PL3330966T3/pl unknown
- 2015-02-04 ES ES15705687T patent/ES2878401T3/es active Active
- 2015-02-04 US US15/117,100 patent/US10043525B2/en active Active
- 2015-02-04 HR HRP20231164TT patent/HRP20231164T1/hr unknown
-
2016
- 2016-09-06 ZA ZA2016/06173A patent/ZA201606173B/en unknown
-
2017
- 2017-12-11 ZA ZA2017/08366A patent/ZA201708366B/en unknown
- 2017-12-11 ZA ZA2017/08368A patent/ZA201708368B/en unknown
- 2017-12-11 ZA ZA2017/08367A patent/ZA201708367B/en unknown
-
2018
- 2018-01-12 US US15/869,560 patent/US10668760B2/en active Active
- 2018-06-18 US US16/011,153 patent/US10730329B2/en active Active
-
2019
- 2019-06-07 JP JP2019107009A patent/JP6775065B2/ja active Active
- 2019-06-07 JP JP2019107008A patent/JP6775064B2/ja active Active
- 2019-06-07 JP JP2019107007A patent/JP6775063B2/ja active Active
-
2020
- 2020-07-13 US US16/926,818 patent/US11312164B2/en active Active
- 2020-07-27 US US16/939,104 patent/US11325407B2/en active Active
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3103116B1 (fr) | Extension ameliorée de bande de fréquence dans un décodeur de signaux audiofréquences | |
| EP3020043B1 (fr) | Facteur d'échelle optimisé pour l'extension de bande de fréquence dans un décodeur de signaux audiofréquences | |
| EP3014611B1 (fr) | Extension améliorée de bande de fréquence dans un décodeur de signaux audiofréquences |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20160804 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: KANIEWSKA, MAGDALENA Inventor name: RAGOT, STEPHANE |
|
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20170720 |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20201123 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1390825 Country of ref document: AT Kind code of ref document: T Effective date: 20210515 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015068913 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
| REG | Reference to a national code |
Ref country code: PT Ref legal event code: SC4A Ref document number: 3103116 Country of ref document: PT Date of ref document: 20210712 Kind code of ref document: T Free format text: AVAILABILITY OF NATIONAL TRANSLATION Effective date: 20210705 |
|
| REG | Reference to a national code |
Ref country code: RO Ref legal event code: EPE |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: TUEP Ref document number: P20211187T Country of ref document: HR |
|
| REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20210721 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP Ref country code: FI Ref legal event code: FGE |
|
| REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
| REG | Reference to a national code |
Ref country code: GR Ref legal event code: EP Ref document number: 20210401962 Country of ref document: GR Effective date: 20210813 |
|
| REG | Reference to a national code |
Ref country code: EE Ref legal event code: FG4A Ref document number: E021177 Country of ref document: EE Effective date: 20210719 |
|
| REG | Reference to a national code |
Ref country code: NO Ref legal event code: T2 Effective date: 20210505 |
|
| REG | Reference to a national code |
Ref country code: SK Ref legal event code: T3 Ref document number: E 37832 Country of ref document: SK |
|
| REG | Reference to a national code |
Ref country code: HU Ref legal event code: AG4A Ref document number: E055111 Country of ref document: HU |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: T1PR Ref document number: P20211187 Country of ref document: HR |
|
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2878401 Country of ref document: ES Kind code of ref document: T3 Effective date: 20211118 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015068913 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20211187 Country of ref document: HR Payment date: 20220127 Year of fee payment: 8 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20220208 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: UEP Ref document number: 1390825 Country of ref document: AT Kind code of ref document: T Effective date: 20210505 |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20211187 Country of ref document: HR Payment date: 20230124 Year of fee payment: 9 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20211187 Country of ref document: HR Payment date: 20240123 Year of fee payment: 10 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210505 |
|
| PGRI | Patent reinstated in contracting state [announced from national office to epo] |
Ref country code: AL Effective date: 20210723 |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20211187 Country of ref document: HR Payment date: 20250121 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: BG Payment date: 20250228 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SI Payment date: 20250124 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AL Payment date: 20250226 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: MK Payment date: 20250122 Year of fee payment: 11 |
|
| REG | Reference to a national code |
Ref country code: HR Ref legal event code: ODRP Ref document number: P20211187 Country of ref document: HR Payment date: 20260122 Year of fee payment: 12 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: U11 Free format text: ST27 STATUS EVENT CODE: U-0-0-U10-U11 (AS PROVIDED BY THE NATIONAL OFFICE) Effective date: 20260301 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: LU Payment date: 20260220 Year of fee payment: 12 Ref country code: NL Payment date: 20260220 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: HU Payment date: 20260211 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SM Payment date: 20260220 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20260223 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20260223 Year of fee payment: 12 Ref country code: LT Payment date: 20260122 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: MC Payment date: 20260219 Year of fee payment: 12 Ref country code: ES Payment date: 20260317 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20260220 Year of fee payment: 12 Ref country code: NO Payment date: 20260218 Year of fee payment: 12 Ref country code: DK Payment date: 20260223 Year of fee payment: 12 Ref country code: IE Payment date: 20260219 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: HR Payment date: 20260122 Year of fee payment: 12 Ref country code: AT Payment date: 20260218 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FI Payment date: 20260220 Year of fee payment: 12 Ref country code: RO Payment date: 20260126 Year of fee payment: 12 Ref country code: BE Payment date: 20260220 Year of fee payment: 12 Ref country code: IT Payment date: 20260220 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: RS Payment date: 20260122 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IS Payment date: 20260223 Year of fee payment: 12 Ref country code: FR Payment date: 20260224 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: TR Payment date: 20260123 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: PT Payment date: 20260121 Year of fee payment: 12 Ref country code: CZ Payment date: 20260126 Year of fee payment: 12 Ref country code: CH Payment date: 20260301 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GR Payment date: 20260220 Year of fee payment: 12 Ref country code: MT Payment date: 20260224 Year of fee payment: 12 Ref country code: PL Payment date: 20260126 Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: EE Payment date: 20260219 Year of fee payment: 12 Ref country code: SK Payment date: 20260123 Year of fee payment: 12 Ref country code: LV Payment date: 20260216 Year of fee payment: 12 |