JP3348831B2 - Text-based voice communication system, communication server device, and communication display device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice communication system using characters using a voice communication line such as a wired telephone.

[0002]

2. Description of the Related Art FIG. 10 is a block diagram showing a schematic configuration of a conventional voice facsimile information service system. In this figure, reference numeral 100 denotes a server device, which is an audio file 101, facsimile information 102, control means 1
It consists of 03. 200 is a terminal device, 300 is a communication line,
Reference numeral 500 denotes a user.

[0003] A user 500 makes a telephone call to a server device 100 for providing an information service, dials a number for identifying information in accordance with a message from the server device 100, and transmits information transmitted as a facsimile signal from the server device 100. Is received by the terminal device 200.

[0004]

In the facsimile information service system shown in FIG. 10, although the finally obtained information is on a piece of paper, the voice from the server device 100 is output on the way. Need to be aware,
Deaf people were not available.

Another prior art is disclosed in Japanese Patent Laid-Open No. 4-156.
050 and Japanese Patent Application Laid-Open No. 7-273892 are referred to as "fax machines". The former processes audio signals for persons with hearing impairments to enable LCD display and recording, but does not display audio signals from a server device. In the facsimile terminal using the telephone number guidance service, the latter recognizes the voice signal and prints the inquired telephone number, and is not a technical idea of displaying the voice signal from the server device.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a voice communication system with characters capable of displaying graphic information in parallel with voice by connecting a display device for extracting features from audible sound information generated by a server device. I do.

[0007]

FIG. 1 is a block diagram showing a basic configuration of a voice communication system with characters according to the present invention. In this figure, reference numeral 400 denotes a display device as a main part of the present invention, which comprises a voice analysis circuit 401 and a display means 402.

As described above, the server device 100 and the user 50
0 and a terminal device 200 such as a facsimile to be used.
The display device 400 is inserted, an audio signal on the communication line 300 is taken in, analyzed by the audio analysis circuit 401, and graphic information corresponding to the analysis result is displayed on the display means 402. By superimposing the character information signal on the audio signal, the graphic information can be displayed at an appropriate time in accordance with the audio. This
In this case, the server device transmits the predetermined character information to be transmitted.
Voice signal or message during a call, depending on
Between fundamental and overtone components in digital audio signals
In addition to changing the phase difference, the display device
Storage means for storing the corresponding predetermined character information or graphic information
Display means for reading and displaying from
Things.

[0009]

2 DETAILED DESCRIPTION OF THE INVENTION, voice server device emits
Is a block diagram showing the configuration of a character combination voice communication system that recognizes and displays.

The server apparatus 100 includes a voice file 101 storing a message, user-provided information 102 such as facsimile information, and control means 103 for performing control.
Consists of

The display device 400 comprises a voice recognition circuit 403, a graphic information memory 404 storing graphic information, and a display means 402 such as a liquid crystal display. The user 500 dials the terminal device 200 in the same manner as a normal call, so that the server device 100
Configure a call state with the. The control means 103 of the server apparatus 100 selects and reproduces a message from the audio file 101 to the user 500. The display device 400 recognizes the voice information and displays the graphic information. User 5
00 is dialed in response to a voice or graphic message of the server apparatus 100, and the server apparatus 10 is dialed.
Information can be interactively exchanged with 0 to obtain desired information such as facsimile information.

Here, the voice file 101 is assumed as the message recording medium, but the present invention is not limited to this format, and for example, a synthesized voice by a computer or the like may be used.

Here, the terminal device 200 and the server device 1
Although the display device 400 is installed during the period of 00, the line may be branched and connected. Alternatively, the terminal may be connected to a signal line supplied to a receiver of the terminal.

[0014] Figure 3 is a flowchart showing the operation of the system.

When the user 500 makes a call to the server device 100, the server device 100 that has received the call responds by voice to input the information number. Based on this voice, the display means 402 of the display device 400 displays a message urging the number to be transmitted by keying. User 50 looking at this
0 inputs a number. Then, the server device 100
To send X, "If you hear the fax tone, fax
Please press the start button of the device. ", And send a fax tone after a while. The display device 400 displays that the start button is pressed when the fax tone is detected. When the user 500 presses the start button, FAX reception is started, so that the user 500 can receive the FAX which is a product without listening to the voice.

Further, even when the user 500 makes a mistake in inputting a number or the like, it is possible to support reception of a fax by displaying an instruction such as "re-input" or "re-call" on the display means 402.

FIG. 4 is a flowchart showing the operation of the server device 100. (1) to (13) show each step.

When receiving the incoming call (1), the server reproduces both a message prompting the input of the number of the FAX information and the voice pattern 1 for operating the display device 400 (2). Then, it waits for the input of the number by the tone signal (3).

If an incorrect number is entered (4),
(5) The message prompting the re-entry of the number and the voice pattern 2 for operating the display device 400 are both reproduced by the allowable number of times (6). If the number exceeds the allowable number, the line is disconnected (7).

If the number is correct (4), a message urging the user to stand by and the voice pattern 3 for operating the display device 400 are reproduced together (8), and preparation for FAX data transmission is made (9). When the transmission is ready, a FAX tone is transmitted (10), and after confirming the connection establishment, the data is transmitted. When the transmission is completed (12), the line is disconnected (7). If the connection cannot be established, disconnect after timeout.

FIG. 5 is a flowchart showing the operation of the display device 400. Note that (21) to (32) indicate each step.

When the receiver goes up (off-hook) and (2
1) Start the operation. The voice signal of the line is monitored, and if it is a predetermined pattern, a corresponding character string is displayed. When the line is disconnected (24), the operation ends. Note that details of the operation of the display device 400 are the same as those described in the flowchart of FIG. 3, and thus further description will be omitted.

FIG . 6 shows a speech generated by the server device .
FIG. 1 is a block diagram illustrating a configuration of a system that analyzes and displays a signal with a tram analyzer or the like, and is a schematic diagram illustrating a system provided by inserting a signal having a frequency characteristic into an audio file. In this figure, reference numeral 405 denotes a spectrum analyzer, and the other components are the same as those in FIG.

The user 500 establishes a call state with the server device 100 by dialing in the same manner as a normal call. The control means 103 of the server apparatus 100 selects and reproduces the voice file 101 as a message for the user 500. At this time, an audible sound having a characteristic frequency distribution such as a DTMF sound (tone signal of a push phone) is inserted or superimposed at the beginning of the audio file 101, for example. The display device 400 performs frequency analysis on the voice information by the spectrum analyzer 405 or the frequency filter, recognizes the voice information, and displays the graphic information. The recipient can interactively exchange information with the server device 100 by dialing according to the message of the server device 100.

That is, by looking at the graphic information synchronized with the voice, it is possible to exchange information interactively without listening to the voice.

Here, a voice file is assumed as the message recording medium. However, the present invention is not limited to this format, and for example, a synthesized voice by a computer or the like may be used.

Although the communication line 300 is branched and connected here, the display device 400 may be provided between the terminal device 200 and the server device 100. Further, the terminal 200 may be connected to a signal line supplied to a receiver of the terminal device 200.

Also, for example, the shift JIS
Arbitrary character strings can be displayed by associating character codes such as codes.

In the present embodiment, the display device 400 can be reduced in size, weight, and cost.

FIG. 7 is a schematic diagram showing the details of the display device 400 in the system shown in FIG.

The display device 400 has two line connectors 411 and 412, one of which is connected to the exchange (line) side.
The other is connected to the telephone (terminal device 200) side for use. Since the two connectors 411 and 412 are directly connected in the device, the function of the terminal device 200 is not affected at all. The display device 400 operates by measuring a change in a signal of a line.

The display device 400 includes a detection circuit such as a DTMF sound detection circuit 414 and a FAX tone detection circuit 415 connected to a data bus 413, a character generator 416 storing character fonts, and a one-chip control unit. It comprises a microcomputer 417 and a liquid crystal display 418 for displaying.

The line signal is detected by the DTMF sound detection circuit 414 and the like as shown in FIG. One-chip microcomputer 4
A monitor 17 constantly monitors the detection status, reads a character string corresponding to the detection status from a character bit map pattern from the character generator 416,
Display by writing to.

The characters to be displayed may correspond to DTMF patterns and characters as fixed sentences, or may be characters and DTMF.
Arbitrary sentences can be displayed corresponding to the patterns. Advanced display can be realized by associating the DTMF pattern with a function such as screen erasure. In addition, by storing figures other than Chinese characters in the character generator 416, display of figures can be realized. The number of display messages may be further increased by increasing the number of detection circuits for a busy tone, a ringing tone and the like.

FIG. 8 is a diagram showing a fundamental tone of a voice uttered by the server device .
Phase difference between minute and harmonic components
Is a description diagram for describing the implementation embodiments of the present invention to modulate.

In general, human real voices and the like include, in addition to the fundamental frequency, which is a main frequency component, harmonics whose frequency is an integral multiple of the fundamental frequency. The time difference between the maximum amplitude of the fundamental tone and the maximum amplitude of the overtone (hereinafter referred to as a phase difference) is constant regardless of time because the frequency ratio is an integer. In the present embodiment, the sound is characterized by changing the phase difference.

The characterized voice is produced as follows.

The base speech is divided at appropriate time intervals.
Each of the divided voices is converted into a frequency spectrum by Fourier transform. The amplitude component of the frequency spectrum is stored, and the phase component is replaced with information to be modulated.
By performing an inverse Fourier transform on the newly created spectrum, a speech signal with a controlled phase component can be reconstructed.

Since a human does not recognize the phase difference between the frequency components, it is possible to send the graphic information without damaging the message voice by using the voice whose phase difference is controlled as in the present embodiment.

Further, a method of producing a sound modulated by a phase difference will be described in detail with reference to FIG. For example, X1, X2,... (X is a real number) are the amplitudes of unmodulated voices separated by time intervals such as syllables arranged in time order. By performing a Fourier transform on this data sequence, a data sequence of frequency components is obtained. The frequency component is represented by a complex number in the form of Ae ⁱ θ using the amplitude A and the phase θ.

The fundamental tone of frequency fl and its overtone (2 × fl)
Will be described. The amplitude of the fundamental tone is A ₁ as shown,
The phase is θ ₁ , and the amplitude of the overtone is A ₁ ′ phase is θ ₁ ′ as shown. Here, exp [i
(Δ + θ ₁ −θ ₁ ′)], the phase difference between the overtone and the fundamental tone becomes δ. After similar processing is performed on other combinations of fundamental and overtones, inverse Fourier transform is performed, and the inversely transformed voice data strings Y1, Y2,... Are used as modulated voices.

In this embodiment, the frequency components are decomposed by Fourier transform. However, the frequency components may be extracted by a filtering (frequency filter) circuit and the phase may be shifted by a delay circuit.

[0043]

According to the present invention as described above, those distant ears in elderly, character combination voice communication system that's not familiar with the language used in the foreign and the like such as voice is also guided by voice
In the system, the server device transmits predetermined character information to be transmitted.
Voice signal or menu during a call, depending on the
Between fundamental and overtone components in the message audio signal
While changing the phase difference, in the display device, the phase
Stores the predetermined character information or graphic information corresponding to the difference
Display means for reading and displaying from the means
As a result, the server said,
Without adding new voice to the message voice signal
Character information or graphic information can be sent,
On the terminal side, sound with text or graphic information superimposed
General that does not have a dedicated device even though it is a voice signal
Listening to the phone without any problem (without feeling uncomfortable)
Can be achieved . "

Also, humans recognize the phase difference between frequency components.
Therefore, the present invention controls the phase difference as in the above configuration.
By using the converted voice, it is possible to send the graphic information without losing the voice of the message.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of a voice communication system with characters according to the present invention.

FIG. 2 is a system for recognizing and displaying a voice uttered by a server device .
FIG. 3 is a block diagram illustrating a configuration of a stem .

FIG. 3 is a flowchart showing the entire operation of FIG. 2;

FIG. 4 is a flowchart showing an operation of the server device in FIG. 2;

FIG. 5 is a flowchart showing an operation of the display device in FIG. 2;

FIG. 6 shows a spectrum analyzer which outputs a voice uttered by a server device .
FIG. 2 is a block diagram illustrating a configuration of a system that analyzes and displays with an analyzer or the like .

FIG. 7 is a schematic diagram showing details of the display device in FIG. 6;

8 is an explanatory diagram of the phase difference between the audio signals for explaining the implementation of the invention.

FIG. 9 is a diagram illustrating a method for producing a sound modulated by a phase difference according to the present invention.

FIG. 10 is a block diagram showing a schematic configuration of a facsimile information service system for explaining a conventional technique.

[Explanation of symbols]

 Reference Signs List 100 server device 101 voice file 102 facsimile information 103 control means 200 terminal device 300 communication line 400 display device 401 voice analysis circuit 402 display means 403 voice recognition circuit 404 graphic information memory 405 spectrum analyzer 411,412 connector 413 data bus 414 DTMF sound detection Circuit 415 FAX tone 416 Character generator 417 One chip microcomputer 418 Liquid crystal display

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int. Cl. ⁷ , DB name) H04N 1/00-1/00 108

Claims (3)

(57) [Claims] 1. A voice communication line, a voice signal during a call or
Is the predetermined character information or figure together with the message voice signal
Server device for transmitting shape information via the voice communication line
And a terminal device and a display device for receiving the same.
In a communication system, a server device communicates according to predetermined character information or graphic information to be transmitted.
Fundamentals in a busy or message voice signal
In addition to changing the phase difference between the harmonic component and the harmonic component, the display device displays the base signal in the voice signal during the call or the message voice signal.
Speech analyzer that extracts the phase difference between sound and harmonic components
Stage and the corresponding function of the phase difference a predetermined character information or graphic information
Storage means held together with the person in charge, and the predetermined character information or graphic information corresponding to the phase difference.
Display means for reading and displaying the information from the storage means.
Character combination voice communication system, characterized in that that. 2. A voice signal or message voice during a call.
Voice communication of specified character information or graphic information along with signals
A server device that transmits data via a line , and communicates according to predetermined character information or graphic information to be transmitted.
Fundamentals in a busy or message voice signal
Features and to Rubun shaped combination voice communication server apparatus varying a phase difference between the component and the harmonic components. (3) Audio signal or message audio during a call
Predetermined characters received via voice communication line along with the signal
Terminal display device that displays information or graphic information.
hand, Base on voice or message voice signals during a call
Speech analyzer that extracts the phase difference between sound and harmonic components
Steps and Correspondence between predetermined character information or graphic information and the phase difference
Storage means held with the staff, The predetermined character information or graphic information corresponding to the phase difference
Display means for reading and displaying information from the storage means; Have
A voice communication display device using characters.