JP3166725B2 - Information recording apparatus, information recording method, and recording medium - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information recording apparatus, an information recording method, and a recording medium. The present invention relates to an information recording apparatus, an information recording method, and a recording medium that enable the above.

[0002]

2. Description of the Related Art In a conventional VTR type video camera, a RET (return) key is provided in a camera portion so that a marker for a portion which is a "trigger" for editing can be input during shooting. ing. Therefore,
By inputting the marker, when editing is performed later, the portion where the marker is input can be easily called, and the editing operation can be facilitated.

[0003]

However, for example, when taking a picture of the operation status with a video camera or the like during the operation, it is difficult for the doctor to operate the camera and input the marker. Even if you ask your assistant,
There is a problem that it is difficult to input a marker as expected by a doctor.

[0004] Therefore, it is desirable to automatically "edit" or to take important screen capture timing during surgery by voice input if possible.

[0005] In this case, unless the key word is a pre-registered word, it becomes impossible to perform an automatic keyword search (collating with a pre-registered word at the time of voice input). Since it is necessary to concentrate on the operation during the operation, it is necessary to automatically input the keyword as metadata (additional data) to the recorder in addition to the video / audio by voice input.

The present invention has been made in view of such a situation, and a keyword is input by voice input during shooting with a video camera, and a keyword is added to video / audio so that a keyword search can be performed later. It is intended to be able to be additionally recorded.

[0007]

An information recording apparatus according to the first aspect of the present invention recognizes video input means for inputting video, audio input means for inputting audio, and audio input by the audio input means. Voice recognition means for converting to a word corresponding to voice, generation means for generating a code corresponding to the word recognized and converted by the voice recognition means, video input by the video input means, and video generated by the generation means and corresponding in association with code words, recording means for recording on a predetermined recording medium, the information about the words and words related
Storage means for linking and storing, and voice recognition means for recognition.
Retrieval means for retrieving recognized word information from storage means
And the information of the word searched by the search means is displayed
Multiple information was searched by the display means and the search means
At this time, a plurality of pieces of information are sequentially displayed on the display means, and a plurality of pieces of information are displayed.
Selecting means for selecting one piece of information from the information,
The recognition means, based on the words stored in the storage means,
The voice is converted into words, and the recording means is selected by the selection means.
Record the word code corresponding to the selected information on the recording medium
Characterized in that it. The information recording device according to claim 2.
Is video input means for inputting video and sound for inputting audio.
Voice input means and voice input by the voice input means
Speech recognition means for recognizing and converting to words corresponding to speech
And the words recognized and converted by the voice recognition means
The corresponding means for generating the code and the video input means
Therefore, the input video and the video generated by the generating means
By associating a code corresponding to a word with a predetermined recording medium
Associating the recording means for recording with words and information about words
And a voice recognition unit.
Retrieval means for retrieving the information of the extracted word from the storage means;
A display that displays information on the word found by the search means
Means and a plurality of pieces of information are searched by the search means.
The display means sequentially displays a plurality of pieces of information,
Selecting means for selecting one piece of information from the
Means for sounding, based on words stored in the storage means;
Converts voice into words, recording means selected by selection means
The code of the word corresponding to the extracted information on the recording medium
Expression generation that generates search expressions from codes and logical codes
Means is further provided, wherein the recording means comprises a code and a search formula.
Associating an image, to characterized that you recorded on a recording medium
You. Further, the selection means is provided with a plurality of information displayed on the display means.
Select one piece of information from a report according to voice instructions
You can do so. The recording means may record the sound input by the sound input means on a recording medium together with the video and the code. The information recording method according to claim 5, wherein a video input step of inputting a video, a voice input step of inputting a voice, and a voice that recognizes the voice input in the voice input step and converts the voice into a word corresponding to the voice. A recognition step, a generation step of generating a code corresponding to the word recognized and converted in the voice recognition step, and associating a video input in the video input step with a code corresponding to the word generated in the generation step A recording step of recording on a predetermined recording medium ;
A storage step for storing in association with a voice recognition step
The information of the word recognized in
A search step for searching from words stored in the
A display that displays information on the word searched for in the step
Steps, multiple information is searched in the search step
Multiple information is displayed sequentially in the display step.
Selection step of selecting one piece of information from a plurality of pieces of information
In the voice recognition step, the storage step
Converts speech to words based on words stored in
In the recording step,
Record the word code corresponding to the selected information on the recording medium
Characterized in that it. The information recording method according to claim 6.
Is a video input step for inputting video, and an audio input step.
Input in the voice input step
Sound that recognizes the converted speech and converts it into a word corresponding to the speech
The voice recognition step and the voice recognition step
Generation code that generates a code corresponding to the converted word
Step and the video input in the video input step
And a command corresponding to the word generated in the generation step.
Recording mode for recording on a predetermined recording medium by associating
And associates the word with information about the word
Recognized in the memory step and the voice recognition step
Whether the word information is the word stored in the storage step
Search step to search from and search in search step
A display step for displaying information on the searched word, and a search step.
When multiple pieces of information are searched for in a
Display multiple pieces of information in sequence, and
Selecting one piece of information;
In the step, stored in the storage step
Based on words, convert voice to words and go to recording step
Correspond to the information selected in the selection step
Record the code of the word
Generates a search expression from the code and associates the code and search expression with the video.
It is characterized by being linked and recorded on a recording medium. Claim
A recording medium according to a seventh aspect is characterized by recording a program capable of executing the information recording method according to the fifth or sixth aspect. In the information recording apparatus, the information recording method, and the recording medium according to the present invention, a video is input, a voice is input, the input voice is recognized, converted into a word corresponding to the voice, recognized, and converted. A code corresponding to the generated word is generated, and the input video and the code corresponding to the generated word are associated with each other and recorded on a predetermined recording medium. At this time, the word and the information about the word are stored in association with each other,
Converts speech into words based on stored words and recognizes them
Search for the information of the stored word from the stored word, and search
Displays information on the word that was searched, and
To display multiple pieces of information in sequence,
Select the information and code the word corresponding to the selected information
Is recorded on a recording medium.

[0008]

FIG. 1 is a diagram showing an example of the configuration of an embodiment of an optical disk camera device to which the information recording device of the present invention is applied. FIG. 1 shows a state in which it is used in a medical video capture and is mounted at the center of the ceiling lighting. The operation of the optical disk camera device 1 (hereinafter abbreviated as a camera as appropriate) is performed by a doctor's assistant staff or the like.

The optical disk camera device 1 includes a lens unit 11 that collects light from a subject and forms an image of the subject,
The microphone 13 includes a microphone 13 that collects surrounding sounds and keywords or the like pronounced by a doctor, an image formed by the lens unit 11, and a camera unit 12 that records sound collected by the microphone 13.

The optical disk camera device 1 has a driver 14 for rotating the optical disk camera device 1 around the Z axis and a driver 15 for rotating the optical disk camera device 1 around the Y axis. Thus, the optical disk camera device 1 can be directed in a predetermined direction.

The optical disk camera apparatus 1 recognizes voice input when capturing an image of an operation or the like, and extracts a corresponding word by referring to a word dictionary 23 in which words and word information are registered in advance. Then, using that as a keyword, the video recording /
The data is inserted as additional data (metadata) into the system data (FIG. 3) inside the frame or field of the audio recording. Thus, after shooting, a frame in which the target video / audio is recorded can be extracted by keyword search.

Also, keywords and logical codes (AND / O
R), a search formula may be generated and recorded in the system data field. For example, keywords such as heart / lung / bypass / surgery are AND / O
By generating a search formula by linking with R and recording it in the system data field, a specific video image can be extracted by specifying the search formula.

FIG. 2 is a block diagram showing an example of an electrical configuration inside the optical disk camera device 1 shown in FIG.

As shown in FIG. 1, an optical disc camera device 1 receives a voice, converts the voice input into predetermined voice data, and converts the voice data converted by the voice input unit 21 into a voice. Recognition voice recognition unit 22
A dictionary search unit 24 for performing a dictionary search on words of the voice recognition result recognized by the voice recognition unit 22; and a search result display unit 25 for displaying information of the words searched by the dictionary search unit 24 to the user. And These voice input unit 21, voice recognition unit 22, dictionary search unit 2
4. The search result display unit 25 constitutes a dictionary search device.

In the optical disc camera apparatus 1, the voice recognition unit 22 uses the voice recognition template for each word used for voice recognition of the voice data supplied from the voice input unit 21 and the dictionary search unit 24 searches for each word. It has a word dictionary 23 in which word information is registered in the same word entry. Here, the voice input unit 21 and the voice input unit 26 constitute the microphone 13 in FIG.

For voice recognition, it is faster to register a language to be used in advance and determine which language is closest to the registered language. Therefore, when a plurality of (for example, two or three) selections occur for the same voice, it is necessary to determine one of them. This determination is input by voice from the voice input unit 26.

The voice input unit 26 responds to the selection of a plurality of candidates of the recognition result displayed as a result of the voice recognition by the search result display unit 25 with YES or NO, or OK.
Alternatively, the NG determination is input by voice. At this time, the voice input from the voice input unit 21 is ignored. Therefore, the voice input unit 26 outputs YES / N
It is assumed that a simple speech recognition circuit for recognizing O, OK / NG is provided.

For example, when the user pronounces "ishi" and inputs the sound from the voice input unit 21, the voice recognition unit 22
From 3, the word "is" is recognized. Next, the dictionary search unit 24 searches the word dictionary 2 for the word “Ishi”.
From 3, search for "doctor", "will", "stone", "hanging", and the like. Then, the search results are sequentially displayed in the search result display unit 2.
5 is displayed. On the other hand, by inputting YES or NO, or OK or NG by voice from the voice input unit 26, a desired word can be selected and determined from a plurality of search results.

FIG. 3 shows an example of a frame format of the optical disk 28 on which video / audio data is recorded. Each frame includes a synchronizing unit for synchronizing, a sync block ID storing an ID indicating a frame order, video data, and audio data. The system data is 640 bytes (B) (= 320 * 2) in the video data and 40 bytes (= 20 * 2) in the audio data, for a total of 68 bytes.
0 bytes (B) / field, ie, 1360 bytes /
Enter the frame. The outer code correction and the inner code correction are error correction codes, respectively.

In the system data of the video data, a keyword input by voice is recorded, and in the system data of the audio data, a keyword, a search formula, progress of “YES / NO determination” described later, Data that could not fit in the data is recorded.

Therefore, it is possible to automatically record 680 characters in the case of 2-byte characters (full-width) and 1360 characters in the case of 1-byte characters (half-width) as metadata in the system data per frame. At this time, if a keyword is extracted from the recognized speech and only the keyword is recorded, it is possible to compress and record the number of used memories as a result.

Next, the operation will be described. During the operation of the doctor, the assistant operates the optical disc camera device 1 to photograph the operation. During photographing, a doctor and an assistant or the like input sound to be recorded on the optical disc camera device 1 by the sound input unit 21.
Enter more.

The voice input to the voice input unit 21 is supplied to a voice recognition unit 22 after being converted into digital voice data. The speech recognition unit 22 uses the word dictionary 23 to
Speech recognition is performed on the speech data supplied from the speech input unit 21, and a word as a recognition result is input to the dictionary search unit 24.
To supply.

The dictionary search unit 24 converts the word as a recognition result supplied from the speech recognition unit 22 into a word dictionary 23.
Is used to perform a dictionary search. Then, word information as a search result, for example, in the case of Japanese, information such as kanji,
In addition, when a plurality of words are searched, information such as homonyms is used, and when the speech recognition is ambiguous, a plurality of search results are set as candidates for the speech recognition results, and the search result display unit 25 is used.
To supply.

The search result display unit 25 displays the word information supplied from the dictionary search unit 24. At this time, if there are a plurality of words that have been voice-recognized, the information of the words is displayed one by one in order, and the system waits for the right or wrong indication.

For example, “YES / NO” or [OK /
Wait for the word "NG" to be input from the voice input unit 26. The voice input unit 26 has a simple voice recognition function, and when “YES” or “OK” is input, the information of the currently displayed word is correct in the search result display unit 25. Is supplied. Upon receiving this signal, the search result display unit 25 determines that the currently displayed word is a correct recognition result, and displays that word in the camera unit 1.
2 to the optical disk recorder recording unit 27.

On the other hand, when "NO" or "NG" is input, the voice input unit 26 supplies a signal to the search result display unit 25 indicating that the information of the currently displayed word is incorrect. I do. Upon receiving this signal, the search result display unit 25 determines that the currently displayed word is not a correct recognition result, and displays the next word. Then, it waits again for the word “YES / NO” indicating the right or wrong to be input from the voice input unit 26 by voice.

From the voice input unit 21, for example, when / where / who / what kind of operation / operation was performed is input.
To be more specific, a voice prompt reads, Kobayashi Kotoshi is the best friend, Fuji's Kyoju is going to meet you
XXXX, man, twenty-six, ", the speech recognition unit 21 extracts a word corresponding to the input speech from the word dictionary 23 and supplies the word to the dictionary search unit 24. The dictionary search unit 24 searches the word dictionary 23 for detailed information on the words recognized by the speech recognition unit 22.

For example, for "Keiodaigaku", "Keio University" registered in the word dictionary 23 in advance is searched. When there are a plurality of search results, as described above, the plurality of search results are sequentially displayed, and one of them is selected by voice. Similarly, other words are searched from the word dictionary 23 and corresponding information is extracted. In this way, the keyword corresponding to the input voice is determined.

In the case of the above example, the following keywords are determined as a result of the speech recognition. That is, “0821198/1
000-1200 / Keio University School of Medicine / Shinanomachi / Lecturer Kobayashi / Professor Fujino / Skull molding / Plastic insertion / Patient name:
***** / male / 25 years old. "

Here, each keyword is represented by an alphabet (A, B, C, D, E, F, G, H, I, J, K) or a number (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 1
Instead of 1), for example, a search formula such as ((A + B) * E * I) may be created and supplied to the optical disk recorder recording unit 27 together with the keyword. In the above retrieval formula, “+” represents a logical sum, and “*” represents a logical product.

The optical disk recorder recording unit 27 writes the keyword supplied from the search result display unit 25, that is, a code corresponding to one or a plurality of keywords, in the system data shown in FIG. Also, the search result display section 2
When the search formula is supplied from 5, the search formula is also written after the keyword.

At this time, as described above, the search result display unit 25 displays one or a plurality of voice-input keywords (words) for each video / frame (still image) so that a keyword search can be performed later. ) And, if necessary, a search formula to the optical disk recorder recording unit 27. For example, as in the above example, “0821198 / 1000-1200 / Keio University School of Medicine / Shinanomachi / Lecturer Kobayashi / Professor Fujino / Skull Molding / Plastic Insertion / Patient Name: **** / Male / 25
Age ”and a search expression ((A + B) * E *
I) is supplied to the optical disk recorder recording unit 27.

The optical disk recorder recording section 27 records the keyword and the search formula in the system data of video data and the system data of audio data of the frame shown in FIG.

In this way, for each frame (still image) constituting a video, the keyword input by voice can be recorded, and if necessary, can be recorded while generating a search formula.

After photographing, for example, “0821198/10
00-1200 / Lecturer Kobayashi / Patient name: **** / ", the optical disk 28 of the camera unit 12 is searched for a frame in which the same keyword as the inputted keyword is recorded in the system data, and Video or still image to be extracted is extracted. When there are a plurality of applicable videos or still images, multiple images are displayed on a small screen obtained by dividing the screen.
Here, by instructing a predetermined video or still image,
In the case of a video, the designated video is reproduced, and in the case of a still image, the video is displayed on the entire screen.

As described above, at the time of photographing, a word input by voice is recognized, a dictionary search is automatically performed on the word, and the search result is recorded in association with the currently recorded video and audio. Then, a search based on the keyword can be performed later, so that the editing work becomes easy and the editing can be performed at high speed. In addition, archiving can be easily performed via a keyword search.

Further, since the keyword is input by voice, it can be used even in a situation where hands cannot be released, such as a doctor during surgery.

In the above embodiment, the case where the present invention is applied to a medical camera has been described. However, the present invention can be applied to automatic editing, automatic archiving, high-speed archiving, and the like.

In the above embodiment, the case where the present invention is applied to an optical disk camera device has been described. However, the present invention can be applied to other image pickup devices such as a digital video camera.

Further, the frame format in the above embodiment is an example, and the present invention is not limited to this.

[0042]

As described above, according to the information recording apparatus, the information recording method, and the recording medium according to the present invention, a video is
Input, input voice, recognize input voice, voice
Is converted to a word corresponding to
Generates the corresponding code, the input video and the generated
Associated with the code corresponding to the word
To record. At this time, the word and information about the word are related.
Attach and memorize, and voice based on the memorized words
And convert the information of the recognized word to the stored word
Search, display the information of the searched word, multiple information
When is searched, a plurality of pieces of information are sequentially displayed, and
Select one piece of information from the information and correspond to the selected information.
The word code is recorded on a recording medium .
While recording video and audio with a video camera, etc., a keyword can be input by voice input, and a keyword can be added to the video and audio for recording. Can be searched.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration example of an embodiment of an optical disk camera device to which an information recording device of the present invention is applied.

FIG. 2 is a block diagram showing an example of an internal electrical configuration of the embodiment of FIG. 1;

FIG. 3 is a diagram illustrating an example of a frame format.

[Explanation of symbols]

 Reference Signs List 1 optical disk camera device 11 lens unit 12 camera unit 13 microphone 14, 15 driver 21, 26 voice input unit 22 voice recognition unit 23 word dictionary 24 dictionary search unit 25 search result display unit 27 optical disk recorder recording unit 28 optical disk

Claims (7)

(57) [Claims] 1. A video input unit for inputting a video, a voice input unit for inputting a voice, a voice recognition unit for recognizing the voice input by the voice input unit and converting the voice into a word corresponding to the voice. Generating means for generating a code corresponding to the word recognized and converted by the voice recognizing means; the video input by the video input means; and the video corresponding to the word generated by the generating means. A recording unit that records a predetermined recording medium in association with a code, and stores the word and information about the word in association with each other.
Storage means, and information of the word recognized by the voice recognition means
Searching means for searching the storage means, and displaying information on the word searched by the searching means.
Display means, and when a plurality of pieces of information are searched by the search means,
Display means to sequentially display a plurality of pieces of information,
Selecting means for selecting one piece of information , wherein the voice recognizing means is configured to store information stored in the storage means.
Converting the voice into the word based on the notation word, wherein the recording unit selects the word selected by the selection unit
An information recording apparatus , wherein a code of a word corresponding to information is recorded on the recording medium . 2. An image input means for inputting an image, an audio input means for inputting audio, and recognizing the audio input by the audio input means.
Voice recognition means for converting the voice into a word corresponding to the voice
And the unit recognized and converted by the voice recognition unit.
Generating means for generating a code corresponding to a word, the video input by the video input means,
The command corresponding to the word generated by the generating means;
Recording means for recording in a predetermined recording medium in association with a code
And stores the word and the information on the word in association with each other.
Storage means, and information of the word recognized by the voice recognition means
Searching means for searching the storage means, and displaying information on the word searched by the searching means.
Display means, and when a plurality of pieces of information are searched by the search means,
Display means to sequentially display a plurality of pieces of information,
Selecting means for selecting one piece of information , wherein the voice recognizing means is configured to store information stored in the storage means.
Converting the voice into the word based on the notation word, wherein the recording unit selects the word selected by the selection unit
Search expression generation for recording a code of a word corresponding to information on the recording medium and generating a search expression from the code and a logical code
Means, wherein the recording means comprises the code and
The search expression is associated with the video and recorded on the recording medium.
An information recording apparatus which is characterized in that recording. 3. The display device according to claim 2 , wherein said selection means is displayed on said display means.
One piece of information from a plurality of pieces of said
3. The method according to claim 1, wherein the selection is made according to
Information recording device according to the above. Wherein said recording means, claims, characterized in that for recording the voice inputted by said voice input means, on the recording medium together with the image and the code
The information recording device according to 1, 2, or 3 . 5. A video input step of inputting a video, a voice input step of inputting a voice, a voice recognition step of recognizing the voice input in the voice input step and converting the voice into a word corresponding to the voice. A generation step of generating a code corresponding to the word recognized and converted in the voice recognition step; and the video input in the video input step;
A recording step of associating the code corresponding to the word generated in the generation step with recording on a predetermined recording medium, and storing the word and information about the word in association with each other
A storage step; and information of the word recognized in the voice recognition step.
Report from the word stored in the storing step
A search step for searching from the list, and information of the word searched in the search step.
A display step of displaying, and a plurality of pieces of information are searched in the search step.
A plurality of pieces of information are sequentially displayed in the displaying step.
Selection step of selecting one piece of information from a plurality of pieces of information
With the door, in the speech recognition step, said storing step
Based on the word stored in the
Converted into words, and in the recording step,
The code of the word corresponding to the information selected by
An information recording method characterized by recording on a recording medium . 6. A video input step of inputting a video , a voice input step of inputting audio, and recognizing the audio input in the audio input step.
Speech recognition step for recognizing and converting to words corresponding to the speech.
And-up, it is recognized in the speech recognition step, the converted pre
A generation step of generating a code corresponding to the notation word, and the video input in the video input step,
Corresponding to the word generated in the generating step.
The code is recorded on a predetermined recording medium in association with the code.
Recording step, storing the word and information about the word in association with each other
A storage step; and information of the word recognized in the voice recognition step.
Report from the word stored in the storing step
A search step for searching from the list, and information of the word searched in the search step.
A display step of displaying, and a plurality of pieces of information are searched in the search step.
A plurality of pieces of information are sequentially displayed in the displaying step.
Selection step of selecting one piece of information from a plurality of pieces of information
With the door, in the speech recognition step, said storing step
Based on the word stored in the
Converted into words, and in the recording step,
The code of the word corresponding to the information selected by
Search expression generation for recording on a recording medium and generating a search expression from the code and the logical code
The recording step further includes:
Associating the video with the code and the search formula,
An information recording method, wherein the information is recorded on the recording medium . 7. A recording medium on which a program capable of executing the information recording method according to claim 5 is recorded.