JP6749193B2 - Finding creation device, finding creation method, finding creation program, and recording medium recording the same - Google Patents

Description

The present disclosure relates to a finding creation device, a finding creating method, a finding creating program, and a recording medium recording the program, which can input a state or finding of a tooth by voice recognition.

Conventionally, as this type of finding creation device, for example, there is a dental diagnosis information processing device described in Patent Document 1 below. This dental diagnosis information processing device is recognized by a voice input unit for inputting a voice regarding the dental diagnosis information, and a voice recognition unit for analyzing the input voice signal and recognizing predetermined dental diagnosis data. Data storage means for storing the dental diagnosis data, and data display means for displaying the recognized dental diagnosis data.

JP-A-8-71091

An object of the present disclosure is to provide a finding creation apparatus, a finding creating method, a finding creating program, and a recording medium that records the program, the finding creating apparatus having a user interface that is easy for an operator to use.

The first aspect of the present disclosure is
A voice recognition unit that performs at least large vocabulary continuous voice recognition on a voice signal representing the utterance content,
Based on the result of the large vocabulary continuous speech recognition, when a predetermined signal indicating the end of character input is received while the first screen in which the characters representing the utterance content are permitted to be input is displayed. A second screen in which characters cannot be input based on the result of the large vocabulary continuous speech recognition, and a finding creation unit that switches the display of the display device ,
The voice recognition unit further performs small vocabulary word voice recognition,
On the second screen, a character creation based on the result of the small vocabulary word voice recognition is permitted, a finding creation device,
Directed to.

The second form of the present disclosure is
A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition;
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A procedure for switching the display contents of the display device to the permitted second screen, and a finding creation method comprising:
Directed to.

The third form of the present disclosure is
On the computer,
A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A finding creation program having a procedure for switching the display content of the display device to the permitted second screen,
Directed to.

The fourth aspect of the present disclosure is
On the computer,
A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition;
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A recording medium on which a finding creation program having a procedure for switching the display contents of the display device on the permitted second screen,
Directed to.

According to the present disclosure, it is possible to provide a finding creation device provided with a user interface that is easy for an operator to use, a finding creating method, a finding creating program, and a recording medium recording the finding.

The figure which shows the structure of the finding preparation apparatus which concerns on one Embodiment of this indication. Schematic diagram showing list screen Schematic diagram showing the finding creation screen Schematic diagram showing the status input screen Schematic diagram showing facial photograph screen, intraoral photograph screen and denture photograph screen A schematic diagram showing the photo editing screen Schematic diagram showing the note screen Schematic diagram showing names and other images Schematic diagram showing the setting change screen Schematic diagram showing the editing screen Schematic diagram showing the selection screen Schematic diagram showing the search screen Schematic diagram showing the output screen Schematic diagram showing the data operation screen Schematic diagram showing the finding deletion screen Schematic diagram showing the screen for creating backup data Schematic diagram showing the screen for restoring finding data Main flow diagram showing the processing of the finding creation device A first flow chart showing the detailed processing procedure of step S009 in FIG. 7A. A second flowchart showing the detailed processing procedure of step S009 in FIG. 7A. A third flowchart showing the detailed processing procedure of step S009 in FIG. 7A. Schematic diagram showing a GUI that prompts the operator to click a setting button Schematic diagram showing the transition of the display screen when the tooth-specific voice recognition result is received Schematic diagram showing the display screen when the tooth status is entered in the status input field Schematic diagram showing the display screen when setting the expression of teeth Schematic diagram showing the display screen when changing the reading of teeth Schematic diagram showing the display screen when changing the name of the examining doctor

Hereinafter, the finding creation device 19 according to an embodiment of the present disclosure will be described in detail with reference to the drawings.

<1. Dental findings creation system configuration>
In FIG. 1, a dental finding creation system 1 is installed in a police station or the like, and is used, for example, for identification confirmation in the event of a disaster. The dental finding creation system 1 can also be installed in a dental clinic and used for managing a patient's dental chart.

The dental finding creation system 1 roughly includes a voice input device 11, an operation input device 13, a data reading device 15, a communication device 17, a finding creation device 19, a display device 111, and a voice output device. And 113. The data reading device 15, the finding creation device 19, the display device 111, and the audio output device 113 may be incorporated in the same housing.

The voice input device 11 is, for example, a wired or wireless headset having a built-in microphone or a stationary microphone, and is connected to the finding creation device 19 by wire or wirelessly.

The voice input device 11 converts the voice input by the operator into an electric signal (hereinafter, referred to as a voice signal) and outputs the electric signal to the finding creation device 19. Examples of the voice signal include a voice signal indicating various voice commands (including a voice signal specifying a tooth and a tooth state) and a voice signal indicating a finding memo. Here, the finding memo is not a voice command, but is a relatively long sentence indicating the finding of a dentist or the like.

The operation input device 13 is, for example, a mouse and a keyboard, and is connected to the finding creation device 19 by wire or wirelessly.

The operation input device 13 converts an operation by a finger of an operator (for example, a dentist) into a specific electric signal (hereinafter, referred to as an operation signal) and outputs it to the finding creation device 19.

The data reading device 15 reads the data stored in a portable recording medium such as a disk or a semiconductor memory and transfers the data to the working memory 193 of the finding creating device 19.

The communication device 17 acquires data from a remote server or the like and transfers it to the working memory 193 of the finding creation device 19.

The finding creation device 19 generally includes various connectors and various interfaces (not shown), a storage device 191, a working memory 193, and a processor 195.

The storage device 191 is, for example, a hard disk drive or a semiconductor memory, and stores a voice recognition program P1, a voice input dental chart program (illustration is simply a dental chart program) P3, and various dictionaries D1 to D11 in advance. doing.

The voice recognition program P1 includes a large vocabulary continuous voice recognition program P11 and a small vocabulary word voice recognition program P13.

The large vocabulary continuous voice recognition program P11 is a program for realizing voice recognition of a voice signal output from the voice input device 11 without being limited to a voice command in order to enable voice recognition by so-called dictation. .. When the large vocabulary continuous speech recognition program P11 is executed, the large vocabulary continuous speech recognition dictionary D1 is used.

On the other hand, unlike the large vocabulary continuous voice recognition program P1, the small vocabulary word voice recognition program P13 is limited to voice commands, and is limited to voice commands for voice signals output from the voice input device 11. It is a program for realizing recognition. When the small vocabulary word voice recognition program P13 is executed, the small vocabulary word voice recognition dictionaries D3 to D11 excluding the large vocabulary continuous voice recognition dictionary D1 are used. Table 1 shows the details of the small vocabulary word voice recognition dictionaries D3 to D11.

As described in Table 1 above, the small vocabulary word voice recognition dictionary D3 defines the voice commands that can be used on the list screen I01 while the list screen I01 is being displayed on the display device 111. Other small vocabulary word voice recognition dictionaries D5 to D11 define voice commands that can be used while the corresponding screen is displayed on the display device 111.

The processor 195 executes both programs P1 and P3 while using the working memory 193, and functions as the voice recognition unit 197 and the finding creation unit 199.

Specifically, the voice recognition unit 197 receives the voice data output from the voice input device 11. The voice recognition unit 197 performs voice recognition on the received voice signal, and passes the voice recognition result obtained thereby to the processor 195 functioning as the finding creation unit 199. In the present disclosure, when the first screen described later (that is, the note screen I15 in FIG. 2F) is displayed, the speech recognition unit 197 causes the large vocabulary continuous speech recognition program P11 and the small vocabulary word speech recognition program P13 to recognize the large vocabulary word speech. This is executed while using the dictionary D1 and the small vocabulary word voice recognition dictionary D9, voice recognition is performed on the received voice signal, and the result is passed to the finding creation unit 199. On the other hand, at the time of displaying the second screen (that is, the dental chart screen I05 of FIG. 2B, the facial photograph screen I09, the intraoral photograph screen I11 and the denture photograph screen I13 of FIG. 2D, and the name and other screen I17 of FIG. , The small vocabulary word voice recognition program P13 is executed while using the corresponding small vocabulary word voice recognition dictionaries D3 to D7, D11, the voice recognition processing is performed on the received voice signal, and the result is found by the finding creating unit 199. To pass.

The finding creation unit 199 creates various screens related to creation, editing, and output of finding data based on the voice command that is the voice recognition result of the voice recognition unit 197 and the operation signal from the operation input device 13, and the created screen Is displayed on the display device 111. Further, while the note screen I15 is displayed, the finding creation unit 199 inputs a character representing a finding memo, which is the voice recognition result of the voice recognition unit 197, into the note input area R11.

The processor 195 performs various processes in addition to functioning as the voice recognition unit 197 and the finding creation unit 199. These will be described later as appropriate.

The display device 111 displays various screens (details will be described later) generated by the finding creation device 19.

The voice output device 113 outputs the voice signal generated by the finding creation device 19 as voice.

<2. Various screens displayed on the display>
Next, various screens displayed by the finding creation device 19 will be described in detail.
<2-1. List screen>
First, with reference to FIG. 2A, a list screen I01 displayed after starting the dental chart program P3 of FIG. 1 will be described.
In FIG. 2A, the list screen I01 includes a new creation button B01, a setting change button B03, a search button B05, an output button B07, a data operation button B09, an end button B11, and a finding list area R01.

Each of the buttons B01 to B11 is a button that can be clicked by a mouse or the like that constitutes the operation input device 13. The functions of the buttons B01 to B11 are as shown in Table 2 below. When the buttons B01 to B11 are clicked on the operation input device 13, the display content of the display device 111 is changed from the list screen I01 as shown in Table 2 below.

In Table 2 above, the new creation button B01 is assigned the function of switching to the display of the finding creation screen I03, and the setting change button B03 is assigned the function of switching to the display of the setting change screen I19. The functions described in Table 2 above are also assigned to the other buttons B01 to B11.

In the finding list area R01, existing finding data (that is, finding data stored in the storage device 191) is displayed in a list format. Each finding data is opened by double-clicking by the operation input device 13 and displayed on the display device 111.

<2-2. Observation creation screen>
Next, the finding creation screen I03 will be described with reference to FIG. 2B.
In FIG. 2B, the finding creation screen I03 is used when creating finding data of an unidentified person or patient (hereinafter referred to as unidentified person, etc.), and a plurality of permanent tooth status input fields C01 and a plurality of permanent tooth status selection buttons. B13, a plurality of screen switching tabs T01, a dental chart screen I05, a plurality of baby tooth condition input fields C03, a plurality of baby tooth condition selection buttons B15, a play button B17, and a close button B19.

In the center of the finding creation screen I03, by clicking the screen switching tab T01, any one of the dental chart screen I05, the facial photograph screen I09, the intraoral photograph screen I11, the denture photograph screen I13, the notebook screen I15, and the other screen I17 is displayed. Is selectively displayed.

The permanent tooth status input field C01 is provided for each tooth (specifically, permanent tooth). In the following description, the right means the right from the back of the paper to the front.

On the upper right side of the finding creation screen I03, the state input fields C01 of the upper right 1 to the upper right 8 in the mouth are arranged in order from top to bottom. At the lower right of the finding creation screen I03, lower right first to lower right permanent tooth status input fields C01 at the lower right of the mouth are arranged in order from bottom to top. It should be noted that a plurality of permanent tooth status input fields C01 at the upper left and lower left are sequentially arranged at the upper left and lower left of the finding creation screen I03.

Note that, in FIG. 2B, for convenience of illustration, the upper right permanent tooth state input field C01 is surrounded by a broken line, and these are collectively denoted by the reference symbol C01.

A character string (more specifically, a tooth state) generated based on the voice recognition result can be input to each permanent tooth state input field C01. It should be noted that the character input here may be based on an operation signal from a keyboard constituting the operation input device 13. The input character string is displayed in the corresponding permanent tooth status input field C01.

When a tooth is selected by voice or the like, the inside of the corresponding permanent tooth status input field C01 is highlighted in a specific color (for example, red). In the example of FIG. 2B, since the left upper Cth milk tooth is being selected, none of the permanent tooth status input fields C01 is highlighted.

The state selection button B13 is provided for each permanent tooth. In the present embodiment, a state selection button B13 for the corresponding permanent tooth is arranged next to each permanent tooth state input field C01.

Note that, in FIG. 2B, for convenience of illustration, each state selection button B13 for the upper right permanent tooth is surrounded by a broken line, and the reference numeral B13 is collectively attached to these.

Each state selection button B13 is assigned a function of overlaying a corresponding tooth state input screen I07 (see FIG. 2C) on the finding creation screen I03.

Here, the state input screen I07 will be described with reference to FIG. 2C. Note that FIG. 2C exemplifies the upper left first permanent tooth status input screen I07.

In FIG. 2C, each status input screen I07 includes an input box C05, a clear button B21, a plurality of status buttons B23, and a close button B25.

A character string indicating the state of the tooth is input to the input box C05.
A function of clearing the character string in the input box C05 is assigned to the clear button B21.

A character string indicating the tooth state is individually assigned to the plurality of state buttons B23. Examples of these character strings include healthy teeth, defects (with alveolar fossa), inlay restoration, onlay restoration, and the like. When a certain state button B23 is clicked on the operation input device 13, the character string of the state of the tooth assigned to the button B23 is input and displayed in the input box C05.

Note that, in FIG. 2C, for convenience of illustration, the all-state button B23 is surrounded by a broken line, and these are collectively denoted by the reference symbol B23.

The close button B25 is assigned a function of inputting/displaying the character string displayed in the input box C05 in the corresponding status input field C01 on the finding creation screen I03 and ending overlay display of the status input screen I07. ing.

Referring again to FIG. 2B.
One of the dental chart screen I05, the facial photograph screen I09, the intraoral photograph screen I11, the denture photograph screen I13, the note screen I15, and the name and other screen I17 is assigned to each of the plurality of screen switching tabs T01.

When a screen switching tab T01 is clicked on the operation input device 13, the contents displayed on the display device 111 are assigned to the clicked tab T01 (dental chart screen I05, facial photograph screen I09, intraoral photograph screen I11). , The denture photo screen I13, the note screen I15, and the name other screen I17).

The dental chart screen I05 includes images representing tooth rows of permanent teeth and milk teeth. In the example of FIG. 2B, the tooth row of the upper permanent teeth is represented by a schematic tooth shape as viewed from below and is shown above the dental chart screen I05. The lower row of permanent teeth is represented by a schematic shape as viewed from above, and is shown below the upper row of teeth.

The upper dentition tooth row is represented by a schematic tooth shape as viewed from below the tooth row, and is shown inside the upper permanent tooth row. The lower dentition dentition is represented by a typical tooth shape as seen from the top of the dentition, and is shown inside the lower permanent dentition. As a result, the space of the dental chart screen I05 is effectively used.

The milk teeth are grayed out in the initial state. While selecting a tooth, the corresponding tooth is surrounded by a circle of a specific color (for example, red).

The milk tooth status input field C03 is provided for each milk tooth.
The state input fields C03 of the upper right A to the upper right E in the mouth are from top to bottom between the permanent tooth status input field C01 on the upper right and the permanent tooth status input field C01 on the lower right in the finding creation screen I03. And arranged in order. Below the lower right permanent tooth status input field C01, lower right A to lower right E teeth status input fields C03 in the mouth are arranged in order from top to bottom.

The upper left and lower left deciduous tooth status input fields C03 are arranged laterally opposite to the upper right and lower right deciduous tooth status input fields C03 with the dental chart screen I05 and the like interposed therebetween.

Note that, in FIG. 2B, for convenience of illustration, a plurality of state input fields C03 for the upper left milk teeth are surrounded by broken lines, and these are collectively denoted by reference numeral C03.

Like each permanent tooth status input field C01, the tooth status based on the voice recognition result or the operation signal can be input to each milk tooth status input field C03. The tooth status input in the primary tooth status input field C03 is displayed on the screen of the display device 111.

As in the case of the permanent tooth status input field C01, while a certain milk tooth is being selected, the inside of the corresponding milk tooth status input field C03 is highlighted in a specific color (for example, red). In the example of FIG. 2B, it is shown that the left upper Cth milk tooth is being selected.

The milk tooth state selection button B15 is provided for each milk tooth. In the present embodiment, a status selection button B13 for a corresponding permanent tooth is arranged next to each milk tooth status input field C03.

Each state selection button B15 is assigned the function of overlaying the corresponding tooth state input screen I07 (see FIG. 2C) on the finding creation screen I03.

The primary tooth status input screen I07 has the same configuration as the permanent tooth status input screen I07, and therefore a description thereof will be omitted. Further, in FIG. 2B, for convenience of illustration, the left upper milk tooth condition selection button B15 is surrounded by a broken line, and these condition selection buttons are collectively denoted by reference numeral B15.

The play button B17 is assigned the function of starting reading the character string input on the note screen I15.
The close button B19 is assigned a function of returning the display content of the display device 111 to the list screen I01 described above.

By the way, as described above, by clicking the screen switching tab T01, the display content of the display device 111 is switched to not only the dental chart screen I05 but also the facial photograph screen I09, the intraoral photograph screen I11, or the denture photograph screen I13.

The facial photograph screen I09, the intraoral photograph screen I11, and the denture photograph screen I13 will be described below with reference to FIG. 2D.

A facial photograph screen I09, an intraoral photograph screen I11, and a denture photograph screen I13 are shown in the upper, middle, and lower rows of FIG. 2D.

In the central areas R03, R05, R07 of the facial photograph screen I09, the intraoral photograph screen I11, and the denture photograph screen I13, the facial photograph of the unidentified person, the intraoral photograph, and the like by dragging and dropping using the operation input device 13 It is possible to attach denture photos. The facial photograph, intraoral photograph, and denture photograph thus pasted together form a part of the finding data and are stored in the storage device 191.

When the stored facial photograph, intraoral photograph, and denture photograph are clicked on the operation input device 13, an edit screen I19 for each photo as shown in FIG. 2E is displayed as an overlay on the finding creation screen I03.

In FIG. 2E, each edit screen I19 has a display area R09 for stored photographs (one of a facial photograph, an intraoral photograph and a denture photograph), a close button B27, a left rotation button B29, an undo button B31, and a right rotation. It is composed of a button B33 and a delete button B35.

A function of ending the overlay display of the edit screen I19 is assigned to the close button B27.
The function of rotating the photo displayed in the display area R09 by 90° counterclockwise is assigned to the left rotation button B29.

The restore button B31 is assigned a function of returning the photo being edited to the initial state (the state at the time when the editing screen I19 is displayed).
The right rotation button B33 is assigned with a function of rotating the photo displayed in the display area R09 clockwise by 90°.

By the way, as described above, by clicking the screen switching tab T01, the display content of the display device 111 is switched not only to the dental chart screen I05 but also to the note screen I15.

Hereinafter, the note screen I15 will be described with reference to FIG. 2F.
In FIG. 2F, the note screen I15 includes a note input area R11 and a voice command display area R13.

In the note input area R11, basically, a character string indicating the voice recognition result by the voice recognition unit 197 is input and displayed. The note screen I15 is mainly used by a dentist to write a finding memo. Therefore, what is input/displayed in the note input area R11 is typically a character string representing a finding memo.

In the voice command display area R13, available voice commands are listed and displayed at least while the note screen I15 is being displayed. In the finding finding device 19, it is assumed that 11 kinds of voice commands shown in Table 3 below are defined.

In Table 3 above, the voice command “end” is assigned a function of ending the input of the voice recognition result by the voice recognition unit 197 to the note input area R11 (that is, dictation input). The voice command “return to first” is assigned a function of moving the cursor in the note input area R11 to the beginning of the character string that has already been input. The functions described in Table 3 above are also assigned to other voice commands.

By the way, as described above, by clicking the screen switching tab T01, the display content of the display device 111 is switched not only to the dental chart screen I05 but also to the name and other screen I17.

The name and other screen I17 will be described below with reference to FIG. 2G.
In FIG. 2G, the name and other screen I17 is configured to be able to set various item information P01 regarding finding data. In the present disclosure, as shown in FIG. 2G, the case name, examination date, examination doctor, life and death, sex, estimated age, actual age, discovery date, discovery location, and examination location can be set. Table 4 shows the definition of each item.

The item information described in Table 4 above is basically input or set based on the operation information from the operation input device 13.

Among the above item information, in particular, the examining doctor can select the doctor registered on the setting change screen I19 described later from the pull-down menu M01.
Further, as the inspection location, the inspection location registered on the setting change screen I19 described later is displayed as an initial value.
As the case name, a name that identifies the identity confirmation business is input based on the operation information of the operation input device 13.

<2-3. Setting change screen>
As described above, in FIG. 2A, the setting change button B03 is assigned the function of switching the display to the setting change screen I19. The configuration of the setting change screen I19 will be described below with reference to FIG. 3A.

The setting change screen I19 is used to read each tooth and set the state of the tooth to be input. The setting change screen I19 is further used to set a doctor name that can be selected on the name and other screens and an initial value of the examination location. Therefore, the setting change screen I19 includes a dental chart area R15, a tooth reading list area R17, a tooth status list area R19, an examination doctor list area R21, and an examination area input area R23. To be done.

The dental chart region R15 is a region at the right end of the setting change screen I19, and is configured so that the operator can visually recognize the tooth row and the information that identifies each tooth.

The tooth reading list area R17 is an area to the left of the dental chart area R15, and readings for identifying each tooth by voice are set and displayed for each tooth. As will be described in detail later, a plurality of readings of each tooth can be set by using a predetermined delimiter.

The tooth condition list area R19 is an area to the right of the tooth reading list area R17. In the tooth status list area R19, a setting button B37 is arranged for each tooth status. For convenience of illustration, in FIG. 3A, the setting button at the upper right of the tooth status list region R19, which is the setting button for the tooth status “healthy”, is denoted by reference numeral B37.

Each setting button B37 is assigned with a function of overlaying the edit screen I21 of the corresponding tooth state on the setting change screen I19.

Here, the edit screen I21 will be described with reference to FIG. 3B. It should be noted that FIG. 3B exemplifies the edit screen I21 of the tooth state “healthy”.

In FIG. 3B, each edit screen I21 includes a name input box C07, a reading input box C09, a color button B39, a tooth expression button B41, an OK button B43, and a cancel button B45.

In the name input box C07, a character string indicating the name of the tooth state is input and displayed.
In the reading input box C09, the reading of the character string input in the name input box C07 is input and displayed.

A function of setting the color of the corresponding setting button B37 is assigned to the color button B39. When the color button B39 is clicked, for example, a color chart (not shown) is further overlaid and displayed. The color operated by the operation input device 13 is set as the color of the setting button B37.

The function of setting the expression of the tooth state in the dental chart image I05 is assigned to the tooth expression button B41. When the tooth expression button B41 is clicked, a tooth expression image selection screen I23 as shown in FIG. 3C is further displayed in overlay.

In FIG. 3C, on the selection screen I23, a sample image G01 that is prepared in advance and that represents a plurality of different (14 in the drawing) different tooth expression methods is displayed in a selectable manner. It should be noted that it is impossible to specify a method for expressing a tooth having an occlusal surface for teeth having no occlusal surface such as permanent teeth Nos. 1 to 3 and milk teeth No. A to C.

Referring again to FIG. 3B.
The OK button B43 is assigned the function of applying the contents changed on the edit screen I21 and ending the overlay display of the edit screen I21.
The cancel button B45 is assigned with a function of discarding the contents changed in the edit screen I21 without applying them and ending the overlay display of the edit screen I21.

Here, FIG. 3A is referred to again.
The examination doctor list region R21 is arranged on the left side of the tooth condition list region R19. The name of the examination doctor is added to or deleted from the examination doctor list area R21.
The examination area input region R23 is arranged below the examination doctor list. In the input area R23 of the inspection place, the initial value of the inspection place of the newly created finding data is entered.

<2-4. Search screen>
As described above, in FIG. 2A, the function of switching to the display of the search screen I25 is assigned to the search button B05. The configuration of the search screen I25 will be described below with reference to FIG. 4A.

The search screen I25 is used to search the existing finding data stored in the storage device 191 for the one containing the condition designated by the operator using the operation input device 13. Therefore, the search screen I25 includes a search condition input area R25 and a search result output area R27.

The search condition input area R25 is a substantially left half area of the search screen I25. Various search conditions are input and displayed in the search condition input area R25. In the present disclosure, items that can be input/set on the finding creation screen I03 are configured to be input/displayable as search conditions.

The search result output area R27 is an area in which the search result is displayed in response to the operation of the search button B47 arranged in the search condition input area R25.

<2-5. Output screen>
As described above, in FIG. 2A, the function of switching to the display of the output screen I27 is assigned to the output button B07. Hereinafter, the configuration of the output screen I27 will be described with reference to FIG. 5A.

The output screen I27 is used to output existing finding data in a specified format, and mainly includes an output destination input area R29, an output format selection button B51, a character code selection button B53, and a close button B55. , And an output button B57.

In the output destination input area R29, the output destination of the existing finding data is input based on the operation information. By clicking the reference button B47 arranged next to the output destination input area R29, a dialog that allows selection/designation of the output destination input area R29 is displayed in overlay.

The output format selection button B51 is used to select the output format of the finding data by operating the operation input device 13. In the present disclosure, a predetermined word processor format and a csv (comma-separated values) format are alternatives.

The character code selection button B53 is used when the csv format is selected, and is used to select a character code and a line feed code by operating the operation input device 13.

The close button B55 is assigned the function of ending the overlay display of the output screen I27.

The output button B57 is used when the file is output in the output format designated by the output destination designated on the output screen I27 by operating the operation input device 13.

<2-6. Data operation screen>
As described above, in FIG. 2A, the data operation button B09 is assigned the function of switching to the display of the data operation screen I29. The configuration of the data operation screen I29 will be described below with reference to FIG. 6A.

The data operation screen I29 is used for deleting any existing finding data, creating a backup, and restoring finding data from the created backup. Therefore, the data operation screen I29 includes a delete button B59 for existing findings, a backup creation button B61, a backup restore button B63, and a close button B65.

The deletion button B59 of the existing finding is assigned a function of switching to the display of the finding deletion screen I31. As shown in FIG. 6B, the finding deletion screen I31 includes an finding list area R31, a delete button B67, and a close button B69.

In the finding list area R31, the definable finding data are listed, and the finding data to be deleted can be selected by operating the operation input device 13.

A function of deleting the selected finding data is assigned to the delete button B67.

A function of returning the display of the finding deletion screen I31 to the data operation screen I29 is assigned to the close button B69.

Referring again to FIG. 6A. The backup creation button B61 is assigned the function of switching to the display of the screen I33 for creating backup data of existing finding data. As shown in FIG. 6C, the screen I33 includes an output destination input area R33, a close button B71, and a create button B73.

In the output destination input area R33, the output destination of the backup data to be created is input based on the operation information. By clicking the reference button B75 arranged next to the output destination input area R33, a dialog (not shown) that allows selection/designation of the output destination input area R33 is displayed in an overlay manner.

The close button B71 is assigned a function of ending the display of the screen I33 and returning to the display of the data operation screen I29.

The create button B73 is used when the backup data is output in the output format specified in the output destination specified in this screen I33 by operating the operation input device 13.

Referring again to FIG. 6A. The backup restore button B63 is assigned the function of switching to the overlay display of the screen I35 for restoring backup data as existing finding data. As shown in FIG. 6D, the screen I35 includes a backup folder designation area R35, a close button B77, and a restore button B79.

In the backup folder designation area R35, the storage location of backup data is input based on the operation information. By clicking the reference button B81 arranged next to the backup folder designation area R35, a dialog (not shown) that allows selection/designation of the backup folder designation area R35 is displayed in overlay.

The close button B77 is assigned a function of ending the display of the screen I35 and returning to the display of the data operation screen I29.

The restore button B79 is used when the backup data in the storage location designated on the screen I35 is restored to the finding data by operating the operation input device 13.

<3. Processing of finding device>
Next, the processing of the finding creation device 19 will be described in detail with reference to FIGS. 7A and 7B.
When the operator performs a predetermined operation to activate both programs P1 and P3, the processor 195 functions as a voice recognition unit 197 and continuously outputs from the voice input device 11 set to ON. Well-known small-scale word voice recognition processing is always performed on the voice signal, and the voice recognition result (that is, character data) is passed to the finding creation unit 199 through the working memory 193 (step S001 in FIG. 7A).

Further, the processor 195 also functions as the finding creation unit 199, and immediately after activation, first, the list screen I01 shown in FIG. 2A is generated and displayed on the display device 111, and the dictionary used for voice recognition is set to the small vocabulary word voice. The recognition dictionary (for list screen) D3 is switched to (step S003).

Next, the finding creation unit 199 determines whether or not the new creation button B01 has been operated (step S005). If NO is determined, the process transitions to step S007 described below.

On the other hand, if YES is determined in step S005, the finding creating unit 199 creates the finding creating screen I03 to create new finding data, and displays the display content of the display device 111 from the list screen I01 to the finding creating screen I03. Then, the finding creation screen I03 is displayed (step S007). At this time, a dental chart screen I05 is displayed in the central portion of the finding creation screen I03, and the dictionary used for small vocabulary word voice recognition is switched to the small vocabulary word voice recognition dictionary (for dental chart) D5.

Here, an operator (for example, a dentist) can also input characters on the dental chart screen I05 by operating an operation input device. In addition, the operator utters a voice representing a predetermined voice command toward the voice input device 11, so that on the dental chart screen I05, based on the small vocabulary word voice recognition result by the voice recognition unit 197, It is also possible to enter the status in characters. In other words, the dental chart screen I05 is an example of the second screen in which characters cannot be input based on the result of the large vocabulary continuous speech recognition.

Therefore, for example, in the process of switching the display from the list screen I01 to the dental chart screen I05, the finding creation unit 199 sets the setting button B83 for setting the input of the voice input device 11 to ON, as shown in FIG. 8A. Encourage the operator to click.

After that, the finding creation unit 199 creates finding data (step S009).
Hereinafter, the detailed processing of step S009 will be described with reference to FIG. 7B.

The operator operates the screen switching tab T01 with the operation input device 13 to select the dental chart screen I05 (step S100), and then opens an unidentified person or the like with his or her own finger to view the inside of the oral cavity. On the other hand, the voice command for specifying the tooth for which the state is to be input is uttered to the voice input device 11. When the voice command specifying the tooth is input, the voice input device 11 outputs a voice signal indicating the voice command to the voice recognition unit 197.

The voice recognition unit 197 performs a small vocabulary word voice recognition process on the input voice signal while the dental chart screen I05 is displayed on the display device 111, and a voice recognition result (word) that identifies a tooth is found by the finding creation unit. Hand it over to 199.

When the finding creation unit 199 receives the voice recognition result that identifies the tooth (step S101), as illustrated in FIG. 8B, the target tooth is surrounded by a circle of a predetermined color on the dental chart screen I05, and the state of the target tooth is also determined. The input fields C01 and C03 are selected and the inside thereof is highlighted with a specific color (step S103). In FIG. 8B, the case where the voice recognition result is “Migiue Ichiban” and the state input columns C01 and C03 are the permanent tooth state input column C01 is illustrated.

The operator speaks a voice command specifying a tooth while diagnosing the oral cavity of an unidentified person or the like, and then speaks a voice command indicating the state of the tooth toward the voice input device 11. When the voice representing the state of the tooth is input, the voice input device 11 outputs a voice signal representing the voice to the voice recognition unit 197.

The voice recognition unit 197 performs the small vocabulary word voice recognition process on the input voice data, and passes the result of the voice recognition indicating the state of the tooth to the finding creation unit 199.

When the finding creation unit 199 receives the voice recognition result indicating the state of the tooth after step S103 (step S105), as shown in FIG. 8C, the state input fields C01 and C03 selected in step S101 indicate the tooth state. Is input in characters and displayed (step S107). FIG. 8C exemplifies a case where the voice recognition result is “enshin”.

At this time, when the expression image of the tooth is previously assigned to the received tooth state (YES in step S109), the finding creation unit 199 is surrounded by a circle in the dental chart screen I05 as shown in FIG. 8D. The expression of the tooth is changed to the one assigned in advance (step S111).
The operator repeatedly speaks to the voice input device 11 the voice that specifies the tooth for which the state is to be input and the state of the tooth. Each time, the finding creation unit 199 executes steps S101 to S111. Then, when the diagnosis of the oral cavity of the unidentified person is completed, the operator speaks to the voice input device 11 with a predetermined voice command “end” to close the dental chart screen I05. As a result, the voice recognition result indicating the voice command “end” is passed from the voice recognition unit 197 to the finding creation unit 199.

If NO is determined in step S109, or next to step S111, the finding creation unit 199 determines whether the close button B19 has been operated (step S114). If YES is determined, the finding creation unit 199 exits the process of step S009 (the process of FIGS. 7A to 7B) and performs step S017 of FIG. 7A. On the other hand, when it is determined NO in step S114, the finding creation unit 199 returns to step S100 in FIG. 7B.

In some cases, the operator may want to correct the state of the tooth that has been input. In this case, the operator speaks to the voice input device 11 a voice that specifies the tooth for which the state is to be input and a voice command “clear” that erases the state of the tooth.

Upon receiving the voice command “clear”, the finding creation unit 199 clears the tooth state already input in the state input fields C01 and C03 selected in step S101, as shown in FIG. 8D. It should be noted that the states are inserted into the state input fields C01 and C03 in the order in which they are uttered, but as for the representation image of the tooth on the dental chart screen I05, the one entered last has priority.

When the operator wants to confirm the state of the tooth entered in the state input fields C01 and C03, he or she operates the operation input device 13 to specify the tooth and then operates the reproduction button B17. In response to this, the finding creation unit 199 performs the reading process of the state of the designated tooth, and causes the voice output device 113 to output voice data representing the state of the tooth.

As described above, the second screen is a screen in which characters cannot be input based on the result of the large vocabulary continuous speech recognition, and the dental chart screen I05 is given as an example. In the present disclosure, the dental chart screen I05, the facial photograph screen I09, the intraoral photo screen I11, the denture photo screen I13, the note screen I15, and the name and other screen I17 that can be switched by the screen switching tab T01 are the only screens other than the note screen I15. Predefined as a dual screen.

An operator (dentist or assistant) may take a facial photograph, an intraoral photograph, and a denture photograph of an unidentified person or the like. In this case, these image data are transferred to the finding creation device 19 via the data reading device 15 and the communication device 17.

In this case, the operator operates the screen switching tab T01 to display the facial photograph screen I09, the intraoral photograph screen I11 and the denture photograph screen I13, and the respective central areas R03, R05, R07 (see FIG. 2D). ) By dragging and dropping. In the finding creating apparatus 19, the finding creating unit 199, in the case of NO in step S100, determines whether any of the facial photograph screen I09, the intraoral photo screen I11, and the denture photo screen I13 is selected (see FIG. 7C). If YES in step S115), the facial photograph screen I09, the intraoral photograph screen I11, and the denture photograph screen I13 are displayed, and the dictionary to be used is switched to the small vocabulary word voice recognition dictionary (for each photograph screen) D7 ( Step S116). After that, the finding creation unit 199 stores the image data of the facial photograph, the intraoral photograph, and the denture photograph in the storage device 191 according to the operation signal of the operation input device 13 (step S117). After that, the finding creation unit 199 returns to step S100 of FIG. 7B.

It should be noted that if a face photograph, an intraoral photograph and a denture photograph of an unidentified person or the like cannot be taken, naturally, the face photograph screen I09, the intraoral photograph screen I11 and the denture photograph screen I13 are not pasted.

When the operator wants to record a finding memo, the operator operates the screen switching tab T01 on the input operation device 13 to display the note screen I15. After that, the operator speaks a voice representing the finding memo to be recorded toward the voice input device 11, and finally speaks a voice command “end”. During this period, in the finding creating device 19, the finding creating unit 199 determines NO in step S115, and then determines whether the note screen I15 is selected (step S119). When determining YES, the finding creating unit 199 determines The notebook screen I15 as another example of the first screen is displayed, and the dictionary to be used is switched to the small vocabulary word voice recognition dictionary (for notebook) D9 (step S121).

Next, the finding creation unit 199 determines whether it has transitioned from another screen and switched to the note screen I15, or has received the voice command “note” from the voice recognition unit 197 (step S122).

If NO is determined in step S122, the finding creation unit 199 performs step S100 of FIG. 7B.

On the other hand, if YES is determined in step S122, the voice recognition unit 197 starts executing the large-scale continuous voice recognition program P11 while using the large-scale continuous voice recognition dictionary D1, and displays the note screen I15 as the first screen. The middle vocabulary continuous voice recognition is performed on the input voice signal from the voice input device 13, and the result is passed to the finding creating unit 199.

The finding creation unit 199 inputs the large vocabulary continuous speech recognition result received from the speech recognition unit 197, that is, the character representing the finding memo into the note input area R11 of the note screen I15 and displays it (step S123). When the finding creation unit 199 receives the voice command “end” (YES in step S125), the content of the note input area R11 is stored in the storage device 191 (step S127), and the display content of the display device 111 is changed to the note screen. By switching from I15 to the facial photograph screen I09 as an example of the second screen, the execution of large vocabulary continuous speech recognition is terminated and the character input by so-called dictation to the notebook screen I15 is disabled (step S129). After that, the finding creation unit 199 returns to step S100 of FIG. 7B.

During creation of the finding memo, the operator can correct the finding memo while using the voice command described in the voice command display area R13.

Further, while the note screen I15 is displayed, the operator operates the operation input device 13 to operate the play button B17. In response to this, the finding creation unit 199 performs reading processing of the finding memo described in the note input area R11, and causes the audio output device 113 to output voice data representing the finding memo.

When the operator wants to set the case name, inspection date, etc., the operator operates the screen switching tab T01 on the input operation device 13 to display the name and other screen I17. After that, the operator operates the input operation device 13 to input the case name, the inspection date, and other necessary items. During this time, when the name and other screen I17 is selected (step S131 in FIG. 7D), the finding creation unit 199 displays the name and other screen I17 and uses the dictionary as the small vocabulary word voice recognition dictionary (for name and other screen). Switching to D11 (step S133), based on the received operation information, necessary items are input and displayed on the name and other screen I17 (step S135). After step S135, or when it is determined to be NO in step S131, the finding creation unit 199 returns to step S100 in FIG. 7B.

The finding data created as described above includes at least a dental chart. Further, in some cases, the finding data includes a facial photograph, an intraoral photograph and a denture photograph, a finding memo, a business office name, and the like. Such finding data is stored in the storage device 191.

Here, FIG. 7A is referred to again. If NO in step S005, step S011 is performed. In step S011, the finding creation unit 199 determines whether the setting change button B03 has been operated.

If YES is determined in step S011, the finding creation unit 199 generates the setting change screen I19 in order to change various settings, and switches the display content of the display device 111 from the list screen I01 to the setting change screen I19. The setting change screen I19 is displayed (step S013). After that, the finding creation unit 199 changes various settings (step S015).

For example, in the case of individually changing the reading of each tooth in the tooth row, the operator clicks the reading of the tooth to be changed with the operation input device 13 in the tooth reading list R17. After that, the operator operates the operation input device 13 to input the reading of the target tooth in Hiragana (see FIG. 9A). Here, when it is desired to set a plurality of readings, the operator inputs the readings in hiragana and separates each reading with a delimiter (for example, |).
The operator also inputs the tooth condition on the edit screen I21 in the same manner as described above.
In response to the above operation, the finding creating unit 199 changes the reading of the tooth and the reading of the tooth state.

Further, when registering the name of the dentist, the operator operates the operation input device 13 to input the dentist name in the name input box C11 arranged in the examination doctor list area R21 as shown in FIG. 9B. To do. After that, the operator clicks the add button B85 arranged in the examination doctor list area R21 with the operation input device 13. In response to such an operation, the finding creation unit 199 adds a new dentist to the dentist list area R21.

After steps S009 and S015, or if NO in step S011, the finding creation unit 199 determines whether to end the execution of the programs P1 and P3 (step S017). If NO is determined, the finding creating unit 199 returns to step S003, but if YES is determined, the execution of the programs P1 and P3 ends.

Note that, in the case of NO in step S011, although not shown in FIG. 7A, existing finding data may be searched for, output, data manipulated, and the like, if necessary (FIGS. 4A, 5A, 6A). See).

<3. Functions and effects of finding device>
As described above, according to the finding creation device 19, the finding creation screen I03 is displayed by operating the plurality of screen switching tabs T01: the dental chart screen I05, the facial photograph screen I09, the intraoral photograph screen I11, the denture photograph screen I13, Either the note screen I15 or the other screen I17 is selectively displayed. Here, the note screen I15 is defined as the first screen, and the other dental chart screen I05, facial photograph screen I09, etc. are defined as the second screen. During the display of the first screen and the execution of step S123, it is permitted to input the characters of the finding memo based on the result of the large vocabulary continuous speech recognition from the speech recognition unit 197. On the other hand, basically, the character input based on the result of the large vocabulary continuous voice recognition is disabled on the second screen, and the character is input based on the result of the small vocabulary word voice recognition.

During the display of the note screen I15, the finding creation unit 199 responds to the voice command “end”, switches the display content of the display device 111 to the facial photograph screen I09, which is the second screen, and performs large vocabulary continuous voice recognition. And the use of the dictionary D1 is terminated (prohibited).

In the present finding creating apparatus 19, while the note screen I15 is being displayed and step S123 is being executed, the voice recognizing unit 197 performs large-scale continuous voice recognition on the voice signal from the voice input device 11, so that the finding making is performed. The unit 199 automatically switches from the note screen I15 (first screen) to the second screen, and ends the execution of the large-scale continuous speech recognition, and does not switch to the state in which only the small-scale word speech recognition is executed. Unnecessary character input may be performed above. However, according to the present finding creating apparatus 19, the note screen I15 (that is, the first screen) responds to the input of the voice command “end”, such as the facial photograph screen I09, which cannot be recognized by large-scale continuous voice recognition. Since the screen is switched to the two screens, the above-mentioned unnecessary character input is eliminated.

As described above, the present finding creating apparatus 19 switches from the large-scale continuous speech recognition to the small-scale word speech recognition so that the finding memo can be created completely hands-free while the note screen I15 is displayed. Switching from the screen to the second screen. This makes it possible to create a complete hands-free finding memo and to provide a finding creation device 19 having a user interface that is easy for the operator to use, and a program for creating a dental finding.

Further, according to the present finding creation device 19, as described above, since it is possible to create a dental chart and a finding memo completely hands-free, a dentist can create a dental chart without an assistant. ..

Further, according to the present disclosure, it is possible to input a command with a natural utterance, such as during normal diagnosis, by changing the reading of the teeth or the dentition (customizing the dictionary).

<4. Note>
In the above embodiment, the switch from the first screen to the second screen is carried out by using the voice command “end” as a trigger, as a preferable mode. However, not limited to this, the operator operates the plurality of screen switching tabs T01 with the operation input device 13, and the operation signal generated thereby is used as a trigger to switch from the first screen to the second screen. It doesn't matter.

In the above embodiment, the voice recognition program P1 and the voice input dental chart program P3 are stored in the storage device 191. However, the present invention is not limited to this, and the programs P1 and P3 may be provided by being stored in a computer-readable recording medium (for example, a DVD or the like). In addition, the program may be stored in the server device so that it can be downloaded by various terminal devices.

Furthermore, the voice recognition program P1 and the voice input dental chart program P3 may be separately stored and provided in a recording medium, and may be provided to the server device so that various terminal devices can individually download them. It may be stored.

Further, the dental chart screen I05 includes a tooth row image viewed from above and below. However, the present invention is not limited to this, and the dental chart screen I05 may include a tooth row image viewed in a plan view from the front, and a tooth row image viewed in a plan view from above and below and a tooth row image viewed in a plan view from the front are included. It may be switched according to the user setting.

The finding creation device, the program for creating a dental finding, and the recording medium recording the program according to the present disclosure include a user interface suitable for recording the dental finding, and are suitable for being mounted on a personal computer or the like. Is.

19 Finding creation device 191 Storage device 197 Speech recognition unit 199 Finding creation unit P1 Speech recognition program P3 Speech input dental chart program

Claims (8)

A voice recognition unit that performs at least large vocabulary continuous voice recognition on a voice signal representing the utterance content,
Based on the result of the large vocabulary continuous speech recognition, when a predetermined signal indicating the end of character input is received while the first screen in which the characters representing the utterance content are permitted to be input is displayed. A second screen in which characters cannot be input based on the result of the large vocabulary continuous speech recognition, and a finding creation unit that switches the display of the display device ,
The voice recognition unit further performs small vocabulary word voice recognition,
Character input based on the result of the small vocabulary word voice recognition is permitted on the second screen,
Finding device. The finding creation device according to claim 1, wherein the predetermined signal is a voice signal representing a predetermined voice command. An operation input device that outputs an operation signal in response to an operation with fingers is connected to the finding creation device,
The finding creation device according to claim 1, wherein the predetermined signal is an operation signal transmitted from an operation input device when a predetermined operation is performed on the first screen. The second screen includes a tooth row image representing a tooth row,
The representation of each tooth in the tooth row image is in a selectable findings generating apparatus according to any of claims 1-3. The second screen includes a tooth row image representing a tooth row,
State of each tooth in the tooth row image is represented by a specific color, findings generating apparatus according to any of claims 1-3. A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition;
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A finding creation method comprising: a procedure for switching the display content of the display device to a permitted second screen. On the computer,
A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition;
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A finding creation program, comprising: a procedure for switching the display content of the display device to a permitted second screen. On the computer,
A procedure for displaying on the display device the first screen on which the input of characters representing the utterance content is permitted based on the result of the large vocabulary continuous speech recognition;
When a predetermined signal indicating the end of character input is received while the first screen is displayed, character input based on the result of the large vocabulary continuous voice recognition is prohibited , and character input based on the result of the small vocabulary word voice recognition is performed. A recording medium on which a finding creation program is recorded, which has a procedure for switching the display content of the display device on the permitted second screen.