JP7486742B2 - Electronic findings record recording support device and electronic findings record recording support method - Google Patents

Description

The present invention relates to an electronic findings record recording support device and an electronic findings record recording support method that support the input of findings information related to multiple body parts into an electronic findings record.

In recent years, electronic medical records (findings records) have become increasingly common in the field of medical treatment. Typically, electronic medical records display a screen on a display interface such as an LCD display, with items and input fields for information to be entered. Electronic medical records then accept information input from medical professionals via a manual input interface such as a keyboard and mouse, and record the input information in a viewable form.

In general hospitals and other facilities, multiple medical staff record and view medical records. Therefore, technology has been proposed that allows access to a single electronic medical record from multiple terminal devices (see, for example, Patent Document 1).

The technology described in Patent Document 1 (hereinafter referred to as "conventional technology") prevents editing of a patient's electronic medical record on other terminal devices while the electronic medical record of the patient is being edited on one of the terminal devices, and switches the terminal device that is permitted to edit based on a predetermined rule. This conventional technology allows multiple medical staff to efficiently record findings in the electronic medical record.

JP 2014-13577 A

Incidentally, there is a demand for computerized records of autopsy findings not only in the field of medical treatment, but also in the fields of forensic and pathological autopsies.

However, it is difficult for surgeons performing autopsies to use a manual input interface. Also, multiple surgeons often perform autopsies on the same subject at the same time, such as one surgeon performing an autopsy on the head and another performing an autopsy on the abdomen. Therefore, the above-mentioned conventional technology is not suitable for recording autopsy findings in an electronic record (hereinafter referred to as "electronic record").

The object of the present invention is to provide an electronic findings record recording support device and an electronic findings record recording support method that can support the recording of autopsy findings in an electronic findings record.

An electronic findings record recording support device according to one aspect of the present invention comprises:
An electronic findings record recording support device that supports recording of findings information related to a body part in an electronic findings record,
a terminal connection unit for connecting to a terminal device having a voice input function and an image display function;
an information acquisition unit that acquires, when body part information indicating a body part and identification information identifying the body part are input by voice to the terminal device displaying a human body diagram, the body part information and the identification information based on a voice recognition process;
a position specifying unit that specifies a position of the body part in the human body diagram based on the acquired body part information, the body part information, and human body diagram information including the body part information and position information indicating the position of the body part in the human body diagram in association with each other ;
a display control unit that displays the identification information at the position of the identified body part in the human body diagram;
Equipped with.

A method for supporting electronic findings recording according to one aspect of the present invention includes:
1. A computer-implemented method for assisting in recording of findings information relating to a body part in an electronic findings record, comprising:
Connecting to a terminal device having a voice input function and an image display function,
when body part information indicating a body part and identification information identifying the body part are input by voice to the terminal device displaying a human body diagram, the body part information and the identification information are acquired based on a voice recognition process;
Identifying a position of the body part on the human body diagram based on the acquired body part information, the body part information, and human body diagram information including the body part information and position information indicating the position of the body part on the human body diagram in association with each other ;
The identification information is displayed at the position of the identified body part on the human body diagram.

This disclosure can assist with recording autopsy findings in an electronic record.

FIG. 1 is a diagram showing an example of an overview of a system in which an electronic findings record recording support device according to an embodiment of the present invention is used. FIG. 1 is a diagram showing an example of the configuration of an electronic findings record recording support device according to an embodiment of the present invention. FIG. 1 is a diagram showing an example of the contents of the findings structure data in the present embodiment. FIG. 13 is a diagram showing an example of the contents of command data according to the present embodiment. FIG. 1 is a diagram showing an example of the contents of pronunciation dictionary data according to the present embodiment. FIG. 1 is a diagram showing an example of the contents of a terminal status management table according to the present embodiment. FIG. 13 is a diagram showing an example of a work start screen for an electronic record in the present embodiment. A flowchart showing an example of the operation of the electronic findings record recording support device according to the present embodiment. FIG. 13 shows a first example of a findings record input screen in the present embodiment. FIG. 13 shows a second example of a findings record input screen in the present embodiment. FIG. 13 shows a third example of a findings record input screen in the present embodiment. FIG. 13 shows a fourth example of a findings record input screen in the present embodiment. FIG. 5 shows a fifth example of a findings record input screen in the present embodiment. FIG. 1 is a diagram showing an example of the contents of the findings record information data in the present embodiment. FIG. 1 shows an example of an autopsy record according to the present embodiment. FIG. 6 shows a sixth example of a findings record input screen in the present embodiment. FIG. 1 is a diagram showing an example of the contents of human body diagram information according to the present embodiment.

Below, one embodiment of the present invention will be described in detail with reference to the drawings.

<System Overview>
First, an overview of an electronic findings recording system in which an electronic findings recording support device according to the present embodiment is used will be described. In the present embodiment, the electronic findings recording system is a system for recording autopsy findings in forensic autopsies.

Figure 1 shows an example of an overview of an electronic findings record system in which an electronic findings record recording support device according to this embodiment is used.

As shown in FIG. 1 , the electronic findings record system 100 includes first and second terminal devices 200 ₁ , 200 ₂ disposed inside the dissection room 110 , and an electronic findings record support device 300 disposed outside the dissection room 110 .

The first terminal device _200-1 has a first terminal control device _210-1 , a first headset _220-1 equipped with a microphone, and a first display device _230-1 equipped with a liquid crystal display.

The first headset 220 ₁ and the first display device 230 ₁ are each communicatively connected to the first terminal control device 210 _1. That is, the first terminal device 200 ₁ is a terminal device having a voice input function and an image display function. The first headset 220 ₁ is worn on the head of a first user 130 ₁ who is a surgeon performing a forensic autopsy on a subject 120. The first display device 230 ₁ is used by this first user 130 ₁ .

The second terminal device 200 ₂ also has a configuration similar to that of the first terminal device 200 ₁ , including a second terminal control device 210 ₂ , a second headset 220 ₂ , and a second display device 230 _2. The second headset 220 ₂ is worn on the head of a second user 130 ₂ who is another surgeon who performs a forensic autopsy on the subject 120. The second display device 230 ₂ is used by this second user 130 ₂ .

The electronic findings record recording support device 300 is communicably connected to each of the first terminal control device _210-1 and the second terminal control device _210-2 , and realizes a user interface for the electronic findings record in each of the first terminal device _200-1 and the second terminal device _200-2 . In other words, the electronic findings record recording support device 300 causes each terminal device 200 to display a findings record input screen, presents findings record information, and accepts input of findings information into the electronic findings record.

More specifically, the electronic findings record recording assistance device 300 enables hands-free input of findings information by voice, and further enables first and second users 130 ₁ , 130 ₂ to input findings information simultaneously.

<Apparatus Configuration>
Next, the configuration of the electronic findings record recording support device 300 will be described.

Figure 2 shows an example of the configuration of the electronic findings record recording support device 300.

In FIG. 2, the electronic findings record recording support device 300 has an information storage unit 310 (functioning as the "human body diagram information storage unit" of the present invention), a terminal connection unit 320, a voice recognition analysis unit 330, an input screen control unit 340 (functioning as the "information acquisition unit," "position identification unit," and "display control unit" of the present invention), and an information recording unit 350 (functioning as the "memory control unit" of the present invention).

The information storage unit 310 prestores various information for realizing the user interface of the electronic findings record. More specifically, the information storage unit 310 stores a voice recognition dictionary 311, findings record configuration information 312, findings record information data 313, and human body diagram information 314.

The speech recognition dictionary 311 is information used in speech recognition processing to convert speech data into text data, such as an acoustic model, a pronunciation dictionary, and a language model. The acoustic model is a digital representation of the probabilistic correspondence between speech features and phonetic symbols. The pronunciation dictionary describes multiple text sequences as a candidate group of speech recognition results obtained by speech recognition processing. The language model is a digital representation of the occurrence probability and connection probability for each of the text sequences described in the pronunciation dictionary.

It is preferable that the pronunciation dictionary and language model correspond to medical terminology and the recording format of the findings. It is also preferable that the acoustic model includes an acoustic model customized for each user through learning, and an acoustic model for unspecified users. It is also preferable that the pronunciation dictionary and language model are prepared for each display screen and each screen mode, which will be described later.

The findings record configuration information 312 is information necessary to construct a user interface for the electronic findings record. The findings record configuration information 312 includes, for example, findings record structure data, command data, pronunciation dictionary data, and a terminal status management table.

The findings record structure data is data that describes the structure of the electronic findings record. The command data is data that describes commands received from the user. The pronunciation dictionary data is data that describes the correspondence between character strings displayed in the electronic findings record and their pronunciations. The terminal status management table is information that identifies each terminal device 200 and describes the status of each terminal device 200. Note that while the findings record structure data, command data, and pronunciation dictionary data are information that is prepared in advance, the terminal status management table is information that is generated and changes depending on the status of the electronic findings record system 100.

Figure 3 shows an example of the contents of observation record structure data.

As shown in FIG. 3, the findings structure data 410 describes, for each part name 411, an item name 412 belonging to the part name and an input field type 413 for that item name 412.

The part name 411 is the name of a body part. The part name 411 is the name of the area of the subject that a surgeon focuses on at one time when performing an autopsy, such as "heart." In this embodiment, the name of a collection of various pieces of information that a surgeon focuses on at one time when performing an autopsy, such as "basic information," is also treated as the part name 411.

The item name 412 is the name of the object for which the finding information should be recorded, corresponding to the part name 411.

The input field type 413 indicates the type of input method for the finding information corresponding to the item name 412.

The findings record structure data 410 may include information such as the location, size, font, and color of each of the part name 411, item name 412, and the item name 412 when displayed on the findings record input screen. The findings record structure data 410 may also include information regarding the memory storage location of the entered findings information for each of the item names 412.

Figure 4 shows an example of the contents of command data.

As shown in FIG. 4, the command data 420 describes a command 422 for each screen mode 421.

Screen mode 421 is the type of operation accepted by the electronic findings record screen. In this embodiment, screen mode 421 includes at least a "selection mode" and an "input mode." Selection mode is a mode that accepts an operation to select a body part name or an item name displayed on the screen. Input mode is a mode that accepts an operation to input information into an input field corresponding to an item name displayed on the screen. It is preferable that input mode is further divided into a mode for inputting free text and a mode for inputting numerical values.

Command 422 is a command word received from the user on the observation record input screen. In this embodiment, command 422 includes an input start command for starting input into the input field, various editing commands for editing the content written in the input field, and an input stop command for stopping input into the input field.

Figure 5 shows an example of the contents of the pronunciation dictionary data.

As shown in FIG. 5, the pronunciation dictionary data 430 describes the reading 432 for each character string 431. The character string 431 is a character string of a phrase for which the electronic findings record system 100 accepts voice input on the findings record input screen, and includes a body part name 411, an item name 412, and a command 422 (see FIG. 3 and FIG. 4).

It should be noted that information having the same content as the pronunciation dictionary data 430 is included in the pronunciation dictionary of the above-mentioned voice recognition dictionary 311. Alternatively, the pronunciation dictionary data 430 may be shared by both the voice recognition dictionary 311 and the findings record configuration information 312.

Figure 6 shows an example of the contents of a terminal status management table.

As shown in FIG. 6, the terminal status management table 440 describes the status for each status item 441 for each of the first terminal device 442 and the second terminal device 443.

The status items 441 include the terminal ID, user name, work observation record number, display screen, work status, and selected item. The terminal ID is identification information of the terminal device 200. The terminal ID may be a combination of a microphone ID and a display ID. The user name is identification information of the user who uses the terminal device 200. The work observation record number is identification information of the observation record information data that is the subject of input or editing work on the terminal device 200. The display screen is identification information of the screen displayed by the terminal device 200. The work status is the screen mode 421 (see FIG. 4) set in the terminal device 200.

The terminal ID is written by the input screen control unit 340 based on the automatic detection function of the communication network and user operation when the terminal device 200 is connected to the electronic findings record recording support device 300, for example. The user name and the work-in-progress findings record number are written by the input screen control unit 340 based on user operation on the work start screen of the electronic findings record, for example. The display screen, work status, and selected item are updated sequentially by the input screen control unit 340 in response to various user operations on the findings record input screen, for example.

The contents of the findings record information data 313 in Figure 2 will be described later.

2 is communicatively connected to each of the first and second terminal devices 200 _{1 and 200 2. The terminal connection unit 320 relays information between each of the first and second terminal devices 200 1 and 200 2 and} the voice recognition analysis unit ₃₃₀ , the input screen control unit 340, and the information recording unit 350.

The voice recognition analysis unit 330 determines whether or not the part name 411 (see FIG. 3) has been input by voice, and whether or not the finding information has been input by voice, for each terminal device 200, by voice recognition processing using the voice recognition dictionary 310. Although not shown, the voice recognition analysis unit 330 includes an acoustic analysis unit that converts the speaker's voice into compact data, and a recognition decoder that analyzes the converted data and converts it into text. When the part name or finding information is input by voice, the voice recognition analysis unit 330 outputs the text information of the part name or finding information to the input screen control unit 340. The voice recognition analysis unit 330 also determines whether or not the part name 412 (see FIG. 3) and the command 422 (see FIG. 4) have been input by voice, and outputs the determination result.

In addition, the voice recognition analysis unit 330 may switch the acoustic model, pronunciation dictionary, and language model to be used, or narrow down the words to be recognized, based on the terminal state management table 440 (see FIG. 6).

The input screen control unit 340 generates and displays a findings record input screen including a list of multiple body part names for each terminal device. Then, when a body part name is input by voice into any of the terminal devices 200, the input screen control unit 340 displays a body part-specific screen for inputting the corresponding findings information on the findings record input screen of that terminal device 200. The input screen control unit 340 also associates the text information of the input findings information with the body part name and item name that were the subject of input, and outputs the text information to the information recording unit 350.

However, while any of the body part screens is displayed on one of the terminal devices 200, the input screen control unit 340 assigns notification information indicating that the corresponding finding information cannot be input to the corresponding body part name displayed on the other terminal device 200. Also, while any of the body part screens is displayed on one of the terminal devices 200, the input screen control unit 340 does not display the corresponding body part screen on the other terminal device 200.

The input screen control unit 340 sequentially reflects the display screen, work status, and selected items of each terminal device 200 in the terminal status management table 440 (see Figure 6).

When text information of findings is input from the input screen control unit 340, the information recording unit 350 associates the input text information of findings with the corresponding part name and item name, and stores it in the information storage unit 310 as findings record information data 313.

The combination of the above-mentioned findings record structure data 410 (see FIG. 3) and findings record information data 313 constitutes an electronic findings record. That is, the information recording unit 350 records the findings information input by the user in the electronic findings record.

Although not shown, the electronic findings record recording support device 300 has, for example, a CPU (Central Processing Unit), a storage medium such as a ROM (Read Only Memory) that stores a control program, a working memory such as a RAM (Random Access Memory), and a communication circuit. In this case, the functions of each of the above-mentioned parts are realized by the CPU executing the control program.

Such an electronic findings record recording support device 300 allows each terminal device 200 to input findings information for each item by voice via a body part screen prepared for each body part. In addition, while a body part screen is displayed on a certain terminal device 200, the electronic findings record recording support device 300 can not display the body part screen on the other terminal device 200 and can notify the user of the other terminal device 200 that the corresponding findings information cannot be input by voice.

<Device Operation>
Next, the operation of the electronic findings record recording support device 300 will be described with reference to examples of screen states of the electronic findings record.

First, the input screen control unit 340 generates an electronic findings record work start screen for each terminal device 200 and displays it on the terminal device 200. Then, the input screen control unit 340 accepts settings for the target of the work of inputting or editing findings information and the settings of the user who will perform the work for each terminal device 200.

Figure 7 shows an example of the work start screen for electronic findings records.

As shown in FIG. 7, the work start screen 510 has a findings record selection area 511 and a user selection area 512. The findings record selection area 511 displays a list of existing findings record information data, and accepts from the user an operation to select findings record information data on which work is to be started, or an operation to start creating new findings record information data. The user selection area 512 displays a list of user names, and accepts from the user an operation to select the user name of the user who is to start work, or an operation to register a new user name.

For example, the first user _130-1 selects the findings record information data "000019" and the user name "TARO" on the work start screen 510 displayed on the first terminal device _200-1 . The second user _130-2 selects the findings record information data "000019" and the user name "HANAKO" on the work start screen 510 displayed on the second terminal device _200-2 .

The electronic findings record recording support device 300 performs the operations described below for each terminal device 200 each time findings record information data and a user name are selected on the work start screen 510.

Figure 8 is a flowchart showing an example of the operation of the electronic findings record recording support device 300.

In step S1010, the input screen control unit 340 generates a findings record input screen for the selected findings record information data and displays it on the terminal device 200 where the selection was made. At this time, the input screen control unit 340 registers the selected user name and sets the selection mode for the terminal device 200 where the selection was made. These registrations and settings are performed using the terminal status management table 440 (see FIG. 6).

Figure 9 shows an example of the findings entry screen.

As shown in FIG. 9, the findings record input screen 600 has a body part selection area 610, a findings input area (body part screen) 620, a command display area 630, and a voice recognition operation area 640.

The part selection area 610 is an area that displays a list of multiple body part part names 411 (see Figure 3) as multiple part name tabs 611.

The findings input area (part-specific screen) 620 is an area that displays, for one body part, a list of multiple item names 412 (see FIG. 3) that correspond to the part name 411 of that body part as multiple item name buttons 621. The findings input area 620 is also an area that displays input fields according to the input field type 413 (see FIG. 3) that corresponds to each item name 412 as input areas 622 in association with the item name buttons 621.

The findings record input screen 600 is drawn so that each findings input area 620 appears as a sheet with a corresponding body part name tab 611 at the top.

The command display area 630 displays a list of the readings of the commands 422 (see Figure 4) corresponding to the screen mode 421.

The voice recognition operation area 640 is an area that accepts operations related to voice recognition, such as operations for editing the voice recognition dictionary 311, such as registering words to be recognized and editing a user profile, as well as operations related to voice recognition, such as microphone volume and starting and stopping voice recognition.

For example, in the initial state, the input screen control unit 340 displays the findings record input screen 600, which includes a findings input area 620 for basic information.

In step S1020 in FIG. 8, the voice recognition analysis unit 330 determines whether or not a voice input of the displayed body part name has been made on the terminal device 200 in the selection mode. This determination is made based on, for example, the findings record structure data 410 (see FIG. 3), the pronunciation dictionary data 430 (see FIG. 5), and the terminal status management table 440 (see FIG. 6).

Here, the name of the part to be judged is displayed as a part name tab 611 in the part selection area 610 of the findings entry screen 600. Therefore, the user can select the desired part name as if selecting one from the multiple displayed part name tabs 611 and reading it out loud, and input this by voice into the terminal device 200.

If there is voice input of the part name in the selection mode (S1020: YES), the voice recognition analysis unit 330 proceeds to step S1030. If there is no voice input of the part name in the selection mode (S1020: NO), the voice recognition analysis unit 330 proceeds to step S1060, which will be described later.

In step S1030, the input screen control unit 340 determines whether the findings record input screen 600 including the findings input area 620 for the part name input by voice is displayed on the other terminal device 200. This determination is made, for example, based on the terminal status management table 440 (see FIG. 6).

If the corresponding findings record input screen 600 is not displayed on the other terminal device 200 (S1030: NO), the input screen control unit 340 proceeds to step S1040. If the corresponding findings record input screen 600 is displayed on the other terminal device 200 (S1030: YES), the input screen control unit 340 proceeds to the subsequent step S1060.

In step S1040, the input screen control unit 340 causes the terminal device 200 that has received the voice input to display the findings record input screen 600 including a list of item names corresponding to the input body part name, i.e., the findings input area 620 corresponding to the input body part name.

Figure 10 shows an example of the findings entry screen when the content corresponding to the body part name "heart" is switched to, and corresponds to Figure 9. The same reference numerals are used to designate parts corresponding to Figure 9, and the explanation of these parts is omitted.

For example, assume that "heart" is input by voice in the selection mode on the first terminal device _200-1 while the cardiac findings input area 620 is not displayed on the second terminal device _200-2 . In this case, the input screen control unit 340 causes the cardiac findings input area 620 to be displayed on the findings record input screen 600 displayed on the first terminal device _200-1 , as shown in FIG.

As described above, the findings input area 620 is displayed as a sheet with a body part name tab 611. This display format allows the findings record input screen 600 to show the user which body part (body part name) the findings input area 620 is for.

In addition, in Figures 9 and 10, the screen mode is the selection mode. Therefore, in each command display area 630, a list of the readings of the commands 422 (see Figure 4) in the selection mode is displayed.

Note that, depending on the body part, if there are many item name buttons 621 and input areas 622, it may not be possible to display all of the item name buttons 621 and input areas 622 at once. Therefore, the command includes a command for scrolling the screen. This makes it possible for the findings input area 620 to display a list of item name buttons 621 and input areas 622 for all necessary items, even if there are many item name buttons 621 and input areas 622.

In step S1050 of FIG. 8, the input screen control unit 340 displays, on the other terminal device 200, the non-notification information for the body part that was the subject of display in step S1040.

Figure 11 shows an example of a findings record input screen on which non-notification information is displayed, and corresponds to Figures 9 and 10. Parts corresponding to those in Figures 9 and 10 are given the same reference numerals, and their explanation will be omitted.

For example, assume that the cardiac findings input area 620 is displayed on the first terminal device _200-1 (see FIG. 10). In this case, the display form of the "heart" body part name tab 611 on the findings record input screen 600 displayed on the second terminal device _200-2 is different from the other body part name tabs 611. In other words, the non-notification information is a display form of the body part name tab 611 that is different from the other body part name tabs 611. As such a different display form, for example, a change in the character color, font, or background color can be adopted.

By displaying such unnoticeable information, the second user can intuitively recognize that since the first user is currently inputting cardiac finding information, cardiac finding information cannot be input into the second terminal device 200 ₂ until the first user finishes inputting the cardiac finding information.

In step S1060 in FIG. 8, the voice recognition analysis unit 330 determines whether or not the name of a displayed item has been voice-inputted, followed by a voice input of a start input command, in the terminal device 200 in the selection mode. This determination is made based on, for example, the findings structure data 410 (see FIG. 3), the command data 420 (see FIG. 4), the pronunciation dictionary data 430 (see FIG. 5), and the terminal status management table 440 (see FIG. 6).

Here, the item names to be judged are displayed as item name buttons 621 in the findings input area 620 of the findings record input screen 600. Therefore, the user can select the desired item name as if selecting one of the multiple displayed item name buttons 621 and reading it out loud, and input this by voice into the terminal device 200.

For example, assume that the cardiac findings input area 620 is displayed (see FIG. 10). In this case, the item names 412 (see FIG. 3) such as "cardiac extraction blood volume" and "cardiac extraction blood properties" and the command 422 "start input" (see FIG. 4) are the targets of judgment.

If there is voice input of the item name and the start input command (S1060: YES), the voice recognition analysis unit 330 proceeds to step S1070. If there is no voice input of the item name and the start input command (S1060: NO), the voice recognition analysis unit 330 proceeds to step S1080, which will be described later.

In step S1070, the input screen control unit 340 switches the screen mode of the terminal device 200 where the item name and start input command have been voice-input to the input mode, and sets the input item as the selected item.

Figure 12 corresponds to Figure 10 and shows the change in the findings record input screen when "Start input" is input by voice following "Cardiac extraction blood properties" on the findings record input screen shown in Figure 10. The same reference numerals are used to designate parts corresponding to those in Figure 10, and the explanation thereof will be omitted.

As shown in FIG. 12, the input screen control unit 340 assigns selection notification information indicating that the item name button 621 corresponding to the voice-input "cardiac extraction blood properties" is being selected. As the selection notification information, for example, a display form of the item name button 621 that is different from the other item name buttons 621 is used. Such a different display form can be the line type of the button frame, the button color, the button shape, the text color, or the font.

The input screen control unit 340 also displays a list of the readings of the input mode commands 422 (see Figure 4) in the command display area 630.

In step S1080 in FIG. 8, the voice recognition analysis unit 330 determines whether or not a voice input has been made for a phrase other than the command displayed in the command display area 630 in the terminal device 200 in the input mode. This determination is made based on, for example, the command data 420 (see FIG. 4), the pronunciation dictionary data 430 (see FIG. 5), and the terminal status management table 440 (see FIG. 6).

If there is voice input of a phrase other than a command (S1080: YES), the voice recognition analysis unit 330 proceeds to step S1090. If there is no voice input of a phrase other than a command (S1080: NO), the voice recognition analysis unit 330 proceeds to step S1100, which will be described later.

In step S1090, the input screen control unit 340 displays the text information of the voice-inputted phrase in the input area 622 (see FIG. 12) corresponding to the selected item name button 621. The information recording unit 350 also records the text data of the inputted phrase together with the original voice data in the electronic findings record as finding information for the item corresponding to the selected item name button 621. That is, the information recording unit 350 adds the inputted information to the findings record information data 313.

Figure 13 shows an example of the findings record input screen when findings information is entered in the findings input area corresponding to the "whole body" body part name, and corresponds to Figures 9 to 12. Parts corresponding to Figures 9 to 12 are given the same reference numerals, and their explanation will be omitted.

As shown in FIG. 13, each input area 622 of the findings input region 620 displays the findings information entered by voice as text. The text information is displayed in real time, for example, each time a voice recognition result is obtained for each phrase. This allows the user to perform voice input while checking successively whether the content they have spoken has been entered correctly.

The input screen control unit 340 may provide completion notification information to the part name tab 611 of a body part for which all necessary finding information has been recorded. Such completion notification information may be a display form for the part name tab 611 that is different from other part name tabs 611, such as by changing the text color, font, or background color.

In other words, the input screen control unit 340 clearly displays body parts for which voice input is not possible because another user is performing an input operation, body parts for which voice input is possible but for which recording of finding information has not been completed, and body parts for which voice input is possible but for which recording of finding information has not been completed.

In step S1100 in FIG. 8, the voice recognition analysis unit 330 determines whether or not a voice input of an input stop command has been received in the terminal device 200 in the input mode. This determination is made based on, for example, the command data 420 (see FIG. 4), the pronunciation dictionary data 430 (see FIG. 5), and the terminal state management table 440 (see FIG. 6).

If there is a voice input of an input stop command (S1100: YES), the voice recognition analysis unit 330 proceeds to step S1110. If there is no voice input of an input stop command (S1100: NO), the voice recognition analysis unit 330 proceeds to step S1120, which will be described later.

In step S1110, the input screen control unit 340 switches the screen mode of the terminal device 200 where the voice input of the input stop command was received to the selection mode. This setting is performed using the terminal state management table 440 (see FIG. 6).

In step S1120, the voice recognition analysis unit 330 determines whether or not a voice input has been made for a command (other command) other than the input start command in the selection mode and the input stop command in the input mode, such as an edit command. This determination is made based on, for example, the command data 420 (see FIG. 4), the pronunciation dictionary data 430 (see FIG. 5), and the terminal status management table 440 (see FIG. 6).

If there is voice input of another command (S1120: YES), the voice recognition analysis unit 330 proceeds to step S1130. If there is no voice input of another command (S1120: NO), the voice recognition analysis unit 330 proceeds to step S1140, which will be described later.

In step S1130, the input screen control unit 340 performs processing according to the voice-input command. Such processing includes, for example, scrolling the screen, adding an item, inputting information indicating that input of finding information is not necessary, editing the input finding information, or deleting the input finding information.

In step S1140, the input screen control unit 340 determines whether or not an instruction has been given to end the voice input process of the finding information. Such an instruction is given, for example, by the user pressing an end button.

If the input screen control unit 340 has not been instructed to end the process (S1140: NO), the process returns to step S1020. If the input screen control unit 340 has been instructed to end the process (S1140: YES), the process ends.

By operating in this manner, the electronic findings record recording support device 300 can accept voice input of information and commands for each terminal device 200 according to the display state and operation progress of each device, and can realize an exclusive voice input interface for each body part in a manner that is easy for the user to use.

If voice input of the name of a body part being input on another terminal device 200 is not accepted without displaying a notification that it is not possible, the user may be confused as they will not be able to immediately identify the reason.

In this regard, the electronic findings record recording support device 300 displays the non-notification information, and does not display the part selection area 610 for the body part being input on the other terminal device 200. In this case, the user can recognize that exclusive control of input operations is in effect before making an unnecessary utterance of the part name or item name.

This allows each user to quickly select the name of a body part other than the body part that the other user is currently inputting, and proceed with the work. In other words, the electronic findings record recording support device 300 can appropriately support multiple users in recording findings information about multiple body parts in the electronic findings record by voice.

Figure 14 is a diagram showing an example of the contents of the findings record information data 313 generated by the information recording unit 350. Here, an example is shown in which the findings record information data 313 is written in XML (eXtensible Markup Language) and includes findings record structure data 410 (see Figure 3) and pronunciation dictionary data 430 (see Figure 5).

As shown in FIG. 14, the findings record information data 313 describes the reading of the item name with an attribute called "spoken", and describes the notation of the item name on the findings record input screen with an attribute called "label". The findings record information data 313 also describes the text information of the entered findings information with an attribute called "data", and describes the initial state of the findings information with an attribute called "initial". Furthermore, the findings record information data 313 describes the input field type with an attribute called "type", and describes the data name of the entered and recorded voice data with an attribute called "voicefile". Note that, when the input field type is a choice, the findings record information data 313 includes a description of the attributes called "spoken" and "label" of each choice, and describes which choice was selected (i.e., the findings information) with an attribute called "select".

For example, when generating an electronic findings record for a new subject, the information recording unit 350 generates findings record information data 313 without describing values in the attributes "data", "voicefile", and "select". Then, each time findings information is input, the information recording unit 350 appends the voice data of the findings information, text information, and information indicating which option was selected to the corresponding locations in the information recording unit 350.

By generating this type of findings record information data 313, not only can the findings information be reflected in the electronic findings record, but the original voice data can also be output as voice, making it possible to check later whether the voice input was accurate.

For example, the input screen control unit 340 not only accepts voice input, but also accepts operations for inputting and editing findings information from the user using a manual input interface such as a keyboard or mouse. When a specific operation such as a click operation is performed on a displayed item name button 621, the input screen control unit 340 obtains corresponding voice data based on the findings record information data 313 and outputs the voice via a loudspeaker.

This allows the user who inputs the findings by voice, or the operator who manages the information in the electronic findings record, to check the actual spoken voice and edit the recorded findings information as appropriate.

In addition, the information recording unit 350 may receive a specified operation from the user, and in response to the specified operation, convert the contents of the findings record information data 313 into document data to create an autopsy record, which may then be displayed or printed.

Figure 15 shows an example of an autopsy record.

As shown in FIG. 15, the autopsy record 710 describes the item name for each part of the body, and further describes the recorded findings information in association with each item name. Such an autopsy record 710 can be used, for example, as the autopsy record section of a certificate.

In forensic autopsy, it is desirable to present autopsy findings to the user in a visually easy-to-understand format that indicates which body part the autopsy finding refers to. One possible solution is to include identification information (e.g., a number) that identifies the body part that corresponds to the autopsy finding in the autopsy finding, display a human body diagram, and display the identification information at the position of the body part on the human body diagram. Conventionally, a user manually inputs identification information that identifies the body part in the autopsy finding, identifies the position of the body part that corresponds to the autopsy finding on the human body diagram, and manually inputs the identification information at the identified position. In this case, the task of inputting the identification information is cumbersome, and there is a problem in that different identification information may be input by mistake between the autopsy finding and the human body diagram.

In this embodiment, when finding information about a certain body part is input by voice on the finding record input screen and the finding information includes body part information indicating the body part and identification information identifying the body part, the electronic findings record recording support device 300 performs a process of identifying the position of the body part on the human body diagram based on the body part information and displaying the identification information at the identified position. This allows the user to input the same identification information for both the autopsy findings and the human body diagram simply by speaking the finding information including the body part information and identification information (i.e., having the electronic findings record recording support device 300 recognize the voice). This solves the conventional problems of the cumbersome task of inputting identification information and the possibility of different identification information being erroneously input between the autopsy findings and the human body diagram.

Below, with reference to Figures 16 and 17, we will explain the specific process of identifying the position of a body part on a human body diagram based on the body part information contained in the findings information and displaying identification information at the identified position.

Figure 16 is a diagram showing an example of a findings record input screen including a human body diagram. As shown in Figure 16, the findings input area (by body part screen) 620 of the findings record input screen 600 is an area that displays, for one body part (in the example shown in Figure 16, "Injury to the neck or higher"), a list of multiple item names 412 (in the example shown in Figure 16, "Injury 01", "Injury 02") corresponding to the body part name 411 of that body part as multiple item name buttons 621a, 621b. The findings input area 620 is also an area that displays input fields according to the input field type 413 (see Figure 3) corresponding to each item name 412 as input areas 622a, 622b in association with the item name buttons 621a, 621b.

Furthermore, the findings input area 620 displays a human body diagram 800, which is a schematic representation of a human body related to one body part ("injury to the neck and above" in the example shown in FIG. 16), to the right of the input areas 622a and 622b. In the human body diagram 800, a right side view of the human body is displayed on the left, and a left side view of the human body is displayed on the right. Note that, for example, four types of human body diagrams are prepared as human body diagrams that can be displayed in the findings input area 620, and from among the four types of human body diagrams, the human body diagram related to the body part selected by voice input while the findings record input screen 600 is displayed.

The human body diagram 800 is included in the human body diagram information 314 stored in the information storage unit 310. FIG. 17 is a diagram showing an example of the contents of the human body diagram information 314. As shown in FIG. 17, the human body diagram information 314 includes a human body diagram (not shown), body part information indicating the body part (part name), reading information indicating how to read the body part, position information indicating the position of the body part in the human body diagram (X position, Y position), and identification information identifying the body part, for example, by number or alphabet, all in association with each other. Here, the X position indicates the position of the body part in the left-right direction of the human body diagram 800 in FIG. 16. Also, the Y position indicates the position of the body part in the up-down direction of the human body diagram 800 in FIG. 16.

For example, if the body part (part name) is "left side neck", by referring to the human body diagram information 314, it is possible to determine that the X position of the "left side neck" in the human body diagram 800 is 307 and the Y position of the "left side neck" is 67. Also, if the body part (part name) is "sternum", it is possible to determine that the X position of the "sternum" in the human body diagram 800 is 372 and the Y position of the "sternum" is 92.

In the findings record input screen 600 shown in FIG. 16, after the displayed item name (e.g., "Damage 01") is followed by a voice input of the input start command, the input screen control unit 340 displays the text information of the voice-input phrase (findings information, e.g., "Damage was found at the base of the nose of number 13.") in the input area 622a corresponding to the selected item name button 621a.

The input screen control unit 340 also acquires body part information indicating a body part (e.g., "root of the nose") and identification information identifying that body part (e.g., 13) from the voice-inputted finding information.

Even if the voice-inputted finding information is expressed in a different way, such as "Damage is found at the root of the nose at No. 13," "Damage is found at the root of the nose at No. 13," "Damage is found at the root of the nose at No. 13," or "Damage is found at the root of the nose at No. 13 left auricle," instead of "Damage is found at the root of the nose at No. 13," the input screen control unit 340 acquires from the finding information body part information indicating the body part (e.g., "root of the nose") and identification information identifying the body part (e.g., 13). When the voice-inputted finding information is "Damage is found at the root of the nose at No. 13 left auricle," that is, when identification information is sandwiched between two pieces of body part information (e.g., "root of the nose," "left auricle"), the input screen control unit 340 acquires the previously voice-inputted "root of the nose" as the body part information.

Next, the input screen control unit 340 identifies the position of the body part (position indicated by reference symbol 810) on the human body diagram 800 based on the acquired body part information ("root of nose") and the human body diagram information 314 stored in the information storage unit 310. The input screen control unit 340 then displays identification information ("13") at the position of the identified body part on the human body diagram 800.

Finally, the information recording unit 350 stores the human body diagram 800, the body part information ("root of nose"), reading information, position information, and the identification information ("13") acquired through the voice input of the findings information in association with each other in the human body diagram information 314 stored in the information storage unit 310. As a result, when the human body diagram 800 is redisplayed on the findings record input screen 600, the input screen control unit 340 can display, for body parts for which identification information exists in the human body diagram information 314, the identification information at the position of that body part on the human body diagram 800.

In addition, on the findings record input screen 600 shown in FIG. 16, after the displayed item name (e.g., "Injury 02") is followed by a voice input of the input start command, the input screen control unit 340 displays the text information of the voice-input phrase (findings information, e.g., "Bleeding is observed in the left auricle of item 5.") in the input area 622b corresponding to the selected item name button 621b.

The input screen control unit 340 also acquires body part information indicating a body part (e.g., "left auricle") and identification information identifying that body part (e.g., 5) from the voice-inputted finding information.

Even if the voice-inputted finding information is expressed in a different way, such as "Bleeding is found in the left auricle at No. 5," "Bleeding is found in the left auricle at No. 5," "Bleeding is found in the left auricle at No. 5," or "Bleeding is found at the root of the nose of the left auricle at No. 5," instead of "Bleeding is found in the left auricle at No. 5," the input screen control unit 340 acquires from the finding information body part information indicating a body part (e.g., "left auricle") and identification information identifying the body part (e.g., 5). When the voice-inputted finding information is "Bleeding is found at the root of the nose of the left auricle at No. 5," that is, when identification information is sandwiched between two pieces of body part information (e.g., "left auricle" and "root of nose"), the input screen control unit 340 acquires the previously voice-inputted "left auricle" as body part information.

Next, the input screen control unit 340 identifies the position of the body part in the human body diagram 800 (the position indicated by the symbol 820) based on the acquired body part information ("left auricle") and the human body diagram information 314 stored in the information storage unit 310. The input screen control unit 340 then displays identification information ("5") at the position of the identified body part in the human body diagram 800.

Finally, the information recording unit 350 stores the human body diagram 800, the body part information ("left auricle"), reading information, position information, and the identification information ("5") acquired through the voice input of the findings information in association with each other in the human body diagram information 314 stored in the information storage unit 310. As a result, when the human body diagram 800 is redisplayed on the findings record input screen 600, the input screen control unit 340 can display, for body parts for which identification information exists in the human body diagram information 314, the identification information at the position of that body part on the human body diagram 800.

Note that, although an example has been described in which the input screen control unit 340 acquires body part information indicating a body part and identification information identifying the body part from the voice-inputted findings information, the method of acquiring the body part information and identification information is not limited to this. For example, when the human body diagram 800 is displayed on the findings record input screen 600, if there is a voice input of body part information (e.g., "front head left outer side") and identification information ("4") following a body diagram selection comment selecting the human body diagram 800, the input screen control unit 340 acquires the voice-inputted body part information and identification information. Then, based on the acquired body part information and the human body diagram information 314 stored in the information storage unit 310, the input screen control unit 340 specifies the position (position indicated by the symbol 830) of the body part ("front head left outer side") in the human body diagram 800. Then, the input screen control unit 340 displays a cursor indicated by a round circle at the position of the identified body part in the human body diagram 800, and displays the identification information ("4") within the cursor. This allows the user to easily determine whether the identification information displayed on the human body diagram 800 is displayed within the cursor and whether the identification information has been included in the findings information and input by voice.

<Effects of this embodiment>
As described above, the electronic findings record recording support device 300 according to this embodiment inputs, by voice, finding information for each item via a body part screen prepared for each body part in each of the multiple terminal devices 200. Furthermore, while any body part screen is being displayed on a certain terminal device 200, the electronic findings record recording support device 300 does not cause the other terminal devices 200 to display that body part screen, and notifies the users of those other terminal devices 200 that the corresponding finding information cannot be input by voice.

As a result, the electronic findings record recording support device 300 can support the recording of findings information into an electronic findings record even in cases where it is difficult to use a manual input interface and multiple users need to simultaneously input findings information for multiple body parts. In other words, the electronic findings record recording support device 300 can support, for example, the recording of autopsy findings into an electronic findings record.

<Modification of this embodiment>
In the above-described embodiment, the electronic findings record support device 300 is applied to a system for recording autopsy findings in forensic autopsy, but the present invention is not limited to this. The electronic findings record support device 300 can be applied to various systems that accept simultaneous input of findings information on multiple body parts by multiple users, such as electronic medical charts for emergency medical care.

In addition, the part names, item names, and commands are not limited to the above examples. Furthermore, processing related to item names and commands is not necessarily required in cases where recording of findings information broken down by item name is not necessary.

The unit of body part is not limited to the above example. A body part may be any range of a group of information that a single user focuses on at one time when recording findings information, and may vary depending on the purpose of the electronic findings record.

Furthermore, the arrangement and display form of each piece of information on the findings record input screen 600 (see Figures 9 to 13) is not limited to the above-mentioned example. For example, the input screen control unit 340 may arrange the part selection area 610 to the left, below, or right of the findings input area 620.

Furthermore, the data format of the findings record information data is not limited to the above-mentioned example. The findings record information data may be in other data formats such as RTF (Rich Text Format) format, TEX format, plain text format, etc.

The terminal connection unit 320 may also communicate with the headset 220 and the display device 230 individually. In this case, the electronic findings record recording support device 300 needs to set the correspondence between the headset 220 and the display device 230, for example, in the input screen control unit 340.

Furthermore, the configuration of the terminal device 200 is not limited to the above example. The terminal device 200 may be, for example, a personal computer equipped with a microphone and a liquid crystal display.

The number of terminal devices 200 to which the electronic findings record recording support device 300 is connected may be three or more. In this case, while any of the body part screens is displayed on any of the terminal devices 200, the input screen control unit 340 assigns non-notification information to the corresponding body part name displayed on all of the other terminal devices 200. Also, while any of the body part screens is displayed on any of the terminal devices 200, the input screen control unit 340 does not allow the corresponding body part screen to be displayed on all of the other terminal devices 200.

In addition, a part of the configuration of the electronic findings record recording support device 300 may be placed on a server on a network or the like and separated from other parts of the configuration of the electronic findings record recording support device 300. In this case, each of these parts needs to be equipped with a communication unit for communicating with each other.

In addition, some or all of the components of the electronic findings record recording support device 300 may be configured integrally with any of the terminal devices 200.

The present invention is useful as an electronic findings record recording support device and an electronic findings record recording support method that can support the recording of autopsy findings in an electronic findings record.

100 Electronic findings record system 200 Terminal device 210 Terminal control device 220 Headset 230 Display device 300 Electronic findings record recording support device 310 Information storage unit 311 Voice recognition dictionary 312 Findings record configuration information 313 Findings record information data 314 Human body diagram information 320 Terminal connection unit 330 Voice recognition analysis unit 340 Input screen control unit 350 Information recording unit

Claims (5)

An electronic findings record recording support device that supports recording of findings information related to a body part in an electronic findings record,
a terminal connection unit for connecting to a terminal device having a voice input function and an image display function;
an information acquisition unit that acquires, when body part information indicating a body part and identification information identifying the body part are input by voice to the terminal device displaying a human body diagram, the body part information and the identification information based on a voice recognition process;
a position specifying unit that specifies a position of the body part in the human body diagram based on the acquired body part information, the body part information, and human body diagram information including the body part information and position information indicating the position of the body part in the human body diagram in association with each other ;
a display control unit that displays the identification information at the position of the identified body part in the human body diagram;
An electronic findings record recording support device comprising: the information acquiring unit, when the finding information is input by voice, acquires the body part information and the identification information included in the finding information based on a voice recognition process.
2. The electronic findings record recording support device according to claim 1. a human body diagram information storage unit that stores the human body diagram information including the human body diagram, the body part information, and position information indicating the position of the body part in the human body diagram in association with each other;
3. An electronic findings record recording support device according to claim 1 or 2. a storage control unit that stores the human body diagram, the body part information, the position information, and the identification information acquired by the information acquisition unit in association with each other in the human body diagram information,
4. The electronic findings record recording support device according to claim 3. 1. A computer-implemented method for assisting in recording of findings information relating to a body part in an electronic findings record, comprising:
Connecting to a terminal device having a voice input function and an image display function,
when body part information indicating a body part and identification information identifying the body part are input by voice to the terminal device displaying a human body diagram, the body part information and the identification information are acquired based on a voice recognition process;
Identifying a position of the body part on the human body diagram based on the acquired body part information, the body part information, and human body diagram information including the body part information and position information indicating the position of the body part on the human body diagram in association with each other ;
displaying the identification information at the position of the identified body part in the human body diagram;
A method to support electronic findings recording.