JP6718243B2 - Display device, display program, display system, and method for controlling display device - Google Patents

Description

The present invention relates to a display device, a display program, a display system, and a display device control method for displaying slides or the like for presentations, for example.

In recent years, a salesperson or the like often uses a terminal which is portable and has a relatively large display device when explaining a company's product. In such terminals, slides and the like according to the explanation order are often stored in advance, but depending on the content of the conversation with the customer, etc., slides different from the explanation order or prepared to be displayed in advance are not prepared. It also becomes necessary to present the slides to the display device.
Therefore, in such a case, a proposal has been made to search for necessary slides (for example, Patent Document 1).

JP, 2006-318219, A

However, if a slide search or the like is performed during an interview with a customer or the like, there is a problem that the talk is interrupted and a smooth presentation of a product description etc. is hindered.

Therefore, an object of the present invention is to provide a display device, a display program, a display system, and a control method of a display device, which can automatically select and display slides and the like related to a conversation without interrupting the conversation. And

According to the present invention, the above-mentioned problem is a display device capable of automatically selecting and displaying slide information related to a conversation without interruption or the like of the conversation, and converting a utterance of a subject into syllable information. A voice recognition unit , a syllable information storage unit that stores only the syllable information of a specific target person among the syllable information converted by the voice recognition unit , slide information that includes explanatory information, and the slide information , The combination of the explanation keyword information relating to the associated explanation information, the slide and the keyword information storage unit that stores the keyword information corresponding to the explanation keyword information, and the combination of the syllable information included in the syllable information storage unit, This is achieved by a display device characterized in that when corresponding to the explanation keyword information, the corresponding keyword information is stored as utterance keyword information, and the slide information including the utterance keyword information is output as recommended slide information.

According to the above configuration, when the combination of the syllable information converted by the voice recognition unit such as the voice determination unit corresponds to the explanation keyword information, the display device which outputs the slide information including the explanation keyword information as the recommended slide information. Has become.
Therefore, for example, when a salesperson or the like displays slide information to a customer or the like to explain a product or the like, it is possible to obtain the utterance of a target person such as the salesperson or the customer as syllable information. it can.

On the other hand, according to the above configuration, the slide information is stored by associating the slide content and the like with the explanation keyword information.
When the combination of these syllable information corresponds to the explanation keyword information, the slide information including the explanation keyword information can be automatically output (selected display, etc.) as recommended slide information.
Therefore, it is possible to output to the display device slide information having appropriate contents in accordance with the flow of conversation with the customer or the like.
Moreover, it is not necessary to perform a slide search or the like during an interview with a customer or the like, and it is possible to prevent a situation in which a conversation is interrupted and a smooth presentation such as an explanation of a product is hindered.

Preferably, the plurality of recommended slide information items of the display device are configured such that recommended display order information regarding a slide display order is attached based on the number of the vocalized keyword information items included in each of the recommended slide information items. It is characterized by

According to the above configuration, when a plurality of pieces of recommended slide information exist, recommended display order information such as priority order information regarding the slide display order is attached based on the number of explanatory keyword information included in the recommended slide information. Therefore, for example, a plurality of pieces of recommended slide information can be displayed in descending order of relevance to conversation.
Therefore, the user can easily select the recommended slide information that is more relevant to the conversation, and can give a smoother presentation of the product etc. without interrupting the flow of the conversation.

Preferably, priority display information is attached to the recommended slide information including the explanation keyword information that matches the unique information of the explanation target person.

According to the above configuration, the recommended slide information including the explanation keyword information that matches the unique information that is the information such as the content of work such as the medical department and the prescription medicine of the customer who is the explanation target is particularly the explanation target person. Is often interesting.
Therefore, the recommended slide information is given priority display information to be preferentially displayed, and is preferentially displayed in the actual display, so that the user can easily select.

Preferably, the display order of the plurality of recommended slide information is determined based on the past display result information of the recommended slide information.

According to the above configuration, the display order of the plurality of recommended slide information is determined based on the display record information of the recommended slide information in the past, so that the recommended slide information can be shown in a more preferable order for the explanation subject. ..

Preferably, the plurality of explanation keyword information of the display device includes different explanation keyword information mutually related, and when the combination of the syllable information corresponds to one of the explanation keyword information, the explanation is made. The keyword information corresponding to the keyword information is stored as the uttered keyword information, and the slide information including the uttered keyword information is also output as recommended slide information.

According to the above configuration, the plurality of explanatory keyword information includes mutually related explanatory keyword information (for example, “hypertension” and “hypotensive agent”), and the combination of the syllable information is one of the explanatory keyword information. When it corresponds to (for example, “hypertension”), the slide information including other mutually related explanation keyword information (for example, “hypotensive agent”) is also output as recommended slide information.
Therefore, more explanatory keyword information can be covered from a word or the like that is a combination of one syllable information, and the recommended slide information having a content suitable for the content of conversation or the like can be provided to the operator. ..

Preferably, the keyword combination of the syllabic information of the display device even when not corresponding to the description keyword information, when corresponding to the keyword-related language information associated with the description keyword information corresponding to the keyword-related language information Information is stored as the utterance keyword, and the slide information including the utterance keyword information is also output as recommended slide information.

According to the above configuration, even when the combination of syllable information does not correspond to the explanation keyword information (eg, “hypertension”), the keyword related language information (eg, “head”) related to the explanation keyword information (eg, “hypertension”). And “pain”), the slide information including the explanation keyword information (for example, “hypertension”) related to the keyword-related language information is also output as the recommended slide information.
Therefore, even when the utterance of the person to be explained does not correspond to the explanation keyword information, if it is related language information, it is possible to output appropriate recommended slide information.

Preferably, the display system has a display device including the terminal device having the voice recognition unit .

According to the above configuration, the voice recognition unit that converts the utterance of the person to be explained into syllable information is not a display device but a separate terminal device such as a mobile phone, and this terminal device performs voice recognition processing. Since the CPU and the like do not perform the voice recognition process, the load of the CPU and the like of the display device is reduced, and the information processing of the display device can be performed quickly.

Preferably, classification information is associated with the recommended slide information, the classification information is associated with the specific explanatory keyword information, and when the combination of the syllable information corresponds to the specific explanatory keyword information, the identification information is identified. The recommended slide information associated with the classification information associated with the explanation keyword information of is output as related classification recommended slide information.

According to the configuration, when the combination of syllable information corresponds to the specific explanatory keyword information, the recommended slide information associated with the classification information associated with the specific explanatory keyword information is associated with the recommended classification slide. It is output as information (for example, "display theme-related slide information" or the like).
For this reason, the user can output the slide information related to the classification information such as the theme that has become a topic in the conversation with the customer who is the explanation subject to the display device, so that it is smoother and more appropriate during the interview with the customer. It is possible to give presentations such as explanation of products.

The object is achieved, without the conversation to such interruption, a display program of the display device can be automatically selected and displayed slide information related to the conversation, the voice recognition to convert the utterance of Target Company syllable information Function, a function of storing only the syllable information of a specific target person in the syllable information storage unit among the syllable information converted by the voice recognition unit , slide information including description information, and association with the slide information. A combination of the explanation keyword information relating to the explanation information that is provided, the function of storing the keyword information corresponding to the explanation keyword information in the slide and the keyword information storage unit , and the combination of the syllable information included in the syllable information storage unit, Achieved by a display program for realizing a function of storing the corresponding keyword information as utterance keyword information and outputting the slide information including the utterance keyword information as recommended slide information when corresponding to the explanation keyword information. To be done.

The object is achieved, without the conversation to such interruption, a control method of a display device can be automatically selected and displayed slide information associated with the conversation, vocalization syllables information of the speech recognition unit Readers conversion, the stores only the syllable information of a specific subject in syllable information storage unit of the syllable information converted by the voice recognition unit, associated with the slide information including explanatory information, and the slide information The explanation keyword information relating to the explanation information and the keyword information corresponding to the explanation keyword information are stored in the slide and the keyword information storage unit, and the combination of the syllable information included in the syllable information storage unit is the explanation keyword. when corresponding to the information, and stores the keyword information corresponding as vocalization keywords, is achieved by the control method of the display device and outputs the slide information including the utterance keyword information as the recommended slide information.

INDUSTRIAL APPLICABILITY The present invention can provide a display device, a display program, a display system, and a control method for a display device, which can automatically select and display slides and the like related to a conversation without interrupting the conversation. There is.

It is a schematic diagram showing a main composition of a presentation support system which is a display system of the present invention, for example. It is a schematic block diagram which shows the main structures of the mobile telephone of FIG. It is a schematic block diagram which shows the main structures of the X pharmaceutical medicine information server of FIG. It is a schematic block diagram which shows the main structures of the tablet type terminal of FIG. It is a schematic block diagram which shows the main content of the 1st terminal side various information storage part. It is a schematic block diagram which shows the main content of the 2nd terminal side various information storage part. It is a schematic block diagram which shows the main content of the 3rd terminal side various information storage part. It is a schematic block diagram which shows the main content of the 4th terminal side various information storage part. It is a schematic block diagram which shows the main content of the 5th terminal side various information storage part. It is a schematic block diagram which shows the main content of the 6th terminal side various information storage part. It is a schematic block diagram which shows the main content of the 7th terminal various information storage part. It is a schematic flowchart which shows the main operation examples of this system. It is another schematic flowchart which shows the main operation examples of this system. It is another schematic flowchart which shows the main operation examples of this system. It is another schematic flowchart which shows the main operation examples of this system. It is another schematic flowchart which shows the main operation examples of this system. It is another schematic flowchart which shows the main operation examples of this system.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Since the embodiments described below are preferred specific examples of the present invention, various technically preferable limitations are given, but the scope of the present invention particularly limits the present invention in the following description. Unless otherwise stated, the present invention is not limited to these modes.

FIG. 1 is a schematic diagram showing a main configuration of a presentation support system 1 which is a display system of the present invention.
As shown in FIG. 1, in the present system 1, for example, an X pharmaceutical company is an employee thereof and a user of the present system 1, for example, a medical information provider (MR (Medical Responsive)) is a target person. For example, slide information used when providing information on the company's products to medical staff such as doctors and pharmacists such as hospitals who are customers, for example, a large number of slides are prepared, and X pharmaceutical drug of FIG. It is configured to be stored in the information server 10.

This slide is, for example, a slide for providing medical information of a company's own product (for example, antihypertensive drug A) to doctors, nurses, pharmacists, etc. whom the MR interviews. Information such as efficacy and side effects is shown.
Further, in the present system 1, each MR has a display device, for example, a tablet type terminal 30 or a terminal device, for example, a mobile phone 70, for displaying the slide to a doctor or the like who is an interview target, As shown in FIG. 1, the tablet terminal 30 and the mobile phone 70 are configured to be able to communicate with the X-pharmaceutical drug information server 10 via the Internet network 2, the base station 3, and the like.

Therefore, the tablet terminal 30 is configured to be able to acquire various slides from the X-pharmaceutical drug information server 10.

As shown in FIG. 1, the mobile phone 70 has, for example, a “mobile-side touch panel 71 ”, which is a display unit for inputting and displaying various information, in the center thereof.
The mobile-side touch panel 71 is a “display device with a position input device” and is an electronic component in which a display device such as a liquid crystal panel and a position input device such as a touch pad are combined.
Therefore, various information can be input and various information can be displayed by pressing the display on the screen.

In addition, as shown in FIG. 1, the mobile phone 70 includes a “mobile-side input button 72” for inputting various kinds of information and a microphone 73 for acquiring voice information of a customer or the like.

The tablet-type terminal 30 in FIG. 1 also has a “terminal-side touch panel 31”, a “terminal-side input button 32”, and the like, similar to the mobile phone 70.

The mobile phone 70, the tablet terminal 30, and the X-pharmaceutical drug information server 10 have computers, and the computers have a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like, which are not shown. However, these are connected via a bus or the like.

FIG. 2 is a schematic block diagram showing the main configuration of the mobile phone 70 of FIG.
As shown in FIG. 2, the mobile phone 70 has a "mobile controller 74", and the mobile controller 74 has a "mobile communication device 75" for communicating with the X-pharmaceutical drug information server 10 and the like. In addition to controlling the "portable-side touch panel 71" and the "portable-side input button 72" shown in FIG. 1, it also controls the "portable telephone device body 76" shown in FIG.
In addition, the portable control unit 74 controls the "50 syllable storage unit 77", the "syllable determination unit (program) 78", and the "portable vowel syllable storage unit 79" shown in FIG. The “50 syllable storage unit 77” and the like will be described later.
Further, the mobile control unit 74 also controls the “terminal-side various information storage unit 80” shown in FIG. 2, which stores various information.

FIG. 3 is a schematic block diagram showing the main configuration of the X-pharmaceutical information server 10 of FIG.
As shown in FIG. 3, the X-pharmaceutical drug information server 10 has a “server control unit 11 ”, and the server control unit 11 uses the “server-side communication device 12” for communicating with the tablet terminal 30 of FIG. 1. , "Server side display 13" for displaying various information, "server side various information input device 14" for inputting various information, and the like.

In addition, the server control unit 11, as shown in FIG. 3, is a “server-side slide data storage unit 15 ”, a “server-side keyword-related data storage unit 16 ”, a “server-side theme-related keyword storage unit 17 ”, and a “server-side hospital”. The data storage unit 18” and the “server side slide provision order history data storage unit 19” are also controlled. The contents of these storage units will be described later.

FIG. 4 is a schematic block diagram showing the main configuration of the tablet terminal 30 of FIG.
As shown in FIG. 4, the tablet terminal 30 has a "terminal control unit 33", and the terminal control unit 33 has a "terminal communication device 34" for communicating with the X-pharmaceutical drug information server 10 and the like. In addition to controlling the "terminal side touch panel 31" and the "terminal side input button 32" shown in FIG. 1, the "first terminal side various information storage unit 110" and the "second terminal side various information storage unit" shown in FIG. 120", "third terminal side various information storage section 130", "fourth terminal side various information storage section 140", "fifth terminal side various information storage section 150", "sixth terminal side various information" The storage unit 160" and the "seventh terminal-side various information storage unit 170" are also controlled.

5 to 11 respectively show "first terminal side various information storage section 110", "second terminal side various information storage section 120", "third terminal side various information storage section 130", "fourth". Of the "terminal-side various information storage section 140", the "fifth terminal-side various information storage section 150", the "sixth terminal-side various information storage section 160", and the "seventh terminal-side various information storage section 170" It is a schematic block diagram showing the contents. The contents of these will be described later.

12 to 17 are schematic flowcharts showing main operation examples of the present system 1.
In this embodiment, a medical information provider (MR) who is an employee of the X pharmaceutical company carries the mobile phone 70 and the tablet terminal 30 of FIG. 1 and slides on the terminal side touch panel 31 of the tablet terminal 30. Will be displayed and the information of the product of the X pharmaceutical company will be provided to the doctor who is the customer of the hospital in charge, for example.

First, the MR activates its own tablet terminal 30 shown in FIG. 1 and communicates with the X drug/medicine information server 10 of the X drug company of FIG.
Then, the process proceeds to step (hereinafter referred to as “ST”) 1. In ST1, the MR operates from the X-pharmaceutical drug information server 10 of FIG. 1 to the “server-side slide data storage unit 15”, the “server-side keyword-related data storage unit 16”, and the “server-side theme-related keyword storage unit 17” shown in FIG. , "Server-side hospital data storage unit 18", and "server-side slide provision order history data storage unit 19".

Then, it is stored in the MR tablet type terminal 30. Specifically, the "terminal-side slide data storage unit 111" in FIG. 5, the "terminal-side keyword-related data storage unit 121", the "terminal-side keyword-related data storage unit 122", and the "terminal-side hospital data storage unit" in FIG. 123” and “terminal side slide provision order history data storage unit 131” in FIG.

That is, since the MR is the tablet terminal 30 and all the data such as slides shown to the doctor etc. is stored in the X-pharmaceutical drug information server 10, all of these data are downloaded to the tablet terminal 30 in this step. Then, it becomes a process of storing.
Further, when these data are already stored in the tablet terminal 30, the present process and the process of updating to the latest data are performed.
The contents of each data stored in the tablet terminal 30 in this step will be described later.

Then, it proceeds to ST2. In ST2, the MR inputs the data of the visiting hospital and visiting medical department scheduled to visit this time, for example, the internal medicine of D hospital to the tablet terminal 30 of its own, and stores it in the "visit Dr information storage unit 132" of FIG. Memorize

After that, the MR brings the mobile phone 70 and the tablet terminal 30 shown in FIG. 1 to visit Hospital D and starts an interview with the doctor of the internal medicine. At this time, the slide is displayed on the terminal side touch panel 31 of the tablet terminal 30, and the medical information of the product of the company is started to be provided to the doctor. Further, the MR also activates the mobile phone 70 brought by the MR.

Then, it proceeds to ST3. In ST3, for example, the “syllabic judgment unit (program) 78” that is the voice recognition unit of FIG. 2 of the mobile phone 70 operates, and the “sound” detected by the microphone 73 of the mobile phone 70 and the “50 syllables” of FIG. The data in the storage unit 77" are compared.
The "50 syllable storage unit 77" stores syllabic information, for example, syllabic data of 50 syllables of Japanese "a" to "n".
Therefore, in this step, it is determined whether or not the “sound” detected by the microphone 73 corresponds to 50 syllables.

Next, when it is determined in ST4 that the “sound” detected by the microphone 73 corresponds to 50 syllables, the process proceeds to ST5. In ST5, the "sound" determined to correspond to the 50 syllables is stored in the "portable vowel syllable storage unit 79" of FIG. 2 as each syllable.

Next, in ST6, the mobile phone 70 transmits the syllable data in the "phone-side vowel syllable storage unit 79" to the tablet terminal 30 in FIG.
Next, in ST7, the tablet terminal 30 stores the received “syllabic data” in the syllable information storage unit of FIG. 7, for example, the “terminal-side vocal syllable storage unit 133”.

Then, it proceeds to ST8. In ST8, the “keyword detection unit (program) 134” of FIG. 7 operates and the combination of syllables stored in the “terminal-side vocal syllable storage unit 133” is stored in the “terminal-side slide data storage unit 111” of FIG. It is determined whether or not it corresponds to the “related keyword”.

As shown in FIG. 5, the "terminal-side slide data storage unit 111" stores slide data including explanation information (explanation of side effects of antihypertensive drug A by pharmaceutical company X) to doctors and the like. Remembered
Also, in association with this slide data, slide number information, for example, information of slide P-1 and the like is stored.

Further, for example, "related keyword" data, which is explanatory keyword information associated with the slide data, is also stored.
This related keyword is a keyword related to the description content of the slide data. For example, in the case of "Slide P-1" in FIG. 5, "related keywords" such as "hypotensive agent, hypertension, familial hypertension, side effects" are stored.

The slide data is associated with classification information, for example, “theme” information. In the case of slide P-1, as shown in FIG. 5, “side effects of antihypertensive agents” is stored as the theme.

Since such data is stored in the "terminal side slide data storage unit 111" and the "related keyword" data is stored in the "terminal side slide data storage unit 111", in this step, "terminal side speech It is determined whether the combination of syllables stored in the "syllable storage unit 133" corresponds to the "related keyword" of the "terminal-side slide data storage unit 111" in FIG.
The terminal-side slide data storage unit 111 is an example of the “slide and keyword information storage unit”.

Next, when it is determined in ST9 that the combination of syllables stored in the “terminal-side vocal syllable storage unit 133” corresponds to the “related keyword” of the “terminal-side slide data storage unit 111” in FIG. 5, ST10 is set. Then, the corresponding keyword, for example, "hypertension" is stored in the "voiced keyword storage unit 135" of FIG.

As described above, in the present embodiment, the slide and the related keyword can be automatically acquired from the words uttered by the doctor or the like with whom the MR is interviewing.

At this time, "speaker recognition" in which a feature is extracted from a voice, modeled, and the voice of an individual is recognized by using the model, only the voice of a doctor or the like can be recognized instead of the MR.
Specifically, the voice characteristics of the MR are modeled in advance and stored in the tablet terminal 30. Further, the “syllabic data” acquired from the mobile phone 70 is configured to include frequency information and the like.
Therefore, in this case, the tablet terminal 30 can distinguish the MR voice from other voices from the “syllable data” including the frequency information, and can select the MR voice.
In this case, since only the “related keyword” uttered by the doctor or the like who is the customer can be stored, the field in which the doctor or the like is interested can be more accurately grasped.

Then, it proceeds to ST11. In ST11, the "related keyword detection unit (program) 136" of FIG. 7 operates and refers to the "terminal side keyword related data storage unit 121" of FIG. Then, it is determined whether or not the “related keyword” stored in the “voiced keyword storage unit 135” of FIG. 7 corresponds to the “related keyword” of the “terminal side keyword related data storage unit 121”.

Next, when it is determined that there is a "related keyword" in ST12, the process proceeds to ST13. In ST13, the corresponding keyword in the “terminal-side keyword-related data storage unit 121” is stored in the “voiced keyword storage unit 135” of FIG. 7 as a “voiced keyword”.
For example, since the related keyword “hypertension” corresponds to the “related keyword” in the “terminal-side keyword-related data storage unit 121”, the keyword “hypotensive agent” corresponding to this “hypertension” is changed to the “voice keyword”. Is registered in the “voiced keyword storage unit 135 ”.
In addition, here, the correspondence information between the “related keyword” and the “keyword” in the “terminal-side keyword-related data storage unit 121” is an example of “explanatory keyword information that is mutually related”.

Therefore, in the present embodiment, it is possible to cover more keywords from words or the like which are a combination of one syllable information.

Then, it progresses to ST14. In ST14, the "related word reference keyword detection unit (program) 137" in FIG. 7 operates, refers to the "terminal side vocal syllable storage unit 133" in FIG. 7, and the "terminal side keyword related data storage unit 121 in FIG. It is determined whether or not there is a word corresponding to the "related word" of ".

Next, when it is determined in ST15 that the word corresponds to the “related word”, in ST16, the keyword corresponding to the “related word” is stored in the “spoken keyword storage unit 135” of FIG. 7 as the “spoken keyword”.
For example, when the words "head" and "painful" are stored in the "terminal-side vocal syllable storage unit 133" as continuous or extremely close words, the related words in the "terminal-side keyword-related data storage unit 121" are stored in the related words. The corresponding "keyword""hypertension" is stored as the uttered keyword.

Further, when the words “low blood pressure” and “nausea” are stored in the “terminal-side vocal syllable storage unit 133” as consecutive or extremely close words, the relevant relation in the “terminal-side keyword-related data storage unit 121” is stored. The “side effect”, which is the “keyword” corresponding to the word, is stored as the uttered keyword.
Further, here, the correspondence information between the “related word” and the “keyword” in the “terminal side keyword-related data storage unit 121” is an example of the “keyword-related language information”.

As described above, in the present embodiment, even if the “syllable data” corresponding to the related keyword is not in the “terminal-side syllable storage unit 133”, the “syllable data” corresponding to the related word is “syllabic data”. Is stored, the related “keyword” is stored as a vocal keyword.
Therefore, a wider "keyword" can be stored as the "voiced keyword" from the conversation during the interview with the doctor.

As described above, the process of acquiring the “related keyword” or the “keyword” from the words of the doctor who is interviewing and storing the “related keyword” or the “keyword” in the “voiced keyword storage unit 135” as the “voiced keyword” ends.
In the present embodiment, as described above, “hypertension”, “hypotensive agent”, and “side effect” are first registered as utterance keywords.
Furthermore, in the present embodiment, for example, since a doctor uttered a language corresponding to “hyperlipidemia”, “hyperlipidemia” is stored as a “voiced keyword”.
Therefore, in the present embodiment, the vocalized keywords are “hypertension”, “hypotensive agent”, “side effect”, and “hyperlipidemia”.

Therefore, in the following, a step of selecting a slide suitable for the content of the talk of the doctor during the interview is carried out from these “voiced keywords”.

First, in ST17, the "basic slide selection processing unit (program) 141" of FIG. 8 operates, and the "terminal side slide data storage unit of FIG. 5 including the "utterance keyword" of the "utterance keyword storage unit 135" of FIG. The presence or absence of the "111" slide is determined.
Specifically, for example, it is determined whether or not there is a slide including “hypertension”, “hypotensive agent”, “side effect” and “hyperlipidemia” as “related keywords”.

Next, when it is determined in ST18 that there is a slide including the "uttered keyword" in the "related keyword", in ST19, the slide number of the slide including the "uttered keyword" is set to the "basic slide storage unit 142" in FIG. Memorize.
For example, as shown in the “terminal-side slide data storage unit 111” of FIG. 5, a slide including any of “hypertension”, “hypotensive agent”, “side effect” and “hyperlipidemia” , "Slide P-1,""SlideP-2,""SlideP-3," and "Slide P-4," these slide numbers are stored in the "basic slide storage unit 142" in FIG.

As a result, we were able to extract a list of slides that were related to the words of the doctor who was interviewing, and then performed the step of identifying the slides that were more closely related to these slides as follows. To do.

In ST20, the "slide priority information addition unit (program) 143" of FIG. 8 operates and the slide numbers (slides P-1, P-2, P-3, P-) of the "basic slide storage unit 142" of FIG. 8 are operated. Among the slides corresponding to 4), the "priority information" is displayed in order from the slide containing the largest number of vocalized keywords ("hypertension", "hypotensive agent", "side effect", "hyperlipidemia", etc.). It is associated and stored in the “priority information storage unit 144” of FIG.

For example, slide numbers P-1 and P-2 include three vocalization keywords “hypertension”, “hypotensive agent”, and “side effect”. Since the number of “vocalization keywords” is the largest, they are associated with “first priority”, It is stored in the "priority information storage unit 144".
Further, since the slide numbers P-3 and P-4 both include the two vocalization keywords “hyperlipidemia” and “side effect”, they are stored in the “priority information storage unit 144” in association with the “second priority”. It
The "priority information" is an example of the "recommended display order information".

Therefore, in the conversation during the interview with the doctor, it is possible to prioritize and prepare slides that are more suitable and more appropriate.

Next, in ST21, the “hospital unique information addition unit (program) 145” of FIG. 8 operates, and based on the information of the “visit Dr information storage unit 132” of FIG. 7, for example, D hospital and internal medicine, Refer to the "terminal side hospital data storage unit 123".
The "terminal-side hospital data storage unit 123" stores a hospital name, a delivered drug name, a related drug name by clinical department, competitive information for each drug, and the like.
For example, A hospital is supplied with antihypertensive agent, B antihypertensive agent, C hyperlipidemic agent, D hyperlipidemic agent and the like, and internal medicine uses antihypertensive agent, hyperlipidemic agent and the like. It is remembered. It is also remembered that the antihypertensive drugs of the internal medicine compete with the antihypertensive drug of A and the antihypertensive drug of B, and the hyperlipidemic drug competes with the hyperlipidemic drug of C and the hyperlipidemic drug of D. ..

Therefore, based on the D hospital and internal medicine in the “visit Dr information storage unit 132”, drug information (eg, “hypotensive agent”, “hyperlipidemic agent”, etc.) of internal medicine of the hospital (D hospital) and competition information ( For example, "A antihypertensive drug" and "B antihypertensive drug", "C hyperlipidemic drug" and "D hyperlipidemic drug" etc. are acquired, and the drug information ("hypertensive drug" "hyperlipidemic drug" is acquired. Of the "basic slide memory unit 142" containing the competitive information ("A antihypertensive agent" and "B antihypertensive agent", "C hyperlipidemic agent" and "D hyperlipidemic agent"). The "hospital unique information" is associated with the slide number and stored in the "hospital unique information storage unit 151".

For example, slide number P-1 includes "hypotensive agent", P-2 includes "hypotensive agent", "A antihypertensive agent" and "B antihypertensive agent", and P-3 includes "hyperlipidemic agent". And P-4 include "hyperlipidemic agent", "C hyperlipidemic agent" and "D hyperlipidemic agent", and thus are slide numbers P-1 to P-4. "Hospital peculiar information" is associated and stored in the "hospital peculiar information storage unit 151" of FIG.

It should be noted that the data such as D hospital and A antihypertensive drug in the “terminal side hospital data storage unit 123” of FIG. 6 is an example of “unique information”, and the hospital unique information is an example of “priority display information”. ..

Therefore, when there are slides that contain related keywords or the like that are relevant to matters that the doctor or the like who is the other party of the interview stored in advance is interested in, these slides are prioritized display “hospital”. It is configured to add "unique information".

Then, it progresses to ST22. In ST22, the "display order slide data extraction unit (program) 152" of FIG. 9 operates, and the slide number of the "basic slide storage unit 142" is the slide of the "terminal side slide provision order history data storage unit 131" of FIG. It is determined whether the numbers match.
This "terminal-side slide provision order history data storage unit 131" stores "slide display order" data indicating the order in which a plurality of slide numbers were previously displayed by another MR. The display count data in the slide display order is also stored.
Therefore, in this step, first, it is determined whether or not the slide number in the "basic slide storage unit 142" matches the slide number in the "terminal side slide provision order history data storage unit 131" in FIG.

Next, in ST23, when the slide number matches, the process proceeds to ST24. In the present embodiment, since the slide numbers of the “terminal side slide provision order history data storage unit 131” are P-1, P-2, P-3, and P-4, “terminal side slide provision order history data”. It matches the slide number of the storage unit 131”.
Therefore, the process proceeds to ST24. In ST24, the "slide display order" information that is frequently displayed in the "terminal side slide provision order history data storage section 131" is selected and stored in the "display order slide order data storage section 153" of FIG.

That is, in the same slide combination, the “slide display order” displayed most by other MRs is stored in the “display order slide order data storage unit 153”.
In the present embodiment, for example, “P-1”→“P-2”→“P-3”→“P-4” is displayed in the “terminal side slide provision order history data storage unit 131” of FIG. 7. The display order is stored because the number is the highest at 20 times.
The data stored in the “terminal side slide provision order history data storage unit 131” is an example of “display record information”.

Then, it proceeds to ST25. In ST25, the “first slide display order determination processing unit (program) 154” in FIG. 9 operates, and whether multiple slide numbers are present in the same priority order in the “priority information storage unit 144” in FIG. Determine whether or not.
In the present embodiment, as described above, the slides P-1 and P-2 are stored in the "priority information storage unit 144" as the "first priority", and the slides are stored as the "second priority". P-3 and P-4 are stored.
Therefore, in ST26, it is determined that a plurality of slide numbers exist in the same priority order. However, in this step, if there are no slide numbers in the same priority order, the process proceeds to ST27.

In ST27, each slide number is displayed as a “recommended slide number” on the terminal side touch panel 31 of the tablet terminal 30 of FIG. 1 in accordance with the priority order of the “priority information storage unit 144”.
That is, the tablet terminal 30 displays the number to the MR as a “recommended slide” having a suitable content according to the flow of conversation with the doctor, as needed. Further, when there are a plurality of recommended slides, the slides having the contents according to the flow of the conversation are displayed in order (priority is given).

Then, the MR visually recognizing such a display can display the slide content of the recommended slide number only by selecting the "recommended slide number" on the terminal side touch panel 31 by clicking or the like. ing.
Therefore, the MR can promptly display the slide content most suitable for the content on the terminal side touch panel 31 during the conversation with the doctor, so that it is not necessary to perform the slide search or the like during the interview unlike the conventional case, and the conversation can be performed. There will be no interruptions and smooth presentations will be possible.

Further, since the recommended slide numbers are displayed in the order of appropriate contents that match the contents of the conversation, the MR selects the slide of the earliest recommended slide number, and the slide with the optimum contents is displayed on the terminal side touch panel 31. Can be displayed on.
The “recommended slide number” is an example of recommended slide information.

On the other hand, when it is determined in ST26 that a plurality of slide numbers are present in the same priority order, the process proceeds to ST28. In ST28, referring to the "hospital unique information storage unit 151" in FIG. 9, even the slides having the same priority order are processed as the more prioritized display, and the "first slide" in FIG. It is stored in the display order determination storage unit 155”.

In the present embodiment, as described above, in the “hospital peculiar information storage unit 151”, the “hospital peculiar information” is associated with all of the slides P-1, P-2, P-3 and P-4. , The slides P-1 and P-2 of "first priority" are stored in the "first slide display order determination storage unit 155" as the same priority display, and the slides P-3 and P of "second priority" are stored. -4 is stored as the same priority display in the "first slide display order determination storage unit 155".

Then, it proceeds to ST29. In ST29, the “second slide display order determination processing unit (program) 161” in FIG. 10 operates, refers to the “first slide display order determination storage unit 155”, and a plurality of slides exist in the same priority order. Determine whether to do.

In the present embodiment, as described above, since a plurality of slides have the same priority in the “first slide display order determination storage unit 155”, it is determined in ST30 that a plurality of slides have the same priority. To be done.
However, if it is determined in ST30 that a plurality of slides do not exist with the same priority, unlike in the present embodiment, the process proceeds to ST31.

In ST31, each slide number is displayed as a "recommended slide number" on the terminal side touch panel 31 of the tablet terminal 30 in FIG. 1 in accordance with the priority order of the "first slide display order determination storage unit 155".
That is, the tablet terminal 30 displays the number to the MR as a “recommended slide” having a suitable content according to the flow of conversation with the doctor, as needed. Further, when there are a plurality of recommended slides, the slides having the contents according to the flow of the conversation are displayed in order (priority is given).

On the other hand, when it is determined in ST30 that a plurality of slide numbers are present in the same priority order as in the above-described present embodiment, the process proceeds to ST32.
In ST32, the “display order slide data storage unit 153” in FIG. 9 is referred to, the slide display order is determined according to the display order, and the slide display order is stored in the “second slide display order determination storage unit 162”.

In the present embodiment, as described above, for example, in the “display order slide data storage unit 153”, priority is given to “slide P-1”→“P-2”→“P-3”→“P-4”. It is stored as a display order.
Therefore, the “second slide display order determination storage unit 162” stores the priority display order of “slide P-1”→“P-2”→“P-3”→“P-4”.

Then, it proceeds to ST33. In ST33, the slide number is displayed as the recommended slide number on the terminal side touch panel 31 of the tablet terminal 30 in accordance with the slide display order of the “second slide display order determination storage unit 162”.
At this time, in addition to preferentially displaying slides containing many “related keywords” based on the utterance of the doctor who is interviewing, if there are slides with the same priority, “hospital specific information (hospital Name, delivered drug name, related drug name by department, competitive information, etc.), and more preferentially display slides preferentially, and/or other MRs in the display order of slides displayed in the past. The configuration is such that more appropriate slides are preferentially displayed based on the information.

Therefore, during the conversation with the doctor, it is possible to quickly display the optimum slide number on the terminal side touch panel 31 because it is closely related to the conversation, and the MR can display the number on the terminal side touch panel 31 as described above. The configuration is such that the appropriate slide content can be displayed promptly by simply selecting it.
Further, even if there are a plurality of recommended slide numbers displayed on the terminal side touch panel 31, a more appropriate recommended slide number is preferentially displayed. Therefore, the MR should select the appropriate recommended slide without hesitation. You can
As described above, the system 1 according to the present embodiment is configured to smoothly provide medical information without interrupting a conversation with a doctor when searching for a slide or the like.

Then, it proceeds to ST34. In ST34, "Do you want to display the theme-related slide?" is displayed on the terminal side touch panel 31.
That is, it is asked whether the content of the conversation with the doctor and the "theme-related slide" which is a slide having the same "theme" are displayed separately from the recommended slide displayed in ST33 or the like.

When it is input in ST35 that the display of the theme-related slide is desired, the process proceeds to ST36. In ST36, the “corresponding theme information extraction processing unit (program) 163” of FIG. 10 operates, and the “corresponding keyword” of the “terminal-side theme-related keyword storage unit 122” of FIG. It is determined whether or not it is included in the "voiced keyword" of "135".

In the present embodiment, as shown in FIG. 6, “corresponding keywords” include “side effects” and “hypotensive agents”, and “corresponding side effects of antihypertensive agents” are stored as corresponding themes.
Further, in the above example, as the “voiced keyword” in the “voiced keyword storage unit 135”,
“Hypertension”, “hypotensive agent”, “side effect” and “hyperlipidemia” are stored.
Therefore, it is judged that the “side effect” and the “hypotensive agent” of the “corresponding keyword” are included in the “voicing keyword”.

In ST37, when the “corresponding keyword” is included in the “voiced keyword”, the process proceeds to ST38. In ST38, the “theme” corresponding to the “corresponding keyword” is stored in the “corresponding theme information storage section 164” of FIG.
In the present embodiment, the “correspondence keyword” “side effect” and “hypertensive agent” are included in the “voiced keyword”. Therefore, in ST38, the “theme” “side effect of antihypertensive agent” is “the subject”. Stored in the information storage unit 164"

Then, it proceeds to ST39. In ST39, the “theme-related slide information extraction processing unit (program) 165” in FIG. 10 operates, refers to the “terminal-side slide data storage unit 111” in FIG. 5, and reads “the relevant data information storage unit 164” in FIG. In the present embodiment, for example, the presence or absence of a slide having “a side effect of an antihypertensive agent” is determined.

If it is determined in ST40 that there is a slide having the theme (for example, “side effect of antihypertensive agent”) stored in the “data information storage unit 164”, the process proceeds to ST41.
In this embodiment, as shown in the “terminal side slide data storage unit 111” in FIG. 5, “slides P-1”, “P-2”, and “P-5” exist.

In ST41, the slide number existing in the "theme-related slide information storage unit 166" of FIG. 10 is stored. In the present embodiment, for example, “slide P-1”, “P-2” and “P-5” are stored.

As described above, in the present embodiment, the MR can extract and store the slide number information regarding the theme that became the topic in the conversation with the doctor.

Then, it proceeds to ST42. In ST42, the “display theme-related slide extraction processing unit (program) 171” in FIG. 11 operates, refers to the “basic slide storage unit 142” in FIG. 8, and the slides that do not overlap with the stored slides are shown in FIG. It is determined whether or not it is stored in the “theme-related slide information storage unit 166”.

In the present embodiment, as described above, the “basic slide storage unit 142” stores “slides P-1”, “P-2”, “P-3”, and “P-4”. , "Slide P-1", "P-2", and "P-5" are stored in the "theme-related slide information storage unit 166".
Therefore, a slide that does not overlap with the “basic slide storage unit 142” is “slide P-5”, and this slide number is stored in the “theme-related slide information storage unit 166”.

In ST43, when the slide number that does not overlap with the "basic slide storage unit 142" is stored in the "theme-related slide information storage unit 166", the process proceeds to ST44.
In ST44, the slide number, in the present embodiment, "slide P-5" is stored in the "display theme related slide storage unit 172" of FIG.

Then, it proceeds to ST45. In ST45, the slide number stored in the “display theme-related slide storage unit 172” in FIG. 11 is displayed on the terminal-side display 31 of the tablet terminal 30 as a “theme-related slide”.
Then, the MR visually recognizing such a display displays the slide content of the slide number by simply clicking and selecting the "slide number" displayed as the "theme-related slide" on the terminal side touch panel 31. It is configured to be done.

Therefore, the MR can display the slide information related to the topic that became a topic in the conversation with the doctor, and thus can provide the medical information more smoothly and appropriately during the interview with the doctor.
Further, in the present embodiment, the slide numbers displayed as “theme-related slides” are slide numbers not included in the recommended slide numbers displayed on the terminal-side display 31 in ST33 or the like, so the same slide number is duplicated. It is possible to avoid displaying.
Therefore, it is possible to avoid unnecessary confusion and the like in the MR during the interview, and it is possible to provide medical information more smoothly.

The “theme related slide” is an example of the related category recommended slide information.

The present invention is not limited to the above embodiment.

DESCRIPTION OF SYMBOLS 1... Presentation support system, 2... Internet network, 3... Base station, 10... X pharmaceutical drug information server, 11... Server control part, 12... Server side communication device, 13 ... server side display, 14... server side information input device, 15... server side slide data storage section, 16... server side keyword related data storage section, 17... server side theme related keyword Storage unit, 18... Server side hospital data storage unit, 19... Server side slide provision order history data storage unit, 30... Tablet type terminal, 31... Terminal side touch panel, 32... Terminal side Input buttons, 33... Terminal control unit, 70... Mobile phone, 71... Portable touch panel, 72... Portable input button, 73... Microphone, 74... Portable control unit, 75 ... mobile communication device, 76... mobile phone device main body, 77... 50 syllable storage unit, 78... syllable determination unit (program), 79... mobile phone syllable storage unit, 80... ..Terminal side various information storage unit 110...First terminal side various information storage unit 111...Terminal side slide data storage unit 120...Second terminal side various information storage unit 121. ..Terminal side keyword related data storage unit, 122... Terminal side theme related keyword storage unit, 123... Terminal side hospital data storage unit, 130...Third terminal side various information storage unit, 131... Terminal side slide provision order history data storage unit, 132... Visit Dr information storage unit, 133... Terminal side vocal syllable storage unit, 134... Keyword detection unit (program), 135... Spoken keyword storage Part, 136... Related keyword detection part (program), 137... Related word reference keyword detection part (program), 140... Fourth terminal side various information storage part, 141... Basic slide selection processing Part (program), 142... Basic slide storage unit, 143... Slide priority information addition unit (program), 144... Priority information storage unit, 145... Hospital unique information addition unit (program), 150... Various information storage unit on fifth terminal side, 151... Hospital unique information storage unit, 152... Display order slide data extraction unit (program), 153... Display order slide order data storage unit, 154... First slide display order determination processing unit (program), 155... First slide display order determination storage unit, 160... Various sixth terminal side Information storage unit, 161... Second slide display order determination processing unit (program), 162... Second slide display order determination storage unit, 163... Theme information extraction processing unit (program), 164 ... The theme information storage unit, 165... Theme-related slide information extraction processing unit (program), 166... Theme-related slide information storage unit, 170... Seventh terminal-side various information storage unit, 171・・・Display theme related slide extraction processing unit (program), 172 ・・・Display theme related slide storage unit

Claims (10)

A display device capable of automatically selecting and displaying slide information related to a conversation without interrupting the conversation,
A voice recognition unit that converts the utterance of the target person into syllable information,
A syllable information storage unit that stores only the syllable information of a specific target person among the syllable information converted by the voice recognition unit,
Slide information that includes explanatory information,
Explanatory keyword information regarding the explanatory information associated with the slide information, and a slide and a keyword information storage unit that stores keyword information corresponding to the explanatory keyword information ,
When the combination of the syllable information included in the syllable information storage unit corresponds to the explanation keyword information, the corresponding keyword information is stored as utterance keyword information, and the slide information including the utterance keyword information is a recommended slide. A display device characterized by outputting as information. A plurality of the recommended slide information is configured such that recommended display order information regarding a display order of slides is attached based on the number of the vocalized keyword information included in each of the recommended slide information. Display device according to 1. The display device according to claim 1 or 2, wherein the recommended slide information including the explanation keyword information that matches the unique information of the explanation target person is given priority display information. The display device according to any one of claims 1 to 3 , wherein a display order of the plurality of recommended slide information items is determined based on display result information of the recommended slide information items in the past. When the combination of the syllable information corresponds to one of the explanation keyword information, the plurality of the explanation keyword information includes different explanation keyword information which are mutually related, and the keywords corresponding to the explanation keyword information. The display device according to claim 1 , wherein information is stored as the utterance keyword information, and the slide information including the utterance keyword information is also output as recommended slide information. Even when the combination of the syllable information does not correspond to the explanation keyword information, when it corresponds to the keyword-related language information related to the explanation keyword information, the keyword information corresponding to the keyword-related language information is stored as the uttered keyword. However, the slide information including the utterance keyword information is also output as recommended slide information, and the display device according to any one of claims 1 to 5. Classification information is associated with the recommended slide information,
The classification information is associated with the specific explanation keyword information,
When the combination of the syllable information corresponds to the specific explanatory keyword information, the recommended slide information associated with the classification information associated with the specific explanatory keyword information is used as related classification recommended slide information. It outputs, The display apparatus of any one of Claim 1 thru|or 6 characterized by the above-mentioned. A display system having the display device according to any one of claims 1 to 7, further comprising a terminal device having the voice recognition unit. A display program for a display device capable of automatically selecting and displaying slide information related to a conversation without interrupting the conversation,
A function of the voice recognition unit that converts the utterance of the target person into syllable information,
A function of storing only the syllable information of a specific target person in the syllable information storage unit among the syllable information converted by the voice recognition unit,
A function for storing slide information including explanation information, explanation keyword information relating to the explanation information associated with the slide information, and keyword information corresponding to the explanation keyword information in a slide and a keyword information storage unit,
When the combination of the syllable information included in the syllable information storage unit corresponds to the explanation keyword information, the corresponding keyword information is stored as utterance keyword information, and the slide information including the utterance keyword information is a recommended slide. A display program for realizing the function to output as information. A method for controlling a display device capable of automatically selecting and displaying slide information related to a conversation without interrupting the conversation,
Voice recognition unit converts the utterances Target Company syllable information,
Among the syllable information converted by the voice recognition unit, only the syllable information of a specific target person is stored in the syllable information storage unit,
Slide information including explanation information, explanation keyword information relating to the explanation information associated with the slide information, and keyword information corresponding to the explanation keyword information is stored in a slide and a keyword information storage unit,
When the combination of the syllable information included in the syllable information storage unit corresponds to the explanation keyword information, the corresponding keyword information is stored as a vocal keyword, and the slide information including the vocal keyword information is recommended slide information. A method for controlling a display device, comprising:

Images