JP6350682B2 - Presentation support device, presentation support method, and presentation support program - Google Patents

Description

  The present invention relates to a presentation support apparatus, a presentation support method, and a presentation support program.

  As an example of a technology for supporting a presentation, there is a technique for presenting a presenter or a listener with a part that the presenter is explaining. For example, a display device has been proposed that aims to suppress skipping of a document. This display device recognizes a phrase uttered by a speaker, identifies a read-out portion of a document being displayed on a display panel based on the recognized phrase, and displays a display state of the identified portion as a first state. The display state is changed to a second display state different from the first display state, for example, highlight display such as blinking.

JP 2009-271814 A JP 2012-150616 A JP 2002-023716 A

  However, in the above technique, as will be described below, an incorrect location may be highlighted on the listener.

  That is, in the above display device, speech recognition is used to obtain a phrase uttered by a speaker. However, when misrecognition occurs in speech recognition, a portion that is not being explained by the speaker is highlighted as a result of misrecognition, and as a result, an incorrect portion may be highlighted for the listener. In this case, the display device may interfere with the progress of the presentation as a result of misleading the attention of the listener.

  In one aspect, an object of the present invention is to provide a presentation support device, a presentation support method, and a presentation support program that can prevent an audience from highlighting an erroneous part.

  An aspect of the presentation support apparatus includes an acquisition unit that acquires a distance relationship between a screen on which a display device displays a document file, a presenter, and an audience, and an area included in a page of the document file that is displayed on the screen from the distance relationship. A setting unit that sets a display size of a marker that activates the highlight display relating to, a determination unit that determines a region that is a candidate for highlight display among regions included in a page displayed on the display device, and the display A marker display unit that displays the marker in association with a region that is a candidate for highlight display according to a size.

  It is possible to suppress highlighting of an erroneous part by the listener.

FIG. 1 is a diagram illustrating the configuration of the presentation support system according to the first embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the presentation support apparatus according to the first embodiment. FIG. 3 is a diagram illustrating an example of marker setting data. FIG. 4 is a diagram illustrating an example of a slide screen. FIG. 5 is a diagram illustrating an example of a slide screen. FIG. 6 is a flowchart illustrating the procedure of the time setting process according to the first embodiment. FIG. 7 is a flowchart illustrating the procedure of the marker setting process according to the first embodiment. FIG. 8 is a flowchart illustrating a procedure of marker display processing according to the first embodiment. FIG. 9 is a flowchart illustrating a procedure of highlight display processing according to the first embodiment. FIG. 10 is a diagram illustrating a functional configuration of the presentation support apparatus 20 according to the second embodiment. FIG. 11 is a flowchart of the extracted word data generation process according to the second embodiment. FIG. 12 is a flowchart illustrating the procedure of the speech recognition process according to the second embodiment. FIG. 13 is a flowchart illustrating a procedure of marker display processing according to the second embodiment. FIG. 14 is a diagram illustrating a hardware configuration example of a computer that executes the presentation support program according to the first embodiment and the second embodiment.

  Hereinafter, a presentation support apparatus, a presentation support method, and a presentation support program according to the present application will be described with reference to the accompanying drawings. Note that this embodiment does not limit the disclosed technology. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[System configuration]
FIG. 1 is a diagram illustrating the configuration of the presentation support system according to the first embodiment. The presentation support system 1 shown in FIG. 1 provides a presentation support service that highlights a portion of the presentation screen on which a document file is displayed on the display device 5 that is presumed to be explained by the presenter.

  As part of the presentation support service, the presentation support system 1 sets the display size of the marker that activates the highlight display based on the distance relationship between the screen on which the slide is displayed as an example of the presentation screen, the presenter, and the listener, and highlights the highlight. Markers are displayed in association with regions that are candidates for display.

  As a result, for example, the marker can be displayed in a size smaller than the highlight display, and the highlight display can be called in a state where the presenter can visually recognize the presentation participants but is difficult for the listener to view. Provides display control to display markers. As a result, when the presenter recognizes the marker, whether or not the highlight display is appropriate can be selected. Accordingly, it is possible to suppress a situation in which a wrong place for the listener, for example, a place where the presenter is not explaining is highlighted.

  Here, in the following, as an example, it is assumed that the above display control function is added to presentation software, and one or more slides included in a document file created using the presentation software are displayed on the display device 5. Assume that the presentation is progressed by displaying. Such slides can be imported with text and graphics as well as content created by other application programs. For example, you can import documents created with word processing software, tables and graphs created with spreadsheet software, images and movies taken with an imaging device, and images and movies edited with image editing software. And can be imported.

  As shown in FIG. 1, the presentation support system 1 accommodates a microphone 3, a display device 5, an input device 7, and a presentation support device 10. The peripheral devices such as the microphone 3, the display device 5 and the input device 7 and the presentation support device 10 are connected by wire or wirelessly.

  The microphone 3 is a device that converts sound into an electrical signal, and is sometimes called a microphone. For example, the microphone 3 can be attached to a presenter who performs a presentation. In this case, a headset-type or tie-pin type microphone can be attached to a predetermined position of the presenter's body or clothes, or a hand-type microphone can be carried by the presenter. The microphone 3 can also be installed at a predetermined position in a range where the utterance of the presenter can be collected. In this case, the microphone 3 may be an attachment type or a stationary type microphone. In any of these cases, a microphone having any type of directivity can be adopted as the microphone 3, but sounds other than the presenter's utterance, for example, the utterance of the listener and the noise such as noise are collected. In order to suppress this, the sensitivity of the microphone can be limited to the speaking direction of the presenter. The microphone 3 can employ any conversion method such as a dynamic type, an electret capacitor type, or a capacitor type.

  The analog signal obtained by collecting the sound in the microphone 3 is converted into a digital signal and then input to the presentation support apparatus 10.

  The display device 5 is a device that displays various types of information. For example, the display device 5 may be a liquid crystal display or an organic EL (electroluminescence) display that realizes display by light emission, or a projector that realizes display by projection. Further, the number of installed display devices 5 is not necessarily limited to one, and a plurality of display devices 5 may be provided. In the following, as an example, it is assumed that a projector and a screen that displays an image projected by the projector are mounted as a shared display device that is viewed by both presenters and listeners who are participants of the presentation.

  For example, the display device 5 displays a presentation screen according to an instruction from the presentation support device 10. For example, the display device 5 displays a slide of a document file opened by presentation software that operates on the presentation support device 10. In this case, the display device 5 can display any slide specified by the presenter via the input device 7 among the slides included in the document file, and the slide show function of the presentation software is set to the ON state. In this case, the slides included in the document file can be switched and displayed in the order in which the slides are created.

  The input device 7 is a device that receives instruction inputs for various types of information. For example, when the display device 5 is mounted as a projector, a laser pointer indicating the position on the screen projected on the screen can be mounted as the input device 7. That is, among laser pointers, there is also a laser pointer with a remote control function provided with an operation unit such as various buttons for advancing and returning a slide page. The operation unit of the laser pointer with a remote control function can be used as the input device 7. In addition, a predetermined part of the screen or presenter was imaged in order to adopt a mouse or keyboard as the input device 7, or to sense the position of the pointer pointed by the laser pointer, detect the gaze of the presenter, or recognize the gesture. An image sensor that inputs an image may be employed as the input device 7. When the display device 5 is mounted as a liquid crystal display, the input device 7 may be a touch sensor bonded on the liquid crystal display.

  As an example, the input device 7 accepts designation of a document file to be executed by the presentation software on the presentation support device 10, an operation of advancing a slide page, an operation of returning a slide page, and the like. The operation accepted through the input device 7 in this way is output to the presentation support device 10.

  The presentation support apparatus 10 is a computer on which presentation software is executed.

  As an embodiment, the presentation support apparatus 10 may employ an information processing apparatus such as a desktop or notebook personal computer. In addition, the presentation support apparatus 10 can employ not only a stationary terminal such as the personal computer but also various portable terminal apparatuses. For example, as an example of a mobile terminal device, a mobile communication terminal such as a smart phone, a mobile phone or a PHS (Personal Handyphone System), and a slate terminal such as a PDA (Personal Digital Assistants) are included in the category.

  In the present embodiment, as an example, it is assumed that the presentation support apparatus 10 provides the above-described presentation support service in a stand-alone manner that independently executes the above-described presentation software without depending on external resources. Although the details will be described later, the presentation support service is not limited to the implementation provided in a stand-alone manner. For example, it is possible to construct a client server system or a thin client system by providing a server that provides the presentation support service for a client that executes presentation software.

[Configuration of Presentation Support Device 10]
Next, the functional configuration of the presentation support apparatus 10 according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a functional configuration of the presentation support apparatus 10 according to the first embodiment. As shown in FIG. 2, the presentation support apparatus 10 includes an input / output I / F (InterFace) unit 11, a storage unit 13, and a control unit 15. Note that FIG. 2 shows a solid line representing the input / output relationship of data, but FIG. 2 shows only a minimum part for convenience of explanation. That is, the input / output of data related to each processing unit is not limited to the illustrated example, and the input / output of data other than those illustrated, for example, between the processing unit and the processing unit, between the processing unit and data, and between the processing unit and the external Data input / output between devices may be performed.

  The input / output I / F unit 11 is an interface that performs input / output with peripheral devices such as the microphone 3, the display device 5, and the input device 7.

  As one embodiment, the input / output I / F unit 11 outputs various operations input from the input device 7 to the control unit 15. Further, the input / output I / F unit 11 outputs the slide image data output from the control unit 15 to the display device 5 or instructs to add a marker to a predetermined area on the slide output from the control unit 15. Or a highlight instruction for a region included in the slide or a cancel instruction thereof is output to the display device 5. Further, the input / output I / F unit 11 outputs the audio data input from the microphone 3 to the control unit 15.

  The storage unit 13 is a device that stores data used for various programs such as an OS (Operating System) and presentation software executed by the control unit 15 and application programs.

  As an embodiment, the storage unit 13 is implemented as a main storage device in the presentation support apparatus 10. For example, various semiconductor memory elements such as a RAM (Random Access Memory) and a flash memory can be employed for the storage unit 13. The storage unit 13 can also be implemented as an auxiliary storage device. In this case, an HDD (Hard Disk Drive), an optical disk, an SSD (Solid State Drive), or the like can be employed.

  The storage unit 13 stores document data 13a, explanation time data 13b, and marker setting data 13c as an example of data used in a program executed by the control unit 15. The explanation time data 13b and the marker setting data 13c other than the document data 13a will be explained together with the explanation of the control unit 15. In addition to the above data, the storage unit 13 also includes other electronic data, for example, definition data in which the correspondence between the positions of the areas and the markers, such as the shape and color of the markers, is defined, and the highlight display. Definition data and the like can also be stored.

  The document data 13a is data related to a document.

  As an embodiment, a document file in which one or more slides are created using presentation software can be adopted as the document data 13a. Such slides can be imported with text and graphics as well as content created by other application programs. For example, you can import documents created with word processing software, tables and graphs created with spreadsheet software, images and movies taken with an imaging device, and images and movies edited with image editing software. And can be imported. In this way, in order to realize a keyword search by voice recognition, meta information including a character string such as an explanatory word or a description of the content is added to the content other than the text before the presentation is started. Can do.

  The control unit 15 has an internal memory for storing various programs and control data, and executes various processes using these.

  As an embodiment, the control unit 15 is implemented as a central processing unit, a so-called CPU (Central Processing Unit). The control unit 15 is not necessarily implemented as a central processing unit, and may be implemented as an MPU (Micro Processing Unit) or a DSP (Digital Signal Processor). The control unit 15 can also be realized by a hard wired logic such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  The control unit 15 virtually implements the following processing unit by executing various programs. For example, as illustrated in FIG. 2, the control unit 15 includes a time setting unit 15 a, a condition acquisition unit 15 b, a marker setting unit 15 c, an area determination unit 15 d, and a display control unit 17.

  The time setting unit 15a is a processing unit that sets a scheduled time used for explaining each area of the slide included in the document file. Hereinafter, the scheduled time used for explaining the area on the slide may be referred to as “explanation time”.

  As one embodiment, the time setting unit 15a can automatically start the process of setting the above explanation time or can be started manually. For example, when starting automatically, when the presentation software closes with the document file stored in the storage unit 13, or when the document file is overwritten and stored in the storage unit 13 while editing the document file via the presentation software. , Can start the process. In addition, when starting with manual setting, the processing can be activated when an instruction to execute presentation pre-processing is received via the input device 7. In any case, the processing is started by reading out the document file corresponding to the save or execution instruction from the document files included in the document data 13a stored in the storage unit 13.

  The setting of the explanation time will be described. The time setting unit 15a is a document file that has been saved among the document files included in the document data 13a stored in the storage unit 13, or a document that has received an instruction to execute the pre-processing of the presentation. Read the file. Here, as an example, the case where the time setting unit 15a reads the document file from the storage unit 13 is illustrated, but the document file acquisition path is not limited to this. For example, the time setting unit 15a can acquire a document file from an auxiliary storage device such as a hard disk or an optical disk or a removable medium such as a memory card or a USB (Universal Serial Bus) memory. The time setting unit 15a can also obtain a document file by receiving it from an external device via a network.

  Subsequently, the time setting unit 15a divides the slide included in the previously read document file into a plurality of areas. For example, the time setting unit 15a divides the slide in units of one sentence, line, paragraph, or the like. In this case, the time setting unit 15a scans the character string included in the slide, detects a delimiter character corresponding to a space, a punctuation point, or a line feed, and sets the delimiter character as the boundary of the region. The time setting unit 15a divides the character string included in the slide before and after such a boundary. Thus, the slide is divided into a plurality of areas for each delimiter character. After that, the time setting unit 15a assigns an index for identifying the area to the area obtained by dividing the slide. Here, the case where the slide is automatically divided is illustrated, but the slide may be divided by manual setting by designating the boundary of the area via the input device 7 or the like.

  After dividing the slide, the time setting unit 15a selects one of the plurality of regions included in the slide. Subsequently, the time setting unit 15a counts the character strings included in the previously selected area, and sets the explanation time for the area according to the number of characters. For example, the time setting unit 15a can set a longer explanation time as the number of characters in the region increases. As an example, the time setting unit 15a can calculate the description time for each area by multiplying the required description time for each character, for example, the required description time set for each character by the number of characters in the area. Thereafter, the time setting unit 15a repeatedly executes the setting of the above explanation time until all the areas included in the slide are selected. Here, as an example, the case where the explanation time of the area is associated with the area is illustrated as an example. However, the elapsed time from the start of the presentation can be associated with the area as the start time of the explanation of the area. In this case, for each region, the cumulative value of the explanation time of the region up to the previous region is associated as the explanation start time.

  After the explanation time is set for all the areas in this way, the time setting unit 15a registers the explanation time data 13b in which the index of the area and the explanation time are associated with each other in the storage unit 13. Note that the above-described setting of the explanation time is executed over all slides included in the document file.

  The condition acquisition unit 15b is a processing unit that acquires conditions used to set the display size of the marker.

  As one embodiment, the condition acquisition unit 15b can start processing at any timing in a period from the time when generation of the explanation time data 13b is started by the time setting unit 15a until the start instruction of the presentation is received.

  The acquisition of such conditions will be described. The condition acquisition unit 15b is either a document file that has been saved by presentation software, a document file that has received an instruction to execute presentation preprocessing, or a document file that has received an instruction to start a presentation. The identification information of the venue where the presentation is held, such as a conference room or a hall, is acquired. By using such venue identification information as a search key, information such as the screen size, the distance between the presenter and the screen, and the distance between the listener and the screen can be automatically specified by searching or the like.

  For example, the venue identification information includes the equipment available at the venue, for example, the model number of the projector installed at the venue and the product number of the screen, and the seat arrangement at the venue, for example, from the screen where the projector displays the slide to the place where the presenter is located May be managed as venue information in a state associated with the distance between the screen and the distance from the screen to the auditorium.

  When the search for the product number of the screen of the display device 5 installed at the venue is successful from the venue information, the condition acquisition unit 15b obtains product information on the screen (not shown) such as the screen size and the applicable projector model number. By referring to the information associated with the product number of the screen, the size of the screen associated with the product number is retrieved. As a result, the size of the screen on which the display device 5 projects the slide is acquired.

  When the distance from the screen to the presenter's place, for example, a seat or a floor, can be searched, the condition acquisition unit 15b can use it as the distance between the presenter and the screen. Furthermore, when the distance from the screen to the auditorium can be searched, as an example, the distance from the screen to the nearest auditorium is used as the distance between the listener and the screen, or as another example, from the screen to each auditorium. Of these distances, a predetermined statistical value, for example, the mode value, the median value, or the average value can be used as the distance between the listener and the screen.

  After acquiring these pieces of information, the condition acquisition unit 15b acquires the size of the slide document included in the document file by referring to the properties of the document file. In this example, the screen size or slide document size is acquired for each document file. However, when the screen or slide document size is fixed, the process of acquiring the screen or slide document size is omitted. You can also

  In addition, here, as an example, the case of acquiring the screen size and the slide document size as a condition in addition to the distance relationship between the screen, the presenter, and the listener is illustrated, but other conditions besides these conditions are exemplified. You can get it. For example, the visual acuity information of at least one of the presenter and the audience can be acquired. At this time, when acquiring the visual acuity information of the audience, the average value of the visual acuity of all the audience can be acquired as the visual acuity information, or the visual acuity of the audience located in the front row is acquired as the visual acuity information from the screen. It is also possible to obtain the best visual acuity as visual acuity information among the visual acuity of the listener. In addition, here, a case where various conditions are automatically acquired by acquiring the venue identification information is illustrated, but the method for acquiring the conditions is not limited to this. For example, various conditions may be input through a GUI component that can input, select, or select various conditions, such as a text box, a pull-down menu, or a radio button.

  The marker setting unit 15c is a processing unit that sets the display size of the marker that activates the highlight display related to the area included in the slide displayed on the screen from the condition acquired by the condition acquisition unit 15b.

  As one embodiment, the marker setting unit 15c includes, among the marker display sizes defined in the marker setting data 13c, the condition acquisition unit when various conditions used for marker setting are acquired by the condition acquisition unit 15b. The display size corresponding to the size of the screen acquired by 15b, the size of the slide document, and the distance relationship between the screen, the presenter, and the listener is set as the display size of the marker used for highlight display of the slide.

  For example, the marker setting data 13c corresponds to the marker display size according to the screen size of the display device 5, the size of the slide document, the distance between the presenter and the screen, and the distance between the listener and the screen. The attached data can be adopted. Here, as an example, a case where the marker is rectangular and the length (mm) of one side is defined as the size is illustrated, but the figure employed as the marker may be any shape. For example, in the case of a circle, the diameter and radius may be defined, and in the case of other shapes, the width and height may be defined. In addition, the marker is not limited to a graphic, and a symbol or a character can be employed as the marker.

  Here, under the above-described conditions, one side of the marker that can be visually recognized by the presenter but is difficult for the listener to define can be defined as the display size of the marker from the relationship between the visual acuity of the participants in the presentation and the eye resolution. For example, the length T (mm) of one side of the marker can be defined according to the following formula (1).

  In the above formula (1), “S” refers to the size of the screen, “s” refers to the size of the slide document, “X” refers to the distance between the presenter and the screen, and “Y” refers to the distance between the listener and the screen. “V0” indicates the visual acuity of the presenter, and “V1” indicates the visual acuity of the listener. These are general normal visual acuities such as “1.5”, “1.0”, and “0.7”. "Can also be entered.

  According to such an equation (1), the length T (mm) of one side of the marker is set so as to satisfy the inequality condition. As a result, the marker setting data 13c shown in FIG. 3 can be defined as an example.

  FIG. 3 is a diagram illustrating an example of the marker setting data 13c. FIG. 3 shows the marker display size when the screen size is equivalent to 85 inches, ie, 1800 mm × 200 mm, and the slide document size is equivalent to A4 size, ie, 300 mm × 200 mm. FIG. 3 shows the presenter for each combination of the case where the distance between the presenter and the screen is 1 m, 1.5 m or 2 m and the case where the distance between the listener and the screen is 3 m, 5 m, 7 m or 10 m. The display size is shown so that the marker display on the screen can be visually recognized and it is difficult for the listener to visually recognize the marker display on the screen.

  For example, if the distance between the presenter and the screen is 1 m, for example, if the distance between the listener and the screen is 3 m, the marker display size is set to 0.07 mm, and the distance between the listener and the screen is set. If the distance is 5 m, the marker display size is set to 0.1 mm. If the distance between the listener and the screen is 7 m, the marker display size is set to 0.13 mm. If the distance between them is 10 m, it is defined that the display size of the marker is set to 0.18 mm.

  By using such marker setting data 13c for setting the display size of the marker, even when the screen size, the size of the slide document, the distance between the presenter and the screen, the distance between the listener and the screen, and the like change, In accordance with the change, the presenter can visually recognize the marker display on the screen, and the audience can set a display size that makes it difficult for the listener to visually recognize the marker display on the screen.

  FIG. 3 shows an example in which the screen size is equivalent to 85 inches and the slide document size is equivalent to A4 size. However, other screen sizes and other slide document sizes are also shown in FIG. Although the values are different, the display size is stored in a state where the computer can realize the above-described visibility as in the example of FIG.

  The region determination unit 15d is a processing unit that determines a region that is a candidate for highlight display.

  As one embodiment, the area determination unit 15 d activates the process when receiving a presentation start instruction via the input device 7. In this case, the area determination unit 15d reads out the explanation time data 13b related to the document file that has received the instruction to start the presentation from the explanation time data 13b stored in the storage unit 13. After that, the area determination unit 15d selects one area index according to the progress of the presentation among the areas included in the explanation time data 13b. For example, when the presentation is started, the first area of one page of the slide is selected. Thereafter, subsequent areas are sequentially selected as the presentation progresses. That is, after the first area of the first page of the slide, the second area, the third area,..., All the areas of the first page are selected, the first area of the second page. The area is repeatedly selected until the last area of the last page is selected.

  Thereafter, the area determination unit 15d measures the elapsed time from the time when the area is selected, and whether or not the elapsed time exceeds the explanation time associated with the previously selected index, that is, elapsed time> explanation. Judge the time. At this time, if elapsed time> explanation time, the region determination unit 15d selects the next region following the previously selected region from the regions included in the explanation time data 13b, and continues monitoring the elapsed time. To do. Until the last region is selected, the region determination unit 15d repeatedly executes selection of a region and start of elapsed time.

  The display control unit 17 is a processing unit that executes various display controls for the display device 5. As shown in FIG. 2, the display control unit 17 includes a slide display unit 17a, a marker display unit 17b, and a highlight display unit 17c.

  Among these, the slide display unit 17a is a processing unit that executes display control related to the slide.

  As one embodiment, when the document file is opened by the presentation software, the slide display unit 17a displays the slide included in the document file on the display device 5. At this time, the slide display unit 17a may display the slide of the first page among the slides included in the document file, or may display the slide of the page edited last. Thereafter, the slide display unit 17a receives a presentation start instruction, and then causes the display device 5 to display a slide related to the region selected by the region determination unit 15d. In addition, when the slide display unit 17 a receives a page switching instruction via the input device 7, the slide display unit 17 a changes the slide displayed on the display device 5. For example, when an operation for advancing a page is received, the slide display unit 17a causes the display device 5 to display a slide on the next page of the slide being displayed. When an operation for returning the page is received, the slide display unit 17a causes the display device 5 to display the slide of the previous page of the currently displayed slide.

  The marker display unit 17b is a processing unit that executes display control related to the marker.

  As one embodiment, the marker display unit 17b is selected as a highlight display candidate according to the display size set by the marker setting unit 15c each time a region to be highlighted is selected by the region determination unit 15d. Markers are displayed in association with areas. For example, the marker display unit 17b can display a marker at a position that is inscribed or circumscribed to the bullet or bullet of the area, in addition to the isolated point close to the area that is a candidate for highlight display and the edge of the screen. .

  FIG. 4 is a diagram illustrating an example of a slide screen. The slide screen 200 shown in FIG. 4 includes two areas. That is, in the first area, there are rectangular bullets “□” and “technical points” used for bullets, and bullets such as “1: ○○” and “2: Δ △”. included. The second area includes rectangular bullets “□” and “assumed service” used for bullets, and bullets such as “□□” and “☆☆”.

  For example, the markers 210A and 210B are markers associated with the first area. Among these, the marker 210A is displayed at an isolated point near the bullet 210 included in the first area. The marker 210B is displayed on the upper end of the slide screen 200. Both of these markers 210A and 210B can be displayed, or any one of them can be displayed alternatively. When a pointer identified by a mouse, a laser pointer, or a line-of-sight detection is brought close to any of these markers via the input device 7, the highlight display of the first area is executed. become.

  The markers 220A to 220E are markers associated with the second area. Among these, the marker 220A is displayed at a position circumscribing the bullet 220 included in the second area, while the marker 220B is displayed at a position inscribed in the bullet 220 included in the second area. Is done. The marker 220C is displayed at the left end of the slide screen 200, the marker 220D is displayed at the lower end of the slide screen 200, and the marker 220E is displayed at the right end of the slide screen 200. All of these markers 220A to 220E can be displayed, or any one or more of them can be displayed. When a pointer identified by a mouse, a laser pointer, or a line-of-sight detection is brought close to any one of these markers via the input device 7, highlight display of the second area is executed. become.

  As shown in FIG. 4, when displaying a marker at an isolated point, the presenter can easily recognize the marker. Further, when displaying a marker at the end of the slide screen, when displaying the marker at a position inscribed or circumscribed to the bullet, it is possible to make it difficult for the listener to visually recognize the marker.

  In addition, the marker display unit 17b can leave the marker once displayed on the slide without erasing it. However, when the predetermined condition is satisfied, the marker being displayed can be erased. For example, the marker display unit 17b can erase the marker when a predetermined period, for example, 30 seconds or 1 minute has elapsed since the marker was displayed. As another example, the marker display unit 17b can also delete the marker in the area where the highlight display is finished. As a further example, when the erasing operation is accepted via the input device 7, the marker display unit 17 b can also erase the marker that has accepted the erasing operation.

  The highlight display unit 17c is a processing unit that executes display control related to highlights.

  As one embodiment, the highlight display unit 17c repeatedly executes the following processing from receiving a presentation start instruction until receiving a presentation end instruction. That is, the highlight display unit 17c monitors pointers such as a mouse, a laser pointer, and a line-of-sight detection input via the input device 7. When the pointer moves, the highlight display unit 17c selects one marker that is being displayed. Then, the highlight display unit 17c determines whether or not the position of the pointer is within a predetermined range from the marker. At this time, when the position of the pointer is within a predetermined range from the marker, it is considered that the presenter intends to highlight the area corresponding to the marker. In this case, the highlight display unit 17c highlights an area corresponding to the marker. On the other hand, when the position of the pointer does not exist within a predetermined range from the marker, it is considered that the presenter does not intend to highlight the area corresponding to the marker. And the highlight display part 17c repeatedly performs the determination regarding the positional relationship of such a pointer and a marker until all the markers currently displayed are selected. Note that “highlight display” here means not only narrow highlight display, that is, display control in a broad sense, but also display control that brightens or reverses the background color. For example, highlighting in general can be arbitrarily executed, such as emphasizing area filling and emphasizing fonts (font size, underline and italic).

  FIG. 5 is a diagram illustrating an example of a slide screen. The slide screen 300 shown in FIG. 5 is the same as the slide screen 200 shown in FIG. 4, and shows a case where highlight display is executed in the first area. In the highlight display 310 shown in FIG. 5, the first area is brightly displayed by increasing the luminance of the background of the first area. As a result, the first area is emphasized, so that the audience's attention can be gathered in the first area. Note that the highlight display can be returned to the normal display after a predetermined time by a timer, or can be returned to the normal display when a cancel operation is received via the input device 7.

[Process flow]
Next, a processing flow of the presentation support apparatus 10 according to the present embodiment will be described. Here, description will be made in the order of (1) time setting processing, (2) marker setting processing, (3) marker display processing, and (4) highlight display processing executed by the presentation support apparatus 10.

(1) Time Setting Process FIG. 6 is a flowchart illustrating the procedure of the time setting process according to the first embodiment. This process can be started automatically or manually. For example, when starting automatically, when the presentation software closes with the document file stored in the storage unit 13, or when the document file is overwritten and stored in the storage unit 13 while editing the document file via the presentation, Processing can be started. In addition, when starting with manual setting, the processing can be activated when an instruction to execute presentation pre-processing is received via the input device 7. In any case, the processing is started by reading out the document file corresponding to the save or execution instruction from the document files included in the document data 13a stored in the storage unit 13.

  As shown in FIG. 6, the time setting unit 15a divides a slide included in a document file that has been stored or a document file that has received an instruction to execute pre-processing of a presentation into a plurality of regions (step S101). Then, the time setting unit 15a assigns an index for identifying the area to each area obtained by the division in step S101 (step S102).

  Subsequently, the time setting unit 15a selects one area from among a plurality of areas included in the slide (step S103). And the time setting part 15a counts the character string contained in the area | region selected by step S103, and sets the description time of the said area | region according to the number of characters (step S104).

  Thereafter, the time setting unit 15a repeatedly executes the processes of steps S103 and S104 described above until all the regions included in the slide are selected (No in step S105). When all the areas included in the slide are selected (step S105 Yes), the time setting unit 15a registers the explanation time data 13b in which the index of the area and the explanation time are associated with the storage unit 13 (step S106). The process ends.

  Of the processes shown in FIG. 6, the processes in steps S103 and S104 can be executed in parallel between a plurality of regions.

(2) Marker Setting Process FIG. 7 is a flowchart illustrating the procedure of the marker setting process according to the first embodiment. This process can be started at an arbitrary timing in a period from when the time setting process shown in FIG. 6 is started until when a presentation start instruction is received.

  As shown in FIG. 7, the condition acquisition unit 15b relates to any one of a document file that has been saved by presentation software, a document file that has received an instruction to execute presentation pre-processing, or a document file that has received a presentation start instruction. Identification information of the venue where the presentation is performed is acquired (step S201).

  Subsequently, the condition acquisition unit 15b acquires the size of the screen on which the display device 5 projects the slide, the distance between the presenter and the screen, the distance between the listener and the screen, and the like through a search using the identification information of the venue. (Step S202, Step S203 and Step S204).

  Further, the condition acquisition unit 15b acquires the size of the slide document included in the document file by referring to the property of the document file (step S205).

  In addition, the marker setting unit 15c, among the display sizes of the markers defined in the marker setting data 13c, the screen size acquired in steps S202 to S204 and the distance relationship between the screen, the presenter, and the listener. And the display size corresponding to the size of the slide document acquired in step S205 is set as the marker display size used for highlight display of the slide (step S206), and the process ends.

  In addition, the process of step S202-step S205 among the processes shown in FIG. 7 can be performed in random order, and can also be performed in parallel with each other.

(3) Marker Display Processing FIG. 8 is a flowchart illustrating a procedure of marker display processing according to the first embodiment. This process is started when a presentation start instruction is received via the input device 7.

  As shown in FIG. 8, when a presentation start instruction is accepted (step S301), the explanation time data 13b related to the document file that has accepted the presentation start instruction is read from the explanation time data 13b stored in the storage unit 13 (step S301). S302). After that, the region determination unit 15d selects one region index according to the progress of the presentation among the regions included in the explanation time data 13b (step S303).

  Subsequently, the marker display unit 17b displays the marker in association with the area selected in step S303 according to the display size set in the marker setting process shown in FIG. 7, that is, the area to be a highlight display candidate. (Step S304).

  Thereafter, the area determination unit 15d measures the elapsed time from the time when the area is selected in step S303, and whether or not the elapsed time exceeds the explanation time associated with the index selected in step S303, that is, Elapsed time> explanation time is determined (step S305).

  At this time, until the elapsed time> explanation time is satisfied (No in step S305), the area determination unit 15d continues to monitor the elapsed time. When the elapsed time> explanation time is satisfied (step S305 Yes), the area determination unit 15d Until the last area is selected (No in step S306), the next area following the previously selected area is selected from the areas included in the explanation time data 13b (step S303), and the processes in steps S304 and S305 are performed. Repeatedly. Thereafter, when the last region is selected (step S306 Yes), the process is terminated.

(4) Highlight Display Processing FIG. 9 is a flowchart illustrating the procedure of highlight display processing according to the first embodiment. This process is repeatedly executed from when the presentation start instruction is received until the presentation end instruction is received.

  As shown in FIG. 9, the highlight display unit 17c monitors a mouse, a laser pointer, a pointer such as a line-of-sight detection input via the input device 7 (step S401). When the pointer moves (step S401 Yes), the highlight display unit 17c selects one marker being displayed (step S402). When the pointer is stopped (No at step S401), monitoring of the pointer is continued.

  Then, the highlight display unit 17c determines whether or not the position of the pointer is within a predetermined range from the marker (step S403). At this time, if the position of the pointer is within a predetermined range from the marker (Yes in step S403), it is considered that the presenter intends to highlight the area corresponding to the marker. In this case, the highlight display unit 17c highlights an area corresponding to the marker (step S404).

  On the other hand, when the position of the pointer does not exist within a predetermined range from the marker (No in step S403), it is considered that the presenter does not intend to highlight the area corresponding to the marker. In this case, the highlight display is not executed and the process proceeds to step S405.

  Then, until all the displayed markers are selected (No in step S405), the highlight display unit 17c repeatedly executes the processes from step S402 to step S404. Thereafter, when all the displayed markers are selected (Yes in step S405), the process returns to step S401 to monitor the pointer.

[One aspect of effect]
As described above, the presentation support apparatus 10 according to the present embodiment sets the display size of the marker that activates the highlight display based on the distance relationship between the screen on which the slide is displayed as an example of the presentation screen, the presenter, and the audience. The marker is displayed in association with the area that is a candidate for highlight display. As a result, for example, the marker can be displayed in a size smaller than the highlight display, and the highlight display can be called in a state where the presenter can visually recognize the presentation participants but is difficult for the listener to view. Provides display control to display markers. As a result, when the presenter recognizes the marker, whether or not the highlight display is appropriate can be selected. Therefore, according to the presentation support apparatus 10 according to the present embodiment, it is possible to suppress a situation where highlights are displayed in a wrong place for the listener, for example, a place where the presenter is not explaining.

  In the first embodiment, the case where the area to be highlighted is made to progress as a candidate for highlight display has been exemplified. However, the area to be highlighted can be determined by another method. Therefore, in this embodiment, as an example, a case will be described in which a region to be a highlight display candidate is determined by voice recognition.

[Configuration of Presentation Support Device 20]
FIG. 10 is a diagram illustrating a functional configuration of the presentation support apparatus 20 according to the second embodiment. The presentation support apparatus 20 shown in FIG. 10 is different from the presentation support apparatus 10 shown in FIG. 2 in that some of the data stored in the storage unit 21, that is, the extracted word data 21a and the recognized word data 21b are different. Some of the processing units virtually realized by the unit 23, that is, the extraction unit 23a, the recognition unit 23b, and the region determination unit 23c are different. In this case, the explanation time data 13b and the time setting unit 15a can be omitted. 10, parts different from the data or function shown in FIG. 1 are denoted by different reference numerals, and parts having the same data or function are denoted by the same reference numerals and description thereof is omitted.

  The extraction unit 23a is a processing unit that extracts, as extracted word data 21a, words registered in dictionary data used for speech recognition from slides included in a document file.

  As an embodiment, the extraction unit 23a can automatically start the process of extracting the extracted word data 21a or can be started manually. For example, when starting automatically, when the presentation software saves the document file in the storage unit 21 and then closes, or when the document file is saved in the storage unit 21 while editing the document file via the presentation, Can be activated. In addition, when starting with manual setting, the processing can be activated when an instruction to execute presentation pre-processing is received via the input device 7. In any case, the processing is started by reading out the document file corresponding to the save or execution instruction among the document files included in the document data 13a stored in the storage unit 21.

  The generation of the extracted word data 21a will be described. The extraction unit 23a has received an instruction to execute a preprocessing of a document file that has been saved or a presentation among document files included in the document data 13a stored in the storage unit 21. Read a document file. Here, as an example, the case where the extraction unit 23a reads a document file from the storage unit 21 is illustrated, but the acquisition path of the document file is not limited to this. For example, the extraction unit 23a can also acquire a document file from an auxiliary storage device such as a hard disk or an optical disk or a removable medium such as a memory card or a USB memory. The extraction unit 23a can also acquire a document file by receiving it from an external device via a network.

  Subsequently, the extraction unit 23a divides the slide included in the previously read document file into a plurality of areas. For example, the extraction unit 23a divides the slide in units of one sentence, line, paragraph, and the like. In this case, the extraction unit 23a scans the character string included in the slide, detects a delimiter character corresponding to a space, a punctuation point, or a line feed, and sets the delimiter character as the boundary of the region. The extraction unit 23a divides a character string included in the slide before and after such a boundary. Thus, the slide is divided into a plurality of areas for each delimiter character. In addition, the extraction unit 23a assigns an index for identifying the area to the area obtained by dividing the slide. Here, the case where the slide is automatically divided is illustrated, but the slide may be divided by manual setting by designating the boundary of the area via the input device 7 or the like.

  After dividing the slide, the extraction unit 23a selects one of the plurality of regions included in the slide. Subsequently, the extraction unit 23a extracts words and their readings by executing natural language processing on the character string included in the previously selected region. For example, the extraction unit 23a extracts a word whose word of speech is a noun and a reading of the word from morphemes obtained by executing morphological analysis or the like on a character string in the region. Thereafter, the extraction unit 23a repeatedly executes the above-described extraction of words and word readings until all the regions included in the slide are selected. In addition, the extraction unit 23 a registers the extracted word data 21 a in which the word, the reading of the word, and the index of the region including the word are associated with the storage unit 21.

  The recognition unit 23b is a processing unit that performs voice recognition.

  As an embodiment, the recognition unit 23b is activated when the presentation software receives a presentation start instruction with the document file opened, and waits until an audio signal having a predetermined length of time is input from the microphone 3. For example, it waits for an audio signal having a time length of at least one frame, for example, 10 msec. The recognizing unit 23b performs voice recognition such as word spotting on the voice signal every time a voice signal having a predetermined time length is input from the microphone 3. At this time, the recognizing unit 23b is the extracted word data relating to the slide that is included in the document file that is being executed by the presentation software among the extracted word data 21a stored in the storage unit 21 and that is being displayed on the display device 5. Apply to word spotting. Thereby, the recognition unit 23b recognizes whether or not a word extracted from each region included in the slide being displayed exists in the utterance of the presenter. Then, when the reading of the word is recognized from the voice signal, the recognition unit 23b registers the recognition word data 21b in which the word and the time when the word is recognized are associated with each other in the storage unit 21. When the same word is recognized multiple times as time passes, the last, that is, the latest recognized time is registered in the storage unit 21.

  Thereafter, the recognizing unit 23b determines whether or not there is a word for which a predetermined period has elapsed since registration in the storage unit 21 in the recognized word data 21b stored in the storage unit 21. For example, for each word included in the recognition word data 21b, the recognition unit 23b has a difference between the time registered in association with the word and the time when the recognition unit 23b refers to the recognition word data 21b, that is, the current time. It is determined whether or not a predetermined threshold is exceeded. At this time, the recognizing unit 23b can change the threshold value used for the above determination according to a unit in which the slide is divided, for example, one sentence, line, paragraph or the like. For example, when the slide is divided in units of lines, it can be assumed that the number of characters read out in one area is approximately 20 to 30 characters. In this case, 3 seconds can be used as an example of the above threshold. Further, when the slide is divided in units of paragraphs, it can be assumed that a time longer than the line unit is devoted to reading. In this case, 20 to 30 seconds can be used as an example of the threshold value.

  Here, when there is a word for which a predetermined period of time, for example, 3 seconds has elapsed since registration in the storage unit 21, there is a high possibility that the explanation regarding the slide region including the word has ended. If such a word is left, the possibility that the area where the explanation has ended will be highlighted. Therefore, the recognition unit 23b deletes the record related to the word from the recognized word data 21b stored in the storage unit 21. On the other hand, when there is no word for which a predetermined period has elapsed since registration in the storage unit 21, there is a high possibility that the explanation regarding the slide area where the word included in the recognized word data 21b appears has not ended. In this case, there is a low possibility that the area for which the explanation has been completed is displayed with highlight. Therefore, the recognition unit 23b leaves the word included in the recognized word data 21b stored in the storage unit 21 without deleting it.

  The recognizing unit 23b determines whether the slide page displayed on the display device 5 has been changed. For example, the recognizing unit 23b determines whether a slide is switched by a slide show, or an operation for advancing a slide page or an operation for returning a slide page is received via the input device 7. At this time, when the slide page displayed on the display device 5 is changed, it is highly possible that the description of the presenter is switched from the slide of the page before the change to the slide of the page after the change. In this case, the recognition unit 23b deletes the recognized word data 21b stored in the storage unit 21. On the other hand, when the slide page displayed on the display device 5 is not changed, there is a high possibility that the page explained by the presenter will not change. In this case, the recognition unit 23b leaves the word included in the recognized word data 21b stored in the storage unit 21 without deleting it.

  Through the series of operations, the recognition unit 23b recognizes a word that is highly likely to be explained by the presenter in the displayed slide. Hereinafter, a word included in the extracted word data 21a is referred to as an “extracted word”, and a word included in the recognized word data 21b is referred to as a “recognized word” to distinguish the labels from each other. is there.

  The region determination unit 23c calculates a score between the region in the slide being displayed and the word obtained as a speech recognition result, and determines the region having the highest score as a highlight execution target.

  As an embodiment, the region determination unit 23c calculates a score for each region according to the following equation (2) as an example.

  “W” in the above equation (2) is a vectorization of the frequency of recognition words recognized within a certain period of t seconds, for example, 3 seconds from the time when the score is calculated, and “D” This is a vectorization of the appearance frequency of extracted words included in the area to be calculated. The score obtained from equation (2) is normalized to a value of 0 ≦ score ≦ 1. For example, seven words “current, technology, points, assumptions, services, today, assignments” are registered in the speech recognition dictionary, and the word “technology, points” is recognized by speech recognition within 3 seconds, and the score When the word “current time, technology, point” is extracted from the calculation target area, W and D are 7-dimensional vectors, that is, W = [0, 1, 1, 0, 0, 0, 0], D = [1 , 1, 1, 0, 0, 0, 0], the above-described equation (2) yields the score of the region as “0.82” as shown in equation (3) below. .

  As described above, after the score is calculated for each region using the equation (2), the region determination unit 23c determines the region having the highest score as a highlight display candidate. In addition, although the case where the region having the highest score is determined as the region that is a candidate for highlight display is illustrated here, it is limited to the case where the highest score value is a predetermined threshold, for example, 0.75 or more. An area having the highest score value may be determined as an area to be highlighted.

  After the region to be a candidate for highlight display is determined in this way, marker display processing and highlight display processing are executed through the same processing as in the first embodiment.

[Process flow]
Next, a processing flow of the presentation support apparatus 20 according to the present embodiment will be described. Here, description will be made in the order of (1) extracted word data generation processing, (2) speech recognition processing, and (3) marker display processing executed by the presentation support apparatus 20.

(1) Extracted Word Data Generation Processing FIG. 11 is a flowchart illustrating a procedure of extracted word data generation processing according to the second embodiment. This process can be started automatically or manually. For example, when starting automatically, when the presentation software saves the document file in the storage unit 21 and then closes, or when the document file is saved in the storage unit 21 while editing the document file via the presentation, Can be activated. In addition, when starting with manual setting, the processing can be activated when an instruction to execute presentation pre-processing is received via the input device 7. In any case, the processing is started by reading out the document file corresponding to the save or execution instruction among the document files included in the document data 13a stored in the storage unit 21.

  As shown in FIG. 11, the extraction unit 23a divides a slide included in a document file into a plurality of regions in units of a sentence, a line, a paragraph, or the like (step S501). Subsequently, the extraction unit 23a assigns an index for identifying each region to the region obtained in step S501 (step S502).

  Then, the extraction unit 23a selects one index among the indexes assigned in step S502 (step S503). Subsequently, the extracting unit 23a extracts a word whose part of speech is a noun from the morpheme obtained by executing morpheme analysis or the like on the character string in the index region selected in step S503 and its reading (step). S504).

  Then, the extraction unit 23a repeatedly executes the processes from step S503 to step S504 until all the indexes assigned in step S502 are selected (No in step S505).

  After that, when all the indexes assigned in step S502 are selected (step S505 Yes), the extraction unit 23a stores the extracted word data 21a in which the word, the reading of the word, and the index of the region including the word are associated with each other. 21 is registered (step S506), and the process is terminated.

(2) Voice Recognition Processing FIG. 12 is a flowchart illustrating the procedure of voice recognition processing according to the second embodiment. This processing is started when the presentation software receives a presentation start instruction with the document file opened, and is repeatedly executed until a presentation end instruction is received.

  As shown in FIG. 12, the recognition unit 23b waits until an audio signal having a predetermined time length is input from the microphone 3, for example, until an audio signal having a time length of at least one frame, for example, 10 msec is input (step S601).

  When an audio signal having a predetermined time length is input from the microphone 3 (step S601 Yes), the recognition unit 23b performs voice recognition such as word spotting on the audio signal (step S602). When word spotting is executed in step S602, the slide is included in the document file in which the presentation software is being executed among the extracted word data 21a stored in the storage unit 21 and is being displayed on the display device 5. Extracted word data relating to a certain slide is applied as dictionary data.

  At this time, when a word is recognized from the voice signal (Yes in step S603), the recognition unit 23b stores the recognized word data 21b in which the word recognized in step S602 and the time when the word is recognized are associated with each other. (Step S604), and the process proceeds to Step S605.

  On the other hand, when a voice signal having a predetermined time length is not input from the microphone 3 or when a word is not recognized from the voice signal (No in Step S601 or Step S603), the subsequent process is skipped and the process proceeds to Step S605. .

  Here, the recognizing unit 23b determines whether or not there is a word for which a predetermined period has elapsed since registration in the storage unit 21 among the recognized word data 21b stored in the storage unit 21 (step S605). Then, when there is a word for which a predetermined period has elapsed since registration in the storage unit 21 (step S605 Yes), the recognition unit 23b deletes the record related to the word from the recognized word data 21b stored in the storage unit 21. (Step S606). If there is no word for which a predetermined period has elapsed since registration in the storage unit 21 (No in step S605), the process of step S606 is skipped and the process proceeds to step S607.

  Thereafter, the recognizing unit 23b determines whether or not the slide page displayed on the display device 5 has been changed (step S607). At this time, when the slide page displayed on the display device 5 is changed (Yes in step S607), the recognizing unit 23b deletes the recognized word data 21b stored in the storage unit 21 (step S608), and in step S601. Return to processing. If the slide page displayed on the display device 5 has not been changed (No at step S607), the process returns to the process of step S601 without executing the process of step S608.

(3) Marker Display Processing FIG. 13 is a flowchart illustrating a procedure of marker display processing according to the second embodiment. This processing is started when the presentation software receives a presentation start instruction with the document file opened, and is repeatedly executed until a presentation end instruction is received. The cycle in which the execution of the process is repeated may be the same as or different from the voice recognition process shown in FIG. 12, and is executed in synchronization with the voice recognition process shown in FIG. It can also be executed asynchronously.

  As illustrated in FIG. 13, the region determining unit 23 c selects one region from among the regions included in the slide being displayed (step S <b> 701). Subsequently, the region determination unit 23c calculates the score for each region selected in step S701 according to the above equation (2) (step S702).

  Then, until the indexes of all the areas included in the displayed slide are selected (No at Step S703), the area determining unit 23c repeatedly executes the processes at Steps S701 and S702 described above.

  Thereafter, when the indexes of all the regions included in the displayed slide are selected (Yes in step S703), the region determining unit 23c highlights the region having the highest score among the scores calculated for each region. Is determined as a candidate area (step S704).

  Then, the marker display unit 17b displays the marker in association with the area determined in step S704 according to the display size set in the marker setting process shown in FIG. Step S705) and the process is terminated.

[One aspect of effect]
As described above, also in the presentation support apparatus 20 according to the present embodiment, as in the first embodiment, it is possible to suppress a situation where highlights are displayed in a wrong place for the listener, for example, a place where the presenter is not explaining. it can.

  Furthermore, in the presentation support apparatus 20 according to the present embodiment, the region to be a highlight display candidate is determined through voice recognition, so that the situation where the marker is displayed at an incorrect location can also be suppressed.

  Although the embodiments related to the disclosed apparatus have been described above, the present invention may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

[Highlights other than text]
In the first embodiment and the second embodiment described above, the case where the area including the character string in the slide is highlighted is illustrated, but the slide includes a graph, a table, an image, a moving image, and the like in addition to the character string. It does not matter. In this case, for example, the presentation support device 10 generates extracted word data in the same manner as in the first embodiment by extracting words from character strings included in meta information set in graphs, tables, images, and moving images. be able to.

[Application example of operation]
In the first embodiment and the second embodiment described above, the case where the area corresponding to the marker is highlighted by receiving an operation in which the pointer approaches the marker via the input device 7 is illustrated, but other operations are received. You can also. For example, when one marker is alternatively displayed on the slide as in the second embodiment, an operation for specifying the correct or incorrect answer of the marker can be accepted, and the process can be executed according to the result. . As an example, when a correct answer (OK) is designated as an answer to a marker being displayed, an area corresponding to the marker is highlighted. On the other hand, when an incorrect answer (NG) is designated, a new marker is displayed in association with the area having the highest score next to the area corresponding to the marker.

[Application examples of document files]
In the first embodiment, the case where the document file created by the presentation software is used has been exemplified. However, the document file created by another application program can be used. That is, if the document file includes a page that is displayed in units of screens at the time of display, the page of the word processing software document file is replaced with a slide, or the sheet of the spreadsheet software document file is replaced with a slide. The process shown in FIG. 9 can be similarly applied.

[Other implementation examples]
In the first embodiment, the case where the presentation support apparatus 10 provides the presentation support service in a stand-alone manner in which the presentation software 10 is independently executed without depending on an external resource is exemplified. Can also be adopted. For example, a client server system can be constructed by providing a server that provides the presentation support service to a client that executes presentation software.

  In this case, the server device can be implemented by installing a presentation support program for realizing the above presentation support service as package software or online software. For example, the server device may be implemented as a Web server that provides the presentation support service, or may be implemented as a cloud that provides the presentation support service by outsourcing.

  At this time, the client uploads the document file used for the presentation and the identification information of the venue where the presentation is performed to the server device, and then the presentation is started. When the presentation is started, the client uploads the audio signal collected from the microphone 3 in real time, and uploads the slide page information every time the slide page being displayed on the display device 5 is switched. As a result, the server apparatus can execute the processes shown in FIGS. 6 to 9 and FIGS. 11 to 13.

  Furthermore, the client can also be constructed as a thin client system by transmitting operation information related to the input device 7 to the server and causing the display device 5 to display only the processing result transmitted from the server. In this case, various resources such as document data are also held by the server, and the presentation software is also implemented as a virtual machine on the server.

  In the first and second embodiments, it is assumed that the presentation support program is added to the presentation software. However, when a request for referring to the presentation support program as a library is received from a client having a license authority, You can also plug in a presentation support program.

[Presentation support program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. In the following, an example of a computer that executes a presentation support program having the same function as that of the above embodiment will be described with reference to FIG.

  FIG. 14 is a diagram illustrating a hardware configuration example of a computer that executes the presentation support program according to the first embodiment and the second embodiment. As illustrated in FIG. 14, the computer 100 includes an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Further, the computer 100 includes a CPU 150, a ROM 160, an HDD 170, and a RAM 180. These units 110 to 180 are connected via a bus 140.

  As shown in FIG. 14, the HDD 170 stores a presentation support program 170a that exhibits the same functions as those of the processing units shown in the first and second embodiments. The presentation support program 170a may be integrated or separated as with each component of the processing unit shown in FIG. That is, the HDD 170 does not necessarily have to store all the data shown in the first embodiment, and data used for processing may be stored in the HDD 170.

  Under such an environment, the CPU 150 reads the presentation support program 170 a from the HDD 170 and expands it on the RAM 180. As a result, the presentation support program 170a functions as a presentation support process 180a as shown in FIG. The presentation support process 180a expands various data read from the HDD 170 in an area allocated to the presentation support process 180a in the storage area of the RAM 180, and executes various processes using the expanded data. For example, the processes shown in FIGS. 6 to 9 and FIGS. 11 to 13 are included as an example of the processes executed by the presentation support process 180a. Note that the CPU 150 does not necessarily operate all the processing units described in the first embodiment, and the processing unit corresponding to the process to be executed may be virtually realized.

  Note that the presentation support program 170a is not necessarily stored in the HDD 170 or the ROM 160 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk inserted into the computer 100, so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 100 may acquire and execute each program from these portable physical media. In addition, each program is stored in another computer or server device connected to the computer 100 via a public line, the Internet, a LAN, a WAN, etc., and the computer 100 acquires and executes each program from these. It may be.

DESCRIPTION OF SYMBOLS 1 Presentation support system 3 Microphone 5 Display apparatus 7 Input device 10 Presentation support apparatus 11 Input / output I / F part 13 Memory | storage part 13a Document data 13b Explanation time data 13c Marker setting data 15 Control part 15a Time setting part 15b Condition acquisition part 15c Marker setting unit 15d Area determination unit 17 Display control unit 17a Slide display unit 17b Marker display unit 17c Highlight display unit

Claims (7)

An acquisition unit for acquiring a distance relationship between a screen on which a display device displays a document file, a presenter, and an audience;
A setting unit for setting a display size of a marker that activates a highlight display related to an area included in a page of a document file displayed on the screen from the distance relationship;
A determination unit for determining a region to be a candidate for highlight display among regions included in a page displayed on the display device;
And a marker display unit that displays the marker in association with an area that is a candidate for highlight display according to the display size. A recognition unit that performs speech recognition;
A calculation unit for calculating a degree of association from the first word extracted from the region and the second word obtained as a result of the voice recognition for each region in the page being displayed on the display device; And
The said determination part determines the area | region where the said degree of association is the highest among the area | regions in the page currently displayed on the said display apparatus as an area | region made into the execution object of the said highlight. Presentation support device.   The presentation support apparatus according to claim 1, further comprising: a highlight display unit configured to perform highlight display regarding a region corresponding to the marker when an operation on the marker is received.   The presentation support apparatus according to claim 1, further comprising: a highlight display unit configured to perform highlight display regarding an area corresponding to the marker when a correct answer is selected as an answer corresponding to the marker.   The marker display unit displays the marker at an isolated point close to an area that is a candidate for highlight display, an edge of the screen of the page, or a position inscribed or circumscribed to a bullet or bullet of the area. The presentation support apparatus according to claim 1. Computer
Processing for obtaining a distance relationship between a screen on which a display device displays a document file, a presenter, and a listener;
A process of setting a display size of a marker that activates highlight display regarding an area included in a page of a document file displayed on the screen from the distance relationship;
A process of determining a region to be a candidate for highlight display among regions included in a page displayed on the display device;
And a process of displaying the marker in association with an area to be a candidate for highlight display according to the display size. On the computer,
Processing for obtaining a distance relationship between a screen on which a display device displays a document file, a presenter, and a listener;
A process of setting a display size of a marker that activates highlight display regarding an area included in a page of a document file displayed on the screen from the distance relationship;
A process of determining a region to be a candidate for highlight display among regions included in a page displayed on the display device;
And a process for displaying the marker in association with an area to be a candidate for highlight display according to the display size.

Images