JP6534893B2 - Information processing device - Google Patents

Description

  The present technology relates to an information processing apparatus. More specifically, the present invention relates to an information processing apparatus suitable for helping a student who has taken a predetermined course understand and learn the contents of the course.

  In the fields where culture coaching and on-the-job training (OJT) are the main methods of education, such as cultural tradition, industry, sports, early childhood education, elderly care, etc., videos from the field are used for off-site education. There are many things.

  In Non-Patent Document 1, the importance of immediacy that can be viewed immediately after the competition and the application of detailed meta information (technique information, time information, etc.) to the video regarding the use of the competition video in sports instruction There is a statement about effectiveness.

  Non-Patent Document 2 describes a content conversion technology and service that can be realized by linking a broadcast program and a mobile terminal such as a smartphone or tablet, and a main screen (for example, a television receiver) and a secondary screen (for example, It is assumed to make full use of mobile terminals).

Miura Tomokazu, "Video System Utilization in Top Sports" Information Processing, Vol. 55, No. 11, pp. 1221-1227 (2014). Furukawa, Y., "On the Trend of the Next Generation Smart Television" Journal of the Institute of Image Information and Television Engineers, Vol. 68, No. 9, pp. 682-685 (2014).

  The above-mentioned video records the situation of the scene and the movement of the characters, but does not record what the characters pay attention to and how they evaluated the situation and intended to act. In addition, a leader (skilled person) matches the learner's skills while watching the video together and supplements the information with an appropriate commentary to obtain a high learning effect, but because the teaching opportunities are limited Have not been able to effectively

  Therefore, it is desirable to develop a technology for contentizing (representing by software) the guidance itself of the instructor. Thus, it is desirable that video and instructor content can be distributed over the Internet, and that learning (teaching) adapted to the skill level of the learner and the free time can be realized.

  The present technology has been made in view of such a situation, and enables the teaching itself of the instructor to be converted into content so that learning can be performed according to the learner's skill level and idle time. It is.

  An information processing apparatus according to one aspect of the present technology includes an image display unit on which an image is displayed, and a template display unit on which a template is displayed, and the template display unit evaluates a situation display unit that displays a situation. A screen including an evaluation display unit to be displayed is displayed.

  The template display unit may further include a work process display unit for displaying a work process.

  The image displayed on the image display unit may be an image obtained by photographing a state in which a predetermined person is performing a predetermined operation.

  The situation display unit may display a result of the instructor determining whether the work situation displayed on the image display unit is an appropriate situation.

  The predetermined work may be care for the elderly, and the situation display unit may display the time spent looking at the care recipient, the time spent talking, and the time spent touching.

  The evaluation display unit may list evaluation items, and may display evaluation items corresponding to the work status displayed on the image display unit so as to be distinguished from evaluation items not corresponding thereto.

  The evaluation display unit can display the corresponding evaluation item in such a manner as to be distinguished from the evaluation item which does not correspond, by blinking, changing the character color, or changing the background color.

  The display may be controlled based on image data of an image displayed on the image display unit, a template displayed on the template display unit, data supplied to the template, and a script. .

  The data and the script may be created by the instructor and made updatable.

  Information to be associated with the student is displayed from the predetermined information in the image displayed on the image display unit, and a predetermined mark is displayed on the predetermined information so that the student pays attention can do.

  The image displayed on the image display unit can be enlarged, reduced, or rotated as necessary.

  The image may be enlarged, reduced, or rotated so that the image displayed on the image display unit is not hidden by the template displayed on the template display unit.

  It is possible to further include a comment display unit that displays a comment from the leader.

  The comment display unit can be superimposed and displayed on the image display unit when there is a comment from the instructor.

  A predetermined area in the screen can be allocated to the comment display unit.

  A predetermined mark is displayed so that the student pays attention to predetermined information in the image displayed on the image display unit, and a confirmation order is displayed in the vicinity of the mark. Can.

  It is possible to display a predetermined mark on the predetermined information in the image displayed on the image display unit so that the student pays attention, and display an arrow indicating a direction in which the mark is traced.

  A question to the student may be displayed, a choice of an answer to the question may be displayed, and processing according to the choice selected by the student may be performed.

  An interface may be provided to listen to the students, and the interface may be displayed as an option having the shape of a balloon.

  In the information processing apparatus according to one aspect of the present technology, a screen configured by an image display unit on which an image is displayed and a template display unit on which a template is displayed is displayed. In addition, the template display unit is configured of a situation display unit that displays a situation and an evaluation display unit that displays an evaluation.

  According to one aspect of the present technology, the guidance itself of the instructor can be converted into content, and learning can be performed in accordance with the learner's skill level and free time.

  In addition, the effect described here is not necessarily limited, and may be any effect described in the present disclosure.

BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a diagram for describing a system of an embodiment to which the present technology is applied. It is a figure for demonstrating the structure of a content reproduction apparatus. It is a flowchart for demonstrating the process in a system. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display. It is a figure for demonstrating the data structure of a template. It is a figure for demonstrating the data structure of data. It is a figure for demonstrating the data structure of a script. It is a figure for demonstrating the preparation timing of data. It is a flowchart for demonstrating the process when a screen is displayed. It is a figure which shows an example of the screen displayed on a display. It is a figure for demonstrating the data definition by a formula. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display. It is a figure which shows an example of the screen displayed on a display.

Hereinafter, modes for carrying out the present technology (hereinafter, referred to as embodiments) will be described. The description will be made in the following order.
1. System configuration 2. Configuration of content reproduction apparatus About processing in the system Screen example 1
5. Screen example 2
6. About templates, data and scripts Processing related to content reproduction 8. Presentation of related information 9. Data definition by formulas 10. Another example of display

<System configuration>
FIG. 1 is a diagram showing the configuration of an embodiment of a system to which the present technology is applied. The present technology can be applied to a system that helps a student who has taken a given course and who has taken the course perform further learning. The system shown in FIG. 1 exemplifies a system related to a course on care.

  The system shown in FIG. 1 is a system in which a student taking a course takes a picture of the situation when he / she is actually caring, and the instructor adds an instruction to the photographed image. In FIG. 1, dotted arrows represent reception of predetermined data, and solid arrows represent transmission of predetermined data.

  As shown in the upper left in FIG. 1, first, the student 1 cares for the person 2 to be cared, and the photographer 3 takes a picture with the photographing device 11. The photographing device 11 can be a digital video camera, a smartphone or the like. Also included are personal computers and the like that can edit captured images. The photographed video data 61 is transmitted to the server 51. The server 51 includes a database 52, and the video data 61 is accumulated in the database 52.

  In the database 52, in addition to the video data 61, a template 62, data 63, a script 64, and a log 65 are associated and accumulated. Although the database 52 (server 51) will be described by way of an example where it is configured by one computer here, it may be distributed to a plurality of databases 52. For example, each data type may be distributed and managed by another database 52 (server 51).

  Further, the database 52 is not limited to a general database management system (DBMS). For example, the video data 61 may be stored as it is in a storage such as a hard disk.

  The template 62 is created by the template creator 4 as shown in the upper right of FIG. The template creator 4 uses the template creation device 21 to create a template, sends it to the database 52 of the server 51, and stores it.

  The data 63 and the script 64 are created by the instructor 5 as shown in the lower right of FIG. The instructor 5 generates the data 63 and the script 64 by inputting, for example, a comment or the like using the template 62 as needed while viewing the video data 61 accumulated in the database 52. The generated data 63 and script 64 are accumulated in the database 52.

  A record of the learner viewing a video (content) based on the video data 61 is stored in the database 52 as a log 65.

  After the video data 61, the template 62, the data 63, and the script 64 are stored in the database 52, the student 1 can perform learning. As shown in the lower left of FIG. 1, the student 1 reproduces the content and performs learning with the content reproduction device 41. Although details will be described later, the content viewed by the student 1 on the content reproduction device 41 is appropriately displayed such as good or bad with respect to the video in which the situation in which the student 1 practices nursing is photographed Content, and comments are displayed.

  In order to reproduce the content to be watched by the student 1, the template 62 of the screen to be synthesized on the video by the video data 61 stored in the database 52, the data 63 displayed in the template 62, and the student 1 The script 64 in which the question and advice contents are described is required. These data are stored in the database 52 as described above.

  Here, the student 1 who practices nursing care and continues to be described as being a student who is watching and learning content (it is the same person) continues the explanation, but, for example, it is It may be a large number of people working in a nursing home including one.

  The present system is a system in which a comment or the like is added to what the student 1 practices and by further watching the comment or the like, further learning is performed.

<Configuration of Content Reproduction Device>
FIG. 2 is a diagram showing the configuration of the content reproduction apparatus 41. As shown in FIG. In the content reproduction apparatus 41, a central processing unit (CPU) 101, a read only memory (ROM) 102, and a random access memory (RAM) 103 are mutually connected by a bus 104. Further, an input / output interface 105 is connected to the bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.

  The input unit 106 includes a keyboard, a mouse, a microphone and the like. The output unit 107 includes a display, a speaker, and the like. The storage unit 108 includes a hard disk, a non-volatile memory, and the like. The communication unit 109 includes a network interface and the like. The drive 110 drives removable media 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the terminal 103 configured as described above, for example, the CPU 101 stores the program stored in the storage unit 108 or the program supplied from the server via the communication unit 109 via the input / output interface 105 and the bus 104. Are loaded into the RAM 103 and executed.

  The template creation device 21 and the data input device 31 can also be configured the same as the content reproduction device 41, and the description thereof is omitted here.

<About processing in the system>
The process in the system shown in FIG. 1 will be described with reference to FIG.

  In step S11, the template creator 4 creates a template 62. The template 62 is a template for a predetermined course, for example, a course relating to care in the above-described example, and is a template suitable for the course for each course. The created template 62 is stored in the database 52 (FIG. 1). It is assumed that the template 62 is not frequently changed after creation.

  In step S12, the photographer 3 captures a process corresponding to a predetermined course, for example, in the above-described example, a process corresponding to a course called care, that is, a situation in which care is practiced. The video data 61 of the photographed video is edited as necessary, transmitted to the database 52, and stored.

  Although the video data 61 may be transmitted to the database 52 via a network, for example, it may be recorded on a recording medium such as a DVD (Digital Versatile Disc) and transmitted to the administrator of the database 52. You may

  In step S13, instruction is given. The leader 5 creates the data 63 and the script 64 by inputting an indication of a wrong action, addition of a comment, and the like based on the template 62 while watching the video that the student 1 is practicing. The created data 63 and script 64 are sent to the database 52 and stored. The data 63 and the script 64 are created for each video and are considered as updatable data. For example, a plurality of leaders 5 can add a comment or the like at a predetermined timing, and the data 63 and the script 64 are updated each time.

  In step S14, learning is performed. The student 1 learns by the instructor 5 while referring to a comment or the like for what the self is practicing. The student 1 can receive an indication from the leader 5 on what the self has practiced. When the student 1 views the content, a log 65 is generated as a viewing record and accumulated in the database 52.

Screen Example 1
FIG. 4 is a view showing an example of a screen displayed on the display as the output unit 107 (FIG. 2) of the content reproduction apparatus 41 in step S14. The screen example shown in FIG. 4 is a screen when the student 1 is taking a care course (care technology course for the elderly).

  The screen displayed on the display 201 is roughly divided into a video display unit 211 on which a video is displayed and a template display unit 212 on which the template 62 is displayed. The image display unit 211 displays an image when the state in which the student 1 is taking care of is photographed at step S12 (FIG. 3).

  Here, although it is described that a video (moving image) is displayed on the video display unit 211, the present technology can be applied to a case where a still image, text, or the like is displayed.

  The template display unit 212 displays information based on the template 62, such as instruction content for the video (condition) displayed on the video display unit 211. The template display unit 212 mainly includes three display units. At the upper part of the template display unit 212, a work process display unit 221 in which a work process is displayed is provided.

  In the work process display section 221 shown in FIG. 4, “S1 preparation for encounter”, “S2 preparation for care”, “S3 perceptual connection”, “S4 emotion fixation”, and “S5 reunion promise” in this order. , The work process is displayed to proceed. In the example shown in FIG. 4, it is a work process of "connection of S3 perception", and the state of the care which the participant 1 was performing at the time of "connection of S3 perception" is displayed on the image display part 211.

  On the left side of the template display unit 212, there is provided a situation display unit 222 in which points to be checked by the student are displayed. In this case, in the situation display unit 222, whether the care provider (the student 1) can catch the line of sight of the target person (the care target person 2), can speak out, or is properly touched It is considered as the display part which can confirm a state, respectively.

  For example, in this case, in the situation display unit 222, the time when the eyes of the subject 2 who are regarded as important when performing nursing care are matched, the time for talking and the time for touching are displayed for each work process. In nursing care, check the situation display section 222 to see if the time when the eyes are aligned, the time when talking starts, and the time when touching are important, and those times are spent for the necessary time. Can.

  On the right side of the template display unit 212, an evaluation display unit 223 is provided. The evaluation display unit 223 blinks the corresponding item when there is a point to be careful in the behavior of the student 1, etc., and notifies the student 1 what kind of point should be noted. It is a display part.

  As described above, the evaluation display unit 223 lists and displays evaluation items to be noted by the care giver (the student 1). The background color is changed, and the display unit is displayed to make the student 1 notice. In addition, when the display of the evaluation display unit 223 is changed, the reproduction of the video displayed on the video display unit 211 may be interrupted temporarily, and a display may be made to make the student 1 more easily noticed.

  The situation display unit 222 and the evaluation display unit 223 may have a display format for each work process (a different display may be performed for each work process), or may be the same display format for all processes.

  The student 1 is displayed on the template display unit 212 whether or not there is a problem with the care in the displayed condition while confirming the state of the care practiced by the self on the image display unit 211. You can check while looking at the items. Learning can be performed by performing such confirmation.

  Further, as described later, it is possible to display a comment from the leader 5. The comment from the leader 5 is appropriately displayed, and learning can be performed by confirming the comment. .

Screen Example 2
FIG. 5 is a view showing another screen example. The screen example shown in FIG. 5 is a screen in a course of mathematics.

  The screen in the course of mathematics shown in FIG. 5 is the same in basic configuration as the screen in the course of care (care technology course for elderly people) shown in FIG. 4. Also in the screen shown in FIG. 5, a video display unit 211 and a template display unit 212 are provided. The image display unit 211 displays an image when the student 1 solves the problem.

  At the upper part of the template display unit 212, a work process display unit 221 is displayed, and it is displayed that there are work processes of "determining answer policy" and "prepare answer" as work processes.

  On the left side of the template display unit 212, a condition display unit 222 is displayed, and indicators such as elapsed time with respect to the target time, accuracy, and legibility are displayed. The evaluation display unit 223 is displayed on the right side of the template display unit 212, and attention should be paid to the answers displayed on the video display unit 211, such as “unspoken meaning” and “unnecessary expression / explanation”. A display unit is provided to notify that a display such as blinking is performed when there is a problem.

  Further, in the screen example shown in FIG. 5, a comment display unit 251 is also displayed. The comment display unit 251 displays a comment from the leader 5. For example, on the left side of the comment display unit 251, an icon display unit 252 is also provided, in which a picture or icon of the speaker (leader 5) who added the comment is displayed (here, assuming that the icon is displayed, to continue).

  Also, in order to clarify which part the comment is about, the mark 253 is also displayed, and in FIG. 5, the mark 253 shown by a circle is superimposed on the image (answer sheet) displayed on the image display unit 211. Is displayed.

  The mark 253 is displayed by a comment on a portion on the screen that the student 1 wants to pay attention to. That is, the mark 253 indicates a position where the image display unit 211 and the template display unit 212 (the work process display unit 221 in the template display unit 212, the status display unit 222, and the evaluation display unit 223) want attention to the student 1 Is displayed. A plurality of marks 253 may be displayed simultaneously.

  In order to clarify the relationship between the comment in the comment display unit 251 and the mark 253, a display effect such as drawing a line 254 on the mark 253 from the comment display unit 251 may be provided. The line 254 may not be displayed if there is one comment in the comment display unit 251 and the correspondence with the mark 253 is clear.

  The comment display unit 251 is not always displayed, but is displayed, for example, in a pop-up manner when there is a comment. Alternatively, a mark 253 indicating that there is a comment may be displayed, and may be displayed when the student 1 operates the mark 253. Alternatively, the frame of the comment display unit 251 may be displayed at all times, and may be displayed in the comment display unit 251 when there is a comment.

<About template, data, script>
The template 62, the data 63, and the script 64 when the screen as shown in FIG. 5 is displayed will be described.

  FIG. 6 is a view showing an example of the data structure of the template 62. As shown in FIG. The template 62 is a list of objects holding information on the process 301, the name 302, the type 303, the appearance 304 of the user interface, and the display position 305.

  At the step 301, information for displaying only at the designated step, and others for non-display is described. In the example shown in FIG. 6, numbers such as “1”, “2”, or “1, 2” are described, “1” is step 1 (decision of answer policy), “2” is step 2 (step It is defined that the display is made in the drafting of the answer) and the steps 1 and 2 (decision of answer policy, drafting of the draft).

  In the name 302, for example, names such as "process" and "target time" are described. As the type 303, those used in general programming languages such as numerical values, character strings, and time can be used. An overview 304 is a component whose appearance changes in accordance with a value, and is drawn in a display step 301 and a display position 305.

  For example, the name 302 is described as "1, 2" as the step 301 at "step", "Number" is described as the type 303, and the appearance 304 is "determination of answer policy It is described as "creation". That is, in the process 1 and the process 2, it is defined that the display of “decision draft of answer policy” is made on the work process display section 221 (FIG. 5).

  Also, for example, the name 302 is described as "2" as the step 301 in the place of "accuracy", is described as "Number" as the mold 303, and "good, usually, bad" as the appearance 304. It is stated that. That is, in step 2 (the step of preparing an answer), it is defined that a display of “good, usually, bad” is made at the situation display section 222 (FIG. 5).

  FIG. 7 is a view showing an example of the data structure of the data 63. As shown in FIG. Data 63 shown in FIG. 7 is a diagram representing a data structure supplied to the template 62 shown in FIG.

  The upper portion of FIG. 7 shows a list 401 of data 63, and the lower portion thereof shows a timeline 402 of data 63. As shown in FIG. The name 403 in the timeline 402 is the same as the name 302 defined in the template 62 shown in FIG. 6, and the value 404 is a value that changes according to the time of the video being reproduced. Here, since it changes in accordance with the time of the video being reproduced, it is described as a timeline 402.

  The part shown black in the timeline 402 is an interval in which the value exists, and the white part represents an interval in which the value does not exist. The value of each object (the cross section of the timeline 402) at the time 405 indicated by the vertical line is as shown in the list 401. By applying the values of the list 401 to the template 62 shown in FIG. 6, an overview of the template is determined.

  For example, referring to the list 401 of the data 63 shown in FIG. 7, it can be understood that the time 405 is step 2 (step of preparing an answer). At time 405, as the information displayed on the status display unit 222, "15:00" is displayed at the target time, and "5:20" is displayed at the elapsed time. Are listed as data. Also, as the information displayed on the status display unit 222, accuracy and viewability are respectively “3” and “3” represents “good” for display, as shown in FIG. The background is displayed in white only in the "good" part of "good", "normal" and "bad".

  In addition, in the list 401, “meaningless”, “unnecessary expression / explanation” displayed in the evaluation display section 223 (FIG. 5), “insufficient explanation”, “calculation error”, “expression error”, “logic failure” It is stated that each item such as “does not have a value at time 405”. Referring to the timeline 402, at time 405, these values are white parts indicating that they do not exist.

  FIG. 8 is a view showing an example of the data configuration of the script 64. As shown in FIG. The script 64 illustrated in FIG. 8 is a script 64 that describes instruction content for the student 1 such as a comment displayed in the comment display unit 251.

  The script 64 describes the instruction start condition and the message content of the instruction, the display position of the mark 253 which is the attention portion, and the instruction such as the pause of the image and the change of the reproduction position.

  For example, in the example shown in Fig. 8, the discriminant is often used if “@ 5: 20”, “agent (“ teacher ”)”, “talk (“ the number of solutions of the quadratic equation are used. "." And "points ((100, 300), (150, 350))" are described. The description of the script 64 as described above relates to the comment display unit 251 and the mark 253 shown in FIG. When the image is 5 minutes and 20 seconds, a comment saying "If the number of solutions of the quadratic equation, the discriminant equation is often used." Is displayed in the comment display column 251, and the coordinates are (100, 300) At 150, 350), a script is displayed to display a mark 253, respectively.

  The timing of creation of such template 62, data 63, and script 64 will be described with reference to FIG.

  At time t1, a template 62 suitable for a predetermined course is created. For example, in the example described above, a template 62 suitable for a course of care and a template 62 suitable for a course of math are respectively created and uploaded to the database 52. It is assumed that the template 62 is not frequently changed once it is designed.

  At time t2, a video is taken and edited, and video data 61 is uploaded to the database 52. The content includes video data 61, data 63, and a script 64, and a plurality of contents are created with the same template 62.

  After the video is uploaded, it is a period during which the data 63 and the script 64 can be input. At time t 3, data 63 and script 64 are created and uploaded to the database 52. After time t4 after the data 63 and the script 64 are uploaded, it becomes a period in which the content can be viewed.

  If the student 1 views the content at time t5, the log 65 is uploaded. The data 63 and the script 64 can be added and edited as needed. For example, at time t6, the data 63 and the script 64 are updated, and the updated data 63 and the script 64 (Rev. 2) are uploaded. After uploading, content based on the uploaded data 63 and script 64 is provided to the student 1.

  For example, when the upload of the data 63 and the script 64 ends at time t7 and the student 1 views the content at time t8 thereafter, the content by the updated data 63 and the script 64 is provided to the student 1 Ru.

  When the student 1 views the content while editing the data 63 and the script 64, the content before the update is provided to the student 1.

<Process related to content reproduction>
Next, processing performed by the content reproduction apparatus 41 (FIG. 2) when the student 1 views the content will be described with reference to the flowchart shown in FIG.

  When content reproduction is instructed by the student 1, in step S101, information necessary for the reproduction of the content, in this case, resources necessary for reproduction, such as the video data 61, the template 62, the data 63, and the script 64. Information on the storage location is obtained.

  In step S102, based on the acquired information, the database 52 is accessed to acquire the video data 61, the template 62, the data 63, and the script 64, respectively. In step S103, a template based on the template 62 is displayed on the display of the content reproduction device 41.

  In step S104, video reproduction based on the video data 61 is started. By displaying the video and the template on the display, for example, a screen as shown in FIG. 4 or 5 is presented to the student 1.

  In step S105, the reproduction position (time) of the video is acquired, and the data 63 corresponding to the reproduction position (time) is acquired. If there is data 63, the displayed template is updated based on the data 63 in step S107.

  In step S107, it is determined whether there is an executable script 64. If there is, the process proceeds to step S108, and the scripts 64 determined to exist are sequentially executed (step S109). For example, the comment display field 251 shown in FIG. 5 is displayed, and a comment or a mark 253 is displayed.

  In step S110, it is determined whether the reproduction is ended. It is determined that the reproduction is ended when the end of the video or the script has a stop instruction. If it is determined in step S110 that the reproduction has not ended, the process returns to step S105, and the subsequent processes are repeated.

  On the other hand, when it is determined in step S110 that the reproduction is ended, the processing relating to the reproduction of the content is ended.

  Thus, the participant 1 views and learns the content reproduced by the content reproduction apparatus 41 (for example, a personal computer, a smart phone, a tablet terminal, etc.).

<Presentation of related information>
FIG. 11 shows an example of a screen when presenting related information. The screen shown in FIG. 11 is an example of a screen displayed on the display 201 of the content reproduction apparatus 41 when taking a math course, as in the screen example shown in FIG.

  The screen shown in FIG. 11 is an example of a screen having an interface that allows the student 1 to learn information to be associated in a specific situation. On the answer sheet displayed on the image display unit 211, a focused portion 601 displayed at a position where the student 1 wants to be focused is displayed. The content that the student 1 wants to associate is displayed in the content list 603. In order to clarify the relationship between the content list 603 and the focused portion 601, a line 602 is displayed between the content list 603 and the focused portion 601.

  In the content list 603, a text 604 for writing content to be associated and a still image 605 are displayed. The display in the content list 603 is not limited to the text 604 and the still image 605, and may include a moving image and the like.

  In the screen example shown in FIG. 11, one attention site 601 is shown, but a plurality of attention sites 601 may exist in one screen.

  The display of the attention point 601, the line 602, and the content list 603 is described in the script 64, and is controlled by executing a process based on the description.

<Data definition by expression>
In the data 63 shown in FIG. 7, an example in which all the values are input in the timeline 402 is shown, but as shown in FIG. 12, it may be calculated from other values by expression expression.

  In the data 63 shown in FIG. 12, items of “score 1”, “score 2”, “average”, and “maximum” are provided. “Score 1” and “Score 2” are data whose values are input by the instructor 5. “Mean” and “Max” are data calculated from Score 1 and Score 2 when relational expressions are input. is there.

  Thus, the data 63 may be data for which another value is calculated by expression expression.

Other Examples of Display
Another screen example displayed on the display 201 of the content reproduction apparatus 41 will be further described with reference to FIG.

  FIG. 13 is a diagram for explaining enlargement, reduction, and rotation of a video displayed on the video display unit 211. The screen shown in FIG. 13 is an example of a screen displayed on the display 201 of the content reproduction apparatus 41 when taking a math course, as in the screen example shown in FIG. Also in the following description, a screen example when taking a math course will be described as an example.

  In the screen example shown in FIG. 13, the image serving as the background is enlarged, reduced, or rotated and displayed. As described above, the screen is provided with the video display unit 211 and the template display unit 212, and the template display unit 212 is displayed being superimposed on the video display unit 211.

  There is a possibility that the image displayed on the image display unit 211, for example, in the example shown in FIG. In addition, there is a possibility that the location of interest is hidden in the template display unit 212 and becomes inconspicuous. In order to prevent such difficulty in viewing, the image displayed on the image display unit 211 is enlarged, reduced, or rotated, for example, to make it easy to see the portion of interest Control may be performed.

  The screen example shown in FIG. 5 is compared with the screen example shown in FIG. The answer sheet displayed on the image display unit 211 shown in FIG. 5 is displayed in a state of being slightly inclined to the left side. On the other hand, the answer sheet displayed on the image display unit 211 shown in FIG. 13 is corrected by being rotated by a predetermined angle from being displayed obliquely to being displayed horizontally. ing.

  Further, the answer sheet displayed on the image display unit 211 shown in FIG. 13 is displayed in a smaller size than the answer sheet displayed on the image display unit 211 shown in FIG. As described above, the correction such as enlargement, reduction, or rotation may be added to the image so that the participant 1 can easily view. Further, such correction may be performed by the student 1 side.

  FIG. 14 is a diagram for explaining note display (separation display) of a comment. In the screen example shown in FIG. 5, the comment display section 251 is displayed superimposed on the video displayed on the video display section 211. However, another area called a note is provided, and the comment is displayed in that area. It may be displayed.

  In the screen example shown in FIG. 14, a note 801 is displayed below the video display unit 211. In the note 801, a list of comments is displayed. When a comment is superimposed on a video, the video becomes difficult to see. However, displaying the video and the comment in separate areas makes it possible to make both the video and the comment easier to see.

  Consider a case where the content reproduction device 41 is, for example, a device capable of displaying content such as a smartphone 851 on a horizontally long screen or a vertically long screen. When the smartphone 851 is placed horizontally and the content is played back on the horizontally long screen, the notebook 801 is not displayed but placed vertically, and when the content is played back on the vertically long screen, the notebook 801 is displayed.

  As described above, it may be determined whether to display the notebook 801 according to the aspect ratio of the screen, and control may be performed to display or not display the notebook 801 according to the determination result.

  FIG. 15 is a diagram for explaining the interactive function. The screen example shown in FIG. 15 is a screen example for causing the student 1 to point, for example, tap or click on a point of interest on the screen to give a strong impression of the important part.

  In the screen, a notable part 901 is displayed with a predetermined mark or the like at a part where the student 1 wants to be made to pay attention. In addition, an order 902 for finger pointing confirmation is displayed in the vicinity of the attention portion 901. An order 902 of "1" is displayed in the vicinity of the attention site 901-1, and an order 902 of "1" is displayed in the vicinity of the attention site 901-2, and in the vicinity of the attention site 901-3. , The order 902 of "2" is displayed.

  Although the same order 902 is displayed in the focused portion 901-1 and the focused portion 901-2, as described above, when there are a plurality of focused portions 901 having the same order 902, simultaneous selection (multi-tap) or continuous selection (Select one by one with a mouse or the like, and the selection order within the same number does not matter).

  As shown in FIG. 15, a line 903 may be displayed between the focused portion 901-1 and the focused portion 901-2 in order to make it easy to understand the simultaneously selected focused portion 901.

  The display of the attention portion 901, the order 902, and the line 903 is described in the script 64, and is controlled by executing processing based on the description.

  The student 1 can confirm the important item by confirming the focused part 901 while confirming pointing based on the order 902.

  FIG. 16 is a diagram for explaining the interactive function as in FIG. The screen example shown in FIG. 16 is a screen example for prompting the student 1 to understand the order relation and the dependency relation with a finger with respect to a plurality of focused parts on the screen, for example, by dragging. .

  In the screen example shown in FIG. 16, attention points 1001-1 to 1001-5 are displayed, and an order 1002 is displayed near those attention points. The order 1002 displayed in the vicinity of the noticed parts 1001-1 to 1001-3 is "1". The order 1002 displayed in the vicinity of the attention site 1001-4 and the attention site 1001-5 is “2”.

  In order to indicate that the attention points 1001-1 to 1001-3 are the first tracing points, an order 1002 of “1” is attached. And in order to show that attention location 1001-4 and attention location 1001-5 are the second tracing location, an order 1002 “2” is attached.

  An arrow 1003 for making the student 1 recognize the order of tracing is also displayed. In the screen example shown in FIG. 16, since the arrow 1003 is drawn from the attention location 1001-1 to the attention location 1001-2, and the arrow 1003 is drawn from the attention location 1001-2 to the attention location 1001-3, The person 1 recognizes that it is sufficient to trace in the order of the attention point 1001-1, the attention point 1001-2, and the attention point 1001-3, and performs tracing.

  Similarly, since the arrow 1003 is drawn from the attention location 1001-4 to the attention location 1001-5, the student 1 recognizes that the attention location 1001-4 and the attention location 1001-5 should be traced in the order Follow the strokes.

  The student 1 can check the important items while tracing the attention location 1001 based on the order 1002 and the arrow 1003.

  The display of the attention portion 1001, the order 1002, and the arrow 1003 is described in the script 64, and is controlled by executing a process based on the description.

  FIG. 17 is a screen example for confirming the knowledge to the student 1 by a question. The screen example shown in FIG. 17 is a screen example for giving a question to the student 1 and making the understanding result aware of the answer result, or giving a more detailed explanation.

  In the screen example shown in FIG. 17, a question dialog 1101 is displayed on the video display unit 211. In the question dialog 1101, a question sentence 1102 and an option 1103 as an answer to the question are displayed below the question sentence 1102.

  When the student 1 selects the option 1103, the display of a message according to the answer, the change of the reproduction position of the image, and the like are performed, and the instruction according to the student 1 is performed.

  For example, if the selected option 1103 is correct, the playback position is changed to the next question image, and the explanation of the next question is started. Also, for example, if the selected option 1103 is incorrect, a comment indicating an error is displayed, or an explanation is started again.

  The display of the question dialog 1101, the question sentence 1102, and the option 1103 is described in the script 64, and is controlled by executing processing based on the description. Further, the process when the option 1103 is selected is also described in the script 64, and the process based on the description is executed, whereby the process such as the change of the reproduction position as described above is performed.

  FIG. 18 is a screen example for asking the student 1 to give an opinion. The screen shown in FIG. 18 has an interface for asking the student 1 to give an opinion. The screen example shown in FIG. 18 is a screen to which the interface disclosed in Japanese Patent No. 4944917 filed by the present applicant has been applied.

  In the screen example shown in FIG. 18, three balloons 1201-1, 1201-2 and 1201-3 are displayed below the video display unit 211. A message such as "Why 4 (k-1)?" Is displayed on the balloon 1201-1, a message such as "What is the discriminant?" Is displayed on the balloon 1201-2, and the message on the balloon 1201-3 is displayed. A message such as "I understand completely" is displayed.

  The student 1 selects a balloon 1201 that matches his / her opinion from among these messages. The student 1 may be configured not to select if there is no message that matches his / her opinion.

  For example, when the balloon 1201-1 is selected, the student 1 can determine that "the reason why the discriminant equation is 4 (k-1) can not be determined", and displays an equation in progress or presents a detailed explanation Processing is performed.

  As described above, a mechanism may be provided in which learning can be performed while confirming the opinions of the student 1.

  As described above, according to the present technology, the process actually performed by the student 1, and in the example described above, guidance from the instructor 5 is added to care and solution methods. Content can be provided. By learning with content suitable for each student 1, it is possible to increase the degree of acquisition of the student 1.

  In addition, since the content can be viewed and listened to at the convenience of the student 1 and can be viewed multiple times, learning can be performed freely without being restricted by time and place. It is possible to increase the degree of acquisition of the student 1.

  Note that the program executed by the computer may be a program that performs processing in chronological order according to the order described in this specification, in parallel, or when necessary, such as when a call is made. It may be a program to be processed.

  Further, in the present specification, the system represents the entire apparatus configured by a plurality of apparatuses.

  In addition, the effect described in this specification is an illustration to the last, is not limited, and may have other effects.

  Note that the embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present technology.

  11 shooting apparatus, 21 template creation apparatus, 31 data input apparatus, 41 content reproduction apparatus, 201 display, 211 video display section, 212 template display section, 221 operation process display section, 222 status display section, 223 evaluation display section

Claims (14)

An information processing apparatus for displaying on a display a screen of course content relating to an instructor's instruction to a task performed by a student.
A storage unit storing a template having a data structure prepared in advance according to the contents of the course content;
A processor for displaying the screen on the display;
The screen is
An image display unit for displaying an image obtained by photographing the state in which the student is performing a predetermined task;
A template display unit for displaying the template;
The template display unit is
A work process display unit for displaying a plurality of work processes predetermined for each of the course contents;
A status display unit for displaying a check point regarding whether or not the work status displayed on the image display unit is appropriate for each work process;
An evaluation display unit configured to display an evaluation of the instructor with respect to the work performed by the student for each of the work processes. The information processing apparatus according to claim 1, wherein the status display unit displays a combination of a process name of each work process and the check point for each work process. The course content is content relating to care for a target person,
The information processing apparatus according to claim 1, wherein the status display unit displays a time spent looking at the care target person, a talked time, and a touch time. The evaluation display unit enumerates evaluation items, and displays evaluation items corresponding to the work status displayed on the image display unit so as to be distinguished from evaluation items not corresponding thereto. The information processing apparatus according to claim 1. The information processing apparatus according to claim 4, wherein the evaluation display unit blinks the corresponding evaluation item, changes a character color, or changes a background color so as to distinguish the evaluation item which does not correspond. . Information to be associated by the student is displayed from predetermined information in the image displayed on the image display unit,
The information processing apparatus according to any one of claims 1 to 5, wherein a predetermined mark is displayed on the predetermined information so that the trainee pays attention. The information processing apparatus according to any one of claims 1 to 6, wherein the image displayed on the image display unit is enlarged, reduced, or rotated as necessary. The information processing according to any one of claims 1 to 7, wherein the image is enlarged, reduced, or rotated so that the image displayed on the image display unit is not hidden by the template displayed on the template display unit. apparatus The information processing apparatus according to any one of claims 1 to 8, wherein the screen further includes a comment display unit that displays a comment from a leader. The information processing apparatus according to claim 9, wherein the comment display unit is superimposed and displayed on the image display unit when there is a comment from the instructor. Displaying a predetermined mark on the predetermined information in the image displayed on the image display unit so that the student pays attention and confirms it;
The information processing apparatus according to any one of claims 1 to 10, wherein the order of confirmation is displayed in the vicinity of the mark. A predetermined mark is displayed on the predetermined information in the image displayed on the image display unit so that the student pays attention.
The information processing apparatus according to any one of claims 1 to 11, wherein an arrow indicating a direction in which the mark is traced is displayed. Display questions for the students,
Display a choice of answers to the question,
The information processing apparatus according to any one of claims 1 to 12, which executes a process according to the option selected by the student. The screen has an interface for listening to the students.
The information processing apparatus according to any one of claims 1 to 13, wherein the interface is displayed as an option having a shape of a balloon.

Images