JP6976996B2 - Dynamic story-oriented digital language education methods and systems - Google Patents

Description

The present invention belongs to a digital teaching method and system, and particularly relates to a method and a system for responding to information to a learner's voice learning and dynamically adjusting the lesson story of a digital language lesson script.

Currently, there are various digital learning materials on the market. For example, digital learning platforms take pictures of teachers' classes at private schools, universities, junior colleges, etc., upload them to the Internet, and let students download them for a fee or for free. Watch or have a digital learning material vendor create and sell a digital learning video from a professional teacher, depending on the course of the school.

Also, as another example, for example, a digital learning system may be based on a variety of digital goods, such as virtual electronic whiteboards, virtual (robot) teachers, voices, texts, etc., based on materials edited by vendors of digital learning materials. Create a digital learning system by using drawings and videos. Therefore, in addition to learning in class, students can study and review after school using any one of the above digital learning materials or digital learning systems.

Many vendors have applied for numerous patents for the above digital learning systems. For example, Patent Document 1 describes a method of editing digital learning contents by using an interface module. Further, Patent Document 2 describes that a text file is used to automatically create the content displayed on the screen. Further, Patent Document 3 describes that the material of the courseware is used to create an agent program of the corresponding courseware according to the contents of each chapter of the courseware and the learning process.

The vendors are also developing several exchange and dynamic digital education systems. For example, in the US Patent No. 9626875 (Patent Document 4) of the Israeli cognitive building timing company (Time to Know Ltd.), students learn various things based on the interaction in the education system. A digital learning system is described in which the learning content is divided into groups, and the learning content is distributed to each learning group, and the learning content that can be dynamically reassembled is provided to the educator. Further, Patent Document 5 describes that metadata generates digital lesson contents based on the type of digital learning by the user and the information entered by the user in the template.

However, the above-mentioned digital learning materials or digital learning systems only broadcast the digital learning materials in a one-sided and linear manner, and the teachers become students by interacting with each other during the lesson as in the conventional lessons. It is not possible to adjust the lesson content at any time according to the learning results.
For example, in a traditional lesson, the teacher teaches using teaching materials (eg, textbooks or presentations), the student accepts the knowledge taught by the teacher, and the teacher understands the student's learning situation during the lesson. If the student does not answer correctly, he / she perceives that he / she does not yet understand the current lesson content and adjusts the current lesson content. For example, the teacher reviews what he has already taught or supplements with other content so that the student can better understand the lesson content.

In addition, in the technical plan described in the above patent document, the educator (that is, the teacher) submits a report to the digital learning system in order to dynamically adjust the digital learning content according to the learning situation of the student, or , You need to manage the system. What's more, students can provide a digital learning system by giving various voice feedbacks (for example, voice-based authenticity questions, multiple-choice questions, question-and-answer questions, answering questions by looking at pictures, and translation questions) to the system. It is also not possible to automatically adjust the content of digital learning.

In other words, teachers are currently unable to respond to student reactions, just as humans actually teach, such as all digital learning materials, digital learning systems or patent literature. Therefore, it is necessary to improve such a problem.

U.S. Patent Publication No. 20090031215 U.S. Pat. No. 763,254 Chinese Patent Publication No. 1525320A U.S. Pat. No. 9626785 U.S. Patent Publication No. 2011065082 (Chinese Patent Publication No. 102696052A)

The present invention was created in view of the problems of the above-mentioned prior art, and in order to solve the above-mentioned problems, the present invention responds to the student's voice reaction when the student is using the digital learning course. One of the purposes is to provide a dynamic story-oriented digital language education method that makes students feel as if the actual person is teaching by being able to dynamically provide appropriate lesson content. Books Another purpose of the invention is to allow language teachers or designers of language teaching materials to edit lesson scripts with dynamic lesson content on their own.

Based on one object of the present invention, a dynamic story-oriented digital language education method including the following steps applied to the provider side is provided. The process by which the provider receives information to execute one of the pre-edited digital lesson courses selected by the learning side, and the digital lesson course is edited by the lesson script and is the basic lesson of the lesson script. It is a process of outputting one of the stories to the learning side and a process of continuing to one of the basic lesson stories based on the response information of different voice evaluations provided by the learning side. Therefore, the learner can feel that the actual person is giving the lesson by learning the appropriate lesson content according to his / her learning situation on the learning side.

In addition, the basic lesson story includes the characters, translations, sounds, images, videos, videos used in the lesson content, and the script information which is the lesson material such as the virtual teacher's video, mouth pattern, facial expression, and hand gesture.

In addition, the story variation condition is that when the response information of different voice evaluation is received, the lesson script can continue to which basic lesson story, and the virtual teacher can express facial expressions, gestures, spoken language responses, etc. based on the script information. Shows.

In addition, the response information of the voice evaluation is different voice response, or the quality of the voice response on the learning side reaches a different level, or the truth question, the multiple choice question, the question-and-answer question, and the picture are seen. Includes answering questions and answering translation questions.

The story fluctuation condition uses conditional branch instructions, loop instructions, random variables, etc. to determine which basic lesson story to continue.

Based on another object of the present invention, the provider further includes a lesson editing unit. A language teacher or a person who designs language materials can edit the lesson script using the lesson editing unit on the editorial side or the provider side and convert the lesson script into a digital lesson course.

In addition, the digital lesson course is stored on the provider side, and in the above conversion process, when the digital lesson course is executed, the necessary lesson materials can be extracted from the database unit by the script information.

Also, when you are converting a lesson screenplay to digital lesson course, by natural saying Katarikai analysis of technology, by analyzing the character and voice of the content of the words virtual teacher says to dynamic, of the appropriate virtual teacher videos, mouth Add lesson materials such as patterns, facial expressions, and hand gestures to the digital lesson course.

According to the present invention, it has one or more of the following effects.
(1) The learner selects the digital lesson course provided by the provider on the learning side, and the provider displays the following basic lesson story based on the response information of the voice evaluation by the learner on the learning side. By dynamically determining, the learner can feel that the actual person is teaching.
(2) A language teacher or a person who designs language teaching materials can easily connect to the provider via a network on the editorial side, or directly use the lesson editing unit provided by the provider on the provider side. You can edit the digital lesson course of.
(3) Language teachers or those who design language teaching materials use the lesson editing unit to use the lesson editing unit to read the characters, translations, sounds, images, videos, videos, and virtual teacher videos, mouth patterns, and facial expressions used in the lesson content. You can add lesson materials such as hand gestures.
(4) The lesson editing unit can automatically add appropriate lesson materials such as virtual teacher videos, mouth patterns, facial expressions, and hand gestures to the digital lesson course when the lesson script is being converted to the digital lesson course. can.

It is a structural diagram of the provider side, the editorial side, and the learning side which concerns on this invention. It is a flow chart of the operation between the providing side, the editing side, and the learning side which concerns on this invention. It is another structural diagram of the provider side, the editorial side, and the learning side which concerns on this invention. It is a figure which shows the lesson editing unit which concerns on this invention. It is a figure which shows the digital learning interface of the learning side which concerns on this invention. It is a figure which shows the digital learning interface of another learning side which concerns on this invention.

[Example]
As shown in FIGS. 1 to 3, the present invention relates to a dynamic story-oriented digital language education method, and is applied between the providing side 1, the editing side 2, and the learning side 3.
The provider 1 is a first electronic device to which a network server, a computer, or the like is remotely connected via a network. The provider 1 is provided with a dynamic story-oriented digital language education system, which includes a lesson editing unit 10, a database unit 12, and a course execution unit 14. Further, the lesson editing unit 10 is created by a programming language, and the database unit 12 is used for characters, translations, sounds, images, videos, videos, virtual teacher videos, mouth patterns, facial expressions, hand gestures, etc. used in digital lessons. Save lesson materials. The lesson material is stored in the database unit 12 in the form of digital goods, for example, the sound is a recorded file of an actual person or a voice file created by voice synthesis by a machine (for example, a file in MP3 format). .. In addition, the images, videos and videos are the corresponding files, such as jpg, png format digital image files, move format digital video files or gif format digital video files.

In the present invention, a language teacher or a person who designs a language teaching material (abbreviation: editor) connects to the provider 1 via a network on the editor 2, or directly connects the lesson editing unit 10 on the provider 1. Use to edit and create at least one lesson script.
The lesson script includes a plurality of basic lesson stories and a plurality of story variation conditions, and the lesson script can be stored in the database unit 12. In addition, the basic lesson story stores script information that is the lesson material such as characters, translations, sounds, images, videos, videos, virtual teacher videos, mouth patterns, facial expressions, and hand gestures used in the lesson content. .. Further, each lesson script can be stored in the database unit 12.

In addition, the story fluctuation condition is that when the response information of the voice evaluation from the learning side 3 is received, if the lesson script continues to which basic lesson story, the virtual teacher will use the script information to express facial expressions, gestures, or spoken words. Shows whether the response etc. can be expressed. Further, as for the response information of the voice evaluation, the quality of the voice response of each learner from the learning side 3 or the voice response of the learner on the learning side 3 is one of the factors of the pronunciation, tone, rhythm, and accent of the voice response. Comprehensive judgment based on one or any combination of two, or the learner on the learning side 3 speaks the truth question, the multiple choice question, the question-and-answer question, the question to answer by looking at the picture, and the translation question. And use conditional branch instructions, loop instructions, stochastic variables, etc. to determine which basic lesson story to continue.

The editing side 2 is a computer or a second electronic device having an Internet connection function that receives information from the lesson editing unit 10 via a network. Alternatively, the editing side 2 is a user of the providing side 1 who can directly use the lesson editing unit 10 on the providing side 1.

As shown in FIG. 4, the lesson editing unit 10 is represented to the editing side 2 or the providing side 1 in the form of a man-machine interface (for example, a window interface). The lesson editing unit 10 includes a script editing unit 100, a voice editing unit 101, a virtual teacher image selection unit 102, a virtual teacher response selection unit 103, a voice evaluation unit 104, a script image / video selection unit 105, and the like. Represented by a different frame or button on the machine interface. Further, the method in which the editor edits the script information of the lesson content using the script editorial unit 100 is the same as that for creating a general programming language, and the present inventors have a function of editing various teaching materials. Will be explained as a reference.

Further, the voice editing unit 101, the virtual teacher image selection unit 102, the virtual teacher response selection unit 103, the voice evaluation unit 104, the script image / video selection unit 105, the translation editing unit 106, and the like are sequentially pre-stored in the database unit 12. Representatives of lesson materials such as voice files, virtual teacher role images, virtual teacher response (eg, praising learners) videos, mouth patterns, facial expressions and gestures, student response voice evaluation conditions, image video and language translation editing. The editor can be provided with a specific wording to be selected, and the editor can easily add the lesson material to the script information of the script editorial unit 100. In addition, the course introduction editorial department 107 is provided to the editor to fill in the course name, introduction or remarks entry field, and the like. The course name, introduction or remarks are saved as the content of the lesson script along with the script information.

Further, after the lesson script is completed, the editor makes a conversion using the edit button 108 provided in the lesson editing unit 10, and a digital lesson course that can be received and used by the learning side 3 is created and the digital lesson is performed. The course is stored in the database unit 12 of the provider 1.
The conversion process allows the digital lesson course to acquire the necessary lesson material in the database unit 12 based on the representative teaching material of the script information. Further, the editor can save the script information currently in the script editing unit 100 by using the save button 109 provided in the lesson editing unit 10 on the man-machine interface. Further, the man-machine interface, which is the lesson editing unit 10, is provided with an execute button 110, and when the editor presses the execute button 110, the ongoing edited lesson script is inspected and edited. You can have a person view the edited result.

In addition, lesson materials such as letters, translations, sounds, images, videos, videos, and virtual teacher videos, mouth patterns, facial expressions, and gestures used in the lesson content are representative teaching materials of numbers, network addresses, or codes, respectively. Because it is replaced with, the capacity of the digital lesson course is suppressed.
When the digital lesson course is conducted, the provider 1 takes out the lesson material from the database unit 12 and sends it to the learning side 3 for output by using the number, the network address or the code. For example, the representative teaching material of the role image of the virtual teacher can be replaced with a code such as "virtual male teacher A", "virtual male teacher B", "virtual female teacher A", and "virtual female teacher B". In addition, the typical teaching material of the voice complimenting the learning side 3 can be replaced with a code such as "100 points of compliment", "90 points or more of compliment", and "80 points or more of compliment". In addition, the representative teaching materials of various facial expressions of the virtual teacher can be replaced with codes such as "smile", "praise", "frown", "shaking head", and "listening". In addition, typical teaching materials for commonly used lesson stories include "Interpreting how to pronounce consonants TH,""Interpreting how to use English pronouns," and "Interpreting the meanings of the four sounds in Chinese." Can be replaced with the code of.

In the present invention, further, when the above conversion is performed, the contents of the characters and voices of the words spoken by the virtual teacher are dynamically analyzed, and the representative of the facial expression videos of the appropriate virtual teacher's mouth type, facial expression and gesture. Teaching materials can be added to digital lesson courses. Then, when the digital lesson course is conducted, the virtual teacher can make an accurate pronunciation mouth type corresponding to the voice content, and a facial expression and a gesture corresponding to the voice content.

For example, the editor can use the lesson editing unit 10 to specify the facial expressions or gestures that the virtual teacher wants to have when speaking, and is not particularly limited, but for example, "smile", "praise", "please". , "I", "us", "look at the blackboard" and so on. Further, the lesson editing unit 10 analyzes information such as length, pronunciation, tone, rhythm, and accent of this sentence when editing is being performed, and automatically represents a representative facial expression or gesture suitable for this sentence. Teaching materials can be added to digital lesson courses. For example, it is video image information about when the virtual teacher starts to say this word, and at what position and angle the head, eyes, eyebrows, lips, and both hands should be placed.

Said of the sentence analysis, is a "natural saying Katarikai analysis" technology and "sentiment analysis" of the (Natural Language Parsing) (Sentiment Analysis ) natural language processing techniques such as (Natural Language Processing, abbreviated NLP), the virtual teacher Analyze and discover the emotions of words. For example, if the word is analyzed as a positive and encouraging word, the lesson editing unit 10 will automatically generate a representative teaching material with a facial expression that is the "smile" of the virtual teacher, and the learning side 3 will use this word. Even if the editor 2 has not edited the facial expression of the smile when executing, the virtual teacher also expresses the facial expression of the smile.
With respect to technology of "natural saying Katarikai analysis", published announcement by the United States at Stanford University, "The Stanford Parser", and was published announcement by the United States of the University of California, Berkeley teaching materials analysis tools such as "The Berkeley Parser" reference can do. In addition, regarding the technique of "sentiment analysis", "Peter Turney. Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Thumbs be able to.

As shown in FIGS. 5 and 6, in the present invention, the learning side 3 is a third electronic device having an Internet connection function such as a desktop computer, a laptop computer, a smartphone or a tablet, and is connected to the providing side 1 via a network. do. The providing side 1 uses the course execution unit 14 to provide the learning side 3 with the necessary contents of the digital learning interface 30.
The digital learning interface 30 is provided with at least one digital lesson course, which is provided to the learners on the learning side 3 for selection. Further, the digital learning interface 30 is a web interface, and the learning side 3 is connected to the providing side 1 by a web browser, and the digital learning interface 30 can be provided to the learning side 3 by the course execution unit 14. The course execution unit 14 may be executed by the providing side 1, or may be downloaded from the providing side 1 and executed by the learning side 3.

In other words, when the learner has the learning side 3 connected to the providing side 1, the course execution unit 14 provides the digital learning interface 30, and the learning side 3 selects one of the digital learning interfaces 30. Can be done. After that, the course execution unit 14 extracts the corresponding lesson material from the database unit 12 of the providing side 1 and provides it to the learning side 3 based on the selected digital lesson course, and the learning side 3 provides the contents of the digital lesson course. Let me start. Further, based on the response information of the voice evaluation completed by the learner on the learning side 3, the course execution unit 14 causes the virtual teacher to express an appropriate facial expression, gesture, and verbal response according to the story variation condition, or automatically. To continue with the appropriate lesson story edited in the lesson script.

In the present invention, the quality of the voice response determined by the course execution unit 14 is one or any combination of two factors such as pronunciation, tone, rhythm, and accent of the voice evaluation response information transmitted from the learning side 3. Make a comprehensive judgment based on. With respect to the above scoring method, the techniques described in Taiwan Patent No. I336880 or Taiwan Patent No. 556152 may be used, but the technique is not limited thereto. All the techniques applied to the evaluation of voice quality of the present invention belong to the above-mentioned scoring method.

In the present invention, teaching materials each number, because it was converted to a representative materials of network address or code, when adding new classes material database unit 12 to the editing side 2 or provider 1 by editors, original Even if there is no change in the lesson script, if the newly added lesson material replaces the old lesson material in the database unit 12, the learning side 3 will be in the database unit 12 while executing the digital lesson course. You can directly use the newly added lesson materials in. For example, when the code of "Virtual Male Teacher A" is used as a representative teaching material in the lesson script, it represents the role of a certain virtual teacher who is giving the lesson. Therefore, when the provider 1 adds a new "virtual male teacher A" to the database unit 12 and replaces the old "virtual male teacher A", the learning side 3 automatically performs the digital lesson course. You can select the new "Virtual Male Teacher A".
In addition, when the code of "smile" is used as a typical teaching material in the lesson script, it represents the response of the facial expression of the virtual teacher, and when the provider 1 updates the facial expression motion of "smile" in the database unit 12. The learning side 3 can automatically select a new "smile" facial expression motion while executing the digital lesson course. In addition, when the code of "Interpret the pronunciation method of consonant TH" is used as a typical teaching material in the lesson script, it represents the lesson story performed in a certain situation and matches "Interpret the pronunciation method of consonant TH". When the lesson story to be played does not yet exist in the database unit 12, the learning side 3 automatically skips this lesson story. However, after the provider 1 adds the lesson story of "interpreting the pronunciation method of consonant TH" to the database unit 12, the learning side 3 automatically selects a new lesson story while executing the digital lesson course. can do.

In order to further understand the technical features of the present invention and the functional effects to be achieved, digital language learning will be described below. Before explaining, I will explain a little about the definitions of native and foreign languages. The native language may be one or more languages, and the foreign language is the language that the learner masters through learning. Furthermore, regarding the definitions of native and foreign languages with reference to Wikipedia®, native language means one or more languages that humans naturally learn from an early age and are most good at, and also foreign languages. A language is a language used in a foreign country, and is generally a language that one wants to master as needed or motivated. For example, if a person's native language is Chinese and English, learning Spanish because of work needs, and learning Japanese because he has a hobby in Japanese culture, the Spanish and Japanese mentioned above. The language is a foreign language. Therefore, for language learning, the characters include the characters of the native language and the foreign language, the translation is that the characters of the native language correspond to the characters of the foreign language with the same meaning, and the voice is the native language and the foreign language. Including the voice of.

In the first embodiment of the present invention, as shown in FIG. 4, the man-machine interface is provided as a lesson editing unit 10 for use by the editor on the editor side 2. The editor edits lesson stories such as 10 types of English part of speech, 5 basic literary systems, present tense, past tense, future tense, relative clauses, interpretation of how to pronounce consonant TH, or practice of how to pronounce want, and digitally. It can be converted into a lesson course and stored in the database unit 12 of the provider 1.

When the learner selects one of the digital lesson courses using the learning side 3, the digital learning interface 30 represents the digital lesson course (see FIGS. 5 and 6). Digital goods such as a virtual teacher 300 and a virtual electronic blackboard 302 are displayed on the digital learning interface 30, and the virtual teacher 300 expresses videos, mouth patterns, facial expressions, gestures, etc. corresponding to each basic lesson story. Can be done. Characters, translations, images, videos, and moving images are displayed on the virtual electronic blackboard 302, and sounds are output by an audio output device provided on the learning side 3.

When the digital learning interface 30 represents a basic lesson story in which the virtual teacher 300 reads out the sentence "I want to play in the park" and makes the learner repeat it in the process of the digital lesson course, for example, the number and the network address. Alternatively, the corresponding lesson material is acquired from the representative teaching materials of the code, and the virtual teacher 300 and the virtual electronic blackboard 302 are expressed. In addition, this sentence is pre-edited with story variation conditions that evaluate the quality level of the voice response of the word "want", and once the quality level is met using conditional branching instructions, it becomes the next basic lesson story. If not, skip to the basic lesson story of "want" pronunciation and repeat the basic lesson story of practicing "want" pronunciation three times using loop commands. At this time, the provider 1 decides whether to continue to the next basic lesson story based on the response information of the voice evaluation by the response of the learning side 3 received, or to the basic lesson story to practice the pronunciation of "want" three times. Decide if you want to skip.

In the second embodiment of the present invention, the editor can edit the Chinese language lesson script and edit it into a Chinese language digital lesson course. The basic lesson story of one of the Chinese language digital lesson courses is for the learner to read aloud the sentence "My thoughts on beef (I want to eat beef)" with the virtual teacher 300 on the learning side 3. It is a story, and the executing side receives the response information of the voice evaluation by the response of the learning side 3, and the learner of the learning side 3 receives the response information of the voice evaluation, and the third intonation of "thought" is the first intonation. When it is determined that the pronunciation of "Kaori" has been obtained, the provider 1 searches for the specified lesson story set by using the conditional branch command based on the story fluctuation condition. , Teach the learner to correctly pronounce the third intonation of the Chinese language.

According to the above, the present invention can be applied to digital voice (viewing) learning of various foreign languages, and by entering an appropriate basic lesson story using story variation conditions, review, practice or general. Since the learning can be performed, the user of the learning side 3 can experience the feeling that the actual teacher teaches by the side.

In addition, common problems for general foreign language learners when learning a foreign language may affect the pronunciation of the foreign language due to their familiarity with their native language. For example, Taiwanese are not good at pronouncing "th" or "sh" in English, and Japanese are not good at pronouncing "l" or "r" in English. In addition, familiarity with native language grammar can affect foreign language grammar learning, or the same problems can occur when learners of different native languages learn the same foreign language. For example, when learning English, there are also problems such as incorrect use of prepositions such as "in", "on" or "at".

Therefore, in order to solve the above problem, in the present invention, when the learning side 3 is executing the digital lesson course on the providing side 1, for example, the course execution unit 14 on the providing side 1 evaluates the voice by the learning side 3. If it is determined that the response information of is incorrect in pronunciation, tone, rhythm, accent, etc., or if the course execution unit 14 on the providing side 1 determines that the response information of the voice evaluation by the learning side 3 has a grammatical error. If so, the course execution unit 14 on the provider side 1 transmits the error status information of the response information of the voice evaluation to the database unit 12 and stores it. Among them, the type of error status information is pronunciation type or grammatical type. The pronunciation type further includes syllables, phonetic symbols and positions in sentences, or the grammatical type further includes grammatical errors due to interference of the native language, errors in the use of part of speech, and the like. In addition, all learners are statistic for error frequency or error rate for each type.

As described above, when the editor edits the lesson script using the lesson editing unit 10, the error frequency or error rate of each type of bias in the above-mentioned foreign language learning is used as a judgment condition in the story fluctuation condition. Is also good. Conditional branch instructions, loop instructions, random variables, etc., when the learner's error frequency or error rate of a certain type meets a preset error frequency threshold or error rate threshold and reaches the above conditions. Use to set to follow the basic lesson story that corresponds to a review or practice error.
When the error frequency or error rate satisfies the error frequency threshold value or error rate threshold value, it indicates that the error frequency or error rate is higher, lower, or equal to the error frequency threshold value or error rate threshold value. Then, when the learning side 3 is executing the digital lesson course, the error frequency or the error rate of each type by the learner is called from the database unit 12 of the providing side 1 based on the instruction of the lesson script. Can be done. After that, if the error frequency or the error rate is higher or lower than a certain value, the provider 1 automatically calls and performs the basic lesson story regarding the error type. Therefore, the learner on the learning side 3 can correct the error by sufficiently practicing or learning.

Further, as described above, the provider 1 provides the lesson editing unit 10 to the language teacher or the person who designs the language teaching materials to edit the digital lesson course. When the learning side 3 is executing the digital lesson course, the providing side 1 represents various basic lesson stories according to the lesson script in the digital lesson course, and especially when the story fluctuation condition is satisfied, the condition. Continue to that one basic lesson story specified by a branch instruction, a loop instruction, and a random variable. Then, the learner executes the digital lesson course on the learning side 3, and feels the scene where the teacher gives the lesson according to the reaction of the learner as if the actual person is giving the lesson.

As described above, since there has been no public notice or application similar to the present invention, the present invention has sufficient novelty, and further, the present invention already has actual effects and satisfies industrial applicability. , Submit the application in accordance with the Patent Law. However, the examples described in the present specification are only preferred embodiments, and do not limit the scope of claims of the present invention. Further, in terms of the theory and technology of the present invention, modifications and changes of each component are included in the claims of the present invention.

According to the dynamic story-oriented digital language teaching method and system of the present invention, the learner can feel as if a real person is teaching.

1 Provider 10 Class editing unit 100 Screen editing department 101 Voice editing department 102 Virtual teacher image selection department 103 Virtual teacher response selection department 104 Voice evaluation department 105 Screenplay image video selection department 106 Translation editing department 107 Course introduction editorial department 108 Edit button 109 Save button 110 Execute button 12 Database unit 14 Course execution unit 2 Editing side 3 Learning side 30 Digital learning interface 300 Virtual teacher 302 Virtual electronic blackboard

Claims (11)

The provider is the first electronic device to which a network server or a computer is remotely connected via the network, and the course execution unit provided on the provider selects one of the digital lesson courses selected by the learning side. Upon receiving the information to be executed, the editor edits the lesson script using the lesson editing unit, converts the lesson script into the digital lesson course, and the editor side receives the information from the lesson editing unit via the network. A computer that receives information or a second electronic device that has an Internet connection function, and the lesson script includes a plurality of basic lesson stories and a plurality of story variation conditions, and the basic lesson story is a lesson used in the lesson content. Including materials, the story variation condition is integrated based on one or any combination of two factors of pronunciation, tone, rhythm, and accent of the voice response , based on the response information of the voice evaluation from the learning side. be judged, or authenticity problems with the voice, choice question, catechetical of the problem, look at including to reply the problem and translation problem answering a look at the picture, and the step of selecting a class the story of the following basic,
The providing-side outputs a class story one said basic is of the class script to the learning side, further includes a database unit, the data base unit, characters used in class, translation, speech, The process in which images, videos, videos, and virtual teacher videos, mouth patterns, facial expressions, and hand gestures are stored.
The provider is characterized by including a step of continuing to one of the basic lesson stories based on separate response information of the voice evaluation provided by the learning side.
A dynamic story-oriented digital language education method. The basic lesson story includes characters, translations, sounds, images, videos, videos, and virtual teacher videos, mouth patterns, facial expressions, and script information that is the lesson material for hand gestures used in the lesson. When the response information of the voice evaluation from the learning side is received, or when the error frequency threshold or the error rate threshold is satisfied, the lesson script uses a conditional branch instruction, a loop instruction, and a probability variable. The dynamic story-oriented digital language education method according to claim 1 , wherein the method is to show that one of the basic lesson stories is continued. The virtual teacher's video, mouth pattern, facial expression, and hand gesture lesson material dynamically analyzes the content of the characters and voices of the words spoken by the virtual teacher, and the appropriate virtual teacher's mouth pattern, facial expression, and hand gesture facial motion video. Typical teaching materials can be added to the digital lesson course, and when the digital lesson course is conducted, the virtual teacher has an accurate pronunciation mouth pattern corresponding to the voice content and a facial expression corresponding to the voice content. The dynamic story-oriented digital language education method according to claim 1, wherein the teacher can make a gesture. After the virtual teacher's mouth-shaped video, facial expression video, and hand gesture video are determined, the virtual teacher's mouth-shaped video, facial expression video, and hand gesture video corresponding to the database unit are extracted and shown by number, network address, or code. The dynamic story-oriented digital language education method according to claim 3, which is characterized. The lesson editing unit sets the error frequency threshold or the error rate threshold, and the course execution unit transmits error status information of the response information of the voice evaluation to the database unit and stores the error status information. The error frequency or error rate of the above is statistic, and the course execution unit matches the story variation condition when the error frequency or the error rate satisfies the error frequency threshold or the error rate threshold. The dynamic story-oriented digital language education method according to claim 2 , wherein the lesson story is performed. The dynamic story-oriented digital language education method according to claim 2 , wherein the sound file is a recorded file of an actual person or voice synthesis by a machine. A lesson editing unit that provides the lesson script to the editorial side and edits the lesson script into a digital lesson course,
A database unit connected to the lesson editing unit and storing the lesson script and the digital lesson course,
It is connected to the database unit, provided to the learning side to select and execute the digital lesson course, and based on the selected digital lesson course, the corresponding lesson material is taken out from the database unit and the learning is performed. A course execution unit that provides the contents of the digital lesson course to the side, displays the contents of the digital lesson course, and performs the next lesson story that matches the story fluctuation condition based on the response information of the voice evaluation transmitted from the learning side. Including,
The lesson script includes a plurality of basic lesson stories and a plurality of story variation conditions.
Each of the plurality of basic lesson stories contains script information of lesson materials used in the lesson content, and
Each of the plurality of story variation conditions indicates that one of the set basic lesson stories should be continued after receiving the voice evaluation response information from the learning side.
The lesson materials include letters, translations, sounds, images, videos, videos, and virtual teacher videos, mouth patterns, facial expressions, and gestures.
The response information of the voice evaluation is comprehensively judged based on one or any combination of two factors of the voice response from the learning side, the pronunciation of the voice response, the tone, the rhythm, and the accent, or by voice. authenticity problem, choice question, catechetical of the problem, look at including to reply the problem and translation problem answering a look at the picture,
Or authenticity problems with the voice, choice question, catechetical of problems, including the fact that the reply of the problem and the translation problem answering a look at the picture,
A dynamic story-oriented digital language education system. The story variation condition is that when the response information of the voice evaluation from the learning side is received, or when the threshold value of the error frequency or the threshold value of the error rate is satisfied, the lesson script is a conditional branch instruction, a loop instruction, and the like. The dynamic story-oriented digital language education system according to claim 7 , wherein a stochastic variable is used to indicate that one of the basic lesson stories is continued. The virtual teacher's video, mouth pattern, facial expression, and hand gesture lesson material dynamically analyzes the content of the characters and voices of the words spoken by the virtual teacher, and the appropriate virtual teacher's mouth pattern, facial expression, and hand gesture facial motion video. Typical teaching materials can be added to the digital lesson course, and when the digital lesson course is conducted, the virtual teacher has an accurate pronunciation mouth pattern corresponding to the voice content and a facial expression corresponding to the voice content. And the dynamic story-oriented digital language education system according to claim 7 , wherein the person can make a gesture. The lesson editing unit includes a script editing unit, a voice editing unit, a virtual teacher image selection unit, a virtual teacher response selection unit, a voice evaluation unit, a script image / video selection unit, and a translation editing unit. Representative of audio files provided and pre-stored in the database unit, role images of virtual teachers, videos of virtual teacher responses, mouth patterns, facial expressions and gestures, audio evaluation conditions of student responses, image videos and language translation editing. The wording can be selected and added to the script information in the script editorial department, and the lesson editing unit also has a course introduction editorial department for the editor to fill in the course name, introduction or remarks entry field. The dynamic story-oriented digital language education system according to claim 7 , wherein the course name, the introduction, or the remarks are stored together with the script information as the content of the lesson script. The lesson editing unit sets an error frequency threshold value or an error rate threshold value, and the course execution unit transmits error status information of the response information of the voice evaluation to the database unit and stores the error status information. The error frequency or error rate is statistic, and the course execution unit matches the story variation condition when the error frequency or error rate satisfies the error frequency threshold value or the error rate threshold value. The dynamic story-oriented digital language education system according to claim 10 , wherein the lesson story is performed.

Images