JP6656689B2 - Programming support tool - Google Patents

Description

  The present invention relates to a programming support tool for assisting and supporting program learning and program development training for children including infants and program learners, or for program developers to develop new programs.

In recent years, artificial intelligence (AI) and the Internet of Things (IoT), which connects the Internet to all things, are expected to advance and develop more and more, and ICTs such as computer systems and communication systems are used in daily life, It has become an indispensable tool for assisting and supporting human behavior and thinking in all situations, such as business and academic studies.
ICT can be broadly divided into hardware and software. Thought and recognition for building software, especially application software, have become indispensable for living in the ICT society. Governments and educational institutions are also moving toward learning.

By the way, if the computer software is learned from the basics with appropriate teaching materials, it is possible for elementary school students and preschoolers to understand and form programs.
Furthermore, program learning leads to organizing and understanding human behavior and thinking, and is considered to be useful for general learning and business, and also for new development of programs.

JP 2018-077342 JP

  However, the conventional programming learning is performed on a computer display as shown in Patent Literature 1, so that the basic ability to use a computer is required, and after all, a display is a virtual virtual machine. Because it is learning, it is difficult to develop the ability to apply programming thinking in everyday life. Therefore, for example, in order for children under 4 to 5 years old to learn programming thinking or hierarchical logical thinking, unfortunately, the conventional one must be said to be extremely unsatisfactory. .

  Note that a “program” is descriptive data that can be interpreted by a computer and operated by processing (instructions). Here, however, the combination of parts of the present invention itself is also regarded as a program, and may be simply referred to as a “program”. .

A program consists of a combination of simple structures, even if it is complex. The more complex a program is, the simpler and the visual it becomes, the more it is possible to perform structured programming, as shown in the NS chart, and it is easy to understand logically and intuitively.
Structured programming flowcharts (flow diagrams) are based on the sequential (sequential / concatenated), selection (case / condition decision / if statement), and repetition (repetition / loop / for statement) processes. Can be represented by replacement or reversal of values, determination by value, cooperation or connection, or the like.
Structured programming is also suitable for sharing large programs and learning the basics of programs. Object-oriented programming, which is the mainstream of programming today, is also structured programming.

  From the ground up, learners of programming want an easy-to-understand one-size-fits-all program and the kind of program that will make it the program they want. What you can see (visually), pick up (tactilely), and assemble (act) by hand (sensory and intuitive) is suitable for learning of program beginners. However, it is a fact that such a thing is not found conventionally.

In order to solve the above-described problem, parts of the programming support tool are a plurality of parts in which letters, numbers, symbols, marks, and the like (hereinafter, referred to as “characters, etc.”) are described or can be described, The combination or arrangement (hereinafter referred to as “layout”) allows the user to visually or tactilely assemble the program.
Therefore, when the shapes of characters and the like and parts have different shapes, if the shapes and layout structures can be understood, the configuration, flow, and processing of the program can be easily understood and recognized easily and quickly.

The programming support tool is a program creation part for creating a program, and includes a processing part in which processing contents are described or can be described (hereinafter simply referred to as “description”), a case part in which a case is described, and a case in which the case is described. Parts that are distinguished and displayed so that they are related to, parts that describe the contents of individual elements (options) corresponding to the case, and repetitive parts that indicate that processing and cases are to be repeated. It has multiple accessory parts that add various meanings.
The individual elements refer to individual options, processes, cases, determinations, and the like, and the individual element parts refer to processing parts, option parts, case parts, determination parts, and the like. Individual elements also correspond to program elements.
The program element is an element for describing an instruction (process) to the computer, that is, an instruction / command word used in the program or data used in the program.

Parts are parts that make up a programming support tool.Each part is the size and weight of a range that can be moved with one hand and can be actually held by hand, such as a display connected to a computer It is not a part that is a display element that has appeared on the display screen.
The size and weight of the area that can be moved with one hand are approximately 1 square centimeter or more and 1000 square centimeters or less in plane size (the size of the placed part when viewed from above) and 2 kg or less in weight. Larger ones are assumed to be used by instructors or the like when learning the program and shown to students.
The size used by the program learner is approximately 1 square centimeter to 100 square centimeters in plane size (the size of the placed part viewed from above), and weighs 300 g or less.

The processing parts indicate the contents of the sequential processing (sequential processing, connection processing).
The case parts are accompanied by individual element parts and indicate the processing contents of those individual element parts.
The processing contents are simply grouping individual element parts to be the title, those that indicate selection processing with options, those that indicate judgment processing with individual element parts that describe the judgment contents, and those that prompt numerical input. There are those indicating that individual element parts are to be processed by numerical values input on the display.
The judgment parts are accompanied by Y judgment parts, N judgment parts, and the like, and prompt the judgment.

The repeat part indicates the range of the repeat and the process of the repeat.
Attached parts are attached to processing parts, case parts, and repeated parts, and work together with them to add specific elements to the processing contents.

The connection part indicates that a program line which is a processing flow is related. The relationship may mean only a “connection”, a special connection such as a wireless connection, a bidirectional connection, a connection different from the usual one-to-one connection, a one-to-two connection, or a cross-connection. It may have various meanings such as a connection to be made.
Note that the connection process is a type of sequential process.

"Description" will be described in detail. The “description” may be any means such as printing, painting, engraving, pasting printed matter, laser marking, handwriting, and displaying by an electromagnetic method. If it is a display by handwriting or an electromagnetic method, what is described can be changed as appropriate.
`` Notation '' includes not only those already described, but also those written with writing implements on parts that can be written with writing implements, other things written on magnets, adhesive sheets, thin liquid crystal sheets, paper, etc. This includes the case of pasting what is described.
It should be noted that “description” may be a color or a pattern (pattern) in addition to characters and the like, but characters and numerals are easy to understand and recognize.
Also, some of the examples use hiragana for the words they express, but this is because they were conscious of infants and elementary school children, and depending on the user, even kanji mixed letters, alphabets, symbols, pictograms, etc. Good.
Braille can also be used by visually impaired people.

In addition, instead of printing or coloring the pattern, it is also possible to express the difference by unevenness or texture of the material or surface, in which case it can be understood by fumbling, so that visually impaired people can use it .
Also, by creating a cavity in the part and putting various things such as bells, sand, wood pieces, resin pieces, metal pieces for each type of part, you can make a difference in the sound that sounds when you lift and shake the part, the sound of the part You can know the type. This makes it easier for visually impaired people to understand, and for infants to be more interested.

The basic part shape is preferably a horizontally long rectangle so that a short sentence of about 10 characters can be described, and the layout is easy to see, understand and understand, and to simplify the parts. . Also, the vertical length of the part (corresponds to the so-called “width”. The vertical direction (vertical direction) length of the part in a plan view when the part is placed on a plane and viewed vertically from above: It is preferable that the minimum is one unit and the unit is a unit of a basic integer unit, and the vertical lengths of a plurality of individual element parts are also united in an integer unit.
Furthermore, the length in the horizontal direction is the same, and the length of the processing parts and the case parts, as well as the length of other parts, are unified in integer units, which is close to the image of the program, and It is preferable from the viewpoint of easiness.

This makes it easier to assemble and lay out each part, and to read the program by image recognition.
The parts may be planar ones such as a card type. In that case, characters and the like can be described on the two sides of the front and back.
If the part is a regular square prism having a length of at least three times (3 units) the side (vertical length: 1 unit) constituting the square of the cube, characters and the like are formed on the four sides of the rectangle. Can be described. This allows various types of characters and the like to be described with a small number of parts.

  It is preferable that at least one of the descriptions of the parts, when placed on a plane, appears on a plane parallel to the placed plane. This is for the purpose of making it easier to see the entire laid-out parts without moving the viewpoint, and to make it easier to perform shooting for conversion into an executable program.

Processing refers to the execution of the instructions of the computer that constitutes the program or its contents, such as those that indicate the start or end of the program, those that represent the processing contents of the program, those that represent events during the execution of the program, and those that indicate the processing status. is there.
A case represents a particular process or state, with an individual element of choice. Some cases are combined only with individual elements dedicated to the case, and other cases are combined with various individual elements. In order to easily distinguish the case from other processes, it is preferable that expressions different from each other be visually expressed by, for example, the color of a character or the like or the color or pattern of a surface on which a character or the like is described. In addition, it is preferable that a different expression is given tactilely for a visually impaired person or the like.
Some cases are individual elements that are associated only with the case, but in this case, it is better to use the same finish and mark for both the case and the individual element so that it is easy to understand that they are combined with each other .
The case part is a long "-" key, and the length of the other part in the vertical direction in plan view is 1 unit, and the vertical length on the left side is 2 units. This makes it easier to understand the distinction between processing parts and how to use case parts.

Multiple parts with different contents are lined vertically from top to bottom, and individual element parts with the same ground pattern or attached parts come under the case parts with the ground pattern etc. It is arranged according to the rule. That is, a simple program configuration is made by layout.
The layout of the processing parts, the case parts, and the individual element parts cannot be executed on a computer as it is, but a substantial program can be created on the layout.
In order to process and execute the resulting program in some form, it is necessary to encode the program so that it can be handled digitally, or in the case of a compiler language, to convert it into an executable program form.

The description of the laid-out processing parts, case parts, option parts, characters of repeated parts, etc. is input as an image and is recognized by OCR, etc., or a one-dimensional code or two-dimensional code containing text data information in advance Or, it is converted into character code data by a three-dimensional code or an IC tag. Further, the character code data is compiled as a block, analyzed based on data in a database or the like, and becomes data of a program element.
For example, “Yugi” is recognized as “case data specifying“ Yugi ”” of stored data.
In addition, a special meaning is added to the symbols and marks, and the setting is made so that the meaning is directly recognized without going through the character code recognition step or the image recognition step using the QR code (registered trademark) or the like. It may be.
The database is a collection of organized information stored in advance in a storage device or the like.

Processed parts laid out, case parts, option parts, characters of repeated parts, ground patterns, part shapes, and part layouts themselves are read as images and analyzed based on data in the database, and instructions are issued. It is recognized as meaningful program element data such as words.
For example, if the character is shifted downward by one unit in the layout, it indicates the next processing stage, or if the shape of the part is "", it is a case part, or a space after a block of characters (lump) If there is a number and there is a number, it indicates "number of times" and so on, and it is recognized as such.

  The program generation unit generates a program based on the analyzed program element data such as characters and the layout program element data by referring to a basic program stored in a database.

It should be noted that a single program element is merely an instruction command and cannot be called a program. A plurality of program elements enable programming. In other words, creating a program requires at least two program elements.
A layout consists of multiple elements. Therefore, the program is established by laying out the program elements.
The description of characters and the like and the parts with only the ground pattern are also program elements, but there is only one program element.
Even if there is only one part, a program is formed by two program elements of description of characters and the like and finishing such as a ground pattern.
It can be said that a layout using parts having two program elements has three program elements by adding a layout program element to the two program elements.

  The data may be stored in a storage device (memory) in the program execution terminal, in a data folder in the execution terminal, or in a server connected to a network such as the Internet or an intranet.

The method of reading the code data from the description of characters etc. and the program configuration data from the shape of the parts and the arrangement of the combined parts is to use the OCR function etc. to image the images taken by the digital camera or smartphone imaging device Recognition or conversion to a character code that is a program element.
The layout of each part is converted and recognized in the same manner, assuming that it is a text layout such as a line feed. The ground pattern and color are also converted into ground pattern codes and color codes, which are program elements, by collating with data stored in the database.
It should be noted that the execution terminal does not have a shooting function, and data shot by another device may be executed by the program execution terminal.
The OCR is an abbreviation of Optical Character Reader, which is an optical character recognition device that converts image data such as handwritten or printed characters into digital character codes that can be used by a computer or the like.

For OCR, one based on image recognition using Watson (registered trademark), one based on image recognition using a flat scanner, one that combines an IC tag such as NFC with a reading device that can read a position and a flat surface, and an IC tag distance sensor And so on.
Watson is WatsonVisualRecognition, an image recognition function developed by IBM (registered trademark), and a system provided with services through the Internet.

If you use a two-dimensional code such as a one-dimensional code or QR code (registered trademark) or a three-dimensional code at the same time as text, or use an IC tag, you can use a reading application such as a smartphone without using the OCR function. You can use it to get the character code.
The QR code (registered trademark) is a matrix type two-dimensional code, and a large amount of code data can be described on a plane in a single color and in a small area.

In addition, there are an electromagnetic method using an IC chip such as NFC, a method disclosed in Patent Document 3, and the like. However, image recognition by OCR is considered to be simpler and advantageous in cost.
NFC is near-field wireless communication (Nearfieldradiocommunication), and the communication area is from several centimeters to about one meter, and is also called non-contact communication.
When using NFC, install the NFC IC chip on the parts side, place multiple NFC compatible readers on the table where the parts are assembled, set the communication distance to several cm, and set the type of the assembled parts and the contents described By reading the layout.

  There is also a method of calculating the position of a part by triangulation using the distance measuring sensor described in Patent Document 4, but it is difficult to read characters and the like, and the platform for mounting the sensor is costly and unreasonable.

If the created program is of a level that can be executed as it is, the program is executed by launching the application and pressing the execution key, and the state thereof can be seen. If this is not the case, the shortage will be supplemented or added or corrected while comparing it with the stored basic program in the database, or errors such as run-time errors, logical errors, volume errors, etc., and correction instructions will be issued. It is.
The program execution device reads display data and control data from the execution data, and executes the program.

The completed program, error display, correction instruction, and the like are displayed on the display of the terminal by executing the program.
By seeing what the program has done on the display, for example, a day at a kindergarten with an anime character, the user's interest and interest in the program will increase and the willingness to learn the program will increase.
If the program uses case parts and a selection button or the like appears on the way, the understanding of the relationship between the layout of the parts and the selection of the program will be deepened, and the student will be more interested in learning the program.
The execution process may be executed and displayed as an image on a display, or may be executed by a production tool such as a robot or a car toy.

  By making it possible to additionally register new characters and the like in the stored data, the number of recognizable characters and the like can be increased. In addition, by additionally setting and registering layout data, a new layout can be recognized, and the ability to generate a program can be expanded.

In addition, the present invention provides a program generated by a terminal, the contents of program learning such as descriptions of additionally registered characters, layout settings, a program generation history, and the state of occurrence of an error. It is a system that can be sent to a program education server using a communication line such as.
In addition, the program education server uses the speed required for programming, the learning speed, the type of learning program, the points of mistakes, their contents and history, additionally registered characters, layout settings, the number of redoes, etc. Calculate learning progress, and if requested, program learning support information stored according to the learning progress status of each terminal, program learning support know-how, description contents of newly added characters, layout setting information, etc. To each terminal.
Also, the program education server sends information for each group, class, and school by registering the group, class, school, etc. to learn, and accumulates information for each region and prefecture. Used for dissemination, improvement and development.

The present invention also provides a method for recognizing code data such as read characters and layout data from a description of characters and the layout of a plurality of descriptions, and a method of recognizing program elements and program configuration data from recognized data and stored data. And a program generation unit for generating a program from the analyzed data.
Generating a program from the analyzed data is similar to generating a program by reading code data and program configuration data from the description and arrangement of characters such as laid out processing parts, case parts, option parts, and repeated parts. is there.

The present invention also provides a method for recognizing code data such as read characters and layout data from a description of characters and the layout of a plurality of descriptions, and a method of recognizing program elements and program configuration data from recognized data and stored data. A method for generating a program, comprising: analysis means for analyzing the data; and a program generation unit for generating a program from the analyzed data.
Generating a program from the analyzed data is similar to the method of generating a program by reading code data and program configuration data from the description and arrangement of characters such as laid out processing parts, case parts, option parts, repeated parts, etc. is there.

The present invention is a program learning tool, but does not require an electronic device such as a computer or a tablet if only a program is constructed. In addition, by simply arranging parts according to rules without using notebooks and writing instruments, or writing words that are program elements on paper, it is possible to move the character on the display or actually pick it up with a very simple work You can build a program that can move things.
In addition, since the program can be immediately executed using a nearby tool such as a smartphone, it is very effective for learning the concept, basic configuration, and functions of the program.
In particular, for infants and elementary school students in the lower grades who do not have the ability to understand and recognize things, learning using intuitive things such as arranging parts that can be seen and touched with hands is easy. This is an effective program learning tool.

FIG. 3 is a diagram showing a layout of a sequential program using the processing parts of the present invention. FIG. 7 is a diagram showing case parts and examples of use thereof, wherein A is a layout diagram of a program, and B is a diagram showing a surplus part group. It is a figure which shows a case part and other usage examples. FIG. 7A is a layout diagram of a program in which one Yuki case part is added to all the parts of the second embodiment shown in FIG. 2, and B is an explanatory diagram of option parts. It is explanatory drawing of a repeatedly attached part. It is a perspective view of the processing part of a square prism. It is a figure of the case parts which described the case content and the number of repetitions. It is a use explanatory drawing of combination of the repeatedly attached parts. It is a figure which shows the example of use of another case part and the repeatedly attached part. It is a figure which shows the example of use of another case part and the repeatedly attached part. It is explanatory drawing of another case attachment part and a repetition attachment part. It is an explanatory view about repetition and the end. It is explanatory drawing of a connection part and its usage. It is explanatory drawing of other usage of a case part. FIG. 9 is a diagram illustrating an example of how to use parts when a plurality of program flows simultaneously proceed. FIG. 9 is a diagram illustrating an example of how to use a connection part and other parts when a plurality of program flows simultaneously proceed. It is a figure showing various connection parts. It is a use explanatory view of a cooperation part. It is another use explanatory drawing of a cooperation part. It is a figure showing the example of use of the case when there are three options. It is a figure which shows the example of use of the case where there are three options, and the case where an accessory part is missing. It is a figure showing the example of use when there is another case in a case. FIG. 11 is an explanatory diagram in a case where there is a further case in the case and there is a chip in an attached part. FIG. 11 is an explanatory diagram in a case where there is a further case in the case and other accessory parts are missing. FIG. 11 is an explanatory diagram in a case where there is a further case in the case and other accessory parts are missing. A usage example where option parts and processing parts are put in a case. 7A is a diagram illustrating an example using accessory parts without parameters, and FIG. 9B is a diagram illustrating an example using Y-determination accessory parts and N-determination accessory parts. Another use case where option parts and processing parts are put in a case. A is an example where two parts, one option part and one processing part, are laid out in the case part option, and B is an example using E judgment accessory parts in addition to Y judgment attachment parts and N judgment attachment parts. FIG. FIG. 7B is a diagram illustrating an example in which an E-determination accessory part is used in addition to the Y-determination accessory part and the N-determination accessory part. FIG. Explanatory drawing of use of repeated parts. A is a diagram when there is one repeated processing part, and B is a diagram when there are two repeated processing parts. It is a figure showing the example of use of the double repeated part. It is a figure which shows the other usage example of the double repeated part. It is explanatory drawing of a judgment part and a judgment layout. It is a figure showing the place where a combination of parts is imaged. 9 is a table showing captured image data and conversion to recognized data. It is a basic block diagram of the system of this application. It is a block diagram of the program execution terminal with a photography function. It is a figure showing a display of a program execution terminal which is executing a program. FIG. 2 is a system diagram showing a device that executes a program and a server that cooperates using a communication line. It is a figure showing an example using a cooperation part. It is a figure of the individual element part which has the hole which attaches a cooperation part. FIG. 14 is a diagram showing another embodiment using the cooperation parts. It is an example of a layout of a programming support tool of the present application that moves a robot. It is a layout example of the programming support tool of the present application used for business purposes. It is explanatory drawing of this invention used for the black toothpick. FIG. 6A is a diagram showing a character or the like written and output in a laid-out frame, and FIG. 6B is a diagram showing a character or the like printed in a laid-out frame. FIG. 14 is a diagram illustrating a programming learning task according to another embodiment. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the parts of the programming support tool used in the same task. It is a figure showing the example of a solution of the same task. FIG. 11 is a diagram illustrating a connection structure of parts according to another embodiment.

Hereinafter, some of the embodiments of the present invention will be described in detail.
The invention of the present application is considered to be installed and used in a kindergarten, a nursery school, or a place for childcare of schoolchildren in lower grades of elementary school, as a set of a block-shaped part and a smartphone application as in the embodiment.
In addition, by combining a large number of parts, a more complicated program can be formed, and even elementary and junior high school students can use it as effective program learning.

Furthermore, those who are working on program creation can also use the programming support tool of the present invention to organize ideas and generate new ideas.
Also, by preparing processing parts, case parts, individual element parts, etc. worth considering beforehand, new programs can be created efficiently without omission, which is useful for program development such as business solutions. .

FIG. 1 shows a first embodiment of the present invention, in which processing parts 1 are arranged in order from the top, and represent a sequential processing program.
The processing part 1 is not a card type but a three-dimensional block of a square prism. Assuming that the block has one unit in the vertical direction, the length in the horizontal direction is five units.
The programs are set to be executed in order from the top.
With the above, the creation of the program is finished, but if you know how it actually works, your motivation to learn will increase. Therefore, a program created as an animation or the like is executed on the display.

The program shown by the layout of these parts is
"Go to Yochien" → Do "Taiso" → Do "Yugi" → Eat "Kyushu" → Do "Ohine" → "Return to home"
On the program execution terminal with the shooting function, the kindergarten child's anime character goes to kindergarten, does gymnastics, plays, eats lunch, takes a nap, and returns home Become.
In addition, since these parts are intended for kindergarten children, the program execution terminal is set so that the animation character of the kindergarten child moves, but the settings such as the scene and the animation character change depending on the user setting Good to do.

Example 2 shown in FIG. 2A is one in which the Yuugi case parts 2-c are incorporated in the layout of the program. The case finish 2-3 of the Yugi case part 2-c has a diagonal pattern on the ground. In addition, finishing refers to finishing of the surface of a part, and there are various finishings such as painting, printing, machining, and laser processing as it is.
The optional parts 3-a and 3-b are the optional parts 3 with optional finishing 3-1. The optional finishing 3-1 on the left side is the same place as the Yuugi case part 2-c. Pattern is given. The ground pattern may be a single-color pattern image, a ground color without a pattern, or an image such as a photograph.

The program shown by the layout of these parts is
"Go to Yochien" → Play "Taiso" → Play either "Hanachimonme" or "Toripanse" → Eat "Kyushuku" → Play "Ohine" → " Change back to home "
It is the contents of.

FIG. 2B shows the remaining parts when laying out the second embodiment.
Since the story case part 2-f has a case finish 2-3 different from that of the Yugi case part 2-c, it is easy to see which option parts 3 each case part 2 can take. The case part finishing 2-3 may be unified as representing the case part 2 and the option part 3.

The third embodiment shown in FIG. 3 means exactly the same program as the second embodiment.
The optional part 3-a differs from that of the second embodiment in that there is no option finishing part 3-1. Therefore, it functions as an option part with the optional accessory part 4-2 without parameters.
As for the alternative part 3-b, the alternative part 3-b does not have the part for finishing the option 3-1. However, by laying it out to the right of the optional part 3-a, the alternative is similar to the optional part 3-a. This indicates that it is part 3.
With this layout, the entire layout of the parts can be shortened, and a program having two options can be assembled with four attached parts. The option parts 3 can be further laid out on the right with three or four parts, but the entire layout becomes horizontally long.

Since the width of the Hanachimonme option part 3-a is 4 units and the width of the repeatedly attached part is 1 unit, the width of the processing unit 1 is 5 units.
The lateral length of the option finish 3-1 part is 1, and the shape of the option finish 3-1 part is a cube.
It is preferable that the ground patterns are also present on the left end surfaces of the case parts 2 and the option parts 3 because the ground patterns are uniform when the combination of the laid out parts is viewed from the left side.
Note that the width of the processing part 1 and the like is not limited to 5 units, but may be any size as long as 1-2 such as characters can be easily described and parts can be easily handled. The width of the processing part 1 having such a size that characters 1-2 can be easily described and the parts are easy to handle is approximately 4 to 10 units.

Embodiment 4 shown in FIG. 4 is a layout diagram of the embodiment in which all the parts corresponding to FIG. B of Embodiment 2 are used, and one case part 2 is added.
In the case of the Yugi case part 2-c, the option part 3 with the option part ground pattern 3-1 or the option part 3 with the attached part 4 is laid out below, but the same as the case finish 2-3 at that time The ground pattern is lined up in "" shape. The number of option parts 3 can be selected as long as it is two or more. There is no upper limit on the number, but around three are often used. When there is only one option part 3, the selection process is directly executed.
The story case part 2-f has a case mark 2-4 of a line indicating that it is the case part 2 instead of the ground pattern on the left side. Under the story case part 2-f, the option part 3 is laid out along with the accessory part 4 in which the case mark 2-4 is described.
The program shown by the layout of these parts is
"Go to Yochien" → Play "Taiso" → Play one of "Hanachimonme", "Toripanse" or "Chanbara" → Eat "Kyushuku" → "Ohiru""Play" → Play "Everywhere you go" or "Kagome Kagome" → Play "Play and play" → Play "Ekaki""Ehon" or "Kamishibai" Listening to → "Go home"
It is the contents of.
FIG. 4B shows the option part 3 and the option accessory part 4-1.

Example 5 shown in FIG. 5 is a repetitive accessory part 4-7 with a repetition count 4-72 on the right of the Yugi case part 2c in the program layout, and the repetition value is “2”. So, the program that the layout of these parts shows
"Go to Yochien" → Play "Taiso" → Repeat "Hanachimonme" game twice → Eat "Kyushuku" → Play "Ohirune" → "Go home" Is shown.
In the parts shown here, the processing part 1 and the case part 2 are regular quadrangular prisms, and there are four different descriptions on four sides of the rectangle. The attached part 4 is a cube. The repetitive accessory part 4-7 is a cube, and the repetition count 4-72 is described, and the numerical value of “1, 2, 3, 4, 5, 6” is described on each of the six surfaces.
A magnet is embedded in the accessory part 4-7 repeatedly, so that it sticks to the iron case part 2-c containing iron, or a hook-and-loop fastener or irregularities. You may make it a set.

  FIG. 6 is a perspective view of the processing part 1-a that goes to the front of the processing part 1-a. 1m describes "Yochikakara", but there is no description on the processing part side surface 1-1s which is a square on the left and right end faces of the square pole.

  FIG. 7 shows the Yugi case part 2-c, in which the number of repetitions “2” is also described. This is case part 2 which also has the meaning of repetition, which means two repetitions without the repetitive accessory part 4-7, but the use is limited because it is limited to two times. By making the description of the variables handwritten or rewritable, the number of repetitions can be changed, and the usability is improved.

  Example 6 shown in FIG. 8 uses two repetitive attached parts 4-7 and shows a repetition of two digits or more. In this program, "Yuugi" "Hanachichimonme" is repeated 10 times. The contents of

FIG. 9 shows a seventh embodiment.
The case part 2 has a case mark 2-4 different from that of the fourth embodiment at the upper left thereof. As a result, this part is known to be the case part 2, and when photographed by the program execution terminal 10 having a photographing function, it is recognized as the Yuugi case part 2-c in combination with the description "Yugi".
Attached part 4 laid out on the left of Hanachimonme option part 3-a and street selection option part 3-b is marked with case mark 2-4, indicating that it is an optional accessory part 4, and has a shooting function. When photographed by the attached program execution terminal 10, it is recognized as the optional accessory part 4-2.

To the right of the Yuugi case part 2-c, instead of the repeated finish 4-73 indicating that it is a repeated accessory part 4-7, a repeated accessory part 4-7 with a repeated accessory part symbol 4-70 is provided. It is laid out.
The lateral width of the Yugi case part 2-c is short, which is four units instead of five units in the sixth embodiment. The appearance of the attached parts 4-7 is neat because they fit neatly into the rectangle where the parts are laid out.
The program shown by the layout of these parts is
"Go to Yochien" → Play "Taiso" → Play either "Hanachimonme" or "Toripanse", repeat this twice → Eat "Kyushuku" → "Ohiru""Nee" → "Go home"
It is the contents of.

FIG. 10 shows an eighth embodiment.
The Yugi case part 2-c is a key type ““ ”that is long horizontally and the size is 1 unit in the vertical width of the left and right long part, and 4 units in the horizontal width. The width is 2 units and the width is 1 unit. With this form, it is recalled that the Yugi case part 2-c is accompanied by at least one option part 3, which contributes to understanding and learning of the program.

  FIG. 10A shows a layout in which the repetitive accessory part 4-7 without the repetition mark 4-71 is laid out on the right of the case part 2-c, but may be repetitive due to repetitive finishing (ground pattern). Understand. Since the repetition in this case is not the number of times, a rule such as “repeated many times until lunch” or a rule of “repeated any number of times” can be set.

FIG. 10B shows a layout in which the number of repetitions 4-72 of the recurring accessory part 4-7 is laid out on the right of the Yugi case part 2-c, and the repetition is two.
The program represented by the layout of these parts is exactly the same as that of the seventh embodiment in FIG.
"Go to Yochien" → Play "Taiso" → Play either "Hanachimonme" or "Toripanse", repeat this twice → Eat "Kyushuku" → "Ohiru""Nee" → "Go home"
It is the contents of.

Example 9 shown in FIG. 11 shows a combination of programs using a repetitive accessory part 4-7 with a repetition mark 4-71.
On the left side of the Yugi processing part 1-c, there is a case attachment part 4-6, which has the same meaning as the Yugi case part 2-c.
"Hanachimonme" and "Yoriponse" have the same width as the other processing parts, with a width of 5 units. Part 3-a has the same meaning as the optional part 3-b.
A repetitive accessory part 4-7 with a repetition mark 4-71 described thereon is laid out on the right side of the Yugi processing part 1-c.
The program indicated by the layout of these parts is different from that of the seventh embodiment.
“Go to Yochien” → Do “Taiso” → Play either “Hanachimonme” or “Yori”, repeat this until it is time for lunch → When it is time for lunch Eat “Kyusoku” → Play “Ohirune” → “Go home”
It is the contents of.

The shape and finish of the case-attached parts 4-6 may be round, cross, star, or random as long as they can be read by the program execution terminal 10 with a photographing function. A square shape is preferred. If it is square, it can be easily attached to other parts using magnets or hook-and-loop fasteners.
The merit of forming various shapes such as a circle, a cross, and a star is that it is easy to distinguish from other parts and visually recognize it.

  In the tenth embodiment shown in FIG. 12, the processing part 1-d is laid out further to the right of the repeated attachment part 4-7 laid out to the right of the Yugi case part 2-c. The layout of the processing parts 1-d in this place is to more clearly or emphasize the processing of "repeat the game until lunch", and the program indicated by this layout is the same as that of the ninth embodiment. .

  In the eleventh embodiment shown in FIG. 13, the layout of the tenth embodiment is such that the attached part 4-7 is repeatedly provided on the right of the oyster case part 2-c, the right connecting part 6-1R is continued to the right thereof, and further the right. The processing part 1-d is laid out, and the processing part 1-e and the processing part 1-g which are changed to a house are laid out under the processing part 1-d. However, the program shows that the flow after lunch is different from the flow before lunch.

The twelfth embodiment shown in FIG. 14 is a layout in which the Yuugi case part 2-c and the repetitive accessory part 4-7 are laid out below the Hanachimonme option part 3-a, the street selection option 3-b. The contents executed by the program are the same as those in the tenth embodiment.
“Go to Yochien” → Do “Taiso” → Play either “Hanachimonme” or “Yori”, repeat this until it is time for lunch → When it is time for lunch Eat “Kyusoku” → Play “Ohirune” → “Go home”
It is the contents of.

  In the present embodiment, it is assumed that "the game is repeated until lunch" in advance, and in the eleventh embodiment, the start of the repetition is set to "lunch", such as "finish the repetition of the game and start lunch". It is possible to create more advanced programs by deciding whether or not to play games.

Example 13 shown in FIG. 15 shows a method of creating a program in the case of a multitask in which the program flow is on the left side in parallel with the program flow on the right side.
There are two types of games: "Hanachimonme" and "Yori-Ponse", but in the case of kindergarten children, the teacher to be instructed is determined. "Teacher".
The program shown by the layout of this part is
“Go to Yochien” → Do “Taiso” → ２ Play “Hanachimonme” as “Yuri-sensei” or “Tori-pense” as “Mitsuami-sensei” twice. Yes or When the teacher says it's over → Eat “Kyushu” → Do “Ohirune” → “Go home”
It is the contents of.

  As a more advanced use method, a client system program is laid out in the left column, and a server system program is laid out in the right column, and is used for understanding, studying, and creating a complicated program involving communication.

  The fourteenth embodiment shown in FIG. 16 is a combination of the thirteenth embodiment in which the leftward connection part 6-1L is added to the right of the habitat choice part 3-a and the street selection part 3-b. As compared with Example 12, it is clearly shown that the game starts after the teacher goes to the classroom from the staff room.

  FIG. 17 shows various connection parts, where A is a left connection part, B is a right connection part, C is a two-way connection part, D is the width of C in two units, E is the vertical length of C in two units, F is the connecting part with the same outer shape and different level as E, G is the connecting part with the same outer shape and diagonal uneven level and the connecting part of F means H denotes a connection part of a cloth having the same outer shape as E and in which processing is sequentially reversed, and I denotes a connection part connecting two processing parts or individual element parts to one part.

These connection parts 6 are used to indicate communication and cooperation between the client system program in the left column and the server system program in the right column.
Various additions and changes may be made to the shape and description depending on the application.
Note that A can also be B by placing the left and right sides upside down. Also, by describing the bidirectional arrow described on the connecting part 6 of C on the opposite surface of the connecting part 6 of A on which the arrow is described, one connecting part 6 can be used in any number of ways. it can. Similarly, since DEFGHI has the same outer shape, it is possible to provide a variety of connection functions with a small number of parts by giving different descriptions to different surfaces.

Example 15 shown in FIG. 18 shows a layout of a program using the cooperation parts 7.
This indicates that the cooperating part 7-A attached to the right of the optional part 3-a and the associated part 7-A attached to the left of the accompaniment 3-a2 are associated with each other. This indicates that the cooperation part 7-B attached to the right of the option part 3-b and the cooperation part 7-B arriving to the left of the street accompaniment part 3-b2 are linked.
In contrast to A's main program, B and C are sub-programs. In the play of Hanachimonme, the accompaniment of Hanachimonme is shown. ing.
The program shown by the layout of this part is
"Go to Yochien" → Play "Taiso" → Play either "Hanachimonme" or "Toripanse" → When playing "Hanachimonme" Is played as "Hanachimonme's accompaniment" / When playing "Street Pose", "Street Pose accompaniment" is played out → Eat "Kyushoku" → Play "Yuugi" → " Change back to home "
It is the contents of.

  The layout of the sixteenth embodiment shown in FIG. 19 is the same as that of the fifteenth embodiment except that the cooperating part 7-A is located on the right of the Hana-chimome choice part 3-a and the co-operating part 7 is also on the left of the Hachi-chimo accompaniment 3a2. -A is laid out, indicating that the optional part 3-a and the accompaniment part 3-a2 are cooperated, and the processing part 1- f indicates the point at which the scene up to the scene in which the bride of the prince is obtained is executed. In addition, a coordination part 7-B is laid out on the right of the street selection part 3-b, and a cooperation part 7-B is laid out on the left side of the street accompaniment part 3-b2. This indicates that b2 is linked, and a linked part 7-C is laid out on the right of the street accompaniment part 3-b2, and a linked part 7-C is also laid out on the left of the brim case part 2-d. -b2 and the case part 2-d are linked. In the execution of the game, the punishment imposed on the person caught in the street is selected and executed.

The program shown by the layout of this part is
"Go to Yochien" → "Taiso" → "Hanachimonme" when "Hanachimonme accompaniment" is played, and then the nominated person is "received" / When performing a "street dance", a "street dance accompaniment" is played. → Those who are caught in a street dance receive a "bomb" and choose whether to "onion" or "leave" → eat "kyushu" → " Play "Yugi" → "Change to the house"
It is the contents of.

In the seventeenth embodiment shown in FIG. 20, option parts 3-h / 3-i / 3-k are laid out on a snack case part 2-a. On the left of the option part 3, an optional accessory part 4-2 without parameters is laid out.
The program shown by the layout of these parts is
"Go to Yochien" → Play "Taisou" → Eat one of the "Mikan", "Strawberry cake" or "Cookie" → Play "Oyugi" → Eat "Kyushu" → Play "Ohine" → "Return to home"
It is the contents of.

Example 18 in FIG. 21 is a layout in which the parameterless selection accessory part 4-2 attached to the left of the orange option part 3-h and the cookie option part 3-k is removed from the example 17.
The program shown by the layout of these parts is
"Go to Yochien" → Do "Taiso" → There are two types of snacks: "Mikan", "Strawberry cake" and "Cookie", but only "Strawberry cake" can be eaten now, so eat "Strawberry cake" → Play “Oyugi” → Eat “Kyushu” → Play “Ohirune” → “Go home”
It is the contents of.

Example 19 in FIG. 22 shows that the cake of choice from Example 17 further includes an option of “strawberry cake” and an option of “cheese cake”. The nested program layout is such that the cake case part 2-b is contained in the snack case part 2-a.
The program shown by the layout of these parts is
"Go to Yochien"->"Taiso"-> There are "Mikan", "Cake" and "Cookie" as snack types, and there are "Strawberry cake" and "Cheese cake". Eat one of them → Play "Oyugi" → Eat "Kyushu" → Play "Ohirune" → "Change home"
It is the contents of.

The embodiment 20 in FIG. 23 is different from the embodiment 19 in that the strawberry cake option part 3-i of the cake case part 2-b, which is also an option of the snack case part 2-a, is laid out to the left of the parameterless selection accessory part 4-i. 2 is removed.
The program shown by the layout of these parts is
“Go to Yochien” → Do “Taiso” → Types of snacks are “Mikan”, “Cake” and “Cookie”, and cakes include “Strawberry cake” and “Cheese cake”, but you can eat them now The cake is a cheesecake, eat any one of them → play “Oyugi” → eat “Kyushu” → play “Ohirune” → “Change home”
Means
In addition, what kind of program is formed by the part layout depends on the setting contents of the program for creating the program.

The embodiment 21 of FIG. 24 is different from the embodiment 19 in that the parameters relating to the snack case part 2-a are laid out to the left of the option part 3 of the cake case part 2-b which is also an option of the snack case part 2-a. It has a layout that removes the optional accessory 4-2.
The program shown by the layout of these parts is
“Go to Yochien” → “Taiso” → Types of snacks are “Mikan”, “Cake” and “Cookie”. If “Cake” is selected, “Strawberry cake” and “Cheese cake” Appears as an option and eats one of “strawberry cake” or “cheese cake” → plays “Oyugi” → eats “Kyusoku” → plays “Ohine” → “Changes to home” "
It is the contents of.

The embodiment 22 of FIG. 25 is different from the embodiment 19 in that the parameter-less selection accessory part 4-2 laid out to the left of the cake case part 2-b, which is also an option of the snack case part 2-a, and the cake case part 2 -Choice part 4-2 laid out to the left of the cheesecake option part 3-j, which is the option for -b, and the optional accessory part 4-2 for the snack case part 2-a, and Ichigo, the option for the snack case part 2-b The layout is such that the optional part 4-2 without parameters for the cake case part 2-b, which was laid out immediately to the left of the cake option part 3-i, has been removed.
The program shown by the layout of these parts is
"Go to Yochien" → Do "Taiso" → There are two types of snacks: "Mikan", "Strawberry cake" and "Cookie". If "Strawberry cake" is selected, "Strawberry cake" and "Cheese""Cake" appears as an option, but "Strawberry cake" cannot be selected, only "Cheese cake" can be selected, and if "Cake" is selected, "Cheese cake" is eaten → "Oyugi" is done → "Kyushoku" ”→“ Ohirune ”→“ Return to the house ”
It is the contents of.

In Example 23A of FIG. 26A, the awning processing part 1-e, which is the processing part 1, is laid out as an option of the young case part 2-c. Although the day processing part 1-e does not originally correspond to the option part of the oyster case part 2-c, it is established as a program.
The program shown by the layout of these parts is
“Go to Yochien” → Do “Taiso” → Eat “Kyushu” → Yuuki has “Hanachimonme” and “Ohirune” → “Hanachimonme” and “Oh Either "Hirune" → Eat "Kyushu" → "Return to the house"
It is the contents of.

The embodiment 26B of FIG. 26B is different from the embodiment 23A in that the no-parameter optional accessory part 4-2 related to the Yugi case part 2-c is replaced with a Y judgment accessory part 4-5Y meaning “Yes” and a “No”. The meaning is the N judgment attached part 4-5N, which indicates that the Yuugi case part 2-c is for the judgment of Yes or No.
The program shown by the layout of these parts is
"Go to Yochien" → Do "Taiso" → Eat "Kyushu" → If you play Yugi, play "Hanaichimonme" / If you do not play "Ohirune" Select either "Yes" or "No" → eat "kyushu" → "change home"
It is the contents of.

Example 24A in FIG. 27A lays out the play processing part 1-h and the day processing part 1-e as options for the Yugi case part 2-c.
The program shown by the layout of these parts is
“Go to Yochien” → Do “Taiso” → Yugi has “Hanaichimonme”, “Oso and Play” and “Ohirune”, and do one of them → “Kyushu” Eat → "Return to home"
It is the contents of.

The embodiment 24B of FIG. 27B is different from the case 23-A of the embodiment 23A in that the optional accessory part 4-2 without parameters is composed of the Y judgment accessory part 4-5Y, the N judgment accessory part 4-5N, and "Else". ", Which means that the Yuugi case part 2-c is for a determination of Yes, No, or any other.
The program shown by the layout of these parts is
“Go to Yochien” → Do “Taiso” → If you play Yugi, play “Hanaichimonme” / If you don't play Yugi, play “Oso and Play”. If you don't want to play "play", play "Ohine" or select "Yes", "No" or "Eles" → Eat "Kyushuku" → "Change back to home"
It is the contents of.

FIG. 28A shows the twenty-fifth embodiment of FIG. 28A in which the following items are included under the daylight processing part 1-e on the right of the judgment attachment part 4-5E relating to the Yuugi case part 2-c. Connected.
In addition, in FIG. 28B, apart from FIG. 28A, a Y judgment attached part 4-5Y and a right-hand part 3-a are laid out, and below that, “Kyushuku” and below are displayed. Are connected.
Further, in FIG. 28C, apart from FIG. 28A, a part 4-5N attached to the N judgment and a right-side option part 3-b are laid out on the right side thereof, and below it are connected with "Kyusoku". .
The program indicated by the layout of these parts is the same as that of the twenty-third embodiment, but is useful for explaining the configuration of the program or for constructing a more complicated program.
The Y judgment attachment part 4-5Y and the N judgment attachment part 4-5N also function as the connection part 6.
The program shown by the layout of these parts is
“Go to Yochien” → Do “Taiso” → If you play Yugi, play “Hanaichimonme” / If you don't play Yugi, play “Oso and Play”. If you don't want to play "play", play "Ohine" or select "Yes", "No" or "Eles" → Eat "Kyushuku" → "Change back to home"
It is the contents of.

Example 26 of FIG. 29A uses the repetitive parts 5, in which the repeat processing part 1c is sandwiched between the repetitive parts 5 and the parts in which the repetitive parts 5 are arranged upside down.
On the right side of the repetition part 5 above, a repetition accessory part 4-7 is laid out, and the repetition number 4-72 is displayed, showing two times of the repetition number.
If the ground pattern of the repeatedly attached part 4-7 is the same as the ground pattern of the repeated part 5, it is easy to understand that it is the number of repetitions.
The program shown by the layout of these parts is
"Go to Yochien" → Do "Taiso" → Repeat "Yu-gi" twice → Eat "Kyu-shoku" → Play "Yu-gi" → "Go home"
It is the contents of.
When expressing the repetition of the contents of case part 2, the case parts repetition attached part 4-7 is suitable. However, when the lump in which the processing parts 1, the case parts 2, the option parts 3, etc. are repeated is repeated, the repetition parts are used. It is easier to express with 5.

Embodiment 27 of FIG. 29B also uses the repetitive part 5, and includes the repetitive part 5 and the repetitive part 5 in which the repetitive part is arranged upside down. 1-c is sandwiched from above and below.
The program shown by the layout of these parts is
"Go to Yochien" → Repeat "Taiso" and "Oyugi" twice → Eat "Kyushuku" → Play "Yugiyu" → "Go back to home"
It is the contents of.

The embodiment 28 of FIG. 30 uses two sets of the repetition parts 5 in total, and uses two sets of the repetition parts 5 and the parts in which the repetition parts 5 are placed upside down to form the Yugi processing part 1-c. In addition, a repetitive parts set including the above-mentioned Yugi processing parts 1-c, and a repetitive parts 5 plus repetitive processing parts 1-b are added. , Sandwiched from above and below.
On the right side of the repetition part 5 above, a repetition accessory part 4-7 is laid out, and the repetition number 4-72 is displayed, showing two times of the repetition number. Also, a repeated accessory part 4-7 is laid out on the right side of the inner repeated part 5, and the number of repetitions 4-72 is displayed, indicating two times of the number of repetitions.
The program shown by the layout of these parts is
｛Do “Taiso” → Repeat “Oyugi” twice｝ Repeat this twice → Eat “Kyushuku” → Play “Oyugi” → “Change home”
It is the contents of. "Oyuugi" will be performed 5 times in total.

In Example 29 of FIG. 31, in Example 28, the processing part 1-d was placed under the part where the lower repeated part 5 was arranged upside down, but the repeated part 5 was arranged upside down. It has been moved to the right of the part.
The program shown by the layout of these parts is
｛Do “Taiso” → Repeat “Oyugi” three times｝ Repeat this until lunch time → Eat “Kyushuku” → Play “Oyugi” → “Go home”
It is the contents of.

In the embodiment 30 shown in FIG. 32, the layout is performed using the judgment parts 8.
FIG. 32A shows a judgment part 8 having a vertical width of 2 units, and a description of “Yes” is on the left side and a description of “No” on the right side. This is a process for determining what to do with the Yuugi processing part 1-c laid out above, and is programmed to follow the processing of the parts laid out below by judging "yes" and "no". You.
As shown in FIG. 32B / C, the judgment part 8 is a judgment part 8 integrally formed with the Yuugi processing part 1-c and formed as an inverted triangle, and a Y judgment part 8-Y indicating the judgment of “Yes” of a right triangle. Similarly, three N-parts 8-N indicating the determination of "No" of the right triangle may be used. In this case, the program creation becomes somewhat easier to understand.
However, in this case, a triangular part is added to the quadrangular part, so that the number of types of the parts increases, and the manufacturing cost may be increased.
Alternatively, as shown in FIG. 32D, a rectangular determination part 8-2 in which "yes" and "no" are integrated in a rectangle may be used. In this case, an increase in manufacturing cost is suppressed.
The determination process is also basically one of the selection processes.

  FIG. 33 shows an example in which a combination 9 of the arranged block parts is combined with an input device 10-1 as a camera and a program execution terminal 10 having a photographing function such as a smartphone having an OCR function (an OCR application software is installed). , Shows where you are shooting.

FIG. 34A shows the OCR function of the program execution terminal 10 having a photographing function, in which the characters described in the combination 9 of the block parts in FIG. 2A are recognized, and the ground pattern is also recognized in (). Is shown.
"(Ground pattern A) Yugi" indicates that the ground pattern A is the entire Yugi case part 2-c. This indicates that the pattern A is the option part 3-a having only one unit width.
The left column of the table in FIG. 35B is character data recognized by the OCR from the read data. Based on the character data and the layout data, the program element data in the right column of the table is analyzed and recognized based on the data in the database 10-45 of the program execution terminal 10.

FIG. 35 is a basic block diagram of the present application system.
The information taken in by the input device 10-1 is converted into character data and the layout into layout data by recognition means 10-3 such as OCR. These data are compared with the data of the database 10-45 by the data analysis means 10-4, and the program element data is created while referring to the data. A program is generated by the program generation unit 10-6 based on the above. In generating the program, data such as a basic program stored in the database 10-45 is used.
The generated program is sent to the program execution device 10-7, and is executed using the execution data 10-75.
The execution data 10-75 includes types such as image data, moving image data, robot control data, and audio data.

The following is an example of a program describing processing contents and processing data to be sent to the program generation unit.

// read text information from image
var captureImg = 'Image captured by OCR etc.';
Tesseract.recognize (captureImg, {lang: 'jpn'}). Then (function (result) {
checkText (result);
});
// Check the obtained character information and send the processing contents to the processing program
function checkText (result) {
var textAll = ['Go to the end', 'I'm sorry'...];
for (var i = 0; i <textAll.length; i ++) {
if (result.match (textAll [i])) {
send_program ("processing content", "character information");
}
}
}
// go sequentially
send_program ("sequentially", "going");
// I want to process sequentially
send_program ("sequentially", "Taiso");
// There is no branch processing Yugi
send_program ("case", "Ougi"["Hanachichimonme","Toronpense"]);
// sequential processing
send_program ("sequentially", "success");
// sequential processing
send_program ("sequentially", "Ohirune");
// sequential processing
send_program ("sequentially", "go home");
// end / /

  The statement line following // in the program is not the program itself but a comment (explanatory text) of the program, and does not affect the processing of the program. Since it is useful for learning a program, it may be displayed by setting.

FIG. 36 is a block diagram of the program execution terminal 10 with the input device of the embodiment 31. The input device 10-1 is a camera. The data of the image taken here is converted into character code data by the OCR of the image reading means 10-31, and the ground pattern and layout image are also converted to ground pattern data, layout data. It is converted to data (up and down layout such as character line feed).
The converted data is analyzed by the data analysis means 10-41 on the basis of the data in the database 10-45, and becomes text program element data and ground pattern and layout program element data.

The program element data of the text and the program element data of the ground pattern and layout are sent to the program generation unit 10-6, and a program is generated based on the element data. In generating the program, reference is made to the basic program data stored in the database 10-45, and the like.
If there is an error such as an inability to execute the program halfway, error information is sent to the error analysis unit, the reason for the error is detected by referring to the error data 10-65, and the error correction unit detects the error in the error analysis unit and the error data file. Correct errors by linking with -65.
The completed program is sent to the program control execution unit 10-7, and if there is an input of the execution button by the user, the still image, the animation video data, the audio data, and the like are taken in from the execution data 10-75. The program is executed.
The executed content is displayed on the display / operation unit 10-2 of the program execution terminal 10.

  FIG. 37 illustrates a display / operation unit 10-2 of the program execution terminal 10 according to the thirty-first embodiment. In the selected scene of the snack, an image 10-22 of the snack as an option, a comment 10-23 prompting the user to operate, and an image 10-24 of an illustration related to the comment are displayed. When one of the three snacks is selected by touching the display / operation unit 10-2, the next scene is changed.

Example 32 of FIG. 38 is a block diagram in which the program execution terminal with communication capability 11, the external communication environment 13, and the program learning server 12 are linked.
A program generated by the terminal, a program generation history, and contents of program learning such as an error occurrence state are transmitted to a program learning server, which is an external server, using an external communication environment 13 such as the Internet by the communication device 11-2 of the terminal. 12 is the system sent to.

The program learning server 12 uses a learning level analysis function, an error information analysis function, an instruction support function, etc., based on the received information on the program execution terminal 11 with communication capability, etc., to provide various services for program learning. The provided function 12-2 is exhibited.
The learning level analysis function determines the learning level based on the degree of difficulty in producing the program, the achievement rate of the program, the simplicity of the program, the speed of creation, the number of errors, the content of errors, and the like.
The error information analysis function grasps a program in which an error is likely to occur from the error information and analyzes a weak point of the program learner.
The learning support supports the learning of the learner by referring to the program learning support data stored in the program learning database 12-1 in conjunction with the learning level analysis function and the error information analysis function. The support contents include tips for program creation, exercises, their answers and explanations, and reviews of learning programs.

  Although the handwritten character recognition function 12-3 is provided for image recognition of a handwritten program, it is considered that recognition is difficult with general character recognition software in consideration of the fact that program learners are young. Then, the photographed image is sent to the education server 12, which is an external server, and the handwritten characters are recognized by the more powerful handwriting recognition function 12-3.

If there is a request, the program learning support information stored in the program learning database 12-1 and the program learning support know-how are sent to each terminal according to the learning progress of each terminal.
If the group, class, school, or the like to be studied is registered, the program learning server 12 sends information for each group, class, or school, and also accumulates information for each region or prefecture. Information on groups, classes, schools, and regions and prefectures is used to spread, improve, and develop program education.

FIG. 39 shows an example of creating a program using the cooperation part 7 in the embodiment 33.
In FIG. 39A, a cooperation part 7-A is laid out to the right of the weekday option part 3-p. In FIG. 39B, another cooperation part 7-A is laid out to the left of another weekday option part 3-p. Below that, there are 6 day option parts 3-pm from Monday to Saturday, with the day case part 2-h and the parameter selection option part 4-2 on the left below. The cooperation part 7-A2 is laid out.

In FIG. 39C, on the left side, a day option part 3-pm for Monday with another cooperating part 7-B and a parameterless optional accessory part 4-2, a school attendance processing part 1-k below, and a lower part below that. Timetable case part 2-k has a time-limited option with a parameterless optional accessory part 4-2 below it and a parameterless optional accessory part 4-2 attached to the weekday option part 3-p. A part 3-t and a lunch option part 3-s are laid out, and a lower part processing part 1-m and a weekday end processing part 1-n are laid out therebelow.
FIG. 39D shows the remaining processing parts.

The program shown by the layout of these parts is
"Wake up" → go to "toilet" → "wash your face" → eat "breakfast""toothpaste" → specify whether today is a weekday or holiday: today is a weekday → jump to the program that specifies the weekday of the week → day of the week Specify: Monday → Jump to Monday program → Monday program: “Go to school” → “Timetable” continues → From “First hour” to “Sixth hour” across “School lunch” → “Go home” Yes → “End of weekday” → Eat “Dinner” → Watch “TV” → Do “Homework” → Enter “Bath” → “Sleep”
It is the contents of.
The timetable case part 2-k is not a case where an option is selected, but a case where sequential processing is performed.

FIG. 40 shows the option part 3 in which the side 3-4s of the option part 3 is provided with a hole 3-4h on the side of the option part. “Holiday” is described on the option part upper surface 3-4u, and “Weekday” is described on the option part front surface 3-4m. Others include "Sunday" and "Holiday", and can be used in four ways depending on which surface is brought to the upper surface.
The hole 3-4h on the side surface of the option part is a hole for fitting a continuous part, and is a cylindrical hole. 39 is inserted into the hole 3-4h on the side of the option part. If the cooperating projection 7-3 of the cooperating part 7 is cylindrical, it can be turned with the cooperating part 7 inserted in the hole 3-4h on the side of the option part. Can be changed easily.
This means that the other accessory parts 4 have the same structure, so that the parameters can be changed simply by turning.
When the cylindrical holes and projections are square pillars, they need to be inserted and removed, but they can be connected without tilting.

Embodiment 34 of FIG. 41 is a modification of the embodiment 33, in which another program is created.
FIG. 41B lays out a Monday program following the weekday case part 2-h following the weekday option part 3-p.
The program shown in the layout of FIG. 43B for these parts is:
Program to specify the weekday of the week → Specify the day of the week: Monday → Monday program “Go to school” → Repeat “One day of physical education” twice from “First hour” (Two days of physical education) → “Preparing for lunch” ”→“ Restaurant ”→“ Meal ”→“ Science ”class →“ Mathematics ”class →“ Go home ”→“ End of weekday ”
It is the contents of.

The following is an example of a program that describes the processing contents and processing data to be analyzed for the OCR and sent to the program generation unit.
// read text information from photo
var captureImg = 'Image captured by OCR etc.';
Tesseract.recognize (captureImg, {lang: 'jpn'}). Then (function (result) {
checkText (result);
});
// Check the obtained character information and send the processing contents to the processing program
function checkText (result) {
var textAll = ['wake up', 'toilet', 'face wash'.
for (var i = 0; i <textAll.length; i ++) {
if (result.match (textAll [i])) {
send_program ("processing content", "character information");
}
}
}
// Wake up sequentially
send_program ("sequentially", "wake up");
// Sequential treatment toilet
send_program ("sequentially", "toilet"); // sequential processing face wash
send_program ("sequentially", "face wash");
// sequential processing breakfast
send_program ("sequentially", "breakfast");
// toothpaste
send_program ("sequentially", "toothpaste");
// branch process what weekday holiday
send_program ("case", "what day"["weekday","holiday"]);
// If you select weekdays
// sequential processing weekdays
send_program ("sequentially", "weekdays");
// branch processing day Monday
send_program ("case", "day of the week"["Monday","Tuesday"...));
// If you select Monday
// Sequential processing attendance
send_program ("sequentially", "go to school"); // Sequential processing timetable
send_program ("sequentially", "timetable");
// repetitive physical education
send_program ("repeat [times]", "physical education");
// Preparation for sequential processing lunch
send_program ("sequentially", "preparing lunch"); // Serving sequentially
send_program ("sequentially", "serving");
// sequentially processed meals
send_program ("sequentially", "meal");
// sequential processing science
send_program ("sequentially", "science");
// sequential arithmetic
send_program ("sequentially", "arithmetic");
// Sequential processing
send_program ("sequentially", "go home");
// Sequential processing (end of branch)
End of weekday
send_program ("return", "end of weekday");
// sequentially processed dinner
send_program ("sequentially", "dinner");
// Sequential processing TV
send_program ("sequentially", "TV");
// sequential homework
send_program ("sequentially", "homework");
// Sequential bath
send_program ("sequentially", "bath");
// sleep sequentially
send_program ("sequentially", "sleep");
// end

Example 35 in FIG. 42 is one in which the movement of the robot is programmed.
The program shown by the layout of these parts is
Robot "power on" → "walk" → "turning" options are "back" and "left and right", and "left and right" have "right" turning and "left" turning options → any one Select one to change direction and keep walking → "Stop" → "Right hand" options include "Right" hand, "Left" hand and "Both hands" → Select one to get the selected content Raise your hand along → “stop” → “power off”
It is the contents of.

A combination of these laid out block parts is executed by a program execution terminal 10 such as a smartphone having an OCR function with an input device 10-1 as a camera and application software for executing a program, and a display thereof. Above, the animation robot moves as programmed.
Note that a small robot may move instead of the animation robot on the display.

FIG. 43 is a usage example for determining the theme of product development, and shows a part of parts laid out for studying a program.
As shown in this example, the present invention can be used in a business environment.
The program shown by the layout of these parts is
In "product development" → Thinking about the “property” first → Considering whether it matches the “philosophy” → Checking “consistency” with the “basic policy” derived from the philosophy first (* 1) → “Corporate goal” Check "Employee happiness" and "Society" (* 2) → "Survey": "Survey" all "purpose", "competitors", "time", "external environment" and "resources" (* 3) → "Promotion of theme development" → Decide whether the product is an "existing line" product, "new line" product or "new category" → In the case of "new category", enter "different industry" or "different business category" (* 4) Or a new product in the existing business format → In the case of “new product”, decide how to use the new product → determine “recycling”, “upcycle (* 5)”, “new design” . → In the case of a new design, decide what kind of design you want to aim at, and think twice about how to use “Basicdesign”, “Redesign”, “Otherdesign” and “Ethcaldesign” (* 6) → Report to the president → Ask for judgment on the possibility of product development theme → Repeat until judgment of “Yes”
It is the contents of.

The following (* 1) to (* 6) are supplemented.
(* 1) The consistency case indicates that the associated individual element part is a check item.
(* 2) Connection parts AA, AB, and AC are followed by specific checks.
(* 3) Individual element parts accompanying the investigation case will be investigated as necessary. The connection parts B, C, D, E, and F are followed by specific investigation contents.
(* 4) “Different industries” refers to industries that handle different products and services. Different business types refer to differences in handling, such as retail, wholesale, subcontracting, and manufacturing and sales.
(* 5) "Upcycle" refers to finishing off new products with scraps and surpluses that come out during the product manufacturing process.
(* 6) Connection parts BA, BB, BC, BD are followed by specific checks.

The embodiment 36 of FIG. 44 is an embodiment of the present application of a black toothpick which is a deformed block which is not a rectangular parallelepiped. Although the description case part 2-u has no description of characters, it is set by application software of the program execution terminal 10 so as to be read as the case part 2 by bark of black characters. The recipe case part 2-v instructs selection of a recipe, but when there is only one option part 3, the contents of the option part 3 are processed and displayed without waiting for the operation of the operator.
In FIG. 44A, when the black character toothpick bark is recognized, the description content of the Satsuki Sohana Yokan option part 3-u laid out below is recognized, and the Satsuki Sohana Yokan is explained on the program execution terminal 10.
FIG. 44B shows the remaining parts of the layout of A. The recipe case part 2-v is a case part 2 for explaining the recipe.

FIG. 45A is an example in which a description of a plurality of characters and the like and those surrounded by a ruled line are output on paper.
A case finish 2-3 such as a ground pattern is provided in the frame described in the wording of the case, and a ground pattern indicating the number of repetitions of 4-72 indicating repetition is provided in the right frame. In addition, to the left of the description of “Hanachimonme”, which is an option, there is a square portion of “Choice Finish 2-3” surrounded by a frame indicating that “Hanachimonme” is an option. .
The program execution terminal 10 with the photographing function reads the output paper, and reads code data such as characters and layout data. An analyzing means for analyzing elements and program configuration data, and a program can be generated and executed from the analyzed data.
The program indicated by the description of the output paper is the same as in the fifth embodiment. “Go to Yochien” → Do “Taiso” → Play “Hanachimonme” twice → “Kyushuku” Eat->"Ohine"->"Return to the house"
It is the contents of.

FIG. 45B is an image obtained by removing the finish of the ruled line and the ground pattern from FIG. 45A and outputting the result on paper.
The word “Yochien ni Go” is recognized from the stored data as a case, the number to the right of the case is recognized as the number of times the case is repeated, and “Hanachimonme” is an option. It is set to recognize that there is.
On the left side of "Hanachimonme", there is no case pattern indicating that "Hanaichimonme" is an option, but "Hanaichimonme" is recognized as an option Since the setting is set, and "" is set to indicate the process instead of the option, the written content can be recognized without fail.
The program shown in the description of the output paper is also the same as in the fifth embodiment, "Go to the house" → "Taiso" → Play "Hanachimonme" twice → "Kyushuku"Eat->"Ohine"->"Return to the house"
It is the contents of.

Next, an embodiment of a programming support tool used in another programming learning will be described.
The problem in this programming learning is to learn a programming configuration for automatically driving a car using a robot and reaching a destination as shown in FIG.
The parts prepared in advance in this learning are rectangular or square, for example, thin plate-like parts, and one of the front and back surfaces is a content display surface for describing the processing content. The content display surface is oriented in the same direction, and can be arranged side by side while contacting the sides with other parts.

  There are at least three types of parts indicating sequential processing, selection processing, and repetition processing. In this embodiment, other types of parts include start / end parts indicating start / end, and a group of processing such as subroutines and modules. Title parts indicating the title are also provided.

Next, various parts will be described.
The start / end parts indicating the start and end are as shown in FIG.

  The sequential processing parts representing the sequential processing are as shown in FIG. The content that is visible on the surface represents the processing content.

  Here, two types of selection processing parts representing the selection processing are prepared. One of them is a case part representing three or more selective branching processes. The case parts in this embodiment can be configured by combining two types of case part elements as shown in FIG. The first case part element has, for example, an L-shape, and includes a description asking what the current location is. The second case part element is arranged beside the vertical part of the first case part element, and a specific place is described as the content.

  Another type of part that represents the selection process is an if part that represents a two-branch process. Here, as shown in FIG. 50, two oblique lines are shown on the surface of the rectangular part, and the contents of the branch condition are described in an inverted isosceles triangle surrounded by the oblique line and the upper side. I have. YES and NO are indicated at both ends of the lower side, and various parts can be further connected and arranged below this.

  As shown in FIG. 51, the repetitive processing part representing the repetitive processing is composed of two repetitive processing part elements, and the processing of the part interposed between the repetitive processing part elements is repeated. As shown. On the surface of the first repetition processing part element, a horizontally long semi-ellipse convex upward is described, and details of the repetition condition are described. On the surface of the second repetition processing part element, a downwardly protruding horizontal semi-ellipse is described, and the fact that the processing up to this point is repeated is described. In this embodiment, a square number of parts element is also provided. The number-of-times part element is placed on the first repetition processing parts element and is used to specify the number of times of repetition.

  Title parts indicating titles of a group of processes such as subroutines and modules are as shown in FIG. FIG. 53 shows parts indicating that the processing of the subroutine or module is performed. This part can also be said to be a kind of sequential processing part, and here, the indication that the title is the destination is displayed.

FIG. 54 shows a part array created by arranging parts by a learner in order to answer the above-mentioned task. In this solution example, the program structure has a hierarchical structure, and a group of parts is divided into three layers, that is, a top layer, an intermediate layer, and a bottom layer, and a plurality of parts are provided.
The tools for reading the sequence of parts created by the learner in FIG. 54 and generating them in an actual program are the same as those described in each of the above embodiments, and a description thereof will be omitted.

  Thus, with such a structure, it is possible to learn structured programming while picking up and arranging each part like a pulse.

  In addition, the present invention is not limited to the illustrated example and the like. For example, the parts may be stacked not only on a plane but also from below. In that case, the vertical surface is the content display surface.

  In addition, a connection structure that physically connects not only the parts but also the parts may be provided. One example is shown in FIG. This coupling structure includes a concave portion X1 provided on a side of a part and a fitting body X2 fitted into the concave portion X1, and the fitting body X2 is fitted into the concave portions X1 of adjacent parts to form the adjacent parts. Parts can be physically connected. By doing so, the produced parts arrangement does not easily fall apart. For example, it is possible to carry it and convert it into a program at another place.

  In addition, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the spirit of the invention, for example, by combining some of the embodiments.

The present invention can be used not only as a program learning tool for children, but also by combining a large number of various parts to make it easier for programmers and system engineers to understand the whole program when studying complex programs in a team. It can also be used for
In addition, by appropriately changing the wording of parts, it can be used for organizing ideas when considering business strategies and product configurations in business and product development.
Also, by reading a program written on paper without using parts, the program can be executed as it is, so that the program can be easily learned and a new program can be developed.

  A sign with a hyphen (-) sign indicates the main group name on the left of the hyphen, and indicates an individual name or a subgroup name together with the left of the hyphen. For example, 1-a indicates that the processing part belongs to the processing part 1.

1 Processing part 1-a Processing part 1-b Processing part 1-c Oyugi processing part 1-d Rough processing part 1-e Ohirane processing part 1-f Processing part to be received 1-g Processing parts to return to the house 1-h Play and play processing parts 1-i Drawing processing parts 1-k Attendance processing parts 1-m Departure processing parts 1-p End of weekday processing parts 1-q Power-on processing parts 1 -r Walking processing part 1-s Stopping processing part 1-t Power-off processing part 1-1m Processing part front 1-1U Processing part top 1-1s Processing part side 1-2 Text etc.

2 Case parts 2-a Snack case parts 2-b Cake case parts 2-c Yuugi case parts 2-d Batsu case parts 2-e Playtime case parts 2-f Story case parts 2-g What day Case part 2-h Day part case 2-k Timetable case part 2-q Turning case part 2-r Left and right case parts 2-s Hand part 2-u Description case part 2-v Recipe case part 2-2 2-3 Case finish, etc. 2-3 Case finish, etc.

3 Optional parts 3-a are not available. 3-a2 are not available. 3-b2 are available. 3-b2 are available. 3-c2 are available. 3-c. Parts 3-e Kagome Kagome Choice Parts e3-f Ehon Choice Parts f
3-g bite choice parts g
3-h Tangerine option parts 3-i Strawberry cake option parts 3-j Cheesecake option parts 3-k Cookie option parts 3-m On-the-fly option parts 3-n Week-off option parts 3-p Weekday option parts 3-pm Day of the week options Parts 3-t Time-limited choice parts 3-s Lunch choice parts 3-u Satsuki Souka Yokan choice parts 3-v Umimi Kanze choice parts 3-bk Back choice parts 3-r Right choice parts 3-L Left choice parts 3-w Optional parts 3-1 for both hands Option finish 3-2 Choice description characters 3-4h Holes for option parts side 3-4m Option parts front 3-4u Option parts top 3-4s Option parts side

4 Optional Parts 4-1 Optional Optional Parts 4-2 Optional Optional Parts 4-3 Optional Optional Finishes 4-5 Y Optional Accessories 4-5Y Y Optional Accessories 4-5N N Optional Accessories 4-5E E Optional Accessories 4-6 Parts included in case 4-7 Parts included repeatedly 4-70 Symbols included in repeated parts 4-71 Repetition marks 4-72 Number of repetitions 4-73 Repeat finish

5 Repeated parts 5-3 Repeated part marks 6 Connection parts 6-1R Right direction connection parts 6-1L Left direction connection parts 7 Cooperation parts 7-A A cooperation parts 7-A2 A2 cooperation parts 7-B B cooperation parts 7-C C-Coupling part 7-2 Coding part description 7-3 Coupling protrusion 8 Judgment part 8-2 Rectangle judgment part 8-Y Y-judgment part 8-NN judgment part 9 Combination of block parts

Reference Signs List 10 Program execution terminal 10-1 Input device 10-2 Display / operation unit 10-22 Snack image 10-23 Comment prompting user operation 10-24 Illustration image related to comment 10-3 Recognition unit 10-31 Image Reading means 10-41 data analyzing means 10-45 database 10-6 program generation part 10-65 error data folder 10-75 execution data 10-7 program execution part 11 program execution terminal 11-2 with communication capability communication device 12 program learning Server 12-1 Program learning database 12-2 Various service providing functions 12-3 Handwritten character recognition function 13 External communication environment 20-1 Order from top of combined block parts 20-2 Image reading data 20-3 Recognition data by OCR

Claims (5)

A programming support tool for computer programming or computer programming learning,
A plurality of parts, each of which is a substance having a square prism shape, having a content display surface on which the content of the processing is described, on a side peripheral surface excluding both end surfaces,
Each of the parts has the same shape, and is configured such that the color is different for each of three types of processing: sequential processing, selection processing, and repetition processing; and
Each of the parts has a contact surface or a contact side that can be arranged side by side while contacting other parts in a posture in which the content display surface is oriented in the same direction, and a desired process is performed according to an arrangement order of a plurality of parts. Is configured to be expressible,
A programming support tool wherein an end face of the part is connected to a cooperating part indicating a lower layer routine of the processing content described in the part.   2. The part according to claim 1, wherein the part is a square prism having at least three times the length of the short side of the solid, and the content display surface is set on a side peripheral surface excluding both end surfaces thereof. Programming support tool. A system for generating and executing a program using the programming support tool according to claim 1 or 2,
Means for reading code data such as characters and layout data from the processing content shown on the content display surface of the parts and the arrangement of the plurality of parts,
Means for recognizing the read code data and layout data;
Analysis means for analyzing program elements and program configuration data from the recognized data and the stored data;
A program generator for generating a program from the analyzed data;
A program generation and execution system, comprising: a program execution device that performs control and execution using the obtained program and stored execution data. 4. A program generation and execution system according to claim 3 , wherein said program generation and execution system has a means for transmitting contents and creation status of a program generated by said program generation and execution system to a predetermined program learning support server using a communication line. A program learning support system. A server having a program generation and execution system according to claim 3, and a means for receiving data of the program generation and execution system , grasping a program learning progress, and transmitting stored program learning support information according to the learning progress. A program learning support system characterized by the following.

Images