JP5747545B2 - Board description recording system - Google Patents

Description

  The present invention relates to a technique for electronically recording contents written on a handwritten board such as a whiteboard used in a conference or the like.

  Whiteboards are frequently used in meetings. The contents of the whiteboard in which the contents examined during the meeting are described are useful information not only for the participants of the meeting but also for those who have not participated in the meeting.

  This useful information is electronically captured on the whiteboard during the meeting, accumulates the captured data, and allows the user to obtain the content written on the whiteboard at any time during the meeting. It is desirable to do.

  In particular, if the system is not systematized, a person manually captures the contents of the whiteboard described during the meeting, and the acquired electronic image data is stored in a PC (Personal Computer) or the like.

  In addition, a conference recording system that automatically captures the contents of the whiteboard electronically has been proposed (see Patent Document 1).

  The above-described method in which the person manually captures the camera and saves the image data has a problem that it takes a lot of human effort.

  On the other hand, as a conference recording system that automatically captures the contents of the whiteboard electronically, it saves all the contents of the automatically acquired whiteboard, making it difficult for the user to search for the target data. There was a problem that the capacity of the storage place was pressed. In addition, if the whiteboard content that was automatically acquired is the last one that was acquired, the user cannot acquire the content of the review that was written on the whiteboard during the meeting and was deleted during the meeting. It was.

  The present invention has been proposed in view of the above-described conventional problems, and the purpose of the present invention is to take a record of the description content of a handwritten board, and does not require human labor, and is excellent in searchability. There is no need to limit the capacity of the data storage location, and all the contents including the contents erased on the way can be comprehensively stored without any extra contents.

  In order to solve the above problems, in the present invention, board information acquisition means for capturing the contents described on the handwritten board as an image, and image storage for determining whether to save the image acquired from the board information acquisition means A determination unit; and an image storage unit that stores the image determined to be stored in a permanent area, and the image storage determination unit stores the captured image when the stored image is not stored. If the image is the same as the latest saved image, the captured image is discarded, and if the captured image is not the same as the latest saved image and is appended, it is saved. If the latest image is deleted and the captured image is saved, and the captured image is not the same as the latest saved image, If the saved image is saved, and the imported image is not the same as the latest saved image, and it is a continuation of the deletion, the latest saved image is deleted and then imported. The image is saved.

  The board description content recording system of the present invention does not require human labor, is excellent in searchability, does not press on the capacity of the data storage location, and all contents including the contents erased in the middle are redundant. It can be stored comprehensively without any content.

It is a figure which shows the hardware structural example of the board description content recording system in 1st Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 1st Embodiment. It is a flowchart which shows the process example of 1st Embodiment. It is a figure which shows the example of the image taken in from the handwritten board in 1st Embodiment, and the image preserve | saved. It is a figure which shows the functional block structural example of the board description content recording system in 2nd Embodiment. It is a flowchart which shows the process example of 2nd Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 3rd Embodiment. It is a flowchart which shows the process example of 3rd Embodiment. It is a flowchart which shows the process example of 4th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 5th Embodiment. It is a flowchart which shows the process example of 5th Embodiment. It is a flowchart which shows the process example of 6th Embodiment. It is a figure which shows the hardware structural example of the board description content recording system in 7th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 7th Embodiment. It is a flowchart which shows the process example of 7th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 8th Embodiment. It is a flowchart which shows the process example of 8th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 9th Embodiment. It is a flowchart which shows the process example of 9th Embodiment. It is a figure which shows the hardware structural example of the board description content recording system in 10th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 10th Embodiment. It is a flowchart which shows the process example of 10th Embodiment. It is a figure which shows the hardware structural example of the board description content recording system in 11th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 11th Embodiment. It is a flowchart which shows the process example of 11th Embodiment. It is a figure which shows the functional block structural example of the board description content recording system in 12th Embodiment. It is a flowchart which shows the process example of 12th Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described.

<First Embodiment>
The first embodiment shows an example of a basic configuration of a board description content recording system, in which the contents described on a handwritten board such as a white board are electronically imaged (image data) by an input device at predetermined time intervals. ) To determine whether the image needs to be captured and stored, and only the image determined to be stored remains in the permanent area. The point is the process flow (algorithm) of how to determine whether the image is necessary and to leave only the image determined to be necessary in the permanent area.

In this embodiment, all the contents written on the handwritten board are left. Therefore, the determination conditions for the image to be saved and the image not to be saved are as follows.
[Image to save]
-If any part of the content written on the handwriting board is erased, an image with the erased content remaining.
-An image containing the contents of the latest handwritten board.
-If only the additional writing has occurred in the content written on the handwriting board, an image containing the added content.
[Images not to save / images to delete]
-The same image as that already saved.
-If only appending has occurred in the content written on the handwriting board, the saved image before appending.

  FIG. 1 is a diagram illustrating a hardware configuration example of a board description content recording system according to the first embodiment.

  In FIG. 1, a board description content recording system manages a handwritten board 1 such as a whiteboard, an input device 2, and a general-purpose PC connected to the input device 2 via a network 3 such as a LAN (Local Area Network). Device 4.

  The input device 2 may be configured integrally with the handwriting board 1 or may be configured separately from the handwriting board 1. When the handwriting board 1 is a multimedia board that electronically captures handwritten contents and also serves as the input device 2, the handwriting board 1 and the input device 2 are integrally configured. When the input device 2 is a camera, there are a case where the input device 2 is provided integrally with the handwriting board 1 and a case where the input device 2 is attached to the handwriting board 1 and its surroundings.

  The input device 2 includes a CPU (Central Processing Unit) 22, a memory 23, a board information acquisition unit 24, and a network communication control unit 25 connected to the data bus 21. The board information acquisition unit 24 may be a capture unit of the handwritten board 1 or a camera or the like. The network communication control unit 25 is a NIC (Network Interface Card) or the like.

  The management device 4 includes a CPU 42, a memory 43, a permanent area 44, and a network communication control unit 45 connected to the data bus 41. The permanent area 44 is a non-volatile storage device such as an HDD (Hard Disk Drive) or a flash memory. The network communication control unit 45 is a NIC or the like.

  FIG. 2 is a diagram illustrating a functional block configuration example of the board description content recording system according to the first embodiment.

  In FIG. 2, the input device 2 includes information acquisition operation control means 201, board information acquisition means 202, and communication means 203.

  The information acquisition operation control unit 201 has a function of performing main control of an operation for acquiring information written on the handwriting board 1.

  The board information acquisition unit 202 has a function of electronically loading information written on the handwritten board 1 into the device.

  The communication unit 203 has a function of performing communication between the input device 2 and the management apparatus 4 that cooperate with each other.

  The management apparatus 4 includes an image storage unit 401, an image storage determination unit 402, an image comparison unit 403, an image information extraction unit 404, an information acquisition timing determination unit 405, and a communication unit 406.

  The image storage unit 401 has a function of accessing the permanent area 44 (FIG. 1), storing an image in the permanent area 44, or deleting an image stored in the permanent area 44. The image storage unit 401 is configured to add a serial number to the file name of the image to be stored or to specify and acquire the latest image from the storage date and time attached to the file.

  The image storage determining unit 402 has a function of determining whether or not an image needs to be stored and determining whether or not an already stored image needs to be deleted. The image storage determination unit 402 has an erase period flag. The erasure period flag indicates that there is a period from the start of erasure of the contents written on the handwriting board 1 to the time when additional writing occurs in the contents written on the handwriting board 1, and immediately before the erasure of the handwriting board 1 begins. This is a flag used to make a determination to save only the image and not save the image other than the latest image during the erasure period. In short, the erasure period flag is an operation control flag for preventing an image being erased from being saved.

  The image comparison unit 403 has a function of comparing two images and determining whether there is a difference between the two images.

  The image information extraction unit 404 has a function of extracting image information (position, color) from the acquired image.

  The information acquisition timing determination unit 405 has a function of managing the timing (time interval) for acquiring information from the input device 2 and requesting acquisition of information when it is time to acquire information.

  The communication unit 406 has a function of performing communication between the input device 2 and the management apparatus 4 that cooperate with each other.

  In addition, although the example of a structure which connects the input device 2 and the management apparatus 4 by the network 3 separately was demonstrated, you may comprise the input device 2 and the management apparatus 4 integrally. In this case, the data bus, CPU, memory, etc. can be used in common. In addition, a network communication control unit for communication between the input device 2 and the management apparatus 4 is not necessary.

  FIG. 3 is a flowchart showing a processing example of the first embodiment.

  In FIG. 3, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S101).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S102 and S103). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S103), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S103), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S104).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S105), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S106), It transmits to the management apparatus 4 by the communication means 203 (step S107).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S108), the image storage determination unit 402 determines whether there is a stored image by the image storage unit 401 (step S109). For example, it is determined whether or not an image file exists in a predetermined folder for storing an image of a meeting or the like that is currently in progress.

  If it is determined that there is no image stored (NO in step S109), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S110), and the next image is stored. The process returns to the determination of the information acquisition timing (step S102).

  When it is determined that there is a stored image (YES in step S109), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S111 and S112).

  If it is determined that the images are the same (YES in step S112), the image storage determination unit 402 discards the image acquired from the input device 2 (step S113), and determines the information acquisition timing for the next image (step S102). Return to).

  When it is determined that the images are not the same (NO in step S112), the image storage determining unit 402 extracts image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S114 and S115). The reference value is the background color of the handwriting board 1, and is stored as, for example, RGB (Red Green Blue) values. As a method for specifying the reference value, there are a method of photographing with a prior camera (photographing the handwritten board 1 with nothing written in accordance with a user instruction) or a method in which the user directly inputs RGB values. Since the reference value represents the background color of the handwriting board 1, if the image information of the changed portion is different from the reference value, it is determined that the description content of the handwriting board 1 has been added, and the reference value If they match, it can be determined that the description on the handwriting board 1 has been erased.

  If it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S115), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S116). .

  If the erasing period flag is not ON (NO in step S116), it is left as it is. If it is ON (YES in step S116), the erasing period flag is turned off (step S117), and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S118), and the process returns to the determination of the information acquisition timing for the next image (step S102).

  When it is determined that the color of the changed portion is the reference value, that is, erasure (YES in step S115), the image storage determination unit 402 determines whether the erasure period flag is ON (step S119). ).

  If the erasure period flag is not ON (NO in step S119), the image storage unit 401 stores the image acquired from the input device 2, sets the erasure period flag to ON (step S120), and information acquisition timing for the next image Return to the determination (step S102). The erase period flag that is turned on indicates that erasure continues until it is turned off by detection of additional writing (step S117).

  If the erase period flag is ON (YES in step S119), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S118), and the next image. Return to the determination of the information acquisition timing (step S102).

  FIG. 4 is a diagram illustrating an example of an image captured from the handwriting board 1 and a stored image in the first embodiment.

  In FIG. 4, images # 1 to # 6 are taken into the management apparatus 4 from the handwriting board 1 by the input device 2 as time passes.

  Image # 1 is saved because it is the first captured image.

  Next, since image # 2 is an image with triangles and squares added to image # 1 on which the star graphic was written, the deletion period flag is OFF at the time after image # 2 is acquired. The image # 1 is deleted and the image # 2 is saved.

  Next, with respect to image # 2, image # 3 has an erased triangular figure, so the deletion period flag is set to ON at the time after acquisition of image # 3, and image # 2 It remains stored as an image. Image # 3 is saved as the image at the start of erasure.

  Next, with respect to image # 3, since image # 4 is obtained by deleting a square figure, erasure continues, the erasure period flag remains ON, and image # 3 is deleted and image # 3 is deleted. 4 is saved.

  Next, since image # 5 has a circular figure added to image # 4, the deletion period flag is turned OFF at the time after acquisition of image # 5, and image # 4 is deleted. Image # 5 is saved.

  Next, since image # 6 has no change with respect to image # 5, image # 6 is not saved.

  Therefore, the images stored at the time after acquisition of image # 6 are image # 2 and image # 5.

  Note that the user can access and use the stored image at any time by using a device that can access the management apparatus 4. However, the stored image is updated in real time, and the stored image is changing.

<Second Embodiment>
The second embodiment generates a new image storage folder when it is detected that the handwriting board is initialized (all erased) from the feature amount of the image acquired from the handwriting board, and the image storage folder stores the new image storage folder. Images are classified and stored.

  When multiple agenda items are discussed on a single handwriting board and the information is saved as an image, when multiple images are saved in a single image storage folder, there is a concern that images of multiple agenda items may be mixed, causing confusion. Arise. In this embodiment, when the handwriting board is initialized, it is determined that the examination subject has been switched, and the image of the handwriting board after the switching timing is created and stored in another folder. And can be saved. This makes it easy for the user to search for necessary images.

  The hardware configuration in the second embodiment is the same as that of the first embodiment shown in FIG.

  FIG. 5 is a diagram illustrating a functional block configuration example of the board description content recording system according to the second embodiment.

  5 is the same as the case of the first embodiment shown in FIG. 2 except that the image classification means 407 is added to the management apparatus 4.

  The image classification unit 407 determines whether or not the handwriting board 1 has been initialized from the feature amount of the image acquired from the handwriting board 1 by the input device 2. The area 44 (FIG. 1) has a function of generating a new image storage folder.

  The image storage unit 401 has a function expanded to newly generate an image storage folder and to perform processing on the dynamically set image storage folder.

  FIG. 6 is a flowchart showing a processing example of the second embodiment.

  In FIG. 6, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S201).

  Next, the image storage unit 401 sets the current image storage folder No. i to No. 0 (step S202), and generates an image storage folder in which No. 0 is reflected in the folder name and the like (step S203). For example, i may be a folder name as it is, i may be added to a fixed folder name, or a folder name may be obtained from a table in which an arbitrary folder name corresponding to i is registered in advance. .

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a predetermined time has passed since the previous information acquisition or the first time (steps S204 and S205). When it is determined that the predetermined time has not elapsed since the previous acquisition of information and it is not the first time (NO in step S205), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S205), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S206).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S207), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S208), It transmits to the management apparatus 4 by the communication means 203 (step S209).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S210), the image classification unit 407 determines whether or not the handwriting board 1 has been initialized from the feature amount of the image acquired from the input device 2 (step S211, S212). Here, the image classification means 407 is initialized if the initial initialized image or the initialized image continues, for example, by retaining the previously determined feature amount. Judge that there is no.

  If it is determined that the handwriting board 1 has not been initialized (NO in step S212), it is left as it is. If it is determined that the handwriting board 1 has been initialized (YES in step S212), the image classification unit 407 displays the image storage unit 401. Thus, 1 is added to i of the current image storage folder No. i (step S213), and an image storage folder in which No. i is reflected in the folder name or the like is generated (step S214).

  If it is determined that the handwriting board 1 has not been initialized (NO in step S212), the image storage determination unit 402 determines whether there is an image stored in the current image storage folder by the image storage unit 401. It is determined whether or not (step S215).

  When it is determined that there is no stored image (NO in step S215) or after the image storage folder is generated (step S214), the image storage determination unit 402 uses the image storage unit 401 to store the acquired image in the permanent area 44. (Step S216), and the process returns to the determination of the information acquisition timing for the next image (step S204).

  When it is determined that there is a stored image (YES in step S215), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S217 and S218).

  If it is determined that the images are the same (YES in step S218), the image storage determination unit 402 discards the image acquired from the input device 2 (step S219), and determines the information acquisition timing for the next image (step S204). Return to).

  When it is determined that the images are not the same (NO in step S218), the image storage determination unit 402 extracts the image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S220 and S221).

  When it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S221), the image storage determining unit 402 determines whether or not the erasing period flag is ON (step S222). .

  If the erasure period flag is not ON (NO in step S222), it is left as it is. If it is ON (YES in step S222), the erasure period flag is turned off (step S223), and the image storage unit 401 stores the current image. The latest image stored in the folder is deleted, the image acquired from the input device 2 is stored in the image storage folder (step S224), and the process returns to the determination of the information acquisition timing for the next image (step S204).

  When it is determined that the color of the changed part is the reference value, that is, erasure (YES in step S221), the image storage determination unit 402 determines whether the erasure period flag is ON (step S225). ).

  If the deletion period flag is not ON (NO in step S225), the image storage unit 401 stores the image acquired from the input device 2 in the current image storage folder, sets the deletion period flag to ON (step S226), The process returns to the determination of the information acquisition timing for the image (step S204).

  If the deletion period flag is ON (YES in step S215), the image storage unit 401 deletes the latest image stored in the current image storage folder, and the image acquired from the input device 2 is stored in the image storage folder. (Step S224), and the process returns to the determination of the information acquisition timing for the next image (step S204).

<Third Embodiment>
In the third embodiment, the color of a character / figure which is the content written on the handwritten board is determined, and the processing (whether or not the image can be saved, the storage location, etc.) is changed according to the color. The image is not stored when a specific color is detected.

  Accordingly, it is possible to satisfy the security requirement that the user wants to write on the handwritten board to share and explain at the meeting place but does not want to keep it as a record.

  The hardware configuration in the third embodiment is the same as that in the first embodiment shown in FIG.

  FIG. 7 is a diagram illustrating a functional block configuration example of the board description content recording system according to the third embodiment.

  7 is the same as the case of the first embodiment shown in FIG. 2 except that a color identification unit 408 is added to the management apparatus 4.

  The color identification unit 408 has a function of determining whether or not a description with a specific color is included in the image.

  FIG. 8 is a flowchart showing a processing example of the third embodiment.

  In FIG. 8, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S301).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S302 and S303). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S303), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S303), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S304).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S305), acquires an image of the contents written on the handwritten board 1 by the board information acquisition unit 202 (step S306), It transmits to the management apparatus 4 by the communication means 203 (step S307).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S308), the color identification unit 408 determines whether or not a description of a specific color is included in the acquired image (steps S309 and S310). The specific color may be determined in advance or specified by the user.

  If it is determined that the acquired image does not contain a description of a specific color (NO in step S310), the image storage determination unit 402 determines whether there is a stored image by the image storage unit 401. (Step S311).

  If it is determined that there is no image stored (NO in step S311), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S312), and the next image is displayed. The process returns to the determination of the information acquisition timing (step S302).

  When it is determined that there is a stored image (YES in step S311), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S313 and S314).

  When it is determined that the images are the same (YES in step S312), or when it is determined that the image contains a description of a specific color (YES in step S310), the image storage determination unit 402 obtains from the input device 2. The discarded image is discarded (step S315), and the process returns to the determination of the information acquisition timing for the next image (step S302).

  When it is determined that the images are not the same (NO in step S314), the image storage determination unit 402 extracts the image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S316 and S317).

  If it is determined that the color of the changed portion is not the reference value, that is, it is an additional recording (NO in step S317), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S318). .

  If the erasure period flag is not ON (NO in step S318), it is left as it is. If it is ON (YES in step S318), the erasure period flag is turned OFF (step S319) and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S320), and the process returns to the determination of information acquisition timing for the next image (step S302).

  When it is determined that the color of the changed part is the reference value, that is, erasure (YES in step S317), the image storage determination unit 402 determines whether the erasure period flag is ON (step S321). ).

  When the erasure period flag is not ON (NO in step S321), the image storage unit 401 stores the image acquired from the input device 2, sets the erasure period flag to ON (step S322), and information acquisition timing for the next image Return to the determination (step S302).

  When the deletion period flag is ON (YES in step S321), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S320), and the next image. Return to the determination of the information acquisition timing (step S302).

<Fourth Embodiment>
In the fourth embodiment, the color of a character / figure that is the content written on the handwritten board is determined, and the processing (whether or not the image can be saved, the storage location, etc.) is changed according to the color. When a specific color is detected, an image is stored in a specific folder.

  By using a specific color depending on the agenda, folders can be automatically divided, and it becomes easier for the user to determine and understand the contents of the proceedings later.

  The hardware configuration in the fourth embodiment is the same as that of the first embodiment shown in FIG. 1, and the functional block configuration is the same as that of the third embodiment shown in FIG.

  FIG. 9 is a flowchart illustrating an example of processing according to the fourth embodiment.

  In FIG. 9, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S401).

  Next, the image storage unit 401 generates a default image storage folder and sets this image storage folder as an image storage destination (step S402).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a predetermined time has passed since the previous information acquisition or the first time (steps S403 and S404). When it is determined that the predetermined time has not elapsed since the previous acquisition of information and it is not the first time (NO in step S404), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S404), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S405).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S406), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S407), It transmits to the management apparatus 4 by the communication means 203 (step S408).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S409), the color identification unit 408 determines whether or not a description of a specific color is included in the acquired image (steps S410 and S411). The specific color may be determined in advance or specified by the user.

  When it is determined that the acquired image contains a description of a specific color (YES in step S411), the color identification unit 408 determines whether a specific image storage folder has been generated (step S412).

  If it is determined that the specific image storage folder has been generated (YES in step S412), it is left as it is. If it is determined that the specific image storage folder has not been generated (NO in step S412), the specific image storage folder is generated by the image storage unit 401. Then, the storage location of the current image is changed from the default image storage folder to the specific image storage folder (step S414). Note that only the current image is applied, and the next image is determined again.

  Then, when it is determined that the description of the specific color is not included in the acquired image (NO in step S411), the image storage determination unit 402 determines whether there is an image stored by the image storage unit 401. (Step S415). Whether or not there is a stored image is confirmed with respect to both the default image storage folder and, if generated, the specific image storage folder.

  If it is determined that there is no image stored (NO in step S415), the image storage determination unit 402 stores the acquired image in the permanent area 44 using the image storage unit 401 (step S416), and the next image is stored. The process returns to the determination of the information acquisition timing (step S403).

  When it is determined that there is a stored image (YES in step S415), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S417 and S418).

  If it is determined that the images are the same (YES in step S418), the image storage determination unit 402 discards the image acquired from the input device 2 (step S419), and determines the information acquisition timing for the next image (step S403). Return to).

  If it is determined that the images are not the same (NO in step S418), the image storage determining unit 402 extracts image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S420 and S421).

  When it is determined that the color of the changed portion is not the reference value, that is, it is additional writing (NO in step S421), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S422). .

  If the erasure period flag is not ON (NO in step S422), the state is left as it is. If it is ON (YES in step S422), the erasure period flag is turned off (step S423), and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S424), and the process returns to the determination of the information acquisition timing for the next image (step S403).

  When it is determined that the color of the changed portion is the reference value, that is, erasure (YES in step S421), the image storage determination unit 402 determines whether the erasure period flag is ON (step S425). ).

  When the erasure period flag is not ON (NO in step S425), the image storage unit 401 stores the image acquired from the input device 2, sets the erasure period flag to ON (step S426), and information acquisition timing for the next image Return to the determination (step S403).

  If the erase period flag is ON (YES in step S425), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S424), and the next image. Return to the determination of the information acquisition timing (step S403).

  Although specific processing has been described as the third embodiment and the fourth embodiment, a table in which correspondence between colors and processing is registered in advance is provided so that processing corresponding to the color detected from the image is performed. be able to.

<Fifth Embodiment>
In the fifth embodiment, a specific symbol is discriminated from the contents written on the handwritten board, and the processing (whether or not the image can be stored, the storage location, etc.) is changed according to the symbol. In this case, the image is not saved when the image is detected.

  Accordingly, it is possible to satisfy the security requirement that the user wants to write on the handwritten board to share and explain at the meeting place but does not want to keep it as a record.

  The hardware configuration in the fifth embodiment is the same as that in the first embodiment shown in FIG.

  FIG. 10 is a diagram illustrating a functional block configuration example of the board description content recording system according to the fifth embodiment.

  10 is the same as the case of the first embodiment shown in FIG. 2 except that a symbol identification unit 409 is added to the management apparatus 4.

  The symbol identification unit 409 has a function of determining whether or not a specific symbol is included in the image.

  FIG. 11 is a flowchart illustrating an example of processing according to the fifth embodiment.

  In FIG. 11, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S501).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a predetermined time has passed since the previous information acquisition or the first time (steps S502 and S503). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S503), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S503), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S504).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S505), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S506), It transmits to the management apparatus 4 by the communication means 203 (step S507).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S508), the symbol identification unit 409 determines whether or not a specific symbol is included in the acquired image (steps S509 and S510). The specific symbol may be determined in advance or specified by the user.

  When it is determined that the acquired image does not include a specific symbol (NO in step S510), the image storage determination unit 402 determines whether there is a stored image by the image storage unit 401. (Step S511).

  If it is determined that there is no image stored (NO in step S511), the image storage determination unit 402 stores the acquired image in the permanent area 44 using the image storage unit 401 (step S512), and the next image is stored. The process returns to the determination of the information acquisition timing (step S502).

  When it is determined that there is a stored image (YES in step S511), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S513 and S514).

  When it is determined that the images are the same (YES in step S512) or when it is determined that the image includes a specific symbol (YES in step S510), the image storage determination unit 402 acquires the image from the input device 2. The discarded image is discarded (step S515), and the process returns to the determination of the information acquisition timing for the next image (step S502).

  When it is determined that the images are not the same (NO in step S514), the image storage determination unit 402 extracts the image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S516 and S517).

  When it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S517), the image storage determining unit 402 determines whether or not the erasing period flag is ON (step S518). .

  If the erasing period flag is not ON (NO in step S518), it is left as it is. If it is ON (YES in step S518), the erasing period flag is turned off (step S519), and the image is saved by the image saving unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S520), and the process returns to the determination of the information acquisition timing for the next image (step S502).

  When it is determined that the color of the changed portion is the reference value, that is, erasing (YES in step S517), the image storage determining unit 402 determines whether the erasing period flag is ON (step S521). ).

  If the erasure period flag is not ON (NO in step S521), the image storage unit 401 stores the image acquired from the input device 2, sets the erasure period flag to ON (step S522), and information acquisition timing for the next image Return to the determination (step S502).

  When the deletion period flag is ON (YES in step S521), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S520), and the next image. The process returns to the determination of the information acquisition timing (step S502).

<Sixth Embodiment>
In the sixth embodiment, a specific symbol is discriminated from the contents written on the handwritten board, and the processing (whether or not the image can be stored, the storage location, etc.) is changed according to the symbol. When the image is detected, the image is stored in a specific folder.

  By describing specific symbols according to the agenda, folders can be automatically divided, and it becomes easier for the user to determine and understand the contents of the proceedings later.

  The hardware configuration in the sixth embodiment is the same as that of the first embodiment shown in FIG. 1, and the functional block configuration is the same as that of the fifth embodiment shown in FIG.

  FIG. 12 is a flowchart illustrating an example of processing according to the sixth embodiment.

  In FIG. 12, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S601).

  Next, the image storage unit 401 generates a default image storage folder and sets this image storage folder as an image storage destination (step S602).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S603 and S604). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S604), the same determination is continued.

  When it is determined that a certain time has elapsed from the previous information acquisition or the first time (YES in step S604), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S605).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S606), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S607), It transmits to the management apparatus 4 by the communication means 203 (step S608).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S609), the symbol identification unit 409 determines whether or not a specific symbol is included in the acquired image (steps S610 and S611). The specific symbol may be determined in advance or specified by the user.

  If it is determined that the acquired image includes a description of a specific symbol (YES in step S611), the symbol identification unit 409 determines whether a specific image storage folder has been generated (step S612).

  If it is determined that the specific image storage folder has been generated (YES in step S612), it is left as it is. If it is determined that the specific image storage folder has not been generated (NO in step S612), the specific image storage folder is generated by the image storage unit 401. Then, the storage location of the current image is changed from the default image storage folder to the specific image storage folder (step S614). Note that only the current image is applied, and the next image is determined again.

  When it is determined that the specific image is not included in the acquired image (NO in step S611), the image storage determination unit 402 determines whether there is an image stored by the image storage unit 401. Is determined (step S615). Whether or not there is a stored image is confirmed with respect to both the default image storage folder and, if generated, the specific image storage folder.

  If it is determined that there is no image stored (NO in step S615), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S616), and the next image is displayed. The process returns to the determination of the information acquisition timing (step S603).

  When it is determined that there is a stored image (YES in step S615), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S617 and S618).

  If it is determined that the images are the same (YES in step S618), the image storage determination unit 402 discards the image acquired from the input device 2 (step S619), and determines the information acquisition timing for the next image (step S603). Return to).

  When it is determined that the images are not the same (NO in step S618), the image storage determining unit 402 extracts image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S620 and S621).

  When it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S621), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S622). .

  If the erasure period flag is not ON (NO in step S622), the state is kept as it is. If it is ON (YES in step S622), the erasure period flag is turned off (step S623), and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S624), and the process returns to the determination of the information acquisition timing for the next image (step S603).

  When it is determined that the color of the changed portion is the reference value, that is, erasing (YES in step S621), the image storage determining unit 402 determines whether the erasing period flag is ON (step S625). ).

  If the erase period flag is not ON (NO in step S625), the image storage unit 401 stores the image acquired from the input device 2, sets the erase period flag to ON (step S626), and information acquisition timing for the next image Return to the determination (step S603).

  If the erase period flag is ON (YES in step S625), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S624), and the next image. The process returns to the determination of the information acquisition timing (step S603).

  Although specific processing has been described as the fifth embodiment and the sixth embodiment, a table in which correspondences between symbols and processing are registered in advance is provided so that processing corresponding to symbols detected from images is performed. be able to.

<Seventh Embodiment>
In the seventh embodiment, presentation materials etc. are displayed on a handwritten board by a projector, rear projector, liquid crystal panel, etc., written on the video by handwriting, and images such as presentation materials are included in the acquired images In such a case, an image such as presentation material is extracted from the acquired image, and an image containing only the contents described by the user is stored.

  In the image captured by combining the information added by the user with the information such as the presentation material projected on the handwritten board, the presentation material may be prohibited from distribution and may not be saved. is there. In the present embodiment, the projection image area can be removed from the difference between the captured image and the projection image that has been captured, and the image of only the portion described by the user can be saved, so only the image from which the presentation material or the like has been removed is saved. can do.

  FIG. 13 is a diagram illustrating a hardware configuration example of the board description content recording system according to the seventh embodiment.

  13 is the same as the case of the first embodiment shown in FIG. 1 except that a projection apparatus 5 connected to the management apparatus 4 via the network 3 is added.

  The projection apparatus 5 includes a CPU 52, a memory 53, a projection processing unit 54, and a network communication control unit 55 connected to the data bus 51. The projection processing unit 54 is a projection / display device such as a projector, a rear projector, or a liquid crystal panel. The network communication control unit 55 is a NIC or the like.

  FIG. 14 is a diagram illustrating a functional block configuration example of the board description content recording system according to the seventh embodiment.

  14 is the same as the case of the first embodiment shown in FIG. 2 except that the difference image generating means 410 is added to the management apparatus 4 and the projection apparatus 5 is added.

  The difference image generation unit 410 has a function of acquiring a projection image from the projection device 5 and generating an image having a difference from the image acquired from the input device 2.

  The projection device 5 includes an image projection unit 501 and a communication unit 502. The image projection unit 501 has a function of holding and displaying an image such as a presentation material on the handwriting board 1. The communication unit 502 has a function of performing communication between the projecting apparatus 5 and the management apparatus 4 that cooperate with each other.

  FIG. 15 is a flowchart illustrating an example of processing according to the seventh embodiment.

  In FIG. 15, the image storage determination unit 402 of the management apparatus 4 starts the operation with the erase period flag set to OFF (step S701).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S702 and S703). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S703), the same determination is continued.

  When it is determined that a certain time has elapsed from the previous information acquisition or the first time (YES in step S703), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S704).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S705), acquires an image of the contents written on the handwritten board 1 by the board information acquisition unit 202 (step S706), It transmits to the management apparatus 4 by the communication means 203 (step S707).

  When the image is received by the communication unit 406 of the management device 4 (step S708), the difference image generation unit 410 requests the projection device 5 to acquire a projection image through the communication unit 406 (step S709).

  When receiving the request through the communication unit 502, the image projection unit 501 of the projection device 5 transmits the projection image to the management device 4 (step S710).

  When the difference image generation unit 410 receives the projection image through the communication unit 406 of the management apparatus 4 (step S711), the difference image generation unit 410 uses the image acquired from the input device 2 and the projection image acquired from the projection device 5 to obtain the user. A difference image that is a portion described by is generated and delivered to the image storage determination unit 402 (step S712). As a method for generating a difference image, the corresponding pixels between the two images are compared, the RGB values of the corresponding pixels are compared, and if the difference between the values is within a threshold, it is determined that the image is a projection image. This process is applied to all pixels, and an image formed from pixels that have not been determined as a projection image is output as a difference image.

  Next, the image storage determination unit 402 determines whether there is an image stored by the image storage unit 401 (step S713).

  If it is determined that there is no image stored (NO in step S713), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S714), and the next image is displayed. The process returns to the determination of the information acquisition timing (step S702).

  When it is determined that there is a stored image (YES in step S713), the image storage determination unit 402 compares the image acquired from the difference image generation unit 410 and the stored image acquired from the image storage unit 401. The latest image of them is compared by the image comparison means 403, and it is determined whether or not they are the same image (steps S715 and S716).

  If it is determined that the images are the same (YES in step S716), the image storage determination unit 402 discards the image acquired from the difference image generation unit 410 (step S717), and determines the information acquisition timing for the next image ( The process returns to step S702).

  When it is determined that the images are not the same (NO in step S716), the image storage determining unit 402 extracts image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S718 and S719).

  If it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S719), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S720). .

  If the erasing period flag is not ON (NO in step S720), it is left as it is. If it is ON (YES in step S720), the erasing period flag is turned off (step S721), and the image is saved by the image saving unit 401. The latest image is deleted, the image acquired from the difference image generation means 410 is stored (step S722), and the process returns to the determination of the information acquisition timing for the next image (step S702).

  When it is determined that the color of the changed portion is the reference value, that is, erasing (YES in step S719), the image storage determining unit 402 determines whether the erasing period flag is ON (step S723). ).

  If the erasure period flag is not ON (NO in step S723), the image storage unit 401 stores the image acquired from the difference image generation unit 410, sets the erasure period flag to ON (step S724), and information about the next image The process returns to the acquisition timing determination (step S702).

  When the deletion period flag is ON (YES in step S723), the image storage unit 401 deletes the latest stored image, stores the image acquired from the difference image generation unit 410 (step S722), and next The process returns to the determination of the information acquisition timing for the image (step S702).

<Eighth Embodiment>
In the eighth embodiment, presentation materials and the like are displayed on a handwritten board by a projector, rear projector, liquid crystal panel, etc., written on the video by handwriting, and images such as presentation materials are included in the acquired image In the case where it is determined that the acquired image is equivalent to the image of the presentation material or the like, the image is not stored but discarded.

  Presentation materials and the like projected on the handwritten board are data already stored as digital data by the user, and it is not necessary to store an image obtained by projecting the data again. In the present embodiment, it is possible to automatically discard an image in which presentation material or the like that is not desired by the user is captured.

  The hardware configuration of the eighth embodiment is the same as that of the seventh embodiment shown in FIG.

  FIG. 16 is a diagram illustrating a functional block configuration example of the board description content recording system according to the eighth embodiment.

  16 is the same as the case of the first embodiment shown in FIG. 2 except that a projection image comparison unit 411 is added to the management apparatus 4 and a projection apparatus 5 is added.

  The projection image comparison unit 411 has a function of acquiring a projection image from the projection device 5 and determining whether the image is equivalent to the image acquired from the input device 2.

  The projection device 5 is the same as that of the seventh embodiment shown in FIG.

  FIG. 17 is a flowchart illustrating an example of processing according to the eighth embodiment.

  In FIG. 17, the image storage determination unit 402 of the management device 4 starts the operation with the erase period flag set to OFF (step S801).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S802 and S803). If it is determined that the predetermined time has not elapsed since the previous information acquisition and it is not the first time (NO in step S803), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S803), the information acquisition timing determination unit 405 instructs the input device 2 to acquire information through the communication unit 406 ( Step S804).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S805), acquires an image of the content written on the handwritten board 1 by the board information acquisition unit 202 (step S806), It transmits to the management apparatus 4 by the communication means 203 (step S807).

  When the image is received by the communication unit 406 of the management device 4 (step S808), the projection image comparison unit 411 requests the projection device 5 to acquire a projection image through the communication unit 406 (step S809).

  When receiving the request through the communication unit 502, the image projection unit 501 of the projection device 5 transmits the projection image to the management device 4 (step S810).

  When the projection image comparison unit 411 receives the projection image through the communication unit 406 of the management device 4 (step S811), the projection image comparison unit 411 compares the image acquired from the input device 2 with the projection image acquired from the projection device 5. It is determined whether the images are the same (steps S812 and S813). As a method for judging whether or not it is equivalent to the projected image, the corresponding pixels between the two images are compared, the RGB values of the corresponding pixels are compared, and if the difference between the values is within a threshold value, the projected image is determined. . This process is applied to all pixels, and if the number of pixels determined to be a projection image is equal to or greater than a threshold value, it is determined as a projection image.

  When it is determined that the images are the same (YES in step S813), the projection image comparison unit 411 instructs the image storage determination unit 402 to discard the image acquired from the input device 2 (step S818), and to determine the next image. The process returns to the information acquisition timing determination (step S802).

  If it is determined that the images are not the same (NO in step S813), the image storage determination unit 402 determines whether there is an image stored by the image storage unit 401 (step S814).

  If it is determined that there is no image stored (NO in step S814), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S815), and the next image is stored. The process returns to the determination of the information acquisition timing (step S802).

  When it is determined that there is a stored image (YES in step S814), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403 to determine whether or not they are the same image (steps S816 and S817).

  If it is determined that the images are the same (YES in step S817), the image storage determination unit 402 discards the image acquired from the input device 2 (step S818), and determines the information acquisition timing for the next image (step S802). Return to).

  When it is determined that the images are not the same (NO in step S817), the image storage determination unit 402 extracts the image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S819 and S820).

  If it is determined that the color of the changed portion is not the reference value, that is, it is an additional writing (NO in step S820), the image storage determination unit 402 determines whether or not the erasure period flag is ON (step S821). .

  If the erasure period flag is not ON (NO in step S821), it is left as it is. If it is ON (YES in step S821), the erasure period flag is turned OFF (step S822), and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S823), and the process returns to the determination of information acquisition timing for the next image (step S802).

  When it is determined that the color of the changed portion is the reference value, that is, erasure (YES in step S820), the image storage determination unit 402 determines whether the erasure period flag is ON (step S824). ).

  When the erasure period flag is not ON (NO in step S824), the image storage unit 401 stores the image acquired from the input device 2, sets the erasure period flag to ON (step S825), and information acquisition timing for the next image Return to the determination (step S802).

  When the erasure period flag is ON (YES in step S824), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S823), and the next image. Return to the determination of the information acquisition timing (step S802).

<Ninth Embodiment>
In the ninth embodiment, an image stored as content written on a handwriting board can be output and displayed on a projection device (projector) provided separately from the handwriting board.

  The handwriting board has a limited space for writing, and it must be erased when there is no space for writing. In this case, since the erased description cannot be visually confirmed, there is a concern that a conference participant forgets the content. In the present embodiment, the contents described in the past can be displayed in a list on the handwriting board, and the contents described in the past can be projected on the projection device, so that the contents of the past examination in the meeting can be confirmed immediately.

  The hardware configuration of the ninth embodiment is the same as that of the seventh embodiment shown in FIG.

  FIG. 18 is a diagram illustrating a functional block configuration example of the board description content recording system according to the ninth embodiment.

  18 is the same as the case of the first embodiment shown in FIG. 2 except that the projection image providing means 412 is added to the management apparatus 4 and the projection apparatus 5 is added.

  The projection image providing unit 412 has a function of providing a projection image to the projection device 5.

  The projection device 5 is the same as that of the seventh embodiment shown in FIG.

  FIG. 19 is a flowchart illustrating an example of processing according to the ninth embodiment. Note that, as in the first embodiment described above, it is determined that it is necessary to save the contents written on the handwriting board 1 and it is assumed that an image determined to be necessary is saved.

  In FIG. 19, when processing is started (step S901), the projection image providing unit 412 of the management apparatus 4 processes all the stored images into a thumbnail or the like, and uses the processed thumbnail images to store the stored images. The list display screen is generated (step S902). For example, the saved time and thumbnail images are paired into a list.

  Next, the projection image providing unit 412 transmits the generated list display screen to the projection device 5 via the communication unit 406 (step S903). For example, the list display screen is transmitted to the projection device 5 at regular intervals in the form of a frame buffer.

  When the image projection unit 501 of the projection apparatus 5 receives the list display screen through the communication unit 502, the image projection unit 501 projects the list display screen onto a screen or the like (step S904).

  Next, the projection image providing unit 412 of the management device 4 causes the user to select a specific image from the list display screen by operating the keyboard or mouse of the management device 4 (for example, moving the cursor on the list display screen, The image to be selected is selected), and the selected image is read from the permanent area 44 and transmitted to the projection device 5 (step S905).

  Receiving the selected image, the image projection unit 501 of the projection device 5 projects the image of the content previously written on the handwriting board 1 on the entire screen (step S906), and proceeds to the next processing (step S907). ).

<Tenth Embodiment>
In the tenth embodiment, an image that is determined to be shared among images stored as contents written on a handwritten board is transmitted to a registered user.

  The handwriting board has a limited space for writing, and it must be erased when there is no space for writing. In this case, since the erased description content cannot be visually confirmed, there is a concern that the participant of the conference forgets the past study content. In this embodiment, by sending an image of the contents written on the handwritten board to the terminal device (general-purpose PC) held by the participants of the meeting, each person confirms the past examination contents at the meeting on the spot can do.

  FIG. 20 is a diagram illustrating a hardware configuration example of the board description content recording system according to the tenth embodiment.

  20 is the same as the case of the first embodiment shown in FIG. 1 except that a terminal device 6 connected to the management device 4 via the network 3 is added.

  The terminal device 6 includes a CPU 62, a memory 53, a permanent area 64, and a network communication control unit 65 connected to the data bus 61. The permanent area 64 is a non-volatile storage device such as an HDD or a flash memory. The network communication control unit 65 is a NIC or the like.

  FIG. 21 is a diagram illustrating a functional block configuration example of the board description content recording system according to the tenth embodiment.

  21 is the same as that of the first embodiment shown in FIG. 2 except that an image providing unit 413 is added to the management device 4 and a terminal device 6 is added.

  The image providing unit 413 has a function of providing an image to the terminal device 6.

  The terminal device 6 includes a display unit 601 and a communication unit 602. The display unit 601 has a function of displaying an image. The communication unit 602 has a function of performing communication between the terminal device 6 and the management device 4 that cooperate with each other.

  FIG. 22 is a flowchart illustrating an example of processing according to the tenth embodiment. Note that, as in the first embodiment described above, it is determined that it is necessary to save the contents written on the handwriting board 1 and it is assumed that an image determined to be necessary is saved.

  In FIG. 22, when processing is started (step S1001), the image providing unit 413 of the management apparatus 4 determines whether there are two or more stored images (step S1002). In the present embodiment, the purpose is to transmit the stored image to the terminal device 6. As will be described later, since there are two types of stored images, the processing triggers that there are at least two images. Yes.

  If it is determined that there are not two or more stored images (NO in step S1002), the process proceeds to the next process (step S1005).

  If it is determined that there are two or more stored images (YES in step S1002), the image providing unit 413 uses the communication unit 406 to select the image having the second latest storage time among the stored images. To the terminal device 6 (step S1003). Here, there are two types of saved files. That is, an image showing the latest description content of the handwriting board 1 and an image including an erased portion (an image showing past examination content) in comparison with the latest description content. The former is an image that is determined to be unnecessary and is deleted when the additional writing occurs because the same content is included in the additional writing when it is not determined whether to leave it permanently. On the other hand, the latter is an image that has been decided to remain permanently as indicating the contents of the past examination. Therefore, it is assumed that only the image indicating the latter examination content is shared. Do not send the latest image as it may still be updated. The transmission target is an image that is stored in the storage time and stored one before the latest image.

  When receiving the image through the communication unit 602, the display unit 601 of the terminal device 6 displays the image (step S1004). Then, the process proceeds to the next process (step S1005).

<Eleventh embodiment>
In the eleventh embodiment, an image that is determined to be shared among images stored as content written on a handwritten board is transmitted to an image forming apparatus such as a printer arranged nearby, and printed. It is made to become.

  The handwriting board has a limited space for writing, and it must be erased when there is no space for writing. In this case, since the erased description content cannot be visually confirmed, there is a concern that the participant of the conference forgets the past study content. In the present embodiment, by printing the contents written on the handwritten board one by one, each person can confirm the past examination contents at the meeting on the spot.

  FIG. 23 is a diagram illustrating a hardware configuration example of the board description content recording system according to the eleventh embodiment.

  FIG. 23 is the same as the case of the first embodiment shown in FIG. 1 except that an image forming apparatus 7 connected to the management apparatus 4 via the network 3 is added.

  The image forming apparatus 7 includes a CPU 72, a memory 73, a plotter device 74, and a network communication control unit 75 connected to the data bus 71. The plotter device 74 is a device that performs printing on paper or the like. The network communication control unit 75 is a NIC or the like.

  FIG. 24 is a diagram showing a functional block configuration example of the board description content recording system in the eleventh embodiment.

  24, the print image providing unit 414 is added to the management apparatus 4 and the image forming apparatus 7 is added, which is the same as in the case of the first embodiment shown in FIG.

  The print image providing unit 414 has a function of providing an image to be printed on the image forming apparatus 7.

  The image forming apparatus 7 includes a printing unit 701 and a communication unit 702. The printing unit 701 has a function of printing an image. The communication unit 702 has a function of performing communication between the cooperative image forming apparatus 7 and the management apparatus 4.

  FIG. 25 is a flowchart showing a processing example of the eleventh embodiment. Note that, as in the first embodiment described above, it is determined that it is necessary to save the contents written on the handwriting board 1 and it is assumed that an image determined to be necessary is saved.

  In FIG. 25, when the process is started (step S1101), the print image providing unit 414 of the management apparatus 4 determines whether there are two or more stored images (step S1102). In the present embodiment, the purpose is to transmit a stored image to the image forming apparatus 7. Since there are two types of stored images, the processing is triggered by at least two images.

  If it is determined that there are not two or more stored images (NO in step S1102), the process proceeds to the next process (step S1105).

  If it is determined that there are two or more stored images (YES in step S1102), the print image providing unit 414 uses the communication unit 406 to select an image stored at the second newest storage time. And transmitted to the image forming apparatus 7 (step S1103).

  When the printing unit 701 of the image forming apparatus 7 receives the image through the communication unit 702, the printing unit 701 prints the image (step S1104). Then, the process proceeds to the next process (step S1105).

<Twelfth Embodiment>
In the twelfth embodiment, if the same image continues for a certain number or more, it is considered that the content of the handwritten board has not been updated and the meeting has been completed, a new folder is created, and the image saved so far is copied. The conference system is terminated.

  In the first embodiment described above, the determination of the start and end of a meeting or the like is left to human hands. However, if the user forgets to end the system, the system will continue to operate, resulting in a waste of electric power required to operate the system. In the present embodiment, it is possible to prevent the system from operating wastefully by automatically determining the end of a meeting or the like.

  The hardware configuration of the twelfth embodiment is the same as that of the first embodiment shown in FIG.

  FIG. 26 is a diagram illustrating a functional block configuration example of the board description content recording system according to the twelfth embodiment.

  26 is the same as the case of the first embodiment shown in FIG. 2 except that an end determination unit 415 is added to the management device 4.

  The end determination means 415 determines whether or not a certain number of the same images have been continuously acquired from the input device 2, and if it is determined that a certain number of the same images have been continuously acquired, the image of the handwriting board 1 that is not updated. It has a function of determining that the conference has ended and executing processing at the end.

  FIG. 27 is a flowchart illustrating a processing example of the twelfth embodiment.

  In FIG. 27, the image storage determination unit 402 of the management device 4 starts the operation with the erase period flag set to OFF (step S1201).

  Next, the information acquisition timing determination unit 405 determines the information acquisition timing using a timer under the control of the CPU 42, and determines whether a certain time has passed since the previous information acquisition or the first time (steps S1202 and S1203). If it is determined that the predetermined time has not elapsed since the previous acquisition of information and it is not the first time (NO in step S1203), the same determination is continued.

  When it is determined that a certain time has passed since the previous information acquisition or the first time (YES in step S1203), the end determination unit 415 determines whether a certain number or more (for example, 20 or more) of the same images have been acquired. (Step S1204).

  If it is determined that a certain number or more of images have been acquired (YES in step S1204), the image storage unit 401 creates a new folder, copies the images stored so far to the folder (step S1205), and ends the processing. (Step S1206).

  If it is determined that the same number of images has not been acquired (NO in step S1204), the information acquisition timing determination unit 405 issues an information acquisition instruction to the input device 2 through the communication unit 406 (step S1207).

  The information acquisition operation control unit 201 of the input device 2 receives an information acquisition instruction through the communication unit 203 (step S1208), acquires an image of the contents written on the handwritten board 1 by the board information acquisition unit 202 (step S1209), It transmits to the management apparatus 4 by the communication means 203 (step S1210).

  When the image is received by the communication unit 406 of the management apparatus 4 (step S1211), the image storage determination unit 402 determines whether there is a stored image by the image storage unit 401 (step S1212).

  If it is determined that there is no image stored (NO in step S1212), the image storage determination unit 402 stores the acquired image in the permanent area 44 by the image storage unit 401 (step S1213), and the next image is displayed. The process returns to the determination of the information acquisition timing (step S1202).

  When it is determined that there is a stored image (YES in step S1212), the image storage determination unit 402 selects the image acquired from the input device 2 and the stored image acquired from the image storage unit 401. The latest image is compared by the image comparison means 403, and it is determined whether or not they are the same image (steps S1214 and S1215).

  If it is determined that the images are the same (YES in step S1215), the image storage determination unit 402 discards the image acquired from the input device 2 (step S1216), and determines the information acquisition timing for the next image (step S1202). Return to).

  If it is determined that the images are not the same (NO in step S1215), the image storage determination unit 402 extracts the image information (position, color) of the changed part in the image by the image information extracting unit 404, and It is determined whether or not the color is a reference value (steps S1217 and S1218).

  When it is determined that the color of the changed portion is not the reference value, that is, it is additional writing (NO in step S1218), the image storage determining unit 402 determines whether or not the erasure period flag is ON (step S1219). .

  If the erasure period flag is not ON (NO in step S1219), it is left as it is. If it is ON (YES in step S1219), the erasure period flag is turned off (step S1220) and the image is stored by the image storage unit 401. The latest image is deleted, the image acquired from the input device 2 is stored (step S1221), and the process returns to the determination of the information acquisition timing for the next image (step S1202).

  If it is determined that the color of the changed portion is the reference value, that is, erasure (YES in step S1218), the image storage determination unit 402 determines whether the erasure period flag is ON (step S1222). ).

  If the erase period flag is not ON (NO in step S1222), the image storage unit 401 stores the image acquired from the input device 2, sets the erase period flag to ON (step S1223), and information acquisition timing for the next image Return to the determination (step S1202).

  When the deletion period flag is ON (YES in step S1222), the image storage unit 401 deletes the latest stored image, stores the image acquired from the input device 2 (step S1221), and the next image. The process returns to the determination of the information acquisition timing (step S1202).

<Summary>
According to the embodiment described above, no human effort is required, the searchability is excellent, the capacity of the data storage location is not compressed, and all contents including the contents erased in the middle are not redundant. It can be stored in a comprehensive manner.

  In addition, the above-described embodiments can be implemented alone or in combination.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments, various modifications and changes may be made to the embodiments without departing from the broad spirit and scope of the invention as defined in the claims. Obviously you can. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

1 Handwritten board 2 Input device 21 Data bus 22 CPU
DESCRIPTION OF SYMBOLS 23 Memory 24 Board information acquisition part 25 Network communication control part 201 Information acquisition operation control means 202 Board information acquisition means 203 Communication means 3 Network 4 Management apparatus 41 Data bus 42 CPU
DESCRIPTION OF SYMBOLS 43 Memory 44 Permanent area | region 45 Network communication control part 401 Image preservation | save means 402 Image preservation | save judgment means 403 Image comparison means 404 Image information extraction means 405 Information acquisition timing judgment means 406 Communication means 407 Image classification means 408 Color identification means 409 Symbol identification means 410 Difference image generating means 411 Projected image comparing means 412 Projected image providing means 413 Image providing means 414 Print image providing means 415 Termination judging means 5 Projecting device 51 Data bus 52 CPU
53 Memory 54 Projection Processing Unit 55 Network Communication Control Unit 501 Image Projection Unit 502 Communication Unit 6 Terminal Device 61 Data Bus 62 CPU
63 Memory 64 Permanent Area 65 Network Communication Control Unit 601 Display Unit 602 Communication Unit 7 Image Forming Device 71 Data Bus 72 CPU
73 Memory 74 Plotter Device 75 Network Communication Control Unit 701 Printing Unit 702 Communication Unit

JP 2010-003197 A

Claims (18)

Board information acquisition means for capturing the contents written on the handwritten board as an image;
Image storage determining means for determining whether to store the image acquired from the board information acquiring means;
Image storage means for storing the image determined to be stored in the permanent area,
The image storage judging means is
If there is no saved image, save the captured image,
If the captured image is the same as the latest saved image, discard the captured image,
If the captured image is not the same as the latest saved image and it is an appending, delete the latest saved image, save the captured image,
If the captured image is not the same as the latest saved image and it is the start of erasure, save the captured image,
If the captured image is not the same as the latest saved image and it is a continuation of erasure, delete the latest saved image and save the captured image. The board description content recording system. In the board description content recording system according to claim 1,
Image comparison means for comparing the captured image with the latest stored image and determining whether the images are the same;
When the captured image and the latest stored image are not the same, the image information extracting means for extracting image information including the color of the changed portion is provided,
The image storage determining means determines whether the additional recording or the erasure is performed depending on whether the color of the changed portion between the captured image and the latest stored image is a reference value corresponding to the background color of the handwriting board. Board description content recording system, characterized in that it is determined whether or not. In the board description content recording system according to any one of claims 1 and 2,
The image storage determination means determines the start and continuation of erasure based on an erasure period flag that is turned on when the initial value is OFF and the erasure is detected and turned off when the additional recording is detected A board description content recording system. In the board description content recording system according to any one of claims 1 to 3,
Image classification means for detecting that the handwriting board has been initialized from the feature amount of the image acquired from the board information acquisition means,
When the initialization of the handwritten board is detected, the image storage unit generates a new image storage folder, and classifies and stores the images in the image storage folder. In the board description content recording system according to any one of claims 1 to 3 ,
A color identification unit for determining whether or not a description by a specific color is included in the image acquired from the board information acquisition unit;
The board description recording system according to claim 1, wherein when it is determined that a specific color is included, the image storage determination unit changes processing. In the board description content recording system according to claim 5,
The board recording content recording system, wherein the image storage determining means determines that the image is not stored when it is determined that a specific color is included. In the board description content recording system according to claim 5,
The image storage determining means, when it is determined that a specific color is included, determines that the image is stored in a specific image storage destination different from the default storage destination Content recording system. In the board description content recording system according to any one of claims 1 to 3, 5 to 7 ,
A symbol identifying means for judging whether a description of a specific symbol is included in the image obtained from the board information obtaining means,
The board description content recording system, wherein when it is determined that a specific symbol is included, the image storage determination means changes processing. In the board description content recording system according to claim 8,
The board recording content recording system, wherein the image storage determining means determines that the image is not stored when it is determined that a specific symbol is included. In the board description content recording system according to claim 8,
The board description is characterized in that, when it is determined that a specific symbol is included, the image storage determination unit determines to store the image in a storage destination for a specific image different from a default storage destination. Content recording system. In the board description content recording system according to any one of claims 1 to 3, 5 to 10 ,
Obtaining a projection image from a projection device that projects a predetermined image on the handwriting board, and comprising difference image generation means for generating a difference image from the image obtained from the board information acquisition means,
The board storage content recording system, wherein the image storage determination unit sets the difference image as a storage target. In the board description content recording system according to any one of claims 1 to 3, 5 to 11 ,
A projection image comparison unit that acquires a projection image from a projection device that projects a predetermined image on the handwriting board and determines whether the image is equivalent to the image acquired from the board information acquisition unit;
When it is determined that the images are equivalent to each other, the image storage determination unit determines that the image is not stored. In the board description content recording system according to any one of claims 1 to 3, 5 to 12 ,
Provided is a projection image providing unit that provides a list display screen of images stored by the image storage unit to a predetermined image projection device and provides an image selected by the user from the list display screen to the image projection device. A board description content recording system. In the board description content recording system according to any one of claims 1 to 3, 5 to 13 ,
An on-board content recording system comprising image providing means for providing an image saved by the image saving means to a predetermined terminal device. In the board description content recording system according to any one of claims 1 to 3, 5 to 14 ,
A board description content recording system comprising print image providing means for providing an image stored by the image storage means to a predetermined image forming apparatus. In the board description content recording system according to any one of claims 1 to 3, 5 to 15 ,
It is determined whether or not the same number of images acquired from the board information acquisition means have been continuously acquired. If it is determined that the same image has been continuously acquired more than a certain number, the processing at the end is executed. A board description content recording system comprising an end determination means. Image storage determination means for determining whether to save the image acquired from the board information acquisition means for capturing the contents described in the handwritten board as an image;
Image storage means for storing the image determined to be stored in the permanent area,
The image storage judging means is
If there is no saved image, save the captured image,
If the captured image is the same as the latest saved image, discard the captured image,
If the captured image is not the same as the latest saved image and it is an appending, delete the latest saved image, save the captured image,
If the captured image is not the same as the latest saved image and it is the start of erasure, save the captured image,
If the captured image is not the same as the latest saved image and it is a continuation of erasure, delete the latest saved image and save the captured image. Management device. The computers that make up the management device
Image storage determining means for determining whether or not to save the image acquired from the board information acquiring means that captures the contents written on the handwritten board as an image;
Function as an image storage means to store the image determined to be stored in the permanent area,
The image storage judging means is
If there is no saved image, save the captured image,
If the captured image is the same as the latest saved image, discard the captured image,
If the captured image is not the same as the latest saved image and it is an appending, delete the latest saved image, save the captured image,
If the captured image is not the same as the latest saved image and it is the start of erasure, save the captured image,
If the captured image is not the same as the latest saved image and it is a continuation of erasure, the management device control program saves the captured image after deleting the latest saved image .

Images