JP7443685B2 - Display device, display method, display program - Google Patents

Description

The present invention relates to a display device, a display method, and a display program.

2. Description of the Related Art Display devices that display images input by hand on a screen have been known. In this display device, when the user performs an operation instructing to save the image data displayed on the screen, the image data is saved.

In the conventional display devices described above, if you forget to save the data and turn off the power, or if you display other image data, the displayed content on the screen will not be saved and may be displayed contrary to the user's intention. The content (information) displayed on the screen will be erased.

The purpose of the disclosure technology is to prevent information from being erased against the intended purpose.

The disclosed technology includes a display control unit that displays a superimposed image obtained by superimposing images drawn on each of a plurality of layers, and when an image of a specified color is input, the image is displayed as , a layer generation unit that causes drawing in a layer associated with the specified color; and a specification screen for specifying a color to be saved and a color to be prohibited from being saved to be displayed by the display control unit; The color to be saved specified on the screen is associated with a layer for automatic saving among the plurality of layers, and the color for which saving is prohibited is associated with a layer for which saving is prohibited among the plurality of layers. a designation section; a layer storage section that saves the image data of the image drawn on the automatic storage layer in a layer storage section at predetermined intervals; and when an instruction to save the superimposed image of the plurality of layers is received; and a page generation unit that generates superimposed image data representing a superimposed image drawn on a layer other than the storage-prohibited layer from the superimposed image, and stores the generated superimposed image data in a page storage unit.

Prevent information from being erased against intention.

It is a figure explaining an electronic blackboard. FIG. 2 is a diagram showing an example of the hardware configuration of an electronic whiteboard. FIG. 2 is a diagram illustrating the functional configuration of the electronic whiteboard of the first embodiment. FIG. 2 is a first diagram illustrating an image displayed on the display of the electronic blackboard according to the first embodiment. FIG. 7 is a second diagram illustrating an image displayed on the display of the electronic whiteboard of the first embodiment. It is a figure explaining page data of a first embodiment. FIG. 3 is a diagram illustrating image data for automatic storage according to the first embodiment. It is a first flowchart explaining the operation of the electronic whiteboard of the first embodiment. FIG. 3 is a diagram illustrating an example of a color specification screen according to the first embodiment. It is a second flowchart explaining the operation of the electronic whiteboard of the first embodiment. FIG. 3 is a first diagram illustrating automatic saving in the first embodiment. FIG. 3 is a second diagram illustrating automatic saving in the first embodiment. FIG. 7 is a third diagram illustrating automatic saving in the first embodiment. FIG. 7 is a diagram illustrating an image displayed on the display of the electronic whiteboard according to the second embodiment. FIG. 7 is a diagram illustrating a functional configuration of an electronic whiteboard according to a second embodiment. It is a flowchart explaining the operation of the electronic whiteboard of the second embodiment. FIG. 7 is a diagram showing an example of a color specification screen according to the second embodiment. FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system including an electronic blackboard. FIG. 3 is a diagram illustrating an information processing system according to a third embodiment. FIG. 7 is a first diagram showing a modification of the information processing system. FIG. 7 is a second diagram showing a modification of the information processing system. It is a third diagram showing a modification of the information processing system.

(First embodiment)
This embodiment will be described below with reference to the drawings. FIG. 1 is a diagram illustrating an electronic blackboard.

The electronic whiteboard 200 of this embodiment includes a short-range communication circuit 219, a power switch 222, a display 280, and a camera 260. When the power switch 222 of the electronic whiteboard 200 is pressed, a display control unit (described later) causes the display 280 to display a drawing screen on which drawing can be performed using an electronic pen or a user's finger. Therefore, the electronic whiteboard 200 is an example of a display device, and the display 280 is an example of a display section of the display device.

Further, the electronic whiteboard 200 of this embodiment draws an image of a pre-designated color among the images drawn on the display 280 in a layer associated with the designated color. Then, the electronic blackboard 200 automatically saves the image drawn in the layer associated with the color, regardless of whether there is an operation to instruct saving the contents of the screen displayed on the display 280.

Therefore, in this embodiment, it is possible to suppress information from being deleted contrary to the user's intention, such as when the user forgets to perform a save operation.

The hardware configuration of the electronic whiteboard 200 of this embodiment will be described below with reference to FIG. 2. FIG. 2 is a diagram showing an example of the hardware configuration of the electronic whiteboard.
FIG. 2 is a hardware configuration diagram of the electronic whiteboard. As shown in FIG. 2, the electronic whiteboard 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network I/ F205 and an external device connection I/F (Interface) 206.

Among these, the CPU 201 controls the entire operation of the electronic whiteboard 2 . The ROM 202 stores programs used to drive the CPU 201, such as the CPU 201 and an IPL (Initial Program Loader). RAM 203 is used as a work area for CPU 201. The SSD 204 stores various data such as electronic whiteboard programs.

Network I/F 205 controls communication with a communication network. External device connection I/F 206 is an interface for connecting various external devices. The external devices in this case are, for example, a USB (Universal Serial Bus) memory 230 and external devices (microphone 240, speaker 250, camera 260).

The electronic whiteboard 200 also includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, an antenna 219a of the short-range communication circuit 219, a power switch 222, and Selection switches 223 are provided.

Among these, the capture device 211 causes the display of an external PC (Personal Computer) 270 to display video information as a still image or a moving image. A GPU (Graphics Processing Unit) 212 is a semiconductor chip that specializes in graphics.
The GPU 212 may be built into the CPU 201 or may be integrated with the CPU 201.

The display controller 213 controls and manages screen display in order to output the output image from the GPU 212 to the display 280 or the like. The contact sensor 214 detects when the electronic pen 290, the user's hand H, or the like comes into contact with the display 280. Sensor controller 215 controls processing of contact sensor 214.

The contact sensor 214 performs coordinate input and coordinate detection using an infrared cutoff method. This method of inputting and detecting coordinates is such that two light receiving and emitting devices installed at both ends of the upper side of the display 280 emit a plurality of infrared rays in parallel to the display 280. This is a method of receiving light that is reflected by a reflecting member and returns along the same optical path as the light emitted by the light receiving element. The contact sensor 214 outputs the ID of the infrared rays emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 215, and the sensor controller 215 identifies the coordinate position that is the contact position of the object.

The electronic pen controller 216 communicates with the electronic pen 290 to determine whether or not the display 280 is touched with the tip of the pen or the end of the pen. The near field communication circuit 219 is a communication circuit such as NF (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for switching the power of the electronic whiteboard 2 ON/OFF. The selection switches 223 are, for example, a group of switches for adjusting the brightness, shade, etc. of the display on the display 280.

Further, the electronic whiteboard 2 includes a bus line 210. The bus line 210 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 201 shown in FIG. 2.

Note that the contact sensor 214 is not limited to the infrared cutoff type, but can also be a capacitive type touch panel that identifies the contact position by detecting changes in capacitance, or a capacitive touch panel that identifies the contact position by detecting changes in the voltage of two resistive films facing each other. Various detection means may be used, such as a resistive touch panel that uses a resistive film, or an electromagnetic induction touch panel that detects electromagnetic induction caused by a contact object coming into contact with the display section to specify the contact position. Furthermore, the electronic pen controller 216 may determine whether or not a portion of the electronic pen 290 that the user grasps or other portions of the electronic pen is touched, in addition to the pen tip and pen tail of the electronic pen 290.

Further, in this embodiment, the camera 260 is an example of a proximity sensor that detects when the electronic pen 290 or the hand H approaches the display 280, but the electronic blackboard 200 uses a projected capacitive type proximity sensor. It may have a touch panel, an infrared sensor, etc.

Next, with reference to FIG. 3, the functional configuration of the electronic whiteboard 200 of this embodiment will be described. FIG. 3 is a diagram illustrating the functional configuration of the electronic whiteboard.

The electronic blackboard 200 of this embodiment includes a page storage section 320, a layer storage section 330, an input section 341, a page generation section 342, a display control section 343, a color specification section 344, a layer generation section 345, and a layer storage section 346.

The page storage unit 320 and layer storage unit 330 of this embodiment are constructed by, for example, the RAM 203, the SDD 204, or the USB memory 230. Furthermore, the input unit 341, page generation unit 342, display control unit 343, color specification unit 344, layer generation unit 345, and layer storage unit 346 of this embodiment include any of the components shown in FIG. , a function realized by operating in accordance with an instruction from the CPU 201 according to a program expanded from the SSD 204 onto the RAM 203, or a means for functioning.

The page storage unit 320 stores page data displayed on the display 280 of the electronic blackboard 200. The page data stored in the page storage unit 320 may be, for example, stroke image data representing a stroke image drawn on the display 280, or may be image data obtained from an external source.

The stroke image is an image of the trajectory of each stroke input by hand onto the display 280 of the electronic whiteboard 200 using the electronic pen 290, the user's finger, or the like.

Further, the page data may be image data of a superimposed image obtained by superimposing the image displayed on the display 280 and the stroke image input to the display 280. Details of the image data displayed on the display 280 will be described later.

The layer storage unit 330 stores stroke image data drawn on a specific layer included in the superimposed image displayed on the display 280.

Specifically, the specific layer is a layer in which a stroke image of a color specified by the color specifying unit 344 is drawn among the stroke images drawn by hand or by the electronic pen 290 on the display 280. In other words, the specific layer is a layer associated with the color specified by the color specifying section 344.

The layer storage unit 330 stores image data of a stroke image drawn in a specified color in a specific layer. Note that the image drawn in the specified color on a specific layer may be an image other than a stroke image. For example, a stamp image of a specified color may be drawn on a specific layer. A stamp image is, for example, an image that expresses feelings and messages in addition to text through illustrations.

The input unit 341 acquires stroke images representing characters and images handwritten into the display 280, image data of images displayed on a touch panel provided on the display 280, and the like.

The input unit 341 also acquires video data captured by the camera 260 and the like. In this embodiment, video data is included in image data. Furthermore, the input unit 341 receives various instructions for the electronic whiteboard 200. The input unit 341 also obtains input image data and the like that are output from the PC 270 and the like and input to the electronic whiteboard 200.

The page generation unit 342 acquires image data of one page of images (display image) displayed on the display 280. Furthermore, when a stroke image is input to one page of images, the page generation unit 342 acquires stroke image data indicating the stroke image.

Specifically, the page generation unit 342 obtains image data of a superimposed image obtained by superimposing an input image inputted to the display 280, a stroke image, etc., and stores it in the page storage unit 320. Note that if no stroke image is input to the display 280, the page generation unit 342 uses the image displayed on the display 280 as image data.

Further, when a stroke image is input to the display 280, the page generation unit 342 stores stroke image data indicating the stroke image in the page storage unit 320 as image data.

In this way, the page generation unit 342 of this embodiment is a generation unit that generates page data from the image data displayed on the display 280 and the stroke image data indicating the stroke image input to the display 280.

The display control unit 343 controls various displays on the display 280. Specifically, for example, the display control unit 343 causes the display 280 to display a specification screen for specifying the color of the stroke image to be automatically saved.

The color designation unit 344 instructs the display control unit 343 to display a screen for designating a color. When a color is specified on the display 280, the color specifying unit 344 notifies the layer generating unit 345 of the specified color. Furthermore, the color specifying unit 344 associates the specified color with a layer included in the superimposed image displayed on the display 280. Note that the color specifying unit 344 may associate a specified color with a layer created in advance, or when a color is specified, it may generate a layer that is associated with this color.

The layer generation unit 345 determines whether or not the input stroke image has the specified color, and if it is the specified color, the layer generation unit 345 transfers the stroke image to a layer associated with the specified color. draw. This layer is a layer on which a stroke image of a specified color is drawn, and the stroke image drawn on this layer is automatically saved.

Further, the layer generation unit 345 generates image data in which a layer on which a stroke image of the specified color is drawn and a layer on which a background image is displayed are superimposed. In the following description, the image data generated by the layer generation unit 345 may be expressed as image data for automatic storage. Furthermore, in the following description, an image indicating image data for automatic storage may be referred to as an image for automatic storage.

Furthermore, when a stroke image with a color other than the specified color is selected and the color of this stroke image is changed to the specified color, the layer generation unit 345 automatically generates the stroke image with the changed color. Draw on a storage layer.

The layer storage unit 346 stores the image data for automatic storage generated by the layer generation unit 345 in the layer storage unit 330.

Next, images displayed on display 280 will be described with reference to FIGS. 4A and 4B. FIG. 4A is a first diagram illustrating an image displayed on the display of the electronic whiteboard according to the first embodiment. FIG. 4B is a second diagram illustrating an image displayed on the display of the electronic whiteboard of the first embodiment.

(A) of FIG. 4A is a diagram illustrating images to be superimposed, and (B) of FIG. 4A is a diagram illustrating an example of the superimposed image. FIG. 4B is a diagram illustrating an example of an image for automatic storage.

In the electronic whiteboard 200 of this embodiment, the display control unit 343 displays the input image acquired by the input unit 341, the stroke image, the UI (User Interface) image, and the background image in a superimposed manner according to a prespecified layout. let

Note that the UI image is an image set in advance. Further, the background image is, for example, a plain image or an image including grid lines, and is media data included in the superimposed image. Media data is data for displaying a background image on the display 280.

As shown in FIG. 4A, the display control unit 343 includes a layer 41 for displaying a UI image, a layer 42 for displaying a stroke image of a specified color, a layer 43 for displaying a stroke image, and a layer 43 for displaying a stroke image from the PC. It has a layer 44 for displaying an input image that is output and input to the electronic whiteboard 200, and a layer 45 for displaying a background image.

The layer 42 is a layer associated with a color specified by the color specification section 344, and is an automatic storage layer in which a stroke image of the color specified by the layer generation section 345 is drawn.

In this embodiment, the layer generation unit 345 generates image data in which the layers 42 and 45 are superimposed and uses it as image data for automatic storage, and the layer storage unit 346 stores the image data for automatic storage in layer storage. 330.

Further, the display control unit 343 of the present embodiment is configured such that when the user of the electronic whiteboard 200 views the display 280, the layer 41 is the first layer, the layer 42 is the second layer, the layer 43 is the third layer, and the layer 44 is the fourth layer. Each layer is superimposed so that layer 45 becomes the fifth layer.

The display control unit 343 then controls the image data of the UI image (UI image data), the stroke image data of the specified color, the stroke image data of a color other than the specified color, the image data of the input image (input image data), the background The image data of the four-layer superimposed image 40 is generated by combining the image data (background image data) of the images.

That is, the superimposed image 40 of this embodiment is an image obtained by combining images displayed on each layer of the display 280, as shown in FIG. 4A (B).

Further, the automatic storage image 40A of this embodiment is an image obtained by superimposing the stroke image data displayed on the layer 42 of the display 280 and the background image data displayed on the layer 45, as shown in FIG. 4B. .

Next, with reference to FIG. 5, page data stored in the page storage unit 320 of this embodiment will be described. FIG. 5 is a diagram illustrating page data of the first embodiment.

The page generation unit 342 of the electronic whiteboard 200 of this embodiment may generate page data having a structure as shown in FIG. 5 and store it in the page storage unit 320.

The page data of this embodiment includes page data ID, start time, end time, stroke array data ID, and media data ID as information items.

The value of the item "start time" indicates the time when the page display started. The value of the item "end time" indicates the time when updating of page data ended. The value of the item "stroke array data ID" indicates identification information for identifying stroke array data generated by inputting a stroke image. The stroke array data of this embodiment includes coordinate information of a point group indicating a specific shape. In other words, the stroke array data of this embodiment is stroke information that is a group of points indicating the locus of each stroke.

The value of the item "media data ID" indicates identification information for identifying media data. Media data is data for displaying a background image on the display 280.

In this manner, in this embodiment, when saving page data, the stroke array data for displaying the input stroke image on the display 280 is associated with the page data.

Furthermore, in this embodiment, if no stroke image is input, there is no stroke array data associated with the page data, so the value of the item "stroke array data ID" in the page data is blank.

For example, in the example of FIG. 5, page data ID "pg001" is associated with stroke array data ID "st001". Therefore, it can be seen that the superimposed image that is the source of the page data ID "pg001" includes a stroke image.

Furthermore, in the example of FIG. 5, the page data ID "pg002" does not have the value of the stroke array data ID input. Therefore, it can be seen that the superimposed image that is the source of the page data ID "pg002" does not include a stroke image.

Next, with reference to FIG. 6, image data for automatic storage stored in the layer storage unit 330 of this embodiment will be described. FIG. 6 is a diagram illustrating image data for automatic storage according to the first embodiment.

The layer generation unit 345 of this embodiment may generate image data having a structure as shown in FIG. 6 and store it in the layer storage unit 330.

The image data for automatic storage in this embodiment has data ID, page data ID, stroke array data ID, and media data ID as information items, and the item "data ID" is associated with other items. It is being

The value of the item "data ID" is identification information for specifying image data for automatic storage. The value of the item "page data ID" is a value for specifying page data that includes the layer 42 for automatic storage. The value of the item "Page data ID" is a value given when an operation instructing to save page data including layer 42 is performed and the page data including layer 42 is stored in the page storage unit 320. It is.

The value of the item "stroke array data ID" indicates identification information for identifying stroke array data generated by inputting a stroke image of a specified color.

The value of the item "media data ID" indicates identification information for identifying the media data that was being displayed when the stroke image of the specified color was input.

In the example of FIG. 6, the image data for automatic storage specified by the data ID "R01" is associated with the page data specified by the page data ID "pg001." Therefore, it can be seen that the page data including the image data for automatic storage specified by the data ID "R01" is saved by an operation instructing to save the page data.

In addition, the image data for automatic storage specified by the data ID "R01" is a superimposed stroke image specified by the stroke array data ID "st101" and the background image specified by the media data ID "m001". It can be seen that the image data is

On the other hand, the value of the page data ID corresponding to the image data for automatic storage specified by the data ID "R02" is empty. Therefore, it can be seen that no operation was performed to instruct the storage of the page data including the image data for automatic storage specified by the data ID "R02".

Furthermore, the image data for automatic storage specified by data ID "R02" is a combination of a stroke image specified by stroke array data ID "st103" and a background image specified by media data ID "m003". It can be seen that the image data is

Next, with reference to FIG. 7, the operation of the electronic whiteboard 200 of this embodiment will be described. FIG. 7 is a first flowchart illustrating the operation of the electronic whiteboard 200 of the first embodiment.

The electronic whiteboard 200 of this embodiment determines whether or not the input unit 341 has received an input of a stroke image (step S701). In step S701, if the input of a stroke image is not accepted, the process waits until the input of a stroke image is accepted.

When the input of a stroke image is accepted in step S701, the electronic whiteboard 200 uses the layer generation unit 345 to determine whether the input stroke image has a specified color (step S702). In step S702, if the color is not the specified color, the process advances to step S708, which will be described later.

In step S702, if the stroke image has the specified color, the layer generation unit 345 draws the input stroke image on a layer for automatic storage (step S703).

Subsequently, the electronic whiteboard 200 determines whether a predetermined time has elapsed (step S704). In step S704, if the predetermined time has not elapsed, the electronic whiteboard 200 returns to step S701. In step S704, if the predetermined time has elapsed, the electronic whiteboard 200 causes the layer generation unit 345 to generate image data for automatic storage on which the background image layer (layer 45) of the layer for automatic storage (layer 42) is superimposed. It is generated and stored in the layer storage unit 330 by the layer storage unit 346 (step S705).

Subsequently, the electronic whiteboard 200 determines whether or not the input unit 341 receives an operation for instructing to save the entire page (step S706). If the save instruction is accepted in step S706, the electronic blackboard 200 uses the page generation unit 342 to generate page data in which all the layers are superimposed and stores it in the page storage unit 320 (step S707), and ends the process. .

Further, in step S702, if the input stroke image is not a stroke image of the specified color, the electronic blackboard 200 draws on a layer (layer 43) for displaying the stroke image, and proceeds to step S706.

In this way, in this embodiment, the stroke image drawn on the automatic storage layer is automatically saved regardless of whether there is an instruction to save the page data.

Therefore, for example, by inputting important information using a stroke image of a specified color, the user can save the content they want to save even if they forget to save the page data. .

Note that in the example of FIG. 7, image data for automatic storage is generated and stored in the layer storage unit 330 each time a stroke image of a specified color is input, but the invention is not limited to this. In this embodiment, for example, image data for automatic storage may be generated and stored in the layer storage unit 330 at regular intervals.

That is, in this embodiment, the layer generation unit 345 may generate image data for automatic storage at predetermined intervals, and the layer storage unit 346 may store the image data in the layer storage unit 330.

In other words, the predetermined interval may be an interval from when a stroke image of a specified color is input until a stroke image of the next specified color is input, or it may be a predetermined interval. It's okay.

Note that in this embodiment, even images other than stroke images may be drawn on the automatic storage layer 42 as long as they are input in a specified color. Images other than stroke images include, for example, stamp images.

The designation of the color of a stroke image according to this embodiment will be described below with reference to FIG. 8. FIG. 8 is a diagram showing an example of a color specification screen according to the first embodiment. A screen 81 shown in FIG. 8 is displayed on the display 280, for example.

On the screen 81, a message 82 prompting the user to specify a color to be automatically saved and a list 83 of colors are displayed. In the example of FIG. 8, since "red" and "blue" are selected in the list 83, the electronic blackboard 200 automatically distinguishes between stroke images input in red and stroke images input in blue. Saved in In other words, the color specified on the screen 81 is associated with the layer 42 for automatic storage by the color specifying section 344.

In the example of FIG. 8, a case has been described where a plurality of colors are specified, but a single color may be specified.

Furthermore, in this embodiment, the color of a stroke image drawn in a color other than the specified color can be changed to the specified color. The stroke image whose color has been changed to the specified color is deleted from the layer 42 for drawing stroke images, and is drawn on the layer 42 for automatic storage.

The processing will be explained below. FIG. 9 is a second flowchart illustrating the operation of the electronic whiteboard of the first embodiment.

The electronic whiteboard 200 of this embodiment determines whether or not the input unit 341 has received a selection of a stroke image whose color is to be changed on the display 280 (step S901). In step S901, if the selection of a stroke image is not accepted, the process waits until the selection of a stroke image is accepted.

Upon receiving the selection of a stroke image whose color is to be changed in step S901, the layer generation unit 345 changes the color of the selected stroke image to the specified color (step S902).

Next, the layer generation unit 345 draws the selected stroke image on the layer 42 for automatic storage (step S903), and erases the selected stroke image from the layer 43 for displaying the stroke image. (Step S904), the process ends.

A case in which the color of a stroke image is changed and automatically saved will be described below with reference to FIGS. 10 to 12.

FIG. 10 is a first diagram illustrating automatic storage in the first embodiment. FIG. 10(A) shows a superimposed image 40-1 displayed on the display 280, and FIG. 10(B) shows a layer 42-1 and a layer 43-1 included in the superimposed image 40-1.

In the superimposed image 40-1, the stroke image representing the characters "ABC" is drawn in the specified color, and therefore is drawn on the layer 42-1. Furthermore, in the superimposed image 40-1, the stroke image indicating the characters "DEF" is drawn in a color other than the designated color, and therefore is drawn on the layer 43-1.

FIG. 11 is a second diagram illustrating automatic storage in the first embodiment. FIG. 11(A) shows a superimposed image 40-2 displayed on the display 280, and FIG. 11(B) shows a layer 42-2 and a layer 43-3 included in the superimposed image 40-2.

The superimposed image 40-2 shows a state in which the stroke image indicating the letter "D" in the superimposed image 40-1 has been selected as the stroke image whose color is to be changed, and has been changed to the stroke image of the specified color. ing.

In this case, the stroke image representing the letter "D" is a stroke image of the specified color, and therefore is drawn on the automatic storage layer 42-2. Furthermore, in the layer 43-2, the character "D" drawn in the layer 43-1 before the color change is erased.

Note that in this embodiment, a plurality of layers for automatic storage and a plurality of layers for displaying stroke images may be provided. FIG. 12 is a third diagram illustrating automatic storage in the first embodiment.

In the example of FIG. 12, the superimposed image 40-3 includes layers 42-3 and 42-4 for automatic storage, and layers 43-3 and 43-4 for displaying stroke images.

Layers 42-3 and 42-4 are layers for automatic storage that are associated with each of a plurality of designated colors. Specifically, a red stroke image is drawn on the layer 42-3, and a blue stroke image is drawn on the layer 42-4.

Furthermore, in the example of FIG. 12, layers 43-3 and 43-4 for displaying stroke images are provided for each color. Specifically, for example, the layer 43-3 is a layer where a green stroke image is drawn, and the layer 43-4 is a layer where a black stroke image is drawn. In this embodiment, layers drawn for each color may be separated in this way.

In this way, in this embodiment, the layer 42 for automatic storage is provided, and the stroke image drawn in the color associated with the layer 42 for automatic storage is automatically saved. More specifically, in this embodiment, a stroke image drawn in a specified color is drawn on an automatic storage layer, and image data in which this layer and a background image layer are superimposed is automatically generated. save.

Therefore, according to the present embodiment, it is possible to prevent information from being deleted against the user's intention due to forgetting to save the information or the like.

Additionally, in this embodiment, a stroke image input in a specified color is drawn on an auto-save layer, and the image on the auto-save layer is saved, so when reading the auto-saved stroke image data, In this case, it is only necessary to read out the image data of the layer for automatic storage, and the load of the readout process can be reduced.

(Second embodiment)
The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that a layer is provided in which drawn stroke images are not saved even when an instruction to save page data is given. Therefore, in the following explanation of the second embodiment, differences from the first embodiment will be explained, and the explanation of the first embodiment will be used for those having the same functional configuration as the first embodiment. The same reference numerals as used will be given, and the explanation thereof will be omitted.

FIG. 13 is a diagram illustrating an image displayed on the display of the electronic whiteboard according to the second embodiment.

FIG. 13(A) is a diagram illustrating images to be superimposed, and FIG. 13(B) is a diagram illustrating an example of the superimposed image.

In this embodiment, a layer 41 for displaying a UI image, a layer 42 for automatic storage, a layer 43 for displaying a stroke image, and a layer for displaying an input image output from a PC and input to the electronic blackboard 200 44. In addition to the background image layer 45, it includes a layer 42A in which storage of displayed images is prohibited. In the following description, the layer 42A in which storage of stroke images is prohibited may be expressed as a storage prohibited layer 42A.

The image drawn on the storage-prohibited layer 42A is, for example, a stroke image or a stamp image of a pre-designated color. The image drawn on the storage-prohibited layer 42A is erased when the page data is stored.

Therefore, in this embodiment, when the superimposed image 40B displayed on the display 280 is saved as page data, it is saved as a superimposed image in which layers other than the storage-prohibited layer 42A are superimposed.

That is, in the present embodiment, when the superimposed image 40B is displayed on the display 280 and an instruction to save page data is received, the superimposed image 40 ((B in FIG. 4A) in which the stroke image 47 is deleted from the superimposed image 40B) A superimposed image showing the reference) is saved.

Therefore, in this embodiment, when inputting highly confidential information at a meeting or the like, for example, by inputting a stroke image in a color specified as a color that is prohibited from being saved, this information can be saved. Can be prohibited. Therefore, for example, in this embodiment, even if page data saved during this meeting is output as minutes, stroke images input in a color that prohibits storage will not be output, and highly confidential parts will be output. This saves you the trouble of filling in black.

FIG. 14 is a diagram illustrating the functional configuration of the electronic whiteboard according to the second embodiment. The electronic blackboard 200A of this embodiment includes a page storage section 320, a layer storage section 330, an input section 341, a page generation section 342A, a display control section 343, a color specification section 344A, a layer generation section 345, and a layer storage section 346.

The page generating section 342A of this embodiment includes a drawing erasing section 349. The drawing erasing unit 349 erases an image of a color designated as a color whose storage is prohibited when generating page data. In other words, the drawing erasing unit 349 erases the stroke image drawn on the layer 42A when generating page data.

The color specifying unit 344A of this embodiment instructs the display control unit 343 to display a screen for specifying a color whose storage is prohibited. When a color is specified on the display 280, the color specifying unit 344 notifies the layer generating unit 345 of the color whose storage is prohibited.

Next, with reference to FIG. 15, the operation of the electronic whiteboard 200A of this embodiment will be described. FIG. 15 is a flowchart illustrating the operation of the electronic whiteboard of the second embodiment.

The processing from step S1501 to step S1506 in FIG. 15 is the same as the processing from step S701 to step S706 in FIG. 7, so a description thereof will be omitted.

In step S1502, if the input stroke image is not a color specified as a color to be automatically saved, the electronic blackboard 200A determines that the input stroke image is a stroke image of a color specified as a color that is prohibited from being saved. It is determined whether or not (step S1507).

In step S1507, if the color is prohibited from being saved, the layer generation unit 345 draws this stroke image on the storage prohibited layer 42A (step S1508), and proceeds to step S1506.

In step S1508, if the color is not prohibited from being saved, the layer generation unit 345 draws this stroke image on the layer 43 for displaying stroke images (step S1509), and proceeds to step S1506.

When the electronic whiteboard 200A receives the instruction to save page data in step S1506, the page generation unit 342A uses the drawing erasure unit 349 to create a page of page data including superimposed image data on which a layer other than the storage prohibited layer 42A is superimposed. The information is stored in the storage unit 320 (step S1510), and the process ends.

In this embodiment, it is possible to provide a storage prohibition layer that prohibits storage of a drawn stroke image, and to prohibit storage of a stroke image drawn in a color associated with the storage prohibition layer.

The color specification screen of this embodiment will be described below with reference to FIG. 16. FIG. 16 is a diagram illustrating an example of a color specification screen according to the second embodiment.

The screen 81A shown in FIG. 16 is displayed on the display 280 by the display control unit 343, for example. On the screen 81A, in addition to a message 82 prompting you to specify colors to be automatically saved and a color list 83, a message 84 prompting you to specify colors to be prohibited from saving and a color list 85 are displayed. Ru.

In this embodiment, the colors selected from the list 85 are the colors that are prohibited from being saved. In the example of FIG. 16, yellow is selected in the list 85. Therefore, the color specifying unit 344 sets the stroke image input in yellow as a stroke image whose storage is prohibited. In other words, the color specifying unit 344 sets yellow as the color associated with the storage prohibited layer 42A.

In this way, according to the present embodiment, when highly confidential information is input, by inputting it as a stroke image of a color that is prohibited from being saved, the user does not have to delete the input stroke image. , will be erased and will not be saved as page data.

Therefore, according to this embodiment, for example, leakage of highly confidential information discussed during a meeting can be suppressed.

Furthermore, the electronic whiteboards 200 and 200A may be included in a system that communicates with a server device.

FIG. 17 is a diagram illustrating an example of a system configuration of an information processing system including an electronic whiteboard. The information processing system 500 includes an electronic whiteboard (electronic information board) 200 and a server device 550. In the information processing system 500, the electronic whiteboard 200 and the server device 550 are connected via a network.

In the information processing system 500 of this embodiment, the electronic blackboard 200 includes image data (captured image data) obtained by capturing the screen of the electronic blackboard 200, and stroke image data indicating characters, images, etc. input by hand to the electronic blackboard 200. , the audio data etc. collected by a sound collecting device such as a microphone are acquired and transmitted to the server device 550. Note that the electronic whiteboard 200 of this embodiment may transmit the date and time when various data were acquired to the server device 550 in association with the acquired information.

Further, the electronic whiteboard 200 can communicate with a plurality of terminal devices, and may acquire image data and audio data from each terminal device. In this case, the image displayed on the electronic whiteboard 200 may be shared by multiple terminal devices, and the electronic whiteboard 200 becomes a shared terminal that displays a screen shared by the multiple terminal devices.

Next, a modification of the above-described information processing system will be described with reference to FIGS. 18 to 21.

FIG. 18 is a first diagram showing a modification of the information processing system. The example of FIG. 18 includes a terminal device 600, an image projection device 700, and a pen motion detection device 810 instead of the electronic blackboard 200.

The terminal device 600 is connected to the image projection device 700 and the pen motion detection device 810 by wire.

Image projection device 700 projects image data input through terminal device 600 onto screen 800 .

The pen motion detection device 810 communicates with the electronic pen 820 and detects the motion of the electronic pen 820 in the vicinity of the screen 800. Specifically, the electronic pen 820 detects coordinate information indicating the point indicated by the electronic pen 820 on the screen 800 and transmits it to the terminal device 600.

The terminal device 600 generates stroke image data representing a stroke image input by the electronic pen 820 based on the coordinate information received from the pen motion detection device 810, and causes the image projection device 700 to draw the stroke image on the screen 800.

Further, the terminal device 600 generates page data including superimposed image data indicating the image being projected by the image projection device 700, and transmits it to the server device 550.

FIG. 19 is a second diagram showing a modification of the information processing system. The example of FIG. 19 includes a terminal device 600, a display 800A, and a pen motion detection device 810 instead of the electronic whiteboard 200.

Pen motion detection device 810 is placed near display 800A, detects coordinate information indicating the point indicated by electronic pen 820A on display 800A, and transmits it to terminal device 600. In the example of FIG. 13, the electronic pen 820A may be charged by the terminal device 600 via the USB connector.

The terminal device 600 generates image data of a stroke image input by the electronic pen 820A based on the coordinate information received from the pen motion detection device 810, and displays it on the display 800A.

Further, the terminal device 600 of this embodiment generates page data including superimposed image data indicating the image projected by the image projection device 700, and transmits it to the server device 550.

FIG. 20 is a third diagram showing a modification of the information processing system. The example of FIG. 20 includes a terminal device 600 and an image projection device 700 instead of the electronic whiteboard 200.

The terminal device 600 performs wireless communication (such as Bluetooth) with the electronic pen 820B and receives coordinate information of the point indicated by the electronic pen 820B on the screen 800. Then, the terminal device 600 generates image data of a stroke image input by the electronic pen 820B based on the received coordinate information, and causes the image projection device 700 to project the stroke image onto the screen 800.

Further, the terminal device 600 generates page data including superimposed image data indicating the image being projected by the image projection device 700, and transmits it to the server device 550.

As described above, each of the embodiments described above can be applied in various system configurations.

Each function of the embodiments described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules.

Note that the device to which this embodiment is applied is not limited to the electronic whiteboard 200, as long as it is a display device that has a function of operating objects by touch operation. The devices to which this embodiment is applied include, for example, a projector (PJ), an output device such as a digital signage, a head up display (HUD) device, a network home appliance, a connected car, a personal computer (laptop), It may be a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a wearable PC, or the like.

Additionally, the devices described in the embodiments are merely illustrative of one of a plurality of computing environments for implementing the embodiments disclosed herein.

In some embodiments, the first apparatus includes multiple computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, the second apparatus may include multiple computing devices configured to communicate with each other.

Furthermore, the first device and the second device can be configured to share the steps of the process shown in FIG. 7 in various combinations. For example, a process performed by a given unit may be performed by a second device. Similarly, the functions of a given unit can be performed by a second device. Moreover, each element of the first device and the second device may be combined into one server device, or may be divided into a plurality of devices.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without detracting from the gist of the present invention, and can be appropriately determined depending on the application thereof.

200, 200A Electronic blackboard 320 Page storage section 330 Layer storage section 341 Input section 342, 342A Page generation section 343 Display control section 344, 344A Color specification section 349 Drawing deletion section

Japanese Patent Application Publication No. 2004-118236

Claims (5)

a display control unit that displays a superimposed image obtained by superimposing images drawn on each of the plurality of layers;
a layer generation unit that, when an image of a specified color is input, draws the image on a layer associated with the specified color among the plurality of layers;
The display control unit displays a specification screen for specifying a color to be saved and a color to be prohibited from being saved, and the color to be saved specified on the specification screen is selected from among the plurality of layers. a color specifying unit that associates the color that is prohibited from being saved with a layer for automatic saving of the layer, and associates the color that is prohibited from being saved with a layer that is prohibited from being saved among the plurality of layers;
a layer storage unit that stores image data of the image drawn on the automatic storage layer in a layer storage unit at predetermined intervals;
A page that generates superimposed image data representing a superimposed image drawn on a layer other than the storage prohibited layer from the superimposed image and stores it in a page storage unit when an instruction to save the superimposed image of the plurality of layers is received. A display device comprising: a generating section; The layer generation unit includes:
An image drawn on a layer other than the layer associated with the specified color among the plurality of layers is selected, and the color of the selected image is changed to the specified color. In case,
The display device according to claim 1, wherein the selected image is erased from the other layer, and the selected image of the specified color is drawn in a layer associated with the specified color. . The layer generation unit includes:
Generating image data in which an image drawn on the automatic storage layer associated with the color to be stored and a background image are superimposed,
The layer storage section is
The display device according to claim 1 or 2, wherein the image data generated by the layer generation section is stored in the layer storage section at predetermined time intervals. A display method using a display device, the display device comprising:
A procedure for displaying a superimposed image in which images drawn on each of multiple layers are superimposed;
When an image of a specified color is input, drawing the image on a layer associated with the specified color among the plurality of layers ;
A designation screen for specifying colors to be saved and colors to be prohibited from being saved is displayed on the display device, and the colors to be saved specified on the specification screen are selected from among the plurality of layers. a layer for automatic saving, and a step of associating the color that is prohibited from being saved with a layer that is prohibited from being saved among the plurality of layers;
a step of saving image data of an image drawn on the automatic storage layer in a layer storage unit at predetermined intervals;
A step of generating superimposed image data representing a superimposed image drawn on a layer other than the storage-prohibited layer from the superimposed image and storing it in a page storage unit when an instruction to save superimposed images of the plurality of layers is received. and the display method to perform. Displays a superimposed image that superimposes images drawn on each of multiple layers,
When an image of a specified color is input, drawing the image on a layer associated with the specified color among the plurality of layers ,
A specification screen for specifying colors to be saved and colors to be prohibited from being saved is displayed, and the color to be saved specified on the specification screen is automatically saved among the plurality of layers. associate the color for which storage is prohibited with a layer for which storage is prohibited from among the plurality of layers;
storing image data of the image drawn on the automatic storage layer in a layer storage unit at predetermined intervals;
When receiving an instruction to save the superimposed image of the plurality of layers, generating superimposed image data representing a superimposed image drawn on a layer other than the storage-prohibited layer from the superimposed image, and storing it in a page storage unit; A display program that causes a computer to perform processing.

Images