JP7769579B2 - Information Processing Systems - Google Patents

Description

The present invention relates to an information processing system capable of manipulating content.

Patent Document 1 describes a known information processing device that includes an information carrier consisting of multiple book-shaped sheets, a touch pen for touching the information carrier, and a main unit that stores content information including output content in response to the touch. The device is configured so that a user can use the touch pen to touch symbols or pictures printed on the sheets, thereby outputting corresponding visual and sound information on a monitor.

According to the above document, the sheet and touch pen can be used to operate content stored on the main device. However, since the sheet needs to be set in a predetermined position on the main device in order to detect the operation position of the touch pen on the sheet, there is no flexibility in the material and size of the sheet. In addition, there are issues with operability, as the heavy main device with the sheet set must be brought close to hand to operate.

Patent No. 3120085

The present invention aims to provide an information processing system in which a sheet containing predetermined information about content and content displayed on a monitor are operated using an operation pen that can touch the sheet, with the objective of providing a sheet containing some of the information about the content with a high degree of freedom and excellent operability of the content.

In order to solve the above problems, the present invention provides an information processing system comprising an operating device for operating content and an information processing device, wherein the operating device has a reading means for optically reading dot information from a sheet-like display medium on which dot information including at least information regarding the operation position is provided, and the information processing device has a storage device in which content information is stored, an output means for outputting content, an operation detection means for detecting operation of the operating device on the display medium by analyzing the dot information read from the display medium by the reading means, and an operation control means for controlling operation of the content in accordance with the operation of the operating device detected by the operation detection means.

The operating device may be provided with a sensor for detecting movement.

An operation case may be provided in which the display medium and the operation device can be placed, and the operation case may have a grip portion for use as an operation tool for operating the content.

An operation aid may be provided into which the tip end of the operation device formed in a pen shape is inserted, thereby enabling the operation device to be used as a joystick.

The operation aid may be provided on the operation case side.

The operation assisting tool may have dot information for detecting that the operation device has been tilted in a predetermined direction at a part that supports the operation device so that it can be tilted, and the operation detecting means may be configured to detect the tilting of the operation device according to the dot information on the operation assisting tool that is read by the operation device.

The display medium may have a handwriting space for drawing diagrams, the operation detection means may be configured to detect the operation trajectory of the operation device within the handwriting space based on dot information read using the operation device, and the operation control means may be configured to output the operation trajectory of the operation device detected by the operation detection means onto the screen in real time, thereby allowing any diagram to be drawn only on the screen on which the content is displayed.

The display medium may have a template display unit that displays a template consisting of a line diagram to be traced on the screen, and the operation control means may be configured to display a template corresponding to the template on the screen when a touch operation on the template display unit is detected by the operation device.

The display medium may have an object operating unit that moves a picture displayed on the screen, and the operation control means may be configured to be able to move the picture on the screen in accordance with a predetermined rule.

The display medium may be a picture book on which the dot information is printed, the dot information forming part of a picture in the picture book, and the dot information including at least information regarding the type of picture book and information regarding the operation position.

In an information processing system that allows content to be operated using a display medium containing content information, an operating device, and a main unit, content operation using the display medium and operating device can be performed more smoothly, and the display medium's configuration can be simplified, allowing display media to be distributed to the market at lower cost.

1 is a diagram showing a configuration of an information processing system according to an embodiment of the present invention. FIG. 1 is a diagram showing the configuration of a terminal system. 1A is a diagram showing an example of a content book of this embodiment, and FIG. 1B is a diagram showing an example of a description of an operation page on which content operations are performed. 10A and 10B are diagrams showing an example of a description in a content book in which handwriting operation control is performed. 10A and 10B are diagrams showing examples of descriptions of a content book in which a content acquisition operation is performed. 1A and 1B are a perspective view and an exploded perspective view showing an operation assisting tool. 1A is a side cross-sectional view of the main part showing how the operation aid is used, and FIG. 1B is a diagram showing how the lever operation is read by the operation pen. 10A is a model diagram showing operation cases, and FIG. 10B is a model diagram showing an example of an operation case in which a content book and an operation pen are set. FIG. 2 is a block diagram showing the configuration of the main unit. FIG. 2 is a block diagram showing the configuration of the operation pen. FIG. 2 is a block diagram showing the configuration of a content server. FIG. 10 is a processing flow diagram showing content information acquisition processing.

The configuration of the information processing system and information processing device according to this embodiment will be described below with reference to the drawings. First, the configuration of the information processing system according to this embodiment will be described. Figure 1 is a diagram showing the configuration of the information processing system according to this embodiment. As shown in Figure 1, the information processing system includes a user-side terminal system and a content server 40. The terminal system and content server 40 can communicate with each other via a network 50 such as the Internet or a mobile communications network. Note that although Figure 1 shows only one terminal system, in this embodiment the terminal system includes multiple terminal systems, each provided for a different user.

The terminal system comprises a main unit 10, which is an information processing device; an information display medium (display medium, information carrier) 30, such as a picture book owned by the user; a reading device 20 that reads information from the information display medium; and an output device 60. The main unit 10 can download content information corresponding to the information display medium 30 from the content server 40 and output the downloaded content via the output device 60, such as a monitor. The terminal system (main unit 10) is also configured to allow the content output to the output device 60 to be operated using an operation unit consisting of the information display medium 30 and the reading device 20 that reads information from the information display medium 30.

The content server 40 stores content information corresponding to the information display medium 30, and can provide content information corresponding to the information display medium 30 operated by the user to the main unit 10 in response to a request from the terminal system (main unit 10). The content server 40 is also configured to be able to perform authentication control to determine whether or not content information can be downloaded when a request for content information is received from the terminal system. Details will be provided below.

Next, an example of the configuration of a terminal system will be explained based on Figures 1 and 2. Figure 2 shows the configuration of the user's terminal system.

As shown in Figure 2, the terminal system in this embodiment comprises a main unit (user terminal) 10, an operation pen (reading device, operation device) 20, and a monitor (output device, display) 60, and the operation unit for operating content is made up of the operation pen 20 and an information display medium 30 on which dot information readable by the operation pen 20 is printed.

In this embodiment, as shown in Figure 2, a content book (book, picture book) 30 in which dot information (dot codes) related to content information is printed on a regular picture book is used as an example of an information display medium 30. The detailed configuration of the content book 30 will be described later.

The operation pen 20, which is an example of a reading device that constitutes the operation unit, is equipped with a reading unit (information reading means, reading means) 21a located on the pen tip side that can optically read dot information printed on the content book 30, a sensor unit (sensor) 21c (described below), a click switch 21e located on the pen tip, operation buttons 21d, 21d located on the end opposite the pen tip or near the grip, and a terminal unit (not shown) to which a cable can be connected. The operation pen 20 is configured to transmit the dot information read from the content book 30 using the reading unit 21a, information related to the movement (movement in three axial directions and angular velocity) detected by the sensor unit 21c, and operation information of the click switch 20e and the operation button 21d to the main device 10, which is connected via wire or wirelessly.

The sensor unit 21c has motion sensors such as an acceleration sensor and a gyro (angular velocity) sensor. In addition to a three-axis sensor, the sensor unit 21c may also use a six-axis sensor that includes a three-axis acceleration sensor and a three-axis acceleration sensor.

With the operation pen 20 configured as described above, the content output on the monitor 60 can be operated by performing a read operation to read the dot information printed on the content book 30, by waving the operation pen 20 (moving operation, rocking operation), or by pressing the operation button 20d or click switch 20e.

The reading operation of reading the dot information printed on the content book 30 with the operation pen 20 is preferably a reading operation (touching operation) in which the tip of the operation pen 20 is brought into contact (touched) with the content book 30, but is not limited to this. For example, it may be a non-contact reading operation in which the reading unit 21a provided on the tip side of the operation pen 20 is brought close to a position where the dot information printed on the content book 30 can be optically read. Hereinafter, the reading operation of the dot information with the operation pen 20 will be referred to as a touch operation for convenience, but this includes both contact and non-contact modes.

Note that the reading device 20 is not limited to a pen, as long as it is capable of reading the dot information contained in the information display medium 30, and may also be a mouse or other operating tool equipped with a reading unit that can optically read dot information.

Incidentally, the operation unit may also be configured with a separate operation case 70 that functions as a controller (operation tool) by setting (accommodating) the content book 30 and the operation pen 20. The specific configuration of the operation case 70 will be described later.

The monitor 60, an example of an output device, is connected to the main unit 10 via a wired or wireless connection and is configured to display video (images) and output audio through an integrated speaker. This allows the monitor 60 to output video and audio corresponding to the content contained in the content book 30 in response to the operation of the operation unit, in other words, the touch operation of the operation pen 20 on the content book (picture book, display medium) 30.

Note that the output device 60 is not limited to being connected to the main device 10 via wired or wireless communication, but may be formed integrally with the main device 10. Furthermore, the output device 60 may be any device that has a screen and/or speakers capable of displaying content, and may also be a projector that projects images, etc.

The main device 10 stores content information corresponding to the content books 30 owned by the user in a storage device described below, and the content information output to the monitor 60 is linked to the dot information printed on the corresponding content book 30. In other words, the content information stored in the main device 10 is composed of a link between the dot information (content operation information) printed on the content book 30 and information (content output information) related to the content, such as video and sound, that is actually executed based on the specific dot information. Incidentally, since a large number of content books 30 can be prepared depending on the content variations, the dot information printed on the content book 30 also includes information for identifying which content book 30 it is.

As a result, the main unit 10 is configured to receive dot information read by touching the content book 30 with the operation pen 20, and thereby execute content operation control to operate the content output on the monitor 60 in accordance with the received dot information (in accordance with the operation of the operation pen 20).

With this configuration, the main unit 10 can detect the operation of the operation pen 20 on the content book 30 anywhere without the content book 30 being installed in a specific location on the main unit 10, thereby improving the operability of content using the operation unit (content book 30 and operation pen 20). Specific examples of content operation control will be described later.

Next, an example of content operation control using a content book and an operation pen will be described with reference to Figures 3 to 5. Figure 3 (A) is a diagram showing an example of a content book in this embodiment, Figure 3 (B) is a diagram showing an example of an operation page where content operation is performed, Figures 4 (A) and (B) are diagrams showing an example of an entry in a content book where handwriting operation is performed, and Figures 5 (A) and (B) are diagrams showing an example of an entry in a content book where content acquisition operation is performed.

The content book 30 used as an information display medium has dot information that can be optically read by the operation pen 20 on parts of objects (designs, etc.) such as pictures, diagrams, and characters printed on a sheet (paper). By reading the dot information with the operation pen 20, it is possible to detect which design, etc. has been touched with the operation pen 20. The content book 30 shown in Figure 3 also has an attachment (operation aid) 31 that turns the operation pen 20 into a joystick. The attachment 31 will be described later.

Specifically, as shown in Figure 3(B), content book 30, a picture book, has patterns A to D printed as pictures (objects) made up of characters, objects, figures, letters, etc., and some of patterns A to D are printed with invisible dot information printed with ink that is difficult to see with the naked eye, or dot information with low visibility. As a result, content book 30 is configured so that, from the user's perspective, there is almost no difference between it and a regular picture book, etc.

This dot information includes at least information identifying the content book 30 and information (content operation information) that can identify which position on which page of the identified content book 30 was touched, in other words, which picture (object) on which page of the identified content book 30 was touched.

Furthermore, the dot information only needs to be configured to be readable by the operation pen (reading device) 20, and it does not matter whether the dot information is visible to the naked eye, and the dot information may be provided by means other than printing on the sheet (such as embossing).

As a result, when it is detected that the user has used the operation pen 20 to read dot information provided on part of a picture, figure, character, etc. printed on the content book 30 that the user owns (touching a specific picture, etc. with the operation pen), the main device 10 (its control unit) is configured to execute content operation control that outputs on the monitor 60 a content operation corresponding to the touched area (dot information) based on the content information stored in the storage device.

To explain the above example in more detail, for example, the content information stored on the main unit 10 stores (associates) specific content output information, which is output when a touch operation (content operation information) of picture A, which is a picture of a specific character, is detected. The specific content output information consists of audio information in which the corresponding character speaks specific words and video information in which the character displayed on the screen performs a specific movement. In this case, when it is detected that picture A in the content book 30 has been touched with the operation pen 20, the main unit 10 (content operation control) is configured to output to the monitor 60 specific audio information and video information linked to the detected touch operation.

The content operation control may be configured to output specific audio or video information when a picture is touched, or may be configured to enable a simulated shopping game by touching products listed in the content book 30, or a simple racing game by manipulating the position of a character displayed on the monitor 60. Other examples of operations using the content operation control are described below.

As shown in FIG. 4, the content book 30 is provided with handwriting space S in addition to images containing dot information, and invisible or low-visibility dot information is printed throughout the target area within the handwriting space S. The dot information arranged within the handwriting space S includes at least positional information within the handwriting space S, and the main unit 10 is configured to be able to detect which position on the handwriting space S has been touched with the operation pen 20 and the operation trajectory of the operation pen 20.

As a result, when the main device 10 (its control unit) detects that the user has used the operation pen 20 to draw a line within the handwriting space S, it is configured to output (display) the line on the monitor 60 in real time according to the operation trajectory of the operation pen 20 on the handwriting space S, thereby allowing the user to draw a line (picture, letter, etc.) on the monitor 60 (execute handwriting operation control).

With this configuration, by touching the operating pen 20 as if drawing a line on the handwriting space S of the content book 30, the line can be drawn only on the monitor 60 without leaving any line on the content book 30. This is economical as it allows you to draw on the monitor 60 multiple times without consuming paper, and also allows you to display pictures drawn in the handwriting space on hand on a large screen on the monitor 60, allowing children to enjoy drawing without getting bored.

Also, as shown in FIG. 4(A), near the handwriting space S of the content book 30, there is provided a thickness change unit 32 for changing the thickness of the line drawing output on the monitor 60 using the operation pen and handwriting space, and a color setting unit 33 for changing the color of the line. The thickness change unit 32 and color setting unit 33 each have dot information that includes instructions for changing the attribute information of the thickness and color of the line drawn on the monitor 60.

As a result, when the main device 10 (controller) detects that a predetermined thickness change unit 32 or color setting unit 33 has been touched with the operation pen 20, it is configured to be able to change the color attributes (thickness and color) according to the touched dot information. In a similar manner, it may also be possible to switch between line types such as solid lines and dotted lines.

Furthermore, a stamp section 34 may be provided near the handwriting space S of the content book 30, as shown in Figure 4(A), which displays pre-set stamps on the monitor.

As a result, the main device 10 (its control unit) is configured to display (output) a stamp corresponding to the read dot information on the monitor 60 when a touch operation on a specific stamp area 34 is detected by the operation pen 20. This configuration allows stamps and the like that correspond to the content of the content book (picture book) 30 to be easily and freely displayed on the monitor, so even children who are not good at drawing can enjoy using the handwriting space S.

Also, near the handwriting space of the content book 30, as shown in Figure 4 (B), a template section (draft section) 36 is provided that displays pre-set templates (drafts) on the monitor.

As a result, the main device 10 (its control unit) is configured to be able to display the corresponding template on the monitor 60 when a touch operation on a predetermined template section 36 with the operation pen 20 is detected. With this configuration, the user can execute the handwriting operation control while the template is displayed on the monitor 60, allowing them to draw a picture by tracing the template (along the template), thereby allowing for repeated drawing practice at low cost and also suitable for children to practice drawing.

Furthermore, as shown in Figure 4(B), an object operation unit 37 is provided near the handwriting space of the content book 30, which allows the user to move handwritten pictures, stamps, etc. (objects) displayed on the monitor 60. The object operation unit 37 is provided with dot information containing instructions to move the display position of the selected object (picture, stamp, etc.) up, down, left, or right on the monitor.

As a result, when a touch operation on the movement section using the operation pen 20 is detected, the main unit 10 (its control section) is configured to be able to move (operate) an object consisting of a picture, stamp, etc. displayed on the monitor within the monitor screen in accordance with the content of the touched object operation section 37.

Furthermore, as shown in FIG. 5(A), the content book 30 is provided with a content acquisition unit (download initiation unit) 38 containing dot information for acquiring (downloading) content information from a content server 40 connected via a network when content information corresponding to the content book 30 owned by the user is not stored in the main device 10.

As a result, when a touch operation (download start operation) on the content acquisition unit 38 using the operation pen 20 is detected, the main unit 10 (its control unit) is configured to execute content information acquisition control to acquire content information necessary to develop content related to the content book 30 used by the user from the content server 40 connected via the network. Details of the content information acquisition control (processing) will be described later. Note that the content acquisition unit 38 may be included in the entire content book 30, so that downloading of content information can be started by touching any part of the content book 30 with the operation pen 20.

With this configuration, even if the main device 10 does not have pre-stored content information corresponding to the content book 30, the user can obtain content information corresponding to the newly acquired (purchased) content book 30 from the content server 40 connected via the network. In other words, the content book 30 itself only needs to be printed with dot information for detecting content operations (touch operations) along with the images that make up a typical picture book, etc.; there is no need to distribute a storage device (storage medium) containing content information related to images and sounds used to express the content. In other words, content books 30 that users purchase can be manufactured at lower cost.

As shown in Figure 5(B), the content information acquisition control may be configured such that multiple (four in the illustrated example) content acquisition units 38A, 38B, 38C, and 38D are provided in the content book 30, and the download of content information is started when it is detected that the multiple content acquisition units have been touched in a predetermined order with the operation pen 20 (download start operation).

As shown in FIG. 5(B), a guide portion 39 made of projections and depressions is formed near the content acquisition portions 38A-38D to guide (assist) the operation pen 20 in sequentially touching the content acquisition portions 38A-38D. This configuration allows the user to smoothly read the content acquisition portions 38A-38D in a preset order by moving the tip of the operation pen 20 along the guide portion 39.

At this time, the content acquisition units 38A-38D and guide unit 39 are arranged in a ring shape, as shown in Figure 5(B), so the user can cycle through the content acquisition units 38A-38D in order by moving the operation pen 20 around the ring-shaped guide unit 39 several times, regardless of where they start reading.

With this configuration, for example, when downloading content information, an announcement is made encouraging the user to circle the operation pen 20 repeatedly along the annular guide portion 39, which allows the user to concentrate on operating the operation pen 20 while the content information is being downloaded, so the child can wait without getting bored.

Incidentally, the multiple content acquisition units 38A-38D may be arranged in a ring shape, or may be arranged in a line (straight line), a wavy line, an arc, or along the periphery of a figure such as a triangle or a rectangle. In this case, the guide unit 39 is formed in a line (straight line), a wavy line, an arc, or along the periphery of a figure such as a triangle or a rectangle so that reading operations can be performed along the arrangement of the multiple content acquisition units 38A-38D.

The information display medium is not limited to the content book 30 described above, as long as it is a display medium on which dot information can be read by the operation pen 20. For example, it may be a card or sheet-like member on which a picture or diagram containing dot information is printed (written), or a tablet terminal on which a picture or diagram containing dot information is displayed.

Next, the specific configuration of the content book and operation pen (operation unit) will be explained based on Figures 6 to 8. Figures 6(A) and 6(B) are perspective and exploded perspective views of the operation aid, Figure 7(A) is a side cross-sectional view of the main parts showing how the operation aid is used, and Figure 7(B) is a diagram showing how the lever operation is read using the operation pen.

As shown in the figure, an operation aid (attachment) 31 is provided on the end of the content book (information display medium) 30. The operation aid 31 pivots around the tip of the operation pen 20, where the reading unit is provided, so that the operation pen 20 can be used as a joystick. The operation aid 31 may be provided separately from the content book 30, such as on the operation case 70 (described below) or as a dedicated device.

The operation assisting device 31 has a pivotal support portion 31A that pivotally supports the pen tip of the operation pen 20 so that it can be tilted forward, backward, left, right (or 360 degrees), and an operation reading portion 31B is provided within the pivotal support portion 31A to read (detect) that the operation pen 20 has been tilted.

The pivot support portion 31A includes a first support 46 that is bowl-shaped (annular) and open in the vertical direction, with the tip of the operation pen inserted into and supported by its inner circumferential surface; a second support 47 that is cylindrical and open in the vertical direction, with its inner circumferential surface surrounding and supporting the circumferential surface of the first support 46; a third support 48 that is cylindrical and open in the vertical direction, with its inner circumferential surface surrounding and supporting the circumferential surface of the second support 47; and an annular cover body 49 that is attached and fixed to cover the upper side of the third support 48 (see Figures 6(A) and (B)).

The first support 46 has a pair of first swing shafts 46a, 46a protruding from its side, and is configured to be pivotally supported on the inner peripheral surface of the second support 47 so as to be swingable up and down (front and back).

The second support 47 has a pair of second swing shafts 47a, 47a protruding from its side, and is configured to be pivotally supported on the inner peripheral surface of the third support 48 so as to be swingable in the left-right direction. The second support 47 also has a pair of first support portions 47b, 47b formed in a direction perpendicular to the second swing shafts, allowing the first swing shafts to be pivotally supported.

The second support 47 also has a restriction hole formed on its underside that fits into at least a portion of the tip of the operation pen 20 when the tip (reading unit 21a) of the operation pen 20 is inserted, thereby restricting the axial rotation of the inserted operation pen 20. In the example shown, the hole is formed to fit into the tip of the operation pen 20 every 90°.

The third support 48 has a pair of second support portions 48b, 48b, which are grooves with an open top, formed on its inner circumferential surface, and are configured to support the second swing shafts 47a, 47a. The operation reading unit 31B is also provided in a cone-shaped bottom portion formed on the underside of the third support 48. Details will be described later.

The cover body 49 covers the upper side of the second oscillating shafts 47a, 47a to prevent them from slipping out of the groove-shaped second shaft support portions 48b, 48b, thereby allowing the first support body (and second support body) to be housed (attached) to the third support body in a state where it can rotate around its axis by 360°.

With this configuration, by inserting the pen tip of the operation pen 20 into the pivot support portion 31A, the operation pen 20 can be used as a joystick that can be tilted. This eliminates the need to prepare a new dedicated operation tool when content requires lever operation using a joystick or the like, thereby improving operability while keeping costs low.

Furthermore, by using the operation assisting device 31 to enable the operation pen 20 to be used as a joystick controller, it becomes easier to freely move objects displayed on the monitor 60 and to operate content that is difficult to operate using only touch operations with the operation pen 20, such as racing games.

Furthermore, by providing the operation aid 31 directly on the corresponding content book 30, it is possible to reliably prevent a situation in which a user purchases a content book 30 that requires joystick operation, but is unable to fully operate the content using the content book 30 because they do not have the necessary operating tool, thereby improving usability (convenience).

The operation reading unit 31B is configured by arranging dot information that can be read by the reading unit 21a of the operation pen 20 on the underside (dot information placement area) of the third support, which is formed in a mortar (funnel) shape. The operation reading unit 31B also has an inclined surface formed so that when the operation pen 20 is used as a joystick and a lever operation (tilt operation) is performed, the distance from the tip of the operation pen 20 (reading unit 21a) to the dot information reading surface is maintained within a predetermined range. Specifically, the operation reading unit 31B is configured from a centrally located circular bottom surface 31B1 and an annular inclined surface 31B2 that slopes downward toward the bottom surface (see Figure 7(A)).

The operation reading unit 31B divides the inclined surface 31B2 into multiple areas (16 areas in the illustrated example) by multiple first boundary lines 51 formed radially from the bottom surface 31B1 and one or more second boundary lines 52 formed concentrically around the circular bottom surface 31B1, and dot information is provided on the operation reading unit 31B (each area on the inclined surface 31B2 and the bottom surface 31B1) to detect the position at which the operation pen 20 is operated.

In the illustrated example, by equally dividing the inclined surface of the operation reading unit 31B by the eight first boundary lines, it is possible to identify lever operations in a total of eight directions in a plan view, including up, down, left, right, and diagonal directions of upper right, upper left, lower right, and lower left, from the initial position (the position where the dot information on the bottom surface is read) where the operation pen 20 is inserted straight into the operation aid 31 (pivot support unit 31A). Furthermore, by dividing the inclined surface of the operation reading unit 31B by one second boundary line, it is possible to identify the degree of inclination of lever operations in each direction in two stages (see FIG. 7B).

With this configuration, the operation reading unit 31B is configured to detect the operation position (lever operation position, tilt position) of the operation pen 20, which can be used as a joystick (lever operation tool) by inserting its tip into the pivot support unit 31A (operation aid 31) (see Figures 7(A) and (B)).

The configuration of the operation case that makes up the operation unit will be explained based on Figure 8. Figure 8(A) is a model diagram showing the operation case, and Figure 8(B) is a model diagram showing an example of the operation case in which a content book and operation pen are set.

The operation case 70 includes a content installation section 71 in which the content book 30 is installed (housed), an operation pen installation section (operation device installation section) 72 in which the operation pen 20 is installed (housed), an operation assistance section 73 corresponding to the operation assistance tool 31, and a handle section 74 for the user to grip, and is formed in a plate shape that allows the operation case 70 with the content book 30 and operation pen 20 installed to be installed on the same plane. The operation case 70 may also be configured to be foldable in half.

The content installation section 71 is a recess that conforms to the outer edge of the content book 30 so that the content book 30 can be set (installed), and is configured so that the content book 30 can be attached in a state where pages can be turned.

The operation pen installation section 72 is a recessed portion recessed along the left and right or top and bottom (right side in the illustrated example) of the content installation section 71 so that the operation pen 20 can be set (installed), and is configured to be attached to the operation case 70 in a state in which the operation buttons provided on the operation pen 20 side can be operated. With this configuration, the operation case 70 with at least the operation pen 20 installed can detect left and right and up and down swing operations of the entire operation case 70 by the sensor unit 21c built into the operation pen 20.

The operation assist unit 73 has a pivot support section (not shown) that pivotally supports the pen tip of the operation pen 20 so that it can be tilted forward, backward, left, right (or 360 degrees). By inserting the pen tip side of the operation pen 20 into the pivot support section, the operation pen 20 can be used as a joystick controller in a state where it stands upright on the flat surface of the operation case 70.

Furthermore, like the operation assisting device 31, the operation assisting unit 73 is configured to have a dot information setting unit (not shown) provided in the pivot support unit for reading (detecting) the tilting of the operation pen 20. Note that the dot information setting unit may be configured to only detect that the operation pen 20 has been set in the pivot support unit, and joystick operation (tilting operation) using the operation pen 20 may be detected by a sensor unit 21c built into the operation pen 20.

The handles 74 are a pair of U-shaped members provided on both the left and right ends of the operation case 70. By grasping the left and right handles 74, the user can smoothly and easily swing (rotate) the operation case 70 left and right and up and down while holding the entire operation case 70 like a handle. However, the handles 74 are not limited to the above shape.

With the above-described configuration, the operation case 70 can be used as a large handle-type controller (operating tool) for operating the content output on the monitor 60 by installing the content book 30 and the operation pen 20.

Next, we will explain in detail the content operation control performed by the above-mentioned information processing system based on Figures 9 to 12.

Figure 9 is a block diagram showing the configuration of the main unit. The main unit 10 includes a control unit 11, which is composed of a CPU, RAM, etc. and executes various functions (means) by executing programs; a storage device 12, which is composed of an SSD or HDD, etc. and stores various information; a global communication interface 13, which enables wireless or wired communication via a network; a local wireless communication interface 14, which enables wireless communication in a local environment and, in this embodiment, communicates with the operation pen 20 and monitor 60; and a local wired communication interface 15.

The control unit 11 is provided with: read information receiving means 11a that receives read information (dot information) transmitted from the operation pen 20; operation information receiving means 11b that receives operation information (described below) transmitted from the operation pen 20; operation detection means 11c that detects the read operation of the operation pen 20 performed on the content book 30 based on the dot information received by the read information receiving means 11a (by analyzing the dot information) and the operation performed using the operation pen 20 based on the operation information received by the operation information receiving means 11b; operation control means 11d that executes a content operation corresponding to the operation of the operation pen 20 (read information and operation information) based on content information stored in the storage device 12; content output means 11e that outputs the executed content to an output device such as a monitor; content information acquisition means 11f that downloads content information from the content server 40; and authentication means 11g that determines whether or not content information can be downloaded from the content server 40.

The content information acquisition means 11f is configured to execute the content information acquisition control to download corresponding content information from the content server 40 when the operation detection means 11c detects a download start operation using the operation pen 20.

The storage device 12 has the following storage areas: a content information storage unit 12a that stores content information acquired (downloaded) from the content server 40; a read information storage unit 12b that stores read information received from the operation pen 20; and an analysis information storage unit 12c that stores analysis information analyzed based on the read information.

The content information stored in the content information storage unit 12a is composed of information that identifies the content book 30, information that identifies objects such as pictures placed within the content book 30, and content output information that consists of audio information, video (image) information, etc. that is output (operated) when the identified object is touched.

Figure 10 is a block diagram showing the configuration of the operation pen. The operation pen 20 includes a control unit 21, which is composed of a CPU, RAM, etc. and executes various functions (means) by executing programs; a storage device 22, which is composed of an SSD or HDD, etc. and stores various information; and a communication interface 23, which enables wireless or wired communication via a network.

The control unit 21 is provided with an information reading means (reading means) 21a that optically reads the dot information printed on the content book 30, a read information transmission means (dot information transmission means) 21b that transmits the read information (dot information) read by the information reading means to the main unit 10, and the sensor unit 21c, operation button 21d, click switch 21e, and operation information transmission means 21f that transmits operation information of the operation pen 20 detected by the sensor unit 21c, operation button 21d, click switch 21e, etc. to the main unit 10. This allows the operation pen 20 to transmit to the main unit 10 operation information related to the swing operation and button operation of the operation pen 20 itself, as well as dot information read when the user touches the content book 30 with the operation pen 20.

As described above, the content operation control (handwriting operation control) is configured so that the read information receiving means 11a executes a process of acquiring read information (dot information) transmitted from the operation pen 20, then the operation detection means 11c executes a process of detecting (analyzing) content operation information indicating which content book 30 the user operated and how, based on the dot information received from the operation pen 20, then the operation control means 11d executes a process of identifying content output information consisting of audio information, video information, etc., output based on the content operation information, based on the detected content operation information and the content information stored in the content information storage unit 12a, and then the content output means 11e executes a process of outputting the operation result (content output information) based on the content operation to the monitor 60.

Figure 11 is a block diagram showing the configuration of a content server. The content server 40 includes a control unit 41, which is composed of a CPU, RAM, etc. and executes various functions (means) by executing programs; a storage device 42, which is composed of an SSD or HDD, etc. and stores various information; a communication interface 43, which enables wireless or wired communication in a local environment; an input interface 44; and an output interface 45.

The control unit 41 is provided with a content information providing means 41a that provides content information to the main unit 10 via the network in response to a request (download start operation) from the main unit 10, and an authentication means 41b that determines whether or not to allow the download of content information.

The storage device 42 has a content storage section 42a that stores content information corresponding to various content books 30 owned by the user, and an authentication information storage section 42b that stores authentication information used to determine whether or not to provide content information.

When the operation detection means 11c detects a predetermined download start operation (touch operation on the content acquisition unit 38) using the operation pen 20, the authentication means 11g, 41b are configured to determine whether or not to permit downloading of content information by determining whether the content has already been downloaded to the user's main device, requesting a specific password (login) from the user, or checking a PIN code or the like enclosed with the content book 30 when the user purchased it. The criteria used for the determination are not limited to those described above.

Figure 12 is a processing flow diagram showing the content information acquisition process. When content acquisition control is initiated, the process proceeds to step S101. In step S101, the operation detection means 11c checks whether a touch operation (download start operation) has been performed on the content acquisition unit 38 with the operation pen 20, and if a download start operation is detected, the process proceeds to step S102.

In step S102, the authentication means 41b checks whether the conditions (permission determination) for downloading content information from the content server 40 to the main unit 10 have been met, and if the download is determined to be permitted, the process proceeds to step S103.

In step S103, the content information providing means 41a can provide the main unit 10 with content information related to the content book 30 requested by the content information acquisition means 11f from the content information stored in the storage device of the content server 40 (download the specified content information to the main unit 10).

10 Main unit (information processing device)
11c Operation detection means 11d Operation control means 11e Content output means (output means)
20 Operation pen (operation device)
21a Information reading means (reading means)
30 Content books (information display media, display media)
40 Content server 41a Content information providing means

Claims (7)

An information processing system including an operation device for operating content and an information processing device,
The operating device is
a reading means for optically reading dot information including at least information regarding an operation position from a sheet-like display medium on which the dot information is provided,
The information processing device includes:
a storage device in which content information is stored;
an operation detection means for detecting an operation of the operation device on the display medium by analyzing the dot information read from the display medium by the reading means;
an operation control means for controlling an operation of the content in accordance with the operation of the operation device detected by the operation detection means;
an output means for outputting the content to an output device ;
a sensor for detecting movement of the operation device is provided on the operation device;
an operation case in which the display medium and the operation device can be installed;
An operation assisting tool is provided that enables the operation device to be used as a joystick by inserting the tip end of the operation device formed in a pen shape.
An information processing system comprising : The information processing system according to claim 1 , wherein the operation case has a grip portion for use as an operation tool for operating content. The information processing system according to claim 1 , wherein the operation assisting tool is provided on the operation case side. the operation assisting tool is provided with dot information for detecting that the operation device has been tilted in a predetermined direction at a portion that pivotally supports the operation device so that the operation device can be tilted,
The information processing system according to claim 1 , wherein the operation detection means is configured to be able to detect a tilt operation of the operation device in accordance with dot information on the operation aid side read by the operation device. An information processing system including an operation device for operating content and an information processing device,
The operating device is
a reading means for optically reading dot information including at least information regarding an operation position from a sheet-like display medium on which the dot information is provided,
The information processing device includes:
a storage device in which content information is stored;
an operation detection means for detecting an operation of the operation device on the display medium by analyzing the dot information read from the display medium by the reading means;
an operation control means for controlling an operation of the content in accordance with the operation of the operation device detected by the operation detection means;
an output means for outputting the content to an output device;
the display medium has a handwriting space for drawing a line drawing;
the operation detection means is configured to be able to detect an operation locus of the operation device within the handwriting space based on dot information read using the operation device;
the operation control means is configured to output the operation trajectory of the operation device detected by the operation detection means on a screen of the output device in real time, thereby enabling any line drawing to be made only on the screen on which the content is displayed;
the display medium has a template display section that displays a template consisting of a line diagram for tracing on the screen;
The operation control means is configured to display a corresponding template on the screen when a touch operation on the template display unit is detected by the operation device.
An information processing system comprising : the display medium has an object operation unit that moves a picture displayed on the screen,
6. The information processing system according to claim 5 , wherein the operation control means is configured to be able to move the picture on the screen in accordance with a predetermined rule. The information processing system according to claim 1, wherein the display medium is a picture book on which the dot information is printed, the dot information forms part of a picture in the picture book, and the dot information includes at least information regarding the type of picture book and information regarding the operation position.