JP6495651B2 - Information processing apparatus, control method therefor, program, and computer-readable storage medium - Google Patents

Description

  The present invention relates to an information processing apparatus, a control method thereof, a program, and a computer-readable storage medium.

  When making a loan contract or application at a bank, a bank employee (hereinafter referred to as “Teller”) is obliged to explain the items necessary for creating the contract and the product in a face-to-face format with the customer. . Then, in order to indicate that the customer has received an explanation from the teller, it is common to put a name, a seal, etc. in a predetermined column. In addition, a system that performs such work semi-electronically has also been proposed (Patent Document 1).

JP 2009-122796 A

  However, in Patent Document 1, although the fact that the teller side explained the product can be left, it cannot be determined whether or not the customer has actively understood and accepted the explanation.

The present invention has been made in view of such problems. The present invention provides a technique capable of controlling which operation among a plurality of users' operations is valid for each document sheet projected on the projection plane.

In order to solve this problem, for example, an information processing apparatus of the present invention has the following configuration. That is, a plurality of sheet information indicating the possible sheet accept gesture operation, storage means for storing the control information for controlling a gesture operation of a plurality of users according to the whole of the sheet, stored in the storage unit sheet Based on the information, a projection control means for controlling to project data representing the sheet onto a projection plane shared by a plurality of users, and a gesture from any user based on a gesture operation detected on the projection plane There is a discrepancy between the specifying means for specifying the operation, the acceptable gesture operation for the entire sheet stored as the control information in the storage means, and the user's gesture operation specified by the specifying means In this case, the gesture operation is invalidated, and the entire sheet stored in the storage unit is applied. And a control means for controlling so as to enable the gesture operation when only a gesture operation of the user identified by the gesture operation and the specific means available with matches.

According to the present invention, there is provided a technique capable of controlling which operation among a plurality of users is effective for each document sheet projected on a projection plane.

It is an external appearance block diagram of the facing system in embodiment. It is a block block diagram of the facing system in embodiment. It is a figure which shows the data structure of sheet DB. It is a figure which shows the utilization form of the facing system in embodiment. It is a flowchart which shows the basic processing procedure of the facing system in embodiment. It is a flowchart which shows the processing content of the procedure of the mortgage application in embodiment. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a figure which shows the example of a sheet | seat used in a mortgage procedure. It is a flowchart which shows the process which concerns on the validity determination of gesture operation in embodiment.

  Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In addition, the facing system in embodiment demonstrates the example utilized in a bank. Further, in the following description, a banker (person) is assumed to be a teller and is distinguished from a customer. The bank was used as an example to facilitate understanding by embodying the business, and can be used if it is a life insurance company or the like that sells or contracts products in person. However, the present invention is not limited to this. Note that this is an example only.

  FIG. 1 is an external configuration diagram of a facing system in the embodiment, and FIG. 2 is a block configuration diagram thereof. This system includes a control device 100 that controls the entire system. The control apparatus 100 is connected to a projection imaging apparatus 110, a display 120 that functions as a user interface with a user (teller, described later), and an input device (such as a keyboard and a mouse) 130. Further, although not shown, it is also connected to a backbone network related to business.

  The control device 100 is an information processing device having the same hardware configuration as a normal PC (personal computer) or the like, and includes a CPU 101 that performs processing according to a program, a ROM 102 that stores a boot program, BIOS, and the like, and an OS and applications that the CPU 101 executes. For storage, the CPU 101 has a RAM 103 used as a work area. The control device 100 also includes an I / F unit 105 for communicating with the projection imaging device 110, and a video controller 106 that performs drawing processing, video signal output processing, and the like in accordance with instructions from the CPU 101. The control device 100 further includes a storage controller 107 that reads and writes data from and to an external storage device 108 represented by a hard disk (HDD), and a network I / F 104 that communicates with a backbone network (particularly a network printer). The external storage device 108 stores an operating system (OS) 108a, an application program 108b for causing it to function as a face-to-face system, a sheet DB 108c, which will be described in detail later, and environment information 108d.

  The projection imaging apparatus 110 accommodates an I / F unit 118, a projection unit 115, an imaging unit 116, and a distance measurement unit 117 for communicating with the control device 100 in the casing. The projection imaging device 110 is provided with an opening 111 for allowing the projection light emitted from the projection unit 115 to pass therethrough. Furthermore, an opening 112 is also provided which is shared by the imaging unit 116 and the distance measurement unit 117 and for receiving light (including infrared rays) from the outside.

  The projection unit 115 emits projection light representing an image requested from the control device 100 toward the top plate 113 through the opening 112 and in a slightly oblique direction. A mirror is provided on the lower surface side of the top plate 113 and reflects the projection light from the projection unit 115. As a result, the image on the near side of the installation position of the projection imaging apparatus 110 in FIG. 1 (actually, the upper surface of the table) is displayed as a projection screen. Note that the top plate 113 may be inclined instead of obliquely emitting the light.

  In addition, the imaging unit 116 and the distance measuring unit 117 are set as an imaging range or a range-finding range through the mirror of the top plate 113, which is wider than the projection area on the table by the projection unit 115. The imaging unit 116 has the same configuration as an imaging device typified by a normal digital camera, and optically reads an image within the imaging range of the table. The distance measurement unit 117 detects depth (distance), and is an irradiation unit that irradiates infrared rays indicating a preset two-dimensional pattern, and a sensor that detects reflected infrared rays in a two-dimensional space from the object. Composed. Then, based on the video data obtained by the imaging unit 116 and the change of the distance data detected by the distance measuring unit 117 with respect to the time axis, the CPU 101 of the control device 100 processes the table with the user's hand movements or fingers. The detection process of the tap operation (gesture) is realized. Note that a technique for detecting a user's gesture by image / infrared pattern irradiation / detection is publicly known (for example, KINTECT (trademark) of Microsoft Corporation in the United States), and details thereof are omitted here. However, the configuration and the principle are not particularly limited as long as the user's gesture can be detected. If there is sufficient space in the housing of the projection imaging apparatus 110, these may be integrated by incorporating the circuit constituting the control apparatus 100 in the projection imaging apparatus 110.

  In the above configuration, when the power of the apparatus is turned on, the CPU 101 executes the boot program stored in the ROM 102, loads the OS 108a stored in the external storage device 108 into the RAM 103, and executes it. Then, under the control of the OS, the application program 108b of the facing system is loaded from the external storage device 108 to the RAM 103 and executed. As a result, this system functions as a face-to-face system for banking business.

  FIG. 4 shows a usage form of the present system. The face-to-face system according to the present embodiment assumes a form in which a teller 401 and a customer 402 sandwich a table 400 between each other and face each other while sitting on a chair as illustrated. In the table 400, the display 120 and the input device 130 are arranged at positions where the teller 401 can be easily operated. Further, since the projection imaging device 110 irradiates the projection light from the oblique direction toward the table 400 by the top plate 113, the projection imaging device 110 is placed at a position that does not get in the way when the teller 401 and the customer 402 face each other. It is possible. As a result, a sufficient space is secured between the teller 401 and the customer 402 in the table 400, and the detection range 410 of the imaging unit 116 and the distance measurement unit 117 and the projection range 411 by the projection unit 115 are secured. Note that the rectangles indicated by the detection range 410 and the projection range 411 are for indicating that the respective ranges are defined on the table 400, and are not intended to display the boundary lines. In addition, the control device 100 is arranged, for example, under the teller side table 400.

  The configuration of the face-to-face system in the embodiment and the usage form thereof have been described above. Next, the processing content of the face-to-face system will be described as a processing procedure of the CPU 101 in particular.

  When this system is operated, various document sheets (hereinafter simply referred to as sheets) are projected and displayed from the projection imaging apparatus 110 on the table 400 (projection range 411) between the teller 401 and the customer 402. Then, the teller 401 gives explanations and explanations each time, and the customer 402 shows the intention of understanding the projection contents and the explanation of the teller 401, and proceeds with the procedure. If this procedure is shown by the processing of the CPU 101, it is as follows. The CPU 101 selects a sheet to be projected from the external storage device 108, displays the selected sheet (details will be described later) on the projection unit 115, and operates the operations of the teller 401 and the customer 402 as gestures. And the distance measuring unit 117 recognizes it. Then, the process of selecting a sheet to be displayed next is repeated, and when a gesture indicating that the teller 401 and the customer 402 have agreed on the display of the final sheet is detected, the process ends.

  This will be described in more detail below. FIG. 5 is a flowchart showing a processing procedure of the CPU 101 when the application program 108b of the face-to-face system is executed.

  When this application is executed, first, in step S101, the CPU 101 displays a menu screen on the display 120 and causes the teller 401 to select one of the items. Items to be displayed include "procedure for borrowing a mortgage", "procedure for opening an account", etc., which are generally face-to-face at the bank. However, one of the items includes “environment setting”.

  In step S <b> 102, the CPU 101 waits for item selection by the operation of the input device 130 by the teller 401. When the selection is made, in step S103, the CPU 101 determines whether or not the selected item is “environment setting”. If it is determined that the environment is set, the process proceeds to step S104 to perform the environment setting process. This environment setting is for setting whether the projection imaging apparatus 110 is installed on the right side or the left side when viewed from the teller 401. Although the details will be described later, the sheet that the projection imaging apparatus 110 projects on the table 400 has the orientation of the teller side and the customer side, and the consistency between the orientation and the positional relationship between the teller 401 and the customer 402 attached to the seat. Is to take. When the setting is completed, the CPU 101 saves the setting contents as environment information 108 d of the external storage device 108. It is not necessary to perform this environment setting unless the arrangement position of the projection imaging device 110 is changed. That is, when the CPU 101 projects the sheet on the projection unit 115, the CPU 101 displays the sheet by rotating it by 180 ° as necessary according to the information stored in the environment information 108d. At the initial stage of startup, the CPU 101 displays a test message indicating in which direction the currently set teller or customer is set according to the information stored in the environment information 108d, and sets the environment setting. May be notified to the teller 401. For example, a message “We accept consultation” which appears upright when viewed from the customer 402 is displayed. If the message looks upside down as seen from the teller 401, it can be determined that the correct environment setting has been made.

  The teller 401 selects the corresponding menu item by operating the input device 130 for the purpose of consultation of the customer 402. When detecting that this selection has been made, the CPU 101 refers to the sheet DB 108c of the external storage device 108 in step S105 and reads GUI configuration information (details will be described later) of the selected procedure. In step S <b> 106 (details will be described later), the CPU 101 follows the procedure and the sheet indicated in the read GUI configuration information, and the corresponding sheet projection process and the gesture operation recognition process for both the teller 401 and the customer 402. , While supporting the exchange between the teller 401 and the customer 402, the procedure support process is performed.

  Before describing step S106, the configuration of the sheet DB 108c in the embodiment will be described with reference to FIG.

  As shown in FIG. 3, the sheet DB 108c is managed in units of menu items (denoted by reference numerals 300, 350,...) Displayed in step S101. In each item, GUI configuration information describing a procedure transition and a sheet to be used is stored. In the embodiment, the “home loan application” item 300 will be described as an example, and GUI configuration information 301 included therein will be described. The GUI configuration information 301 describes information for specifying GUI sheet information 302 to 306 describing a procedure related to a mortgage borrowing application and a display format of a sheet used at that time.

The procedure between the teller 401 and the customer 402 described in the GUI configuration information 301 in the embodiment is as follows:
Procedure (1): Customer registration procedure (2): Product explanation procedure (3): Loan simulation procedure (4): Document reading procedure (5): It is assumed that five stages of explanation of future procedure are described. . In each stage, it is assumed that GUI sheet information 302 to 306 used at that time is described.

  Each of the GUI sheet information 302 to 306 includes form information (corresponding to “customer registration form”, “product description form”...) Shown in the drawing, which describes the display form of the sheet to be projected (GUI), the sheet itself, or the sheet. Whether various GUI parts (buttons, etc.) placed above can be operated only from the teller side, or can be operated only from the customer side (or the operation from the teller side is not permitted, or the operation from the customer side is not allowed. It is composed of restriction information ("GUI restriction information" shown in the figure) that describes restrictions (conditions) related to operations such as whether to permit. 2 user), there is a first user GUI component associated with the first user, and a second user GUI component associated with the second user. For example, if it is set that only the teller side can be operated, all GUI parts on the sheet are handled as being operable only from the teller side. It is possible to describe whether the user can operate the Teller side or the customer side, that is, the restriction on the sheet takes precedence over the restriction on the GUI part.The form information also includes a description about the direction of the teller side and the customer side. As a result, in the embodiment, it is possible to define a sheet that can be operated only by the teller 401 and a sheet that can be operated only by the customer 402 in the embodiment. And for a sheet that can be operated by both, specify which of the GUI parts on the sheet can be operated. It can become.

  Assume that a certain button on the projected sheet is set to be operable only by the customer 402. In this embodiment, when the customer 402 operates the button, it is determined that the operation is valid, and processing corresponding to the button is performed. On the other hand, when the teller 401 operates the button, the operation becomes invalid and the operation is ignored. For that purpose, it is necessary to determine whether the person who operated is the teller 401 or the customer 402. In the embodiment, the teller 401 and the customer 402 are seated so as to face each other with the table 400 interposed therebetween. The detection range 410 includes the projection range 411. Therefore, it is possible to detect the direction in which the hand enters the projection range 411 at a timing before the timing at which the GUI component is designated. Since the direction of the teller side and the customer side is known from the environmental information 108d, it is possible to determine whether the person who has the hand touching the table 400 is the teller 401 or the customer 402.

  In the above description, whether the person who performed the touch operation is the teller 401 or the customer 402 is determined from the direction in which the hand has entered the projection surface, but the detection method is not limited to this. For example, since the touch operation is generally performed with the index finger, the touch operation may be determined from the outer shape pattern and orientation of the hand protruding the index finger.

  7 to 12 show examples of sheets drawn and projected in accordance with the form information in the GUI sheet information 302 to 306. FIG. 7 is a sheet 700 used in the procedure (1), FIG. 8 is a sheet 800 used in the procedure (2), FIG. 9 is a sheet 900 used in the procedure (3), and FIG. 10 is a sheet used in the procedure (4). 1000 and FIG. 11 show the sub-sheet 1100 used in the procedure (4), and FIG. 12 shows the sheet 1200 used in the procedure (5).

  The sheet 700 used in the procedure (1) of FIG. 7 includes a teller area 710 that appears upright from the teller 401 and a customer area 720 that appears upright from the customer 402. In the teller area 710, text input areas 711 to 717 where characters can be input, a radio button 718, and a registration button 719 are provided as GUI components. The customer area 720 includes text input areas 711 to 717 in the teller area 710, an area 721 for confirming the input result of the radio button 718, and a confirmation button 722 indicating intention to confirm the area 721. It is provided as a GUI component.

  The sheet 700 defined by the GUI sheet information 302 in the embodiment is operated by two persons, a teller and a customer. Therefore, the restriction information has no description on the restriction on the sheet itself. Instead, for the GUI parts that can be operated on the sheet 700 (reference numerals 711 to 719 and 722 in FIG. 7), information indicating whether the part can be operated is a teller or a customer is described in the restriction information. In the case of the embodiment, the input areas 711 to 718 and the registration button 719 are set so that only the teller 401 can be operated, and the confirmation button 722 is set so that only the customer 402 can be operated. Note that the GUI part in the text input area is not particularly limited as long as it is operated by operating the input device 130 (the fact that it can be operated from the relationship of the arrangement position of the input device 130 is a teller). Side only).

  The sheets 800 to 1200 in FIGS. 8 to 12 are also configured with an area that appears upright when viewed from the teller side and an area that appears upright when viewed from the customer. Further, since the sheets 800 to 1200 are operated by two parties, there is no restriction on the sheet itself. In other words, the GUI parts on each sheet are the same as in FIG. 7 in that information indicating whether the GUI parts can be operated on the teller side or the customer side is described as the restriction information. Hereinafter, the sheets of FIGS. 8 to 12 will be briefly described.

  A sheet 800 in FIG. 8 is a sheet for procedure (2): “product description”. This sheet 800 is displayed when the customer 402 performs an operation on the confirmation button 722 regarding the information regarding the customer 402 input by the teller 401 and the teller 401 operates the registration button 719 in the sheet of FIG. . In the sheet of FIG. 7, it is assumed that the customer 402 operates the registration button 719 without operating the confirmation button 722. In this case, although it is confirmed that the registration button 719 has been operated, the procedure is incomplete, so that the procedure (2) cannot be entered, and a message such as no customer confirmation is displayed. When the teller 401 operates the confirmation button 722, the operation itself is ignored. Therefore, it is not possible to shift to the procedure (2) without an operation on the confirmation button 722 by the customer 402. This also applies to other sheets.

  Returning to the description of FIG. In the teller area of the sheet 800, as GUI parts that can be operated only by the teller side, areas 811 to 813 for designating sub-sheets for product description, and next (procedure (3)) are instructed. A button 815 and an interruption button 814 for instructing interruption are arranged. In the drawing, the area 811 is in a selected state (default selection), and the sub-sheet (its original size) of the selected area is displayed in the customer area. In the customer area, a confirmation button 821 as a GUI component that can be operated only by the customer and a button 822 to the previous screen are arranged. The confirmation button 821 is used to indicate that the explanation content has been confirmed, and the previous screen button 822 is a button for inputting an instruction to return to the previous procedure (procedure (1)).

  A sheet 900 in FIG. 9 is a sheet for the procedure (3): “loan simulation”. This sheet 900 is displayed when the customer 402 performs an operation on the confirmation button 821 and the teller 401 operates the next button 815 in the sheet of FIG. In the teller area of the sheet 900, GUI parts 911 to 917 that can be operated only by the teller are arranged. In the customer area, GU parts 921 and 922 that can be operated only by the customer are arranged. The teller 401 operates the input device 130 according to the customer's request, and makes various settings for the borrowing amount, the repayment period, the repayment amount at the time of bonus, and the interest rate on the GUI components 911 to 914. The teller then operates the simulation button 915. When detecting the operation of this button, the CPU 101 calculates details relating to the repayment and displays the result in the customer area. Then, this operation is repeated as necessary. Note that the interrupt button 816 in the teller area, the next button 917, the confirmation button 921 in the customer area, and the previous button 922 are the same functions as the buttons 814, 815, 821, and 822 in FIG. Indicates.

  A sheet 1000 in FIG. 10 is a sheet for the procedure (4): “document reading”. This procedure reads a document to verify the customer's identity. This sheet 1000 is displayed when the customer 402 performs an operation on the confirmation button 921 and the teller 401 operates the next button 917 in the sheet of FIG. In the teller area of the sheet 1000, areas 1011 to 1016 indicating document candidates that can be operated only by the teller 401, an interruption button 1017, and a next button 1018 are arranged. On the other hand, in the customer area, areas 1021 to 1026 indicating document candidates that can be operated only by the customer 402 and a button 1027 on the previous screen are arranged. The customer 402 operates the area 1022 to indicate that he / she submits a driver's license, for example, as a document confirming his / her identity. The teller 401 selects the “driver's license” selected by the customer 402, selects the same document, and then operates the next button 1018 to display the document reading sheet (sub-sheet) 1100 in FIG. 11. Switch. Since the selected document is a driver's license, a frame 1101 indicating the position where the driver's license is arranged is displayed at the center position. The customer 402 places a driver's license in the frame 1101. In response to this, the teller 401 operates the document reading button 1111 to instruct reading of the document. When the CPU 101 detects an operation of the document reading button 1111, the CPU 101 controls the imaging unit 116 to read an image in the frame 1101 and stores the image in association with a series of procedures. In addition, since the type of document to be read is known, the character string in the document may be recognized as appropriate and stored in association with each other, or it may be determined whether or not it matches the name shown in the first registration process. Also good. If the teller 401 operates the cancel button 1112 or the customer 402 operates the button 1121 to the previous screen, the display returns to the display of the sheet 1000 in FIG.

  A sheet 1200 of FIG. 12 is a sheet for the procedure (5): “Explanation of future procedures”. The sheet 1200 is displayed after a button 1111 for instructing document reading is operated and reading is performed on the sheet of FIG. In the teller area and customer area of the sheet 1200, there is a description of a procedure for a future application and a period required for it, and the teller 401 basically explains the stage. The customer 402 who has received a general explanation operates a confirmation button 1221 indicating acceptance of the explanation. Subsequently, the teller 401 operates the end button 1211 to complete a series of mortgage application procedures. At this time, mortgage application documents according to items agreed upon in the simulation are temporarily registered in a server on the backbone network, a print request is made to a printer on the network, and the printed matter is handed over to the customer. At a later date, if the customer completes the formal procedure in the application form, the procedure will be performed, but this procedure will be omitted. When the customer 402 operates the button 1222 to the previous screen while the sheet 1200 of FIG. 12 is displayed, the process returns to the display processing of the sheet 1000 of FIG. 10 instead of FIG.

  As described above, the form information and the restriction information for forming the sheet stored in the sheet DB in the embodiment have been described. Next, the processing in step S106 in FIG. 5 described above will be described with reference to the flowchart in FIG. Here, the description will be made assuming that “application for mortgage” is selected from a menu screen (not shown).

  In step S201, the CPU 101 refers to the GUI configuration information 301 in the mortgage application that has already been read, generates the sheet 700 of FIG. 7 as the initial GUI screen, and performs rotation processing as necessary with reference to the environment information 108d. Then, the image is transferred to the projection unit 115. As a result, the lower side in FIG. 7 is projected on the table 400 with the direction in which the teller 401 is seated and the upper side in the direction in which the customer 402 is seated.

  Next, the CPU 101 determines whether or not there is an operation input to the teller 401 and the customer 402 within the projection range 411, and waits until it is present. If it is determined that there is an operation input, the process proceeds to step S203 to determine its validity.

  Hereinafter, the validity determination process in step S203 will be described with reference to the flowchart of FIG.

  First, in step S301, the CPU 101 determines whether the gesture operator is the teller 401 or the customer 402 depending on whether the hand operated by the gesture has entered the projection range 411 from the direction of the teller side or the customer side. To do. In step S302, the CPU 101 acquires restriction information on GUI sheet information of the currently projected sheet. In step S303, the CPU 101 determines whether there is a restriction description for the entire sheet. If there is such description, the process advances to step S304 to determine whether the person who can operate the entire sheet is a teller or a customer. On the other hand, if there is no description relating to the restriction on the entire sheet, in step S305, the operated GUI part is specified, and it is determined whether the operable person is a teller or a customer from the restriction information on the GUI part. . As described above, when an operable person is determined from the restriction information from the GUI sheet information in step S304 or S305, the process proceeds to step S306.

  In step S306, the CPU 101 determines a match / mismatch between the gesture operator determined in the process of step S301 and the operable operator determined in step S304 or S305. If they match, the gesture operation is determined to be valid (step S307), and if they do not match, it is determined to be invalid (unauthorized) (step S308).

  As described above, the validity determination process in step S203 is performed. Returning to the flowchart of FIG.

  In step S204, if the result of the validity determination in step S203 is invalid (unauthorized), the CPU 101 does nothing (ignore) for the gesture operation and waits for the next input.

  On the other hand, if it is determined to be valid, the process proceeds to step S205. In step S205, it is determined whether or not the end button 1211 on the displayed sheet 1200 (the last sheet of the procedure) has been operated. If not, the process proceeds to step S206 and the corresponding process is performed. Note that the processing in step S206 includes processing related to sheet switching, and includes calculation processing of the simulation button 915 and the like, which are clear from the above description and will not be described in detail. If the displayed sheet is the last sheet 1200 and the end button 1211 is operated and it is determined that the sheet is valid, the process proceeds to step S207 to create loan application data. Then, temporary registration to the server on the backbone network and print processing are performed, and a series of processing is completed.

  As described above, according to the face-to-face system of the present embodiment, by preparing a sheet or GUI part that can be operated only by the customer side or the teller side, it is related to a product sale or contract at least with the consent of the customer. It becomes possible to carry out business.

  In the above embodiment, the restriction information stores information on whether only the teller side can be operated or only the customer side can operate each GUI component arranged on the corresponding sheet. An example was explained. As described above, only the teller side or the customer side can be operated on the sheet itself (the entire sheet). Therefore, the menu screen in step S101 of FIG. 5 described above is also regarded as one sheet, and the restriction information is created so that only the teller side can operate the entire sheet (the operation for the customer cannot be restricted). You may do it. As long as this is the case, the menu sheet in step S101 may be projected onto the table 400 by the projection unit 115 (since the customer cannot operate it). Further, the button 1211 operated by the teller 401 may be deleted from the sheet 1200 of FIG. 12 so that only the customer 402 can operate the sheet 1200 itself. In this case, the confirmation button 1221 may function as a button for instructing to end a series of procedures.

  In the above embodiment, it is assumed that the attribute indicating whether the document sheet itself and each GUI component that is a component of the document sheet are operated by the customer or the teller is described in the restriction information. explained. However, regarding the GUI parts, it may be determined whether the operation is permitted to the customer or the teller from the position of the GUI parts. Typically, a GUI part that can be operated only by a customer or a GUI part that can be operated only by a teller may be determined depending on which position is specified with respect to the document sheet (for example, a central position).

  In the embodiment, as shown in FIG. 3, the form and the restriction information are managed as separate data. However, the form and the restriction information are not limited to the configuration shown in FIG.

  In the embodiment, the hardware such as the projection imaging apparatus 110 is required, but most of the processing can be realized by a program executed by the CPU 101. Therefore, the present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 100 ... Control apparatus, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... Network I / F, 105 ... I / F, 106 ... Video controller, 107 ... Storage controller, 108 ... External storage device, 110 ... Projection imaging Apparatus 115 ... Projection unit 116 ... Imaging unit 117 ... Distance measurement unit

Claims (11)

A plurality of sheet information indicating the possible sheet accept gesture operation, storage means for storing the control information for controlling a gesture operation of a plurality of users according to the whole of the sheet,
Projection control means for controlling to project data representing the sheet onto a projection plane shared by a plurality of users based on the sheet information stored in the storage means;
A specifying means for specifying a gesture operation from any user based on the gesture operation detected on the projection plane;
The gesture operation stored in the storage means as the control information is invalidated when the recognizable gesture operation for the entire sheet does not match the user gesture operation specified by the specifying means, Further, when the receivable gesture operation for the entire sheet stored in the storage unit coincides with the user's gesture operation specified by the specifying unit, the control is performed so that the gesture operation becomes valid. Means,
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the specifying unit specifies a user's gesture operation based on a direction of the gesture operation detected on the projection plane. The seat includes a first user area erect when viewed from the first user and a second user area erect when viewed from the second user,
The control means validates the gesture operation by specifying in which area of the first user area or the second user area the user's gesture operation specified by the specifying means is performed. The information processing apparatus according to claim 1, wherein the information processing apparatus controls whether to perform or disable . The sheet includes a GUI component that can accept a gesture operation,
The specifying unit may determine the target of the gesture operation depending on whether the GUI component of the target of the gesture operation is located in the first user region or the second user region. The information processing apparatus according to claim 3, wherein the GUI component is specified as a GUI component that is set to be operable by any user. Wherein said control means includes a gesture operation can accept according to the whole of the sheet, the gesture operations and identified in a particular unit invalidates the gesture operation when a mismatch, according to the overall acceptance possible gesture operation of the seat 5. The information processing apparatus according to claim 4 , wherein when the gesture operation specified by the specifying unit matches, the gesture operation corresponding to the GUI component is controlled to be valid. The storage means further stores sheet information indicating a plurality of continuous sheets, and control information for controlling a user's gesture operation for each of the sheets,
If the gesture operation specified by the specifying means matches an acceptable gesture operation based on the control information, the projection control means changes the data projected on the projection plane to other data, and The projection control is performed so that the data projected on the projection plane is not changed to other data when the gesture operation specified by the means does not coincide with an acceptable gesture operation based on the control information. The information processing apparatus according to any one of 1 to 5. Storage means for storing sheet information indicating a plurality of consecutive sheets, and user's operation on the sheet, and restriction information indicating which operation is valid for each sheet ;
Projection control means for controlling data representing the sheet to be projected onto a projection plane shared by a plurality of users based on the sheet information stored in the storage means;
Specifying means for specifying an operation detected on the projection plane;
Wherein when operations that are valid mismatch by the operation and the restriction information specified by the specifying means invalidates the operation to the sheet, also enabled by the operation and the restriction information specified by said specifying means and control means for controlling the effective operation corresponding to the sheet when the operations and to be match,
An information processing apparatus comprising: A plurality of sheet information indicating the possible sheet accept gesture operation, a method of controlling an information processing apparatus including a storage means for storing the control information for controlling a gesture operation of a plurality of users according to the whole of the sheet,
A projection control step for controlling to project data representing the sheet onto a projection plane shared by a plurality of users based on the sheet information stored in the storage unit;
A specific step of identifying a user's gesture operation based on the gesture operation detected on the projection plane;
The gesture operation stored in the storage means as the control information is invalidated when the recognizable gesture operation for the entire sheet and the user's gesture operation specified in the specific step are inconsistent, In addition, when the receivable gesture operation for the entire sheet stored in the storage unit and the user's gesture operation specified in the specific step coincide with each other, control is performed so as to validate the gesture operation. Steps,
A method for controlling an information processing apparatus, comprising: A control method for an information processing apparatus comprising storage means for storing sheet information indicating a plurality of consecutive sheets and restriction information indicating a user operation on the sheet and which operation is valid for each sheet. There,
A projection control step for controlling data representing the sheet to be projected onto a projection plane shared by a plurality of users based on the sheet information stored in the storage unit;
A specifying step of specifying an operation detected on the projection plane;
Wherein when operations that are valid mismatch by the operation and the restriction information specified by the specifying step invalidates the operation to the sheet, also enabled by the operation and the restriction information specified by the specifying step a control step of controlling the effective operation corresponding to the sheet when the operations and to be match,
A method for controlling an information processing apparatus, comprising:   The program for functioning a computer as each means of the information processing apparatus of any one of Claims 1 thru | or 7.   A computer-readable storage medium storing the program according to claim 10.

Images