JP7647367B2 - Information processing device, information processing system, information processing method, and program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, an information processing method, and a program.

It is possible to set permissions for each user of the image forming device, such as the services that can be used and the files that can be accessed. Furthermore, it is also possible to perform user authentication by displaying an authentication screen for an external service on the application screen of the image forming device. Here, in the Android (trademark) OS (Operation System), when displaying a web screen on the application screen, a display module called Webview is used. Patent Document 1 also discloses a process for registering an IC card used to authenticate a user of the image forming device from the image processing device.

However, the conventional technology has a problem in that it is not possible to appropriately control the display module in order to use an external service. Furthermore, the technology of Patent Document 1 does not solve this problem.

In view of the above problems, an embodiment of the present invention aims to appropriately control a display module in order to utilize external services.

In order to solve the above-mentioned problems, the present invention provides an information processing device having a function of displaying a display screen of an external service connected via a communication network, comprising: a control unit that generates a process for obtaining screen information of the display screen from the external service before a user uses the external service, and deletes the generated process before a next user starts using the external service; and a Web display unit that uses a display module that displays the display screen in a predetermined display area using the process, wherein the control unit generates the process before a user logs in to the external service, and deletes the generated process after the login is completed .

According to an embodiment of the present invention, the display module can be appropriately controlled to utilize external services.

FIG. 1 is a diagram showing an example of a schematic diagram of an information processing system according to an embodiment of the present invention. FIG. 1 is a diagram illustrating an example of a hardware configuration of an image forming apparatus (MFP) according to an embodiment of the present invention. FIG. 1 is a diagram showing an example of a functional block diagram of an information processing system according to an embodiment of the present invention; FIG. 13 is a diagram showing an example of a configuration of an authentication screen according to the embodiment of the present invention. FIG. 13 is a diagram showing an example of an authentication screen displayed on the image forming apparatus according to the embodiment of the present invention. FIG. 11 is a sequence diagram showing an example of a login process in the information processing system according to the embodiment of the present invention. FIG. 11 is a diagram illustrating an example of a login screen according to an authentication setting according to an embodiment of the present invention. 11A to 11C are diagrams illustrating an example of a process in which a login screen (authentication screen) according to an embodiment of the present invention is omitted. FIG. 13 is a diagram illustrating a method for executing a process to solve the problem of retaining account information according to an embodiment of the present invention. FIG. 11 is a sequence diagram showing an example of a login process that solves a problem related to user authentication according to an embodiment of the present invention. 11 is a sequence diagram showing an example of a process for displaying a screen of an external service at an appropriate magnification according to an embodiment of the present invention. FIG. FIG. 13 is a diagram showing an example of a script for changing the magnification of a screen display according to an embodiment of the present invention.

Below, embodiments of an information processing device, an information processing system, an information processing method, and a program according to the present invention will be described in detail with reference to the attached drawings.

[First embodiment]
<System Overview>
FIG. 1 is a diagram showing an example of a schematic diagram of an information processing system 5 according to an embodiment of the present invention. The information processing system 5 includes an information processing device 6 such as an image forming device 9 and an authentication server 2, and is capable of communicating with an external Web service 4 and an authentication relay server 7 via a communication network 3. A user executes a login operation using an account of an external Web service 4 such as Office365 (trademark) from a touch panel 940a of the image forming device 9. Here, the touch panel 940a includes a device equipped with an Android (trademark) OS (Operation System). The image forming device 9 executes an application for authenticating a user with the authority granted to each user. The granted authority may include whether the user is a general user or a user with administrator authority, or may include service usage authority including external services such as copying, scanning, and file downloading in the image forming device 9, or access authority to a shared file. In this application, a Web display module called Webview is used to display a Web page. Webview is a function provided by the OS. When the external Web service 4 determines from the account information that the user belongs to the information processing system 5, it requests the authentication server 2 in the information processing system 5 to execute user authentication, and the authentication server 2 executes the user authentication. The authentication relay server mediates the external Web service 4 to provide an authentication screen to the information processing device 6. The authentication relay server 7 transmits the URL (Uniform Resource Locator) of the redirect destination (external Web service 4, etc.) that executes authentication to the requester of user authentication, based on information such as the user ID of the account information (such as the service used by the user).

In the following explanation, the email address, user ID, and password are account information, but the email address may be referred to as the first authentication information, and the user ID and password as the second authentication information. In addition, the authentication screen and login screen are both examples of user authentication screens, but the screen for inputting the email address may be referred to as the authentication screen or the first authentication screen, and the screen for inputting the user ID and password may be referred to as the login screen or the second authentication screen. In addition, both authentication and login are examples of user authentication processing, but the processing executed in the external web service 4 based on the email address may be referred to as the authentication processing or the first authentication processing, and the processing executed in the authentication server 2 based on the user ID and password may be referred to as the login processing or the second authentication processing. In addition, an external web service may be referred to as an external service, but there is no difference between the two.

<Hardware configuration example>
Fig. 2 is a diagram showing an example of a hardware configuration of an image forming apparatus 9 (MFP) according to an embodiment of the present invention. As shown in Fig. 2, the MFP (Multifunction Peripheral/Product/Printer) includes a controller 910, a short-range communication circuit 920, an engine control unit 930, an operation panel 940, and a network I/F 950. The operation panel 940 includes a touch panel 940a for receiving input from a user, and a numeric keypad 940b for receiving input from a user.

Of these, the controller 910 has a CPU 901, which is the main part of the computer, a system memory (MEM-P) 902, a north bridge (NB) 903, a south bridge (SB) 904, an ASIC (Application Specific Integrated Circuit) 906, a local memory (MEM-C) 907, which is a storage unit, an HDD controller 908, and a HD 909, which is also a storage unit, and is configured such that the NB 903 and the ASIC 906 are connected by an AGP (Accelerated Graphics Port) bus 921.

Of these, the CPU 901 is a control unit that performs overall control of the MFP 9. The NB 903 is a bridge that connects the CPU 901 with the MEM-P 902, the SB 904, and the AGP bus 921, and includes a memory controller that controls reading and writing to the MEM-P 902, a PCI (Peripheral Component Interconnect) master, and an AGP target.

The MEM-P 902 is composed of a ROM 902a, which is a memory for storing programs and data that realize the various functions of the controller 910, and a RAM 902b, which is used for expanding the programs and data, and as a drawing memory during memory printing. The programs stored in the RAM 902b may be provided by recording them in an installable or executable format on a computer-readable recording medium such as a CD-ROM, CD-R, or DVD.

SB904 is a bridge for connecting NB903 to PCI devices and peripheral devices. ASIC906 is an integrated circuit (IC) for image processing applications that has hardware elements for image processing, and acts as a bridge connecting AGP bus921, PCI bus922, HDD908, and MEM-C907. This ASIC906 is composed of a PCI target and AGP master, an arbiter (ARB) that is the core of ASIC906, a memory controller that controls MEM-C907, multiple DMACs (Direct Memory Access Controllers) that rotate image data using hardware logic, and a PCI unit that transfers data between scanner unit931 and printer unit932 via PCI bus922. In addition, a USB (Universal Serial Bus) interface or an IEEE1394 (Institute of Electrical and Electronics Engineers 1394) interface may be connected to the ASIC 906.

<About the function>
Fig. 3 is a diagram showing an example of a configuration diagram of functional blocks of an information processing system 5 according to an embodiment of the present invention. As shown in Fig. 3, the information processing system 5 includes, as devices having main functional blocks, an information processing device 6 such as an image forming device 9, and an authentication server 2. Each functional block is, for example, a function or means realized by a CPU 901 executing instructions included in one or more programs installed in the image forming device 9.

<Functions of the information processing device>
The information processing device 6 includes a control unit 10 , an operation receiving unit 12 , a display control unit 13 , a first communication unit 14 , and a Web display unit 15 .

The control unit 10 transmits a display request to the Web display unit 15 for a login screen, authentication screen, etc. to be displayed on the touch panel 940a of the image forming device 9. The control unit 10 also starts a Web display process executed by the Web display unit 15 to display the login screen and authentication screen. Alternatively, the control unit 10 may transmit a start request for process start to the Web display unit 15, so that the Web display unit 15 starts the process. The control unit 10 also transmits a request to execute a script that changes the display magnification of the authentication screen and login screen of the external Web service 4, etc., to the Web display unit 15.

The operation reception unit 12 receives operations such as user login on the touch panel 940a of the image forming device 9.

The display control unit 13 displays a menu screen, a login screen for an external web service 4, and an authentication screen on the touch panel 940a of the image forming device 9.

The first communication unit 14 transmits and receives information to and from the external Web service 4, the authentication server 2, and the authentication relay server 7 via the communication network. The first communication unit 14 transmits, for example, information such as the account and password used by the user at the time of login, which is received by the operation reception unit 12, to the authentication server 2 and the external Web service 4 via the communication network 3. The first communication unit 14 also receives information related to the authentication screen from the authentication server 2 and the external Web service 4 via the communication network 3. The first communication unit 14 also transmits a display request for the authentication screen to the authentication relay server 7, and receives information such as the URL of the external Web service 4 for displaying the authentication screen from the authentication relay server 7. The transmission and reception of information performed by the first communication unit 14 may be performed by the Web display unit 15.

The Web display unit 15 uses information received from the external Web service 4, etc. to display a Web screen (a display screen based on a communication protocol on the Internet called World Wide Web) including an authentication screen or a login screen on the touch panel 940a of the image forming device 9. Alternatively, screen information of the Web screen to be displayed may be created, and the display control unit 13 may display the created screen information on the touch panel 940a of the image forming device 9. In the Android (trademark) OS, a Web display module called Webview realizes this function. In addition, the Web display unit 15 accesses the external Web service 4, the authentication server 2, etc. to obtain information on the login screen or the authentication screen. Alternatively, the Web display unit 15 transmits a user authentication request together with the user's account information to the external Web service 4, the authentication server 2, etc. In addition, the Web display unit 15 executes a script for changing the display magnification requested by the control unit 10 to change the display magnification of the displayed Web screen. In addition, the process that executes the processing performed by the web display unit 15 is called the web display process.

<Authentication server functions>
The authentication unit 11 executes user authentication using the received account information (user ID and password).

The second communication unit 16 receives authentication requests, transmits authentication results, and transmits login screens and authentication screens via the communication network 3 with the image forming device 9 and the external web service 4.

<Authentication screen structure>
Fig. 4 is a diagram showing an example of the configuration of an authentication screen according to an embodiment of the present invention. As shown in Fig. 4, a login screen frame 101 for displaying an authentication screen or a login screen is provided in a touch panel 100 of the image forming apparatus 9, and a Webview screen 102 displayed by a Web display module Webview is provided in the login screen frame 101. Furthermore, an external Web service authentication screen 103 displayed by an external Web service 4 is provided in the Webview screen 102.

Figure 5 is a diagram showing an example of an authentication screen displayed on the image forming device 9 according to an embodiment of the present invention. Based on the configuration of the authentication screen shown in Figure 4, a copy button 114 and a scanner button 115 for specifying a menu of the image forming device 9 are displayed in the touch panel 110. In the login screen frame 111, a Webview screen 112 displayed by Webview, a language designation button 116 for designating a language, and an administrator login button 117 for calling up an administrator login screen are displayed. In the Webview screen 112, an external Web service authentication screen 113 is displayed. In the external Web service authentication screen 113, an account information input field 118 for inputting user account information and a login execution button 119 for executing a login request after inputting the account information are displayed. Here, for example, an internal email address given to the user is used as the account information. The external Web service 4 determines that the user is a user in the information processing system 5 from the domain information of the email address, and requests user authentication from the authentication server 2 in the information processing system 5.

Figure 6 is a sequence diagram showing an example of authentication processing and login processing in the information processing system 5 according to an embodiment of the present invention. Using Figure 6, the processing executed by each functional block of the information processing system 5 when a user logs in to the image forming device 9 will be described. Here, the control unit 10 and the Web display unit 15 are functions within the image forming device 9, and the authentication unit 11 is a function of the authentication server 2, but processing by other functions shown in Figure 3 will also be described as necessary. In addition, communication between the Web display unit 15 and the external Web service 4, and between the Web display unit 15 and the authentication unit 11 is performed by exchange of request messages and the like using protocols for displaying the Web, such as HTTP (Hyper Text Transfer Protocol) and HTTPS (HTTP Secure), so that the description of the processing by the first communication unit 14 and the second communication unit 16 may be omitted.

Step S21: The operation reception unit 12 receives a request to display a login screen by the user operating the touch panel 940a of the image forming device 9, and transmits the received display request to the control unit 10.

Step S22: The control unit 10 sends a display request for the authentication screen of the external web service 4 to the web display unit 15.

Step S23: The web display unit 15 sends a display request for the authentication screen of the external web service 4 to the external web service 4.

Step S24: The external Web service 4 transmits information about the authentication screen of the external Web service 4 to the first communication unit 14 of the image forming device 9. The first communication unit 14 receives the information about the external Web service authentication screen and transmits the received information to the display control unit 13. The display control unit 13 uses the received information to display the authentication screen of the external Web service 4 on the touch panel 940a of the image forming device 9. Note that the authentication screen has an input field for accepting input of an email address as account information. Alternatively, the process performed by the first communication unit 14 may be performed by the Web display unit 15.

Step S25: The operation reception unit 12 receives the email address input by the user as account information for user authentication of the external Web service 4, and transmits the received email address to the first communication unit 14. The first communication unit 14 transmits the received email address to the external Web service 4 via the communication network 3. Alternatively, the process performed by the first communication unit 14 may be performed by the Web display unit 15.

Step S26: The external web service 4 determines based on the domain information of the received email address that the authentication server 2 in the information processing system 5 will perform user authentication, and requests the web display unit 15 to redirect the user authentication to the authentication server 2. In other words, if there are multiple authentication servers 2, the external web service 4 can identify the authentication server 2 to redirect based on the domain information, and send a redirect request to the web display unit 15.

Step S27: Based on the received request, the web display unit 15 sends a request to display the login screen to the authentication unit 11.

Step S28: The second communication unit 16 of the authentication server 2 transmits screen information of the login screen to the first communication unit 14 of the image forming device 9 via the communication network 3. The first communication unit 14 transmits the received screen information to the display control unit 13, and the display control unit 13 displays the login screen on the touch panel 940a of the image forming device 9. Note that the login screen has input fields for accepting input of a user ID and password as account information.

Step S29: The operation reception unit 12 receives account information (login ID and password) from the user, and transmits the received account information to the first communication unit 14. The first communication unit 14 transmits the account information to the second communication unit 16 of the authentication server 2 via the communication network 3. The second communication unit 16 transmits the received account information to the authentication unit 11. Alternatively, the web display unit 15 may transmit a user authentication request to the authentication unit 11 together with the user's account information.

Step S30: The authentication unit 11 performs user authentication based on the received account information. If the user authentication is successful, that is, the received account information (user ID and password) matches the account information held by the authentication unit 11.

Step S31: The authentication unit 11 sends an authentication success notification to the web display unit 15, indicating that the user authentication was successful.

Step S32: The web display unit 15 sends the received authentication success notification to the control unit 10.

Step S33: The control unit 10 puts the image forming device 9 in a state in which the user can start using the external service with the authorized authority. The display control unit 13 displays a menu screen on the touch panel 940a of the image forming device 9. As the menu screen, a list screen of applications installed in the information processing device 6 can be displayed. The user can operate the application icon displayed on the menu screen to request the execution of a desired function, such as a copy function, print function, scan function, or fax function.

The above describes the processing performed by each functional block of the information processing system 5 when a user logs in to the image forming device 9.

Figure 7 is a diagram showing an example of an authentication screen and a login screen according to the authentication setting according to an embodiment of the present invention. The screen on the left side of Figure 7 is the same as the authentication screen shown in Figure 4, and corresponds to the authentication screen displayed in steps S22 to S24 of Figure 6. The screens on the upper right and lower right of Figure 7 correspond to the login screen displayed in steps S26 to S28 of Figure 6, and respectively display the form authentication screen 104 and the BASIC authentication screen 105 (or the integrated OS authentication screen) in the Webview screen 102. In this way, the login screen is set so that the login screen of any of the form authentication, BASIC authentication, and integrated OS authentication is displayed depending on the authentication setting. Note that the integrated OS authentication is, for example, integrated Windows (commercial law) authentication, but will be referred to as integrated OS authentication hereinafter. In form authentication, account information (user ID and password) is entered using a form input screen displayed on the Web, and session management is performed using cookies. In BASIC authentication, authentication is performed using the HTTP protocol, also known as HTTP authentication. In integrated OS authentication, authentication is performed using user account information in the OS.

<User authentication is omitted>
8 is a diagram showing an example of a process in which a login screen (authentication screen) according to an embodiment of the present invention is omitted. A problem in which user authentication is omitted will be described with reference to FIG.

Step S120: User A enters an email address on the authentication screen of the external web service 4 to log in to the image forming device 9. The external web service 4 requests that the authentication server 2 execute the authentication process based on the received email address. (The received request is redirected to the authentication server 2 by returning the URL of the authentication server 2.)

Step S121: In the user authentication process by authentication server 2, BASIC authentication or integrated OS authentication is set as the authentication setting, so the BASIC authentication screen or integrated OS authentication screen (login screen for BASIC authentication or integrated OS authentication) is displayed. User A enters his/her user ID and password on the BASIC authentication screen or integrated OS authentication screen.

Step S122: User authentication by user A is successful, and the menu screen of the image forming device 9 is displayed.

Step S123: User A logs out from the image forming device 9.

Step S124: User B enters his/her email address on the authentication screen of the external web service 4 to log in to the image forming device 9.

Step S125: User authentication for user B (displaying the login screen and executing the user authentication process) is omitted.

Step S126: Login is successful as user A, not as user B, and the menu screen of the image forming device 9 is displayed.

As described above, when BASIC authentication or integrated OS authentication is set as the authentication setting, a problem occurs in which user authentication for User B is not performed and the user successfully logs in as User A, who was previously using the service. This problem is caused by the following process of Webview, which is the web display module that displays the BASIC authentication screen or integrated OS authentication screen.

Causing Webview actions:
- When user A logs in, the account information (user ID and password) is stored as cache.
When User B logs in, the system executes user authentication processing using the stored account information of User A without presenting a login screen to User B, allowing User B to successfully log in as User A.

Webview does not provide an API for deleting the account information stored in the cache, so it cannot be deleted intentionally. On the other hand, if form authentication is set as the authentication setting, deleting the cookie will not cause information about User A to be stored, so this type of problem will not occur.

<How to delete account information held by Webview>
9 is a diagram for explaining a method of executing a process for solving the problem of account information being held according to an embodiment of the present invention. FIG. 9 shows processes newly generated and executed in the image forming apparatus 9, and the process 130 shown on the left includes both processes other than Webview-related processes and Webview-related processes. Meanwhile, in the process shown on the right, the process 131 includes processes other than Webview-related processes, and the process 132 includes only Webview-related processes. Here, the process 131 including processes other than Webview-related processes is an example of a first process, and is, for example, a process related to the display of the Webview screen 102 and the external Web service authentication screen 103, and corresponds to a Web display process. Also, the process 132 including only Webview-related processes is an example of a second process, and is, for example, a process related to the display of the login screen frame 101 other than the Webview screen 102 and the external Web service authentication screen 103. By dividing the process in this way and deleting (stopping, KILLing) the process 132 that contains only Webview-related processing, it is possible to delete the account information cached by Webview and execute the login process for the next user without skipping it. Note that if the process 130 that is not divided is deleted (stopped, KILLing), the processing of the system itself will stop, and the next user authentication process cannot be executed.

<Process to avoid the problem of user authentication being omitted>
Fig. 10 is a sequence diagram showing an example of login processing that solves the problem related to user authentication according to the embodiment of the present invention. Processing that solves the problem of omitting user authentication due to Webview holding account information will be described with reference to Fig. 10. When the image forming apparatus 9 is started up, a process having processing other than Webview-related processing is started up, and the Webview-related processing process is started up as a separate process for each user before the login processing starts.

Step S41: The operation reception unit 12 receives a request to display a login screen by user A operating the touch panel 940a of the image forming device 9, and transmits the received display request to the control unit 10.

Step S42: The control unit 10 generates (or starts) a Web display process A17 for the login process of user A. Note that the control unit 10 generates a process that includes processes other than those related to the Webview, but this may be done simultaneously with the generation of the Web display process A17 or may be done before the generation of the Web display process A17.

Step S43: The control unit 10 sends a display request for the external web service authentication screen to the web display process A17 of the web display unit 15.

Step S44: The web display process A17 of the web display unit 15 sends a request to the external web service 4 to display the external web service authentication screen to the external web service 4.

Step S45: The external Web service 4 transmits information about the external Web service authentication screen to the first communication unit 14 of the image forming device 9. The first communication unit 14 receives the information about the external Web service authentication screen and transmits the received information to the display control unit 13. The display control unit 13 uses the received information to display the external Web service authentication screen on the touch panel 940a of the image forming device 9. Alternatively, the process executed by the first communication unit 14 may be executed by the Web display unit 15.

Step S46: The operation reception unit 12 receives the email address entered by user A as account information for external web service authentication, and transmits the received email address to the first communication unit 14. The first communication unit 14 transmits the received email address to the external web service 4 via the communication network 3. Alternatively, the process performed by the first communication unit 14 may be performed by the web display unit 15.

Step S47: Based on the domain information of the received email address, the external web service 4 determines that user authentication will be performed by the authentication server 2 in the information processing system 5, and requests the web display process A17 of the web display unit 15 to redirect user authentication to the authentication server 2.

Step S48: Based on the received request, the Web display process A17 of the Web display unit 15 sends a request to display the login screen to the authentication unit 11.

Step S49: The second communication unit 16 of the authentication server 2 transmits screen information of the login screen to the first communication unit 14 of the image forming device 9 via the communication network 3. The first communication unit 14 transmits the received screen information to the display control unit 13, and the display control unit 13 displays the login screen on the touch panel 940a of the image forming device 9.

Step S50: The operation reception unit 12 receives account information (login ID and password) from user A, and transmits the received account information to the first communication unit 14. The first communication unit 14 transmits the account information to the second communication unit 16 of the authentication server 2 via the communication network 3. Alternatively, the web display unit 15 may transmit a user authentication request to the authentication unit 11 together with the user's account information.

Step S51: The second communication unit 16 transmits the received account information to the authentication unit 11, and the authentication unit 11 performs user authentication based on the received account information. Here, it is assumed that the user authentication is successful, that is, the received account information (user ID and password) matches the account information held by the authentication unit 11.

Step S52: The authentication unit 11 sends an authentication success notification indicating that the user authentication was successful to the Web display process A17 of the Web display unit 15.

Step S53: The Web display process A17 of the Web display unit 15 sends the received authentication success notification to the control unit 10.

Step S54: The control unit 10 puts the image forming device 9 in a state in which user A can start using the external service with the authorized authority. The display control unit 13 displays the menu screen on the touch panel 940a of the image forming device 9.

Step S55: The control unit 10 deletes (or stops, KILLs) the web display process A17. This process deletes the account information of user A that was stored in the web display process A17. At this time, the control unit 10 can leave processes that include processes other than those related to the web view, without deleting them. Note that the timing for deleting the web display process A17 is not limited to this. The web display process A17 may be deleted before the web display process B18 is started. For example, it may be deleted when user A logs out from the image forming device 9, when the image forming device 9 transitions to or returns from a power saving state, or when a request to display a login screen is received from user B.

Step S56: User A uses the functions of the image forming device 9.

Step S57: User A logs out from the image forming device 9. For example, a logout request is received from User A via the touch panel 94a. Alternatively, the user may be automatically logged out if the touch panel 94a is not operated for a certain period of time.

Step S58: The operation reception unit 12 receives a request to display the login screen by user B operating the touch panel 940a of the image forming device 9, and transmits the received display request to the control unit 10.

Step S59: The control unit 10 starts the web display process B18 for the login process of user B. The web display process B18 is a second web display process that is generated after the web display process A17 is deleted.

After that, in steps S60 to S74, the same processing as steps S43 to S57 is executed for user B using web display process B18, so that the login processing for user B is executed without skipping, and user B logs in as user B.

If the Web display process A17 used during authentication of user A is not deleted and is instead used continuously during authentication of user B, the following process will be executed in step S65, and user authentication of user B will be omitted.

Step S65: The web display unit 15 completes the authentication process using the account information of user A stored in the cache without making a request to the authentication server 2 to display the login screen, thereby allowing user A to successfully log in.

Through the above processing, when User A finishes using the external service and before the next user, User B, starts using the external service, the information processing system 5 deletes the process related to Webview, thereby deleting the user's account information stored in Webview. In this way, by appropriately controlling the display module for using the external service in response to user switching, user authentication is performed without being omitted, thereby solving the problem of user authentication being omitted. Here, the "next user" may be the same user or a different user.

Second Embodiment
<Process to avoid the problem of the authentication screen layout collapsing>
The screen layout of a user authentication screen (authentication screen) by an external Web service 4 such as Office365 (trademark) is usually designed on the assumption that it will be displayed on a browser of a PC (Personal Computer). Therefore, when the screen is displayed on a device other than a PC, such as a tablet terminal using Android (trademark) OS or a touch panel 940a of an image forming apparatus 9, a problem may occur in which a part of the screen is cut off due to differences in the size and aspect ratio of the display screen. Therefore, when an application that displays an authentication screen of the external Web service 4 is developed on the client side, it is possible to specify a display magnification that matches the device on which the screen is displayed by specifying a value indicated by the viewport tag of HTML. However, since the client side application can also handle account information (such as a user ID and password) of the external Web service 4, this information may be illegally obtained and misused. Therefore, from a security standpoint, it is desirable for the client side to simply transition to the URL of the authentication screen of the external Web service 4 and display the login screen (receiving only the authentication result without receiving account information).

The following describes a process for displaying an authentication screen for the external Web service 4 in a layout suited to the device by loading a script that changes the display magnification. FIG. 11 is a sequence diagram showing an example of a process for displaying an external service screen at an appropriate magnification according to an embodiment of the present invention. Here, the system configuration and functional block configuration are the same as those described in the first embodiment using FIG. 1 and FIG. 3. Communication between the Web display unit 15 and the external Web service 4, and between the Web display unit 15 and the authentication relay server 7 involves the exchange of request messages and the like using protocols for displaying the Web such as HTTP and HTTPS, so that a description of the processing of the first communication unit 14 and the second communication unit 16 will be omitted.

Step S81: When the user starts the image forming device 9, an application for performing user authentication is executed. The operation reception unit 12 may receive a request to display a login screen by the user operating the touch panel 940a of the image forming device 9, and transmit the received display request to the control unit 10.

Step S82: The control unit 10 of the image forming device 9 sends a display request for the authentication screen to the web display unit 15 as a request to read the web page (top page) to be displayed on the application screen.

Step S83: The Web display unit 15 reads the top page information (HTML and Javascript), analyzes the contents of the information, and executes it. The top page information contains a code that requests a login screen from the external Web service 4.

Step S84: The web display unit 15 sends a request to display the login screen included in the top page information (HTML) to the authentication relay server 7.

Step S85: The authentication relay server 7 sends the URL (Uniform Resource Locator) of the external web service to which the user is redirected to the web display unit 15.

Step S86: The web display unit 15 accesses the received URL and sends a message to the external web service 4 requesting screen information for the authentication screen.

Step S87: The external web service 4 sends screen information (HTML) of the authentication screen to the web display unit 15.

Step S88: The web display unit 15 reads the received screen information (HTML) and sends a read completion notification to the control unit 10 to inform it that reading has been completed.

Step S89: The control unit 10 sends a request to execute a script (Javascript) for changing the display magnification to the Web display unit 15. The script specifies a display magnification according to the size (or width, size, width, height, etc.) of the area in which the Web screen is displayed in the touch panel 940a of the image forming device 9 (for example, the Webview screen 102 shown in FIG. 4) by the viewport tag. FIG. 12 is a diagram showing an example of a script for changing the magnification of the screen display according to an embodiment of the present invention. This is an example of a script for resetting the viewport value using the viewport value included in the screen information of the authentication screen received from the external Web service 4 in step S87 and information on the display area of the device (the touch panel 940a of the image forming device 9). WEBVIEW_WIDTH indicates the display area width of the device, and VIEWPORT_WIDTH indicates the width of the authentication screen of the external Web service 4 before the change included in the received screen information. By calculating and specifying the ratio value of WEBVIEW_WIDTH/VIEWPORT_WIDTH in initial-scale, which indicates the display magnification, it is possible to change the display magnification to match the display area width of the device. Alternatively, the application that performs authentication may read out the value of the display magnification that was set and stored in advance in the design stage of the image forming device 9, or the values of WEBVIEW_WIDTH and VIEWPORT_WIDTH, and include them in the script. Alternatively, the application that performs authentication may determine the display magnification by calculating the value of WEBVIEW_WIDTH/VIEWPORT_WIDTH based on device information (such as the screen size and aspect ratio of the touch panel 940a of the image forming device 9) stored on the image forming device 9 or the cloud.

Returning to FIG. 11, the following explanation will be given. Step S90: The web display unit 15 executes the magnification change script based on the request received from the control unit 10.

Step S91: The web display unit 15 changes the display magnification of the authentication screen received from the external web service 4 based on the execution result of the magnification change script.

Step S92: The web display unit 15 sends an execution completion notification to the control unit 10 to notify that execution of the magnification change script has been completed.

Step S93: The display control unit 13 displays the authentication screen for the external web service with the display magnification changed on the touch panel 940a of the image forming device 9.

By the above process, the information processing system 5 can change the display magnification of the screen information of the authentication screen acquired from the external Web service 4 to fit the display area of the touch panel 940a of the image forming device 9 and display it. In addition, both the process described in the first embodiment and the process described in the second embodiment may be executed. That is, the process of steps S81 to S93 can be executed in the authentication screen display described above in steps S41 to S45. Similarly, the screen information of the login screen acquired from the authentication unit 11 can be displayed by changing the display magnification to fit the display area of the touch panel 940a of the image forming device 9. In this case, when the Web display unit 15 receives the screen information of the login screen from the authentication unit 11, it transmits a login screen reading completion notification to the control unit 10, and by receiving a display magnification change script execution request from the control unit 10, it can execute the display magnification change script to change the display magnification.

Although several embodiments for implementing the present invention have been described above, the present invention is in no way limited to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention.

For example, the functional block diagram in FIG. 3 is divided according to the main functions to facilitate understanding of the processing by the image forming device 9, the information processing device 6, and the information processing system 5. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing by the image forming device 9 and the information processing device 6 can be divided into even more processing units depending on the processing content. It can also be divided so that one processing unit includes even more processes.

The functions of the embodiments described above can be realized by one or more processing circuits. In this specification, the term "processing circuit" includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and devices such as an ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array), and conventional circuit modules designed to execute each function described above.

The described devices are merely representative of one of multiple computing environments for implementing the embodiments disclosed herein. In one embodiment, the image forming device 9, the information processing device 6, and the information processing system 5 include multiple computing devices, such as a server cluster. The multiple computing devices are configured to communicate with each other via any type of communication link, including a network, shared memory, and the like, and perform the processes disclosed herein.

The first communication unit 14 and the second communication unit 16 are sometimes simply referred to as the communication unit.

Reference Signs List 2 Authentication server 3 Communication network 4 External Web service 5 Information processing system 6 Information processing device 7 Authentication relay server 9 Image forming device 10 Control unit 11 Authentication unit 12 Operation reception unit 13 Display control unit 14 First communication unit 15 Web display unit 16 Second communication unit

JP 2016-012358 A

Claims (7)

An information processing device having a function of displaying a display screen of an external service connected via a communication network,
a control unit that generates a process for acquiring screen information of the display screen from the external service before a user uses the external service, and deletes the generated process before a next user starts using the external service;
a Web display unit that uses a display module that displays the display screen in a predetermined display area using the process;
having
The information processing apparatus , wherein the control unit generates the process before a user logs in to the external service, and deletes the generated process after the user completes the login. The information processing apparatus according to claim 1 , wherein the Web display unit changes a display magnification at which the display screen is displayed in accordance with a size of the display area. The information processing apparatus according to claim 2 , wherein the Web display unit calculates the display magnification ratio using a ratio of a first display area width included in the display screen to a second display area width in the size of the display area. 4. The information processing apparatus according to claim 3 , wherein the Web display unit uses the display magnification that is set in advance. An information processing system having an information processing device that displays a display screen of an external service connected via a communication network and an authentication server,
The information processing device includes:
a control unit that generates a process for acquiring screen information of the display screen from the external service before a user uses the external service, and deletes the generated process before a next user starts using the external service;
a Web display unit that uses a display module that displays the display screen in a predetermined display area using the process ;
having
The control unit generates the process before the user logs in to the external service, and deletes the generated process after the user logs in ;
The information processing system is characterized in that the authentication server performs authentication of a user who uses the external service. An information processing method performed by an information processing device having a function of displaying a display screen of an external service connected via a communication network, comprising:
generating a process for acquiring screen information of the display screen from the external service before a user uses the external service, and deleting the generated process before a next user starts using the external service;
utilizing a display module to display said display screen in a predetermined display area using said process;
creating the process before a user logs in to the external service, and deleting the created process after the user logs in;
13. An information processing method comprising: An information processing device having a function of displaying a display screen of an external service connected via a communication network,
generating a process for acquiring screen information of the display screen from the external service before a user uses the external service, and deleting the generated process before a next user starts using the external service;
utilizing a display module to display said display screen in a predetermined display area using said process;
creating the process before a user logs in to the external service, and deleting the created process after the user logs in;
A program that executes the following.

Images