JP7669302B2 - Information processing system, image processing device and program - Google Patents

Description

The present invention relates to an information processing system, an image processing device, an information processing device, a server device, an information processing method, and a program for registering an image processing device to a server device.

Image processing devices such as digital cameras (hereafter referred to as cameras) have the ability to send images captured by them to external web services via wireless communication such as Wi-Fi (registered trademark). Examples of external web services include Facebook (registered trademark) and Google Photo (registered trademark). In this case, there is a web server (server device) that acts as an intermediary between the camera and the external web service, and a system exists in which, by registering the camera on the web server, the camera can send images to the web server, which then forwards the images to the external web service.

To register a camera with a web server, it is necessary to link the camera with account information for the service provided by the web server. To do this, it is known that the user inputs the information required for registration with the web server via the camera's user interface, and communicates with the web server or an information processing device such as a smartphone or personal computer.

In the system described in Patent Document 1, an email address is input from the user via the camera's user interface, and the camera is registered on a web server using the input email address.

JP 2015-114724 A

As described above, the system described in Patent Document 1 requires the user to operate the camera to input an email address. However, inputting characters via a camera's user interface is generally less user-friendly than inputting characters via a personal computer or smartphone, and therefore requires a lot of effort.

In addition, camera owners do not necessarily have email accounts, so users who do not have an email account must create one in order to register the camera, which is inconvenient.

In view of the above problems, the present invention aims to reduce the amount of work required for registration by reducing the number of operations required on the image processing device to register the image processing device to a server device.

In order to achieve the above objects , an information processing system according to one aspect of the present invention is an information processing system including an image processing device, an information processing device, and a server, wherein the image processing device is configured to receive identification information including at least a random character string used to register the image processing device to a web service provided by the server, and a QR (Quick Search) including a URL (Uniform Resource Locator) related to the server. the information processing device has a display control means for displaying an image of a QR code (registered trademark) and a communication control means for controlling communication of the identification information with the server , the information processing device has an imaging means for imaging an image of the QR code displayed by the display control means of the image processing device , an acquisition means for performing an analysis process to analyze the image of the QR code captured by the imaging means and acquire identification information and a URL, and a first transmission control means for transmitting the identification information acquired by the analysis process to an outside using the URL acquired by the analysis process, and the server has a registration means for registering the image processing device to the Web service after determining that the identification information communicated with the image processing device matches the identification information acquired by the analysis process as a result of receiving access using the URL of the information processing device.

Also, an information processing system as another aspect of the present invention is an information processing system including an image processing device, an information processing device, and a server device, wherein the image processing device comprises a generation means for generating identification information, a display means for displaying the identification information generated by the generation means, and a first transmission means for transmitting the identification information generated by the generation means to the server device, the information processing device comprises an input means for accepting input from a user of the identification information displayed by the display means, and a second transmission means for transmitting the identification information input by the input means to the server device, and the server device comprises a first receiving means for receiving the identification information transmitted by the first transmission means, a second receiving means for receiving the identification information transmitted by the second transmission means, and a registration means for registering the image processing device based on a match between the identification information received by the first receiving means and the identification information received by the second receiving means.

According to another aspect of the present invention, there is provided an image processing device that communicates with a Web service, the image processing device having a display control means for controlling to display an image of a QR (Quick Response) code including identification information including at least a random character string used to register the image processing device to a related Web service and a URL (Uniform Resource Locator) related to the Web service, and a communication control means for controlling to communicate the identification information with the Web service, wherein, when the image processing device recognizes based on a result of further communication that a process of registration to the Web service has been performed as a result of a process of providing the identification information included in the QR code to register the image processing device to the Web service by another information processing device that has read the image of the QR code, the display control means controls to display a notification indicating that the process has been completed.

Furthermore, an information processing device as another aspect of the present invention is an information processing device capable of communicating with an image processing device and a server device, and is characterized in that it comprises an imaging means for capturing an image displayed on the image processing device, an acquisition means for acquiring identification information based on the image captured by the imaging means, a transmission means for transmitting the identification information acquired by the acquisition means to the server device, and a notification means for notifying a user that the registration is complete when the image processing device is registered to the server device based on a match between the identification information transmitted by the transmission means and the identification information transmitted from the image processing device to the server device.

Furthermore, a server device as another aspect of the present invention is a server device capable of communicating with an image processing device and an information processing device, and is characterized in comprising a first receiving means for receiving identification information generated by the image processing device from the image processing device, a second receiving means for receiving the identification information obtained based on the captured image from the information processing device that captured the image displayed on the image processing device, and a registration means for registering the image processing device based on a match between the identification information received by the first receiving means and the identification information received by the second receiving means.

The present invention can reduce the effort required to register an image processing device to a server device.

FIG. 1 is a block diagram of a camera 100 according to first and second embodiments. FIG. 1 is an external view of a camera 100 according to first and second embodiments. FIG. 2 is a block diagram of a Web server according to the first and second embodiments. 1 is a schematic diagram of an entire system according to a first embodiment. FIG. 2 is an overall sequence diagram of processing according to the first embodiment. FIG. 4 is a flowchart showing the operation of the camera 100 according to the first embodiment. FIG. 4 is a flowchart illustrating the operation of the Web server 400 in the first embodiment. FIG. 4 is a flowchart illustrating the operation of the smartphone 500 according to the first embodiment. FIG. 11 is a schematic diagram of an entire system according to a second embodiment. FIG. 11 is an overall sequence diagram of processing according to the second embodiment. FIG. 11 is a flowchart showing the operation of the personal computer 600 in the second embodiment. 3A to 3C are diagrams showing examples of screens displayed on the camera 100 in the first and second embodiments. FIG. 11 is a flowchart illustrating the operation of the camera 100 according to the third embodiment. FIG. 13 is a flowchart illustrating the operation of the Web server 400 according to the third embodiment.

[First embodiment]
Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the configurations shown in the drawings.

FIG. 1 shows an example of the hardware configuration of a camera 100 according to an embodiment of the present invention. Note that in this embodiment, the camera 100 is described as an example of an image processing device, but the image processing device is not limited to the camera 100 and may be any device for processing images, such as a printer that prints images or a video camera that can capture moving images.

The control unit 101 controls each part of the camera 100 in accordance with input signals and a program described below. Note that instead of the control unit 101 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.

The imaging unit 102 is composed of, for example, an optical system that controls an optical lens unit, an aperture, zoom, focus, etc., and an imaging element for converting light (image) introduced through the optical lens unit into an electrical image signal. As the imaging element, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is generally used. Under the control of the control unit 101, the imaging unit 102 converts the subject light imaged by the lens included in the imaging unit 102 into an electrical signal using the imaging element, performs noise reduction processing, etc., and outputs the digital data as image data. In the camera 100 of this embodiment, the image data is recorded on the recording medium 110 in accordance with the DCF (Design Rule for Camera File system) standard.

The non-volatile memory 103 is a non-volatile memory that can be electrically erased and recorded, and stores the programs to be executed by the control unit 101, which will be described later. The working memory 104 is used as a buffer memory that temporarily holds image data captured by the imaging unit 102, as image display memory for the display unit 106, as a working area for the control unit 101, etc.

The operation unit 105 functions as a user interface for receiving instructions from the user to the camera 100. The operation unit 105 includes, for example, a power button for the user to instruct the camera 100 to be turned on/off, a release button for instructing shooting, and a playback button for instructing the playback of image data. In addition, the operation unit 105 includes operation members such as a dedicated connection button for starting communication with an external device via a wireless communication unit 111 described later. The operation unit 105 also includes a touch panel formed on the display unit 106 described later. The release button has a switch 1 and a switch 2. When the release button is pressed halfway, the switch 1 is turned ON. This accepts instructions for preparing for shooting, such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing. When the release button is pressed fully, the switch 2 is turned ON. This accepts instructions for shooting.

The display unit 106 displays the viewfinder image when shooting, displays captured image data, and displays text for interactive operation. It also displays lights/blinks/off using lamps or the like. Examples include the access state to the recording medium 110 described below, and the communication state of the wireless communication unit 111. Note that the display unit 106 does not necessarily have to be built into the camera 100. The camera 100 can be connected to an internal or external display unit 106, and it is sufficient that the camera 100 has at least a display control function for controlling the display of the display unit 106.

The authentication information generating unit 107 generates authentication information used when registering the camera 100 to the web server 400. The authentication information includes a random number and a QR code (registered trademark) described below. Note that the authentication information generating unit 107 may be provided as a software module realized by the control unit 101, rather than as a hardware module.

The recording medium 110 can record image data output from the imaging unit 102. The recording medium 110 may be configured to be detachable from the camera 100, or may be built into the camera 100. In other words, the camera 100 must have at least a means for accessing the recording medium 110.

The wireless communication unit 111 is an interface for connecting to an external device. The camera 100 of this embodiment can exchange data with an external device via the wireless communication unit 111. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the wireless communication unit 111. In this embodiment, the wireless communication unit 111 includes an interface for communicating with the external device via so-called Wi-Fi (registered trademark) in accordance with the IEEE 802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the wireless communication unit 111. The communication method is not limited to Wi-Fi (registered trademark), and also includes, for example, an infrared communication method. The wireless communication unit 111 is an example of a first wireless communication means. It is assumed that the smartphone 500 described later has the same hardware configuration as the camera 100 described using FIG. 1. Here, the smartphone 500 is described as an example of an information processing device, but any information processing device capable of capturing an image such as a QR code may be used other than the smartphone 500.

Next, the external appearance of the camera 100 will be described. Figures 2(a) and (b) are diagrams showing an example of the external appearance of the camera 100. The release button 105a, the playback button 105b, the directional keys 105c, the touch panel 105d, and the power lever 105e are operation members included in the operation unit 105 described above. The display unit 106 displays an image obtained as a result of imaging by the imaging unit 102, a QR code described below, and a notification indicating the result of registration of the camera 100 to the web server 400.

Figure 3 shows an example of the hardware configuration of a web server 400 as an example of a server device that registers the camera 100. The control unit 401 controls each unit of the web server 400 in accordance with input signals and programs described below. Note that instead of the control unit 401 controlling the entire device, multiple pieces of hardware may share the processing to control the entire device.

The non-volatile memory 403 is an electrically erasable and recordable non-volatile memory, and stores the programs executed by the control unit 401, which will be described later, and information about the camera 100 to be registered.

The authentication information processing unit 410 performs login authentication of a user who uses the web server 400 from an information processing device such as a smartphone 500 described later. If the login authentication is successful, it generates an authentication key that uniquely identifies the information processing device. It also performs authentication when a random number is notified from the camera 100. Note that the authentication information processing unit 410 may be provided as a software module realized by the control unit 401, rather than as a hardware module.

The communication unit 411 is an interface for connecting to an external device via the public network 300. The web server 400 of this embodiment can exchange data with the camera 100 and the smartphone 500 via the public network 300. Note that in this embodiment, the communication unit 411 is not limited to being wireless or wired.

Figure 4 is a schematic diagram of the entire system consisting of a camera 100, an access point 200, a public network 300, a web server 400, and a smartphone 500. In the system of this embodiment, the camera 100, the web server 400, and the smartphone 500 are connected so that they can communicate with each other.

Figure 5 is a sequence diagram showing how the QR code displayed on the camera 100 is captured by the smartphone 500 and the camera 100 is registered on the web server 400 in this embodiment.

First, in order to log in to the Web server 400, the smartphone 500 notifies the Web server 400 of the account ID and password (M401). The account ID and password may be stored in the smartphone 500, or may be input by the user each time the user logs in. The Web server 400 performs login authentication using the authentication information processing unit 410, and if authentication is successful, generates an authentication key that uniquely identifies the user and distributes it to the smartphone 500 (M402).

On the other hand, when the camera 100 receives a registration instruction to the Web server 400 from the user via the operation unit 105, the control unit 101 instructs the authentication information generation unit 107 to generate a random number (M403). Then, a QR code is generated based on the random number generated in M403 and an authentication URL that the smartphone 200 accesses to perform authentication processing with the Web server 400 (M404). After generating the QR code, the control unit 101 causes the display unit 106 to display the QR code and the random number (M405). Note that, although a random number, an example of an image showing the identification information, and a QR code have been described as examples of identification information here, this is not limited to these. For example, a combination of numbers that is not a random number may be used as identification information, or an image in a format other than a QR code may be used.

When the QR code is displayed in M405, the smartphone 500 captures an image of the QR code (M406). The smartphone 500 analyzes the captured QR code and obtains a random number and an authentication URL (M407). Next, the smartphone 500 accesses the authentication URL and notifies the web server 400 of the random number and the authentication key distributed by the web server in M402 (M408).

When the Web server 400 receives the random number and authentication key from the smartphone 500, the authentication information processing unit 410 checks whether the same random number has been received twice (M409). Duplicate reception here includes reception from the smartphone 500 or reception from an information processing device other than the smartphone 500. If it is confirmed that there is no duplication, the Web server 400 temporarily stores the authentication key and random number as provisional registration information (M410) and notifies the smartphone 500 that provisional registration has been completed (M411).

The smartphone 500 displays that the provisional registration has been completed, and prompts the user to continue the registration process (M412). The guidance given to the user here includes prompting the user to operate the camera 100. If the random numbers notified by the smartphone 500 in M408 are duplicated, the web server 400 does not perform provisional registration, and notifies the smartphone 500 of the duplication (error). Furthermore, the previously provisionally registered information is also deleted.

After provisional registration, the camera 100 starts wireless communication 111 based on the user's operation on the operation unit 105, and starts a connection with the Web server 400 via the access point 200 and the public network 300 (M413). Then, the camera 100 notifies the Web server 400 of the random number generated in M403 and information specific to the camera 100 (camera information, or "device information") (M414). The information specific to the camera 100 includes, for example, the camera's serial number, MAC address, model ID, etc.

Note that the wireless communication unit 111 may be started before M403. In this embodiment, the wireless communication unit 111 is started in M413, thereby suppressing power consumption by the wireless communication unit 111 during the period from M403 to M412.

The Web server 400, which has received the random number, compares the received random number with the random numbers contained in the provisional registration information temporarily stored to determine whether there is a match (M415). If a match is found, the authentication information processing unit 410 generates camera identification information (device identification information) for uniquely identifying the camera (M416). After the camera 100 is registered with the Web server 400, when communicating with the Web server 400 (uploading image data), the camera identification information is included in the transmission. The Web server 400 identifies the camera 100 based on the camera identification information. Next, the account information linked to the authentication key, the camera information, and the camera identification information are stored in association with each other (M417). The associated information is stored in the non-volatile memory 403. Through this process, the camera 100 is registered with the Web server 400.

When the camera 100 is registered in M417, the web server 400 notifies the smartphone 500 that registration is complete and provides the camera information (M418). The smartphone 500 displays the camera information along with a notification that registration is complete (M419). The camera information is displayed here to allow the user to confirm that the correct camera has been registered.

The web server 400 then notifies the camera 100 that registration was successful and the camera identification information (M420). When the control unit 101 of the camera 100 receives the successful registration result and the camera identification information, it stops the wireless communication unit 111 (M421). Then, the display unit 106 displays the camera information, indicating that registration to the web server 400 was successful, and asking whether to save the camera identification information (M422). When the user confirms that the camera information displayed on the smartphone 500 in M419 matches the camera information displayed in M422, he or she selects OK (M423). This causes the control unit 101 to store the camera identification information in the non-volatile memory 103 (M424). After storage, the display unit 106 displays a message indicating that registration is complete (M425).

Note that if the camera information is notified in M414 before the smartphone 500 captures the QR code in M406, i.e., before the random number is sent from the smartphone 500 to the web server 400 in M408, the web server 400 notifies the camera 100 of a registration failure.

In addition, if a certain amount of time has elapsed since the Web server 400 notified the smartphone 500 of the success of the provisional registration in M411, but the random number and camera information have not been received from the camera 100, the Web server 400 deletes the provisional registration information.

Figure 6 is a flow chart illustrating the operation of the camera 100 in this embodiment.

When a user issues an instruction to register on the web server 400 via the operation unit 105 of the camera 100, the control unit 101 generates a random number and causes the display unit 106 to display a QR code that encodes data including the random number and the numerical value of the random number itself (S501).

Figure 12 shows an example of the screen displayed in S501. Information 1201 at the top of the screen is a random number, and information 1202 on the left side of the screen is a QR code. In addition, the guidance to the user displayed on the smartphone 500 in M412 includes a message encouraging the user to operate the operation button 1203 in Figure 12.

When the operation button 1203 is operated, the control unit 101 activates the wireless communication unit 111 to start a wireless connection with the access point 200 (S502). The control unit 101 checks whether the wireless connection between the wireless connection unit 111 and the access point 200 is successful (S503). If the connection is successful in S503, the control unit 101 transmits the random number and camera information to the web server 400 via the wireless communication unit 111 and the public network 300 (S504).

After that, the control unit 101 receives the registration result and the camera identification information that uniquely specifies the camera registered by the Web server 400 from the Web server 400 via the wireless communication unit 111 (S505), and the control unit 101 stops the wireless communication unit 111 (S506). After stopping the wireless communication unit 111, the control unit 101 checks whether the result is successful (S507). If the registration is successful, the control unit 101 displays the camera information, indicating that the registration to the Web server 400 was successful and asking whether the camera identification information should be saved (S508). The user selects OK or Cancel on the operation unit 105 (S509). The purpose of making the selection here is to have the user check whether the intended camera is registered in the Web server 400. If OK is selected in S509, the control unit 101 stores the camera identification information in the non-volatile memory 103 (S510). The control unit 101 then causes the display unit 106 to display a message indicating that registration to the web server 400 has been completed (S511).

If the wireless connection fails in S503, the control unit 101 stops the wireless communication unit 111 (S512). The control unit 101 then instructs the display unit 106 to display an error (S513). In this case, an error message is displayed indicating that the wireless connection has failed.

Also, if registration fails in S507, the control unit 101 instructs the display unit 106 to display an error (S513). In this case, the process may also proceed to S512 and the wireless communication unit 111 may be stopped. Here, a message is displayed indicating that the registration process to the Web server 400 has failed. One cause of the error is when provisional registration by the smartphone 500 has not yet been performed. Other causes include when a certain amount of time has passed since provisional registration and the random number and camera information have not been sent to the Web server 400, causing the expiration date to expire, or when another user has provisionally registered using the same random number. Other possible causes include concentrated access or a system error occurring on the Web server 400 side. The contents of the error may be displayed for each of the listed cases, or it may simply be displayed indicating that the registration process has failed.

If cancel is selected in S509, the camera identification information received from the Web server 400 is discarded (S514). The camera 100 behaves as if it is not registered with the Web server 400.

Figure 7 is a flow chart explaining the operation of the web server 400 in this embodiment.

First, an account ID and password for logging in are received from the smartphone 500 (S601). The authentication information processing unit 410 of the web server 400 generates an authentication key that is unique to the user based on the received account ID (S602) and notifies the smartphone 500 (S603).

Next, the random number and authentication key are received from the smartphone 500 that captured the QR code displayed on the camera 100 (S604). At this time, the authentication information processing unit 410 checks whether another authentication key has been registered with the same random number as the random number received in S604, and checks whether provisional registration is possible with the notified authentication key (S605). If provisional registration is possible, i.e., if there is no other authentication key with the same random number, the authentication key and random number are associated and stored in the non-volatile memory 403 (S606). Then, the control unit 401 notifies the smartphone 500 that provisional registration was successful (S607). The control unit 401 starts a timer for checking the expiration date of the provisional registration (S608).

Then, the random number and camera information are received from the camera 100 via the communication unit 411 (S609). The authentication information processing unit 410 checks whether the same random number as the random number received in S609 exists among the provisionally registered authentication keys (S610). If the same random number exists, the control unit 401 checks whether it is within the expiration date (S611). If it is within the expiration date, the registration is deemed successful, and camera identification information is generated (S612). After generating the camera identification information, the account ID and unique information of the camera 100 received in (S601) are associated with the camera identification information and stored in the non-volatile memory 403 (S613). After storage, the smartphone 500 is notified that the registration of the camera 100 has been completed and the unique information of the camera 100 (S614). Next, the camera 100 is notified that the registration of the camera 100 has been completed and the camera identification information (S615).

Note that, although an example has been described in which the processing from S609 onwards is started after the processing from S601 to S608 has been performed, in reality, the processing from S609 to S608 and the processing from S609 onwards may be performed independently and in parallel. For this reason, there may be cases in which provisional registration has not been completed at the time the random number is received from the camera 100 in S609. In this case, the determination in S610 will result in the same random number not existing.

If it is determined in S605 that another authentication key has registered the same random number, the authentication key and random number received in S604 are not stored, and the provisional registration information of the other authentication key is erased from the non-volatile memory 403 (S616). This prevents the camera 100 from being unintentionally associated with another user. Then, the smartphone 500 and the information processing device that distributed the other authentication key are notified of the provisional registration failure due to the duplication of the random number (S617). In addition, if the random number notified from the camera 100 in S610 is not found among the random numbers of the provisionally registered authentication key, the camera 100 and the smartphone 500 are notified of the registration failure due to the absence of provisional registration information (S618). In addition, if the expiration date has passed in S611, the camera 100 and the smartphone 500 are notified of the registration failure due to the expiration date (S619). By setting an expiration date, the possibility of the random numbers being duplicated is gradually reduced.

Figure 8 is a flowchart showing the operation of the smartphone 500 in this embodiment.

The user inputs an account ID and password on the smartphone 500 and sends them to the web server 400 (S701). Once sent, an authentication key is received from the web server 400 (S702). The user then captures an image of the QR code displayed on the camera 100 with the smartphone 500 (S703). From the read QR code, the smartphone 500 obtains a random number and an authentication URL (S704). The smartphone 500 transmits the authentication key and random number to the web server 400 (S705). The smartphone 500 receives a response from the web server and confirms the provisional registration result (S706). If provisional registration is successful, the smartphone 500 displays a message on the camera 100 urging the user to continue the registration process (S707).

Then, the smartphone 500 receives the registration result of the camera 100 and the unique information of the camera 100 from the web server 400 (S708). It checks whether the registration was successful (S709). If successful, the smartphone 500 displays a message indicating that registration has been completed and the serial number of the camera 100 (S710).

If provisional registration fails in S706, the smartphone 500 displays a message indicating that registration has failed (S711). If official registration fails in S709, the smartphone 500 checks whether the expiration date has passed (712). If the expiration date has passed, a message indicating that the expiration date has passed is displayed (S713). If the expiration date has not passed, a message indicating that registration has failed is displayed, as in S711.

As described above, according to this embodiment, the smartphone 500 captures the QR code generated and displayed by the camera 100, and the camera 100 can be registered to the Web server 400 without inputting complex information on the camera's operation unit 105. That is, in an information processing system including the camera 100 (image processing device), the smartphone 500 (information processing device), and the Web server 400 (server device), the camera 100 generates a random number (identification information) and displays a QR code (image) indicating the generated random number. The camera 100 also transmits the generated random number to the Web server 400 (first transmission). The smartphone 500 captures the QR code displayed on the camera 100, acquires a random number based on the captured QR code, and transmits the acquired random number to the Web server 400 (second transmission). The web server 400 receives the random number sent from the camera 100 (first reception) and the random number sent from the smartphone 500 (second reception), and registers the camera 100 based on the match between the random numbers. This improves usability for the user.

Second Embodiment
A second embodiment of the present invention will be described below. The hardware configurations of the camera 100 and the smartphone 500 are the same as those in FIG. 1, and the hardware configuration of the web server 400 is the same as those in FIG.

Figure 9 is a schematic diagram of the entire system in this embodiment, and differs from Figure 4, which is a schematic diagram of the first embodiment, in that the smartphone 500 is replaced with a personal computer 600. In this embodiment, it is assumed that an information device terminal that does not have a QR code reading function, such as the smartphone 500, is used.

Figure 10 is a sequence diagram showing how, in this embodiment, the personal computer 600 accesses the authentication URL displayed on the camera 100 and registers the camera 100 to the web server 400 by entering a random number.

M901 to M905 are similar to M401 to M405 in the sequence in the first embodiment (Figure 5), so the explanation is omitted.

The user manually inputs the authentication URL of the web server 400 on the personal computer 600 to access the server (M906). The authentication URL is assumed to be written on a web page or in an instruction manual, but may also be displayed on the camera 100. After accessing the authentication URL on the personal computer 600, the user inputs the random number displayed on the camera 100 (M907).

M908 to M925 are similar to M408 to M425 in the sequence in the first embodiment (Figure 5), so the explanation is omitted.

Figure 11 is a flow chart showing the operation of the personal computer 600 in this embodiment. The flow charts for the camera 100 and the Web server 400 are the same as those in the first embodiment, so the explanation is omitted.

Steps S1001 to S1002 are the same as those in the flowchart for the first embodiment (Figure 8), so the explanation will be omitted.

The user manually enters the authentication URL of the web server 400 into the personal computer 600 to access it (S1003). After accessing the authentication URL, the user enters the random number displayed on the camera 100 into the personal computer 600 (S1004).

Steps S1005 to S1013 are the same as those in the flowchart for the first embodiment (Figure 8), so the explanation is omitted.

As described above, according to this embodiment, even if a personal computer 600 that cannot read QR codes is used, the camera 100 can be registered to the Web server 400 without inputting setting information for registering to the Web server 400 on the operation unit 105 of the camera 100. That is, in an information processing system including the camera 100 (image processing device), the smartphone 500 (information processing device), and the Web server 400 (server device), the camera 100 generates a random number (identification information) and displays the generated random number. The camera 100 also transmits the generated random number to the Web server 400 (first transmission). The smartphone 500 accepts input of the random number displayed on the camera 100 from the user, and transmits the accepted random number to the Web server 400 (second transmission). The web server 400 receives the random number sent from the camera 100 (first reception) and the random number sent from the smartphone 500 (second reception), and registers the camera 100 based on the match between the random numbers. This improves usability for the user.

In addition, by displaying the QR code and the random number on the same screen in the camera 100, it becomes unnecessary for the user to select whether to use the smartphone 500 or the personal computer 600 with the camera 100. This simplifies the operation of the camera 100 and improves usability for the user.

[Third embodiment]
A third embodiment of the present invention will now be described. The hardware configurations of the camera 100 and the smartphone 500 are the same as those shown in FIG. 1, and the hardware configuration of the web server 400 is the same as those shown in FIG.

Figure 13 is a flow chart for explaining the operation of the camera 100 in this embodiment, and corresponds to Figure 6 explained in the first embodiment. Comparing with Figure 6, it can be seen that S515 and S516 have been added.

In S515, the control unit 101 checks whether the error is due to a busy state (server congestion) caused by concentrated access to the Web server 400. If the error is not due to a busy state, the camera 100 ends the registration process to the Web server 400. If the error is due to a busy state, the display unit 106 displays a message asking whether or not to end the registration process to the Web server 400, and accepts an instruction from the user (S516). If an instruction not to end is given, the random number generated in S501 is maintained and the process returns to S502. This allows the registration process to be resumed without the smartphone 500 having to read the QR code again.

If registration fails in S507, it may be determined whether to stop the wireless communication unit 111 depending on the error content. That is, if the error content is a busy state due to concentrated access to the Web server 400, the wireless communication unit 111 may not be stopped and may be restarted from S504. This allows restarting from a state in which the wireless connection between the wireless connection unit 111 and the access point 200 is maintained, thereby saving the time required for the wireless connection.

Figure 14 is a flow chart for explaining the operation of the web server 400 in this embodiment, and corresponds to Figure 7 explained in the first embodiment. Comparing with Figure 7, it can be seen that S620 and S621 have been added.

In S620, the control unit 401 checks whether or not there is a concentration of access to the Web server 400. If there is no concentration of access, the process proceeds to S610. On the other hand, if there is congestion due to a concentration of access to the Web server 400, an error notification indicating that the Web server 400 is congested is sent to the camera 100 (S621).

As described above, in this embodiment, if an error is caused by server congestion, a retry (resend) can be performed without regenerating the authentication key, thereby reducing the processing load and operational procedures.

[Other embodiments]
A recording medium on which the program code of the software for realizing the above-mentioned functions is recorded may be supplied to the system or device, and the computer (CPU, MPU) of the system or device may read and execute the program code stored in the recording medium. In this case, the program code itself read from the storage medium will realize the functions of the above-mentioned embodiment, and the storage medium on which the program code is stored will constitute the above-mentioned device.

Storage media for supplying program code may include, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card, a ROM, a DVD, etc.

In addition, not only can the above-mentioned functions be realized by the computer executing the program code it has read, but the OS running on the computer can also perform some or all of the actual processing based on the instructions of the program code to realize the above-mentioned functions. OS is an abbreviation for Operating System.

The program code read from the storage medium is then written to memory on a function expansion board inserted into the computer or on a function expansion unit connected to the computer. Then, based on the instructions of the program code, a CPU on the function expansion board or function expansion unit may perform some or all of the actual processing to realize the above-mentioned functions.

The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

REFERENCE SIGNS LIST 100 Camera 101 Control unit 106 Display unit 107 Authentication information generating unit 111 Wireless communication unit 400 Web server 410 Authentication information processing unit 500 Smartphone

Claims (25)

An information processing system including an image processing device, an information processing device, and a server,
The image processing device includes:
a display control means for displaying an image of a QR (Quick Response) Code (registered trademark) including identification information including at least a random character string used for registering the image processing device to a web service provided by the server and a URL (Uniform Resource Locator) related to the server;
A communication control means for controlling communication of the identification information with the server;
having
The information processing device includes:
an imaging means for capturing an image of the QR code displayed by the display control means of the image processing device;
an acquisition means for performing an analysis process of analyzing the image of the QR code captured by the imaging means and acquiring identification information and a URL;
a first transmission control means for transmitting the identification information obtained by the analysis process to an outside using a URL obtained by the analysis process;
having
The server,
a registration means for registering the image processing device to the Web service after determining that the identification information communicated with the image processing device matches the identification information obtained by the analysis process as a result of accessing the information processing device using the URL;
An information processing system comprising: The information processing system according to claim 1, characterized in that the image processing device further has a generating means for generating the random character string, and the communication control means of the image processing device communicates the identification information including at least the random character string generated by the generating means to the server. The information processing system according to claim 1 or 2, characterized in that the registration means registers the image processing device in association with account information of the web service. The information processing system according to any one of claims 1 to 3, characterized in that the registration means registers the image processing device by storing the serial number or MAC address of the image processing device. The information processing system according to any one of claims 1 to 4, characterized in that the server further comprises means for generating device identification information for identifying the image processing device when the image processing device is registered by the registration means, and notifying the image processing device of the device identification information. The information processing system according to any one of claims 1 to 5, characterized in that the server further comprises a means for notifying the image processing device and/or the information processing device that the image processing device has been registered by the registration means. the server performs control so that, when identification information of a random character string is obtained as a result of access using the URL, the identification information of the random character string and information related to the account are temporarily stored;
The information processing system according to any one of claims 1 to 6, characterized in that the server further has a means for notifying an error to the information processing device that made the new access when identification information matching the identification information of the temporarily stored random string is obtained as a result of a new access using the URL. The information processing system according to any one of claims 1 to 7, characterized in that the server exchanges information with an external device via a public network. The information processing system according to claim 2, further comprising means for notifying the image processing device of an error upon receiving the communication if a condition that access to the server is concentrated is satisfied when the image processing device communicates the identification information including at least the random character string generated by the generation means to the server. The information processing system according to claim 9, characterized in that, when the image processing device receives the error notification, it performs a retry process, and in the retry process, the identification information that includes at least the generated random character string is resent. The information processing system according to claim 10, characterized in that the retry process is executed when the error notification is received and in response to a first user instruction in response to a user inquiry made in response to the receipt of the error notification. The information processing system according to any one of claims 1 to 11, characterized in that the image processing device registered in the web service uploads image data to the web service. The information processing system according to any one of claims 1 to 12, characterized in that the first transmission control means of the information processing device transmits, after performing a login process for the Web service based on the credential information received from the user, the identification information obtained by the analysis process using the URL obtained by the analysis process together with an identifier corresponding to the information processing device that is generated when the login process is successful, to the outside. The information processing system according to any one of claims 1 to 13, characterized in that the information processing device is a smartphone, and the image processing device is a camera having at least a release button capable of detecting a half-pressed state and a fully-pressed state, and a touch panel display for displaying an image of the QR code. The information processing system according to any one of claims 1 to 14, characterized in that the display control means controls to display a human-readable character string indicating the identification information together with the image of the QR code. The information processing system according to claim 14, characterized in that the display control means controls to further display a display item including a human-readable character string "MENU" together with the image of the QR code. An image processing device that communicates with a web service,
a display control unit for controlling to display an image of a QR (Quick Response) code including identification information at least a random character string used for registering the image processing device to a related Web service and a URL (Uniform Resource Locator) related to the Web service;
A communication control means for controlling communication of the identification information with the web service;
having
The image processing device is characterized in that, when the image processing device recognizes based on the results of further communication that a registration process to the Web service has been performed as a result of a process of providing the identification information contained in the QR code in order to register the image processing device to the Web service by another information processing device that has read the image of the QR code, the display control means controls to display a notification indicating that the process has been completed. The method further comprises: generating means for generating the random character string;
18. The image processing apparatus according to claim 17, wherein the communication control means communicates the identification information including at least the random character string generated by the generation means to a server that provides the Web service. The image processing device according to claim 17, characterized in that the image processing device is a camera having at least a release button capable of detecting a half-pressed state and a fully-pressed state, and a touch panel display for displaying an image of the QR code. The image processing device according to any one of claims 17 to 19, characterized in that the display control means controls to display a human-readable character string indicating the identification information together with the image of the QR code. The image processing device according to claim 20, characterized in that the display control means controls to further display a display item including a human-readable character string "MENU" together with the image of the QR code. A communication interface for performing Wi-Fi (registered trademark) communication is provided.
The image processing device according to any one of claims 17 to 21, characterized in that the communication control means communicates the identification information between the image processing device and a server providing the Web service by communication via the communication interface, the communication being via an access point to which the image processing device is wirelessly connected. The image processing device according to any one of claims 17 to 22, characterized in that after registration with the web service is completed, image data is uploaded to the web service. The image processing device according to claim 23, characterized in that the image data is image data conforming to the DCF (Design rule for Camera File system) standard, and the image data is image data recorded on a storage medium built into the image processing device or a storage medium attached to the image processing device and accessible by the image processing device. A program for causing a computer to function as each of the means described in any one of claims 17 to 24.

Images