JP7615092B2 - COMMUNICATION DEVICE, CONTROL METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to a system in which a communication device and an external device are communicatively connected.

Patent document 1 describes a technology in which, in a system in which a communication device and an external device are communicatively connected, the external device creates and transmits screen information to be displayed on the communication device. Patent document 2 describes a technology in which image data held by the communication device is transmitted to the external device.

JP 2019-102985 A JP 2004-120329 A

However, when it is assumed that an external device creates screen information as in Patent Document 1 based on image data received from a communication device as in Patent Document 2, there are the following problems. In Patent Document 2, thumbnails are sent preferentially so that images can be used quickly in the external device, so after the external device receives the original image, the previously received thumbnail becomes unnecessary and is wasted. Also, if there are images that have not been received from the communication device due to communication delays or the like, and these images are information necessary for creating screen information, it becomes difficult for the external device to create the screen information.

The present invention has been made in consideration of the above problems, and its purpose is to realize a technology that makes it possible to create screen information to be displayed on a communication device in an external device even when there is information that has not been received from the communication device.

In order to solve the above problems and achieve the object, the communication device of the present invention has a connection means for connecting to an external device so as to be able to communicate with the external device, and a control means for creating screen information to be displayed on the external device based on first information received from the external device and including an image held by the external device, transmitting the screen information to the external device, and receiving operation information for the screen information from the external device, wherein when creating the screen information in response to the operation information, the control means requests from the external device second information including a thumbnail of an image held by the external device that has not been received from the external device, and creates the screen information including a selection button used to send an original image corresponding to the thumbnail based on the first information, the second information, and the operation information.

According to the present invention, even if there is information that has not been received from the communication device, it is possible to create screen information to be displayed on the communication device in an external device.

1A is a block diagram showing the configuration of a digital camera according to an embodiment of the present invention, FIG. FIG. 2 is a block diagram showing the configuration of a server according to the embodiment. FIG. 4 is a sequence diagram showing processing by the digital camera and the server according to the first embodiment. FIG. 4 is a diagram illustrating a screen generated by the server according to the first embodiment. 6 is a flowchart showing processing of a server according to the first embodiment. FIG. 11 is a sequence diagram of a digital camera and a server according to the second embodiment. FIG. 11 is a diagram illustrating a screen generated by a server according to the second embodiment. 10 is a flowchart showing processing of a server according to the second embodiment.

The following embodiments are described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe multiple features, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicate explanations are omitted.

The following describes a system in which a digital camera and a server are used as the communication device and external device of this embodiment, and the digital camera is connected to the server via a network so that they can communicate with each other.

In this embodiment, an example is described in which the communication device is applied to a digital camera capable of taking still images and videos, but the present invention is not limited to this and may be an information processing device such as a tablet device or personal computer with a camera function, a surveillance camera, or a medical camera. Also, in this embodiment, a server that communicates with the communication device is described as an example of an external device, but the present invention is not limited to this and may be an information processing device such as a tablet device or personal computer.

In addition, in this embodiment, when a digital camera is the communication device, the server with which it communicates is the external device, and when a server is the communication device, the digital camera with which it communicates is the external device.

[Embodiment 1]
In the first embodiment, in a system in which a server 200 creates screen information that can be displayed and operated on a digital camera 100 and transmits it to the digital camera 100, the server 200 requests predetermined unsent image information from the digital camera 100, and creates a UI (User Interface) screen such as an image list screen based on the transmitted images and unsent image information received from the digital camera 100.

<Configuration of Digital Camera 100>
First, the configuration and functions of a digital camera 100 according to this embodiment will be described with reference to FIG.

The control unit 101 is a central processing unit (CPU) that controls the entire digital camera 100, and performs communication and control processes, which will be described later, by executing programs stored in the non-volatile memory 103, which will be described later. Note that instead of the control unit 101 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.

The imaging unit 102 includes a group of lenses including a zoom lens and a focus lens, and a shutter with an aperture function. The imaging unit 102 also has an imaging element consisting of a CCD or CMOS element that converts the subject image into an electrical signal, and an A/D converter that converts the analog image signal output from the imaging element into a digital signal. Under the control of the control unit 101, the imaging unit 102 converts the subject image light formed by the lens included in the imaging unit 102 into an electrical signal using the imaging element, performs noise reduction processing, and outputs image data consisting of a digital signal.

The control unit 101 has an image processing unit 101a. The image processing unit 101a performs development processing such as exposure correction, white balance (WB), and sharpness on the image data (RAW data) captured by the imaging unit 102, generates an image file, and records it on the recording medium 208. The developed image file is recorded on the recording medium 208 in accordance with the DCF (Design Rule for Camera File system) standard. In addition, the control unit 101 performs a predetermined calculation process using the captured image data, and controls the focus lens, aperture, and shutter of the imaging unit 102 based on the obtained calculation result, thereby performing AF (autofocus) processing and AE (automatic exposure) processing.

The non-volatile memory 103 is an electrically erasable and recordable memory, and may be, for example, an EEPROM. Constants, programs, etc. for the operation of the control unit 101 are recorded in the non-volatile memory 103. The programs referred to here are programs for executing the communication processing and control processing described later in this embodiment.

The working memory 104 is used as a working area for expanding constants and variables for the operation of the control unit 101, programs read from the non-volatile memory 103, etc. The working memory 104 is also used as a buffer memory for temporarily storing image data captured by the imaging unit 102, and as a memory for displaying images on the display unit 106.

The operation unit 105 is made up of operation members such as various switches, buttons, and a touch panel that accept various operations from the user. For example, as shown in Figs. 1(b) and (c), the operation unit 105 includes a shutter button 105a for taking an image, a playback button 105b for playing back a captured image, and a four-way key 105c consisting of up, down, left, and right buttons for configuring various camera settings. The operation unit 105 also includes a touch panel 105d that is integrally formed with the display unit 106, which will be described later. The operation unit 105 also includes a dedicated connection button for starting communication with an external device such as the server 200.

When the shutter button 105a is pressed halfway (a shooting preparation command) during operation, it turns on and generates a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the control unit 101 controls the imaging unit 102 to start shooting preparation operations such as AF processing and AE processing. In addition, when the operation of the shutter button 105a is completed, in other words, when it is pressed all the way (a shooting command), it turns on and generates a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the control unit 101 starts a series of shooting processing operations from reading the signal from the imaging unit 102 to writing image data to the recording medium 110.

The display unit 106 displays the viewfinder image during shooting, displays the captured image, and displays text for interactive operation. The display unit 106 is, for example, a display device such as a liquid crystal display or an organic EL display. The display unit 106 may be integrated with the digital camera 100, or may be an external device connected to the digital camera 100. The digital camera 100 only needs to be able to connect to the display unit 106 and have a function for controlling the display of the display unit 106. The display unit 106 can also display screen information created by the server 200.

Image data output from the imaging unit 102 is recorded on the recording medium 107, or an image file already recorded is read by the control unit 101. The recording medium 107 may be a memory card or a hard disk drive that is attached to the digital camera 100, or may be a flash memory or a hard disk drive built into the digital camera 100. It is sufficient that the digital camera 100 has at least a means for accessing the recording medium 107.

The connection unit 108 is an interface for connecting to an external device such as a server 200 so as to be able to communicate with the external device. The digital camera 100 of this embodiment can exchange data with the external device via the connection unit 108. For example, the digital camera 100 can transmit an image file to the external device via the connection unit 108, or can receive an image file or screen information from the external device via the connection unit 108. Note that in this embodiment, the connection unit 108 includes an interface for communicating with the external device via a wireless LAN in accordance with the IEEE802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the connection unit 108. Note that the communication method is not limited to a wireless LAN, and a wired connection method such as IEEE1394 may be used.

The authentication information generating unit 109 generates authentication information to be used when connecting the digital camera 100 to an external device such as the server 200. After the connection with the server 200 is completed, the control unit 101 transmits image files to the server 200, receives screen information from the server 200, and transmits operation information of the screen information to the server 200.

<Configuration of Server 200>
The configuration and functions of the server 200 of this embodiment will be described with reference to FIG.

The control unit 201 is a central processing unit (CPU) that controls the entire server 200, and performs communication processing and control processing, which will be described later, by executing programs stored in the non-volatile memory 203, which will be described later. Note that instead of the control unit 201 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.

The non-volatile memory 203 is an electrically erasable and recordable memory, and may be, for example, an EEPROM. Constants, programs, etc. for the operation of the control unit 201 are recorded in the non-volatile memory 203. The programs referred to here are programs for executing the communication processing and control processing described later in this embodiment.

The working memory 204 is used as a working area for expanding constants, variables, programs read from the non-volatile memory 203, etc. for the operation of the control unit 201.

The connection unit 208 is an interface for connecting to an external device such as the digital camera 100 so as to be able to communicate with the external device. The control unit 201 controls the connection unit 208 to realize communication with the external device. As a protocol for communicating data, for example, HTTP (Hyper Text Transfer Protocol) via a wireless LAN can be used.

The authentication information processing unit 209 performs login authentication of a user who uses the server 200 from the digital camera 100. If the login authentication is successful, the authentication information processing unit 209 generates an authentication key that uniquely identifies the digital camera 100.

The control unit 201 has an image processing unit 201a. The image processing unit 201a creates screen information that can be displayed and operated on the digital camera 100. After the connection with the digital camera 100 is completed, the control unit 201 transmits screen information to the digital camera 100 and receives image files and operation information for the screen information from the digital camera 100.

<Processing of Digital Camera 100 and Server 200>
Next, communication processing and control processing by the digital camera 100 and server 200 of this embodiment will be described with reference to FIGS.

Figure 3 illustrates an example of a sequence of communication and control processes performed by the digital camera 100 and server 200 of this embodiment. Figure 4 illustrates an example of a screen created by the server 200 of this embodiment.

In the following, the digital camera 100 and the server 200103 are described as the main processing subjects, but in reality, the control unit 101 of the digital camera 100 executes a program stored in the non-volatile memory 103 to control each component, and the control unit 201 of the server 200 executes a program stored in the non-volatile memory 203 to control each component. The same applies to Figure 6 described below.

In S301, when the digital camera 100 detects that the user has turned on the power of the digital camera 100 via the operation unit 105, it executes the server connection start process in S302.

In S302, the digital camera 100 starts the connection process with the server 200.

In S303, the server 200 notifies the digital camera 100 whether or not a connection is possible. If a connection is possible, the server 200 notifies the digital camera 100 that the connection is OK, and if a connection is not possible, the server 200 notifies the digital camera 100 that the connection is not OK. In this example, the server 200 notifies the digital camera 100 that the connection is OK.

In S304, the digital camera 100 transmits authentication information for connecting to the server 200. The authentication information includes, for example, an account ID and password for logging in to the server 200. Note that the authentication information may be information that the user has stored in advance in the non-volatile memory 103 of the digital camera 100. In addition, when transmitting the authentication information, the user may input the authentication information using the operation unit 105 of the digital camera 100.

In S305, the server 200 notifies the digital camera 100 whether authentication was successful. If authentication was successful, the server 200 notifies authentication OK, and if authentication was unsuccessful, the server 200 notifies authentication NG. In this example, it is assumed that authentication is OK.

In S306, in response to the connection OK notification in S305, the connection between the digital camera 100 and the server 200 is completed.

In S307, when the digital camera 100 detects that the user has performed a photographing operation on the digital camera 100 via the operation unit 105, the digital camera 100 starts photographing using the imaging unit 102 and executes the image transmission process of S308.

In S308, the digital camera 100 transmits the image captured in S307 to the server 200.

The digital camera 100 then repeats the process from S307 to S308.

In S309, when the digital camera 100 detects that the operation unit 105, to which the SNS (Social Networking Service) posting function is assigned, has been operated, it executes the operation information transmission process of S310.

In S310, the digital camera 100 transmits information on the operation performed by the user via the operation unit 105 to the server 200. The digital camera 100 transmits operation information indicating that the operation unit 105 to which the SNS posting function is assigned has been operated.

In S311, the server 200 creates the SNS posting screen 401 shown in FIG. 4(a) as screen information to be displayed on the display unit 106 of the digital camera 100.

In S312, the server 200 transmits the SNS posting screen 401 of FIG. 4(a) created in S311 to the digital camera 100.

In S313, the digital camera 100 displays the SNS posting screen 401 of FIG. 4(a) received from the server 200 in S312 on the display unit 106.

In S314, when the digital camera 100 detects that the user has selected "Photos and Videos" 451 from the multiple selection items on the SNS posting screen 401 of FIG. 4A via the operation unit 105, it executes the operation information transmission process of S315. Note that the selectable items on the SNS posting screen 401 of FIG. 4A include "Photos and Videos" 451, "Tagging" 452, "Font" 453, and "Background Color" 454. "Photos and Videos" 451 allows the user to specify the image to be posted. "Tagging" 452 allows the user to assign a specific label to the image to be posted. "Font" 453 allows the user to change the explanatory text used to explain the image to be posted to any font. "Background Color" 454 allows the user to change the background of the explanatory text used to explain the image to be posted to any background color.

In S315, the digital camera 100 transmits to the server 200 operation information about the operation performed by the user on the SNS posting screen 401 in FIG. 4(a) in S314. In this case, "Photos and videos" 451 is selected on the SNS posting screen 401 in FIG. 4(a), and the screen position coordinates corresponding to the selected "Photos and videos" 451 button are transmitted as operation information. In addition, the amount of cursor movement when the user operates a cursor or the like displayed on the display unit 106 via the operation unit 105 may also be transmitted as operation information.

In S316, the server 200 requests the digital camera 100 to transmit unsent image information. The unsent image information includes thumbnails (hereinafter, unsent images) that use as their original images unsent images that were not received from the digital camera 100 in S308. The server 200 requests the unsent image information in order to create an image list screen in S318, which will be described later.

In S317, the digital camera 100 transmits unsent image information to the server 200. The digital camera 100 transmits unsent image information for images that have not been transmitted to the server 200 in S308.

In S318, the server 200 creates the image list screen 402 of FIG. 4(b) as image information to be displayed on the display unit 106 of the digital camera 100. When creating the image list screen 402 of FIG. 4(b), it is created so that the images received from the digital camera 100 in S308 and the unsent images received from the digital camera 100 in S317 are displayed in a distinguishable manner. The distinguishable display manner may be such that the transparency of the unsent images is lower than that of the sent images.

In S319, the server 200 transmits the image list screen 402 of FIG. 4(b) created in S318 to the digital camera 100.

In S320, the digital camera 100 displays the image list screen 402 of FIG. 4(b) received from the server 200 in S319 on the display unit 106.

In S321, when the digital camera 100 detects that the user has checked the check box for "Unsent image" 455 from among multiple images on the image list screen 402 of FIG. 4B via the operation unit 105, it executes the operation information transmission process of S322. Note that selectable items on the image list screen 402 of FIG. 4B include the check boxes for "Unsent image" 455 and "Sent image" 456, and the "Send" 457 button. Checking the check box for "Unsent image" 455 allows you to specify an unsent image to post on the SNS. Checking the check box for "Sent image" 456 allows you to specify a sent image to post on the SNS. "Send" 457 allows you to post the specified unsent image and/or sent image to the SNS via the server 200.

In S322, the digital camera 100 transmits to the server 200 information about the operation performed by the user on the image list screen 402 in FIG. 4B in S321. In this case, the check box for "Unsent image" 455 is checked on the image list screen 402 in FIG. 4B, and the position coordinates of the screen corresponding to the specified unsent image are transmitted as operation information.

In S323, the server 200 requests the digital camera 100 to transmit the original image corresponding to the unsent image for which the check box of "Unsent Image" 455 on the image list screen 402 in FIG. 4(b) is checked.

In S324, the digital camera 100 transmits to the server 200 an original image corresponding to an unsent image for which the check box for "Unsent image" 455 on the image list screen 402 of FIG. 4(b) has been checked. In this case, after receiving the original image corresponding to the unsent image from the digital camera 100, the server 200 may replace the unsent image displayed on the image list screen 402 of FIG. 4(b) with the original image when creating the SNS posting screen 401 of FIG. 4(a) and the image list screen 402 of FIG. 4(b) in S311 and S318.

The digital camera 100 then repeats the processes from S311 to S324.

According to this embodiment, the server 200 requests unsent image information from the digital camera 100, and creates an image list screen based on the transmitted images and predetermined unsent image information received from the digital camera 100. In addition, when an unsent image is specified on the image list screen displayed on the digital camera 100, the server 200 requests the digital camera 100 to transmit the original image corresponding to the unsent image.

<Processing of Server 200>
Next, the process of the server 200 for implementing the process of FIG. 3 will be described with reference to FIG.

The process in FIG. 5 is realized by the control unit 201 of the server 200 loading a program read from the non-volatile memory 203 into the working memory 204 and executing it. The same applies to FIG. 8, which will be described later.

In S501, the control unit 201 performs connection processing with the digital camera 100. S501 corresponds to S302 to S306 in FIG. 3.

In S502, the control unit 201 receives an image from the digital camera 100.

In S503, the control unit 201 determines whether or not an SNS posting instruction has been received from the digital camera 100, and if it is determined that an SNS posting instruction has been received, the process proceeds to S504, and if it is determined that an SNS posting instruction has not been received, the process returns to S502.

In S504, the control unit 201 generates screen information to be displayed on the display unit 106 of the digital camera 100 using the image processing unit 201a. S504 corresponds to S311 in FIG. 3.

In S505, the control unit 201 transmits the screen information created in S504 to the digital camera 100. S505 corresponds to S312 in FIG. 3.

In S506, the control unit 201 determines whether or not operation information has been received from the digital camera 100, and if it is determined that operation information has been received, the process proceeds to S507, and if it is determined that operation information has not been received, the process returns to S506.

In S507, the control unit 201 determines whether to continue the process. If it is determined that the process should be continued, the process proceeds to S508. If it is determined that the process should not be continued, the process ends. For example, the control unit 201 determines that the process should not be continued when it receives operation information such as the digital camera 100 being powered off.

In S508, the control unit 201 determines whether or not to create an image list screen, and if it is determined that an image list screen should be created, the process proceeds to S509, whereas if it is determined that an image list screen should not be created, the process returns to S504. For example, the control unit 201 determines that an image list screen should be created when it receives operation information such as the selection of "Photos and Videos" 451 on the SNS posting screen 401 in FIG. 4(a).

In S509, the control unit 201 requests the digital camera 100 to transmit unsent image information. S512 corresponds to S316 in FIG. 3.

In S510, it is determined whether or not unsent image information has been received from the digital camera 100. If it is determined that unsent image information has been received, the process proceeds to S511. If it is determined that unsent image information has not been received, the process proceeds to S512.

In S511, the control unit 201 adds the thumbnails included in the unsent image information received in S510 to a list that manages the sent images received from the digital camera 100 in S502 and that is stored in the non-volatile memory 203, in order to display them on the image list screen.

In S512, the control unit 201 refers to the list that manages the transmitted images stored in the non-volatile memory 203, and creates an image list screen using the image processing unit 201a. S512 corresponds to S318 in FIG. 3.

In S513, the control unit 201 transmits the image list screen created in S512 to the digital camera 100. S513 corresponds to S319 in FIG. 3.

In S514, the control unit 201 determines whether an unsent image has been selected from the operation information on the image list screen received from the digital camera 100, and if it is determined that an unsent image has been selected, the process proceeds to S515, and if it is determined that an unsent image has not been selected, the process returns to S502.

In S515, the control unit 201 requests the original image of the unsent image from the digital camera 100. S515 corresponds to S323 in FIG. 3.

In S516, the control unit 201 receives the original image of the unsent image from the digital camera 100.

According to this embodiment, when the server 200 receives operation information from the digital camera 100 and creates an image list screen, it requests unsent image information from the digital camera 100. The server 200 then creates an image list screen based on the transmitted images and unsent image information received from the digital camera 100, and transmits it to the digital camera 100. Furthermore, when the server 200 receives operation information specifying an unsent image from the digital camera 100, it requests the original image of the unsent image from the digital camera 100, and receives the original image of the unsent image. In this way, by receiving unsent image information or the original image of the unsent image from the digital camera 100 when the server 200 creates an image list screen, the server 200 can create an image list screen even if an unsent image exists, and all images held by the digital camera 100 can be displayed on the image list screen.

[Embodiment 2]
In the second embodiment, a process will be described in which unsent image information is specified on the image list screen 402 of FIG. 4(b) displayed on the digital camera 100 in the first embodiment, and in response to operation of the “Send” button 457, the server 200 requests the original image of the unsent image.

The configuration of the digital camera 100 and the configuration of the server 200 are the same as those of the digital camera 100 and the server 200 in the first embodiment. The communication process for connecting the digital camera 100 and the server 200 is the same as that in the first embodiment. The following description will focus on the differences from the first embodiment.

<Processing of Digital Camera 100 and Server 200>
Next, communication processing and control processing by the digital camera 100 and server 200 of this embodiment will be described with reference to FIGS.

Figure 6 illustrates an example of a sequence of communication and control processes performed by the digital camera 100 and server 200 of this embodiment. Figure 7 illustrates an example of a screen created by the server 200 of this embodiment.

S601 to S610 are the same as S301 to S310 in FIG. 3.

In S611, the server 200 creates the SNS posting screen 701 in FIG. 7(a) as image information to be displayed on the display unit 106 of the digital camera 100. The SNS posting screen 701 in FIG. 7(a) is similar to the SNS posting screen 401 in FIG. 4(a).

In S612, the server 200 transmits the SNS posting screen 701 of FIG. 7(a) created in S611 to the digital camera 100.

In S613, the digital camera 100 displays the SNS posting screen 701 of FIG. 7(a) received from the server 200 in S612 on the display unit 106.

In S614, when the digital camera 100 detects that the user has selected "Photos and Videos" 751 from the multiple selection items on the SNS posting screen 701 in FIG. 7(a) via the operation unit 105, it executes the operation information transmission process of S615.

In S615, the digital camera 100 transmits to the server 200 operation information about the operation performed by the user on the SNS posting screen 701 in FIG. 7(a) in S614. In this case, "Photos and videos" 751 is selected on the SNS posting screen 701 in FIG. 7(a), and the screen position coordinates corresponding to the selected "Photos and videos" 751 button are transmitted as operation information. In addition, the amount of movement of the cursor when the user operates the cursor displayed on the display unit 106 via the operation unit 105 may be transmitted as operation information.

S616 to S617 are similar to S316 to S317 in Figure 3.

In S618, the server 200 creates the image list screen 702 in FIG. 7(b) as screen information to be displayed on the display unit 106 of the digital camera 100. The image list screen 702 in FIG. 7(b) is similar to the image list screen 402 in FIG. 4(b).

In S619, the server 200 transmits the image list screen 702 of FIG. 7(b) created in S618 to the digital camera 100.

In S620, the digital camera 100 displays the image list screen 702 of FIG. 7(b) received from the server 200 in S619 on the display unit 106.

In S621, when the digital camera 100 detects that the user has checked the check box for "Unsent Images" 755 from among multiple images on the image list screen 702 in FIG. 7(b) via the operation unit 105, it executes the operation information transmission process of S622.

In S622, the digital camera 100 transmits to the server 200 operation information about the operation performed by the user on the image list screen 702 in FIG. 7(b) in S621. In this case, the check box for "Unsent image" 755 is checked on the image list screen 702 in FIG. 7(b), and the position coordinates of the screen corresponding to the specified unsent image are transmitted as operation information. In addition, the amount of movement of the cursor when the user operates the cursor displayed on the display unit 106 via the operation unit 105 may also be transmitted as operation information.

S623 performs the same processing as S618.

In S624, the server 200 transmits to the digital camera 100 the image list screen 703 of FIG. 7(c) that was created in S618 and in which the check box for "Unsent images" 755 on the image list screen 702 of FIG. 7(b) was checked in S621.

In S625, the digital camera 100 displays the image list screen 703 of FIG. 7(c) received from the server 200 in S624 on the display unit 106.

In S626, when the digital camera 100 detects that the user has operated the "Send" 757 button on the image list screen 703 in FIG. 7(c) via the operation unit 105, it executes the operation information transmission process of S627.

In S627, the digital camera 100 transmits to the server 200 operation information about the operation performed by the user on the image list screen 703 in FIG. 7(c) in S626. In this case, the "Send" 757 button is operated on the image list screen 703 in FIG. 7(c), and the screen position coordinates corresponding to the "Send" 757 button are transmitted as operation information. In addition, the amount of cursor movement when the user operates a cursor or the like displayed on the display unit 106 via the operation unit 105 may also be transmitted as operation information.

In S628, the server 200 requests the digital camera 100 to transmit the original image corresponding to the unsent image for which the check box for "Unsent Image" 755 on the image list screen 703 in FIG. 7(c) has been checked.

In S629, the digital camera 100 transmits to the server 200 the original image corresponding to the unsent image for which the check box for "Unsent Image" 755 on the image list screen 703 in FIG. 7(c) is checked.

The digital camera 100 then repeats the process from S611 to S629.

According to this embodiment, when unsent image information is specified on the image list screen 702 of FIG. 7(b) displayed on the digital camera 100 and the "Send" 757 button is operated, the server 200 requests the original image of the unsent image.

<Processing of Server 200>
Next, a control process of the server 200 for implementing the process of FIG. 6 will be described with reference to FIG.

In S801, the control unit 201 performs connection processing with the digital camera 100. S801 corresponds to S602 to S606 in FIG. 6.

In S802, the control unit 201 receives an image from the digital camera 100.

In S803, the control unit 201 determines whether or not an SNS posting instruction has been received from the digital camera 100, and if it is determined that an SNS posting instruction has been received, the process proceeds to S804, and if it is determined that an SNS posting instruction has not been received, the process returns to S802.

In S804, the control unit 201 generates screen information to be displayed on the display unit 106 of the digital camera 100 using the image processing unit 201a. S804 corresponds to S611 in FIG. 6.

In S805, the control unit 201 transmits the screen information created in S804 to the digital camera 100. S805 corresponds to S612 in FIG. 3.

In S806, the control unit 201 determines whether or not operation information has been received from the digital camera 100, and if it is determined that operation information has been received, the process proceeds to S807, and if it is determined that operation information has not been received, the process returns to S806.

In S807, the control unit 201 determines whether to continue the process. If it is determined that the process should be continued, the process proceeds to S808. If it is determined that the process should not be continued, the process ends. For example, the control unit 201 determines that the process should not be continued when it receives operation information such as the digital camera 100 being powered off.

In S808, the control unit 201 determines whether or not to create an image list screen, and if it is determined that an image list screen should be created, the process proceeds to S809, whereas if it is determined that an image list screen should not be created, the process returns to S804. For example, the control unit 201 determines that an image list screen should be created when it receives operation information such as the selection of "Photos and Videos" 751 on the SNS posting screen 701 in FIG. 7(a).

In S809, the control unit 201 requests the digital camera 100 to transmit unsent image information. S812 corresponds to S616 in FIG. 6.

In S810, it is determined whether or not unsent image information has been received from the digital camera 100. If it is determined that unsent image information has been received, the process proceeds to S811. If it is determined that unsent image information has not been received, the process proceeds to S812.

In S811, the control unit 201 adds the unsent image received in S810 to a list that manages the sent images received from the digital camera 100 in S802 and that are stored in the non-volatile memory 203, in order to display them on the image list screen.

In S812, the control unit 201 refers to the list that manages the transmitted images stored in the non-volatile memory 203, and creates an image list screen using the image processing unit 201a. S812 corresponds to S618 in FIG. 6.

In S813, the control unit 201 performs processing to transmit the image list screen to the digital camera 100. S813 corresponds to S619 in FIG. 6.

In S814, the control unit 201 determines whether an unsent image has been selected from the operation information received from the digital camera 100, and if it is determined that an unsent image has been selected, the process proceeds to S815, and if it is determined that an unsent image has not been selected, the process returns to S802.

In S815, the control unit 201 determines whether or not to send the unsent images to the SNS based on the operation information received from the digital camera 100 in S814, and if it is determined that the images should be sent, the process proceeds to S816, and if it is determined that the images should not be sent, the process returns to S812.

In S816, the control unit 201 requests the original image of the unsent image from the digital camera 100. S816 corresponds to S323 in FIG. 3.

In S817, the control unit 201 performs a process of receiving the original image of the unsent image from the digital camera 100.

According to this embodiment, when the server 200 receives operation information from the digital camera 100 and creates an image list screen, it requests unsent image information from the digital camera 100. The server 200 then creates an image list screen based on the sent images and unsent image information received from the digital camera 100, and sends it to the digital camera 100. Furthermore, when the server 200 receives operation information from the digital camera 100 to specify an unsent image and send it to the SNS, it requests the original image of the unsent image from the digital camera 100, and receives the original image of the unsent image. In this way, by receiving unsent image information or the original image of the unsent image from the digital camera 100 when the server 200 creates an image list screen, it is possible to create an image list screen in the server 200 even if an unsent image exists, and all images held by the digital camera 100 can be displayed on the image list screen.

[Other embodiments]
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Therefore, the following claims are appended to disclose the scope of the invention.

The disclosure of this specification includes the following communication device, control method, and program.
[Configuration 1]
A connection means for communicatively connecting to an external device;
a control means for generating screen information to be displayed on the external device based on first information received from the external device, transmitting the screen information to the external device, and receiving operation information for the screen information from the external device;
the control means requests, when creating the screen information in response to the operation information, second information that has not been received from the external device, from the external device;
A communication device, comprising: a display unit configured to display a display screen of the communication device;
[Configuration 2]
2. The communication device according to configuration 1, wherein the first information includes a request for creating the screen information and information used to create the screen information.
[Configuration 3]
the first information includes an image held by the external device;
3. The communication device according to claim 1, wherein the second information includes thumbnails of images held by the external device.
[Configuration 4]
4. The communication device according to configuration 3, wherein the screen information is a list screen of images held by the external device.
[Configuration 5]
5. The communication device according to claim 4, wherein the control means makes the image and the thumbnail distinguishable on the list screen.
[Configuration 6]
The communication device according to configuration 4 or 5, wherein the control means, when receiving an original image corresponding to the thumbnail from the external device, replaces the thumbnail displayed on the list screen with the original image.
[Configuration 7]
The communication device according to any one of configurations 4 to 6, wherein the control means requests, when the operation information is operation information for selecting an image on the list screen and the selected image is a thumbnail, an original image corresponding to the thumbnail from the external device.
[Configuration 8]
The communication device according to any one of configurations 4 to 6, wherein the control means is configured to request, when the operation information is operation information for transmitting an image selected on the list screen and the selected image is a thumbnail, an original image corresponding to the thumbnail from the external device.
[Configuration 9]
A connection means for communicatively connecting to an external device;
a display means for displaying screen information received from the external device;
a control means for transmitting operation information of the screen information to the external device;
The communication device, wherein the control means transmits to the external device, predetermined information that has not been transmitted from the communication device, when the external device creates the screen information based on the operation information.
[Configuration 10]
10. The communication device according to claim 9, wherein the control means transmits the predetermined information to the external device in response to a request from the external device.
[Configuration 11]
11. The communication device according to configuration 9 or 10, wherein the predetermined information includes thumbnails of images that are held by the communication device and have not been transmitted to the external device.
[Configuration 12]
A method for controlling a communication device, comprising:
communicatively connecting to an external device;
creating screen information to be displayed on the external device based on first information received from the external device;
transmitting the screen information to the external device and receiving operation information of the screen information from the external device;
and when generating the screen information in response to the operation information, requesting second information that has not been received from the external device from the external device,
A control method, wherein in the creating step, the screen information is created based on the first information, the second information, and the operation information.
[Configuration 13]
A method for controlling a communication device, comprising:
communicatively connecting to an external device;
displaying the screen information received from the external device;
and transmitting operation information of the screen information to the external device,
A control method characterized in that in the transmitting step, when the external device creates the screen information based on the operation information, predetermined information that has not been transmitted from the communication device is transmitted to the external device.
[Configuration 14]
12. A program for causing a computer to function as the communication device according to any one of claims 1 to 11.

100...digital camera, 101...control unit, 102...imaging unit, 106...display unit, 108...connection unit, 200...server, 201...control unit, 208...connection unit

Claims (9)

A connection means for communicatively connecting to an external device;
a control means for creating screen information to be displayed on the external device based on first information received from the external device and including an image held by the external device , transmitting the screen information to the external device, and receiving operation information for the screen information from the external device;
the control means requests, from the external device, second information including a thumbnail of an image held by the external device, which second information has not been received from the external device when creating the screen information in response to the operation information;
a communication device that creates the screen information including a selection button used when transmitting an original image corresponding to the thumbnail based on the first information, the second information, and the operation information. The communication device according to claim 1, characterized in that the first information includes a request to create the screen information and information used to create the screen information. The communication device according to claim 1 , wherein the screen information is a list screen of images held by the external device. 4. The communication device according to claim 3 , wherein the control means makes the images and the thumbnails distinguishable from each other on the list screen. The communication device according to claim 4, characterized in that the control means replaces the thumbnail displayed on the list screen with the original image when the control means receives an original image corresponding to the thumbnail from the external device. The communication device according to claim 3, characterized in that when the control means receives selection operation information from the external device indicating that the selection button has been selected on the list screen, it requests an original image corresponding to the thumbnail linked to the selection button from the external device. The communication device according to claim 3, characterized in that when the control means receives selection operation information from the external device indicating that the selection button is selected and an operation to transmit the image is further selected, it requests an original image corresponding to the thumbnail linked to the selection button from the external device . A method for controlling a communication device, comprising:
communicatively connecting to an external device;
creating screen information to be displayed on the external device based on first information received from the external device and including an image held by the external device ;
transmitting the screen information to the external device and receiving operation information of the screen information from the external device;
and requesting, from the external device, second information including a thumbnail of an image held by the external device, which second information has not been received from the external device when creating the screen information in response to the operation information,
A control method characterized in that in the creating step, the screen information including a selection button used when transmitting an original image corresponding to the thumbnail is created based on the first information, the second information, and the operation information. A program for causing a computer to function as the communication device according to any one of claims 1 to 7 .

Images