JP6843564B2 - Display control device, its control method and program - Google Patents

Description

The present invention relates to a display control device, a control method thereof, a program, and a recording medium. In particular, it is a technique related to control performed based on the posture of the device.

Conventionally, there are known imaging devices and display devices that perform control based on posture information detected via a posture detecting means. In the image pickup apparatus, the photometric evaluation and the weighting of the subject detection are changed, and the shooting posture is recorded in association with the image and used to assist the rotation display at the time of reproduction. Further, the display device detects the posture at the time of reproduction, changes the display direction of the image, and displays the image on the display unit.

In Patent Document 1, the photographed image data is subjected to image rotation processing based on the result of whether or not the attitude state of the apparatus at the time of reproduction and the attitude state at the time of photographing recorded together with the photographed image data match, and the photographed image is subjected to image rotation processing. An image processing device that displays data in the correct direction is disclosed.

On the other hand, the user may want to view the image in the display orientation desired by the user regardless of the posture state of the device.
Patent Document 2 describes a mobile terminal that captures a user's face image with a camera provided on the same side as the display unit, rotates the orientation of the image according to the orientation of the user's face, and displays the image on the display unit. The device is disclosed.
In Patent Document 3, the orientation of the image is rotated on the display unit based on the contact position of the hand holding the housing detected by the contact sensor arranged on the back surface of the housing and the posture of the housing. The mobile terminal to be displayed is disclosed.

Japanese Unexamined Patent Publication No. 2000-31329 Japanese Unexamined Patent Publication No. 2008-177819 Japanese Unexamined Patent Publication No. 2013-150129

However, the mobile terminal device disclosed in Patent Document 2 requires a camera for photographing the user, and even when displaying an image, it cannot be handled unless the camera is activated.
Further, the mobile terminal disclosed in Patent Document 3 works only when the housing is held in a specific pattern, and cannot correspond to various holding modes of the housing.
As described above, the conventional technique has a problem that it is not easy to display the image in the display direction desired by the user.

The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to enable the display target to be displayed in the display direction desired by the user.

The present invention includes a display means, a reception means for receiving a switching instruction for switching a display target to be displayed on the display means from a first display target to a second display target, and a posture detection means for detecting the posture of the display control device. , When the control means for controlling the orientation of the display target displayed on the display means to be changed according to the posture detected by the posture detection means, and the display control device is the first posture. When the first display target is displayed on the display means in the first direction with respect to the display means and the switching instruction is received in that state, the second display target is displayed in the first direction. When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and a specific operation is performed. When the display control device changes from the first posture to the second posture which is 90 degrees different from the first posture in the absence state, the first display target is 90 degrees from the first direction. When the display is performed in a different second direction and the switching instruction is received in that state, the second display target is controlled to be displayed in the second direction, and the display control device is in the first posture. In this case, the first display target is displayed on the display means in the first direction with respect to the display means, and the display control device changes from the first posture to the second posture in a state where a specific operation is performed. If the display direction of the first display target is not changed from the first direction and the switching instruction is received in that state, the second display target is displayed in the first direction. After that, when the display control device changes from the second posture to the first posture in a state where no specific operation is performed, the second display target is changed to the first posture. It is characterized by having a control means for controlling so as to display in a third orientation which is 90 degrees different from the orientation and 180 degrees different from the second orientation.

According to the present invention, the display target can be displayed in the display direction desired by the user.

It is a figure which shows the structure of the display device. It is a figure for demonstrating operation of a sensor. It is a flowchart which shows the display control of 1st Embodiment. It is a figure which shows the display example of an image. It is a figure which shows the display example of an image. It is a figure which shows the display example of an image. It is a flowchart which shows the display control of the 2nd Embodiment. It is a flowchart which shows the display control of the 3rd Embodiment. It is a figure which shows the display example of an image. It is a flowchart which shows the display control of 4th Embodiment. It is a figure which shows the display example for each detection posture and reference posture. It is a figure which shows the display example of the display target.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the drawings. In this embodiment, a case where the display control device is applied to the display device will be described. Here, the display device is a device that can be carried by the user, and is, for example, a mobile phone terminal such as a smartphone.
(First Embodiment)
FIG. 1A is a diagram showing a schematic configuration of a display device 100.
The display device 100 includes a control unit 101, a power switch 102, a sensor 103, an image display button 104, an operation switch 105, a memory 106, a recording medium 107, a display unit 108, a touch panel 109, and the like.

The control unit 101 is, for example, a CPU (Central Processing Unit) and controls the entire display device 100. The power switch 102 is pressed by the user when the power of the display device 100 is turned on or off. The sensor 103 is, for example, at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and outputs the posture of the display device 100. Here, the sensor 103 outputs the vertical / horizontal posture of the display device 100, and outputs whether the display surface of the display unit 108 faces upward or downward. The image display button 104 is pressed by the user when displaying an image or a menu screen on the display unit 108. The operation switch 105 is pressed by the user when making various settings.

The memory 106 is, for example, a volatile memory such as a RAM, which temporarily stores image data, characters, figures, and the like to be displayed, and temporarily stores the calculation result of the control unit 101. The recording medium 107 is, for example, a non-volatile memory such as a semiconductor memory, and records data and programs necessary for control, and records image data. The recording medium 107 is an example of a recording unit, and specifically, an EEPROM and a flash ROM can be used. The recording medium 107 may be detachable from the display device 100. The display unit 108 is, for example, a TFT for displaying an image, a menu screen, or the like.

The touch panel 109 is arranged on the display surface of the display unit 108, and detects contact or approach to the display unit 108 by a user's finger, a pen, or the like. As the touch panel 109, any one of various methods such as a resistance film method, a capacitance method, a surface acoustic wave method, an infrared ray method, an electromagnetic induction method, an image recognition method, and an optical sensor method can be used. Depending on the method, there are a method of detecting that there is a touch due to contact with the touch panel 109 and a method of detecting that there is a touch due to the approach of a finger or a pen to the touch panel 109. You may.

The control unit 101 determines the following operations and states (a) to (e) by the user via the touch panel 109.
(A) A finger or pen that has not touched the touch panel 109 newly touches the touch panel 109. That is, the start of touch (referred to as Touch-Down).
(B) The touch panel 109 is in a state of being touched with a finger or a pen (referred to as touch-on).
(C) The touch panel 109 is moved while being touched with a finger or a pen (referred to as Touch-Move).
(D) The finger or pen touching the touch panel 109 is released, that is, the end of the touch (referred to as touch-up or release of the touch).
(E) The touch panel 109 is not touched (referred to as touch-off).

The above-mentioned operations and states (a) to (e) and the coordinate position where the finger or pen is touching on the touch panel 109 are notified to the control unit 101 via the internal bus. The control unit 101 determines the operation of the user on the touch panel 109 based on the notified information.
When the control unit 101 detects a touchdown, it also detects a touch-on. Further, after the touchdown, the control unit 101 normally continues to detect the touch-on unless the touch-up is detected. The control unit 101 also detects touch-on while detecting touch move. Further, even if the control unit 101 detects the touch-on, the control unit 101 does not detect the touch move unless the coordinate position has moved. Further, the control unit 101 detects the touch-off after detecting the touch-up of all the fingers and pens that have been touched.

Regarding the touch move, the control unit 101 can also determine the moving direction of the finger or pen moving on the touch panel 109 for each vertical component and horizontal component on the touch panel 109 based on the change in the coordinate position. Further, when the control unit 101 detects a touch-up on the touch panel 109 after a constant touch move from the touch-down, it determines that the stroke has been drawn. The operation of drawing a stroke quickly is called flicking. Flicking is an operation of quickly moving a finger on the touch panel 109 by a certain distance and then releasing it as it is, in other words, an operation of quickly tracing the touch panel 109 as if flicking it with a finger. The control unit 101 detects that a touch move has been performed over a predetermined distance at a predetermined speed or higher, and detects a touch-up (release of touch) as it is, and determines that a flick has been performed. Further, when the control unit 101 detects that the touch move is performed over a predetermined distance at a speed lower than the predetermined speed, the control unit 101 determines that the drag has been performed.

FIG. 1B is a diagram showing an external configuration of the display device 100. The above-described components in FIG. 1A are designated by the same reference numerals, and the description thereof will be omitted as appropriate.
In the display device 100, a rectangular display unit 108 is located at the center, and a touch panel 109 is arranged so that a touch on the display surface of the display unit 108 can be detected. Further, in the display device 100, the power switch 102 is arranged on the right side, and the operation switch 105 is arranged on the lower side of the display unit 108.
Further, the display device 100 itself is a vertically long rectangle whose outer shape is composed of a long side and a short side. Similarly, the display unit 108 is also a rectangle whose outer shape is composed of a long side and a short side. Typically, the posture of the display device 100 shown in FIG. 1B is referred to as a vertical posture, and the posture rotated by 90 ° from the state shown in FIG. 1B is referred to as a horizontal posture. In the present embodiment, it is assumed that the display device 100 is in the normal position when it is in the vertical posture.

Next, the operation in which the sensor 103 outputs the posture of the display device 100 will be described. Here, a case where the sensor 103 is a 3-axis acceleration sensor will be described.
The sensor 103 outputs three axes, the X-axis, the Y-axis, and the Z-axis. Here, the X-axis is parallel to the display surface and parallel to the short side of the outer shape of the display device 100. Further, the Y-axis is an axis parallel to the display surface and parallel to the long side of the outer shape of the display device 100. The Z-axis is an axis orthogonal to the display surface, that is, an axis orthogonal to the X-axis and the Y-axis.

FIG. 2 is a diagram for explaining the operation of the sensor 103. FIG. 2 shows the output of the sensor 103 when the posture of the display device 100 is changed. Here, the X-axis, Y-axis, and Z-axis are indicated by dashed arrows, and the length of the dashed arrows is set to "1", which is the maximum level with respect to gravity. On the other hand, each output of the X-axis, Y-axis, and Z-axis of the sensor 103 is indicated by a solid arrow, and the length of the solid arrow corresponds to the output value. The control unit 101 detects the posture of the display device 100 based on the output value from the sensor 103.

FIG. 2A is a diagram showing the output of the sensor 103 when the display device 100 is in the vertical posture. As shown in FIG. 2A, when the display device 100 is in the vertical posture, the output value on the Y-axis is approximately “-1”. On the other hand, the output values of the X-axis and the Z-axis are approximately "0". The control unit 101 determines that the display device 100 is in the vertical posture from the output values of the X-axis to the Z-axis.
FIG. 2B is a diagram showing the output of the sensor 103 when the display surface of the display unit 108 of the display device 100 is turned downward. As shown in FIG. 2B, when the display surface faces downward, the output value of the Z axis is approximately “-1”. On the other hand, the output values of the X-axis and the Y-axis are approximately "0". When the display surface is facing upward, the output value of the Z axis is approximately "1".
FIG. 2C is a diagram showing the output of the sensor 103 when the display device 100 is in the horizontal posture (the power switch 102 is downward). As shown in FIG. 2C, when the display device 100 is in the horizontal posture, the output value on the X-axis is approximately “1”. On the other hand, the output values of the Y-axis and the Z-axis are close to "0". The control unit 101 determines that the display device 100 is in the horizontal posture from the output values of the X-axis to the Z-axis. When the power switch 102 points upward, the output value of the X-axis is approximately "-1".

Next, the display control of the display device 100 will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 3 is realized by the control unit 101 expanding the program recorded on the recording medium 107 into the memory 106 and executing the program. Further, the flowchart of FIG. 3 is started in response to an instruction to display the image recorded on the recording medium 107 on the display unit 108. In this embodiment, a case where one of a plurality of images recorded on the recording medium 107 is displayed will be described.

In S301, the control unit 101 detects the posture of the display device 100 based on the output of the sensor 103. This process corresponds to an example of the process by the posture detecting means. Here, the control unit 101 detects whether the display device 100 is in the vertical posture or the horizontal posture, and stores the posture flag aphv corresponding to the detected posture in the memory 106 as posture information.
Specifically, when the absolute value of the Y-axis output value by the sensor 103 is larger than the absolute value of the X-axis output value, the control unit 101 determines that the display device 100 is in the vertical posture. In this case, the control unit 101 sets the posture flag aphv to “0” indicating that the posture is vertical, and stores the posture flag in the memory 106.
On the other hand, when the absolute value of the Y-axis output value by the sensor 103 is smaller than the absolute value of the X-axis output value, the control unit 101 determines that the display device 100 is in the horizontal posture. In this case, the control unit 101 sets the posture flag aphv to "1" indicating that the posture is horizontal, and stores the posture flag in the memory 106.

In S302, the control unit 101 reads out the image to be displayed from the recording medium 107 in the reading memory 106, and also reads out the image information (attribute information) associated with the image. Here, the control unit 101 detects whether the vertical / horizontal information (posture information) included in the read image information is in the vertical direction or the horizontal direction. Next, the control unit 101 stores the vertical / horizontal display flag imghv according to the vertical / horizontal information in the memory 106.
Specifically, when the vertical / horizontal information is in the vertical direction, the control unit 101 sets the vertical / horizontal display flag imghv to “0” and stores the information. On the other hand, when the vertical / horizontal information is in the horizontal direction, the control unit 101 sets the vertical / horizontal display flag imghv to “1” and stores the information. Here, when the image is oriented horizontally as shown in FIG. 4 (a), the vertical and horizontal information in the horizontal direction is associated, and when the image is oriented vertically as shown in FIG. 5 (a), the vertical and horizontal information in the horizontal direction is associated. Vertical and horizontal information is associated.

In S303, the control unit 101 compares the value of the posture flag aphv with the value of the vertical / horizontal display flag imghv, and determines whether or not they are the same. If the values are different, the process proceeds to S304, and if they are the same, the process proceeds to S305.
In S304, the control unit 101 rotates the image by 90 ° and stores it in the memory 106 in order to change the display orientation of the image. For example, the control unit 101 can rotate the image by 90 ° by calculating to rotate the image data by 90 °. Whether to rotate 90 ° clockwise or 90 ° counterclockwise depends on the posture of the display device 100 detected by the sensor 103. That is, if the display device 100 rotates 90 ° clockwise with respect to the normal position, the image data is rotated 90 ° counterclockwise, and the display device 100 rotates 90 ° counterclockwise with respect to the normal position. If the direction is to be used, the image data is rotated 90 ° clockwise. Hereinafter, the case of 90 ° rotation is assumed to be different depending on the posture of the display device 100 in this way.

In S305, the control unit 101 displays the image stored in the memory 106 on the display unit 108.
Here, the image displayed on the display unit 108 after the specific processes S301 to S305 will be described.

FIG. 4A is an image associated with vertical and horizontal information in the horizontal direction.
First, it is assumed that the display device 100 is in the horizontal posture as shown in FIG. 4 (b). In this case, in S301, the control unit 101 detects that the display device 100 is in the horizontal posture, sets the posture flag aphv to "1", and stores the display device 100. In S302, the control unit 101 detects that the vertical / horizontal information of the image of FIG. 4A is in the horizontal direction, sets the vertical / horizontal display flag imghv to “1”, and stores the information. In S303, the control unit 101 determines that the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are the same, and proceeds to S305. In S305, the control unit 101 displays the image on the display unit 108 as it is so as to match the direction without rotating the image. Therefore, as shown in FIG. 4B, an image in the horizontal direction is displayed on the display device 100 in the horizontal posture.

Next, it is assumed that the display device 100 is in the vertical posture as shown in FIG. 4 (c). In this case, in S301, the control unit 101 detects that the display device 100 is in the vertical posture, sets the posture flag aphv to “0”, and stores the display device 100. In S302, the control unit 101 detects that the vertical / horizontal information of the image of FIG. 4A is in the horizontal direction, sets the vertical / horizontal display flag imghv to “1”, and stores the information. In S303, the control unit 101 determines that the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are different, and proceeds to S304. In S304, the control unit 101 rotates the image by 90 °, and in S305, the control unit 101 displays the rotated image on the display unit 108. Therefore, as shown in FIG. 4 (c), the image in the horizontal direction is displayed as an image rotated by 90 ° as compared with FIG. 4 (b) with respect to the display device 100 in the vertical posture.
In this way, the image is displayed in the display orientation desired by the user regardless of whether the display device 100 is in the vertical posture or the horizontal posture.

On the other hand, FIG. 5A is an image in which the vertical and horizontal directions are erroneously associated with each other, although the vertical and horizontal information should originally be in the horizontal direction as shown in FIG. 4A.
First, it is assumed that the display device 100 is in the vertical posture as shown in FIG. 5 (b). In this case, through S301 and S302, in S303, the control unit 101 determines that the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are both "0" and the same, and proceeds to S305. In S305, the control unit 101 displays the image on the display unit 108 as it is so as to match the direction without rotating the image. Therefore, as shown in FIG. 5B, an image in the vertical direction is displayed on the display device 100 in the vertical posture.

Next, it is assumed that the display device 100 is in the horizontal posture as shown in FIG. 5 (c). In this case, after passing through S301 and S302, in S303, the control unit 101 determines that the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are different, and proceeds to S304. In S304, the control unit 101 rotates the image by 90 °, and in S305, the control unit 101 displays the rotated image on the display unit 108. Therefore, as shown in FIG. 5 (c), the image in the vertical direction is displayed as an image rotated by 90 ° as compared with FIG. 5 (b) with respect to the display device 100 in the horizontal posture.
As described above, since the image is associated with erroneous vertical and horizontal information, the image is not displayed in the display orientation desired by the user even if the display device 100 is in the vertical or horizontal posture.

Next, in S306 and subsequent steps of the flowchart of FIG. 3, the control unit 101 controls the display so that the image has the display orientation desired by the user. In the processing after S306, it continues to monitor whether the posture of the display device 100 changes with time, and repeats the loop.
In S306, the control unit 101 substitutes the value of the posture flag aphv into the past posture flag aphold indicating the posture of the past display device 100.
In S307, the control unit 101 detects the posture of the display device 100 and sequentially updates the posture flag aphv according to the detected posture.

In S308, the control unit 101 determines whether or not the posture of the display device 100 has changed. Specifically, the control unit 101 compares the values of the past attitude flag aphold and the attitude flag aphv and determines whether or not they are the same. If the values are the same, the process proceeds to S316, the control unit 101 determines whether or not to continue the display, and if it continues, returns to S306 to continue displaying the image. On the other hand, when the values are different, that is, when the display device 100 changes from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture, the process proceeds to S309.

In S309, the control unit 101 detects the state of the touch panel 109. Specifically, the control unit 101 detects touch-on, touch-off, and the like based on the notification from the touch panel 109. This process corresponds to an example of the process by the touch detection means. When the control unit 101 detects touch-on, the variable tch is set to "1", and when it is not touch-on (touch-off), the variable tch is set to "0" and stored in the memory 106. The fact that the control unit 101 detected the touch-on means that the touchdown was detected before, and it was in the touched state when determining the change in the posture in S308, that is, it was touched before the change in the posture. It shows that it remained.

In S310, the control unit 101 determines whether or not touch-on is detected. Specifically, the control unit 101 determines whether or not the variable tch is "1". That is, here, it is determined whether or not the touch panel 109 is touched on when the display device 100 changes from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture. If touch-on is detected, the process proceeds to S311. If touch-on is not detected, the process proceeds to S313.

In S311 the control unit 101 changes the vertical and horizontal information of the image. Specifically, the control unit 101 sets “0” if the vertical / horizontal display flag imghv of the image stored in the memory 106 is “1”, and sets it to “1” if the vertical / horizontal display flag imghv is “0”.
In S312, the control unit 101 updates the changed vertical / horizontal display flag imghv and stores it in the memory 106.
In S313, the control unit 101 compares the value of the posture flag aphv with the value of the vertical / horizontal display flag imghv, and determines whether or not they are the same. If they are different, the process proceeds to S314, and if they are the same, the process proceeds to S315. In the case of proceeding from S312 to S313, the value of the vertical / horizontal display flag imghv is the vertical / horizontal display flag changed in S311.
In S314, the control unit 101 rotates the image by 90 ° and stores it in the memory 106 in order to change the display orientation of the image.

In S315, the control unit 101 displays the image stored in the memory 106 on the display unit 108. This process corresponds to an example of process by the control means.
In S316, the control unit 101 determines whether or not to continue the display. Specifically, the control unit 101 determines whether or not an instruction not to display an image has been received by an operation by the user via the image display button 104. If the display is to be continued, the process proceeds to S306, and if the display is not to be continued, the process proceeds to S317.

Here, a case where the touch-on is detected when the change in the posture is detected and a case where the touch-on is not detected will be described.
If the control unit 101 does not detect the touch-on when the change in the posture of the display device 100 is detected, the process proceeds to S313, S314, and S315 via S306 to S310. In this case, the display orientation of the image with respect to the display device 100 is changed and displayed according to the change in the posture of the display device 100.
On the other hand, if touch-on is detected when the control unit 101 detects a change in the posture of the display device 100, the process proceeds to S313 and S315 via S306 to S310, S311 and S312. In this case, the display orientation of the image with respect to the display device 100 is not changed according to the change in the posture of the display device 100.

Here, an example of an image displayed on the display unit 108 will be specifically described through the processes of S306 to S310, S311 and S312, and the processes of S313 and S315.
FIG. 6A is the same state as in FIG. 5B described above. That is, the image shown in FIG. 5B is an image in which vertical and horizontal information in the vertical direction is erroneously associated with the image, and the image is not displayed in the display direction desired by the user. The image is not limited to the image to which the incorrect vertical / horizontal information is associated, and may be an image to which the vertical / horizontal information itself is not associated.
Here, in the state where the image is displayed on the display unit 108 by S305, the posture flag aphv is stored as “0” and the vertical / horizontal display flag imghv is stored as “0” in the memory 106. If the posture of the display device 100 does not change as it is, “0” is stored in the past posture flag aphvolt in S306, so that the display orientation of the image is not changed in order to proceed to S316 in the determination of the posture change in S308. ..

On the other hand, as shown in FIGS. 6 (b), 6 (c), and 6 (d), it is assumed that the display device 100 is changed from the vertical posture to the horizontal posture while the user touches the touch panel 109. .. In this case, in S307, the control unit 101 updates the attitude flag aphv from "0" to "1". In S308, since the control unit 101 determines that the values of the past attitude flag aphold and the attitude flag aphv are different, the process proceeds to S309. In S309, the control unit 101 detects the touch-on of the touch panel 109 by the user, so that the variable tch is set to “1”. In S310, the control unit 101 determines that the variable tch is "1", so the process proceeds to S311. In S311 and S312, the control unit 101 changes the vertical and horizontal information by changing the vertical and horizontal display flag imghv from "0" to "1", and updates the memory 106.

In S313, the control unit 101 determines that the attitude flag aphv is "1" and the vertical / horizontal display flag imghv is "1", and the values are the same, so the process proceeds to S315. In S315, the control unit 101 displays a horizontal image so as to align the direction with respect to the horizontal posture display device 100. That is, when the image of FIG. 6B and the image of FIG. 6D are compared, the display orientation of the image with respect to the display device 100 is not changed. Therefore, even if the image is associated with erroneous vertical and horizontal information, the user changes the display device 100 from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture while touching on the touch panel 109. The image is displayed in the desired display orientation.

Next, as shown in FIG. 6E, it is assumed that the user releases the finger from the touch panel 109 and detects the touch-off. When the user releases (touches up) the touch panel 109 from the state of FIG. 6 (d) and holds the display device 100 in the posture as shown in FIG. 6 (e), the posture of the display device 100 is before touch-up. It doesn't change from. In this case, it is determined to be Yes in S308 via S316 to S306 and S307, and a loop is performed to proceed to S316. Therefore, since S314 that performs the rotation process is not passed through, the control unit 101 displays the image while maintaining the display orientation of the image of FIG. 6 (d) as shown in FIG. 6 (e), and does not change the display orientation of the image. After that, when the user changes the holding method so as to change the posture of the display device 100 without touching the touch panel 109, it is determined as No in S308. Since the user has not touched the touch panel 109, in S310, the control unit 101 determines that the touch-on has not been detected, and proceeds to S313. Here, the value of the vertical / horizontal display flag imghv remains updated, that is, "1", and the aphv is "0" because the posture has changed. Therefore, in S313, the control unit 101 has the value of the posture flag aphv. It is determined that the values of the vertical and horizontal display flags imghv are not the same. Therefore, via S314, in S315, the control unit 101 is displayed as shown in FIG. 4 (c). In this way, after the display device 100 is touched to rotate the display device 100 and the touch is released, the image is displayed in the display direction desired by the user regardless of whether the display device 100 is in the vertical posture or the horizontal posture. ..
Although the case of displaying an image with incorrect vertical and horizontal information has been described here, the same processing is performed for an image with correct vertical and horizontal information. Further, in the processing of S306 to S315, when the user merely touches the touch panel 109 without changing the posture of the display device 100, the process does not proceed from S308 to S309, so that the image display orientation. Is not controlled.

Returning to the flowchart of FIG. 3, in S317, the control unit 101 displays a confirmation screen on the display unit 108 for confirming with the user whether to record the vertical and horizontal information of the image. Specifically, as shown in FIG. 6 (f), the control unit 101 superimposes the image on the image and displays a message "Do you want to switch and save the vertical and horizontal information of the image?" And options such as a dialog box. ..
In S318, the control unit 101 determines whether or not to record the vertical and horizontal information of the image on the recording medium 107. Specifically, the control unit 101 determines whether the option of saving the vertical and horizontal information of the image is selected or the option of not saving the image is selected. If recording is selected by the user, the process proceeds to S319, and if not recording is not selected, the process proceeds to S320.

In S319, the control unit 101 associates the vertical and horizontal information stored in the memory 106 with the image and records it on the recording medium 107. More specifically, the vertical and horizontal information (posture information, rotation information, angle information) of the image recorded as the attribute information of the image file is updated and recorded based on the vertical and horizontal information stored in the memory 106. Since it is sufficient to change the correspondence between the orientation of the image recorded in the image file and the attitude information included in the attribute information, the image itself is stored in the memory 106 without changing the recording of the attribute information of the image file. The image may be rotated and recorded based on the stored vertical and horizontal information (that is, the orientation of the recorded image itself is changed). In addition, instead of updating the posture information of the already recorded image or changing the orientation of the recorded image (that is, not overwriting), the image file in which the posture information is newly changed, or the recording orientation of the image is changed. You may create and record the modified image file. For example, in the display example shown in FIG. 6 (f), when the user selects to record the vertical and horizontal information, the control unit 101 sets the image itself in the horizontal direction and records the vertical and horizontal information in association with each other. Record on medium 107. Therefore, when the flowchart of FIG. 3 is started next time to display the same image, the vertical and horizontal information in the horizontal direction is read out as the image information associated with the image in S302. Therefore, in S305, it is displayed as shown in FIG. 4 (b) or FIG. 4 (c) from the beginning.
On the other hand, in the display example shown in FIG. 6 (f), when the user selects not to record the vertical and horizontal information, the processing of S319 is omitted, so that the image remains in the vertical direction and is in the vertical direction. The vertical and horizontal information of is still recorded in association with each other. Therefore, when the flowchart of FIG. 3 is started next time to display the same image, the vertical and horizontal information in the vertical direction is read out as the image information associated with the image in S302. Therefore, in S305, it is displayed as shown in FIG. 5 (b) or FIG. 5 (c).

Finally, in S320, the control unit 101 ends the flowchart of FIG. 3 by turning off the display unit 108.
In this way, the user changes the posture of the display device 100 while the touch panel 109 is touched on, so that the control unit 101 determines the correspondence between the posture of the display device 100 and the display orientation of the image with respect to the display unit 108. The change is made before and after the change in the posture of the display device 100. Therefore, the image can be displayed in the direction desired by the user. Further, since the operation of changing the posture of the display device 100 while the touch panel 109 is touched on is intuitive and easy to understand, the operability of the display device 100 can be improved.

Further, in the present embodiment, the display orientation of the image is controlled only for the image displayed on the display unit 108 by changing the vertical and horizontal information associated with the image. Therefore, even when a plurality of images are recorded, it is possible to prevent the vertical and horizontal information from being changed to images other than the displayed image.

The above-mentioned processes S317 to S319 may be omitted. In this case, even if the vertical and horizontal information of the image is changed in S311, the vertical and horizontal information before the change is read out as the vertical and horizontal information associated with the image when the next time the process proceeds to S302 to display the same image. Is done.
Further, the above-mentioned processes S317 to S319 can be performed only when passing through S311 and S312. In this case, only when the vertical and horizontal information of the image is changed, the user is asked whether or not to switch and save the vertical and horizontal information of the image. Therefore, the operability of the display device 100 can be improved.

Further, in S316, the case of determining whether or not to continue the display has been described, but the present invention is not limited to this case, and it is determined whether or not the user flicks the touch panel 109 to instruct the image feed. You may. Image feed means that when a plurality of images are recorded on the recording medium 107 in the order of shooting date and time, the transition to the next image is performed according to the order. If the image feed is instructed, the process may proceed to S317, and if the image feed is not instructed, the process may return to S306. Therefore, when the image feed is instructed, in S317, the control unit 101 asks the user whether to record the vertical and horizontal information of the image before the image feed.

(Second embodiment)
Next, the display control of the second embodiment will be described with reference to the flowchart of FIG. In the first embodiment, when the control unit 101 has detected the touch-on in S310, the case where the process proceeds to the process of changing the vertical / horizontal information in S311 has been described. In the present embodiment, the case where the process proceeds to S311 when the touch-up is detected will be described. The flowchart shown in FIG. 7 is realized by the control unit 101 expanding the program recorded on the recording medium 107 into the memory 106 and executing the program. Note that the flowchart of FIG. 7 is obtained by changing the processes of S307 to S310 of the flowchart of FIG. 3 described in the first embodiment to the processes of S701 to S705. Therefore, among the flowcharts of FIG. 7, the same processes as those of the flowchart of FIG. 3 are given the same step numbers, and the description thereof will be omitted.

In S701, the control unit 101 determines whether or not there is a touchdown based on the notification from the touch panel 109. If there is a touchdown, the process proceeds to S702, and if there is no touchdown, the process proceeds to S313. The processing after S313 is the same as that of the first embodiment.

In S702, the control unit 101 detects the posture of the display device 100 and changes the posture as compared with that before the touchdown of S701, that is, whether or not there is a change from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture. To judge. Specifically, the control unit 101 compares the value of the past posture flag aphold before the touchdown with the value of the posture flag aphv at the time of touchdown, and determines whether or not they are the same. If the values are different, that is, if the posture changes, the process proceeds to S703. On the other hand, if the values are the same, that is, if the posture has not changed, the process proceeds to S704.

In S703, the control unit 101 determines whether or not there is a touch-up based on the notification from the touch panel 109. If there is no touch-up, the posture of the display device 100 may change, so the process returns to S702. If there is a touch-up, the process proceeds to S311. That is, the case of proceeding to S311 is a case where the display device 100 changes from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture before and after the touchdown to the touch panel 109. The processing after S311 is the same as that of the first embodiment.
Also in S704, the control unit 101 determines whether or not there is a touch-up based on the notification from the touch panel 109. If there is no touch-up, the posture of the display device 100 may change, so the process returns to S702. If there is a touch-up, the process proceeds to S705. That is, the case of proceeding to S705 is a case where the posture of the display device 100 does not change before and after the touchdown with respect to the touch panel 109, which is a normal touch operation.
Therefore, in S705, the control unit 101 performs a process corresponding to the touch. Although detailed description of the process corresponding to the touch is omitted, for example, the function assigned to the display item at the touched position may be executed.

As described above, according to the present embodiment, it is determined whether or not the posture of the display device 100 changes until the touch-up is performed, and the process proceeds to the next process based on the time when the touch-up is detected. Therefore, the display device 100 can omit the display control according to the posture of the display device 100 until the user touches up and shifts to the next process.

(Third Embodiment)
Next, the display control of the third embodiment will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 8 is realized by the control unit 101 expanding the program recorded on the recording medium 107 into the memory 106 and executing the program. In the first and second embodiments, a case where the display orientation of the image is controlled by changing the vertical and horizontal information associated with the image has been described. In the present embodiment, a case where the display orientation of the image is controlled without changing the vertical and horizontal information will be described. In the present embodiment, for example, it is used when the user lies down and browses the image displayed on the display unit 108. In the flowchart of FIG. 8, S801 is added to the flowchart of FIG. 7 described in the second embodiment, and the processing of S311 to S315 is changed to the processing of S802 to S808. Therefore, among the flowcharts of FIG. 8, the same processes as those of the flowchart of FIG. 7 are given the same step numbers, and the description thereof will be omitted.

First, an example of using the display device 100 of the present embodiment will be described with reference to FIG.
FIG. 9A is a diagram showing a state in which the user is viewing the image displayed on the display unit 108 of the display device 100 while lying down. When the user lays down and browses the image, the display device 100 is in a tilted state by the user. At this time, the control unit 101 detects that the display device 100 is in the vertical posture, but it is preferable that the image is rotated by 90 ° and displayed in view of the relative value of the line of sight of the user. In the present embodiment, the image is displayed based on the change information that changes the correspondence between the posture of the display device 100 and the display orientation of the image with respect to the display unit 108. Hereinafter, a specific description will be given.

In S801, the control unit 101 substitutes 0 in order to initialize the change flag R as change information, and stores it in the memory 106. Here, the change flag R is a flag indicating whether or not to change the correspondence between the posture of the display device 100 and the display orientation of the image with respect to the display unit 108.
The processes from S303 to S705 are the same as those in the first and second embodiments.
In S703, the control unit 101 determines whether or not there is a touch-up based on the notification from the touch panel 109, and if there is a touch-up, proceeds to S802. That is, the case of proceeding to S802 is a case where the display device 100 changes from the vertical posture to the horizontal posture or from the horizontal posture to the vertical posture before and after the touchdown with respect to the touch panel 109.

In S802, the control unit 101 inverts the change flag R stored in the memory 106. Specifically, the control unit 101 stores the change flag R in the memory 106 as "1" if the change flag R is "0", sets it as "0" if the change flag R is "1", and stores it in the memory 106. To do.
In S803, the control unit 101 compares the value of the posture flag aphv with the value of the vertical / horizontal display flag imghv and determines whether or not they are the same. If the values are the same, the process proceeds to S804, and if they are different, the process proceeds to S806.

In S804, the control unit 101 determines whether or not the change flag R is “0”. In the case of "1", the process proceeds to S805, and the control unit 101 rotates the image by 90 ° and stores it in the memory 106 in order to change the display direction of the image. On the other hand, in the case of "0", the process of rotating the image is not performed, and the process proceeds to S808. That is, when the change flag R is "1", even if the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are the same, the image is rotated by 90 ° and displayed.

Similarly in S806, the control unit 101 determines whether or not the change flag R is “0”. In the case of "0", the process proceeds to S807, and similarly to S304 described above, the control unit 101 rotates the image by 90 ° and stores it in the memory 106 in order to change the display direction of the image. On the other hand, in the case of "1", the control unit 101 does not perform the process of rotating the image, and proceeds to S808. That is, when the change flag R is "1", even if the value of the posture flag aphv and the value of the vertical / horizontal display flag imghv are different, the process of rotating the image is not performed.

In S808, the control unit 101 displays the image stored in the memory 106 on the display unit 108. Here, a case where the image of FIG. 4A is displayed will be described with reference to FIGS. 9B and 9C. In FIGS. 9B and 9C, the posture of the display device 100 is detected as the vertical posture.

First, FIG. 9B is a table when the process proceeds to S803 without going through S802 (the value of the change flag R remains “0”) after it is determined in S701 that there is no touchdown to the touch panel 109. It is an example. That is, in S803, the control unit 101 proceeds to S806 because the attitude flag aphv is “0” and the vertical / horizontal display flag imghv is “1” and the values are different. In S806, the control unit 101 rotates the image by 90 ° because the value of the change flag R is “0”. Therefore, as shown in FIG. 9B, the image is displayed in the same display orientation as in FIG. 4C. In this case, when the user is lying down as shown in FIG. 9A, the line of sight of the user (broken line shown in FIG. 9B) and the display orientation of the image do not match.

On the other hand, in FIG. 9C, for example, when the user lies down and the display device 100 changes from the horizontal posture to the vertical posture, there is a touchdown to the touch panel 109, and the value of the change flag R is passed through S802. Is inverted to "1"), and is a display example when the process proceeds to S803. That is, in S803, the control unit 101 proceeds to S806 because the attitude flag aphv is “0” and the vertical / horizontal display flag imghv is “1” and the values are different. In S806, the control unit 101 does not rotate the image because the value of the change flag R is "1". Therefore, as shown in FIG. 9 (c), the image is displayed in the same display orientation as in FIG. 4 (b). In this case, when the user is lying down as shown in FIG. 9 (a), the line of sight of the user (broken line shown in FIG. 9 (c)) matches the image, and the display orientation desired by the user. Matches with.

After that, in S316, the control unit 101 determines whether or not to continue the display, and if it continues, returns to S306 and repeats the above-described processing. If the display is continued in S316, the value of the change flag R remains "1" unless the process proceeds to S802 via S306, S701, S702, and S703 again. Therefore, when the user flicks the touch panel 109 to instruct the image feed while the image is continuously displayed, the control unit 101 responds to the value of the maintained change flag R. To display the image.
Here, for example, it is assumed that the user flicks from the state shown in FIG. 9 (c) as shown by the arrow in FIG. 9 (d). The control unit 101 transitions the images in the next order according to the flick and displays them on the display unit 108. This process corresponds to an example of process by the transition means. Even in this case, the control unit 101 displays the image according to the processes of S803 to S808 while maintaining the value of the change flag R. Therefore, even when the image is fed, the displayed image matches the display orientation desired by the user.

Similarly, when the display is continued in S316, the value of the change flag R remains "1" unless the process proceeds to S802 again. Therefore, when the user instructs the display of the setting screen (menu screen) for setting the display of the image via the touch panel 109 or the operation switch 105, the control unit 101 sets the value of the maintained change flag R to the value. Transit to the corresponding setting screen.
Here, for example, it is assumed that the user has instructed the display of the setting screen via the operation switch 105 from the state shown in FIG. 9C. In this case, as shown in FIG. 9E, the control unit 101 displays the setting screen while maintaining the value of the change flag R. Therefore, even when the setting screen is displayed, the setting screen matches the display orientation desired by the user.

In this way, the user changes the posture of the display device 100 while the touch panel 109 is touched on, so that the control unit 101 changes the posture of the display device 100 and the correspondence relationship between the posture of the display device 100 and the image display direction with respect to the display unit 108. Change before and after the change of. Therefore, the image can be displayed in the direction desired by the user.

Further, in the present embodiment, the control unit 101 does not change the vertical and horizontal information associated with the image, but changes the display orientation of the image based on the change information. By processing in this way, the control unit 101 controls the posture as if it is different from the posture of the detected display device 100. Therefore, the user's desire is not limited to the image currently displayed (first image), but even when the next different image (second image) to which the image has been sent or the setting screen is displayed. It can be matched with the display orientation.

Further, in the present embodiment, by displaying the image as if the posture is different from the posture of the display device 100, the image is displayed in the display direction desired by the user even when the user lies down and browses the image. Can be made to. When the control unit 101 detects that the display surface of the display device 100 is not downward through the sensor 103, the user changes from lying down to getting up, and it can be determined that the lying down is completed. In this case, the control unit 101 initializes the change flag R even when the display is continued in S316. Therefore, even when the laying down is completed, the image can be matched with the display orientation desired by the user.

(Fourth Embodiment)
Next, the display control of the fourth embodiment will be described with reference to FIGS. 10 and 11. In the present embodiment, for example, when the user lays down and browses, when the display device 100 is rotated according to the content displayed on the display unit 108 from the lie down state, the display is performed in a more appropriate orientation. An example will be described. More specifically, the posture (reference posture) of the reference display device is changed depending on whether the user is looking upright at the display device 100 or lying down. Even when lying down, there are two patterns, one in which the user's right eye is on the lower side in the direction of gravity and the other in which the user's left eye is on the lower side in the direction of gravity. .. The operation of changing the reference posture is performed by rotating the display device 100 while touching it, as in the first to third embodiments described above. However, the operation of changing the reference posture is not limited to this. The display orientation of the content (image, etc.) displayed on the display unit 108 is automatically rotated according to the orientation of the display device 100 for each reference posture.

FIG. 11 is a table showing display examples and content rotation angles (display directions) for each posture of the display device 100 in each reference posture in the present embodiment.
Each column of row 1100 shows the definition of each of the four postures of the display device 100. As shown in line 1100, the control unit 101 determines which of the following four postures the posture of the display device 100 is based on the output of the sensor 103 (which posture is the closest to which posture range). Whether it fits) can be determined.
Positive posture (posture 1): A posture in which the upper part of the display surface of the display device 100 faces upward in the direction of gravity.
-Upper right vertical posture (posture 2): A direction in which the upper part of the display surface of the display device 100 faces upright and faces the right side when viewed from the user. A posture in which the display device 100 is rotated 90 degrees clockwise (clockwise) around an axis perpendicular to the display surface as compared with the normal posture.
Upside-down posture (posture 3) A posture in which the upper part of the display surface of the display device 100 faces downward in the direction of gravity. A posture in which the display device 100 is rotated 180 degrees around an axis perpendicular to the display surface as compared with the normal posture. Positive posture and upside down posture.
-Upper left vertical posture (posture 4): A direction in which the upper part of the display surface of the display device 100 faces upright and faces the left side when viewed from the user. A posture in which the display device 100 is rotated clockwise / clockwise by 270 degrees (counterclockwise / counterclockwise 90 degrees) with respect to an axis perpendicular to the display surface as compared with the normal posture.

Each column of row 1101 shows a display example in which the detected posture is in each of the above-mentioned postures 1 to 4 when the reference posture is the normal posture (posture 1). When the reference posture is the normal posture (posture 1), the user is in an upright position (the upper part of the face is upward in the direction of gravity and the lower part of the face (chin) is downward in the direction of gravity). It is assumed that the display unit 108 is being viewed. As illustrated in line 1101, the display device 100 is displayed in a direction in which the upper part of the display target (content) faces upward in the direction of gravity regardless of the above four postures so that an upright user can easily see the display device 100. The display orientation is automatically rotated according to the posture of the display device 100.

Each column of row 1102 shows a display example in which the detected posture is in each of the above-mentioned postures 1 to 4 when the reference posture is the upper right vertical posture (posture 2). When the reference posture is the upper right vertical posture (posture 2), it is assumed that the user is watching the display unit 108 in the lying posture in which the user's right eye is on the lower side in the direction of gravity as the assumed usage scene. ing. As illustrated in line 1102, the display orientation is automatically rotated according to the posture of the display device 100. That is, in order to make it easier for the user to lie down with the right eye on the lower side in the direction of gravity, the right side of the display target (content) faces downward in the direction of gravity regardless of the above four postures. It is displayed in the direction of.

Each column of row 1103 shows a display example in which the detected posture is in each of the above-mentioned postures 1 to 4 when the reference posture is the upside-down posture (posture 3). As illustrated in line 1103, the display orientation is automatically rotated according to the posture of the display device 100. That is, regardless of the above-mentioned four postures of the display device 100, the display is displayed in a direction in which the upper side of the display target (content) is downward in the direction of gravity (upside down). However, since it is not assumed that such a display is suitable for use, the reference posture is not set to the upside-down posture (posture 3) in the present embodiment (the display as in the display example of line 1103 is not performed). ). However, it goes without saying that if there is a usage situation in which it can be assumed that the display such as the display example of line 1103 is suitable, the display such as the display example of line 1103 may be performed without this limitation. ..

Each column of row 1104 shows a display example in which the detected posture is in each of the above-mentioned postures 1 to 4 when the reference posture is the upper left vertical posture (posture 4). When the reference posture is the upper left vertical posture (posture 4), it is assumed that the user is viewing the display unit 108 in a lying posture in which the user's left eye is on the lower side in the direction of gravity as an assumed usage scene. ing. As illustrated in line 1104, the display orientation is automatically rotated according to the posture of the display device 100. That is, in order to make it easier for the user to lie down with the left eye on the lower side in the direction of gravity, the left side of the display target (content) faces downward in the direction of gravity regardless of the above four postures. It is displayed in the direction of.

FIG. 10 shows a flowchart for realizing an automatic rotation display as in each display example of FIG. The flowchart of FIG. 10 is realized by the control unit 101 expanding the program recorded on the recording medium 107 into the memory 106 and executing the program.
In S1001, the control unit 101 initializes the change flag R held in the memory 106 to 0. As a result, when the display process is started (when the software for executing this process is started or when the power of the display device 100 is turned on), the reference posture becomes the normal posture (posture 1). It is initialized.

In S1002, the control unit 101 reads out the vertical and horizontal information of the display target (image, document, etc.) to be displayed. This process is the same as the process of S302 described above. When displaying without reflecting the vertical and horizontal information of the display target, this process may be omitted. Further, when the display target is a display target of a type such as a Web page to which vertical and horizontal information is not given, this process may be omitted.

In S1003, the control unit 101 detects the posture of the display device 100 based on the output of the sensor 103. Information indicating which of the above-mentioned postures 1 to 4 is used is held in the system memory 52 as the value of the variable aphv indicating the current posture.
In S1004, the control unit 101 displays the display target on the display unit 108 in the direction according to the current posture aphv along the value of the change flag R. Since the variable R = 0 in the initial state, the display is performed in the direction (rotation angle of the display target) according to the current posture aphv among the four display examples shown in line 1101 of FIG. That is, when the current posture aphv is the posture 1, the display target is displayed without rotating. When the current posture aphv is the posture 2, the display target is rotated clockwise by 270 degrees and displayed. When the current posture aphv is the posture 3, the display target is rotated 180 degrees and displayed upside down. When the current posture aphv is the posture 4, the display target is rotated 90 degrees clockwise to be displayed.

In S1005, the control unit 101 stores the value of the current posture aphv as a variable aphfold holding in the system memory 52 indicating the posture of the display device 100 at least one cycle before (immediately before). That is, the current posture aphv is stored in the system memory 52 as the past posture.
In S1006, the control unit 101 determines whether or not there is a touchdown. If it is determined that there is a touchdown, the process proceeds to S1007, and if not, the process proceeds to S1021.

In S1007, the control unit 101 detects the posture of the display device 100 based on the output of the sensor 103. This process is the same as the process of S1003. Further, S1007 is a process of detecting the posture of the display device 100 during touching.
In S1008, the control unit 101 determines whether or not the current posture aphv during touching has changed as compared with the aphbold indicating the posture of the display device 100 before being touched down. That is, after the touch is started, it is determined whether or not the posture of the display device 100 has changed while the touch continues. If there is a change, the process proceeds to S1011. If not, the process proceeds to S1009.

In S1009, the control unit 101 determines whether or not there is a touch-up. If there is a touch-up, the process proceeds to S1010 and processing is performed according to the touch-up. This process is the same as that of S705 described above. If there is no touch-up, the process proceeds to S1007 and the process is repeated.
In S1011, the control unit 101 determines whether or not there is a touch-up. If there is a touch-up, the process proceeds to S1012, and if not, the process proceeds to S1007 and the process is repeated.

In S1012, S1014, S1016, and S1018, the control unit 101 determines which of the postures 1 to 4 is the current posture aphv indicating the posture detected immediately before the touch-up is detected in S1011. Immediately after the touch-up is detected in S1011, the posture of the display device 100 may be detected again, and then the processes of S1012, S1014, S1016, and S1018 may be performed. In any case, it is a process of determining the posture at the time of touch-up (the posture when the posture changes while being touched and the touch is released after the posture change).
If it is determined that the posture is 1, the change flag R = 0 is stored in S1013.
If it is determined that the posture is 2, the change flag R = 1 is stored in S1015.
If it is determined that the posture is 3, the change flag R = 0 is stored in S1017. This is because it is difficult to assume a situation in which the user intentionally turns the display device 100 upside down and the user himself / herself browses the display device 100 from the upside-down direction. Even if the display device 100 is upside down, it is assumed that the user himself / herself is not viewing the display device 100 from the upside down direction, and R = 0 is set as in the case of the normal posture. That is, the display when R = 2 shown in FIG. 11 is not performed. In other words, when R = 1 or 3, the display device 100 is rotated and turned upside down while being touched, and the reference posture R can be reset to 0 by releasing the touch. Needless to say, when the posture is 3, R = 2 may be set instead of R = 0.
If it is determined that the posture is 4, the change flag R = 3 is stored in S1019.

In S1020, the control unit 101 stores the posture that caused the processing of S1012 to S1019 as a variable aphfold indicating the past posture.
In S1021, the control unit 101 again detects the posture of the display device 100 based on the output of the sensor 103. This process is the same as the process of S1003.
In S1022, the control unit 101 determines whether or not the display device 100 has a posture change (whether or not there has been a posture change in a non-touched state) by comparing the past posture aphvolve with the current posture aphv. If there is no change in posture, the process proceeds to S1023. If there is a change in posture, the process proceeds to S1004, and the direction of the display target displayed on the display unit 108 is changed (rotated) so as to match the value of the change flag R and the current posture aphv. That is, even when the display device 100 is rotated while touching to change the reference posture (variable R), the display orientation of the display target is not fixed. It is rotated and displayed according to the subsequent change in the posture of the display device 100 and the reference posture. The value of each variable R and the display orientation for each posture are as shown in FIG. As a result, for example, assuming that R = 1, the display device 100 is rotated in which direction for the user who browses the display device 100 while lying down as shown in the assumed usage scene of line 1102 in FIG. Even if you let it lie down, you can see the display target in an easy-to-see direction. Even when lying in the opposite direction, if the change flag is set to R = 3 and the posture different from that of line 1101 is set as the reference posture, the display is displayed as shown in line 1104 according to the posture of the display device 100. You can see the display target in an easy-to-see orientation while lying down.

In S1023, the control unit 101 determines whether or not there is a change instruction (switching instruction) of the display target to be displayed on the display unit 108 (accepts the switching instruction). The change instruction is, for example, a change instruction by an image feed operation for switching the image displayed on the display unit 108 to another image when the captured image is being browsed. Alternatively, it is an automatic switching change instruction after a lapse of a certain period of time by slide show processing. Further, in the case of browsing a Web page or the like, it is an instruction to display another page, display a page displayed in another window, or the like. If there is no instruction to change the display target, the process proceeds to S1024, and if there is an instruction to change the display target, the process proceeds to S1002. When the process proceeds to S1002, the vertical and horizontal information is read about the display target after switching, and the display target after switching is changed to the value of the current change flag R and the posture aphv of the current display device 100 through S1003 and S1004. It is displayed on the display unit 108 in the matched orientation. As a result, for example, if R = 1, the user who browses the display device 100 while lying down can easily see the display target after switching while lying down even when the display target is switched. be able to.

In S1024, the control unit 101 determines whether or not there is an instruction to end the display process of FIG. The instructions for terminating the display process of FIG. 10 include turning off the power of the display device 100, shutting down (terminating) the software for executing the display process, and turning off the auto display (automatically display unit 108 if no operation continues for a predetermined time). Processing to end and turn off the display of), etc. are included. Further, auto power off (a process of automatically turning off the power of the display device 100 when no operation continues for a predetermined time) and the like are included. As a result, if the user changes the change flag R so that the display target can be easily seen while lying down, and then stands up and takes a different posture from the lying down state, the display of the display unit 108 is temporarily terminated. You can reset the change flag just by restarting from. That is, the change flag R can be reset without confusion by restarting the display device 100 or restarting the software that performs the display process.

If there is no instruction to end the display process of FIG. 10 in S1024, the process returns to S1005 and the process is repeated to continue the display based on the change flag R. When instructed in S1024 to end the display process of FIG. 10, the process is terminated. After that, when the image display process is restarted again, the change flag is reset and the display control is performed with the normal posture as the reference posture.

12 (a) to 12 (f) are display examples when the above-mentioned display processing is performed.
FIG. 12A is a display example of the image 1201 when the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 1, and is the first column of the row 1102 in FIG. This is the same display example as the display example (image rotation angle 90 degrees). Since the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 1, the image 1201 is rotated 90 degrees clockwise with respect to the display unit 108 by the above-mentioned processing of S1004. It is displayed in the orientation.

FIG. 12 (c) is a display example in which the posture of the display device 100 is changed from the state of FIG. 12 (a) to the posture 2 through the state of FIG. 12 (b). This is the same display example as the display example of the column (image rotation angle 0 degree). Since the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 2, the image 1201 is displayed in a direction that does not rotate with respect to the display unit 108 by the process of S1004 described above. There is. That is, in FIG. 12 (c), the image 1201 is displayed in a display direction rotated 90 degrees counterclockwise from the display direction in FIG. 12 (a).

FIG. 12D is a display example of the image 1202 when the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 1. Since the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 1, the image 1202 is rotated 90 degrees clockwise with respect to the display unit 108 by the above-mentioned processing of S1004. It is displayed in the orientation. When an instruction to change the display target is given from the display state of FIG. 12A, the result is Yes in S1023 described above, and the display is displayed in S1004 in a direction rotated 90 degrees clockwise with respect to the display unit 108. That is, both the image 1201 of FIG. 12A before switching the display target and the image 1202 of FIG. 12B after switching the display target are displayed in the same direction rotated 90 degrees clockwise.

FIG. 12 (f) is a display example in which the posture of the display device 100 is changed to the posture 2 from the state of FIG. 12 (d) through the state of FIG. 12 (e). Since the reference posture is the posture 2 (R = 1) and the display device 100 is the posture 2, the image 1202 is displayed in a direction that does not rotate with respect to the display unit 108 by the above-mentioned processing of S1004. .. That is, in FIG. 12 (f), the image 1202 is displayed in a display direction rotated 90 degrees counterclockwise from the display direction in FIG. 12 (d). Further, even when an instruction to change the display target to the image 1202 is given from the display state of FIG. 12 (c), the display state of FIG. 12 (f) is obtained. That is, according to the instruction to change the display target, Yes is set in S1023 described above, and in S1004, the display unit 108 is displayed in a non-rotating direction. That is, both the image 1201 of FIG. 12 (c) before the display target is switched and the image 1202 of FIG. 12 (f) after the display target is switched are displayed in the same non-rotating direction with respect to the display unit 108. ..

According to the above-mentioned display processing, as shown in the first column of the row 1101 of FIG. 11, when the reference posture is the normal posture and the display device 100 is the posture 1, the image is displayed on the display unit 108. Display without rotating. When it is detected that the display state is changed to the posture 2 without being touched (specific operation) from the display state shown in the first column of the row 1101 of FIG. 11, it is as shown in the second column of the row 1101 of FIG. In addition, the image is automatically rotated and displayed in the direction rotated by 270 degrees (90 degrees counterclockwise).
On the other hand, even if it is detected that the display state shown in the first column of the row 1101 of FIG. 11 has changed from the posture 1 to the posture 2 with the operation of rotating the display device 100 while touching the row 1101, the row of FIG. As shown in the second column of 1102, the display orientation of the image is not changed from 0 degrees. At this time, the reference posture R is changed from 0 to 1. When it is detected that the posture 2 has changed to the posture 1 without being touched from the state shown in the second column of the row 1102 of FIG. 11, as shown in the first column of the row 1102 of FIG. , The image is automatically rotated and displayed in the direction rotated 90 degrees clockwise. The display orientation of the image in the first column of row 1102 in FIG. 11 is 180 degrees different from the display orientation of the image shown in the second column of row 1101 in FIG.

In the process of FIG. 10, an example of resetting the change flag at the start of the display process has been described, but the present invention is not limited to this. The reference posture may be reset (R = 0, the reference posture is set to the normal posture) by accepting an operation from the user for resetting the reference posture without restarting the display process. For example, it should be reset when a triple tap on the touch panel (an operation of repeating touchdown and touchup three times within a predetermined time) or a gesture operation such as drawing a predetermined trajectory such as a circle is received on the touch panel. You can do it. Further, a reset icon (display item) for accepting the reset of the reference posture may be displayed, and the reset may be performed when there is a touch operation on the reset icon. Further, the display device 100 is reset by a strong shaking operation twice or more (a multiple shaking operation) or an operation of continuously switching the vertical and horizontal orientations of the display device 100 twice or more within a short time (multiple switching operation). You can do it. For example, when the acceleration sensor included in the sensor 103 continuously detects a set of accelerations consisting of positive accelerations and negative accelerations whose absolute values are equal to or greater than a predetermined value twice within a predetermined time. The control unit 101 determines that the operation of shaking strongly twice has been performed. Further, for example, in the sensor 103, the posture of the display device 100 changes from the vertical posture to the horizontal posture (the first change in the vertical and horizontal orientation), and changes from the horizontal posture to the vertical posture (the second change in the vertical and horizontal orientation). If it is detected within a predetermined time, the control unit 101 determines that the operation of switching the vertical and horizontal directions of the display device 100 twice in succession within a short time has been performed.
Further, in the above-mentioned example, an example of changing the setting of the reference posture (changing the change flag R) by performing a specific operation of changing the posture of the display device 100 while the touch panel 109 is touched on has been described. However, it is not limited to this. The reference posture may be changed by operating the setting item for switching the reference posture displayed on the setting menu screen. Alternatively, the touch panel 109 may be switched by tapping the icon for switching the reference posture displayed on the drawer displayed by the touch move operation from the peripheral portion to the central portion. Further, when a change in the vertical and horizontal orientations of the display device 100 is detected, a display target such as an image is rotated and displayed, and an icon for switching the reference posture is displayed and displayed for a predetermined time within a predetermined time. It may be switched when there is a tap operation on the icon.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these specific embodiments, and various embodiments within the scope of the gist of the present invention are also included in the present invention. Further, each of the above-described embodiments is merely an embodiment of the present invention, and each embodiment can be combined as appropriate.

In each of the above-described embodiments, the control unit 101 has described the case where the display device 100 detects the upward and downward directions and the vertical and horizontal postures of the display device 100 via one sensor 103. However, the present invention is not limited to this case, and the upward and downward and vertical / horizontal postures may be detected via separate sensors.
In each of the above-described embodiments, the case where the upward and downward detection is detected via the sensor output as a continuous value has been described, but in the Z-axis direction, it is sufficient if the threshold value zth can be determined, and the binary value is determined. Such members (means) may be used.
In each of the above-described embodiments, the case where the power switch 102, the operation switch 105, and the like are arranged at predetermined positions has been described, but the present invention is not limited to this case. That is, the power switch 102, the operation switch 105, and the like may be at any position of the display device 100, and may be, for example, a switch displayed on the display unit 108 and operated via the touch panel 109.

In each of the above-described embodiments, the case where the display device 100 is applied to the mobile phone terminal has been described, but the present invention is not limited to this case, and any device that controls the display of the display unit 108 can be applied. That is, the present invention can be applied to an image pickup device such as a digital camera, a tablet terminal, a PDA, a portable image viewer, a digital photo frame, a music player, a game machine, an electronic book reader, etc., which can control the display of the display unit 108. Is.
In each of the above-described embodiments, the case of a still image has been described, but even a moving image can be processed in the same manner.

In each of the above-described embodiments, when the control unit 101 detects touchdown or touch-on via the touch panel 109, the control unit 101 displays a guide display indicating that the display orientation of the image with respect to the display device 100 can be maintained by rotating while touching. It may be displayed on 108. The control unit 101 may be controlled by one hardware, or the entire device may be controlled by sharing the processing among a plurality of hardware.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100: Display device (display control device) 101: Control unit 102: Power switch 103: Sensor 104: Image display button 105: Operation switch 106: Memory 107: Recording medium 108: Display unit 109: Touch panel

Claims (5)

Display means and
A receiving means for receiving a switching instruction for switching the display target to be displayed on the display means from the first display target to the second display target, and
Posture detection means for detecting the posture of the display control device,
A control means for controlling the orientation of a display target displayed on the display means so as to change according to the posture detected by the posture detection means.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and when the switching instruction is received in that state, the second display means is received. Is controlled so as to be displayed on the display means in the first direction.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and the display control device is in a state where no specific operation is performed. However, when the posture changes from the first posture to the second posture which is 90 degrees different from the first posture, the first display target is displayed in the second direction which is 90 degrees different from the first direction. When the switching instruction is received in that state, the second display target is controlled to be displayed in the second direction.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and the display control device is in a state where a specific operation is performed. When the first posture is changed to the second posture, the display direction of the first display target is not changed from the first direction, and when the switching instruction is received in that state, the second position is received. When the display target is controlled to be displayed in the first orientation, and then the display control device changes from the second posture to the first posture in a state where no specific operation is performed. A display control device comprising: a control means for controlling the second display object to be displayed in a third direction which is 90 degrees different from the first direction and 180 degrees different from the second direction. .. The display means is a touch panel.
The display control device according to claim 1, wherein the specific operation is a touch operation on the display means. A control method for a display control device having a display means.
A reception step for receiving a switching instruction for switching the display target to be displayed on the display means from the first display target to the second display target, and
A posture detection step for detecting the posture of the display control device, and
A control step for controlling the orientation of the display target displayed on the display means so as to change the orientation according to the posture detected in the posture detection step.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and when the switching instruction is received in that state, the second display means is received. Is controlled so as to be displayed on the display means in the first direction.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and the display control device is in a state where no specific operation is performed. However, when the posture changes from the first posture to the second posture which is 90 degrees different from the first posture, the first display target is displayed in the second direction which is 90 degrees different from the first direction. When the switching instruction is received in that state, the second display target is controlled to be displayed in the second direction.
When the display control device is in the first posture, the first display target is displayed on the display means in the first direction with respect to the display means, and the display control device is in a state where a specific operation is performed. When the first posture is changed to the second posture, the display direction of the first display target is not changed from the first direction, and when the switching instruction is received in that state, the second position is received. When the display target is controlled to be displayed in the first orientation, and then the display control device changes from the second posture to the first posture in a state where no specific operation is performed. A display control device comprising a control step for controlling the second display object to be displayed in a third direction which is 90 degrees different from the first direction and 180 degrees different from the second direction. Control method. A program for operating a computer as each means of the display control device according to claim 1 or 2. A computer-readable storage medium that stores a program for causing the computer to function as each means of the display control device according to claim 1 or 2.