JP7801033B2 - Image display program, image display device, image display method, and recording medium - Google Patents

Description

This disclosure relates to an image display program, an image display device, an image display method, and a recording medium.

A spherical image capturing system is known that can display an entire celestial sphere (the entire celestial sphere) on a display device such as a monitor by combining images captured by multiple wide-angle cameras. For example, Patent Document 1 discloses a spherical image capturing system that includes an imaging means, an image combining unit that creates spherical frame data, an attitude detection means that detects attitude information of the imaging means, a correction amount calculation unit that creates correction amount data that converts the coordinates of the spherical frame data based on the attitude information, and an association means that associates the spherical frame data with the correction amount data to obtain a spherical image, wherein the correction amount calculation unit creates correction amount data that corrects tilt of the spherical frame data with respect to the vertical direction in global coordinates and corrects shaking within the horizontal plane in global coordinates by excluding minute shaking components.

Japanese Patent Application Laid-Open No. 2020-061770

The spherical imaging system described in Patent Document 1 captures images of a specified space and generates a group of images, making it possible to refer to the captured space in a virtual space. However, in this case, the direction of the captured space and the reference angle indicating the center of each image in the group of captured images differ for each image. Furthermore, when switching the displayed images to simulate movement within the virtual space, there is a problem in that the direction of the displayed space may change each time the image is switched.

The present disclosure therefore aims to provide an image display program, image display device, image display method, and recording medium that enable virtual movement while maintaining the previous viewpoint direction.

In order to achieve the above object, the image display program of the present disclosure includes:
An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change.
An image display program for causing a computer to execute each of the above procedures.

The image display device of the present disclosure includes:
an image display unit, an operation information acquisition unit, and a display control unit;
the image display unit displays an area image cut out from an image of a target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition unit acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
The display control unit changes the image to be displayed based on the selection of the link information, and controls the angle at which an area image is cut out from the changed image based on the offset information of the images before and after the change.

The image display method of the present disclosure includes:
The method includes an image display step, an operation information acquisition step, and a display control step,
The image display step displays an area image cut out from an image of the target area,
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change.
The image display method is one in which each of the steps is executed by a computer.

The recording medium of the present disclosure includes:
An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the images before and after the change.
A computer-readable recording medium stores an image display program for causing a computer to execute each of the above procedures.

This disclosure makes it possible to perform virtual movement while maintaining the previous viewpoint direction.

FIG. 1 is a block diagram showing a configuration of an example of an image display device according to the present disclosure. FIG. 2 is a block diagram showing an example of a hardware configuration of the image display device of the present disclosure. FIG. 3 is a flowchart showing an example of processing in the image display device of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments. In the following drawings, the same parts are denoted by the same reference numerals. Furthermore, the descriptions of the embodiments can be mutually incorporated unless otherwise specified, and the configurations of the embodiments can be combined unless otherwise specified.
It can be obtained.

[Embodiment 1]
The image display program of the present disclosure is a program for causing a computer to execute an image display procedure, an operation information acquisition procedure, and a display control procedure. The image display program of the present disclosure can also be said to be a program for causing a computer to function as the image display procedure, the operation information acquisition procedure, and the display control procedure. Furthermore, the image display program of the present disclosure can also be said to be a program for causing a computer to execute, for example, each step of an image display method described below.

The image display step displays an area image cut out from an image captured of the target area, the image captured of the target area is associated with offset information, the offset information is information that associates a reference angle of the display angle in the image with the direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires user operation information for the area image, the operation information includes selection of the link information, and the display control step changes the image to be displayed based on the selection of the link information and controls the angle at which the area image is cut out from the changed image based on the offset information of the images before and after the change.

For example, the "procedure" in each of the steps can be read as "processing." The image display program of the present disclosure may be recorded on a computer-readable recording medium, for example. The recording medium may be, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples include random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., SSD (Solid State Drive), USB flash memory, SD/SDHC card, etc.), optical disk (e.g., CD-R/CD-RW, DVD-R/DVD-RW, BD-R/BD-RE, etc.), magneto-optical disk (MO), floppy disk (FD), etc. The image display program of the present disclosure (also referred to as a programming product or program product) may be distributed from an external computer, for example. The "distribution" may be, for example, distribution via a communications network or via a device connected via a wire. The image display program of the present disclosure may be installed and executed on the device to which it is distributed, or it may be executed without being installed. An information processing device capable of executing the image display program of the present disclosure may be referred to as, for example, the image display device of the present disclosure.

Next, the configuration of an example of an image display device according to the present disclosure will be described using FIG. 1. FIG. 1 is a block diagram showing the configuration of an example of an image display device 10 according to this embodiment (hereinafter also referred to as "the device"). As shown in FIG. 1, the device 10 includes an image display unit 11, an operation information acquisition unit 12, and a display control unit 13. Although not shown, the device 10 may also include, for example, an input unit, an output unit, a display unit, and/or a storage unit. The image display unit 11, the operation information acquisition unit 12, and the display control unit 13 are each capable of executing, for example, an image display procedure, an operation information acquisition procedure, and a display control procedure in the image display program according to the present disclosure.

The device 10 may be, for example, a single device including each of the above-mentioned components, or a device in which each of the above-mentioned components can be connected via a communication network. Furthermore, the device 10 can be connected to an external device (described later) via the communication network. The communication network is not particularly limited and any known network can be used, and may be wired or wireless, for example. Examples of the communication network include the Internet, WWW (World Wide Web), telephone lines, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Tolerant Networking), LPWA (Low Power Wide Area), and L5G (Local 5G). Examples of wireless communication include Wi-Fi (registered trademark), Bluetooth (registered trademark), local 5G, and LPWA. The wireless communication may be in the form of direct communication between devices (ad hoc communication), infrastructure communication, or indirect communication via an access point. The device 10 may be incorporated into a server as a system. The device 10 may also be, for example, a personal computer (PC, e.g., desktop or laptop) with the program of the present disclosure installed, a smartphone, or a tablet terminal. The device 10 may also be in the form of cloud computing or edge computing, in which at least one of the components is located on a server and the other components are located on a terminal.

Figure 2 shows an example block diagram of the hardware configuration of the device 10. The device 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, memory 102, bus 103, storage device 104, input device 105, output device 106, and communication device 107. Each part of the device 10 is connected to each other via the bus 103 and their respective interfaces (I/F).

The central processing unit 101 operates in cooperation with other components via controllers (system controller, I/O controller, etc.) and is responsible for overall control of the device 10. In the device 10, the central processing unit 101 executes, for example, the program disclosed herein and other programs, and also reads and writes various types of information. Specifically, the central processing unit 101 functions as, for example, an image display unit 11, an operation information acquisition unit 12, and a display control unit 13. The device 10 may also include other computing devices such as a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), or a combination of these as its computing devices.

The bus 103 can also be connected to, for example, external devices. Examples of such external devices include a user terminal, an external storage device (such as an external database), a printer, an external input device, an external display device, and an external imaging device. The device 10 can be connected to an external network (the communication line network) via, for example, a communication device 107 connected to the bus 103, and can also be connected to other devices via the external network.

The memory 102 may be, for example, a main memory (primary storage device). When the central processing unit 101 performs processing, the memory 102 reads various operating programs, such as the program of the present disclosure, stored in the storage device 104 (described below), and the central processing unit 101 receives data from the memory 102 and executes the program. The main memory may be, for example, a RAM (random access memory). The memory 102 may also be, for example, a ROM (read-only memory).

The storage device 104 is also referred to as an auxiliary storage device, in contrast to the main memory (primary storage device). As mentioned above, the storage device 104 stores operating programs, including the program of the present disclosure. The storage device 104 may be, for example, a combination of a recording medium and a drive that reads and writes from and to the recording medium. The recording medium is not particularly limited and may be, for example, an internal or external type, such as a hard disk drive (HDD), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, or memory card. The storage device 104 may be, for example, a hard disk drive (HDD) or solid state drive (SSD) that integrates the recording medium and drive.

In the device 10, the memory 102 and storage device 104 can also store various information such as log information, information obtained from an external database (not shown) or an external device, information generated by the device 10, and information used by the device 10 when executing processing. In this case, the memory 102 and storage device 104 may store, for example, the aforementioned information about users of the device. Note that at least some of the information may be stored, for example, on an external server other than the memory 102 and storage device 104, or may be stored in a distributed manner across multiple terminals using blockchain technology or the like. Furthermore, if the device 10 includes the storage unit, for example, the memory 102 and storage device 104 function as the storage unit.

The device 10 further includes, for example, an input device 105 and an output device 106. Examples of the input device 105 include pointing devices such as a touch panel, track pad, or mouse; a keyboard; imaging means such as a camera or scanner; card readers such as IC card readers or magnetic card readers; and audio input means such as a microphone. Examples of the output device 106 include display devices such as LED displays or LCD displays; audio output devices such as speakers; and a printer. In this embodiment 1, the input device 105 and the output device 106 are configured separately, but they may also be configured as an integrated device, such as a touch panel display.

An example of processing by the image display program of the present disclosure will be described in more detail using Figure 3. Figure 3 is a flowchart showing an example of each procedure of the image display program of the present disclosure. The image display program of the present disclosure is implemented, for example, as follows using the device 10 of Figure 1 or Figure 2 on which the image display program of the present disclosure is installed. Note that implementation of the image display program of this embodiment is not limited to use with the device 10 of Figure 1 or Figure 2.

First, prior to processing by the device 10, an image of the target area is captured with a camera to create a group of multiple images of the target area. The target area may be, for example, an area for three-dimensional reconstruction, and may be indoors or outdoors. The images may be, for example, images captured within the target area, and may be videos or still images. The images may be, for example, wide-angle images. The wide-angle images may be, for example, panoramic images or spherical images. The panoramic images or spherical images may be captured by capturing the target area with, for example, a wide-angle camera equipped with a fisheye lens or a wide-angle lens, or a spherical camera (also called a 360° camera). The captured images may be recorded in the memory unit of the device 10 or on another recording medium. Furthermore, at this time, identification information for the target area may be associated with the group of images of the target area and recorded.

Next, offset information is obtained for each image. The obtained offset information is, for example, linked to each image and recorded. The offset information is information that associates the reference angle of the display angle in the image with the direction of the target area. The reference angle is, for example, an angle in a spherical coordinate system that indicates the center point of the image. The reference angle is, for example, an angle at which both the pitch angle indicating the vertical direction of the image and the yaw angle indicating the horizontal direction are 0 degrees. The reference angle is, for example, defined by the attitude of the camera when each image was captured. The reference angle means, for example, the front direction of the camera at the time of capture. The direction of the target area may be, for example, a direction (north, south, east, west) or may be expressed as an angle (azimuth angle). In the latter case, for example, the reference angle (azimuth angle: 0 degrees) is not particularly limited, and any direction can be specified. As a specific example, if the north direction of the target area is set as the reference direction of the target area, the direction of the target area can be defined as north being 0 degrees, east being 90 degrees, south being 180 degrees, and west being 270 degrees. Note that the correspondence between each direction and azimuth angle is not limited to this, and any direction can be designated as the reference azimuth angle (0 degrees). Then, for each image, offset information for each image can be obtained by obtaining, for example, the reference angle and the angle indicating the direction of the target area (azimuth angle).

Next, for each group of images, link information for transitioning to other images is embedded. The link information is information for transitioning to other images, and can be a link to the other image, such as a URL (Uniform Resource Locator). For each image, the link information can be in any format. As a specific example, if an image includes a location where another image was captured, the link information can be embedded in the area of that location. Furthermore, an icon indicating the embedding of link information can be displayed in the pixel area where the link information is embedded. This allows the user to transition to another image specified by the link information, for example, by selecting an icon in the displayed image. Note that the method of displaying the link information is not limited to this; for example, a window displaying image transition links can be displayed separately from the image currently being displayed.

The image display unit 11 displays an area image cut out from an image of the target area (S11, image display procedure). The image display unit 11 can display the area image by, for example, cutting out the image at a predetermined angle of view based on a preset display viewing angle. The image display unit 11 may, for example, display the area image on the output device (display) 106 of the device 10, or may display the area image outside the device 10 (for example, on a user terminal). In the latter case, the image display unit 11 can display the area image on the user terminal by, for example, transmitting the area image to the user terminal. The image of the target area is associated with offset information. The offset information is, for example, as described above. The image includes link information for transitioning to another image. The link information is, for example, as described above.

The operation information acquisition unit 12 acquires user operation information for the area image (S12, operation information acquisition procedure). The operation information includes the selection of the link information. The operation information acquisition unit 12 can acquire, for example, information indicating that the user has selected (clicked, tapped, etc.) the link information in the area image as the operation information. The operation information acquisition unit 12 may also acquire operation information including, for example, a user's viewpoint operation. Examples of the viewpoint operation include slide information of a pointing device on the area image (e.g., a mouse drag operation or a touch panel swipe operation). The viewpoint operation information includes, for example, the user's selection start (click or tap start) position in the area image, the movement distance (drag or swipe distance), and the selection end (click or tap end) position. The operation information acquisition unit 12 may also acquire, for example, other operation information. Examples of the other operation information include, but are not limited to, a double-click of a mouse, a double-tap on a touch panel, pinching in or out, keyboard input, etc.

The display control unit 13 changes the image to be displayed based on the selection of the link information, and controls the angle at which the area image is cut out from the changed image based on the offset information of the images before and after the change (S13, display control procedure). The display control unit 13 determines the direction of the target area displayed by the area image, for example, based on the offset information of the image before the change and the cutout angle of the area image in the image before the change. Then, the display control unit 13 controls the cutout angle of the area image in the changed image, for example, based on the direction of the target area and the offset information of the image after the change.

The processing of the display control unit 13 will be described using a specific example. For example, assume that in the offset information for the pre-change image, the direction of the target area associated with a reference angle of 0 degrees is north (azimuth angle 0 degrees), and in the offset information for the post-change image, the direction of the target area associated with a reference angle of 0 degrees is east (azimuth angle 90 degrees). In this case, the display control unit 13, for example, first calculates the azimuth angle of the displayed area image from the angle of view of the displayed area image in the pre-change image and the offset information for the pre-change image. Next, the display control unit 13 determines the cropping angle of the post-change image corresponding to the calculated azimuth angle, for example, from the calculated azimuth angle and the offset information for the post-change image, and controls the display so that the post-change image is cropped at the determined cropping angle and displayed as a new area image.

The display control unit 13 may also extract features from the pre-altered image and the post-altered image, estimate the imaging position and camera imaging orientation in the target area for each image based on the features, and estimate the offset information based on the imaging position and camera imaging orientation in the target area. When the display control unit 13 estimates the offset information, it can estimate the imaging position and camera imaging orientation in the target area using techniques such as SfM (Structure from Motion) and VSLAM (Visual simultaneous localization and mapping).

The display control unit 13 may, for example, change the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image. In this case, the display control unit 13 may change the display angle of the area image in the same manner as, for example, well-known spherical image viewer software. Furthermore, if the display control unit 13 has acquired other operation information in S12, for example, it may execute corresponding display control (e.g., zoom in/out) processing.

The image display method of the present disclosure is a method implemented, for example, by replacing each "procedure" in the image display program of the present disclosure with a "step." The image display method of the present disclosure can be implemented, for example, using the image display device 10 of the present disclosure shown in FIG. 1 or FIG. 2. Note that the image display method of the present disclosure is not limited to methods that use the image display device 10, for example. The image display method of the present disclosure can incorporate, for example, the descriptions of the image display program and image display device of the present disclosure.

When an area image is cut out from an image for a user to view, that area image, i.e., the viewpoint direction from which the user is viewing, can be expressed as a difference from the reference angle of the image. However, when the target area is photographed from multiple locations, the correspondence between the reference angle of each image (the center of the image, the front direction of the camera) and the orientation of the target area differs for each image. Therefore, when switching images, if an image is cut out using a difference from the same reference angle, an image cut out in a different direction from the orientation of the target area displayed in the image before switching will be obtained. In response to this, the image display program disclosed herein includes an image display procedure, an operation information acquisition procedure, and a display control procedure. The image display step displays an area image cut out from an image captured of a target area, the image captured of the target area being associated with offset information, the offset information correlating a reference angle for display in the image with the direction of the target area, the image including link information for transitioning to another image, the operation information acquisition step acquiring user operation information for the area image, the operation information including selection of the link information, and the display control step changing the image to be displayed based on the selection of the link information and controlling the angle at which the area image is cut out from the changed image based on the offset information of the images before and after the change. Therefore, the image display program disclosed herein enables virtual movement while maintaining the previous viewpoint direction using multiple images captured with different camera front directions.

The present disclosure has been described above with reference to the embodiments, but the present disclosure is not limited to the above embodiments. Various modifications that would be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

<Additional Notes>
Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.
(Appendix 1)
An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the images before and after the change.
An image display program for causing a computer to execute each of the above procedures.
(Appendix 2)
The display control procedure includes:
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
2. The image display program according to claim 1, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image.
(Appendix 3)
The display control procedure includes:
extracting features from the pre-altered image and the post-altered image;
For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount;
3. The image display program according to claim 1, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.
(Appendix 4)
the operation information acquisition step acquires operation information including a viewpoint operation of a user;
4. The image display program according to claim 1, wherein the display control procedure changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image.
(Appendix 5)
an image display unit, an operation information acquisition unit, and a display control unit;
the image display unit displays an area image cut out from an image of a target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition unit acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
The display control unit changes the image to be displayed based on the selection of the link information, and controls the angle at which an area image is cut out from the changed image based on the offset information of the images before and after the change.
(Appendix 6)
The display control unit
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
6. The image display device according to claim 5, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image.
(Appendix 7)
The display control unit
extracting features from the pre-altered image and the post-altered image;
For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount;
7. The image display device according to claim 5, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.
(Appendix 8)
the operation information acquisition unit acquires operation information including a viewpoint operation by a user;
The image display device according to any one of appendices 5 to 7, wherein the display control unit changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image.
(Appendix 9)
The method includes an image display step, an operation information acquisition step, and a display control step,
The image display step displays an area image cut out from an image of the target area,
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change.
An image display method in which each of the steps is executed by a computer.
(Appendix 10)
The display control step includes:
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
An image display method according to claim 9, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image.
(Appendix 11)
The display control step includes:
extracting features from the pre-altered image and the post-altered image;
For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount;
11. The image display method according to claim 9, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.
(Appendix 12)
the operation information acquisition step acquires operation information including a viewpoint operation of a user;
12. The image display method according to any one of claims 9 to 11, wherein the display control step changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image.
(Appendix 13)
An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
The image of the target area is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image,
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the images before and after the change.
A computer-readable recording medium that records an image display program for causing a computer to execute each of the above procedures.
(Appendix 14)
The display control procedure includes:
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
14. The recording medium according to claim 13, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image.
(Appendix 15)
The display control procedure includes:
extracting features from the pre-altered image and the post-altered image;
For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount;
15. The recording medium according to claim 13, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.
(Appendix 16)
the operation information acquisition step acquires operation information including a viewpoint operation of a user;
16. The recording medium according to any one of appendices 13 to 15, wherein the display control procedure changes a crop angle of the image being displayed based on the viewpoint operation, thereby changing a display angle of the area image.

This disclosure enables virtual movement while maintaining the previous viewpoint direction. Therefore, this disclosure is expected to be used in a variety of fields, such as creating images for building interior tours and creating promotional images for parks, event venues, etc.

10 Image display device 11 Image display unit 12 Operation information acquisition unit 13 Display control unit 101 Central processing unit 102 Memory 103 Bus 104 Storage device 105 Input device 106 Output device 107 Communication device

Claims (10)

An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired;
Each image captured of the target area included in the image group is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image included in the image group ;
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
The display control step changes an image to be displayed based on the selection of the link information from an image included in the image group , and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change.
An image display program for causing a computer to execute each of the above procedures. The display control procedure includes:
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
2. The image display program according to claim 1, further comprising: controlling an angle at which the new area image is cut out in the changed image based on the direction of the target area and the offset information of the changed image. The display control procedure includes:
extracting features from the pre-altered image and the post-altered image;
For each image included in the image group , an imaging position and an imaging attitude of a camera in the target area are estimated based on the feature amount;
3. The image display program according to claim 1, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. the operation information acquisition step acquires operation information including a viewpoint operation of a user;
3. The image display program according to claim 1, wherein the display control step changes a display angle of the area image by changing a cutout angle of the image being displayed based on the viewpoint operation. an image display unit, an operation information acquisition unit, and a display control unit;
the image display unit displays an area image cut out from an image of a target area;
the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired;
Each image captured of the target area included in the image group is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image included in the image group ;
the operation information acquisition unit acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
The display control unit changes the image to be displayed based on the selection of the link information from the images included in the image group , and controls the angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change. The display control unit
specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change;
The image display device according to claim 5 , wherein the angle at which the new area image is cut out in the changed image is controlled based on the direction of the target area and the offset information of the changed image. The display control unit
extracting features from the pre-altered image and the post-altered image;
For each image included in the image group , an imaging position and an imaging attitude of a camera in the target area are estimated based on the feature amount;
7. The image display device according to claim 5, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. the operation information acquisition unit acquires operation information including a viewpoint operation by a user;
7. The image display device according to claim 5, wherein the display control unit changes a display angle of the area image by changing a cutout angle of the image being displayed based on the viewpoint operation. The method includes an image display step, an operation information acquisition step, and a display control step,
The image display step displays an area image cut out from an image of the target area,
the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired;
Each image captured of the target area included in the image group is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image included in the image group ;
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
the display control step changes an image to be displayed based on the selection of the link information from the images included in the image group , and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change.
An image display method in which each of the steps is executed by a computer. An image display procedure, an operation information acquisition procedure, and a display control procedure are included.
the image display step displays an area image cut out from an image captured of the target area;
the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired;
Each image captured of the target area included in the image group is associated with offset information,
the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area,
the image includes link information for transitioning to another image included in the image group ;
the operation information acquisition step acquires information about a user's operation on the area image;
the operation information includes selection of the link information,
The display control step changes an image to be displayed based on the selection of the link information from an image included in the image group , and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change.
A computer-readable recording medium that records an image display program for causing a computer to execute each of the above procedures.