JP7728545B2 - Terminal device, display method, computer program, and information provision system - Google Patents

Description

This disclosure relates to a terminal device, a display method, a computer program, and an information provision system.

Patent Document 1 discloses technology for displaying golf course information on a terminal device.

JP 2020-18439 A

However, with the technology in Patent Document 1, it is difficult to clearly display the slope conditions (undulations) of a golf course to the user.

A terminal device according to one aspect of the present disclosure (the terminal device) has an imaging unit that captures an image of the ground of a golf course to generate a ground image, and a control unit that acquires the slope of the ground based on the ground image and superimposes the ground image and a slope symbol indicating the slope of the ground on a display screen.

This terminal device is carried by users at golf courses. The control unit of this terminal device displays on the display screen a ground image, which is an image of the ground (e.g., the green) of the golf course, along with a slope symbol indicating the slope (undulations) of the ground. This allows users of this terminal device to clearly understand the undulations of the ground at the golf course.

This makes it easier for users of this terminal device to predict the direction in which a golf ball will roll when hit on the golf course, enabling them to make a good next hit (putt or shot).

Here, the slope symbol may include an arrow indicating the direction of the slope. The slope symbol may also include a symbol indicating that the ground is substantially flat.

In addition, in this terminal device, the control unit may be configured to divide the ground image into predetermined small areas, obtain the slope status for each small area, and superimpose the slope symbol for each small area on the ground image.

In this case, the terminal device may further include an input unit that accepts user instructions, and the control unit may be configured to change at least one of the size and the number of the small regions based on the user instructions via the input unit.
This allows the user of this terminal device to adjust the size and number of small areas so that the slope of the ground of the golf course can be easily grasped.

In this case, the control unit may also form an AR space including the ground image, set a plurality of panel sections in the AR space centered on a reference point, set the height of the center of each panel section in the AR space to a position higher than the reference point by a first predetermined value, obtain ground coordinates that are the three-dimensional coordinates of a portion of the ground image located below the center of each panel section, obtain panel coordinates that are coordinates higher by a second predetermined value than the ground coordinates corresponding to each panel section, form panels centered on the panel coordinates in the AR space, drop the panels toward the ground image to give the panels an inclination corresponding to the inclination of the ground image, and superimpose an inclination symbol corresponding to the inclination on the panels that have fallen on the ground image, and superimpose the inclination symbol for each of the small regions on the ground image.
This makes it possible to easily determine the slope of the ground.

In addition, in this terminal device, the control unit may be configured to superimpose a color corresponding to the height of the captured ground on the ground image. This allows the user of this terminal device to more clearly grasp the undulations (especially the elevation difference) of the golf course.

The terminal device may further include an input unit that accepts user instructions, and the control unit may be configured to display a virtual golf ball and a virtual cup on the ground image displayed on the display screen based on instructions from the user via the input unit.

This configuration is particularly effective when the ground image is an image of a green. This makes it easier for users of this terminal device to consider how to aim when hitting (putting) a virtual golf ball toward a virtual cup.

In this case, the control unit may also be configured to acquire the slope of the ground based on the ground image, generate advice information for helping the virtual golf ball land in the virtual cup, and superimpose this advice information on the ground image.

Furthermore, the control unit may be configured to display, as the advice information, a first arrow indicating the target position for hitting the virtual golf ball from above, a second arrow pointing from the virtual golf ball to the target position, and the distance from the virtual cup to the target position.

In this configuration, the user can learn information (e.g., the hitting direction of the golf ball (putting direction)) that is effective for putting the virtual golf ball into the virtual cup based on the advice information (e.g., the first arrow, the distance from the virtual cup to the target position, and the second arrow).

The terminal device may further include an input unit that accepts user instructions, and the control unit may be configured to superimpose a virtual golf ball and the movement trajectory of the virtual golf ball when hit on the ground image displayed on the display screen based on instructions from the user via the input unit.
This configuration is particularly effective when the ground image is a green image.
This allows the user to understand how the virtual golf ball will roll based on the movement trajectory when putting the virtual golf ball.

In addition, in this terminal device, the control unit may be configured to obtain the slope of the ground, the position of the golf ball, and the position of the cup based on the ground image, create advice information for the next shot, and display this advice information superimposed on the ground image. Note that the golf ball and cup may be real, or may be a virtual golf ball and a virtual cup.
This allows the user to perform actual hitting while referring to the displayed advice information.

A display method according to one aspect of the present disclosure (the present display method) is a display method implemented in the terminal device, that is, the display method includes capturing an image of the ground of a golf course to generate a ground image, acquiring a slope condition of the ground based on the ground image, and
and superimposing the ground image and a slope symbol indicating the slope of the ground on a display screen. This display method allows golf course users to clearly understand the undulations of the ground of the golf course.

Furthermore, a computer program according to one aspect of the present disclosure causes a computer to acquire the slope of the ground based on a ground image obtained by capturing an image of the ground of a golf course, and to superimpose the ground image and a slope symbol indicating the slope of the ground on a display screen.

This computer program enables a general-purpose user terminal to function as this terminal device. This allows users to use their own user terminal, such as a smartphone, as this terminal device instead of a dedicated terminal device.

An information provision system (the present system) according to one aspect of the present disclosure includes the terminal device and a management unit. The terminal device has a terminal communication unit for communicating with the management unit. The control unit is configured to transmit the ground image to the management unit via the terminal communication unit and receive information transmitted from the management unit. The management unit has a management communication unit for communicating with the terminal device and a management control unit that receives the ground image via the management communication unit, obtains the slope of the ground based on the ground image, recognizes the position of the golf ball and the position of the cup in the ground image, generates advice information for the next shot, and transmits this advice information to the terminal device via the management communication unit. In this configuration, the golf ball and cup may be real, or may be a virtual golf ball and virtual cup set by the terminal device. The advice information may also be information for putting the virtual golf ball into the virtual cup.

The management unit of this system functions as a device that generates advice information and transmits it to this terminal device. The management unit is capable of communicating with this terminal device and is located, for example, at the golf course or on the cloud. In this system, the management unit generates advice information instead of the terminal device, which reduces the load on the terminal device.

According to one aspect of the present disclosure, a user can clearly grasp the undulations of the ground on a golf course. This makes it easier for the user to predict the direction in which a golf ball will roll when hit on the golf course, enabling the user to perform the next shot (such as a putt) successfully.

FIG. 2 is an explanatory diagram showing a golf course, a user terminal, and a management unit. FIG. 2 is a block diagram showing the configuration of a user terminal and a management unit. FIG. 10 is an explanatory diagram showing a touch panel displaying a ground image acquired by a camera. 10 is an explanatory diagram showing a touch panel on which a ground image and an inclination symbol indicating the inclination state of the ground are superimposed. FIG. 10 is an explanatory diagram showing the correspondence between ground height and color. 10 is an explanatory diagram showing a touch panel on which a ground image, a slope symbol indicating the slope of the ground, and a color according to the height of the ground are superimposed and displayed. FIG. 10 is an explanatory diagram showing a touch panel on which an image of the ground including a virtual golf ball and a virtual cup is displayed. FIG. FIG. 10 is an explanatory diagram showing a method for generating advice information. FIG. 10 is an explanatory diagram showing advice information. FIG. 10 is an explanatory diagram showing a putting simulation. FIG. 10 is an explanatory diagram showing a putting simulation. FIG. 10 is an explanatory diagram showing a touch panel on which a screen for setting the size and number of small areas corresponding to one tilt symbol is displayed. 13(a) and 13(b) are explanatory diagrams showing examples of the size of a small area corresponding to one tilt symbol. FIG. 2 is an explanatory diagram showing a touch panel on which a setting screen is displayed. FIG. 2 is an explanatory diagram showing a ground image. FIG. 2 is an explanatory diagram showing a panel section. FIG. 10 is an explanatory diagram showing a panel section that is higher than a reference point by a first predetermined value. FIG. 10 is an explanatory diagram showing a materialized panel. FIG. 10 is an explanatory diagram showing a panel that is inclined along the ground. FIG. 10 is an explanatory diagram showing a panel with inclined symbols.

As shown in FIG. 1, a golf course 1 according to one embodiment of the present disclosure has multiple holes, including hole 10, and users who are golfers carry user terminals 20. Furthermore, user terminals 20 are connected to a management unit 60 via a computer network N, such as the Internet or an intranet.

As shown in FIG. 1, the hole 10 includes, for example, a teeing ground 13, a fairway 14, rough 15 surrounding the fairway 14, a pond 16, a bunker 17, and a green 18.

In this embodiment, the user terminal 20 carried by a user at the golf course 1 is a smartphone owned by the user. As shown in FIG. 2, the user terminal 20 includes a terminal communication unit 21 for communicating with the management unit 60, a processor 23 for controlling each component of the user terminal 20, a memory 25 serving as a storage unit, and an input/output device 30 including a camera 31, etc.

The terminal communication unit 21 is configured to be able to send and receive various data to and from the management unit 60 via the computer network N.

The input/output device 30 includes, for example, a camera 31 for capturing still or video images, a touch panel 33 capable of displaying images, and a speaker 35 for providing audio displays to the user.

The camera 31 functions as an imaging unit that captures an image of the ground of the golf course 1 and generates a ground image. Here, the ground of the golf course 1 refers to, for example, the ground surfaces of the teeing ground 13, fairway 14, rough 15, bunker 17, and green 18. The ground image is an image of the ground of the golf course 1 obtained by the camera 31.
The touch panel 33 functions as a display screen for displaying images, and also functions as an input unit for receiving instructions from the user.

Memory 25 is a non-transitory, tangible recording medium such as RAM, flash memory, SSD, hard disk drive, or SD card. Memory 25 stores programs used in processing by processor 23, such as application programs AP downloaded via computer network N.

The processor 23 acquires various functions mainly in accordance with the application program AP (instructions included in the application program AP). For example, by reading the application program AP, the processor 23 acquires the function of a control unit that controls the operation of the user terminal 20 described below. For example, the processor 23 acquires the function of acquiring the ground slope (undulations) based on a ground image acquired by the camera 31 of the input/output device 30, and superimposing the ground image on a slope symbol indicating the ground slope.

Here, a display method according to this embodiment will be described as an example of the operation of the user terminal 20.
First, the user starts the application program AP on the user terminal 20 using the touch panel 33 of the input/output device 30. In response, the processor 23 reads the application program AP from the memory 25 and performs the function of the control unit described above.

The user then captures an image of the ground of the golf course 1 using the camera 31 of the input/output device 30. That is, the camera 31 captures an image of the ground of the golf course 1 based on the user's instructions and generates a ground image, which is an image of this ground. In the following, the camera 31 captures an image of the ground of the green 18 on the golf course 1 based on the user's instructions and obtains a ground image of the green 18 (a ground image of the ground including the grass on the green 18).

In response, the processor 23 displays a ground image of the green 18 captured by the camera 31 on the touch panel 33, as shown in Figure 3.

At this time, the arrow setting tab 101, caddy button 102, cup setting button 103, ball setting button 104, navigation button 106, hint button 107, reset button 108, and setting button 109 are displayed at the bottom of the touch panel 33.

When the user selects (touches) the ball setting button 104 on the left side and touches any part of the ground image displayed on the touch panel 33, the processor 23 displays a virtual golf ball 110 in the touched area, as shown in FIG. 4. Furthermore, the processor 23 acquires the slope (undulations) of the ground of the green 18, which is the captured ground, based on the ground image acquired by the camera 31, and displays the ground image and a slope symbol indicating the slope of the ground superimposed on the touch panel 33 of the user terminal 20 in augmented reality (AR). In other words, the processor 23 displays an AR space including the ground image and the slope symbol on the touch panel 33.

In the example shown in Figure 4, the slope symbols used are arrow symbol M1, which indicates the direction of the slope, and circle symbol M2. Arrow symbol M1 indicates the slope of the area marked with arrow symbol M1 by its direction, and indicates that the ground slopes downward in the direction indicated by the arrow. On the other hand, circle symbol M2 indicates that the area marked with circle symbol M2 is flat (having a small slope and being essentially flat).

In addition, in this display example, the processor 23 divides the ground image into specified small areas (panels), obtains the slope status for each small area, and superimposes a slope symbol for each small area on the ground image. In other words, the processor 23 divides the ground image into small areas corresponding to one slope symbol (arrow symbol M1 or circle symbol M2). The processor 23 then obtains the slope status (slope direction) for each small area and superimposes a slope symbol, either the arrow symbol M1 or the circle symbol M2, on the image of each small area.

If the ground image obtained by the camera 31 is a video, the processor 23 continuously acquires the ground slope status and superimposes the ground image and slope symbol on it at a predetermined rate.

The processor 23, which serves as the control unit, also superimposes a color corresponding to the height of the captured ground on the ground image displayed on the touch panel 33 along with the arrow symbol M1 and circle symbol M2. That is, the processor 23, for example, sets the height of the position of the virtual golf ball 110 to the zero height point (a point where the height is essentially zero; a point corresponding to plus or minus 2 cm). Then, as shown in FIG. 5, the processor 23 obtains the height of the ground in the ground image and divides the ground image into, for example, nine different color regions, each approximately spaced apart by plus or minus 5 cm. Note that in FIG. 5, the nine different colors are indicated by gray brightness and hatching.

Then, as shown in Figure 6, the processor 23 superimposes color areas corresponding to the height of the ground on the ground image. That is, the processor 23 displays the ground image by dividing it into nine color areas (meshes) (in the example of Figure 6, six color areas are displayed).

Furthermore, when the user selects the cup setting button 103 displayed on the touch panel 33 and touches any part of the ground image displayed on the touch panel 33, the processor 23 displays a virtual cup 112, which is a virtual cup (hole), and a virtual pin flag 113 representing the virtual cup 112, in the touched area, as shown in FIG. 7. In the example of FIG. 7, the virtual cup 112 and virtual pin flag 113 are displayed at positions corresponding to the real pin flag 51.

Furthermore, after displaying the virtual cup 112, the processor 23 displays the distance between the virtual golf ball 110 and the virtual cup 112 (4.1 m in the example of FIG. 7 ) superimposed on the ground image on the touch panel 33. In the example shown in FIG. 7 , this distance is displayed in the center of the touch panel 33.
When the user changes the position of either the virtual golf ball 110 or the virtual cup 112, the processor 23 sequentially calculates the distance corresponding to the virtual golf ball 110 and the virtual cup 112 after the change in position and displays them on the touch panel 33.

As described above, in this embodiment, the processor 23 of the user terminal 20 acquires the slope of the ground of the green 18 based on a ground image, which is an image of the ground of the green 18, which is the ground of the golf course 1, on the touch panel 33, and superimposes the ground image and slope symbols (arrow symbol M1 and circle symbol M2) indicating the slope of the ground of the green 18 on the touch panel 33 using AR. This allows the user of the user terminal 20 to clearly grasp the slope (undulation) of the green 18. This makes it easier for the user to predict in which direction a hit golf ball will roll on the green 18, allowing for better putting.

In addition, in this embodiment, the processor 23 superimposes a color corresponding to the height of the ground of the green 18 onto the ground image of the green 18 displayed on the touch panel 33 along with the arrow symbol M1 and the circle symbol M2. This allows the user of the user terminal 20 to more clearly grasp the undulations (particularly the elevation difference) of the green 18.

Furthermore, in this embodiment, the processor 23 is configured to display the virtual golf ball 110 and the virtual cup 112 on the ground image displayed on the touch panel 33 based on instructions from the user via the touch panel 33. This allows the user to easily consider how to aim the virtual golf ball 110 when putting toward the virtual cup 112.

The user may also display a virtual golf ball 110 and a virtual cup 112 in positions on the ground image that correspond to the actual golf ball and cup. This allows the user to easily grasp the slope of the green 18, which is useful when putting a real golf ball toward the cup.

The processor 23 is also configured to display the distance between the virtual golf ball 110 and the virtual cup 112 on the touch panel 33. This allows the user to consider in more detail how to aim the virtual golf ball 110 when putting towards the virtual cup 112.

In this embodiment, advice information regarding putting can also be displayed to the user on the touch panel 33.

Specifically, when the user selects the caddie button 102 displayed in the center of the bottom of the touch panel 33, the processor 23 generates and displays advice information (navigation information). The advice information is, for example, information for guiding the virtual golf ball 110 into the virtual cup 112. That is, in this embodiment, the processor 23 obtains the slope of the green 18 based on a ground image of the green 18, generates advice information, and displays this advice information superimposed on the ground image.

The generation and display of advice information will be described in more detail below. When the user presses the caddie button 102, the processor 23 generates a movement trajectory (rough prediction) 120 of the virtual golf ball 110 when the virtual golf ball 110 is hit straight toward the virtual cup 112 with a predetermined strength, as shown in FIG. 8.

At this time, the processor 23 generates the movement trajectory 120 of the virtual golf ball 110, taking into consideration, for example, the slope of the green 18, the weight, rolling resistance, elasticity, etc. of the virtual golf ball 110. Note that in order to generate the movement trajectory 120 of the virtual golf ball 110, the processor 23 may read existing software for generating the movement trajectory 120 from the memory 25.
In the example shown in FIG. 8, the movement trajectory 120 of the virtual golf ball 110 deviates to the left in accordance with the slope of the green 18 .

In addition, as shown in FIG. 8, the processor 23 sets, in the ground image, a first line L11 that passes through the virtual golf ball 110 and the virtual cup 112, and a second line L12 that is perpendicular to the first line L11 and passes through the virtual cup 112.

Next, the processor 23 determines a first position P11, which is the position of the intersection between the movement trajectory 120 of the virtual golf ball 110 and the second straight line L12. Furthermore, the processor 23 determines a second position P12, which is a position on the second straight line L12 on the opposite side of the virtual cup 112 from the first position P11. The processor 23 then determines this second position as the target position for hitting the virtual golf ball 110.
This second position P12 (target position) is a position at which the user is likely to be able to hit the virtual golf ball 110 into the virtual cup 112 by hitting the virtual golf ball 110 toward this position. In this embodiment, the processor 23 sets the second position P12 in accordance with the amount of deviation from the virtual cup 112 on the movement trajectory 120.

Then, as shown in FIG. 9, the processor 23 superimposes a first arrow 121 indicating the second position P12 from above and the distance 122 from the virtual cup 112 to the second position P12 (the distance along the second straight line L12) on the ground image of the green 18 as advice information. In this embodiment, the processor 23 displays information indicating a multiple of the diameter of the virtual cup 112 (i.e., "how many cups does the distance correspond to?") as the distance 122.

The processor 23 also superimposes a second arrow 123 pointing from the virtual golf ball 110 toward the second position P12 as advice information on the ground image near the virtual golf ball 110.

In this way, with this configuration, the user can know the effective putting direction for putting the virtual golf ball 110 into the virtual cup 112 based on the first arrow 121, distance 122, and second arrow 123 as shown in FIG. 9. In other words, the user can recognize that in order to putt the virtual golf ball 110 into the virtual cup 112, it is preferable to putt the virtual golf ball 110 in the direction indicated by the second arrow 123 toward the second position P12 (target position) indicated by the first arrow 121.

The user may also display the virtual golf ball 110 and virtual cup 112 at positions on the ground image that correspond to the actual golf ball and cup. This allows the user to easily grasp advice information that is useful when putting with the actual golf ball toward the cup.

Furthermore, in this configuration, it is preferable that the processor 23 performs the calculation shown in FIG. 8 and updates the display mode of the first arrow 121, distance 122, and second arrow 123 shown in FIG. 9 each time the caddy button 102 is pressed by the user.

In addition, in this embodiment, the user can turn off the navigation button 106 to remove the advice information (first arrow 121, distance 122, and second arrow 123) and the distance between the virtual golf ball 110 and the virtual cup 112 from the touch panel 33. This advice information, etc. is displayed again on the touch panel 33 when the user turns the navigation button 106 back on.

In this embodiment, the movement trajectory of the virtual golf ball 110 may also be displayed on the touch panel 33 as advice information. In this case, when the user selects the caddie button 102 displayed in the center of the bottom of the touch panel 33, the processor 23 performs a putting simulation (trial shot, putting trajectory simulation). In the putting simulation, the movement trajectory (orbit) of the virtual golf ball 110 is predicted when putting toward the virtual cup 112.

Specifically, when the user presses and holds the caddie button 102, the processor 23 displays the putting strength (a numerical value; in the example of FIG. 10, "17") below the center of the touch panel 33, as shown in FIG. 10. When the user moves the finger that is pressing and holding the caddie button 102 on the touch panel 33, the processor 23 detects the movement of the user's finger and changes the strength.

After setting the putting strength in this way, the user releases the finger that has been holding down the caddie button 102. As shown in FIG. 11, the processor 23 generates a movement trajectory (rough estimate) 135 of the virtual golf ball 110 when the virtual golf ball 110 is hit straight toward the virtual cup 112 with the set strength, and displays it superimposed on the ground image. At this time, the processor 23 generates the movement trajectory 135 of the virtual golf ball 110 taking into consideration the slope of the green 18, the weight, rolling resistance, elasticity, etc. of the virtual golf ball 110. Note that the processor 23 may load existing software for generating a movement trajectory from the memory 25 in order to generate the movement trajectory 135 of the virtual golf ball 110.

In the example shown in Figure 11, the movement trajectory 135 of the virtual golf ball 110 is shown deviating to the left in accordance with the slope of the green 18. Note that when the user presses the caddie button 102 again, the virtual golf ball 110 that has been hit and moved returns to its original position.

In this configuration, the processor 23 is configured to superimpose, on the ground image displayed on the touch panel 33, the movement trajectory of the virtual golf ball 110 when the virtual golf ball 110 is hit toward the virtual cup 112, based on instructions from the user via the touch panel 33. This allows the user to easily understand how the virtual golf ball 110 will roll when putting toward the virtual cup 112. The location where the virtual cup 112 is displayed is not limited to the position of the real cup on the ground image, and may be a position offset from the real cup. Note that the processor 23 may also be configured to allow an arbitrary hitting direction to be specified on the ground image without displaying the virtual cup 112, and to allow the virtual golf ball 110 to be hit in that direction to simulate putting.

The processor 23 may also acquire the slope (undulations) of the ground of the green 18, the position of the golf ball, and the position of the cup based on a ground image, which is an image of the ground of the green 18, which is the ground of the golf course 1. Based on this, the processor 23 may create an example of an ideal putting line (the path of the golf ball's movement to the cup) as advice information for the next shot (putt), and display it superimposed on the ground image. This allows the user to refer to the displayed putting line when actually putting. The golf ball and cup may be real, or they may be a virtual golf ball 110 and a virtual cup 112.

Furthermore, the above-described putting advice information may be created by the management unit 60 shown in Figures 1 and 2. As shown in Figure 2, the management unit 60 has a management communication unit 61 for communicating with the user terminal 20, and a management control unit 63.

In this configuration, the processor 23 of the user terminal 20 transmits a ground image of the green 18 to the management unit 60 via the terminal communication unit 21. In the management unit 60, the management control unit 63 receives the ground image via the management communication unit 61. The management control unit 63 then obtains the slope of the green 18 based on the ground image, which is an image of the ground on the green 18, and recognizes the positions of the golf ball and the cup in the ground image to generate advice information for the next shot. In other words, the management control unit 63 creates advice information based on the slope of the green 18, the position of the golf ball, and the position of the cup, and transmits it to the user terminal 20 via the management communication unit 61.

Then, in the user terminal 20 , the processor 23 displays the advice information transmitted from the management unit 60 superimposed on the ground image displayed on the touch panel 33 .
In this configuration, the golf ball and the cup may be real, or may be virtual golf ball 110 and virtual cup 112. The advice information may be, for example, first arrow 121, distance 122, and second arrow 123 shown in Fig. 9, movement trajectory 135 shown in Fig. 11, or the ideal putting line described above.

In this configuration, the user terminal 20 and the management unit 60 constitute an information provision system that provides advice information to the user terminal 20. In this system, the user of the user terminal 20 can also obtain advice information. In addition, in this configuration, the advice information is generated by the management unit 60 instead of the user terminal 20, which reduces the load on the user terminal 20. The management unit 60 may be provided on the golf course 1 or on the cloud. The advice information may also be created by the administrator (advisor) of the management unit 60.

In this embodiment, as shown in FIG. 12, the user can set the size and number of small areas (panels) corresponding to one tilt symbol (arrow symbol M1 or circle symbol M2) by touching the arrow setting tab 101 in the lower right of the ground image displayed on the touch panel 33. That is, the processor 23 is configured to change at least one of the size or number of small areas based on instructions from the user via the touch panel 33. Specifically, when the user touches the arrow setting tab 101, the processor 23 displays a small area setting field 140 on the touch panel 33, as shown in FIG. 12. The small area setting field 140 includes a panel size setting slider 141 and a panel number setting slider 142.

The user can use the panel size setting slider 141 to change the size of a single small area, and the panel count setting slider 142 to change the number of small areas lined up in one direction. In the example shown in Figure 12, the size of the small area is set to 17 cm, and the number of small areas lined up in one direction is set to 100. This means that 10,000 small areas can be displayed in an area 1,700 cm square.

For example, if the user reduces the size of the small area using the panel size setting slider 141, the size of the small area M corresponding to one slope symbol will become smaller, and the slope of the green 18, which is the ground being imaged, will be displayed in more detail, as shown in Figure 13(a). On the other hand, if the size of the small area is enlarged, the slope of the green 18 will be displayed more vaguely (roughly), as shown in Figure 13(b).

Furthermore, when the user increases or decreases the number of small areas using the panel number setting slider 142, the number of small areas superimposed on the touch panel 33 increases or decreases, and therefore the number of displayed inclination symbols (arrow symbol M1 or circle symbol M2) increases or decreases.
In this way, the user can use the panel size setting slider 141 and the panel number setting slider 142 to adjust the size and number of small areas so that the slope of the green 18 can be easily grasped.

When the virtual golf ball 110 and virtual cup 112 are displayed on the touch panel 33, the processor 23 arranges multiple small regions centered on the midpoint between the virtual golf ball 110 and the virtual cup 112. In other words, in this case, the processor 23 sets the reference point (the center of the multiple small regions) of the multiple small regions (panels) to the midpoint between the virtual golf ball 110 and the virtual cup 112.

Furthermore, when the virtual golf ball 110 is displayed on the touch panel 33 but the virtual cup 112 is not, the processor 23 arranges multiple small regions around the virtual golf ball 110. That is, in this case, the processor 23 sets the reference point of the multiple small regions (panels) to the position of the virtual golf ball 110.

Furthermore, the hint button 107 shown in FIG. 3 etc. is a button for displaying an operation explanation on the touch panel 33. That is, in this embodiment, the processor 23 is configured to display an operation explanation of the display method according to this embodiment on the touch panel 33 when the user presses the hint button 107. Note that the processor 23 may also be configured to display an operation explanation of the display method according to this embodiment on the touch panel 33 when the application program AP is launched for the first time on the user terminal 20.

The reset button 108 shown in FIG. 3 and elsewhere is a button for resetting the display content of the touch panel 33. That is, when the user presses the reset button 108, the processor 23 erases the virtual golf ball 110, virtual cup 112, virtual pin flag 113, the distance between the virtual golf ball 110 and the virtual cup 112, the slope symbol (arrow symbol M1 and circle symbol M2), the color region (mesh), and advice information (first arrow 121, distance 122, second arrow 123, etc.) that are superimposed on the ground image on the touch panel 33, and displays only the ground image on the touch panel 33. The user can once again superimpose the virtual golf ball 110 and virtual cup 112 on the ground image by operating the cup setting button 103, ball setting button 104, etc.

The user can also configure other detailed settings regarding the display of tilt symbols and color areas. In this case, the user touches the settings button 109 displayed in the lower right corner of the touch panel 33 shown in Figure 3, etc. In response, the processor 23 displays a settings screen such as that shown in Figure 14 on the touch panel 33.

In the example shown in this figure, when the top row "Non-LiDAR model support" is checked, the processor 23 functions to support user terminals 20 that are not equipped with LiDAR.

The "Distance Display Position" and "Distance Display Character Size" settings relate to the display of the distance from the virtual golf ball 110 to the virtual cup 112 shown in Figure 7, etc. The "Distance Display Position" setting allows you to set whether the distance is displayed in the center or at the top of the touch panel 33. The "Distance Display Character Size" setting allows you to set the size of the characters used to display the distance.

Furthermore, "ball mass (kg)," "ball rolling resistance," and "ball elasticity" are settings for generating advice information, as described above with reference to Figures 8 to 11. That is, "ball mass (kg)," "ball rolling resistance," and "ball elasticity" are the values of the mass, rolling resistance, and elasticity of the virtual golf ball 110 at the time the advice information is generated, and are used by the processor 23 to generate the movement trajectory 120 or the movement trajectory 135.

Furthermore, the "Mesh Display" check box is used to set whether or not to superimpose a color area (mesh) corresponding to the height of the ground, as shown in FIG. 6, on the ground image on the touch panel 33. In other words, when "Mesh Display" is checked, the processor 23 superimposes a color area on the ground image on the touch panel 33. And "Mesh Transparency" is used to set the transparency (depth) of the color area displayed on the touch panel 33.

The "mesh display mode" is used to set the display mode for the color area. In this embodiment, the mesh display mode can be selected from, for example, gradation display or step display. In gradation display, the color area is formed using the nine colors shown in Figure 5. In step display, the color area is formed using colors different from those used in gradation display.

Furthermore, "mesh rolling resistance" and "mesh elasticity" are settings used to generate the advice information described above with reference to Figures 8 to 11. That is, "mesh rolling resistance" and "mesh elasticity" are values of the rolling resistance and elasticity of the ground of green 18, and are used by processor 23 to generate movement trajectory 120 or movement trajectory 135.

Furthermore, the "Show gradient arrow" check box is used to set whether or not to superimpose a gradient symbol (arrow symbol M1 or circle symbol M2) as shown in Figure 4 on the ground image on the touch panel 33. In other words, when "Show gradient arrow" is checked, the processor 23 superimposes a gradient symbol on the ground image on the touch panel 33. And "Arrow transparency" is used to set the transparency (thickness) of the gradient symbol displayed on the touch panel 33.

The "arrow display gradient threshold" is a threshold for setting whether to display an arrow symbol M1 or a circle symbol M2 in a small area of the ground image. In other words, if this threshold is small, the arrow symbol M1 will be displayed in small areas with a small gradient, and the amount of displayed arrow symbol M1 will increase. On the other hand, if the threshold is large, the circle symbol M2 will be displayed in small areas with a small gradient, and the amount of displayed circle symbol M2 will increase. For example, if the threshold is 0.7, a gradient of 0.7 degrees or less is considered flat. The "arrow center update interval" is a field for setting the time to update the center (reference point) of a small area containing a gradient symbol, for example.

Furthermore, "Maximum Size" and "Maximum Number Displayed" are used to set the size and number of small regions M described using Figures 12 and 13. That is, in this embodiment, the user can set the size and number of small regions M via the arrow setting tab 101 or via the setting button 109.

In this way, in this embodiment, the user can set the display mode of the touch panel 33 in detail. For example, if the user checks "Mesh display" but unchecks "Slope symbol display," the processor 23 will not display a slope symbol on the touch panel 33, but will instead superimpose a color (color area) corresponding to the ground height on the ground image. Even with this configuration, the user can easily grasp the slope condition of the green 18.

Alternatively, if the user unchecks "Mesh display" but checks "Slope symbol display," the processor 23 will superimpose slope symbols (arrow symbol M1 and circle symbol M2) on the ground image without displaying color areas on the touch panel 33. This configuration also allows the user to easily grasp the slope condition of the green 18.

In this embodiment, when the user selects the ball setting button 104 shown in FIG. 3 and touches any part of the ground image on the touch panel 33, the processor 23 superimposes on the ground image the inclination symbol (arrow symbol M1 and circle symbol M2) and a color area corresponding to the height of the ground, along with the virtual golf ball 110 (see FIGS. 4 and 6). However, the timing of displaying the inclination symbol and color area is not limited to this.

For example, when a user touches any part of the ground image on the touch panel 33 while the cup setting button 103 is selected, the processor 23 may superimpose a slope symbol and color area on the ground image along with the virtual cup 112. In this case, the processor 23 may display the slope symbol and color area only in the area on the ground image between the virtual golf ball 110 and the virtual cup 112. This increases the visibility of the ground image for the user, as the slope symbol and color area are displayed only in the area necessary for putting.

In addition, in this embodiment, the processor 23 may recognize the actual golf ball and cup that appear in the ground image acquired by the camera 31. The processor 23 may then superimpose a slope symbol and a color area between the golf ball and the cup in the ground image. This configuration allows the user to easily grasp the slope conditions of the green 18 that are useful for putting, without having to set up the virtual golf ball 110 and virtual cup 112.

In this case, when a real golf ball is hit by the user, the processor 23 may obtain the trajectory of the golf ball from the ground image showing the hit golf ball and superimpose it on the ground image displayed on the touch panel 33.

In addition, in this embodiment, the camera 31 captures an image of the ground of the green 18 on the golf course 1 to obtain a ground image of the green 18, and the processor 23 superimposes a slope symbol and color area on the ground image of the green 18. In this regard, the ground image displayed on the touch panel 33 in this embodiment is not limited to the ground image of the green 18, but may be an image of ground other than the green 18 on the golf course 1, such as the teeing ground 13, fairway 14, rough 15, and bunker 17. For example, by using the ground image of the fairway 14, the user can clearly grasp the slope condition (undulations) of the fairway 14.

In addition, in the user terminal 20 of this embodiment, the memory 25 is equipped with an application program AP. The processor 23 reads this application program AP to obtain the functions of the processor 23 described above (i.e., the function as a control unit). In other words, this application program AP is a computer program that causes the processor 23 as a computer to, for example, acquire the ground slope status based on a ground image obtained by capturing an image of the ground of the golf course 1, and superimpose the ground image and a slope symbol indicating the ground slope status on the display screen (touch panel 33).

This application program AP is a program that enables a general-purpose user terminal 20, such as a smartphone, to function as a terminal device that functions at the golf course 1. This allows users to use their own user terminal 20, such as a smartphone, as a terminal device that functions at the golf course 1, instead of a dedicated terminal device.

The user terminal 20 may also be a dedicated terminal device loaned to the user by the golf course 1. In this case, the user terminal 20 may be equipped with a control unit configured by hardware instead of a processor 23 that functions by reading the application program AP.

Here, we will explain how to create the inclined symbols (arrow symbol M1 and circle symbol M2) for each small region M.

The processor 23 first creates an AR space including a ground image 70, as shown in FIG. 15. The ground image 70 is an image of a three-dimensional ground surface (e.g., a green 18 ground surface) that includes slopes. The ground image 70 is recognized, for example, as a collection of polygonal meshes that serve as constituent units of color regions.

Next, the processor 23 sets (internally generates) multiple rectangular panel sections 80 in this AR space, centered on the reference point 72, as shown in Figure 16.

As described above, the reference point 72 is either the position of the virtual golf ball 110 or the midpoint between the virtual golf ball 110 and the virtual cup 112; in the example shown in Figure 16, it is the position of the virtual golf ball 110. N x N (e.g., 3 x 3) panel sections 80 are set at the same height, with this reference point 72 as the center.

This panel section 80 is a frame (a virtual frame) of a panel (described later) corresponding to a small region M, and is, for example, a square. The number N of panel sections 80 and their size (length of one side) can be set as the number and size of small regions M, as explained with reference to Figure 12. Note that, since it is preferable to provide one panel section 80 that serves as the center of the multiple panel sections 80, it is preferable that the number N of panel sections 80 be an odd number.
The processor 23 then determines the coordinates of the center of each panel section 80 thus set.

Next, as shown in FIG. 17, the processor 23 raises the panel sections 80 in the AR space, and sets the height of the center of each panel section 80 in the AR space (the Y coordinate among the coordinates of the center of each panel section 80) to a position that is a first predetermined value L1 (1 m in this embodiment) higher than the reference point 72. Then, the processor 23 sets the coordinate of the center of each panel section 80 at this position as center coordinate P1.

It is preferable to set the first predetermined value to a relatively large value (e.g., 1 m) so that it is greater than the maximum height of the ground image 70 (height of the undulations; height from the reference point 72). This prevents the panel section 80 from being buried within the ground image 70.

Next, as shown in FIG. 17, the processor 23 performs a ray cast (projects a virtual ray of light) downward (in the negative vertical direction, downward in the vertical direction) from the center coordinate P1 of each panel section 80, and obtains ground coordinate P2, which is the coordinate of the position where the light hits in the ground image 70 (the mesh that forms the ground image 70). As a result, the processor 23 obtains ground coordinate P2, which is the three-dimensional coordinate of the part of the ground image 70 that is located below the center of each panel section 80.

The processor 23 then acquires a panel coordinate P3, which is a coordinate that is higher than the ground coordinate P2 corresponding to each panel section 80 by a second predetermined value L2 (1 cm in this embodiment). The processor 23 then materializes all N x N (3 x 3) panel sections 80 so that each panel coordinate P3 is at its center. As a result, the processor 23 forms multiple panels 82 in the AR space, each centered on a panel coordinate P3 that is higher than the ground coordinate P2 by the second predetermined value L2 (1 cm), as shown in FIG. 18. This panel 82 corresponds to a small region M to which one tilt symbol (arrow symbol M1 and circle symbol M2) is assigned, and is a square, plate-shaped object in the AR space.

Next, as shown in FIG. 19, the processor 23 causes the panel 82 to freely fall toward the ground image 70 in the AR space. As a result, the panel 82 falls 1 cm and collides with the ground image 70. The panel 82 that collides with the ground image 70 comes to rest at the point of collision on the ground image 70, tilted in line with the slope of this point. Specifically, the panel 82 that collides with the ground image 70 comes to rest at an inclination such that its normal line is the normal (a line extending perpendicularly from the point of collision) of the point of collision on the ground image 70 (for example, the point at ground coordinate P2). In this way, the processor 23 causes the panel 82 to fall toward the ground image 70, giving the panel 82 an inclination that corresponds to the slope of the ground image 70.

Then, as shown in FIG. 20, the processor 23 displays the panel 82 that has fallen onto the ground image 70 as a small region M superimposed on the ground image 70, with an inclination symbol (arrow symbol M1 or circle symbol M2) corresponding to the panel's inclination. In this way, the processor 23 can superimpose the inclination symbol for each small region M on the ground image 70.

In this method of forming a tilt symbol, the tilt of the ground is calculated based on the tilt of the panel 82 that fell onto the ground image 70, and a tilt symbol is attached to the panel 82. This makes it easier to calculate the tilt of the ground than a method that calculates the tilt of the ground by sampling the heights of multiple points on the ground.
Furthermore, with this method, by reducing the size of the panel 82 (the size of the panel section 80), it is possible to obtain a detailed slope condition (undulations) of the ground image 70.

1: Golf course, 10: Hole, 13: Teeing ground, 14: Fairway,
15: Rough, 16: Pond, 17: Bunker, 18: Green,
20: User terminal, 21: Terminal communication unit, 23: Processor, 25: Memory,
30: Input/output device, 31: Camera, 33: Touch panel, 35: Speaker,
51: pin flag, 60: management unit, 61: management communication unit, 63: management control unit,
70: ground image, 72: reference point, 80: panel section, 82: panel,
101: Arrow setting tab, 102: Caddy button, 103: Cup setting button,
104: Ball setting button, 106: Navigation button, 107: Hint button,
108: Reset button, 109: Setting button,
110: Virtual golf ball, 112: Virtual cup, 113: Virtual pin flag,
120: movement trajectory, 121: first arrow, 122: distance, 123: second arrow,
135: Movement trajectory,
140: Small area setting field, 141: Panel size setting slider,
142: Slider for setting the number of panels,
AP: application program, N: computer network,
L11: first straight line, L12: second straight line, P11: first position, P12: second position,
L1: first predetermined value, L2: second predetermined value,
P1: center coordinates, P2: ground coordinates, P3: panel coordinates M: small area, M1: arrow symbol, M2: circle symbol

Claims (12)

an imaging unit that captures an image of the ground of the golf course and generates a ground image;
a control unit that acquires a ground inclination state based on the ground image and superimposes the ground image and an inclination symbol indicating the ground inclination state on a display screen,
the control unit is configured to divide the ground image into predetermined small areas, acquire a slope status for each of the small areas, and superimpose the slope symbol for each of the small areas on the ground image ;
The control unit
forming an AR space including the ground image;
setting a plurality of panel sections in the AR space with a reference point as a center;
Setting the height of the center of each panel section in the AR space to a position higher than the reference point by a first predetermined value;
obtaining ground coordinates, which are three-dimensional coordinates of a portion of the ground image located below the center of each panel section;
acquiring panel coordinates that are higher by a second predetermined value than the ground coordinates corresponding to each panel section;
forming a panel centered on the panel coordinates in the AR space;
dropping the panel toward the ground image to tilt the panel in accordance with the tilt of the ground image; and
displaying the panel that has fallen onto the ground image as the small area superimposed on the ground image with an inclination symbol corresponding to the inclination of the panel;
and superimposing the inclination symbol for each small region on the ground image by
Terminal device. The tilt symbol includes an arrow indicating the tilt direction.
The terminal device according to claim 1 . further comprising an input unit for receiving instructions from a user;
The control unit is configured to change at least one of the size and the number of the small regions based on an instruction from a user via the input unit.
The terminal device according to claim 1 . The control unit is configured to superimpose a color corresponding to the height of the captured ground on the ground image.
The terminal device according to claim 1 . further comprising an input unit for receiving instructions from a user;
the control unit is configured to display a virtual golf ball and a virtual cup on the ground image displayed on the display screen based on an instruction from a user via the input unit.
The terminal device according to claim 1 . the control unit is configured to acquire a slope condition of the ground based on the ground image, generate advice information for causing the virtual golf ball to go into the virtual cup, and display the advice information superimposed on the ground image.
The terminal device according to claim 5 . the control unit is configured to display, as the advice information, a first arrow indicating a target position for hitting the virtual golf ball from above, a second arrow pointing from the virtual golf ball to the target position, and a distance from the virtual cup to the target position.
The terminal device according to claim 6 . The control unit
a first line passing through the virtual golf ball and the virtual cup, and a second line perpendicular to the first line and passing through the virtual cup, are set in the ground image;
a first position, which is a position of an intersection between a moving path of the virtual golf ball when the virtual golf ball is hit toward the virtual cup and the second line;
a second position on the second straight line, the second position being a position on the opposite side of the virtual cup from the first position, is determined, and the second position is set as the target position;
The terminal device according to claim 7 . further comprising an input unit for receiving instructions from a user;
the control unit is configured to superimpose a virtual golf ball and a movement trajectory of the virtual golf ball when the virtual golf ball is hit on the ground image displayed on the display screen based on an instruction from the user via the input unit.
The terminal device according to claim 1 . capturing an image of the ground of the golf course to generate a ground image;
acquiring a slope condition of the ground based on the ground image; and
superimposing the ground image and a slope symbol indicating the slope of the ground on a display screen, the method including dividing the ground image into predetermined small areas, obtaining a slope status for each small area, and superimposing the slope symbol for each small area on the ground image;
Dividing the ground image into predetermined small areas, acquiring a slope status for each small area, and superimposing and displaying the slope symbol for each small area on the ground image includes:
forming an AR space including the ground image;
setting a plurality of panel sections in the AR space with a reference point as a center;
Setting the height of the center of each panel section in the AR space to a position higher than the reference point by a first predetermined value;
obtaining ground coordinates, which are three-dimensional coordinates of a portion of the ground image located below the center of each panel section;
acquiring panel coordinates that are higher by a second predetermined value than the ground coordinates corresponding to each panel section;
forming a panel centered on the panel coordinates in the AR space;
dropping the panel toward the ground image to tilt the panel in accordance with the tilt of the ground image; and
and superimposing the panel that has fallen onto the ground image as the small area on the ground image with an inclination symbol according to the inclination of the panel.
Display method. acquiring a slope condition of the ground based on a ground image obtained by capturing an image of the ground of the golf course; and
A computer program for causing a computer to superimpose on a display screen the ground image and a slope symbol indicating the slope of the ground, the computer program comprising: dividing the ground image into predetermined small areas; acquiring a slope status for each of the small areas; and superimposing and displaying the slope symbol for each of the small areas on the ground image ,
Dividing the ground image into predetermined small areas, acquiring a slope status for each small area, and superimposing and displaying the slope symbol for each small area on the ground image includes:
forming an AR space including the ground image;
setting a plurality of panel sections in the AR space with a reference point as a center;
Setting the height of the center of each panel section in the AR space to a position higher than the reference point by a first predetermined value;
obtaining ground coordinates, which are three-dimensional coordinates of a portion of the ground image located below the center of each panel section;
acquiring panel coordinates that are higher by a second predetermined value than the ground coordinates corresponding to each panel section;
forming a panel centered on the panel coordinates in the AR space;
dropping the panel toward the ground image to tilt the panel in accordance with the tilt of the ground image; and
and superimposing the panel that has fallen onto the ground image as the small area on the ground image with an inclination symbol according to the inclination of the panel.
Computer program. A system including the terminal device according to claim 1 and a management unit,
the terminal device includes a terminal communication unit for communicating with the management unit, and the control unit is configured to transmit the ground image to the management unit and receive information transmitted from the management unit via the terminal communication unit,
The management unit
a management communication unit for communicating with the terminal device;
a management control unit that receives the ground image via the management communication unit, acquires the slope of the ground based on the ground image, recognizes the position of the golf ball and the position of the cup in the ground image, generates advice information for the next shot, and transmits the advice information to the terminal device via the management communication unit.
Information provision system.