JP7125085B2 - MULTI-DISPLAY CONTROL SYSTEM, MULTI-DISPLAY CONTROL METHOD AND MULTI-DISPLAY CONTROL PROGRAM - Google Patents

Description

The present invention relates to a multi-display control system, a multi-display control method and a multi-display control program.

Games and mobile terminals using motion capture are widely used. Motion capture is an interface that captures the motion of an operator into an information device as a signal, and improves the operability of the information device in that it does not require input from a keyboard, mouse, or the like.

Japanese Patent Application Laid-Open No. 2010-118060 JP 2013-143775 A

It is conceivable to use motion capture for multiple displays. A multi-display has a plurality of displays arranged in a matrix. When operating a multi-display by motion capture, it is difficult to improve the operability due to the unique features of the multi-display.

First, as a first problem, it is difficult to determine the operator to be captured by motion capture. Multi-displays are mainly used in places where many people gather or where many people move. If the operator cannot be accurately determined by motion capture, the control operation cannot be recognized, resulting in malfunction.

As a second problem, it is difficult to install motion capture in an existing multi-display system. Space is required to newly introduce equipment such as a camera used for motion capture into an existing multi-display system.

Furthermore, as a third problem, it is difficult to instruct the display position of the video to be displayed on the multi-display by motion capture. This is because, for example, when capturing a motion of waving a hand by motion capture and indicating a display position, the width of the hand swing varies among individuals.

As a fourth problem, it is also difficult to instruct the size of the video to be displayed on the multi-display by motion capture. This is because, as in the case of the third problem, when the size of the image to be displayed is indicated, the width of the hand swing varies depending on the individual.

Thus, it is difficult to operate the multi-display by motion capture, and the operability of the multi-display cannot be improved.

An object of the present disclosure is to provide a multi-display control system, a multi-display control method, and a multi-display control program that solve any of the above problems.

A multi-display control system according to one embodiment includes a multi-display in which a plurality of displays are arranged in a matrix, and motion capture that is arranged on a business desk and outputs a control signal by capturing the operation of an operator. a system control terminal designating a controllable area of the business desk in the multi-display based on the control signal output by the motion capture; and displaying an image in the controllable area designated by the system control terminal. a multi-display control terminal that allows

According to one embodiment, a multi-display control system, a multi-display control method, and a multi-display control program are provided that can operate a multi-display by motion capture and improve the operability of the multi-display.

1 is a configuration diagram illustrating a multi-display control system according to an embodiment; FIG. FIG. 10 is a configuration diagram illustrating a multi-display control system according to another example of an embodiment; FIG. 10 is an explanatory diagram illustrating an example of a plurality of business desks that control a dedicated business desk area and a shared area of the multi-display according to the embodiment; FIG. 10 is a flow chart diagram illustrating a method for controlling a dedicated business desk area in a multi-display according to an embodiment; FIG. 4 is a flow chart diagram illustrating a method for controlling a shared area in a multi-display according to an embodiment;

(embodiment)
A multi-display control system according to an embodiment will be described. First, the configuration of the multi-display control system will be described. FIG. 1 is a configuration diagram illustrating a multi-display control system according to an embodiment. As shown in FIG. 1, the multi-display control system 1 includes a multi-display 10, a multi-display control terminal 20, a business desk 30, a motion capture 40, a system control terminal 50, a switcher 60, and video sources 71-73. .

The multi-display 10 has multiple displays. A plurality of displays are arranged in a matrix on the multi-display 10 . For example, the multi-display 10 has M displays arranged vertically and N displays arranged horizontally. The multi-display 10 has, for example, a rectangular shape as a whole. In the multi-display 10, each display may display an image independently, or one image may be displayed as a whole.

The multi-display control terminal 20 controls images displayed on the multi-display 10 . For example, the multi-display control terminal 20 controls images independently displayed by each display. Also, the multi-display control terminal 20 controls the video displayed as a whole. Furthermore, the multi-display control terminal 20 controls the video displayed in the controllable area of the business desk 30 instructed by the system control terminal 50 .

The business desk 30 is a desk for operating the multi-display 10 . An operator of the business desk 30 operates the multi-display 10 . A motion capture 40 is arranged on the business desk 30 . Motion capture 40 is one type of human interface. The motion capture 40 captures the motion of the operator's hands, feet, or the like with a camera or the like. The motion capture 40 outputs a control signal by capturing the motion of the operator. The motion capture 40 designates the controllable area of the multi-display 10 with the control signal.

A system control terminal 50 controls the entire system. The system control terminal 50 is connected to the business desk 30, the multi-display control terminal 20, the multi-display 10 and the switcher 60 via signal lines 51 through which control signals are transmitted. Note that the signal line 51 also includes wireless. A system control terminal 50 receives a control signal from the motion capture 40 via a signal line 51 or the like. The system control terminal 50 then instructs the multi-display control terminal 20 and the switcher 60 based on the control signal output by the motion capture 40 .

For example, the system control terminal 50 designates the controllable area of the business desk 30 on the multi-display 10 based on the control signal output by the motion capture 40 . Also, the system control terminal 50 causes the multi-display control terminal 20 to display an image based on the control signal output by the motion capture 40 . As a result, the multi-display control terminal 20 displays the image in the area designated by the system control terminal 50 .

The switcher 60 switches the video sources 71 to 73 according to control signals from the system control terminal 50 . The switcher 60 is connected to the video sources 71 to 73 and the multi-display control terminal 20 via signal lines 21 through which video signals are transmitted. Note that the signal line 21 also includes wireless.

Although only one business desk 30 is provided in the multi-display control system 1 in FIG. 1, a plurality of business desks 30 may be provided.

FIG. 2 is a configuration diagram illustrating a multi-display control system 1a according to another example of the embodiment. As shown in FIG. 2, the multi-display control system 1a may have multiple business desks 31-34. Each business desk 31-34 has a motion capture 41-44. The business desks 31 to 34 are connected to the system control terminal 50, the multi-display control terminal 20, the multi-display 10 and the switcher 60 via signal lines 51 and the like. The system control terminal 50 instructs the multi-display control terminal 20 and the switcher 60 according to control signals output from the motion capture devices 41-44 on the business desks 31-34.

When the business desks are collectively referred to, they are referred to as the business desk 30, and when individual business desks are specified, one of the business desks 31 to 34 or the like is added. When referring to motion capture collectively, it is referred to as motion capture 40, and when specifying individual motion captures, one of motion captures 41 to 44 or the like is added.

Next, operations of the multi-display control systems 1 and 1a according to the embodiment will be described. FIG. 3 is an explanatory diagram illustrating a plurality of business desks 31 to 34 that control the dedicated business desk areas 81 to 84 and the shared area 90 of the multi-display 10 according to the embodiment.

As shown in FIG. 3, the multi-display 10 may have areas 81 to 84 dedicated to business desks and a shared area 90 . The business desk dedicated areas 81-84 may be provided in the same number as the business desks 31-34. For example, when four business desks 31-34 are provided, four business desk dedicated areas 81-84 corresponding to the business desks 31-34 are provided. In the case of the multi-display control system 1 having one business desk 30, in FIG. 3, for example, only the business desk 31 and the dedicated area 81 for the business desk may be provided.

Each of the dedicated business desk areas 81 to 84 is provided at four corners of the multi-display 10 . Each dedicated business desk area 81-84 includes two displays 11, for example. In the figure, only some of the displays are labeled 11 and the other displays are omitted so as not to clutter the drawing. The number of displays 11 included in each of the dedicated business desk areas 81 to 84 is not limited to two. Further, the positions of the dedicated business desk areas 81 to 84 on the multi-display 10 are not limited to the corners.

Areas that can be controlled by the business desks 31 to 34 are areas 81 to 84 dedicated to the business desks. Therefore, the areas that can be controlled by the business desks 31-34 are dedicated control areas for the business desks 31-34. The motion capture 41 on the business desk 31 controls the video displayed on the business desk dedicated area 81 . Similarly, the motion captures 42-44 on each business desk 32-34 control the video displayed on each business desk dedicated area 82-84. In this way, since the business desk areas 81 to 84 are provided so that the business desks 31 to 34 can be exclusively controlled, the multi-display 10 can be controlled from a plurality of business desks 30 at the same time.

Multi-display 10 may have one shared area 90 . A shared area 90 is arranged in the central part of the multi-display 10 . Shared area 90 includes twelve displays 11 . Therefore, the shared area 90 is a wider display area than the areas 81 to 84 dedicated to business desks. Note that the number of displays 11 included in the shared area 90 is not limited to twelve. Also, the position of the shared area 90 in the multi-display 10 is not limited to the center.

Each business desk 31 - 34 can also control a shared area 90 . Each of the business desks 31 to 34 can control the shared area 90 by acquiring the control right of the shared area 90 . The area that can be controlled by the business desk 30 that has acquired the control right is the shared control area. The business desk 30 that has acquired the control right can exclude control signals from other than the business desk 30 . Therefore, when the multi-display 10 is operated by a plurality of business desks 31 to 34, the shared area 90 cannot be operated by anyone other than the business desk 30 that has acquired the control right.

In order to acquire the control right of the shared area 90, it is acquired when the business desk 30 is operated. The control right of the shared area 90 may be given by, for example, capturing a predetermined motion by the motion capture 40 . During the operation pattern from the start of control to the end of control on the business desk 30 that has obtained the control right, the other business desks 30 cannot be controlled.

For example, colors such as red, green, and blue are associated with each of the business desks 31 to 34, and while the business desk 30 that has obtained control rights is controlling the shared area 90, the multi-display 10 may be displayed with a wavy line in a color corresponding to the business desk 30 . As a result, it is possible to know from other business desks 30 which business desk 30 has the right to control the shared area 90 .

FIG. 4 is a flow chart diagram illustrating a control method for the dedicated business desk areas 81 to 84 in the multi-display 10 according to the embodiment. As shown in step S11 in FIG. 4, the operation is started, and first, it is determined whether the control area is the business desk dedicated areas 81 to 84 or the shared area 90. FIG. For example, the motion capture 40 captures a predetermined motion of an operator, and outputs a control signal indicating a control region based on the captured predetermined motion. As a result, the system control terminal 50 determines whether the control area is the business desk dedicated areas 81 to 84 or the shared area 90 .

In this way, in the multi-display 10 in which a plurality of displays 11 are arranged in a matrix, the motion capture 40, which is arranged on the business desk 30 and outputs a control signal by capturing the motion of the operator, is used to perform the multi-display. A controllable area of the business desk 30 on the display 10 is specified.

If the control area is the shared area 90, the process proceeds to the control method flow for the shared area 90 as shown in step S12. The flow of the method for controlling the shared area 90 will be described later.

In step S11, if the control area is the business desk dedicated area 80, the display operation is captured by the motion capture 40 as shown in step S13. The motion capture 40 outputs a display operation control signal by capturing the motion of the operator.

Next, as shown in step S<b>14 , the system control terminal 50 that has received the control signal for the display operation from the motion capture 40 displays a video window on the business desk dedicated area 80 on the multi-display 10 . The video window is a screen that can display the candidates of the video sources 71 to 73 and the video.

Next, as shown in step S15, candidates for the video sources 71 to 73 are displayed in the video window displayed in the dedicated area 80 for business use.

Next, as shown in step S16, the video sources 71 to 73 are scrolled to select the video to be displayed in the area 80 dedicated to the business desk. Then, the motion capture 40 captures the image selection operation of the operator and outputs a control signal for the image selection operation.

Next, as shown in step S17, a display image is determined. Specifically, the system control terminal 50 causes the switcher 60 to switch the selected video sources 71 to 73 based on the control signal for the video selection operation from the motion capture 40 . Then the process ends. Thus, in the multi-display 10, an image is displayed in the designated area 80 dedicated to the business desk.

FIG. 5 is a flow chart diagram illustrating a method for controlling the shared area 90 of the multi-display 10 according to an embodiment. As shown in step S21 in FIG. 5, first, the business console 30 that attempts to operate the shared area 90 acquires control authority. As a result, the shared area 90 can be controlled, and the control signals from the business desks 30 other than the business desk 30 to be operated are eliminated. The control right of the shared area 90 is granted, for example, by the motion capture 40 capturing a predetermined motion. While the business desk 30 that has obtained control rights is controlling the shared area 90, the outer frame of the shared area 90 may be displayed with a wavy line in the color that indicates the business desk 30 that has obtained control rights.

The control right of the shared area 90 may be automatically canceled if there is no control signal within a predetermined time from the business desk 30 that has acquired the control right after the operation. The predetermined time is, for example, 5 minutes. Further, a dedicated video control console (not shown) may be provided that can acquire the control right with priority over the business console 30 . When controlling from the dedicated video control console, even if the business desk 30 has the control right, the control right of the business desk 30 is invalidated, and the shared area 90 is controlled from the dedicated video control console. be able to.

Next, as shown in step S22, it is determined whether or not there is control authority. If there is no control authority, the process returns to step S21 to obtain control authority. The case where there is no control right is, for example, the case where there is no control within a predetermined time and the control right is automatically canceled. Alternatively, the case where there is no control right is the case where the dedicated video control console has the control right.

In step S22, if there is control authority, the motion capture 40 captures the display operation as shown in step S23. The motion capture 40 outputs a display operation control signal by capturing the motion of the operator.

Next, as shown in step S<b>24 , the system control terminal 50 that has received the display operation control signal from the motion capture 40 displays a video window in the shared area 90 of the multi-display 10 .

Next, as shown in step S25, candidates for the video sources 71 to 73 are displayed in the video window displayed in the shared area 90. FIG.

Next, as shown in step S26, the video sources 71 to 73 are scrolled to select the video to be displayed in the shared area 90. FIG. Then, the motion capture 40 captures the image selection operation of the operator and outputs a control signal for the image selection operation.

Next, as shown in step S27, a display image is determined. Specifically, the system control terminal 50 causes the switcher 60 to switch the selected video sources 71 to 73 based on the control signal for the video selection operation from the motion capture 40 . Then the process ends. Thus, an image is displayed on the designated shared area 90 on the multi-display 10. FIG.

As described above, as the operation of the multi-display control systems 1 and 1a, the method of controlling the multi-display business desk dedicated area 80 and the shared area 90 has been described. may That is, in the multi-display 10 in which a plurality of displays 11 are arranged in a matrix, the multi-display 10 is arranged using the motion capture 40 that is arranged on the business desk 30 and outputs a control signal by capturing the motion of the operator. A controllable area is specified by the business desk 30 in , and an image is displayed in the specified controllable area. Multi-displays may be controlled using a multi-display control program that causes a computer to execute such a series of procedures.

Next, the effects of this embodiment will be described.
The multi-display control system 1 of this embodiment can operate the multi-display 10 by the motion capture 40, and can improve the operability of the multi-display 10. FIG.

The motion capture 40 is placed on the business desk 30 and operates the multi-display by capturing the motion of the operator positioned on the business desk 30 . Therefore, since the motion of a person who is positioned other than the business desk 30 is not captured, the operator can be determined with high accuracy, and malfunction can be suppressed.

Also, since the motion capture 40 is arranged on the business desk 30, it can be incorporated into an existing system without requiring a new space.

Further, as a control area in which each business desk 30 can be controlled, a business desk dedicated area 80 and a shared area 90 are provided. Therefore, the motion capture 40 can instruct the display position and size of the image to be displayed on the multi-display 10 .

In this way, the operator can be accurately determined and incorporated into an existing system, so the multi-display control systems 1 and 1a of the present embodiment can be applied to police-related and fire-related surveillance. can. It can also be applied to the operation of multi-displays for advertising on the street. Since the multi-display control systems 1 and 1a of the present embodiment use the motion capture 40, the multi-display control operation, which was controlled by a plurality of procedures, can be performed more intuitively like operating a smartphone or tablet terminal. can be operated effectively, and operability can be improved. In addition, by using the motion capture 40, it is possible to suppress failures due to operation and failures due to erroneous operations because the device does not need to be touched.

Since each business desk 30 is provided with a dedicated business desk area 80 that can be exclusively controlled, the multi-display 10 can be controlled simultaneously from a plurality of business desks 30 . Further, since the common area 90 wider than the dedicated area 80 for each business desk is provided, each desk 30 for business can control an area wider than the dedicated area 80 for business desk.

A control right for the shared area 90 is provided, and the business desk 30 that has acquired the control right is allowed to control the shared area 90, and control signals from other than the business desk 30 that has acquired the control right are eliminated. there is Therefore, it is possible to accurately determine the operator and suppress malfunction.

Colors such as red, green, and blue are associated with each of the business desks 31 to 34, and while the business desk 30 that has obtained control rights is controlling the shared area 90, The outer frame of the shared area 90 is displayed with a wavy line in a color corresponding to the business desk 30 . As a result, it is possible to know from other business desks 30 which business desk 30 has the right to control the shared area 90 .

The control right of the shared area 90 is automatically canceled if there is no control within a predetermined time after the operation. Therefore, the shared area 90 can be operated without waste.

A console dedicated to video control is provided, which can acquire the control right with priority over the business console 30. - 特許庁Thus, the shared area 90 can be used to display sudden urgent matters. In addition, the common area 90 can be used when the business desk 30 fails.

It should be noted that the present invention is not limited to the above embodiments, and can be modified as appropriate without departing from the scope of the invention.

1, 1a Multi-display control system 10 Multi-display 11 Display 20 Multi-display control terminals 30, 31, 32, 33, 34 Business desks 40, 41, 42, 43, 44 Motion capture 50 System control terminal 51 Signal line 60 Switcher 71 , 72, 73 video sources 81, 82, 83, 84 dedicated desk area 90 shared area

Claims (5)

A multi-display in which multiple displays are arranged in a matrix,
A motion capture device that is placed on a business desk and outputs control signals by capturing the actions of the operator,
a system control terminal that designates a controllable area of the business desk in the multi-display based on the control signal output by the motion capture;
a multi-display control terminal that displays an image in the controllable area designated by the system control terminal;
with
A plurality of the business desks are provided,
The multi-display has an area where each business desk can be controlled,
Each controllable area is a dedicated control area for each commercial desk,
Multi-display control system. The multi-display further has a shared control area for each of the business desks,
the controllable region further comprises the shared control region ;
the shared control area is a wider display area than the dedicated control area for each business desk;
Acquiring the control right of the shared control area when operating the business desk, and eliminating the control signal to the shared control area from other than the business desk that has acquired the control right;
The multi-display control system of claim 1. The control right is automatically canceled if the control signal is not received within a predetermined time from the business console that has acquired the control right.
3. The multi-display control system of claim 2 . In a multi-display in which a plurality of displays are arranged in a matrix, the business-use desk in the multi-display uses motion capture that is arranged on the business-use desk and outputs a control signal by capturing the motion of an operator. specifying a controllable region;
displaying an image in the designated controllable area;
with
A plurality of the business desks are provided,
The multi-display has an area where each business desk can be controlled,
Each controllable area is a dedicated control area for each commercial desk,
Multi-display control method. In a multi-display in which a plurality of displays are arranged in a matrix, the business-use desk in the multi-display uses motion capture that is arranged on the business-use desk and outputs a control signal by capturing the motion of an operator. Specify the controllable area,
displaying an image in the designated controllable area;
When you let a computer do something,
A plurality of the business desks are provided,
The multi-display has an area where each business desk can be controlled,
Each controllable area is a dedicated control area for each commercial desk,
Multi-display control program.

Images