JP7156644B2 - Wireless communication control method - Google Patents

Description

The present invention relates to a radio communication control method.

Various wireless communication systems are currently in widespread use. For example, a cellular system, which is a licensed-band wireless communication system, is currently commercialized according to the fourth-generation wireless communication standard, and accommodates mobile wireless terminals while combining cells with large and small diameters. In addition, wireless LAN systems are the first to be mentioned as wireless communication systems that are widespread in the unlicensed band. Broadband wireless communication is provided to wireless terminals that In addition, LPWA (Low Power Wide Area), which is another unlicensed band wireless communication system, can provide wireless communication with low power consumption to wireless terminals existing in a wide diameter of several to several kilometers. Suitable for housing Internet of Things services.

As described above, a wireless communication environment has become widespread in which a suitable wireless communication system can be selected from among various wireless communication systems according to a request for wireless service. In addition, among wireless communication systems, those aiming at large capacity are increasing the density of wireless base stations in order to increase the area capacity. For example, there is an increasing number of wireless environments in which one or more wireless base stations detected with sufficiently strong received power to carry out wireless communication exist around wireless terminals.

As a result, the degree of freedom of radio access that can be selected by a radio terminal has increased both in terms of the types of radio communication systems and the number of radio base stations. Taking advantage of this degree of freedom, wireless communication protocols have been developed that perform load balancing and frame redundancy transmission by simultaneously connecting to a plurality of wireless accesses (see Non-Patent Document 1, for example). For example, by simultaneously using a cellular line and a wireless LAN line, the wireless communication environment can be stabilized.

A configuration in which wireless virtual interface wireless base station assignment control is performed by wireless terminal-led autonomous decentralized control is one of the leading configurations due to the simplicity of control arithmetic processing. However, in this case, the following three problems arise step by step in the prior art.

The first problem is that congestion tends to occur at the radio base station. In the conventional technology, from the viewpoint of maximizing the wireless communication transmission rate, the wireless terminal is mainly connected to the wireless base station with the maximum received power. However, when the radio virtual interfaces that require a large capacity are concentrated around a certain radio base station, the maximum transmission rate of radio communication of the radio base station is exceeded and congestion occurs, making it impossible to satisfy the requirements of each radio virtual interface. .

The second problem is that the conventional technology does not have a radio communication control algorithm that considers the stability of the radio communication environment. This is because there is a possibility of outputting settings that would otherwise occur. For example, assume that the wireless terminal can select an appropriate wireless base station at a given point in time by overcoming the first problem and having means for collecting information on the utilization rate of the wireless base stations. However, when the observed wireless communication environment is instantaneous, for example, when there is a lot of comings and goings of the wireless virtual interface, the wireless base station is temporarily unable to accommodate the traffic of the initial wireless virtual interface. It can be successful, but immediately causes congestion when a new radio virtual interface is attached to the radio base station.

The third problem is that the number of states of information collected by a wireless terminal is enormous, and a technique that implements control using a statistical technique cannot be applied. In order to overcome the second problem, statistical control methods such as reinforcement learning and pattern matching should be used to determine whether the wireless communication environment acquired by information collection is stable or unstable, and each wireless virtual interface in each case. An effective approach is to empirically acquire a judgment function such as which radio base station should belong to.

However, in any of the above control methods, the wireless communication environment is defined as a pre-discretized state, and after determining which state the currently acquired wireless communication environment belongs to, the wireless virtualization in that state is performed. It is necessary to take a step of determining an appropriate home radio base station for the interface. On the other hand, most wireless communication quality information, such as signal reception strength and traffic data rate, are defined as continuous values. Therefore, if the discrete states are defined as they are by the type of each numerical value, the number of states becomes too large, and there is a problem that the state determination processing does not converge.

Atefeh Hajijamali Arani, 4 others, "Distributed Learning for Energy-Efficient Resource Management in Self-Organizing Heterogeneous Networks", IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, OCTOBER 2017, VOL. 66, NO. 10, p.9287-9303

SUMMARY OF THE INVENTION It is an object of the present invention to provide a radio communication control method capable of suppressing deterioration in communication quality even if the arrangement of radio terminals with respect to radio base stations is uneven.

A radio communication control method according to an aspect of the present invention is a radio communication control method for controlling radio communication performed by a plurality of radio terminals and a plurality of radio base stations, wherein the radio base stations belong to the radio base stations. a notification step of notifying each wireless terminal of quality measurement information based on wireless communication quality with wireless terminals and wireless communication quality with other wireless terminals belonging to other wireless base stations; A calculation step of calculating belonging information for selecting any one of the wireless base stations capable of improving wireless communication quality as a new belonging destination based on the measurement information, and updating the belonging destination of the wireless terminal based on the calculated belonging information. and a recording step of recording attribute information so that the attribute information is recorded , and the calculating step includes a state of discretely representing wireless communication quality based on current quality measurement information between the wireless base station and the wireless terminal, and a wireless base station Attribute information for selecting one of the wireless base stations capable of improving the wireless communication quality as a new destination is calculated by using the behavior representing the combination of the wireless terminals belonging to each .

In the wireless communication control method according to one aspect of the present invention, the calculating step selects an element that maximizes gain from a plurality of elements included in a Q table indicating discrete combinations of the state and the action. is characterized by calculating belonging information for selecting any one of the wireless base stations capable of improving the wireless communication quality as a new belonging destination.

In the wireless communication control method according to one aspect of the present invention, the calculating step calculates a reward based on quality measurement information between a wireless base station and a wireless terminal, and uses the calculated reward to determine the plurality of values included in the Q table. is characterized by repeatedly updating the gains of the elements of .

In the radio communication control method according to one aspect of the present invention, the calculating step includes a matrix indicating which radio base station the radio terminal belongs to and a matrix indicating whether or not the gain is equal to or greater than a predetermined value. is defined as the above state.

In the radio communication control method according to one aspect of the present invention, the calculating step includes data rate, requested data rate, average packet size, and band utilization rate of the radio base station in radio communication between the radio base station and the radio terminal. It is characterized in that the gain is calculated based on the

In the wireless communication control method according to an aspect of the present invention, the calculating step comprises: one wireless terminal for which belonging information is calculated; another wireless terminal located near the wireless terminal for which belonging information is calculated; , calculating the state and the reward for any of the identified one or more wireless terminals.

ADVANTAGE OF THE INVENTION According to the present invention, it is possible to suppress the deterioration of communication quality even if the placement of wireless terminals with respect to wireless base stations is uneven.

1 is a diagram illustrating a configuration example of a wireless communication system according to an embodiment; FIG. FIG. 2 is a diagram showing an information exchange path through which radio base stations exchange quality measurement information; 1 is a diagram illustrating a configuration example of a radio base station according to an embodiment; FIG. 1 is a diagram illustrating a configuration example of a wireless terminal according to an embodiment; FIG. It is a figure which shows the outline|summary of the control processing using Q table. It is a figure which shows the outline|summary of the learning process using Q table. 1 illustrates an example of a wireless communication system according to an embodiment; FIG. FIG. 3 is a diagram showing notation examples of radio transmission power, channel coefficients, a set of serving radio base stations, a set of radio virtual interfaces, and a set of radio terminals; FIG. 10 is a diagram showing another example of a wireless communication system according to one embodiment; 4 is a flow chart showing control of each wireless terminal in a wireless communication control algorithm;

An embodiment of a wireless communication system will be described below with reference to the drawings. FIG. 1 shows a configuration example of a wireless communication system 10 according to one embodiment. As shown in FIG. 1, in a radio communication system 10, a plurality of radio base stations 20 are connected to a network 100 via switches 102, respectively. Here, each wireless base station 20 is connected to each other by a wired communication path via network 100 . Also, the radio base station 20 can communicate with other radio base stations 20 by radio communication.

A plurality of wireless terminals 30 that perform wireless communication with the wireless base station 20 are located around the wireless base station 20 . The radio terminal 30 has one or more radio physical interfaces that determine belonging to the radio base station 20 based on a physical signal such as the strength of a received signal strength indicator (RSSI), and according to the result of arithmetic processing of the received signal. is connected to the radio base station 20 by any of one or more radio virtual interfaces that determine membership to the radio base station 20. The wireless virtual interface controls where the wireless terminal 30 belongs to the wireless base station 20 by, for example, reinforcement learning.

Here, based on the quality measurement information notified from the radio base station 20, the radio terminal 30 performs autonomous decentralized control to select the radio base station 20 to which it belongs. The quality measurement information includes information obtained by measuring the radio communication quality between the radio base station 20 and the radio terminal 30 to which the radio base station 20 belongs, and information obtained by measuring the radio communication quality between the radio terminals 30 in other radio base stations 20. (described later with reference to FIG. 3, etc.). Note that the wireless terminal 30 can belong to one or more nearby wireless base stations 20 and cannot belong to a remote wireless base station 20 .

FIG. 2 shows an information exchange path through which the radio base stations 20 in the radio communication system 10 exchange information such as quality measurement information. Information exchange paths indicated by thick arrows in FIG. 2 are classified into two types: a wired section (wired communication path) and a wireless section (wireless communication path). Information is exchanged via the switch 102 and the network 100 in the wired section. The radio section includes a section in which the radio base station 20 directly communicates with another radio base station 20, and a section in which the radio base station 20 communicates with the other radio base station 20 via a radio terminal 30. There is an interval. In other words, the radio terminal 30 can also relay communication between the radio base station 20 and another radio base station 20 .

For example, if the radio terminal 30 does not relay communication between the radio base stations 20, the radio base station 20 transmits the quality measurement information measured by itself to other surrounding radio base stations 20. exchange their respective quality measurement information;

Also, when the radio terminal 30 relays communication between the radio base stations 20, the radio base station 20 notifies the surrounding radio terminals 30 of the quality measurement information measured by itself. Then, the radio terminal 30 notifies other surrounding radio base stations 20 of the notified quality measurement information. The wireless terminal 30 executes a plurality of wireless communication applications, converts the wireless communication standard (wireless communication method) to another wireless communication standard when relaying information, and notifies the wireless base station according to the other wireless communication standard. It may be configured as Also, the wireless terminal 30 and the wireless base station 20 may have a plurality of wireless communication applications that perform wireless communication according to a plurality of wireless communication standards, and the quality measurement information may be based on the wireless communication quality of each wireless communication application. good.

FIG. 3 shows a configuration example of the radio base station 20 according to one embodiment. As shown in FIG. 3, the radio base station 20 includes an antenna section 21, a radio communication section 22, a communication I/F section 23, a quality measurement section 24, an information notification section 25, a request information evaluation section 26, and a request response notification section 27. and an attribute information recording unit 28 .

The radio base station 20 transmits and receives radio waves conforming to a predetermined standard via the antenna section 21 , and performs radio communication with the radio terminal 30 and other radio base stations 20 through processing performed by the radio communication section 22 . The wireless communication unit 22 has an RF unit 220 that processes radio frequency (RF) signals and a MAC function unit 222 that has a wireless communication medium access control (MAC) function. The communication I/F unit 23 is an interface that performs communication via a wired section configured by the network 100 (FIG. 1) or the like.

The quality measurement unit 24 has a radio environment measurement unit 240 and a traffic measurement unit 242, measures the quality of radio communication with the radio terminal 30 belonging to the radio base station 20 (own station), and measures the radio communication quality of the own station. Quality measurement information based on communication quality is calculated and acquired by quality measurement information calculation processing. The radio environment measurement unit 240 measures the radio communication environment and acquires radio environment information. The traffic measuring unit 242 measures wireless communication traffic and acquires traffic information. Quality measurement information is calculated, for example, based on radio environment information and traffic information. The quality measurement information may also include the received power in wireless communication, the requested data rate, and the usage rate of the band of the wireless base station.

The radio base station 20 receives the information of the wired section via the communication I/F section 23 regarding the quality measurement information indicating the quality of radio communication with the radio terminal 30 belonging to another radio base station 20 (another station). , and acquires information on the wireless section via the wireless communication unit 22 . Then, the quality measurement unit 24 aggregates the quality measurement information acquired from its own station and other stations.

The information notification unit 25 notifies the wireless terminal 30 via the wireless communication unit 22 of the quality measurement information aggregated by the quality measurement unit 24 .

When the request information evaluation unit 26 receives a later-described affiliation request from the wireless terminal 30 via the wireless communication unit 22, the request information evaluation unit 26 determines whether or not to assign the wireless terminal 30 (whether to change or update the assignment destination).

When the request information evaluation unit 26 permits the updating of the destination of the wireless terminal 30, the request response notification unit 27 notifies the wireless terminal 30 of this as a request response via the wireless communication unit 22. FIG.

The belonging information recording unit 28 updates and records the management information for managing the belonging destination of the wireless terminal 30 when the request information evaluating unit 26 permits updating of the belonging destination of the wireless terminal 30 .

FIG. 4 shows a configuration example of the wireless terminal 30. As shown in FIG. As shown in FIG. 4 , the wireless terminal 30 has an antenna section 31 , a wireless communication section 32 , a control information calculation section 33 , a destination requesting section 34 and a destination recording section 35 .

The wireless terminal 30 transmits and receives radio waves conforming to a predetermined standard via the antenna section 31 , and wirelessly communicates with the wireless base station 20 through processing performed by the wireless communication section 32 . The wireless communication unit 32 has an RF unit 320 that processes high-frequency signals and a MAC function unit 322 that has a wireless communication media access control (MAC) function. Then, the wireless terminal 30 acquires quality measurement information transmitted by the wireless base station 20 via the wireless communication unit 32 .

The control information calculation unit 33 includes a state calculation unit 330, a reward calculation unit 332, a Q table management unit 334, and a destination calculation unit 336. For example, the home base station 20 is determined by a wireless virtual interface using reinforcement learning. to control.

The state calculator 330 acquires the quality measurement information via the wireless communication unit 32 and calculates a “state” discretely representing the quality measurement information.

The remuneration calculator 332 calculates a "reward" based on the quality measurement information.

The Q table management unit 334 holds and manages the Q table that stores the gain when the “action” in each discrete “state” is selected, and uses the “reward” calculated by the reward calculation unit 332, Correct the gain. The gain is calculated based on the data rate in wireless communication between the wireless base station 20 and the wireless terminal 30, the requested data rate, the average packet size, the bandwidth usage rate of the wireless base station 20, and the like.

The destination calculation unit 336 performs a destination calculation process based on the Q table managed by the Q table management unit 334, and selects one of the radio base stations 20 capable of improving the wireless communication quality as a new destination. Calculate information. For example, the home destination calculation unit 336 calculates home information for selecting the optimum wireless base station 20 as a new home destination in order to improve the wireless communication quality.

The belonging destination requesting unit 34 sends a belonging request requesting permission to change the belonging destination to the belonging wireless base station 20 or the wireless base station 20 selected according to the belonging information calculated by the belonging destination calculating unit 336. Notification is made via the wireless communication unit 32 .

When the wireless terminal 30 receives from the wireless base station 20 a response to a request permitting update of the belonging destination, the belonging destination recording unit 35 updates the belonging destination based on the belonging information calculated by the belonging destination calculating unit 336. Record attribution information. That is, the belonging destination recording unit 35 updates the management information for managing the belonging destination with the belonging information.

Next, a radio communication control algorithm (radio communication control method) executed by the radio communication system 10 will be described.

First, when the wireless terminal 30 assigns a wireless virtual interface to the wireless base station 20 by some action, the wireless base station 20 determines the current wireless interface group of the wireless terminal 30 and the surrounding wireless terminals 30. The communication quality is measured, and quality measurement information based on the wireless communication quality of the own station is calculated by quality measurement information calculation processing.

The radio base station 20 exchanges information with another radio base station 20 (another station) so as to acquire quality measurement information indicating the quality of radio communication with the radio terminal 30 to which it belongs, if necessary. Aggregate the quality measurement information obtained from the station and other stations.

The radio base station 20 then notifies the radio terminal 30 of the aggregated quality measurement information.

The wireless terminal 30 calculates the current state and rewards to be given to other wireless terminals 30 based on the notified quality measurement information. The reward is a value for correcting the Q table managed by the Q table management unit 334, and will be described later using FIG. 12 and the like.

The wireless terminal 30 uses the state and the reward to perform the control processing described using FIG. 5 and the learning processing described using FIG.

FIG. 5 shows an overview of control processing using the Q table. The Q table is partitioned by combinations of discrete states and actions, and the payout when the action in the state is selected is stored for each partition. A state discretely represents the current quality measurement information. An action is a control target parameter in a radio communication control algorithm, and indicates a combination of destinations to be assigned to a base station by a radio virtual interface.

As shown in FIG. 5, the control information calculation unit 33 calculates, for example, state 3, extracts the block group corresponding to the current state from the Q table, and selects the block group corresponding to the current state from the block group. By selecting a section, a control process for selecting an action to be taken at the next point in time (for example, action 4) is performed.

FIG. 6 shows an overview of learning processing using the Q table. In the wireless terminal 30, the current behavior (for example, behavior 2) is recorded in the belonging destination recording unit 35. FIG. The control information calculation unit 33 calculates, for example, state 3, calculates a reward (correction value of Q table gain: for example a), and selects one section corresponding to the current state/behavior from the Q table. , a learning process is performed to correct the gain of one selected section with a reward.

The radio terminal 30 acquires the function of estimating appropriate behavior in each state through statistical parameter tuning through trial and error by sequentially repeating the above-described processing.

Next, a first example of the wireless communication system according to one embodiment will be described.

FIG. 7 shows an example of a wireless communication system according to one embodiment. In the first embodiment of the wireless communication system, assuming that the number of wireless base stations is B, the number of wireless terminals is K, and the number of wireless virtual interfaces is F, the matrix A showing the attribution status of each wireless virtual interface of each wireless terminal is expressed by the following equation: (1).

Moreover, the belonging relationship is represented by the following formula (2).

Also, radio transmission power, channel coefficients, a set of destination radio base stations, a set of radio virtual interfaces, and a set of radio terminals are described as shown in FIG.

Here, the wireless transmission rate achieved by wireless terminal k is represented by the following equations (3) and (4).

Also, the time share caused by the request traffic from the radio base station b to the radio virtual interface f of the radio terminal k is expressed by the following equation (5).

The wireless base station b is described in the literature (A.H. Arani, M.J. Omidi, A. Mehbodniya and F. Adachi, "A Distributed Learning-based Users Association for Heterogeneous Networks", Trans. on Emerging Telecommun. Techno., vol.28, no.11, DOI: 10.1002/ett.3192, April 2017), congestion occurs when the following condition (6) is satisfied.

Also, the file transmission delay time from the wireless base station b to the wireless virtual interface f of the wireless terminal k is expressed by the following equation (7).

Note that the allowable delay time _Tkf in the wireless virtual interface f of the wireless terminal k is determined separately.

Next, the conditional expressions (expressions (8) to (12)) used for calculating the state and reward will be described.

The element indicating the affiliation is represented by, for example, the following formula (8), as explained using the above formulas (1) and (2).

Also, whether or not one wireless virtual interface belongs to only one wireless base station is defined by the following equation (9).

Also, whether or not the requested data rate (minimum rate constraint) of the wireless virtual interface is satisfied is defined by whether or not the gain is equal to or greater than a predetermined value, as shown in Equation (10) below.

Also, whether or not the maximum delay constraint of the wireless virtual interface is satisfied is defined by whether or not the delay time is equal to or less than the allowable delay time, as shown in the following equation (11).

Further, whether or not the usage rate of the radio base station is congested (overloaded) is defined by the following formula (12).

Next, a method of designing states, actions, and rewards used in the radio communication control algorithm will be described with reference to FIG. 9 and the like. FIG. 9 shows another example of a wireless communication system according to one embodiment.

As described above, the radio base station notifies, for example, φ _b , R _kf , a _bkf (t), and γ _bkf (t) to the radio virtual interfaces of nearby radio terminals belonging to it. The wireless terminal calculates states, actions, and rewards based on the notified information.

The state is indicated by the following equation (13).

Here, the size of the state space is represented by the following equation (14).

また、下式（１５）に示すように、各仮想インターフェースは、１つの無線基地局のみを利用可能となっている。

Also, as shown in the following formula (15), each virtual interface can use only one radio base station.

The reward is designed by combining c _1k and c _2k calculated based on the quality measurement information with a weight w _k , as also shown in the following equation (16).

The following equation (17) indicates, for example, the attribution of the radio base station b.

C _1k and c _2k are the data rate of wireless communication between the wireless base station to which the wireless terminal belongs and the wireless virtual interface in an arbitrary range, as represented by the following equations (18) and (19), respectively. It consists of information on the data rate and the usage rate of the radio base station, and the information is notified from the radio base station to the radio terminal.

In addition, when calculating the reward by the local feedback of the radio base station b, _c2k is represented by the following equation (20).

Here, it is assumed that the load normalization coefficient N(t) is represented by the following equation (21).

Also, when calculating the reward in consideration of the minimum rate constraint and maximum delay constraint of the wireless virtual interface, _c2k is expressed by the following equation (22).

Here, assume that M(t) is represented by the following equation (23).

When the wireless terminal to which the wireless base station belongs calculates the state and reward, and if the wireless terminal and wireless virtual interface subject to information collection do not belong to the wireless base station, the wireless base station exchanges information with other wireless base stations. Exchanges are made to obtain status and rewards at non-affiliated wireless terminals.

Actions are represented by the following equation (24).

FIG. 10 is a flow chart showing control of each wireless terminal in the wireless communication control algorithm. Each wireless terminal k initializes the Q table at initial time t=0 (S100). Also, since the state cannot be calculated at the initial time t=0, the wireless terminal k randomly determines the state (S102).

Thereafter, the wireless terminal k repeats the following sequential processing at each time point (S104). The greedy coefficient ε is multiplied by a decay rate λ defined by a positive real number of 1 or less each time the time loop is updated, and is adjusted so that the selection of actions that do not satisfy the judgment conditions becomes dominant over time. play a role

That is, the wireless terminal k first generates a random number p of 1 or less and determines whether or not it is less than the greedy coefficient ε (S106). If the random number p is less than the greedy coefficient ε, the wireless terminal k randomly selects an action from among the possible options and sets it as the next action y _k (t) (S108). If the random number p is not less than the greedy coefficient ε, the wireless terminal k refers to the Q table and selects the action that maximizes the gain in the current state as y _k (t) (S110).

Each radio base station b determines whether or not the radio base station itself is overloaded, and if not overloaded, feeds back the destination result to the radio terminal, and if it is overloaded, it is assigned. A wireless terminal is selected and other wireless terminals are dropped (S112).

After performing the action, the wireless terminal k acquires feedback of quality measurement information after the wireless base stations measure the wireless communication quality and exchange information between the wireless base stations, and obtains state S by y _k (t). Calculate _k (t+1) and reward Γ _k (t) (S114). Then, the wireless terminal k substitutes the reward Γ _k (t) into the following equation (25), updates Q(x _k (t), y _k (t)) in the Q table (S116), and Replacement is performed (S118).

As described above, the wireless communication system according to the embodiment updates the attribute destination based on the attribute information calculated based on the quality measurement information. decline can be suppressed.

In addition, the radio communication system according to the embodiment not only improves frequency utilization efficiency, but also avoids congestion at radio base stations as much as possible, and converts continuous radio communication quality into a discrete state. , whether the quality measurement information obtained by information collection is stable, and to which radio base station each radio virtual interface should belong in each case. The method has been made applicable.

In addition, in the wireless communication system according to the embodiment, in parallel with operation, the learning results of reinforcement learning are shared among wireless terminals, and based on the learning results, centralized control by the central control station according to the location of the failure. , distributed control by wireless terminals. In other words, in both control methods, it is considered that there is some feature in the method of reinforcement learning that enables optimization using the learning results corresponding to each switching operation corresponding to the fault occurrence location.

10... Radio communication system, 20... Radio base station, 22... Radio communication unit, 23... Communication I/F unit, 24... Quality measurement unit, 25... Information notification unit, 26... Request information evaluation unit, 27... Request response notification unit, 28... Attribution information recording unit, 30... Wireless terminal, 32... Wireless communication unit, 33... Control information calculation unit , 34... Attribution destination request unit, 35... Attribution destination recording unit, 100... Network, 330... State calculation unit, 332... Remuneration calculation unit, 334... Q table management unit, 336 ... belonging destination calculation unit

Claims (6)

A radio communication control method for controlling radio communication between a plurality of radio terminals and a plurality of radio base stations,
Quality measurement information based on radio communication quality between a radio base station and radio terminals belonging to the radio base station and radio communication quality between other radio terminals belonging to other radio base stations is provided to each radio terminal. a notification step of notifying the
a calculation step of calculating belonging information for selecting any one of the wireless base stations capable of improving the wireless communication quality as a new belonging destination based on the notified quality measurement information;
a recording step of recording the attribution information so as to update the attribution destination of the wireless terminal based on the calculated attribution information;
including
The calculation step includes:
Radio communication using states discretely representing radio communication quality based on current quality measurement information between a radio base station and a radio terminal and behavior representing a combination of radio terminals belonging to each radio base station Calculating belonging information for selecting any one of the wireless base stations whose quality can be improved as a new belonging destination
A wireless communication control method characterized by: The calculation step includes:
Any one of the radio base stations capable of improving the radio communication quality is newly selected by selecting the element with the maximum gain from a plurality of elements included in the Q table showing discrete combinations of the states and the actions. The wireless communication control method according to claim 1, further comprising: calculating belonging information to be selected as a belonging destination. The calculation step includes:
3. The method according to claim 2, wherein a reward is calculated based on quality measurement information between a radio base station and a radio terminal, and the calculated reward is used to repeatedly update gains of a plurality of elements included in the Q table. wireless communication control method. The calculation step includes:
4. The state according to claim 3, wherein the state is a product of a matrix indicating which radio base station the radio terminal belongs to and a matrix indicating whether the gain is equal to or greater than a predetermined value. Wireless communication control method. The calculation step includes:
5. The radio according to claim 4, wherein the gain is calculated based on the data rate in radio communication between the radio base station and the radio terminal, the requested data rate, the average packet size, and the band utilization rate of the radio base station. Communication control method. The calculation step includes:
For any of one wireless terminal for which attribute information is calculated, another wireless terminal located near the wireless terminal for which attribute information is calculated, and one or more specified wireless terminals, the above 6. The wireless communication control method according to claim 5, further comprising: calculating a state and said reward.

Images