JP7796411B2 - Service provision system - Google Patents

Description

The present invention is a system that allows a service provider to remotely provide guidance to a service recipient on nursing care, rehabilitation, training guidance, or treatment (which refers to not only Western medicine but also acupuncture, moxibustion, Chinese herbal medicine, Eastern medicine, massage, osteopathy, Ayurveda, aromatherapy, and other general treatments; the same applies hereinafter) through a support person, such as an expert in the service.

Traditionally, for example, a person with a nursing qualification (such as a certified care worker in Japan) provides nursing care services to elderly people who are service recipients. A person with a rehabilitation qualification (such as a physical therapist in Japan) provides rehabilitation services to patients who are service recipients. A person with a training qualification (such as a trainer at a sports gym) provides training guidance services to service recipients. A person with a medical qualification (such as a doctor, moxibustion therapist, or judo therapist in Japan) provides treatment services to patients who are service recipients.

The problem of nursing care is serious in an aging society.
It is also important to provide appropriate treatment and rehabilitation before reaching the point of needing care.
Furthermore, in order to prevent sarcopenia, locomotive syndrome, frailty, etc., training to maintain and strengthen muscles and endurance is also important.
It is also possible to maintain good health by incorporating not only Western medicine but also Chinese herbal medicine, acupuncture, massage, and various other treatment methods as appropriate.

Traditionally, qualified individuals (hereafter referred to as "professionals") provided services directly to service recipients, such as elderly people. For example, in the case of home care, a professional would visit the recipient's home to provide services such as nursing care, rehabilitation, training guidance, and treatment.

It would be ideal if professionals could provide home care services, but as the aging population continues to grow, there are concerns that there will be a shortage of professional caregivers. This is not just a problem in Japan.
When there is a shortage of personnel, experienced professionals have no choice but to train those with no experience or little experience.
It would be ideal if inexperienced or less experienced workers could receive direct guidance from experienced professionals and provide care and other services in pairs, but given the current shortage of professionals, it is difficult to provide guidance in pairs.

Japanese Patent Application Laid-Open No. 2002-99623 Japanese Patent Application Laid-Open No. 2006-244125 Japanese Patent Application Laid-Open No. 2003-16189 Japanese Patent Application Laid-Open No. 2001-325362 Patent Publication No. 2008-242980

The present invention aims to realize a system (hereinafter referred to as a "service provision system") that enables a person who provides services such as nursing care, rehabilitation, training guidance, and treatment (hereinafter referred to as a "service provider") to provide services to a person who receives the services, such as an elderly person (hereinafter referred to as a "service recipient"), with a qualified person or an experienced professional (hereinafter referred to as a "support person") remotely supervising the service provider and providing the services to the service recipient.

In order to solve the above problems, the present invention has the following features.
The present invention is a service providing system comprising at least one server system, at least one service provider system, and at least one rear support terminal.
The server system stores a database of manual information for use in providing nursing, rehabilitation, training instruction, or treatment services to service recipients.
The service provider system includes at least a wearable terminal that can be worn on the head.
The wearable terminal displays the manual information obtained from the server system, allowing the service provider to provide the service to the service recipient while viewing the manual information.
The rear support terminal is a terminal used by a rear supporter who has specialized knowledge about the service, and is capable of communicating with a wearable terminal worn by the service provider who is providing the service, allowing the rear supporter to provide guidance to the service provider using the communication function.

The service provider system transmits an interview sheet showing the results of an interview about the status of the service recipient to the server system.
The server system creates a plan for providing the service based on the hearing sheet sent from the service provider system.

The hearing sheet will be prepared based on the ICF (International Classification of Functioning, Disability and Health).

The server system creates the plan using artificial intelligence that has a trained plan creation learning model that has been trained to create plans from interview sheets.

The rear support terminal transmits the plan modified by the rear supporter to the server system.
The server system uses the hearing sheet and the revised plan to retrain the plan creation learning model.

The server system extracts the manual information for use in the plan.
The wearable terminal displays the manual information extracted by the server system.

The server system extracts manual information to be used in the plan using artificial intelligence with a trained manual information extraction model that has been trained to extract manual information from the hearing sheet and plan.

The rear support terminal transmits to the server system guidance information that has been modified and/or added to the manual information used in the plan extracted by the server system, based on the guidance given to the service provider.
The server system re-learns the manual information extraction model based on the hearing sheet, the plan, and the instruction information.

The server system preprocesses the database based on the training information and then performs re-learning.

Preprocessing is the process of adding new manual information to the database if the instruction information is manual information that is not stored in the database.

Manual information is stored in a database linked to the attributes of service recipients.

The service providing system further includes a vital information acquisition terminal for acquiring vital information of the service recipient.
The server system stores the vital information from the vital information acquisition terminal.

The server system determines whether the stored vital information is appropriate, and if it is not, instructs the rear support terminal to revise the plan or manual information.

The service providing system further includes a user terminal used by the service recipient.
A service recipient can use a user terminal to select whether the service is provided in the real world, online, or in the metaverse.

The service providing system further includes a system for a metaverse space.
When provision of a service in the metaverse space is selected, the service recipient can receive the service within the metaverse space.

Manual information for services online or in the metaverse space is also stored in the database.

The manual information includes manual information for using the equipment used to provide the service, and equipment experts are included as support personnel.

The present invention also provides a service provision system comprising at least one server system, at least one service recipient system, and at least one rear support terminal, wherein the server system stores a database of manual information used when providing nursing care, rehabilitation, training guidance, or treatment services to service recipients, and the service recipient system includes at least a wearable terminal that can be worn on the head, and the wearable terminal displays the manual information obtained from the server system so that the service recipient can receive the service while viewing the manual information, and the rear support terminal is a terminal used by a rear support person who has specialized knowledge about the service, and is capable of communicating with the wearable terminal worn by the service recipient receiving the service, allowing the rear support person to provide guidance to the service recipient using the communication function.
That is, the wearable device may be used by the service recipient regardless of whether there is a service provider.

According to the present invention, manual information is displayed on the service provider's wearable device, leaving both hands free for the service provider, making it easier to provide services to service recipients. Furthermore, the service can be provided while receiving advice from a rear support person using a rear support terminal as needed. Therefore, even inexperienced service providers can provide high-quality services.

This invention provides a system that allows professionals to remotely instruct and instruct service providers on appropriate care methods, or supports remote diagnosis by medical professionals using a proxy service provider. Because service providers are inexperienced, there are concerns about accidents. Care provided by inexperienced caregivers can be unsettling for those receiving care, and poor care can place physical and mental strain on the recipient. The same is true for medical diagnoses.
By using the system of the present invention, both hands are free to use, and the image from the service provider's line of sight is transmitted to the caregiver or doctor who is providing rear support, so that the rear supporter can provide safe guidance as if they were looking directly at the service recipient. This sense of safety and security is one of the advantages of this system.

A service provision plan will be created based on the interview sheet, making it possible to provide appropriate services.

By creating interview sheets based on an ICF-based perspective, it becomes possible to provide optimal services to service recipients.

By using artificial intelligence with a trained model to create a plan based on an interview sheet, it is possible to easily create a high-quality plan.

Furthermore, by having the AI re-learn plans revised by rear supporters, it is possible to further strengthen the trained model.

By automatically extracting the manual information used in the plan in the server system, the service provider's system eliminates the need to select manual information, improving the quality of service provided.

By using artificial intelligence with a trained model to extract the manual information necessary to provide the services described in the plan, it is possible to extract the most appropriate manual information.

If a support staff member modifies or adds to the manual information used in the plan, the trained model can be retrained based on that instructional information, further strengthening the trained model.

Preprocessing the training information before the above relearning process will make relearning easier.

As an example of the above preprocessing, if the training information is manual information that is not stored in the database, adding new manual information to the database strengthens the content of the database as new manual information is accumulated, making it easier to retrain using a trained model.

By storing the service recipient's vital signs on the server system, it becomes possible to provide appropriate services while checking the vital signs.

If vital information is inappropriate, the service content may not be appropriate. In this case, the server system will instruct the customer to review the plan or manual information, thereby providing the optimal service.

By allowing users to choose whether to provide services in the real world, online, or metaverse, it becomes possible to provide services tailored to the needs of service recipients. Providing services online or in the metaverse improves productivity.

By including manual information for using equipment that can be used in nursing care in the manual information and having experts on the equipment act as supporters, it will become easier to provide services such as nursing care using nursing robots, etc. Furthermore, the manufacturer of the equipment will be able to remotely check the actual on-site use of nursing care robots, etc., and will be able to obtain information that will be useful for future development. This will eliminate concerns about using nursing care robots, etc., and the use of nursing care robots, etc. is expected to improve the productivity of service provision.

Furthermore, according to the present invention, service recipients can provide self-care, self-training, self-rehabilitation, and self-treatment, in which they provide care, training, rehabilitation, and treatment themselves while receiving guidance from support staff.

These and other objects, features, aspects, and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

FIG. 1 is a block diagram showing the overall configuration of a service providing system according to an embodiment of the present invention. FIG. 2 is a flowchart showing the overall flow from application for a service to the provision of the service in the service providing system. FIG. 3 is a block diagram showing the functional configuration of the server 1 when the plan creation AI program is being executed. FIG. 4 is a block diagram showing the functional configuration of the server 1 when the manual information extraction AI program is executed. FIG. 5 is a diagram showing the exchange between the service provider system and the rear support terminal when the service provider provides a service. FIG. 6 is a block diagram showing the functional configuration of the server 1 when new learning data is learned by the manual information extraction AI program. FIG. 7 is a flowchart showing the vital information feedback process in the server 1. FIG. 8 is a flowchart showing the operations of the user terminal 21 and the server 1 when a service application is made from the user terminal 21. FIG. 9 is a flowchart showing the operations of the user terminal 21 and the server 1 at the time of payment.

In Figure 1, the service provision system comprises a server 1, a service receiver system 2, at least one service provider system 3, at least one service center 4, at least one rear support terminal 5, a center terminal 6, an item management device 7, and a metaverse space system 8, all of which are connected via a network.

Server 1 is a computer device that can execute the stored overall operation program to realize the operations described below in Figure 2. Server 1 has a plan creation AI program, a manual information extraction AI program, and a manual information correction program.

The plan creation AI program and manual information extraction AI program each have a trained model.

The plan creation program is an artificial intelligence that uses a trained model to create plans based on an interview sheet that interviews the service recipient's situation based on the ICF (International Classification of Functioning, Disability and Health).
The hearing sheet used for input does not have to be one based on the ICF. The hearing sheet used for input does not have to be one based on the ICF, as long as it is capable of gathering information about the service recipient's health condition, medical condition, care status, lifestyle habits, living environment, etc. Hereinafter, it will be simply referred to as the hearing sheet.

The manual information extraction AI program is an artificial intelligence that uses a trained model to extract manual information to be used in the plan.
The manual information indicates a manual for providing the content of the service, such as how to change diapers, how to take a bath, how to do muscle training, etc.

However, depending on the health condition and care status of the service recipient, it may not be possible to provide the same care, rehabilitation, and training.
For example, when it comes to leg-raising training, leg-raising training for a bedridden elderly person, leg-raising training for an elderly person who is confined to a wheelchair, and leg-raising training for an elderly person who can walk with a walker are all different.
Therefore, the manual information is linked to the attributes of the service recipient (for example, bedridden elderly people, wheelchair-bound elderly people, elderly people who can walk with a walker, etc.).

The manual information correction program is a program used to preprocess data for relearning by the manual information extraction AI program.

As shown in Figure 1, the server 1 stores the ICF hearing sheet input results, a provisional plan, a final plan, a manual information database, manual information used in the final plan, guidance information, and vital information. Each piece of data is stored linked to the service recipient's identification information.
It goes without saying that information other than the data shown in the figure, such as personal information of service recipients, service providers, and support staff, as well as basic programs for communication processing, contract processing, payment processing, etc., are stored on the server.

Server 1 may be realized by a single computer device, or by multiple computer devices. Therefore, Server 1 will be referred to as a server system.

The service recipient system 2 is a system that exists on the side of the service recipient (elderly people, people with disabilities, patients, people requiring care, etc.), and includes at least a user terminal 21 and a vital information acquisition terminal 22.
The user terminal 21 is a computer device such as a smartphone, a tablet terminal, or a personal computer.
The vital sign information acquisition terminal 22 is a device capable of acquiring at least one piece of vital sign information such as pulse rate, heart rate, blood pressure, blood oxygen concentration, etc., and is, for example, a smart watch.

The service provider side system 3 is a system that exists on the side of a party (service provider) that provides a service to a service recipient, and includes at least a wearable terminal 31 and a service provider terminal 32 .
The wearable terminal 31 is a head-mounted device such as smart glasses or a head-mounted display that can display images in the field of view while viewing the real space. The wearable terminal 31 includes a communication function and can communicate with the rear support terminal 5. The wearable terminal 31 also includes a microphone and a camera, and can capture images of the surroundings of the service provider and transmit the captured data to the rear support terminal 5.
The wearable terminal 31 may be capable of communicating with the rear support terminal 5 via the service provider terminal 32 or other communication devices.

The manual information is displayed on the wearable terminal 31. The service provider can provide the service to the service recipient while looking at the displayed manual information.
In addition, data captured by the wearable terminal 31 is transmitted to the rear support terminal 5, and through two-way communication with the rear support terminal 5, the service provider can provide services to the service recipient while receiving guidance from the rear supporter.

The service provider terminal 32 is a computer device such as a smartphone, tablet terminal, or personal computer. The service provider uses the service provider terminal 32 to execute the necessary information processing as appropriate.

The service center 4 is a center to which the service provider and the back-office supporter belong. Note that the service provider and the back-office supporter may not belong to the service center 4 but may be external persons.
The service center 4 includes a rear support terminal 5, a center terminal 6, and an item management device 7.
There may be multiple service centers 4, for example, for each region.

The rear support terminal 5 is a computer device that is capable of two-way communication of voice, images, text information, etc. with the service provider system 3.

The center terminal 6 is a computer device that receives a service application from the service receiver system 2 received by the server 1, automatically or manually selects an appropriate service provider, and makes a request to the service provider system 3.
All operations of the center terminal 6 may be performed by the server system. That is, the server system may automatically or manually select an appropriate service provider in response to a service application received from the service receiver system 2, and request the service provider system 3 to provide the service.

A possible variation is to create an account for each service center 4 on the server 1, and each service center logs in to the server 1 to select and notify service providers and rear supporters on the server 1. In this case, the center side terminal 6 becomes a terminal for logging in to the server 1, and the server 1 is responsible for transmitting information to service providers and rear supporters.
Furthermore, the center terminal 6 as a login terminal may also be eliminated, and the server 1 itself may select and notify the service provider and rear supporter.

The item management device 7 manages the inventory and shipping of items necessary for providing services (supplements, medicines, exercise equipment, rehabilitation equipment, nursing care products, etc.), and is a device that makes arrangements for shipping the necessary items when requested by the service provider terminal 32 and the rear support terminal 5.
The operation of the goods management device 7 may be performed by a server system.
The item management device 7 may also be located outside the service center 7 .

The metaverse space system 8 is a computer device that can provide the service recipient system 2, the service provider system 3, and the rear support terminal 5 with a metaverse space that can be used for training or rehabilitation when the service recipient requests training or rehabilitation in the metaverse space as part of the service.

For example, if a service recipient is doing aerobic exercise as part of their training, while they are taking a walk around the neighborhood, the metaverse space system 8 can cause the user terminal 21 (or a head-mounted wearable terminal used by the service recipient) to display the service recipient moving through the metaverse space. At that time, the service provider system 3 and rear support terminal 5 can also enter the same metaverse space and give advice and motivation to the service recipient, allowing them to carry out their training or rehabilitation in a relaxed and enjoyable manner. Furthermore, by allowing other service recipients to enter the same metaverse space, service recipients can enjoy their training or rehabilitation while communicating with each other, which can lead to increased motivation.

With reference to Figure 2, we will explain the overall operation of the service provider system from application for service to provision of service. Note that the figure numbers marked with an "*" in Figure 2 indicate that details are provided in Figure 3 and beyond.

In the service provider system 2, a service recipient or a related person applies for a service to the server 2 using a user terminal 21 (S1). As shown in Fig. 8 described later, the service recipient can select whether the service is provided in real space, online, or in the metaverse space.
Here, regardless of which option is selected, the process will proceed to the next step S2 and subsequent steps for creating a plan.
However, if the provision of the service is selected to be online or in the metaverse space, the service may be provided with the service content specified by the service recipient without proceeding to the creation of the plan.

The server 2 selects a service center 4 that will be responsible for providing the service to the service recipient, and instructs the center-side terminal 66 of the selected service center 4 to create a care plan (S2).
The selection of the service center 4 by the server 2 may be performed automatically, taking into consideration the location of the service recipient, the state of care, the desired service content, etc., or the operator may select the service center 4 manually.

Upon receiving the instruction from the server 2, the center terminal 6 selects a service provider to interview the service recipient and instructs the service provider system 3 to interview the service recipient (S3).

A hearing request is sent to the service provider system 3 used by the selected service provider (S4). The service provider who received the hearing request visits the location of the service recipient or hears about the status of the service recipient online.
For example, the interview is conducted based on the ICF by listening to the positive and negative aspects from the perspectives of health status, physical and mental functions, physical structure, activity, participation, environmental factors, and personal factors. However, as mentioned above, the interview may be conducted using perspectives other than the ICF.

For example, let us consider the case of a 78-year-old woman shown in Figure 3. We assume that she has osteoarthritis of the knee, which causes pain and makes it difficult to bend the knee, and that she needs care. We also assume that she has a history of high blood pressure.
In this case, in the health condition section, knee osteoarthritis is input as the disease name and high blood pressure is input as the medical history into the service provider terminal 32 .

After interviewing the patient about his physical and mental functions and physical structure, we found that, on the positive side, there were no problems with his cognitive functions. On the negative side, we found that there was a limit to the range of motion of his right knee. Although not shown in Figure 3, it would be a good idea to accurately measure the range of motion numerically.

As a result of interviews about the individual's activities, it was found that, on the positive side, the individual is able to eat and use the toilet independently. However, there is a possibility of leakage, and it was discovered that the individual uses diapers. On the negative side, it was found that the individual needs to move around with a cane, has difficulty bathing in a bathtub, and can only take showers.

As a result of interviews regarding participation, it was found that most of the time was spent at home.
As a result of interviews about environmental factors, it was found that in terms of physical environment, there were stairs in the home and there was a lot of traffic in the neighborhood. In terms of human environment, it was found that the person lived alone.
Personal factors included a 78-year-old woman, 160 cm tall, weighing 68 kg, and a hobby of reading.

The service provider enters the results of this hearing into the service provider terminal 32. The service provider terminal 32 then transmits the results of the hearing sheet input to the server 1 (S5).

Server 1 uses the results of the interview sheet as input and executes the plan creation AI program to create a provisional care plan (hereinafter referred to as the "provisional plan") (S6).

Here, the operation of the plan creation AI program will be described with reference to FIG.
The plan creation AI program has a plan creation trained model, which is a model trained by machine learning (including deep learning) using previously created ICF hearing sheets as input as training data and previously created plans (plans previously created by professionals such as logistics support personnel) as output.
In addition, even if the plan is not based on the ICF, it is also possible to use as learning data a plan created based on a hearing sheet that shows the results of interviews regarding the service recipient's health condition, medical condition, care status, lifestyle habits, living environment, etc.

The results of the interview sheet (whether or not an ICF is used) accurately represent the health status, care needs, and disability status of the service recipient. The plan is information summarizing the necessary care, rehabilitation, training, treatment, etc. based on the health status, care needs, and disability status.
Therefore, there is a correlation between the results of the interview sheet input and the plan.
Therefore, the trained model is constructed based on this correlation and can be used as a learning model for artificial intelligence.

By inputting the results of a new interview sheet created by the service provider into this learning model, the plan creation AI program will automatically create a new plan (provisional plan).

Returning to the explanation of the operation in Fig. 2, in S6, the server 1 transmits the created tentative plan to the service provider side system 3. The service provider side system 3 transmits the transmitted tentative plan to the rear support side terminal 5 (S5).
The server 1 may directly transmit the tentative plan to the rear support terminal 5 .

The rear support person using the rear support terminal 5 checks the contents of the tentative plan, makes any necessary corrections, and transmits the tentative plan as a final plan to the service provider system 3 (S7). At this time, the rear support terminal 5 also transmits the final plan to the server 1 as appropriate.
The service provider system 3 transmits the received plan to the service receiver system 2 (S8).

When the service recipient (or a related party) contracts for the provision of services under the received plan, the service recipient system 2 is used to proceed to electronic contract and electronic payment (S9).
Once the contract is signed, the plan is finalized. The finalized plan will be referred to as the finalized plan.

Once the contract and payment are complete, the center terminal 6 selects a service provider and a support person based on the finalized plan and notifies the service provider and support person of the service recipient's information (S10). This selection should be performed automatically or manually based on the area of expertise.

As shown in FIG. 3, the provisional plan created by the plan creation AI program is a plan to perform hip lifts and squats once a week.
When the support staff checked this tentative plan, they determined that patella setting, hip lifts, and squats were required three times a week, as well as knee massage once a week, and the plan was revised accordingly.
The server 1 uses this finalized plan and the corresponding ICF hearing sheet as new learning data and has the plan creation AI program re-learn the correlation between them, thereby further strengthening the learning model for plan creation (S11 in FIG. 2).

If selected, the service provider system 3 and the rear support terminal 5 confirm acceptance (S12 and S13).
The selected service provider and logistical supporter may be the same as or different from the service provider and logistical supporter involved in creating the plan.

Next, Server 1 extracts the manual information used in the service content of the confirmed plan using a manual information extraction AI program (S14).

Here, using Figure 4, we will explain the operation of server 1 when executing the manual information extraction AI program.

The premise is that the manual information should be divided according to the attributes of the care recipient (symptoms, medical condition, age, etc.). For example, there may be circumstances where a person has a limited range of motion in their knees and is unable to perform difficult squats. Therefore, the manual information needs to be broken down into detailed categories according to attributes such as symptoms, medical condition, and age.
As shown in FIG. 4, different manuals are registered in the manual information database depending on such attributes, even for the same rehabilitation menu or the same massage menu.
The manual information is not just textual information explaining how to provide services such as nursing care, rehabilitation, training, and massage, but also includes a variety of information such as photographs, videos, and audio guides, allowing even inexperienced service providers to provide services.

The manual information extraction trained model possessed by the manual information extraction AI program is a learning model that learns the correlation between the input training data, which is interview sheets and plans, and the output manual information to be used (created by professionals such as support staff). This learning is carried out using machine learning (including deep learning).

Since the interview sheet is correlated with the attributes of the service recipient, and the plan is correlated with the manual information to be used, the learning model can take into account the correlation between the attributes and manual information and extract the manual information to be used that it deems optimal from the manual information database.

Server 1 inputs the results of the interview sheet and the final plan into the manual information extraction AI program, and can extract manual information linked to the attributes to be used as output. In the example shown in Figure 4, Server 1 extracts manual information about patella settings appropriate for attribute a (for example, the attribute "knee osteoarthritis").

The manual information database also stores manuals for online training and metaverse training. If a service recipient requests online or metaverse service delivery, this manual information will be extracted.

2, the server 1 transmits the manual information to be used in the final plan to the service provider system 3 and the rear support terminal 5 (S15). The service provider system 3 and the rear support terminal 5 receive the transmitted manual information (S16 and S17).
In addition, the service provider side system 3 may receive the manual information directly at the wearable terminal 31 and display it on the screen, or may transfer the manual information received at the service provider terminal 32 to the wearable terminal 31 and display it on the screen.

Next, the service provider will provide the service by actually visiting the service recipient, providing the service online, or providing the service using the metaverse space.
While the service is being provided, the service provider takes pictures of the service being provided using the camera and microphone included in the wearable terminal 31 (S18). The captured images and audio are stored in the server 1 as the service provider's behavior history (S19). The behavior history is also transmitted to the rear support terminal 5. Alternatively, the rear support terminal 5 can view the behavior history stored in the server (S22).

The service provider will provide the service to the service recipient while looking at the manual displayed on the wearable terminal 31. At this time, two-way communication is possible between the rear support terminal 5 and the wearable terminal 31 (or the service provider terminal 32), so that the status of the service provided by the service provider can be confirmed in real time on the rear support terminal 5, and the rear supporter can provide advice as appropriate (S22).

The service recipient also wears a vital sign information acquisition terminal 22. The vital sign acquisition terminal 22 measures vital sign information and transmits it to the server 1 (S20). Note that the vital sign information may also be transmitted to the server 1 via the user terminal 21.

The server 1 stores the transmitted vital information (S21). The service provider system 3 and the rear support terminal 5 can access the server 1 to check the stored vital information in real time or at a later time (S22).

Furthermore, if it is determined that some item is required to provide the service, the service provider system 3 and the rear support terminal 5 can arrange for the item management device 7 to deliver the required item.
If the item is needed, payment is made as appropriate using known techniques.

The advice may reveal that it would be better to correct the manual information extracted by the manual information extraction AI program. This point will be explained with reference to FIG.
As shown in Figure 5, initially, the service provider provided the service to the service recipient based on the manual information extracted by the manual information extraction AI program.
The situation is transmitted to the rear support terminal 5 as images and audio.

After observing the service recipient, the support staff determines that the load on the patella setting is too heavy, so they instruct the recipient to reduce the number of repetitions to two sets. They also instruct the recipient to increase the number of repetitions for squats to three sets. They also instruct the recipient to massage the backs of their knees.
Based on such guidance, the service provider can provide services that are appropriate for the service recipient, not only using the manual information extracted by the manual information extraction AI program, but also with support from rear support staff.

Then, the provision of the service is assumed to have ended (S23).

The rear support person inputs into the rear support terminal 5 what kind of guidance was given in response to the manual information extracted by the manual information extraction AI program, saves this as guidance information (S24), and sends it to the server 1 (S25).

The service provider system 3 reports to the center terminal 6 that the provision of the service has ended (S26). The service recipient uses the service recipient system 2 to send a message to the center terminal 6 that the service has been received and an evaluation of the service (S27). As a result, the center terminal 6 manages the case as having ended (S28).

The server 1 saves the training information sent from the rear support terminal 5 (S30) and has the manual information extraction AI program re-learn it (S31).

Using FIG. 6, the operation of the server 1 when the manual information extraction AI program is relearning will be described.
First, a manual information correction program is executed as a preprocessing step to allow the manual information extraction AI program to re-learn.

The manual information correction program receives input of guidance information, the results of the interview sheet input, and the finalized plan.
The manual information correction program determines whether the result of the instruction is new manual information that is not in the manual information database.
If it is new manual information (S301), the manual information correction program adds the instruction result to the manual information database as new manual information (S302). At this time, the attribute to be linked is extracted from the hearing sheet input result.

If the training results are already in the manual information database (S303), manual information for the corresponding attributes is obtained from the manual information database (S304).

In this way, the new manual information and/or existing manual information becomes revised manual information corresponding to the confirmed plan (S305), completing the pre-processing for relearning the manual information extraction AI program.

It is also possible to perform preprocessing other than the above and retrain the manual information extraction AI program.

Server 1 inputs the interview sheet input results and the finalized plan as new learning data into the manual information extraction AI program, and outputs the revised manual information, causing it to re-learn (S306). As a result, manual information that is in line with the actual provision of services is reflected in the manual information extraction trained model, strengthening the manual information extraction AI program.

In FIG. 2, after the operation of S31, the server 1 executes a feedback process for vital information (S32). The feedback process for vital information will be explained using FIG. 7.

Server 1 recognizes the content of the service provided to the service recipient (S401). Then, Server 1 recognizes the vital sign information at the time the service content was provided (S402). Because Server 1 stores the behavioral history of the service provider, it can recognize the vital sign information at the time the service was provided by comparing the date and time of the service provision with the date and time of the vital sign information.

Then, the server 1 determines whether the vital signs information at the time the service content was provided was appropriate (S403). For example, the server 1 determines whether the heart rate or blood pressure was extremely high.

If the vital information is appropriate, the server 1 determines to maintain the confirmed plan or manual information as is (S404).
If the vital information is not appropriate, the server 1 instructs the rear support side terminal 5 to reconsider the final plan or manual information (S405).

Note that the above-described feedback processing of vital information is merely an example, and other processing may be used, or artificial intelligence may be used for the feedback processing.

Next, with reference to Figure 8, we will explain the flow when applying for a service from the service receiver system 2. The operations shown in Figure 8 are realized through communication between the server 1 and the user terminal 21, and may be realized using a dedicated app or a web app.

First, a screen for starting a service application is displayed on the user terminal 21 (S501). Next, a screen for entering personal information is displayed on the user terminal 21 (S502). The service recipient (or a related party) enters their personal information. Next, a screen for selecting the type of service desired is displayed (S503). Type refers to whether the service is nursing care, rehabilitation, training, etc. The service recipient (or a related party) selects the type.

Next, a questionnaire entry screen is displayed on the user terminal 21 (S504). The service recipient (or a related party) enters information into the questionnaire.

Next, a selection screen is displayed on the user terminal 21 asking whether the user wishes to receive the service in real space (real) or in virtual space (S505). The service recipient (or a related party) makes a selection.

If virtual service provision is selected, a screen is displayed on the user terminal 21 prompting the user to select whether to receive online instruction or use the metaverse (S506). The service recipient (or a related party) makes the selection.

After that, regardless of which course is selected, an explanation of the upcoming process (S507), a screen for reserving a hearing date for creating a plan (S508), and an application completion screen (S509) are displayed, and the application for the service is completed.

You can also change your choice of real, online, or metaverse at a later date.

Next, the contract and settlement process will be described with reference to FIG.
The service provider system 3 presents the plan (S601), and the user terminal 21 receives the plan (S602). The server 1 also receives the plan, understands the service content of the plan, and automatically calculates the price (S603). The server 1 creates an estimate based on the calculated price and sends it to the user terminal 21, the service provider system 3, and the center terminal 6 (S604).

The quote may be for a one-off request or a monthly subscription.
For example, if you sign a subscription contract, it is a good idea to allow services to be used within the scope of the subscription contract up to a certain monthly amount.
At this time, the server 1 may count which services the service recipient receives each month, and if the amount exceeds a certain amount, the server 1 may charge the service recipient an additional fee.

The server 1 creates a contract form and sends it to the user terminal 21 (S605).

The user terminal 21 receives the estimate (S606) and the contract form (S607). If the service recipient (or a related party) agrees with the estimated amount, the service recipient uses the user terminal 21 to input information into the contract form (S608) and transmits it to the server 1 (S609).
Any known means may be used to send and receive the contract form.

The server 1 receives the input results into the contract form and directs the user terminal 21 to the payment screen (S610). When the payment information is input into the user terminal 21 (S611), the payment process is completed (S612).
Any known means can be used for the payment process.

(Another embodiment 1)
Currently, various robots that support nursing care are being developed around the world. These robots are designed to reduce the physical burden on caregivers and to support the activities of those receiving care.
Below are some examples of national projects supported by the Japanese government.
https://robotcare.jp/jp/home/index

By using these, even inexperienced caregivers can provide professional-level care.
However, nursing care and rehabilitation that utilizes robotic technology has not been taught much in nursing education or in education for physical therapists and occupational therapists.
Therefore, even if a robot automatically assists in nursing care or rehabilitation by pressing a button like a home appliance, it is a robot that comes into contact with the human body, and it is difficult to operate safely and securely unless it is operated with guidance to avoid incorrect use.

For this reason, if remote instruction such as that shown in the above-mentioned embodiment of the present invention were to include instruction on how to use robots and various devices, even amateurs would be able to provide professional-level care and rehabilitation. It is also conceivable that instructors (who would become "supporters") from manufacturers that develop devices to assist with caregiving could provide support from behind the scenes to ensure that the devices are used correctly.

Such support staff can provide instruction remotely from, for example, the manufacturer's office or the instructor's home, without having to go to the site, which should also improve the productivity of instruction.

In the past, even if care professionals wanted to use care robots and ICT equipment to reduce the strain on their lower backs and improve work efficiency, these devices were mechatronic products, and they were unable to determine what to do when a problem occurred, such as when the device stopped working. This anxiety led to people being afraid to use these devices even if they wanted to, and this prevented them from becoming widespread.
Using it while providing support from behind can alleviate this anxiety.

In addition, by directly connecting service providers with manufacturer instructors, it becomes possible to clarify usage methods that the manufacturer did not anticipate and any problems that arise as a result. As a result, know-how for providing new care and rehabilitation using robotic nursing equipment and other devices can be accumulated as data. Valuable data related to risk assessment can be obtained. While it has not been possible to accumulate this data until now, this invention makes it possible to accumulate the tacit knowledge of professionals in a visible form as digital data.

In light of the above, in another embodiment of the present invention, the plan may include the use of nursing care equipment, rehabilitation equipment, training equipment, or treatment equipment. Services using these equipment may also be included in the plan. Therefore, the manual information may include manual information on how to use these equipment.
Furthermore, equipment experts (manufacturer leaders and engineers, IT engineers, electrical engineers, mechanical engineers, etc.) will be included as supporters.

As in the previous embodiment, the service provider provides the service using a wearable device and a care robot, etc., while viewing the manual information, and the rear support person instructs the service provider on how to use the support device as appropriate. As the rear support person revises the manual information as instructional information in line with the actual actions of the service provider, a wealth of information on how to use the equipment is accumulated that is suited to the actual situation.

(Another embodiment 2)
In the above-described embodiments, a system has been described in which a service provider uses a wearable terminal to provide a service while receiving guidance from a rear supporter.
Another example of the use of this system is that, regardless of whether or not there is a service provider, the service recipient may wear a wearable device and use nursing care equipment, rehabilitation equipment, training equipment, or treatment equipment themselves while receiving guidance from a support person.
That is, another embodiment 2 of the present invention is a service providing system including at least one server system, at least one service receiver system, and at least one rear support terminal.
The server system stores a database of manual information for use in providing nursing, rehabilitation, training instruction, or treatment services to service recipients.
The service receiver system includes at least a wearable terminal that can be worn on the head.
The wearable terminal displays the manual information obtained from the server system, allowing the service recipient to receive the service while viewing the manual information.
The rear support terminal is a terminal used by a rear supporter who has specialized knowledge about the service, and is capable of communicating with a wearable terminal worn by the service recipient who is receiving the service, allowing the rear supporter to provide guidance to the service recipient using the communication function.
This will enable service recipients to receive direct guidance from support staff and properly use the equipment used to receive services, enabling them to engage in self-rehabilitation, self-training, self-care, and self-treatment using rehabilitation, training, care robots, treatment equipment, etc.
Alternative embodiment 2 is expected to contribute to resolving the labor shortage and promoting the spread of nursing care robots and the like.

(Other embodiment 3)
The service provider may also be the recipient's family member, housekeeper, friend, neighbor, etc. In such cases, it may not be necessary to pay the service provider.
By expanding the scope of service providers beyond non-professionals to include family and friends, the present invention is expected to further alleviate the shortage of personnel for providing services.

The present invention has been described in detail above, but the above description is merely illustrative of the present invention in all respects and is not intended to limit its scope. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. Each of the constituent elements of the invention disclosed in this specification is considered to be an independent, stand-alone invention. Inventions in which the constituent elements are combined in any manner are also included within the scope of the present invention.

This invention is a service provision system and has industrial applicability.

REFERENCE SIGNS LIST 1 Server 2 Service receiver system 21 User terminal 22 Vital information acquisition terminal 3 Service provider system 31 Wearable terminal 32 Service provider terminal 4 Service center 5 Rear support terminal 6 Center terminal 7 Goods management device

Claims (16)

A service providing system including at least one server system, at least one service provider system, and at least one rear support terminal,
The server system stores a database of manual information to be used when providing care, rehabilitation, training guidance, or treatment services to service recipients;
the service provider-side system includes at least a wearable terminal that can be worn on a head,
the wearable terminal displays the manual information obtained from the server system, allowing a service provider to provide the service to the service recipient while viewing the manual information;
the rear support side terminal is a terminal used by a rear supporter who has specialized knowledge about the service, and is capable of communicating with the wearable terminal worn by the service provider who is providing the service, so that the rear supporter can provide guidance to the service provider by using a communication function ;
the service provider system transmits a hearing sheet showing the results of hearing about the status of the service recipient to the server system;
A service providing system, characterized in that the server system creates a plan for providing the service based on the hearing sheet transmitted from the service provider system . 2. The service provider side system according to claim 1 , wherein the hearing sheet is created based on a viewpoint based on the International Classification of Functioning, Disability and Health (ICF). The service providing system of claim 1 , wherein the server system creates the plan using artificial intelligence having a trained plan creation learning model that has been trained to create the plan from the hearing sheet. the rear support side terminal transmits the plan modified by the rear support person to the server system;
4. The service providing system according to claim 3 , wherein the server system causes the plan creation learning model to re-learn using the hearing sheet and the revised plan. The server system extracts the manual information for use in the plan;
The service providing system according to claim 1 , wherein the wearable terminal displays the manual information extracted by the server system. The service providing system of claim 5, wherein the server system extracts the manual information to be used in the plan using artificial intelligence having a trained manual information extraction model that has been trained to extract the manual information from the hearing sheet and the plan. the rear support side terminal transmits to the server system guidance information that has been modified and/or added to the manual information used in the plan extracted by the server system based on the guidance given to the service provider;
7. The service providing system according to claim 6 , wherein the server system re-learns the manual information extraction model based on the hearing sheet, the plan, and the training information. 8. The service providing system according to claim 7 , wherein said server system preprocesses said database based on said instruction information and then performs said relearning. 9. The service providing system according to claim 8 , wherein the pre-processing is a process of adding new manual information to the database when the instruction information is manual information that is not stored in the database. 2. The service providing system according to claim 1 , wherein the manual information is stored in a database linked to attributes of the service recipients. Further provided is a vital information acquisition terminal for acquiring vital information of the service recipient,
2. The service providing system according to claim 1 , wherein the server system stores the vital information from the vital information acquisition terminal. The service provision system described in claim 11, characterized in that the server system determines whether the stored vital information is appropriate, and if it is not appropriate, instructs the rear support side terminal to modify the plan or the manual information. Further provided is a user terminal used by the service recipient,
The service providing system of claim 1 , wherein the service recipient can use the user terminal to select whether the service is provided in real space, online, or metaverse space. It also has a system for the metaverse space,
The service provision system described in claim 13 , characterized in that when provision of a service in the metaverse space is selected, the service recipient is able to receive provision of the service within the metaverse space . The service providing system according to claim 14 , wherein manual information for the online or metaverse space service is also stored in the database. the manual information includes manual information for using a device used to provide the service,
2. The service providing system according to claim 1, wherein the back-up supporters include experts on the equipment.