Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
CN118219259B - A control system and method for a throat swab sampling robot - Google Patents
[go: Go Back, main page]

CN118219259B - A control system and method for a throat swab sampling robot - Google Patents

A control system and method for a throat swab sampling robot

Info

Publication number
CN118219259B
CN118219259B CN202410322087.8A CN202410322087A CN118219259B CN 118219259 B CN118219259 B CN 118219259B CN 202410322087 A CN202410322087 A CN 202410322087A CN 118219259 B CN118219259 B CN 118219259B
Authority
CN
China
Prior art keywords
control module
node
sampling
information
visual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202410322087.8A
Other languages
Chinese (zh)
Other versions
CN118219259A (en
Inventor
孟庆虎
洪悦
孟令啸
赵梓淇
王建坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southern University of Science and Technology
Original Assignee
Southern University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southern University of Science and Technology filed Critical Southern University of Science and Technology
Priority to CN202410322087.8A priority Critical patent/CN118219259B/en
Publication of CN118219259A publication Critical patent/CN118219259A/en
Application granted granted Critical
Publication of CN118219259B publication Critical patent/CN118219259B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Program-controlled manipulators
    • B25J9/16Program controls
    • B25J9/1602Program controls characterised by the control system, structure, architecture
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Program-controlled manipulators
    • B25J9/16Program controls
    • B25J9/1694Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Manipulator (AREA)

Abstract

The application discloses a throat swab sampling robot control system and a throat swab sampling robot control method, wherein the throat swab sampling robot control system comprises a main control module, a hardware control module, a visual control module and a comprehensive control module which are sequentially in communication connection, wherein the main control module is used for receiving visual tracking information sent by the visual control module, sending prompt and running state information to the comprehensive control module and performing instruction information interaction with the hardware control module, the hardware control module is used for performing information interaction of a sampling mechanism with the visual control module and transmitting voice playing information to the comprehensive control module, and the visual control module is used for transmitting voice playing or text image prompt information to the comprehensive control module and receiving visual tracking activation information sent by the comprehensive control module, so that flexibility and expandability of the throat swab sampling robot are improved, and various uncertain problems possibly occurring in a sampling process can be intelligently handled.

Description

Throat swab sampling robot control system and method
Technical Field
The application relates to the technical field of robots, in particular to a throat swab sampling robot control system and method.
Background
The throat swab sampling is a routine inspection operation in modern clinical medicine, and the throat swab sampling robot can replace human beings, and can complete inspection consumable access, personnel information acquisition, verification, target sampling position identification and positioning, throat swab scraping sampling, sampling effectiveness discrimination, sample collection, disinfection, sterilization, fault treatment and other works completely independently.
In the prior art, a throat swab sampling robot generally adopts a mode of a hardware control mechanical structure, but the hardware control programming of the existing throat swab sampling robot is relatively complex, the flexibility and the expandability are insufficient, the functions are relatively insufficient, and various uncertain problems possibly occurring in the sampling process can not be well solved.
Disclosure of Invention
In view of the above, the application provides a throat swab sampling robot control system and a throat swab sampling robot control method, which are used for solving the problems that the throat swab sampling robot with a hardware control mechanical structure in the prior art is insufficient in flexibility and expandability and cannot well cope with various uncertainty possibly occurring in the sampling process.
The application provides a throat swab sampling robot control system which comprises a main control module, a hardware control module, a visual control module and a comprehensive control module which are sequentially in communication connection;
The main control module is used for receiving the visual tracking information of the visual control module, releasing the visual tracking state of the throat swab sampling robot in real time according to the visual tracking information, simultaneously sending a text prompt message or an operation state message to the comprehensive control module, and controlling the comprehensive control module to display the text prompt message or the operation state message on a user interface of the throat swab sampling robot in real time;
The hardware control module is used for carrying out information interaction with the visual control module, issuing a motion instruction of a sampling mechanism of the throat swab sampling robot in real time according to information provided by the visual control module, transmitting voice playing information to the comprehensive control module, and controlling the comprehensive control module to control the throat swab sampling robot to play voice;
The visual control module is used for monitoring the throat of a patient, tracking the position of the throat, transmitting voice playing information or text image prompt information to the comprehensive control module, and controlling the throat swab sampling robot to start a visual servo tracking function after receiving the visual tracking activation message sent by the comprehensive control module;
the comprehensive control module is used for receiving the sampling information transmitted by the main control module, the hardware control module and the visual control module, displaying the sampling information on a user interface of the throat swab sampling robot in real time, sending the visual tracking activation message to the visual control module, and controlling the visual tracking function of the robot system.
Optionally, the main control module is used for receiving the visual tracking message sent by the visual control module, and the main control module is used for issuing the current visual tracking state of the throat swab sampling robot in real time after receiving the visual tracking message sent by the visual control module, the main control module is used for sending a text prompt message or an operation state message to the comprehensive control module, and the comprehensive control module is used for displaying the text prompt message or the operation state message on the throat swab sampling robot in real time after receiving the text prompt message or the operation state message;
the hardware control module is used for carrying out information interaction of a sampling mechanism with the visual control module and issuing a motion instruction of the sampling mechanism in real time according to the direction of deviation of a target point, and is used for transmitting voice playing information to the comprehensive control module, and the comprehensive control module receives the voice playing information and then controls the throat swab sampling robot to carry out voice playing in real time;
The visual control module is used for transmitting the voice playing information or the text image prompt information to the comprehensive control module, and the comprehensive control module receives the voice playing information or the text image prompt information and then controls the throat swab sampling robot to play voice or prompt text image in real time;
The integrated control module is used for receiving the text prompt message or the running state message sent by the main control module and displaying the text prompt message or the running state message on the throat swab sampling robot, the integrated control module is used for receiving the voice playing message transmitted by the hardware control module and displaying the voice playing message on the throat swab sampling robot, the integrated control module is used for receiving the voice playing message or the text image prompt message transmitted by the visual control module and displaying the voice playing message or the text image prompt message on the throat swab sampling robot, and the integrated control module is used for sending the visual tracking activation message to the visual control module.
Optionally, the main control module includes a monitoring window node and a main state machine node, the monitoring window node is communicatively connected to the main state machine node, and interaction between the operation state message and the manual intervention service is performed between the monitoring window node and the main state machine node;
The hardware control module comprises a hardware driving node and a servo sampling node, and the hardware driving node is in communication connection with the servo sampling node;
the main state machine node is in communication connection with the servo sampling node and is used for sending a sampling start message to the servo sampling node, and the monitoring window node is in communication connection with the hardware driving node and is used for executing instruction information interaction with the hardware driving node.
Optionally, the main control module further comprises a password verification node, wherein the password verification node is used for performing authority verification when medical staff logs in.
Optionally, the hardware driving node comprises a CAN communication driving node, a portal frame driving node, a mobile mask driving node, a 3-PRS driving node, a clamping jaw driving node and a motion control node;
the CAN communication driving node is used for completing bidirectional CAN communication between the upper computer and the lower computer;
the portal frame driving node and the movable mask driving node are used for controlling the motions of the portal frame of the sampling robot and the motor of the movable mask;
the 3-PRS driving node is used for controlling the motion of a 3-PRS sampling hand of the throat swab sampling robot;
The clamping jaw driving node is used for controlling the opening and closing of a swab clamping jaw of the sampling robot;
the motion control node is used for multi-mechanism cooperative motion control and mechanism modularization operation;
the servo sampling node is used for jointly controlling the portal frame, the movable mask and the sampling hand of the 3-PRS so as to realize force servo scraping sampling.
Optionally, the vision control module includes a face tracking node communicatively connected to the hardware driving node and the master state machine node, respectively;
the face tracking node is used for sending a visual tracking end message to the main state machine node and interacting position information and quick motion information of the sampling mechanism with the hardware driving node.
Optionally, the integrated control module includes a voice interaction node, a sampled window node and an identity verification node, where the identity verification node is respectively connected to the voice interaction node and the sampled window node in a communication manner, and the identity verification node is used for sending a voice playing message to the voice interaction node and sending a sampled information message to the sampled window node;
The voice interaction node is respectively connected with the face tracking node and the servo sampling node in a communication way, and is used for receiving voice playing information of the face tracking node and the servo sampling node;
The sampled window node is respectively in communication connection with the face tracking node and the main state machine node, and is used for receiving text prompt messages and running state messages of the face tracking node and the main state machine node;
the identity verification node is in communication connection with the face tracking node, and the identity verification node is used for sending a vision tracking activation message to the face tracking node.
Optionally, the main control module, the hardware control module, the visual control module and the comprehensive control module perform communication interaction through a first communication mode and a second communication mode of the ROS1 system;
the first communication mode is unilateral information release and information receiving, the information release and the information receiving are mutually independent and do not interfere, and the second communication mode is that a service request sends a request to a service provider, and the service provider responds and feeds back the request.
Optionally, the operation state message is the current operation state of the throat swab sampling robot issued by the main control module in real time, and the manual intervention service inputs configuration parameters and manual intervention instructions for medical staff in an interaction window.
Optionally, the position information of the sampling mechanism includes position information of a portal frame of the sampling mechanism and an end of a moving mask of the sampling mechanism, and the interaction of the rapid movement information of the sampling mechanism includes receiving a relative movement instruction of the sampling mechanism and driving the sampling mechanism to complete rapid following when visual servo throat tracking is completed.
The application also provides a throat swab sampling robot control method based on the throat swab sampling robot control system, which comprises the following steps:
The main control module receives the visual tracking information of the visual control module, issues the visual tracking state of the throat swab sampling robot in real time according to the visual tracking information, simultaneously sends a text prompt message or an operation state message to the comprehensive control module, and controls the comprehensive control module to display the text prompt message or the operation state message on a user interface of the throat swab sampling robot in real time;
The hardware control module performs information interaction with the visual control module, issues a motion instruction of a sampling mechanism of the throat swab sampling robot in real time according to information provided by the visual control module, transmits voice playing information to the comprehensive control module, and controls the comprehensive control module to control the throat swab sampling robot to play voice;
The vision control module monitors the throat of a patient, tracks the position of the throat, transmits voice playing information or text image prompt information to the comprehensive control module, and controls the throat swab sampling robot to start a vision servo tracking function after receiving a vision tracking activation message sent by the comprehensive control module;
The comprehensive control module receives the sampling information transmitted by the main control module, the hardware control module and the visual control module, displays the sampling information on a user interface of the throat swab sampling robot in real time, and sends the visual tracking activation message to the visual control module to control the visual tracking function of the robot system.
The application has the advantages that the application is different from the prior art, the software control system is divided into a plurality of independent functional modules according to the functional modules by arranging the main control module, the hardware control module, the visual control module and the comprehensive control module which are sequentially connected, each functional module comprises a plurality of program nodes which can independently operate, each node communicates with each other through information and service, the whole operation is realized, the main control module is used for receiving visual tracking information sent by the visual control module, sending prompt and running state information to the comprehensive control module and performing instruction information interaction with the hardware control module to realize the function of the main control module, and secondly, the hardware control module is used for carrying out information interaction of a sampling mechanism with the visual control module and transmitting voice playing information to the comprehensive control module, and thirdly, the visual control module is used for transmitting voice playing or text image prompt information to the comprehensive control module and receiving visual tracking activation information sent by the comprehensive control module, and is applied to the modularized development of the ROS1 system, and is based on the characteristics of communication, flexible and extensible, the robot software control system realizes the whole operation control of the robot by using the 1 operation system, has a certain expandability, is convenient for the new function, the expandability of the sensor can not be increased, and the intelligent sampling device can not be ensured, and the sampling process can not be ensured.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application as claimed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic block diagram of a control system of a throat swab sampling robot of the present application;
FIG. 2 is a schematic diagram illustrating the operation of a preferred embodiment of the throat swab sampling robot control system of the present application;
fig. 3 is a flow chart of a preferred embodiment of the throat swab sampling robot control method of the present application.
Detailed Description
In order to enable those skilled in the art to better understand the technical scheme of the present application, the following describes in further detail a throat swab sampling robot control system and method provided by the present application with reference to the accompanying drawings and detailed description. It is to be understood that the depicted embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terms "first," "second," and the like in this disclosure are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
The application provides a throat swab sampling robot control system and a throat swab sampling robot control method, which are used for solving the problems that in the prior art, the throat swab sampling robot with a hardware control mechanical structure is insufficient in flexibility and expandability and can not well cope with various uncertainty possibly occurring in the sampling process.
Referring to fig. 1 to 2, fig. 1 is a schematic block diagram of a control system of a throat swab sampling robot according to the present application, and fig. 2 is a schematic node diagram of a preferred embodiment of the control system of a throat swab sampling robot according to the present application.
The application provides a throat swab sampling robot control system, which is shown in fig. 1 and 2, wherein the throat swab sampling robot control system comprises a main control module 51, a hardware control module 52, a visual control module 53 and a comprehensive control module 54 which are sequentially in communication connection, wherein the main control module 51 is used for receiving visual tracking information sent by the visual control module 53, the main control module 51 is used for sending current visual tracking state of the throat swab sampling robot in real time after receiving the visual tracking information sent by the visual control module 53, the comprehensive control module 51 is used for sending text prompt information or running state information to the comprehensive control module 54, the comprehensive control module 54 is used for sending the text prompt information or the running state information to the throat swab sampling robot in real time, the comprehensive control module 54 is used for interacting with execution instruction information of the hardware control module 52 and using execution instruction information to control the hardware control module 52, the hardware control module 52 is used for interacting with information of a sampling mechanism and sending a movement instruction of the sampling mechanism according to the direction of a target point deviation, the comprehensive control module 52 is used for sending voice playing information to the comprehensive control module 54, the comprehensive control module 54 is used for controlling the throat swab to play real-time after receiving the voice playing information, the real-time control module 54 receives the voice playing information, the text prompt information is used for playing the visual image information, the visual sampling robot is used for playing the visual image information, or the comprehensive control module is used for playing the visual information is used for playing the visual prompt information, or is used for playing the visual information, or is used for playing, for is used for real, the visual control module 53 starts the visual servo throat tracking function of the throat swab sampling robot after receiving the visual tracking activation message sent by the comprehensive control module 54, the comprehensive control module 54 is used for receiving the text prompt message or the running state message sent by the main control module 51 and displaying the text prompt message on the throat swab sampling robot, the comprehensive control module 54 is used for receiving the voice playing message transmitted by the hardware control module 52 and displaying the voice playing message on the throat swab sampling robot, the comprehensive control module 54 is used for receiving the voice playing message or the text image prompt message transmitted by the visual control module 53 and displaying the voice playing message or the text image prompt message on the throat swab sampling robot, and the comprehensive control module 54 is used for sending the visual tracking activation message to the visual control module 53.
In the embodiment, the software control system is divided into a plurality of independent functional modules according to the functional modules by arranging the main control module, the hardware control module, the visual control module and the comprehensive control module which are sequentially connected in a communication way, each functional module comprises a plurality of program nodes which can independently operate, the nodes are mutually communicated through messages and services to realize overall operation, the main control module is used for receiving visual tracking messages sent by the visual control module, sending prompt and running state messages to the comprehensive control module and performing instruction information interaction with the hardware control module to realize the function of the main control module, and secondly, the hardware control module is used for carrying out information interaction of a sampling mechanism with the visual control module and transmitting voice playing information to the comprehensive control module, and thirdly, the visual control module is used for transmitting voice playing or text image prompt information to the comprehensive control module and receiving visual tracking activation messages sent by the comprehensive control module, and is applied to the modularized development of an ROS1 system, and based on the characteristics of communication and flexible and extensible, and the robot software control system realizes overall operation control of a robot by using the ROS1 operation system, and has a certain expandability, so that the intelligent swab can not be ensured in the following steps.
Further, the main control module comprises a monitoring window node and a main state machine node, the monitoring window node is in communication connection with the main state machine node, interaction of operation state information and manual intervention service is carried out between the monitoring window node and the main state machine node, the hardware control module comprises a hardware driving node and a servo sampling node, the hardware driving node is in communication connection with the servo sampling node, interaction of sampling mechanism fast motion information, sampling mechanism position information and force feedback condition information is carried out between the hardware driving node and the servo sampling node, the main state machine node is in communication connection with the servo sampling node and is used for sending sampling start information to the servo sampling node, and the monitoring window node is in communication connection with the hardware driving node and is used for carrying out execution instruction information interaction with the hardware driving node.
The main state machine node is used for completing the whole flow control, fault monitoring and processing of the sampling robot, and the monitoring window node is used for the functions of operation control of medical personnel interaction windows, manual intervention of operation of the main state machine, parameter configuration, fault, log feedback and the like, and simultaneously provides the functions of screen locking and the like.
Further, the main control module further comprises a password verification node, and the password verification node is used for performing authority verification when medical staff logs in.
The medical staff password verification service comprises the steps of inputting a medical staff ID, a name and a password, feeding back whether a user has machine operation authority and whether the password is matched, wherein the manual intervention service is to input configuration parameters of an interaction window of the medical staff and feed back manual intervention instructions to be a state machine response result, and the operation state information is the current operation state issued by the main control module in real time.
Further, the hardware driving nodes comprise CAN communication driving nodes, portal frame driving nodes, mobile mask driving nodes, 3-PRS driving nodes, clamping jaw driving nodes and motion control nodes;
The CAN communication driving node is used for completing bidirectional CAN communication between the upper computer and the lower computer;
the portal frame driving node and the movable mask driving node are used for controlling the movement of motors of the portal frame and the movable mask of the sampling robot;
the 3-PRS driving node is used for controlling the movement of a 3-PRS sampling hand of the throat swab sampling robot;
the clamping jaw driving node is used for controlling the opening and closing of a steering engine of a swab clamping jaw of the sampling robot;
The motion control node is used for realizing complex multi-mechanism cooperative motion control and mechanism modularization operation;
the servo sampling node is used for jointly controlling the portal frame, the movable mask and the sampling hand of the 3-PRS so as to realize force servo scraping sampling.
The hardware driving node further comprises a force sensor driving node, a seat control node, a UPS monitoring node and other equipment driving nodes, wherein the force sensor driving node is used for interacting with the force sensor, the seat control node is used for controlling the liftable seat, the UPS monitoring node is used for monitoring the working state of an Uninterruptible Power Supply (UPS), and the other equipment driving nodes are used for controlling mechanisms including a movable door plate, test tube storage, swab storage and the like and communicating with sensors such as a photoelectric door and the like.
Further, the vision control module comprises a face tracking node which is respectively connected with the hardware driving node and the main state machine node in a communication way;
the face tracking node is used for sending a visual tracking end message to the main state machine node, and interacting the position information and the quick motion information of the sampling mechanism with the hardware driving node, and can also be used for completing the functions of face recognition, image acquisition, mouth opening detection, throat three-dimensional positioning and the like.
Further, the comprehensive control module comprises a voice interaction node, a sampled window node and an identity verification node, wherein the identity verification node is respectively in communication connection with the voice interaction node and the sampled window node, and is used for sending a voice playing message to the voice interaction node and sending a sampled information message to the sampled window node;
The voice interaction node is respectively connected with the face tracking node and the servo sampling node in a communication way, and is used for receiving voice playing information of the face tracking node and the servo sampling node;
the sampled window node is respectively connected with the face tracking node and the main state machine node in a communication way, and is used for receiving text prompt messages and running state messages of the face tracking node and the main state machine node;
the identity verification node is in communication connection with the face tracking node, and the identity verification node is used for sending a vision tracking activation message to the face tracking node.
The identity verification node can also acquire and verify identity information of the sampled person through the modes of identity card reading or face recognition and the like, the voice interaction node can also generate voice prompt in a sampling stage, and the window node of the sampled person can also face the visual interface of the sampled person to display prompt characters, information of the sampled person, image guidance/prompt information and the like.
Further, the main control module, the hardware control module, the visual control module and the comprehensive control module are in communication interaction through a first communication mode and a second communication mode of the ROS1 system;
the first communication mode is a 'message' mode, namely unilateral information release and information receiving, the information release and the information receiving are mutually independent and do not interfere with each other or are not synchronous, the second communication mode is a 'service' mode, namely a service request sends a request to a service provider, and the service provider responds and feeds back the request, so that the method has synchronism.
Further, the operation state information is the current operation state of the throat swab sampling robot issued by the main control module in real time, and the manual intervention service inputs configuration parameters and manual intervention instructions for medical staff in an interaction window.
Further, the position information of the sampling mechanism comprises the position information of the end of a portal frame of the sampling mechanism and the position information of the end of a movable mask of the sampling mechanism, and the interaction of the rapid movement information of the sampling mechanism comprises the steps of receiving a relative movement instruction of the sampling mechanism and driving the sampling mechanism to complete rapid following when visual servo throat tracking is finished.
The execution instruction service is specifically a motor/equipment control instruction in the form of an input character string, the feedback execution is successful or not, the execution script service is specifically a motor/equipment control script file name in the form of the input character string, the feedback execution is successful or not, the force feedback condition information is specifically a reading of a force feedback sensor, the sampling mechanism position information is specifically a tail end position information of a sampling mechanism (comprising a portal frame and a movable mask), the sampling mechanism rapid movement information is specifically a relative movement instruction of the receiving sampling mechanism, the sampling mechanism is driven to complete corresponding actions (used for rapid following of the sampling mechanism when visual servo throat tracking), the sampling start information is specifically a received information, the sampling mechanism starts to execute sampling operation, and the sampling end information is specifically a successful/failed release of sampling after the sampling is ended.
Further, when the visual tracking activation message is monitored, the visual servo throat tracking is started, when the visual throat servo tracking is finished, the visual tracking finishing message is issued, and the voice playing message and the text prompting message are issued according to the deviating azimuth of the target point while the visual throat servo tracking is finished.
The visual tracking activation message is specifically that when the message is monitored, visual servo throat tracking is started, the visual tracking ending message is specifically that when the visual throat servo tracking is ended, the message is issued, the voice playing message is specifically that when the visual throat servo tracking is carried out, the voice prompt message and the text prompt message are issued according to the direction of deviation of the target point, the sampling mechanism rapid movement message is specifically that in the visual servo throat tracking process, the sampling mechanism movement instruction is issued in real time according to the direction of deviation of the target point, the image message is specifically that in the visual servo throat tracking process, the image of the throat part of a person to be sampled is issued after being highlighted and identified, and the image visual guidance of the image is provided for the person to be sampled.
In the integrated control module, the voice playing message is specifically a voice content in the form of a received character string, and plays corresponding audio, the text prompting message is specifically a text prompting content in the form of a received character string, and is displayed on a window of a sampled person, the information message of the sampled person is specifically a sampled person information obtained by issuing a code scanning or face recognition, the image message is specifically a received image message, and the image message is displayed on an interface in real time to the sampled person.
In some real-time examples, the throat swab sampling robot control system of the present application may be further based on an ROS1 system (i.e., a robot operating system (Robot Operating System, i.e., a robot operating system), where the control system is designed to be split according to the function according to the characteristics of the ROS1 system, each simple functional unit (node) may operate in the system independently and in parallel in a thread manner, and each node communicates with each other in a message and service manner to transfer necessary information.
Referring to fig. 3, fig. 3 is a flowchart of a method for controlling a throat swab sampling robot according to a preferred embodiment of the present application.
The application also provides a throat swab sampling robot control method based on the throat swab sampling robot control system of the embodiment, which comprises the following steps:
Step S100, the main control module receives the visual tracking information of the visual control module, issues the visual tracking state of the throat swab sampling robot in real time according to the visual tracking information, simultaneously sends a text prompt message or an operation state message to the comprehensive control module, and controls the comprehensive control module to display the text prompt message or the operation state message on a user interface of the throat swab sampling robot in real time;
Step 200, the hardware control module performs information interaction with the vision control module, issues a motion instruction of a sampling mechanism of the throat swab sampling robot in real time according to information provided by the vision control module, transmits voice playing information to the comprehensive control module, and controls the comprehensive control module to control the throat swab sampling robot to play voice;
Step 300, the vision control module monitors the throat of a patient and tracks the position of the throat, transmits voice playing information or text image prompt information to the comprehensive control module, and controls the throat swab sampling robot to start a vision servo tracking function after receiving a vision tracking activation message sent by the comprehensive control module;
And step 400, the comprehensive control module receives the sampling information transmitted by the main control module, the hardware control module and the visual control module, displays the sampling information on a user interface of the throat swab sampling robot in real time, and sends the visual tracking activation message to the visual control module to control the visual tracking function of the robot system.
In summary, the application comprises a main control module, a hardware control module, a visual control module and a comprehensive control module which are sequentially connected in a communication way, so that the software control system is divided into a plurality of independent functional modules according to the functional modules, each functional module comprises a plurality of program nodes which can independently operate, the nodes communicate with each other through messages and services to realize the whole operation, the main control module is used for receiving visual tracking messages sent by the visual control module, sending prompt and running state messages to the comprehensive control module and performing execution instruction information interaction with the hardware control module to realize the function of the main control module, and secondly, the hardware control module is used for performing information interaction of a sampling mechanism with the visual control module and transmitting voice playing information to the comprehensive control module, and thirdly, the visual control module is used for transmitting voice playing or text image prompt information to the comprehensive control module and receiving visual tracking activation messages sent by the comprehensive control module, and is applied to the modularized development of an ROS1 system, and is based on the characteristics of communication, flexible and extensible, and the robot software control system uses an ROS1 operation system to realize the whole operation control of a robot, has a certain function, is convenient for later stage, the device is convenient, the expandability and can not confirm the problem of the sampling performance of a swab in a machine.
It should be noted that, the various alternative embodiments described in the embodiments of the present application may be implemented in combination with each other, or may be implemented separately, which is not limited to the embodiments of the present application.
In the description of the present application, it should be understood that the terms "upper," "lower," "left," "right," and the like indicate an orientation or a positional relationship based on that shown in the drawings, and are merely for convenience in describing the present application and simplifying the description, and do not indicate or imply that the apparatus or element in question must have a specific orientation, as well as a specific orientation configuration and operation. Therefore, it should not be construed as limiting the application. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.
In the description of the present application, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and the like are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected, mechanically connected, electrically connected, directly connected, indirectly connected via an intervening medium, or in communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.
The embodiments described above are described with reference to the drawings, and other different forms and embodiments are possible without departing from the principle of the application, and therefore the application should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will convey the scope of the application to those skilled in the art. In the drawings, component dimensions and relative dimensions may be exaggerated for clarity. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. The terms "comprises," "comprising," and/or "includes," when used in this specification, specify the presence of stated features, integers, components, and/or groups thereof, but do not preclude the presence or addition of one or more other features, integers, components, and/or groups thereof. Unless otherwise indicated, numerical ranges are stated to include the upper and lower limits of the range and any subranges therebetween.
The foregoing description is only a partial embodiment of the present application, and is not intended to limit the scope of the present application, and all equivalent devices or equivalent processes using the descriptions and the drawings of the present application or directly or indirectly applied to other related technical fields are included in the scope of the present application.

Claims (8)

1.一种咽拭子采样机器人控制系统,其特征在于,包括依次通信连接的主控制模块、硬件控制模块、视觉控制模块和综合控制模块;1. A control system for a throat swab sampling robot, characterized in that it comprises a main control module, a hardware control module, a vision control module, and an integrated control module that are sequentially connected in communication; 所述主控制模块用于接收所述视觉控制模块的视觉追踪消息,并根据所述视觉追踪消息实时发布咽拭子采样机器人的视觉追踪状态,同时向所述综合控制模块发送文本提示消息或运行状态消息,并控制所述综合控制模块将所述文本提示消息或所述运行状态消息实时显示于所述咽拭子采样机器人的用户界面上;The main control module is used to receive visual tracking messages from the visual control module, and publish the visual tracking status of the pharyngeal swab sampling robot in real time according to the visual tracking messages. At the same time, it sends text prompt messages or running status messages to the integrated control module, and controls the integrated control module to display the text prompt messages or running status messages on the user interface of the pharyngeal swab sampling robot in real time. 所述主控制模块包括监控窗口节点和主状态机节点,所述监控窗口节点通信连接于所述主状态机节点,所述监控窗口节点与所述主状态机节点之间进行所述运行状态消息和人工干预服务的交互;The main control module includes a monitoring window node and a main state machine node. The monitoring window node is communicatively connected to the main state machine node, and the monitoring window node and the main state machine node interact with each other to exchange the running status messages and manual intervention services. 所述硬件控制模块包括硬件驱动节点和伺服采样节点,所述硬件驱动节点通信连接于所述伺服采样节点;The hardware control module includes a hardware driver node and a servo sampling node, and the hardware driver node is communicatively connected to the servo sampling node. 所述主状态机节点通信连接于所述伺服采样节点,且用于向所述伺服采样节点发送采样开始消息,所述监控窗口节点通信连接于所述硬件驱动节点,且用于与所述硬件驱动节点进行执行指令信息交互;The master state machine node is communicatively connected to the servo sampling node and is used to send a sampling start message to the servo sampling node. The monitoring window node is communicatively connected to the hardware driver node and is used to interact with the hardware driver node to exchange execution instruction information. 所述硬件驱动节点包括CAN通信驱动节点、龙门架驱动节点与移动面罩驱动节点、3-PRS驱动节点、夹爪驱动节点和运动控制节点;The hardware driving nodes include a CAN communication driving node, a gantry driving node and a moving mask driving node, a 3-PRS driving node, a gripper driving node and a motion control node. 所述CAN通信驱动节点用于完成上位机与下位机间的双向CAN通信;The CAN communication driver node is used to complete bidirectional CAN communication between the host computer and the slave computer. 所述龙门架驱动节点与所述移动面罩驱动节点用于控制采样机器人的龙门架与移动面罩的电机运动;The gantry drive node and the moving mask drive node are used to control the motor movement of the gantry and moving mask of the sampling robot. 所述3-PRS驱动节点用于控制所述咽拭子采样机器人的3-PRS采样手的运动;The 3-PRS drive node is used to control the movement of the 3-PRS sampling hand of the pharyngeal swab sampling robot; 所述夹爪驱动节点用于控制采样机器人的拭子夹爪的开合;The gripper drive node is used to control the opening and closing of the swab gripper of the sampling robot; 所述运动控制节点用于多机构协作运动控制和机构模块化操作;The motion control node is used for multi-mechanism collaborative motion control and modular operation of mechanisms; 所述伺服采样节点用于联合控制所述龙门架、所述移动面罩以及所述3-PRS的采样手,以实现力伺服刮擦采样;The servo sampling node is used to jointly control the gantry, the moving mask, and the sampling hand of the 3-PRS to achieve force servo scraping sampling; 所述硬件控制模块用于与所述视觉控制模块进行信息交互,根据所述视觉控制模块提供的信息实时发布所述咽拭子采样机器人的采样机构的运动指令,并向所述综合控制模块传递语音播放信息,控制所述综合控制模块控制所述咽拭子采样机器人进行语音播放;The hardware control module is used to interact with the vision control module, and to issue motion commands for the sampling mechanism of the pharyngeal swab sampling robot in real time based on the information provided by the vision control module. It also transmits voice playback information to the integrated control module and controls the integrated control module to control the pharyngeal swab sampling robot to play voice. 所述视觉控制模块用于监测患者咽喉并追踪咽喉位置,并向所述综合控制模块传递语音播放信息或文本图像提示信息,当接收到所述综合控制模块发送的视觉追踪激活消息后,控制所述咽拭子采样机器人启动视觉伺服追踪功能;The visual control module is used to monitor the patient's throat and track its position, and transmit voice playback information or text image prompts to the integrated control module. When it receives the visual tracking activation message sent by the integrated control module, it controls the throat swab sampling robot to start the visual servo tracking function. 所述综合控制模块用于接收所述主控制模块、所述硬件控制模块及所述视觉控制模块传递的采样信息,并实时在所述咽拭子采样机器人的用户界面上展示,并发送所述视觉追踪激活消息至所述视觉控制模块,控制机器人系统的视觉追踪功能。The integrated control module is used to receive sampling information transmitted by the main control module, the hardware control module and the vision control module, display it in real time on the user interface of the throat swab sampling robot, and send the vision tracking activation message to the vision control module to control the vision tracking function of the robot system. 2.根据权利要求1所述的咽拭子采样机器人控制系统,其特征在于,所述主控制模块还包括密码核验节点,所述密码核验节点用于在医务人员登录时进行权限验证。2. The throat swab sampling robot control system according to claim 1, wherein the main control module further includes a password verification node, the password verification node being used to verify permissions when medical personnel log in. 3.根据权利要求1所述的咽拭子采样机器人控制系统,其特征在于,所述视觉控制模块包括面部追踪节点,所述面部追踪节点分别通信连接于所述硬件驱动节点和所述主状态机节点;3. The pharyngeal swab sampling robot control system according to claim 1, wherein the vision control module includes a face tracking node, and the face tracking node is communicatively connected to the hardware driver node and the main state machine node respectively; 所述面部追踪节点用于向所述主状态机节点发送视觉追踪结束消息,并与所述硬件驱动节点进行采样机构的位置信息和快速运动信息的交互。The face tracking node is used to send a visual tracking end message to the main state machine node and to interact with the hardware driver node to obtain the position information and rapid motion information of the sampling mechanism. 4.根据权利要求3所述的咽拭子采样机器人控制系统,其特征在于,所述综合控制模块包括语音交互节点、被采样者窗口节点和身份核验节点,所述身份核验节点分别通信连接于所述语音交互节点和所述被采样者窗口节点,所述身份核验节点用于向所述语音交互节点发送语音播放消息,以及用于向所述被采样者窗口节点发送被采样者信息消息;4. The throat swab sampling robot control system according to claim 3, characterized in that the integrated control module includes a voice interaction node, a sampled person window node and an identity verification node, wherein the identity verification node is communicatively connected to the voice interaction node and the sampled person window node respectively, and the identity verification node is used to send a voice playback message to the voice interaction node and to send a sampled person information message to the sampled person window node. 所述语音交互节点分别通信连接于所述面部追踪节点和所述伺服采样节点,所述语音交互节点用于接收所述面部追踪节点和所述伺服采样节点的语音播放消息;The voice interaction node is communicatively connected to the face tracking node and the servo sampling node, respectively, and the voice interaction node is used to receive voice playback messages from the face tracking node and the servo sampling node; 所述被采样者窗口节点分别通信连接于所述面部追踪节点和所述主状态机节点,所述被采样者窗口节点用于接收所述面部追踪节点和所述主状态机节点的文本提示消息和运行状态消息;The sampled user window node is communicatively connected to the face tracking node and the main state machine node, respectively. The sampled user window node is used to receive text prompt messages and running status messages from the face tracking node and the main state machine node. 所述身份核验节点通信连接于所述面部追踪节点,所述身份核验节点用于向所述面部追踪节点发送视觉追踪激活消息。The identity verification node is communicatively connected to the face tracking node, and the identity verification node is used to send a visual tracking activation message to the face tracking node. 5.根据权利要求1所述的咽拭子采样机器人控制系统,其特征在于,所述主控制模块、所述硬件控制模块、所述视觉控制模块和所述综合控制模块之间通过ROS1系统的第一通信方式和第二通信方式进行通信交互;5. The pharyngeal swab sampling robot control system according to claim 1, characterized in that the main control module, the hardware control module, the vision control module and the integrated control module communicate and interact with each other through the first communication method and the second communication method of the ROS1 system; 其中,所述第一通信方式为单方面的发布信息和接收消息,且信息发布者与信息接收者相互独立且互不干预,所述第二通信方式为服务请求方向服务提供方发出请求,再由所述服务提供方进行响应和反馈。The first communication method involves one-way information publishing and message receiving, with the information publisher and the information receiver being independent of each other and not interfering with each other. The second communication method involves the service requester sending a request to the service provider, which then responds and provides feedback. 6.根据权利要求1所述的咽拭子采样机器人控制系统,其特征在于,所述运行状态消息为所述主控制模块实时发布的所述咽拭子采样机器人的当前运行状态,所述人工干预服务为医务人员在交互窗口输入配置参数及输入人工干预指令。6. The pharyngeal swab sampling robot control system according to claim 1, wherein the operating status message is the current operating status of the pharyngeal swab sampling robot published in real time by the main control module, and the manual intervention service is the input of configuration parameters and manual intervention instructions by medical personnel in the interactive window. 7.根据权利要求4所述的咽拭子采样机器人控制系统,其特征在于,所述采样机构的位置信息包括所述采样机构的龙门架和所述采样机构的移动面罩的末端位置信息,所述采样机构的快速运动信息的交互包括接收所述采样机构的相对运动指令,并驱动所述采样机构完成视觉伺服咽喉追踪时的快速跟随。7. The throat swab sampling robot control system according to claim 4, wherein the position information of the sampling mechanism includes the end position information of the gantry of the sampling mechanism and the moving mask of the sampling mechanism, and the interaction of the rapid motion information of the sampling mechanism includes receiving the relative motion command of the sampling mechanism and driving the sampling mechanism to complete the rapid following when visually servoing throat tracking. 8.一种基于权利要求1-7任一项所述的咽拭子采样机器人控制系统的咽拭子采样机器人控制方法,其特征在于,包括:8. A method for controlling a pharyngeal swab sampling robot based on the pharyngeal swab sampling robot control system according to any one of claims 1-7, characterized in that it comprises: 所述主控制模块接收所述视觉控制模块的视觉追踪消息,并根据所述视觉追踪消息实时发布咽拭子采样机器人的视觉追踪状态,同时向所述综合控制模块发送文本提示消息或运行状态消息,并控制所述综合控制模块将所述文本提示消息或所述运行状态消息实时显示于所述咽拭子采样机器人的用户界面上;The main control module receives the visual tracking message from the visual control module, and publishes the visual tracking status of the pharyngeal swab sampling robot in real time according to the visual tracking message. At the same time, it sends a text prompt message or running status message to the integrated control module, and controls the integrated control module to display the text prompt message or running status message on the user interface of the pharyngeal swab sampling robot in real time. 所述硬件控制模块与所述视觉控制模块进行信息交互,根据所述视觉控制模块提供的信息实时发布所述咽拭子采样机器人的采样机构的运动指令,并向所述综合控制模块传递语音播放信息,控制所述综合控制模块控制所述咽拭子采样机器人进行语音播放;The hardware control module interacts with the vision control module, and releases motion commands for the sampling mechanism of the pharyngeal swab sampling robot in real time based on the information provided by the vision control module. It also transmits voice playback information to the integrated control module, and controls the integrated control module to control the pharyngeal swab sampling robot to play voice. 所述视觉控制模块监测患者咽喉并追踪咽喉位置,并向所述综合控制模块传递语音播放信息或文本图像提示信息,当接收到所述综合控制模块发送的视觉追踪激活消息后,控制所述咽拭子采样机器人启动视觉伺服追踪功能;The visual control module monitors the patient's throat and tracks its position, and transmits voice playback information or text image prompts to the integrated control module. When it receives the visual tracking activation message sent by the integrated control module, it controls the throat swab sampling robot to start the visual servo tracking function. 所述综合控制模块接收所述主控制模块、所述硬件控制模块及所述视觉控制模块传递的采样信息,并实时在所述咽拭子采样机器人的用户界面上展示,并发送所述视觉追踪激活消息至所述视觉控制模块,控制机器人系统的视觉追踪功能。The integrated control module receives sampling information from the main control module, the hardware control module, and the vision control module, displays it in real time on the user interface of the throat swab sampling robot, and sends the vision tracking activation message to the vision control module to control the vision tracking function of the robot system.
CN202410322087.8A 2024-03-20 2024-03-20 A control system and method for a throat swab sampling robot Active CN118219259B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410322087.8A CN118219259B (en) 2024-03-20 2024-03-20 A control system and method for a throat swab sampling robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410322087.8A CN118219259B (en) 2024-03-20 2024-03-20 A control system and method for a throat swab sampling robot

Publications (2)

Publication Number Publication Date
CN118219259A CN118219259A (en) 2024-06-21
CN118219259B true CN118219259B (en) 2025-11-04

Family

ID=91507302

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410322087.8A Active CN118219259B (en) 2024-03-20 2024-03-20 A control system and method for a throat swab sampling robot

Country Status (1)

Country Link
CN (1) CN118219259B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115399809A (en) * 2022-10-20 2022-11-29 苏州小二智能机器人有限公司 Sample auxiliary collection robot
CN115922725A (en) * 2022-12-28 2023-04-07 山东大学 Positioning system of throat swab sampling robot

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11974731B2 (en) * 2020-05-26 2024-05-07 Tsinghua University Automatic throat swab sampling system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115399809A (en) * 2022-10-20 2022-11-29 苏州小二智能机器人有限公司 Sample auxiliary collection robot
CN115922725A (en) * 2022-12-28 2023-04-07 山东大学 Positioning system of throat swab sampling robot

Also Published As

Publication number Publication date
CN118219259A (en) 2024-06-21

Similar Documents

Publication Publication Date Title
CN104887312B (en) Exchange method, auxiliary device, auxiliary system, unit and the system of auxiliary device
CN112469539B (en) robotic system
CN112352285A (en) Context-aware systems and methods for computer-assisted surgery systems
CN114224498B (en) Master-slave control system for complex airway multi-mode tracheal intubation robot
CN110993087A (en) A kind of remote ultrasonic scanning manipulation device and method
CN102335017A (en) Interventional therapy auxiliary mechanical arm
CN115607294B (en) Surgical robot system and data processing method
CN118219259B (en) A control system and method for a throat swab sampling robot
CN117840968A (en) Remote operation bidirectional control system and method for robot based on master-slave force feedback
CN109129471A (en) A kind of long-range gestural control system and method for the robot device for medical field
CN110547874B (en) Method for establishing movement paths, components thereof and application in automation equipment
JP7173079B2 (en) WORK RESUME SYSTEM, MANUFACTURING METHOD, AND PROGRAM
CN113311787A (en) Multi-axis servo control system and method
JP7515126B2 (en) Robot arm motion control method, system and surgical system
CN114699169A (en) Multi-mode navigation intubation system
Chella et al. A BCI teleoperated museum robotic guide
KR20130015441A (en) Surgical robot system
CN208552018U (en) Auxiliary puncture device of robot
CN105159157B (en) Video auxiliary system for industry mechanical arm remote control
CN113223709B (en) Surgical procedure backtracking system, method and storage medium
CN107745384A (en) A kind of both arms cooperation robot
CN112527001A (en) Intelligent inspection robot control system and control method
Morse et al. Magellan: Technical description of a new system for robot-assisted nerve blocks.
CN211355577U (en) Control system for scanning probe of automatic ultrasonic scanner
CN113616239A (en) Automatic ultrasonic detection method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant