Repository Summary
Checkout URI | https://github.com/open-navigation/opennav_docking.git |
VCS Type | git |
VCS Version | humble |
Last Updated | 2024-11-22 |
Dev Status | MAINTAINED |
CI status | No Continuous Integration |
Released | RELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (0)
Good First Issues (0) Pull Requests to Review (0) |
Packages
Name | Version |
---|---|
opennav_docking | 0.0.2 |
opennav_docking_bt | 0.0.2 |
opennav_docking_core | 0.0.2 |
opennav_docking_msgs | 0.0.2 |
README
Open Navigation’s Nav2 Docking Framework
This package contains an automatic robot docking framework & auxiliary tools. It uses plugin dock
implementations for a particular platform to enable the framework to generalize to robots of many different kinematic models, charging methods, sensor modalities, and so on. It can also handle a database of many different docking locations and dock models to handle a heterogeneous environment. This task server is designed be called by an application BT or autonomy application to dock once completed with tasks or battery is low – not within the navigate-to-pose action itself (though undock
may be called from inside navigate actions!).
This work is sponsored by NVIDIA and created by Open Navigation LLC.
This is split into 4 packages
-
opennav_docking
: Contains the main docking framework -
opennav_docking_msgs
: Contains the action interfaces for docking and undocking -
opennav_docking_core
: Contains the dock plugin header file to be implemented for each dock type -
opennav_docking_bt
: Contains behavior tree nodes and example XML files using the docking task server -
nova_carter_docking
: Contains an implementation using the Docking system with the Nvidia Nova Carter Robot platform and dock.
NOTE: This capability has been migrated within Nav2 itself as of June 2024 and nova_carter_docking
was migrated to Nova Carter’s GitHub in August 2024.
⚠️ Need ROS 2, Nav2 help or support? Contact Open Navigation! ⚠️
Click on the image above to see an extended video of docking in action.
Architecture
The Docking Framework has 5 main components:
-
DockingServer
: The main action server and logic for performing the docking/undocking actions -
Navigator
: A NavigateToPose action client to navigate the robot to the dock’s staging pose if not with the prestaging tolerances -
DockDatabase
: A database of dock instances in an environment and their associated interfaces for transacting with each type. An arbitrary number of types are supported. -
Controller
: A spiral-based graceful controller to use for the vision-control loop for docking -
ChargingDock
: Plugins that describe the dock and how to transact with it (check if charging, detection, etc). You can find this plugin header in theopennav_docking_core
package.
The ChargingDock
plugins are the heart of the customizability of the framework to support any type of charging dock for any kind of robot. The DockDatabase
is how you describe where these docks exist in your environment to interact with and any of them may be used in your docking request.
The docking procedure is as follows:
- Take action request and obtain the dock’s plugin and its pose
- If the robot is not within the prestaging tolerance of the dock’s staging pose, navigate to the staging pose
- Use the dock’s plugin to initially detect the dock and return the docking pose
- Enter a vision-control loop where the robot attempts to reach the docking pose while its actively being refined by the vision system
- Exit the vision-control loop once contact has been detected or charging has started
- Wait until charging starts and return success.
If anywhere this procedure is unsuccessful, N
retries may be made by driving back to the dock’s staging pose and trying again. If still unsuccessful, it will return a failure code to indicate what kind of failure occurred to the client.
Undocking works more simply:
- If previously docked, use the known dock information to get the dock type. If not, use the undock action request’s indicated dock type
- Find the staging pose for this dock and back out to that pose
- Check if successfully backed out to the pose and charging has stopped
Interfaces
Docking Action
The docking action can either operate on a dock in the DockDatabase
or from a dock specified in the docking request. This second option is useful for testing or when dock’s locales are not necessarily known in advance.
If use_dock_id = true
, it uses the dock_id
field to specify which dock in the database to use.
Else, you must populate the dock_pose
and dock_type
fields.
If you wish for the docking server to stage your robot at the the dock’s staging pose for you, navigate_to_staging_pose
must be true.
Else, you can send your robot to this pose and it will be skipped as long as the robot is within the prestaging tolerances.
You may set the maximum time for navigation using max_staging_time
.
In return, you obtain the num_retries
, for the number of attempted retries of the action; success
, if the action worked and the robot is successfully charging; and errro_code
to return a semantically meaningful error code about what kind of error occurred, if any. See DockRobot.action
for more details.
While the action is performing, you can obtain feedback about the current state
of docking, how much time docking_time
has elapsed, and the current number of retries attempted.
Undocking Action
Undocking is similarly laid out. The action request contains the dock_type
which is optional if the docking server previously docked the robot at its current dock. Else, it is required so that the undocking action can obtain the staging pose to back out to if there are multiple dock plugins specified (else, will use the default).
There is also a maximum undocking time as a timeout for failures to uncouple itself from the dock, max_undocking_time
.
The result similarly contains success
and semantic error_code
with no feedback.
Reload Database Service
This service exists to potentially reload the dock server’s known dock database with a new file of docks after it is loaded. Simply provide the filepath
to your new set of docks and it shall be done!
Dock Specification
There are two unique elements to consider in specifying docks: dock instances and dock plugins. Dock instances are instances of a particular dock in the map, as the database may contain many known docks (and you can specify which by name you’d like to dock at). Dock plugins are the model of dock that each is an instance of. The plugins contain the capabilities to generically detect and connect to a particular dock model. This separation allows us to efficiently enable many individual docking locations of potentially several different revisions with different attributes.
The dock plugins are specified in the parameter file as shown below. If you’re familiar with plugins in other Nav2 servers, this should look like a familiar design pattern. Note that there is no specific information about the dock’s pose or instances. These are generic attributes about the dock revision (such as staging pose, enable charging command, detection method, etc). You can add additional parameters in the dock’s namespace as you choose (for example timeout
).
dock_plugins: ["dockv1", "dockv3"]
dockv1:
plugin: "my_custom_dock_ns::Dockv1"
dockv3:
plugin: "my_custom_dock_ns::Dockv3"
timeout: 10.0
There are two ways to populate the database of dock instances in your environment: through the parameter file or an external file. If you’d like to embed your dock information in your Docking Server config file (if you only have a couple of docks), you may use a similar method as defining the dock plugins, specifying the docks in the docks
parameter. Note that we specify the plugin type and the dock’s location [x, y, theta]
in a particular frame.
docks: ['dock1', 'dock2']
dock1:
type: "dockv3"
frame: map
pose: [0.3, 0.3, 0.0]
dock2:
type: "dockv1"
frame: map
pose: [0.0, 0.0, 0.4]
If you’d prefer to specify the docks using an external file, you may use the dock_database
parameter to specify the filepath to the yaml file. The file should be laid out like:
docks:
dock1:
type: "dockv3"
frame: map
pose: [0.3, 0.3, 0.0]
dock2:
type: "dockv1"
frame: map
pose: [0.0, 0.0, 0.4]
Note that you may leave the type
to an empty string if there is only one type of dock being used. The frame
will also default to map
if not otherwise specified. The type
and pose
fields are required. Note also that these can be in any frame, not just map (i.e. odom
, base_link
, etc) in both the database and action requests.
Dock Plugin API
The dock plugin has several key functions to implement. First, there are two functions related to poses:
-
getStagingPose
: This function should transform the dock pose into a pose for staging into the docking maneuver. Nav2 will be used to move the robot to the staging pose if not already within prestaging tolerances. -
getRefinedPose
: This function can be used refine the dock pose using sensors. Depending on how the robot can detect the dock, this might use laser scan data or camera data.
There are two functions used during dock approach:
-
isDocked
: As the robot approaches the dock, this function should tell us when to stop driving forward. There are many ways this function could be implemented depending on the robot hardware:- If a charge dock communicates before charging starts, this should be done here. If the charge dock needs an “enable” message to be sent, this is a good place to send it.
- If the charge dock doesn’t use any sort of communications, you might still be able to detect contact with the dock by looking at the motor effort/current, or determining that velocity has dropped to zero.
- In the absolute simplest case,
isDocked
might just callisCharging
if there is no other feedback to know when we are docked.
-
isCharging
: The approach stops when the robot reportsisDocked
, then we wait for charging to start by callingisCharging
.- This may be implemented using the
sensor_msgs/BatteryState
message to check the power status or for charging current.
- This may be implemented using the
Similarly, there are two functions used during undocking:
-
disableCharging
: This function is called before undocking commences to help prevent wear on the charge contacts. If the charge dock supports turning off the charge current, it should be done here. -
hasStoppedCharging
: This function is called while the controller is undocking. Undocking is successful when charging has stopped and the robot has returned to the staging pose.
Keep in mind that the docking and undocking functions should return quickly as they
will be called inside the control loop. Also make sure that isDocked
should
return true if isCharging
returns true.
Simple Charging Dock Plugin
The SimpleChargingDock
plugin is an example with many common options which may be fully functional for
some robots.
getStagingPose
applys a parameterized translational and rotational offset to the dock pose to obtain the staging pose.
getRefinedPose
can be used in two ways.
- A blind approach where the returned dock pose will simply be equal to whatever was passed in from the dock database. This may work with a reduced success rate on a real robot (due to global localization error), but is useful for initial testing and simulation.
- The more realistic use case is to use an AR marker, dock pose detection algorithm, etc. Tthe plugin will subscribe to a
geometry_msgs/PoseStamped
topicdetected_dock_pose
. This can be used with theimage_proc/TrackMarkerNode
for Apriltags or other custom detectors for your dock. It is unlikely the detected pose is actually the pose you want to dock with, so several parameters are supplied to represent your docked pose relative to the detected feature’s pose.
During the docking approach, there are two options for detecting isDocked
:
- We can check the joint states of the wheels if the current has spiked above a set threshold to indicate that the robot has made contact with the dock or other physical object.
- The dock pose is compared with the robot pose and
isDocked
returns true when the distance drops below the specifieddocking_threshold
.
The isCharging
and hasStoppedCharging
functions have two options:
- Subscribing to a
sensor_msgs/BatteryState
message on topicbattery_state
. The robot is considered charging when thecurrent
field of the message exceeds thecharging_threshold
. - We can return that we are charging is
isDocked() = true
, which is useful for initial testing or low-reliability docking until battery state or similar information is available.
For debugging purposes, there are several publishers which can be used with RVIZ:
Topic | Description | Type |
---|---|---|
dock_pose | The current transformed dock pose | geometry_msgs/PoseStamped |
filtered_dock_pose | The current un-transformed dock pose | geometry_msgs/PoseStamped |
staging_pose | The staging pose for the dock | geometry_msgs/PoseStamped |
Configuration
Parameter | Description | Type | Default |
---|---|---|---|
controller_frequency | Control frequency (Hz) for vision-control loop | double | 50.0 |
initial_perception_timeout | Timeout (s) to wait to obtain intial perception of the dock | double | 5.0 |
wait_charge_timeout | Timeout (s) to wait to see if charging starts after docking | double | 5.0 |
dock_approach_timeout | timeout (s) to attempt vision-control approach loop | double | 30.0 |
undock_linear_tolerance | Tolerance (m) to exit the undocking control loop at staging pose | double | 0.05 |
undock_angular_tolerance | Angular Tolerance (rad) to exist undocking loop at staging pose | double | 0.05 |
max_retries | Maximum number of retries to attempt | int | 3 |
base_frame | Robot’s base frame for control law | string | “base_link” |
fixed_frame | Fixed frame to use, recommended to be a smooth odometry frame not map | string | “odom” |
dock_backwards | Whether the robot is docking with the dock forward or backward in motion | bool | false |
dock_prestaging_tolerance | L2 distance in X,Y,Theta from the staging pose to bypass navigation | double | 0.5 |
dock_plugins | A set of dock plugins to load | vector |
N/A |
dock_database | The filepath to the dock database to use for this environment | string | N/A |
docks | Instead of dock_database , the set of docks specified in the params file itself |
vector |
N/A |
navigator_bt_xml | BT XML to use for Navigator, if non-default | string | ”” |
controller.k_phi | TODO | double | 3.0 |
controller.k_delta | TODO | double | 2.0 |
controller.beta | TODO | double | 0.4 |
controller.lambda | TODO | double | 2.0 |
controller.v_linear_min | TODO | double | 0.1 |
controller.v_linear_max | TODO | double | 0.25 |
controller.v_angular_max | TODO | double | 0.75 |
controller.slowdown_radius | TODO | double | 0.25 |
controller.use_collision_detection | Whether to use collision detection to avoid obstacles | bool | true |
controller.costmap_topic | The topic to use for the costmap | string | “local_costmap/costmap_raw” |
controller.footprint_topic | The topic to use for the robot’s footprint | string | “local_costmap/published_footprint” |
controller.transform_tolerance | Time with which to post-date the transform that is published, to indicate that this transform is valid into the future. | double | 0.1 |
controller.projection_time | Time to look ahead for collisions (s). | double | 5.0 |
controller.simulation_time_step | Time step for projections (s). | double | 0.1 |
controller.dock_collision_threshold | Distance (m) from the dock pose to ignore collisions, i.e. the robot will not check for collisions within this distance from the dock pose, as the robot will make contact with the dock. Set to 0.0 when physical contact is not made with a dock. |
double | 0.3 |
Note: dock_plugins
and either docks
or dock_database
are required.
SimpleChargingDock Parameter | Description | Type | Default |
---|---|---|---|
use_battery_status | Whether to use the battery state message or isDocked() for isCharging()
|
bool | true |
use_external_detection_pose | Whether to use external detection topic for dock or use the databases’ pose | bool | false |
external_detection_timeout | Timeout at which if the newest detection update does not meet to fail | double | 1.0 |
external_detection_translation_x | X offset from detected pose for docking pose (m) | double | -0.20 |
external_detection_translation_y | Y offset from detected pose for docking pose (m) | double | 0.0 |
external_detection_rotation_yaw | Yaw offset from detected pose for docking pose (rad) | double | 0.0 |
external_detection_rotation_pitch | Pitch offset from detected pose for docking pose (rad) | double | 1.57 |
external_detection_rotation_roll | Roll offset from detected pose for docking pose (rad) | double | -1.57 |
filter_coef | Dock external detection method filtering algorithm coefficient | double | 0.1 |
charging_threshold | Threshold of current in battery state above which isCharging() = true
|
double | 0.5 |
use_stall_detection | Whether or not to use stall detection for isDocked() or positional threshold |
bool | false |
stall_joint_names | Names in joint_states topic of joints to track |
vector |
N/A |
stall_velocity_threshold | The joint velocity below which to trigger isDocked() = true
|
double | 1.0 |
stall_effort_threshold | Current or motor effort in joint state to trigger isDocked() = true
|
double | 1.0 |
docking_threshold | If not using stall detection, the pose threshold to the docking pose where isDocked() = true
|
double | 0.05 |
staging_x_offset | Staging pose offset forward (negative) of dock pose (m) | double | -0.7 |
staging_yaw_offset | Staging pose angle relative to dock pose (rad) | double | 0.0 |
Note: The external detection rotation angles are setup to work out of the box with Apriltags detectors in image_proc
and isaac_ros
.
Etc
On Staging Poses
Staging poses are where the robot should navigate to in order to start the docking procedure. This pose should be close enough to the dock to accurately detect the dock’s presence, but far enough that if its moved slightly or the robot’s localization isn’t perfect it can still be detected and have enough room to adjust. The robot’s charging contacts or charging location should be pointed towards the dock in this staging pose. That way, a feasible global planner can be used to model your robot’s real constraints while getting to the docking pose (non-circular, non-holonomic), rather than complicating the docking process itself.