Auxiliary Modules#
The following modules provide support to the main library, or implement additional, secondary functionality.
Implementations of RL objectives, extending those of TorchRL. |
|
Various utility functions and classes. |
|
Classes for logging experiment statistics during training. |
|
Logging training artifacts to W&B every so often. |
|
Utilities for basing the current experiment on a previous W&B run. |
|
Utilities for saving and loading models together with their parameters. |
|
Code for timing various things, to test performance. |