Time-Discounted GAE
In semi-MDPs, each step has an associated duration. Instead of the usual value equation
\begin{equation} V(s_1) = r_1 + \gamma r_2 + \gamma^2 r_3 + ... \end{equation}
one discount based on step duration
\begin{equation} V_{\Delta t}(s_1) = \gamma^{\Delta t_1} r_1 + \gamma^{\Delta t_1 + \Delta t_2} r_2 + \gamma^{\Delta t_1 + \Delta t_2 + \Delta t_3} r_3 + ... \end{equation}
using the convention that reward is given at the end of a step.
The generalized advantage estimator can be rewritten accordingly. In our implementation, the exponential decay lambda is per-step (as opposed to timewise).
RLlib Version
RLlib is actively developed and can change significantly from version to version. For this script, the following version is used:
[1]:
from importlib.metadata import version
version("ray") # Parent package of RLlib
[1]:
'2.35.0'
Define the Environment
A simple single-satellite environment is defined, as in :doc:examples/rllib_training.
[2]:
import numpy as np
from bsk_rl import act, data, obs, sats, scene
from bsk_rl.sim import dyn, fsw
class ScanningDownlinkDynModel(
dyn.ContinuousImagingDynModel, dyn.GroundStationDynModel
):
# Define some custom properties to be accessed in the state
@property
def instrument_pointing_error(self) -> float:
r_BN_P_unit = self.r_BN_P / np.linalg.norm(self.r_BN_P)
c_hat_P = self.satellite.fsw.c_hat_P
return np.arccos(np.dot(-r_BN_P_unit, c_hat_P))
@property
def solar_pointing_error(self) -> float:
a = (
self.world.gravFactory.spiceObject.planetStateOutMsgs[self.world.sun_index]
.read()
.PositionVector
)
a_hat_N = a / np.linalg.norm(a)
nHat_B = self.satellite.sat_args["nHat_B"]
NB = np.transpose(self.BN)
nHat_N = NB @ nHat_B
return np.arccos(np.dot(nHat_N, a_hat_N))
class ScanningSatellite(sats.AccessSatellite):
observation_spec = [
obs.SatProperties(
dict(prop="storage_level_fraction"),
dict(prop="battery_charge_fraction"),
dict(prop="wheel_speeds_fraction"),
dict(prop="instrument_pointing_error", norm=np.pi),
dict(prop="solar_pointing_error", norm=np.pi),
),
obs.OpportunityProperties(
dict(prop="opportunity_open", norm=5700),
dict(prop="opportunity_close", norm=5700),
type="ground_station",
n_ahead_observe=1,
),
obs.Eclipse(norm=5700),
]
action_spec = [
act.Scan(duration=180.0),
act.Charge(duration=120.0),
act.Downlink(duration=60.0),
act.Desat(duration=60.0),
]
dyn_type = ScanningDownlinkDynModel
fsw_type = fsw.ContinuousImagingFSWModel
sat = ScanningSatellite(
"Scanner-1",
sat_args=dict(
# Data
dataStorageCapacity=5000 * 8e6, # bits
storageInit=lambda: np.random.uniform(0.0, 0.8) * 5000 * 8e6,
instrumentBaudRate=0.5 * 8e6,
transmitterBaudRate=-50 * 8e6,
# Power
batteryStorageCapacity=200 * 3600, # W*s
storedCharge_Init=lambda: np.random.uniform(0.3, 1.0) * 200 * 3600,
basePowerDraw=-10.0, # W
instrumentPowerDraw=-30.0, # W
transmitterPowerDraw=-25.0, # W
thrusterPowerDraw=-80.0, # W
panelArea=0.25,
# Attitude
imageAttErrorRequirement=0.1,
imageRateErrorRequirement=0.1,
disturbance_vector=lambda: np.random.normal(scale=0.0001, size=3), # N*m
maxWheelSpeed=6000.0, # RPM
wheelSpeeds=lambda: np.random.uniform(-3000, 3000, 3),
desatAttitude="nadir",
),
)
duration = 5 * 5700.0 # About 5 orbits
env_args = dict(
satellite=sat,
scenario=scene.UniformNadirScanning(value_per_second=1 / duration),
rewarder=data.ScanningTimeReward(),
time_limit=duration,
failure_penalty=-1.0,
terminate_on_time_limit=True,
)
RLlib Configuration
The configuration is mostly the same as in the standard example.
[3]:
import bsk_rl.utils.rllib # noqa To access "SatelliteTasking-RLlib"
from ray.rllib.algorithms.ppo import PPOConfig
N_CPUS = 3
training_args = dict(
lr=0.00003,
gamma=0.999,
train_batch_size=250,
num_sgd_iter=10,
model=dict(fcnet_hiddens=[512, 512], vf_share_layers=False),
lambda_=0.95,
use_kl_loss=False,
clip_param=0.1,
grad_clip=0.5,
reward_time="step_end",
)
config = (
PPOConfig()
.env_runners(num_env_runners=N_CPUS - 1, sample_timeout_s=1000.0)
.environment(
env="SatelliteTasking-RLlib",
env_config=env_args,
)
.reporting(
metrics_num_episodes_for_smoothing=1,
metrics_episode_collection_timeout_s=180,
)
.checkpointing(export_native_model_files=True)
.framework(framework="torch")
.api_stack(
enable_rl_module_and_learner=True,
enable_env_runner_and_connector_v2=True,
)
)
Rewards can also be distributed at the start of the step by setting reward_time="step_start".
The additional setting that must be configured is the appropriate learner class. This uses the d_ts key from the info dict to discount by the step length, not just the step count.
[4]:
from bsk_rl.utils.rllib.discounting import TimeDiscountedGAEPPOTorchLearner
config.training(learner_class=TimeDiscountedGAEPPOTorchLearner)
[4]:
<ray.rllib.algorithms.ppo.ppo.PPOConfig at 0x7f79f445cd10>
Training can then proceed as normal.
[5]:
import ray
from ray import tune
ray.init(
ignore_reinit_error=True,
num_cpus=N_CPUS,
object_store_memory=2_000_000_000, # 2 GB
)
# Run the training
tune.run(
"PPO",
config=config.to_dict(),
stop={"training_iteration": 2}, # Adjust the number of iterations as needed
)
# Shutdown Ray
ray.shutdown()
2026-05-19 20:30:38,270 INFO worker.py:1783 -- Started a local Ray instance.
2026-05-19 20:30:41,769 INFO tune.py:616 -- [output] This uses the legacy output and progress reporter, as Jupyter notebooks are not supported by the new engine, yet. For more information, please see https://github.com/ray-project/ray/issues/36949
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/spaces/box.py:130: UserWarning: WARN: Box bound precision lowered by casting to float32
gym.logger.warn(f"Box bound precision lowered by casting to {self.dtype}")
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/utils/passive_env_checker.py:164: UserWarning: WARN: The obs returned by the `reset()` method was expecting numpy array dtype to be float32, actual type: float64
logger.warn(
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/utils/passive_env_checker.py:188: UserWarning: WARN: The obs returned by the `reset()` method is not within the observation space.
logger.warn(f"{pre} is not within the observation space.")
Tune Status
| Current time: | 2026-05-19 20:31:47 |
| Running for: | 00:01:05.32 |
| Memory: | 4.8/15.6 GiB |
System Info
Using FIFO scheduling algorithm.Logical resource usage: 3.0/3 CPUs, 0/0 GPUs
Trial Status
| Trial name | status | loc | iter | total time (s) | num_env_steps_sample d_lifetime | num_episodes_lifetim e | num_env_steps_traine d_lifetime |
|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking-RLlib_9ae85_00000 | TERMINATED | 10.1.0.241:5931 | 2 | 50.5292 | 8000 | 67 | 8000 |
(PPO pid=5931) Install gputil for GPU system monitoring.
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:30:57,507 sats.satellite.Scanner-1 WARNING <8760.00> Scanner-1: failed battery_valid check
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:03,251 sats.satellite.Scanner-1 WARNING <10380.00> Scanner-1: failed battery_valid check [repeated 11x across cluster] (Ray deduplicates logs by default. Set RAY_DEDUP_LOGS=0 to disable log deduplication, or see https://docs.ray.io/en/master/ray-observability/user-guides/configure-logging.html#log-deduplication for more options.)
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,492 utils.orbital WARNING <0.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,500 utils.orbital WARNING <60.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,507 utils.orbital WARNING <120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,522 utils.orbital WARNING <300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,529 utils.orbital WARNING <360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,542 utils.orbital WARNING <540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,549 utils.orbital WARNING <600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,559 utils.orbital WARNING <720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,566 utils.orbital WARNING <780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,576 utils.orbital WARNING <900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,588 utils.orbital WARNING <1080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,595 utils.orbital WARNING <1140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,605 utils.orbital WARNING <1260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,611 utils.orbital WARNING <1320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,619 utils.orbital WARNING <1380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,626 utils.orbital WARNING <1440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,633 utils.orbital WARNING <1500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,639 utils.orbital WARNING <1560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,646 utils.orbital WARNING <1620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,657 utils.orbital WARNING <1740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,674 utils.orbital WARNING <1920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,691 utils.orbital WARNING <2100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,699 utils.orbital WARNING <2160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,716 utils.orbital WARNING <2340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,726 utils.orbital WARNING <2400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,740 utils.orbital WARNING <2520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,754 utils.orbital WARNING <2700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,765 utils.orbital WARNING <2820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,779 utils.orbital WARNING <2940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,791 utils.orbital WARNING <3060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,798 utils.orbital WARNING <3120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,805 utils.orbital WARNING <3180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,814 utils.orbital WARNING <3240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,830 utils.orbital WARNING <3420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,840 utils.orbital WARNING <3480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,859 utils.orbital WARNING <3660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,869 utils.orbital WARNING <3780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,886 utils.orbital WARNING <3960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,906 utils.orbital WARNING <4140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,923 utils.orbital WARNING <4320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,933 utils.orbital WARNING <4380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,949 utils.orbital WARNING <4560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,958 utils.orbital WARNING <4620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,967 utils.orbital WARNING <4680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,976 utils.orbital WARNING <4740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,986 utils.orbital WARNING <4800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:06,993 utils.orbital WARNING <4860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,006 utils.orbital WARNING <4980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,016 utils.orbital WARNING <5100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,023 utils.orbital WARNING <5160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,036 utils.orbital WARNING <5340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,043 utils.orbital WARNING <5400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,050 utils.orbital WARNING <5460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,056 utils.orbital WARNING <5520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,063 utils.orbital WARNING <5580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,069 utils.orbital WARNING <5640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,076 utils.orbital WARNING <5700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,088 utils.orbital WARNING <5820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,107 utils.orbital WARNING <6000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,115 utils.orbital WARNING <6060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,123 utils.orbital WARNING <6120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,138 utils.orbital WARNING <6240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,147 utils.orbital WARNING <6360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,160 utils.orbital WARNING <6540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,167 utils.orbital WARNING <6600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,174 utils.orbital WARNING <6660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,181 utils.orbital WARNING <6720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,192 utils.orbital WARNING <6840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,202 utils.orbital WARNING <6960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,216 utils.orbital WARNING <7140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,227 utils.orbital WARNING <7200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,237 utils.orbital WARNING <7260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,250 utils.orbital WARNING <7380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,260 utils.orbital WARNING <7440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,268 utils.orbital WARNING <7500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,282 utils.orbital WARNING <7680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,290 utils.orbital WARNING <7740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,304 utils.orbital WARNING <7860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,320 utils.orbital WARNING <8040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,329 utils.orbital WARNING <8100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,339 utils.orbital WARNING <8160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,356 utils.orbital WARNING <8340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,366 utils.orbital WARNING <8400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,375 utils.orbital WARNING <8460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:07,394 utils.orbital WARNING <8640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:08,553 sats.satellite.Scanner-1 WARNING <10080.00> Scanner-1: failed battery_valid check [repeated 11x across cluster]
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:14,540 sats.satellite.Scanner-1 WARNING <20700.00> Scanner-1: failed battery_valid check [repeated 7x across cluster]
Trial Progress
| Trial name | env_runners | fault_tolerance | learners | num_agent_steps_sampled_lifetime | num_env_steps_sampled_lifetime | num_env_steps_trained_lifetime | num_episodes_lifetime | perf | timers |
|---|---|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking-RLlib_9ae85_00000 | {'episode_len_min': 180, 'agent_episode_returns_mean': {'default_agent': -0.7319122807017544}, 'episode_return_max': -0.6844912280701754, 'module_episode_returns_mean': {'default_policy': -0.7319122807017544}, 'episode_return_min': -0.7793333333333333, 'num_env_steps_sampled_lifetime': 16000, 'episode_len_max': 212, 'num_module_steps_sampled': {'default_policy': 4000}, 'num_agent_steps_sampled': {'default_agent': 4000}, 'num_agent_steps_sampled_lifetime': {'default_agent': 12000}, 'num_episodes': 34, 'episode_len_mean': 196.0, 'sample': np.float64(20.217751201277764), 'num_module_steps_sampled_lifetime': {'default_policy': 12000}, 'episode_return_mean': -0.7319122807017544, 'episode_duration_sec_mean': 2.0570268820000024, 'num_env_steps_sampled': 4000, 'time_between_sampling': np.float64(4.5492874690000065)} | {'num_healthy_workers': 2, 'num_in_flight_async_reqs': 0, 'num_remote_worker_restarts': 0} | {'default_policy': {'default_optimizer_learning_rate': 5e-05, 'num_trainable_parameters': 139013.0, 'curr_entropy_coeff': 0.0, 'vf_loss_unclipped': 0.0009060684824362397, 'mean_kl_loss': 0.015882940962910652, 'num_module_steps_trained': 4000, 'entropy': 1.3267607688903809, 'curr_kl_coeff': 0.20000000298023224, 'total_loss': -0.13866297900676727, 'vf_explained_var': 0.03500258922576904, 'policy_loss': -0.14274564385414124, 'num_non_trainable_parameters': 0.0, 'vf_loss': 0.0009060684824362397}, '__all_modules__': {'num_env_steps_trained': 4000, 'num_module_steps_trained': 4000, 'total_loss': -0.13866297900676727, 'num_non_trainable_parameters': 0.0, 'num_trainable_parameters': 139013.0}} | {'default_agent': 8000} | 8000 | 8000 | 67 | {'cpu_util_percent': np.float64(46.8972972972973), 'ram_util_percent': np.float64(30.900000000000006)} | {'env_runner_sampling_timer': 20.44360566688002, 'learner_update_timer': 4.301331923859995, 'synch_weights': 0.0059854253200296624, 'synch_env_connectors': 0.00609227285001964} |
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:22,001 sats.satellite.Scanner-1 WARNING <16860.00> Scanner-1: failed battery_valid check [repeated 4x across cluster]
(SingleAgentEnvRunner pid=5979) 2026-05-19 20:31:27,099 sats.satellite.Scanner-1 WARNING <18480.00> Scanner-1: failed battery_valid check [repeated 7x across cluster]
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,031 sats.satellite.Scanner-1 WARNING <11880.00> Scanner-1: failed battery_valid check [repeated 11x across cluster]
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,091 utils.orbital WARNING <0.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,099 utils.orbital WARNING <60.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,112 utils.orbital WARNING <240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,118 utils.orbital WARNING <300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,131 utils.orbital WARNING <480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,138 utils.orbital WARNING <540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,149 utils.orbital WARNING <660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,163 utils.orbital WARNING <840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,173 utils.orbital WARNING <960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,182 utils.orbital WARNING <1080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,196 utils.orbital WARNING <1260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,208 utils.orbital WARNING <1440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,215 utils.orbital WARNING <1500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,222 utils.orbital WARNING <1560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,228 utils.orbital WARNING <1620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,241 utils.orbital WARNING <1800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,254 utils.orbital WARNING <1920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,274 utils.orbital WARNING <2100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,284 utils.orbital WARNING <2160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,294 utils.orbital WARNING <2220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,307 utils.orbital WARNING <2340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,318 utils.orbital WARNING <2400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,331 utils.orbital WARNING <2520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,346 utils.orbital WARNING <2640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,356 utils.orbital WARNING <2700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,367 utils.orbital WARNING <2760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,377 utils.orbital WARNING <2820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,386 utils.orbital WARNING <2880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,402 utils.orbital WARNING <3000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,413 utils.orbital WARNING <3060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,427 utils.orbital WARNING <3180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,442 utils.orbital WARNING <3300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,451 utils.orbital WARNING <3360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,462 utils.orbital WARNING <3420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,478 utils.orbital WARNING <3600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,488 utils.orbital WARNING <3660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,508 utils.orbital WARNING <3840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,526 utils.orbital WARNING <4020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,537 utils.orbital WARNING <4140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,549 utils.orbital WARNING <4260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,561 utils.orbital WARNING <4380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,568 utils.orbital WARNING <4440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,580 utils.orbital WARNING <4560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,589 utils.orbital WARNING <4620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,602 utils.orbital WARNING <4740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,610 utils.orbital WARNING <4800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,624 utils.orbital WARNING <4980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,641 utils.orbital WARNING <5160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,653 utils.orbital WARNING <5220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,662 utils.orbital WARNING <5280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,672 utils.orbital WARNING <5340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,678 utils.orbital WARNING <5400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,687 utils.orbital WARNING <5460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,703 utils.orbital WARNING <5640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,715 utils.orbital WARNING <5760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,726 utils.orbital WARNING <5820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,735 utils.orbital WARNING <5880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,753 utils.orbital WARNING <6060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,773 utils.orbital WARNING <6240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,784 utils.orbital WARNING <6300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,796 utils.orbital WARNING <6420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,803 utils.orbital WARNING <6480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,809 utils.orbital WARNING <6540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,822 utils.orbital WARNING <6720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,835 utils.orbital WARNING <6900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,845 utils.orbital WARNING <7020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,858 utils.orbital WARNING <7200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,865 utils.orbital WARNING <7260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,875 utils.orbital WARNING <7380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,882 utils.orbital WARNING <7440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,895 utils.orbital WARNING <7620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,901 utils.orbital WARNING <7680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,908 utils.orbital WARNING <7740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,914 utils.orbital WARNING <7800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,924 utils.orbital WARNING <7920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,937 utils.orbital WARNING <8100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,945 utils.orbital WARNING <8160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,957 utils.orbital WARNING <8280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,973 utils.orbital WARNING <8460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,981 utils.orbital WARNING <8520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:33,997 utils.orbital WARNING <8700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,004 utils.orbital WARNING <8760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,017 utils.orbital WARNING <8940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,023 utils.orbital WARNING <9000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,030 utils.orbital WARNING <9060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,043 utils.orbital WARNING <9240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,056 utils.orbital WARNING <9420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,067 utils.orbital WARNING <9540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,080 utils.orbital WARNING <9720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,087 utils.orbital WARNING <9780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,100 utils.orbital WARNING <9960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,110 utils.orbital WARNING <10080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:34,123 utils.orbital WARNING <10260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:38,199 sats.satellite.Scanner-1 WARNING <13620.00> Scanner-1: failed battery_valid check [repeated 7x across cluster]
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,112 utils.orbital WARNING <0.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,127 utils.orbital WARNING <180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,134 utils.orbital WARNING <240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,145 utils.orbital WARNING <360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,154 utils.orbital WARNING <480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,168 utils.orbital WARNING <660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,175 utils.orbital WARNING <720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,185 utils.orbital WARNING <840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,195 utils.orbital WARNING <960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,208 utils.orbital WARNING <1140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,223 utils.orbital WARNING <1320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,236 utils.orbital WARNING <1500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,247 utils.orbital WARNING <1620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,257 utils.orbital WARNING <1740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,271 utils.orbital WARNING <1920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,285 utils.orbital WARNING <2100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,292 utils.orbital WARNING <2160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,303 utils.orbital WARNING <2280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,316 utils.orbital WARNING <2460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,328 utils.orbital WARNING <2580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,338 utils.orbital WARNING <2700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,348 utils.orbital WARNING <2820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,355 utils.orbital WARNING <2880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,361 utils.orbital WARNING <2940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,371 utils.orbital WARNING <3060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,378 utils.orbital WARNING <3120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,385 utils.orbital WARNING <3180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,391 utils.orbital WARNING <3240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,404 utils.orbital WARNING <3420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,414 utils.orbital WARNING <3540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,420 utils.orbital WARNING <3600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,428 utils.orbital WARNING <3660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,434 utils.orbital WARNING <3720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,444 utils.orbital WARNING <3840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,451 utils.orbital WARNING <3900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,457 utils.orbital WARNING <3960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,464 utils.orbital WARNING <4020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,470 utils.orbital WARNING <4080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,480 utils.orbital WARNING <4200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,487 utils.orbital WARNING <4260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,494 utils.orbital WARNING <4320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,509 utils.orbital WARNING <4500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,517 utils.orbital WARNING <4560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,530 utils.orbital WARNING <4680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,550 utils.orbital WARNING <4860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,568 utils.orbital WARNING <5040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,581 utils.orbital WARNING <5160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,597 utils.orbital WARNING <5340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,608 utils.orbital WARNING <5400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,629 utils.orbital WARNING <5580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,648 utils.orbital WARNING <5760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,657 utils.orbital WARNING <5820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,665 utils.orbital WARNING <5880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,674 utils.orbital WARNING <5940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,682 utils.orbital WARNING <6000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,689 utils.orbital WARNING <6060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,703 utils.orbital WARNING <6240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,714 utils.orbital WARNING <6360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,729 utils.orbital WARNING <6540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,740 utils.orbital WARNING <6600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,760 utils.orbital WARNING <6780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,768 utils.orbital WARNING <6840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,782 utils.orbital WARNING <6960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,790 utils.orbital WARNING <7020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,802 utils.orbital WARNING <7080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,819 utils.orbital WARNING <7260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,828 utils.orbital WARNING <7320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,838 utils.orbital WARNING <7380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,850 utils.orbital WARNING <7440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,862 utils.orbital WARNING <7560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,880 utils.orbital WARNING <7740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,898 utils.orbital WARNING <7920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,908 utils.orbital WARNING <7980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,921 utils.orbital WARNING <8100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,930 utils.orbital WARNING <8160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,942 utils.orbital WARNING <8280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,952 utils.orbital WARNING <8400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,959 utils.orbital WARNING <8460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,969 utils.orbital WARNING <8580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,976 utils.orbital WARNING <8640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,982 utils.orbital WARNING <8700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:40,989 utils.orbital WARNING <8760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,002 utils.orbital WARNING <8880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,022 utils.orbital WARNING <9060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,032 utils.orbital WARNING <9120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,042 utils.orbital WARNING <9180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,051 utils.orbital WARNING <9240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,068 utils.orbital WARNING <9420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,084 utils.orbital WARNING <9600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,091 utils.orbital WARNING <9660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,107 utils.orbital WARNING <9840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,124 utils.orbital WARNING <10020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,141 utils.orbital WARNING <10200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,150 utils.orbital WARNING <10260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,160 utils.orbital WARNING <10320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,170 utils.orbital WARNING <10380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,184 utils.orbital WARNING <10500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,198 utils.orbital WARNING <10620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,214 utils.orbital WARNING <10800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,226 utils.orbital WARNING <10860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,242 utils.orbital WARNING <10980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,257 utils.orbital WARNING <11100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,275 utils.orbital WARNING <11280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,293 utils.orbital WARNING <11460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,304 utils.orbital WARNING <11580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,311 utils.orbital WARNING <11640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,317 utils.orbital WARNING <11700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,324 utils.orbital WARNING <11760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,330 utils.orbital WARNING <11820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,344 utils.orbital WARNING <12000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,351 utils.orbital WARNING <12060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,361 utils.orbital WARNING <12180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,368 utils.orbital WARNING <12240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,381 utils.orbital WARNING <12420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,388 utils.orbital WARNING <12480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,395 utils.orbital WARNING <12540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,405 utils.orbital WARNING <12660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,412 utils.orbital WARNING <12720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,419 utils.orbital WARNING <12780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,432 utils.orbital WARNING <12960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,446 utils.orbital WARNING <13140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,452 utils.orbital WARNING <13200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,466 utils.orbital WARNING <13380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,479 utils.orbital WARNING <13560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,486 utils.orbital WARNING <13620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,492 utils.orbital WARNING <13680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,506 utils.orbital WARNING <13860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,513 utils.orbital WARNING <13920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,526 utils.orbital WARNING <14100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,534 utils.orbital WARNING <14160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,541 utils.orbital WARNING <14220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,549 utils.orbital WARNING <14280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,559 utils.orbital WARNING <14400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,566 utils.orbital WARNING <14460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,579 utils.orbital WARNING <14640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,585 utils.orbital WARNING <14700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,592 utils.orbital WARNING <14760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,602 utils.orbital WARNING <14880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,615 utils.orbital WARNING <15060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,622 utils.orbital WARNING <15120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,629 utils.orbital WARNING <15180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,637 utils.orbital WARNING <15240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,651 utils.orbital WARNING <15360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,663 utils.orbital WARNING <15480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,675 utils.orbital WARNING <15600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,684 utils.orbital WARNING <15660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,693 utils.orbital WARNING <15720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,702 utils.orbital WARNING <15780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,724 utils.orbital WARNING <15960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,741 utils.orbital WARNING <16140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,754 utils.orbital WARNING <16260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,765 utils.orbital WARNING <16320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,776 utils.orbital WARNING <16440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,791 utils.orbital WARNING <16620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,799 utils.orbital WARNING <16680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,812 utils.orbital WARNING <16860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,826 utils.orbital WARNING <17040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,840 utils.orbital WARNING <17220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,847 utils.orbital WARNING <17280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,857 utils.orbital WARNING <17340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,869 utils.orbital WARNING <17400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,877 utils.orbital WARNING <17460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,891 utils.orbital WARNING <17640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,904 utils.orbital WARNING <17820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,915 utils.orbital WARNING <17940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,929 utils.orbital WARNING <18120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,939 utils.orbital WARNING <18240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,946 utils.orbital WARNING <18300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,955 utils.orbital WARNING <18360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,968 utils.orbital WARNING <18540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,982 utils.orbital WARNING <18720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:41,993 utils.orbital WARNING <18840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,000 utils.orbital WARNING <18900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,015 utils.orbital WARNING <19080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,022 utils.orbital WARNING <19140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,037 utils.orbital WARNING <19320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,044 utils.orbital WARNING <19380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,059 utils.orbital WARNING <19560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,066 utils.orbital WARNING <19620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,074 utils.orbital WARNING <19680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,081 utils.orbital WARNING <19740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,088 utils.orbital WARNING <19800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,098 utils.orbital WARNING <19920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,112 utils.orbital WARNING <20100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,119 utils.orbital WARNING <20160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,126 utils.orbital WARNING <20220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,133 utils.orbital WARNING <20280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,147 utils.orbital WARNING <20460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,154 utils.orbital WARNING <20520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,174 utils.orbital WARNING <20700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,185 utils.orbital WARNING <20760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,194 utils.orbital WARNING <20820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,211 utils.orbital WARNING <21000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,222 utils.orbital WARNING <21060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,230 utils.orbital WARNING <21120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,239 utils.orbital WARNING <21180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,249 utils.orbital WARNING <21240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,261 utils.orbital WARNING <21300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,271 utils.orbital WARNING <21360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,293 utils.orbital WARNING <21540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,303 utils.orbital WARNING <21600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,313 utils.orbital WARNING <21660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,323 utils.orbital WARNING <21720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,334 utils.orbital WARNING <21780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,347 utils.orbital WARNING <21960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,355 utils.orbital WARNING <22020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,362 utils.orbital WARNING <22080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,369 utils.orbital WARNING <22140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,376 utils.orbital WARNING <22200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,386 utils.orbital WARNING <22320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,396 utils.orbital WARNING <22440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,410 utils.orbital WARNING <22620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,417 utils.orbital WARNING <22680.00> Could not find eclipse transitions in next 12000.0 seconds
2026-05-19 20:31:47,118 INFO tune.py:1009 -- Wrote the latest version of all result files and experiment state to '/home/runner/ray_results/PPO_2026-05-19_20-30-41' in 0.0142s.
2026-05-19 20:31:47,658 INFO tune.py:1041 -- Total run time: 65.89 seconds (65.30 seconds for the tuning loop).
(SingleAgentEnvRunner pid=5980) 2026-05-19 20:31:42,418 sats.satellite.Scanner-1 WARNING <22680.00> Scanner-1: failed battery_valid check [repeated 7x across cluster]