Time-Discounted GAE
In semi-MDPs, each step has an associated duration. Instead of the usual value equation
\begin{equation} V(s_1) = r_1 + \gamma r_2 + \gamma^2 r_3 + ... \end{equation}
one discount based on step duration
\begin{equation} V_{\Delta t}(s_1) = \gamma^{\Delta t_1} r_1 + \gamma^{\Delta t_1 + \Delta t_2} r_2 + \gamma^{\Delta t_1 + \Delta t_2 + \Delta t_3} r_3 + ... \end{equation}
using the convention that reward is given at the end of a step.
The generalized advantage estimator can be rewritten accordingly. In our implementation, the exponential decay lambda is per-step (as opposed to timewise).
RLlib Version
RLlib is actively developed and can change significantly from version to version. For this script, the following version is used:
[1]:
from importlib.metadata import version
version("ray") # Parent package of RLlib
[1]:
'2.35.0'
Define the Environment
A simple single-satellite environment is defined, as in :doc:examples/rllib_training.
[2]:
import numpy as np
from bsk_rl import act, data, obs, sats, scene
from bsk_rl.sim import dyn, fsw
class ScanningDownlinkDynModel(
dyn.ContinuousImagingDynModel, dyn.GroundStationDynModel
):
# Define some custom properties to be accessed in the state
@property
def instrument_pointing_error(self) -> float:
r_BN_P_unit = self.r_BN_P / np.linalg.norm(self.r_BN_P)
c_hat_P = self.satellite.fsw.c_hat_P
return np.arccos(np.dot(-r_BN_P_unit, c_hat_P))
@property
def solar_pointing_error(self) -> float:
a = (
self.world.gravFactory.spiceObject.planetStateOutMsgs[self.world.sun_index]
.read()
.PositionVector
)
a_hat_N = a / np.linalg.norm(a)
nHat_B = self.satellite.sat_args["nHat_B"]
NB = np.transpose(self.BN)
nHat_N = NB @ nHat_B
return np.arccos(np.dot(nHat_N, a_hat_N))
class ScanningSatellite(sats.AccessSatellite):
observation_spec = [
obs.SatProperties(
dict(prop="storage_level_fraction"),
dict(prop="battery_charge_fraction"),
dict(prop="wheel_speeds_fraction"),
dict(prop="instrument_pointing_error", norm=np.pi),
dict(prop="solar_pointing_error", norm=np.pi),
),
obs.OpportunityProperties(
dict(prop="opportunity_open", norm=5700),
dict(prop="opportunity_close", norm=5700),
type="ground_station",
n_ahead_observe=1,
),
obs.Eclipse(norm=5700),
]
action_spec = [
act.Scan(duration=180.0),
act.Charge(duration=120.0),
act.Downlink(duration=60.0),
act.Desat(duration=60.0),
]
dyn_type = ScanningDownlinkDynModel
fsw_type = fsw.ContinuousImagingFSWModel
sat = ScanningSatellite(
"Scanner-1",
sat_args=dict(
# Data
dataStorageCapacity=5000 * 8e6, # bits
storageInit=lambda: np.random.uniform(0.0, 0.8) * 5000 * 8e6,
instrumentBaudRate=0.5 * 8e6,
transmitterBaudRate=-50 * 8e6,
# Power
batteryStorageCapacity=200 * 3600, # W*s
storedCharge_Init=lambda: np.random.uniform(0.3, 1.0) * 200 * 3600,
basePowerDraw=-10.0, # W
instrumentPowerDraw=-30.0, # W
transmitterPowerDraw=-25.0, # W
thrusterPowerDraw=-80.0, # W
panelArea=0.25,
# Attitude
imageAttErrorRequirement=0.1,
imageRateErrorRequirement=0.1,
disturbance_vector=lambda: np.random.normal(scale=0.0001, size=3), # N*m
maxWheelSpeed=6000.0, # RPM
wheelSpeeds=lambda: np.random.uniform(-3000, 3000, 3),
desatAttitude="nadir",
),
)
duration = 5 * 5700.0 # About 5 orbits
env_args = dict(
satellite=sat,
scenario=scene.UniformNadirScanning(value_per_second=1 / duration),
rewarder=data.ScanningTimeReward(),
time_limit=duration,
failure_penalty=-1.0,
terminate_on_time_limit=True,
)
RLlib Configuration
The configuration is mostly the same as in the standard example.
[3]:
import bsk_rl.utils.rllib # noqa To access "SatelliteTasking-RLlib"
from ray.rllib.algorithms.ppo import PPOConfig
N_CPUS = 3
training_args = dict(
lr=0.00003,
gamma=0.999,
train_batch_size=250,
num_sgd_iter=10,
model=dict(fcnet_hiddens=[512, 512], vf_share_layers=False),
lambda_=0.95,
use_kl_loss=False,
clip_param=0.1,
grad_clip=0.5,
reward_time="step_end",
)
config = (
PPOConfig()
.env_runners(num_env_runners=N_CPUS - 1, sample_timeout_s=1000.0)
.environment(
env="SatelliteTasking-RLlib",
env_config=env_args,
)
.reporting(
metrics_num_episodes_for_smoothing=1,
metrics_episode_collection_timeout_s=180,
)
.checkpointing(export_native_model_files=True)
.framework(framework="torch")
.api_stack(
enable_rl_module_and_learner=True,
enable_env_runner_and_connector_v2=True,
)
)
Rewards can also be distributed at the start of the step by setting reward_time="step_start".
The additional setting that must be configured is the appropriate learner class. This uses the d_ts key from the info dict to discount by the step length, not just the step count.
[4]:
from bsk_rl.utils.rllib.discounting import TimeDiscountedGAEPPOTorchLearner
config.training(learner_class=TimeDiscountedGAEPPOTorchLearner)
[4]:
<ray.rllib.algorithms.ppo.ppo.PPOConfig at 0x7f9689da7a90>
Training can then proceed as normal.
[5]:
import ray
from ray import tune
ray.init(
ignore_reinit_error=True,
num_cpus=N_CPUS,
object_store_memory=2_000_000_000, # 2 GB
)
# Run the training
tune.run(
"PPO",
config=config.to_dict(),
stop={"training_iteration": 2}, # Adjust the number of iterations as needed
)
# Shutdown Ray
ray.shutdown()
2026-07-18 03:52:45,742 INFO worker.py:1783 -- Started a local Ray instance.
2026-07-18 03:52:50,306 INFO tune.py:616 -- [output] This uses the legacy output and progress reporter, as Jupyter notebooks are not supported by the new engine, yet. For more information, please see https://github.com/ray-project/ray/issues/36949
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/spaces/box.py:130: UserWarning: WARN: Box bound precision lowered by casting to float32
gym.logger.warn(f"Box bound precision lowered by casting to {self.dtype}")
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/utils/passive_env_checker.py:164: UserWarning: WARN: The obs returned by the `reset()` method was expecting numpy array dtype to be float32, actual type: float64
logger.warn(
/opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/gymnasium/utils/passive_env_checker.py:188: UserWarning: WARN: The obs returned by the `reset()` method is not within the observation space.
logger.warn(f"{pre} is not within the observation space.")
Tune Status
| Current time: | 2026-07-18 03:54:04 |
| Running for: | 00:01:14.42 |
| Memory: | 4.9/15.6 GiB |
System Info
Using FIFO scheduling algorithm.Logical resource usage: 3.0/3 CPUs, 0/0 GPUs
Trial Status
| Trial name | status | loc | iter | total time (s) | num_env_steps_sample d_lifetime | num_episodes_lifetim e | num_env_steps_traine d_lifetime |
|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking-RLlib_25878_00000 | TERMINATED | 10.1.0.142:5950 | 2 | 56.4785 | 8000 | 39 | 8000 |
(SingleAgentEnvRunner pid=5994) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:330: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenMatrix3d will be removed after 2027-06-23: Use simHelpers.np2EigenMatrix3d instead.
(SingleAgentEnvRunner pid=5994) self.scObject.hub.IHubPntBc_B = unitTestSupport.np2EigenMatrix3d(self.I_mat)
(SingleAgentEnvRunner pid=5994) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:335: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5994) self.scObject.hub.r_CN_NInit = unitTestSupport.np2EigenVectorXd(rN)
(SingleAgentEnvRunner pid=5994) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:336: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5994) self.scObject.hub.v_CN_NInit = unitTestSupport.np2EigenVectorXd(vN)
(SingleAgentEnvRunner pid=5994) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:701: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5994) unitTestSupport.np2EigenVectorXd(nHat_B),
(SingleAgentEnvRunner pid=5995) unitTestSupport.np2EigenVectorXd(nHat_B),
(PPO pid=5950) unitTestSupport.np2EigenVectorXd(nHat_B),
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:06,710 utils.orbital WARNING <0.00> Could not find eclipse transitions in next 12000.0 seconds
(PPO pid=5950) Install gputil for GPU system monitoring.
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:10,600 sats.satellite.Scanner-1 WARNING <21060.00> Scanner-1: failed battery_valid check
(PPO pid=5950) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:701: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead. [repeated 8x across cluster] (Ray deduplicates logs by default. Set RAY_DEDUP_LOGS=0 to disable log deduplication, or see https://docs.ray.io/en/master/ray-observability/user-guides/configure-logging.html#log-deduplication for more options.)
(PPO pid=5950) self.scObject.hub.IHubPntBc_B = unitTestSupport.np2EigenMatrix3d(self.I_mat) [repeated 2x across cluster]
(PPO pid=5950) self.scObject.hub.r_CN_NInit = unitTestSupport.np2EigenVectorXd(rN) [repeated 2x across cluster]
(PPO pid=5950) self.scObject.hub.v_CN_NInit = unitTestSupport.np2EigenVectorXd(vN) [repeated 2x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:11,859 utils.orbital WARNING <9480.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 88x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:13,544 sats.satellite.Scanner-1 WARNING <23580.00> Scanner-1: failed battery_valid check
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:15,994 sats.satellite.Scanner-1 WARNING <10020.00> Scanner-1: failed battery_valid check
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:16,879 utils.orbital WARNING <6780.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 295x across cluster]
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:21,030 sats.satellite.Scanner-1 WARNING <13080.00> Scanner-1: failed battery_valid check [repeated 2x across cluster]
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:21,030 utils.orbital WARNING <13080.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 325x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:26,248 sats.satellite.Scanner-1 WARNING <6480.00> Scanner-1: failed battery_valid check [repeated 4x across cluster]
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:28,480 utils.orbital WARNING <12240.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 111x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:30,393 sats.satellite.Scanner-1 WARNING <21360.00> Scanner-1: failed battery_valid check [repeated 5x across cluster]
Trial Progress
| Trial name | env_runners | fault_tolerance | learners | num_agent_steps_sampled_lifetime | num_env_steps_sampled_lifetime | num_env_steps_trained_lifetime | num_episodes_lifetime | perf | timers |
|---|---|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking-RLlib_25878_00000 | {'agent_episode_returns_mean': {'default_agent': -0.3100175438596492}, 'module_episode_returns_mean': {'default_policy': -0.3100175438596492}, 'num_agent_steps_sampled_lifetime': {'default_agent': 12000}, 'num_episodes': 20, 'num_module_steps_sampled_lifetime': {'default_policy': 12000}, 'num_env_steps_sampled_lifetime': 16000, 'episode_len_max': 269, 'num_module_steps_sampled': {'default_policy': 4000}, 'episode_len_min': 67, 'episode_len_mean': 168.0, 'episode_return_mean': -0.3100175438596492, 'episode_duration_sec_mean': 1.8963188879999962, 'num_env_steps_sampled': 4000, 'episode_return_min': -0.9338245614035088, 'sample': np.float64(23.391269221789607), 'num_agent_steps_sampled': {'default_agent': 4000}, 'episode_return_max': 0.31378947368421045, 'time_between_sampling': np.float64(5.067473111999988)} | {'num_healthy_workers': 2, 'num_in_flight_async_reqs': 0, 'num_remote_worker_restarts': 0} | {'default_policy': {'mean_kl_loss': 0.021068459376692772, 'curr_kl_coeff': 0.30000001192092896, 'num_trainable_parameters': 139013.0, 'vf_explained_var': -1.0, 'default_optimizer_learning_rate': 5e-05, 'total_loss': -0.15978547930717468, 'vf_loss': 1.9060405975324102e-05, 'entropy': 1.3519237041473389, 'curr_entropy_coeff': 0.0, 'num_module_steps_trained': 4000, 'num_non_trainable_parameters': 0.0, 'policy_loss': -0.16401821374893188, 'vf_loss_unclipped': 1.9060405975324102e-05}, '__all_modules__': {'total_loss': -0.15978547930717468, 'num_non_trainable_parameters': 0.0, 'num_module_steps_trained': 4000, 'num_env_steps_trained': 4000, 'num_trainable_parameters': 139013.0}} | {'default_agent': 8000} | 8000 | 8000 | 39 | {'cpu_util_percent': np.float64(47.0175), 'ram_util_percent': np.float64(31.639999999999997)} | {'env_runner_sampling_timer': 23.78257578345003, 'learner_update_timer': 4.633975103600005, 'synch_weights': 0.005838374320039747, 'synch_env_connectors': 0.006396153820022618} |
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:36,719 utils.orbital WARNING <16440.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 297x across cluster]
(SingleAgentEnvRunner pid=5995) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:330: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenMatrix3d will be removed after 2027-06-23: Use simHelpers.np2EigenMatrix3d instead.
(SingleAgentEnvRunner pid=5995) self.scObject.hub.IHubPntBc_B = unitTestSupport.np2EigenMatrix3d(self.I_mat)
(SingleAgentEnvRunner pid=5995) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:335: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5995) self.scObject.hub.r_CN_NInit = unitTestSupport.np2EigenVectorXd(rN)
(SingleAgentEnvRunner pid=5995) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:336: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5995) self.scObject.hub.v_CN_NInit = unitTestSupport.np2EigenVectorXd(vN)
(SingleAgentEnvRunner pid=5995) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:701: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead.
(SingleAgentEnvRunner pid=5995) unitTestSupport.np2EigenVectorXd(nHat_B),
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:38,932 sats.satellite.Scanner-1 WARNING <26940.00> Scanner-1: failed battery_valid check
(SingleAgentEnvRunner pid=5994) unitTestSupport.np2EigenVectorXd(nHat_B),
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:38,344 utils.orbital WARNING <28500.00> Could not find eclipse transitions in next 12000.0 seconds [repeated 114x across cluster]
(SingleAgentEnvRunner pid=5994) /home/runner/work/bsk_rl/bsk_rl/src/bsk_rl/sim/dyn/base.py:701: BSKDeprecationWarning: Basilisk.utilities.unitTestSupport.np2EigenVectorXd will be removed after 2027-06-23: Use simHelpers.np2EigenVectorXd instead. [repeated 4x across cluster]
(SingleAgentEnvRunner pid=5994) self.scObject.hub.IHubPntBc_B = unitTestSupport.np2EigenMatrix3d(self.I_mat)
(SingleAgentEnvRunner pid=5994) self.scObject.hub.r_CN_NInit = unitTestSupport.np2EigenVectorXd(rN)
(SingleAgentEnvRunner pid=5994) self.scObject.hub.v_CN_NInit = unitTestSupport.np2EigenVectorXd(vN)
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:48,121 sats.satellite.Scanner-1 WARNING <24420.00> Scanner-1: failed battery_valid check [repeated 4x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,713 utils.orbital WARNING <0.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,723 utils.orbital WARNING <60.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,734 utils.orbital WARNING <180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,746 utils.orbital WARNING <300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,754 utils.orbital WARNING <360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,762 utils.orbital WARNING <420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,771 utils.orbital WARNING <480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,779 utils.orbital WARNING <540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,796 utils.orbital WARNING <720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,804 utils.orbital WARNING <780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,819 utils.orbital WARNING <960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,835 utils.orbital WARNING <1140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,843 utils.orbital WARNING <1200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,858 utils.orbital WARNING <1380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,866 utils.orbital WARNING <1440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,873 utils.orbital WARNING <1500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,889 utils.orbital WARNING <1680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,897 utils.orbital WARNING <1740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,908 utils.orbital WARNING <1860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,919 utils.orbital WARNING <1980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,926 utils.orbital WARNING <2040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,933 utils.orbital WARNING <2100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,940 utils.orbital WARNING <2160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,948 utils.orbital WARNING <2220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,955 utils.orbital WARNING <2280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,962 utils.orbital WARNING <2340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,969 utils.orbital WARNING <2400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,976 utils.orbital WARNING <2460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,984 utils.orbital WARNING <2520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:49,994 utils.orbital WARNING <2580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,016 utils.orbital WARNING <2760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,029 utils.orbital WARNING <2820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,040 utils.orbital WARNING <2880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,053 utils.orbital WARNING <2940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,062 utils.orbital WARNING <3000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,078 utils.orbital WARNING <3120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,087 utils.orbital WARNING <3180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,099 utils.orbital WARNING <3240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,120 utils.orbital WARNING <3420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,131 utils.orbital WARNING <3480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,140 utils.orbital WARNING <3540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,149 utils.orbital WARNING <3600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,165 utils.orbital WARNING <3720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,176 utils.orbital WARNING <3780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,184 utils.orbital WARNING <3840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,204 utils.orbital WARNING <4020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,214 utils.orbital WARNING <4080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,234 utils.orbital WARNING <4260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,250 utils.orbital WARNING <4380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,267 utils.orbital WARNING <4560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,277 utils.orbital WARNING <4620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,287 utils.orbital WARNING <4680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,299 utils.orbital WARNING <4740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,314 utils.orbital WARNING <4860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,324 utils.orbital WARNING <4920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,335 utils.orbital WARNING <4980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,345 utils.orbital WARNING <5040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,362 utils.orbital WARNING <5160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,370 utils.orbital WARNING <5220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,385 utils.orbital WARNING <5340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,396 utils.orbital WARNING <5400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,416 utils.orbital WARNING <5580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,426 utils.orbital WARNING <5640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,442 utils.orbital WARNING <5760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,452 utils.orbital WARNING <5820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,466 utils.orbital WARNING <5940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,474 utils.orbital WARNING <6000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,482 utils.orbital WARNING <6060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,491 utils.orbital WARNING <6120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,498 utils.orbital WARNING <6180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,507 utils.orbital WARNING <6240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,514 utils.orbital WARNING <6300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,529 utils.orbital WARNING <6480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,537 utils.orbital WARNING <6540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,544 utils.orbital WARNING <6600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,559 utils.orbital WARNING <6780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,567 utils.orbital WARNING <6840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,575 utils.orbital WARNING <6900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,590 utils.orbital WARNING <7080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,602 utils.orbital WARNING <7200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,613 utils.orbital WARNING <7320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,621 utils.orbital WARNING <7380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,628 utils.orbital WARNING <7440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,643 utils.orbital WARNING <7620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,652 utils.orbital WARNING <7680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,663 utils.orbital WARNING <7800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,671 utils.orbital WARNING <7860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,681 utils.orbital WARNING <7920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,688 utils.orbital WARNING <7980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,696 utils.orbital WARNING <8040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,704 utils.orbital WARNING <8100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,714 utils.orbital WARNING <8160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,734 utils.orbital WARNING <8340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,754 utils.orbital WARNING <8520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,766 utils.orbital WARNING <8580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,781 utils.orbital WARNING <8700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,793 utils.orbital WARNING <8760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,805 utils.orbital WARNING <8820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,815 utils.orbital WARNING <8880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,827 utils.orbital WARNING <8940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,838 utils.orbital WARNING <9000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,850 utils.orbital WARNING <9060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,859 utils.orbital WARNING <9120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,875 utils.orbital WARNING <9240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,885 utils.orbital WARNING <9300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,906 utils.orbital WARNING <9480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,918 utils.orbital WARNING <9540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,927 utils.orbital WARNING <9600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,935 utils.orbital WARNING <9660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,944 utils.orbital WARNING <9720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,953 utils.orbital WARNING <9780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,963 utils.orbital WARNING <9840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,982 utils.orbital WARNING <10020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:50,992 utils.orbital WARNING <10080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,011 utils.orbital WARNING <10260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,033 utils.orbital WARNING <10440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,046 utils.orbital WARNING <10500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,061 utils.orbital WARNING <10620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,071 utils.orbital WARNING <10680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,078 utils.orbital WARNING <10740.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,094 utils.orbital WARNING <10920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,113 utils.orbital WARNING <11100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,135 utils.orbital WARNING <11280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,151 utils.orbital WARNING <11460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,165 utils.orbital WARNING <11640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,180 utils.orbital WARNING <11820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,195 utils.orbital WARNING <12000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,202 utils.orbital WARNING <12060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,210 utils.orbital WARNING <12120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,227 utils.orbital WARNING <12300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,235 utils.orbital WARNING <12360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,242 utils.orbital WARNING <12420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,250 utils.orbital WARNING <12480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,258 utils.orbital WARNING <12540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,278 utils.orbital WARNING <12660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,295 utils.orbital WARNING <12840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,308 utils.orbital WARNING <12960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,315 utils.orbital WARNING <13020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,324 utils.orbital WARNING <13080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,345 utils.orbital WARNING <13260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,363 utils.orbital WARNING <13440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,371 utils.orbital WARNING <13500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,386 utils.orbital WARNING <13620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,408 utils.orbital WARNING <13800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,419 utils.orbital WARNING <13860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,428 utils.orbital WARNING <13920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,436 utils.orbital WARNING <13980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,443 utils.orbital WARNING <14040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,450 utils.orbital WARNING <14100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,458 utils.orbital WARNING <14160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,469 utils.orbital WARNING <14280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,483 utils.orbital WARNING <14460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,498 utils.orbital WARNING <14640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,505 utils.orbital WARNING <14700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,515 utils.orbital WARNING <14760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,524 utils.orbital WARNING <14820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,533 utils.orbital WARNING <14880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,548 utils.orbital WARNING <15000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,559 utils.orbital WARNING <15120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,567 utils.orbital WARNING <15180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,581 utils.orbital WARNING <15360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,592 utils.orbital WARNING <15480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,603 utils.orbital WARNING <15600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,610 utils.orbital WARNING <15660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,625 utils.orbital WARNING <15840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,636 utils.orbital WARNING <15900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,646 utils.orbital WARNING <15960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,668 utils.orbital WARNING <16140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,678 utils.orbital WARNING <16200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,692 utils.orbital WARNING <16320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,709 utils.orbital WARNING <16440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,722 utils.orbital WARNING <16560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,730 utils.orbital WARNING <16620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,746 utils.orbital WARNING <16800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,763 utils.orbital WARNING <16980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,775 utils.orbital WARNING <17100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,783 utils.orbital WARNING <17160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,799 utils.orbital WARNING <17340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,807 utils.orbital WARNING <17400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,814 utils.orbital WARNING <17460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,822 utils.orbital WARNING <17520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,830 utils.orbital WARNING <17580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,843 utils.orbital WARNING <17700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,861 utils.orbital WARNING <17880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,877 utils.orbital WARNING <18000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,886 utils.orbital WARNING <18060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,895 utils.orbital WARNING <18120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,911 utils.orbital WARNING <18240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,924 utils.orbital WARNING <18360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,940 utils.orbital WARNING <18480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,952 utils.orbital WARNING <18540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:51,971 utils.orbital WARNING <18720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,009 utils.orbital WARNING <18840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,017 utils.orbital WARNING <18900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,024 utils.orbital WARNING <18960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,032 utils.orbital WARNING <19020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,047 utils.orbital WARNING <19140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,069 utils.orbital WARNING <19320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,090 utils.orbital WARNING <19500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,102 utils.orbital WARNING <19560.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,112 utils.orbital WARNING <19620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,127 utils.orbital WARNING <19800.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,135 utils.orbital WARNING <19860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,147 utils.orbital WARNING <19920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,167 utils.orbital WARNING <20100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,176 utils.orbital WARNING <20160.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,199 utils.orbital WARNING <20340.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,210 utils.orbital WARNING <20400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,223 utils.orbital WARNING <20460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,234 utils.orbital WARNING <20520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,245 utils.orbital WARNING <20580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,255 utils.orbital WARNING <20640.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,276 utils.orbital WARNING <20820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,286 utils.orbital WARNING <20880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,301 utils.orbital WARNING <21000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,312 utils.orbital WARNING <21060.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,323 utils.orbital WARNING <21120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,333 utils.orbital WARNING <21180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,342 utils.orbital WARNING <21240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,355 utils.orbital WARNING <21300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,366 utils.orbital WARNING <21360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,383 utils.orbital WARNING <21540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,392 utils.orbital WARNING <21600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,400 utils.orbital WARNING <21660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,408 utils.orbital WARNING <21720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,430 utils.orbital WARNING <21900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,440 utils.orbital WARNING <21960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,451 utils.orbital WARNING <22020.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,471 utils.orbital WARNING <22200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,482 utils.orbital WARNING <22260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,491 utils.orbital WARNING <22320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,513 utils.orbital WARNING <22500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,534 utils.orbital WARNING <22680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,557 utils.orbital WARNING <22860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,567 utils.orbital WARNING <22920.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,578 utils.orbital WARNING <22980.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,587 utils.orbital WARNING <23040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,597 utils.orbital WARNING <23100.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,619 utils.orbital WARNING <23280.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,637 utils.orbital WARNING <23400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,646 utils.orbital WARNING <23460.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,665 utils.orbital WARNING <23580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,683 utils.orbital WARNING <23700.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,707 utils.orbital WARNING <23880.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,718 utils.orbital WARNING <23940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,729 utils.orbital WARNING <24000.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,751 utils.orbital WARNING <24180.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,761 utils.orbital WARNING <24240.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,781 utils.orbital WARNING <24360.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,790 utils.orbital WARNING <24420.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,806 utils.orbital WARNING <24540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,816 utils.orbital WARNING <24600.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,828 utils.orbital WARNING <24660.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,851 utils.orbital WARNING <24840.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,862 utils.orbital WARNING <24900.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,884 utils.orbital WARNING <25080.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,894 utils.orbital WARNING <25140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,904 utils.orbital WARNING <25200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,916 utils.orbital WARNING <25260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,928 utils.orbital WARNING <25320.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,936 utils.orbital WARNING <25380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,947 utils.orbital WARNING <25440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,963 utils.orbital WARNING <25620.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,973 utils.orbital WARNING <25680.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:52,989 utils.orbital WARNING <25860.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,005 utils.orbital WARNING <26040.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,022 utils.orbital WARNING <26220.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,039 utils.orbital WARNING <26400.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,052 utils.orbital WARNING <26520.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,060 utils.orbital WARNING <26580.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,079 utils.orbital WARNING <26760.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,091 utils.orbital WARNING <26820.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,108 utils.orbital WARNING <26940.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,129 utils.orbital WARNING <27120.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,146 utils.orbital WARNING <27300.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,163 utils.orbital WARNING <27480.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,172 utils.orbital WARNING <27540.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5995) 2026-07-18 03:53:52,321 sats.satellite.Scanner-1 WARNING <14760.00> Scanner-1: failed battery_valid check [repeated 4x across cluster]
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,193 utils.orbital WARNING <27720.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,204 utils.orbital WARNING <27780.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,225 utils.orbital WARNING <27960.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,246 utils.orbital WARNING <28140.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,256 utils.orbital WARNING <28200.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,266 utils.orbital WARNING <28260.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,283 utils.orbital WARNING <28380.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,296 utils.orbital WARNING <28440.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:53,306 utils.orbital WARNING <28500.00> Could not find eclipse transitions in next 12000.0 seconds
(SingleAgentEnvRunner pid=5994) 2026-07-18 03:53:58,824 sats.satellite.Scanner-1 WARNING <7080.00> Scanner-1: failed battery_valid check [repeated 3x across cluster]
2026-07-18 03:54:04,782 INFO tune.py:1009 -- Wrote the latest version of all result files and experiment state to '/home/runner/ray_results/PPO_2026-07-18_03-52-50' in 0.0166s.
2026-07-18 03:54:05,010 INFO tune.py:1041 -- Total run time: 74.70 seconds (74.40 seconds for the tuning loop).