Training with RLlib PPO
RLlib is a high-performance, distributed reinforcement learning library. It is preferable to other RL libraries (e.g. Stable Baselines 3) for bsk_rl environments because it steps environments copies asynchronously; because of the variable step lengths, variable episode step counts, and long episode reset times, stepping each environment independently can increase step throughput by 2-5 times.
Warning: RLlib currently has a bug that results in an undesirable timeout which stops training. Check here to see if it has been resolved: https://github.com/ray-project/ray/pull/45147
Define the Environment
A nadir-scanning environment is created, to the one used in this paper. The satellite has to collect data while managing the data buffer level and battery level.
First, the satellite class is defined. A custom dynamics model is created that defines a few additional properties to use in the state.
[1]:
import numpy as np
from bsk_rl import act, data, obs, sats, scene
from bsk_rl.sim import dyn, fsw
class ScanningDownlinkDynModel(dyn.ContinuousImagingDynModel, dyn.GroundStationDynModel):
# Define some custom properties to be accessed in the state
@property
def instrument_pointing_error(self) -> float:
r_BN_P_unit = self.r_BN_P/np.linalg.norm(self.r_BN_P)
c_hat_P = self.satellite.fsw.c_hat_P
return np.arccos(np.dot(-r_BN_P_unit, c_hat_P))
@property
def solar_pointing_error(self) -> float:
a = self.world.gravFactory.spiceObject.planetStateOutMsgs[
self.world.sun_index
].read().PositionVector
a_hat_N = a / np.linalg.norm(a)
nHat_B = self.satellite.sat_args["nHat_B"]
NB = np.transpose(self.BN)
nHat_N = NB @ nHat_B
return np.arccos(np.dot(nHat_N, a_hat_N))
class ScanningSatellite(sats.AccessSatellite):
observation_spec = [
obs.SatProperties(
dict(prop="storage_level_fraction"),
dict(prop="battery_charge_fraction"),
dict(prop="wheel_speeds_fraction"),
dict(prop="instrument_pointing_error", norm=np.pi),
dict(prop="solar_pointing_error", norm=np.pi)
),
obs.Eclipse(),
obs.OpportunityProperties(
dict(prop="opportunity_open", norm=5700),
dict(prop="opportunity_close", norm=5700),
type="ground_station",
n_ahead_observe=1,
),
obs.Time(),
]
action_spec = [
act.Scan(duration=180.0),
act.Charge(duration=180.0),
act.Downlink(duration=60.0),
act.Desat(duration=60.0),
]
dyn_type = ScanningDownlinkDynModel
fsw_type = fsw.ContinuousImagingFSWModel
Next, parameters are set. Since this scenario is focused on maintaining acceptable data and power levels, these are tuned to create a sufficiently interesting mission.
[2]:
sat = ScanningSatellite(
"Scanner-1",
sat_args=dict(
# Data
dataStorageCapacity=5000 * 8e6, # MB to bits
storageInit=lambda: np.random.uniform(0, 5000 * 8e6),
instrumentBaudRate=0.5e6,
transmitterBaudRate=-112e6,
# Power
batteryStorageCapacity=400 * 3600, # Wh to W*s
storedCharge_Init=lambda: np.random.uniform(400 * 3600 * 0.2, 400 * 3600 * 0.8),
basePowerDraw=-10.0,
instrumentPowerDraw=-30.0,
transmitterPowerDraw=-25.0,
thrusterPowerDraw=-80.0,
# Attitude
imageAttErrorRequirement=0.1,
imageRateErrorRequirement=0.1,
disturbance_vector=lambda: np.random.normal(scale=0.0001, size=3),
maxWheelSpeed=6000.0, # RPM
wheelSpeeds=lambda: np.random.uniform(-3000, 3000, 3),
desatAttitude="nadir",
nHat_B=np.array([0, 0, -1]), # Solar panel orientation
)
)
Finally, the environment arguments are set. Stepping through this environment is demonstrated at the bottom of the page.
[3]:
duration = 2 * 5700.0 # About 2 orbits
env_args = dict(
satellite=sat,
scenario=scene.UniformNadirScanning(value_per_second=1/duration),
rewarder=data.ScanningTimeReward(),
time_limit=duration,
failure_penalty=-1.0,
terminate_on_time_limit=True,
)
Configure Ray and PPO
The bsk_rl package supplies a utility to make logging information at the end of episodes easier. This is useful to see how an agent’s policy is changing over time, using a monitoring program such as TensorBoard.
[4]:
from bsk_rl.utils.rllib import EpisodeDataCallbacks
class CustomDataCallbacks(EpisodeDataCallbacks):
def pull_env_metrics(self, env):
reward = env.rewarder.cum_reward
reward = sum(reward.values()) / len(reward)
orbits = env.simulator.sim_time / (95 * 60)
data = dict(
reward=reward,
reward_per_orbit=reward / orbits,
# Are satellites dying, and how and when?
alive=float(env.satellite.is_alive()),
rw_status_valid=float(env.satellite.dynamics.rw_speeds_valid()),
battery_status_valid=float(env.satellite.dynamics.battery_valid()),
orbits_complete=orbits,
)
if not env.satellite.is_alive():
data["orbits_complete_partial_only"] = orbits
return data
Then, PPO (or some other algorithm) can be configured. Of particular importance are setting sample_timeout_s and metrics_episode_collection_timeout_s to appropriately high values for this environment.
[5]:
from bsk_rl import SatelliteTasking
from bsk_rl.utils.rllib import unpack_config
from ray.rllib.algorithms.ppo import PPOConfig
training_args = dict(
lr=0.00003,
gamma=0.999,
train_batch_size=250, # In practice, usually a bigger number
num_sgd_iter=10,
model=dict(fcnet_hiddens=[512, 512], vf_share_layers=False),
lambda_=0.95,
use_kl_loss=False,
clip_param=0.1,
grad_clip=0.5,
)
config = (
PPOConfig()
.training(**training_args)
.env_runners(num_env_runners=2, sample_timeout_s=1000.0)
.environment(
env=unpack_config(SatelliteTasking),
env_config=env_args,
)
.callbacks(CustomDataCallbacks)
.reporting(
metrics_num_episodes_for_smoothing=1,
metrics_episode_collection_timeout_s=180,
)
.checkpointing(export_native_model_files=True)
.framework(framework="tf2")
)
Once the PPO configuration has been set, ray can be started and the agent can be trained.
Training on a reasonably modern machine, we can achieve 5M steps over 32 processors in 6 to 18 hours, depending on specific environment configurations.
[6]:
import ray
from ray import tune
ray.init(
ignore_reinit_error=True,
num_cpus=3,
object_store_memory=2_000_000_000, # 2 GB
)
# Run the training
tune.run(
"PPO",
config=config.to_dict(),
stop={"training_iteration": 10}, # Adjust the number of iterations as needed
checkpoint_freq=10,
checkpoint_at_end=True
)
# Shutdown Ray
ray.shutdown()
2024-06-21 15:53:03,117 INFO worker.py:1749 -- Started a local Ray instance.
2024-06-21 15:53:03,441 INFO tune.py:614 -- [output] This uses the legacy output and progress reporter, as Jupyter notebooks are not supported by the new engine, yet. For more information, please see https://github.com/ray-project/ray/issues/36949
/Users/markstephenson/avslab/refactor/.venv_refactor/lib/python3.10/site-packages/gymnasium/spaces/box.py:130: UserWarning: WARN: Box bound precision lowered by casting to float32
gym.logger.warn(f"Box bound precision lowered by casting to {self.dtype}")
/Users/markstephenson/avslab/refactor/.venv_refactor/lib/python3.10/site-packages/gymnasium/utils/passive_env_checker.py:164: UserWarning: WARN: The obs returned by the `reset()` method was expecting numpy array dtype to be float32, actual type: float64
logger.warn(
/Users/markstephenson/avslab/refactor/.venv_refactor/lib/python3.10/site-packages/gymnasium/utils/passive_env_checker.py:188: UserWarning: WARN: The obs returned by the `reset()` method is not within the observation space.
logger.warn(f"{pre} is not within the observation space.")
Tune Status
| Current time: | 2024-06-21 15:53:31 |
| Running for: | 00:00:27.67 |
| Memory: | 13.5/16.0 GiB |
System Info
Using FIFO scheduling algorithm.Logical resource usage: 3.0/3 CPUs, 0/0 GPUs
Trial Status
| Trial name | status | loc | iter | total time (s) | ts | num_healthy_workers | num_in_flight_async_ reqs | num_remote_worker_re starts |
|---|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking_Unpacked_04380_00000 | TERMINATED | 127.0.0.1:70339 | 10 | 18.558 | 2500 | 2 | 0 | 0 |
2024-06-21 15:53:03,474 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_cpus_per_worker` has been deprecated. Use `AlgorithmConfig.num_cpus_per_env_runner` instead. This will raise an error in the future!
2024-06-21 15:53:03,474 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_gpus_per_worker` has been deprecated. Use `AlgorithmConfig.num_gpus_per_env_runner` instead. This will raise an error in the future!
2024-06-21 15:53:03,474 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_learner_workers` has been deprecated. Use `AlgorithmConfig.num_learners` instead. This will raise an error in the future!
2024-06-21 15:53:03,474 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_cpus_per_learner_worker` has been deprecated. Use `AlgorithmConfig.num_cpus_per_learner` instead. This will raise an error in the future!
2024-06-21 15:53:03,474 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_gpus_per_learner_worker` has been deprecated. Use `AlgorithmConfig.num_gpus_per_learner` instead. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:07,538 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_cpus_per_worker` has been deprecated. Use `AlgorithmConfig.num_cpus_per_env_runner` instead. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:07,538 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_gpus_per_worker` has been deprecated. Use `AlgorithmConfig.num_gpus_per_env_runner` instead. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:07,538 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_learner_workers` has been deprecated. Use `AlgorithmConfig.num_learners` instead. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:07,538 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_cpus_per_learner_worker` has been deprecated. Use `AlgorithmConfig.num_cpus_per_learner` instead. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:07,538 WARNING deprecation.py:50 -- DeprecationWarning: `AlgorithmConfig.num_gpus_per_learner_worker` has been deprecated. Use `AlgorithmConfig.num_gpus_per_learner` instead. This will raise an error in the future!
(PPO pid=70339) Install gputil for GPU system monitoring.
(PPO pid=70339) 2024-06-21 15:53:14,125 WARNING deprecation.py:50 -- DeprecationWarning: `_get_slice_indices` has been deprecated. This will raise an error in the future!
(PPO pid=70339) 2024-06-21 15:53:14,143 WARNING tf_utils.py:774 -- KL divergence is non-finite, this will likely destabilize your model and the training process. Action(s) in a specific state have near-zero probability. This can happen naturally in deterministic environments where the optimal policy has zero mass for a specific action. To fix this issue, consider setting the coefficient for the KL loss term to zero or increasing policy entropy.
(PPO pid=70339) 2024-06-21 15:53:14,270 WARNING tf_utils.py:774 -- KL divergence is non-finite, this will likely destabilize your model and the training process. Action(s) in a specific state have near-zero probability. This can happen naturally in deterministic environments where the optimal policy has zero mass for a specific action. To fix this issue, consider setting the coefficient for the KL loss term to zero or increasing policy entropy.
(PPO pid=70339) 2024-06-21 15:53:14,488 WARNING tf_utils.py:774 -- KL divergence is non-finite, this will likely destabilize your model and the training process. Action(s) in a specific state have near-zero probability. This can happen naturally in deterministic environments where the optimal policy has zero mass for a specific action. To fix this issue, consider setting the coefficient for the KL loss term to zero or increasing policy entropy.
Trial Progress
| Trial name | agent_timesteps_total | counters | custom_metrics | env_runners | episode_media | fps | info | num_agent_steps_sampled | num_agent_steps_sampled_lifetime | num_agent_steps_trained | num_env_steps_sampled | num_env_steps_sampled_lifetime | num_env_steps_sampled_this_iter | num_env_steps_sampled_throughput_per_sec | num_env_steps_trained | num_env_steps_trained_this_iter | num_env_steps_trained_throughput_per_sec | num_healthy_workers | num_in_flight_async_reqs | num_remote_worker_restarts | num_steps_trained_this_iter | perf | timers |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PPO_SatelliteTasking_Unpacked_04380_00000 | 2500 | {'num_env_steps_sampled': 2500, 'num_env_steps_trained': 2500, 'num_agent_steps_sampled': 2500, 'num_agent_steps_trained': 2500} | {} | {'episode_reward_max': 0.5413157894736842, 'episode_reward_min': 0.40394736842105244, 'episode_reward_mean': 0.4726315789473683, 'episode_len_mean': 88.0, 'episode_media': {}, 'episodes_this_iter': 2, 'episodes_timesteps_total': 176, 'policy_reward_min': {}, 'policy_reward_max': {}, 'policy_reward_mean': {}, 'custom_metrics': {'reward_mean': 0.4726315789473683, 'reward_min': 0.40394736842105244, 'reward_max': 0.5413157894736842, 'reward_per_orbit_mean': 0.23631578947368415, 'reward_per_orbit_min': 0.20197368421052622, 'reward_per_orbit_max': 0.2706578947368421, 'alive_mean': 1.0, 'alive_min': 1.0, 'alive_max': 1.0, 'rw_status_valid_mean': 1.0, 'rw_status_valid_min': 1.0, 'rw_status_valid_max': 1.0, 'battery_status_valid_mean': 1.0, 'battery_status_valid_min': 1.0, 'battery_status_valid_max': 1.0, 'orbits_complete_mean': 2.0, 'orbits_complete_min': 2.0, 'orbits_complete_max': 2.0}, 'hist_stats': {'episode_reward': [0.40394736842105244, 0.5413157894736842], 'episode_lengths': [92, 84]}, 'sampler_perf': {'mean_raw_obs_processing_ms': 3.101712889332089, 'mean_inference_ms': 0.6436502142585248, 'mean_action_processing_ms': 0.04842222261009552, 'mean_env_wait_ms': 9.618122324192647, 'mean_env_render_ms': 0.0}, 'num_faulty_episodes': 0, 'connector_metrics': {'ObsPreprocessorConnector_ms': 0.0033617019653320312, 'StateBufferConnector_ms': 0.0021576881408691406, 'ViewRequirementAgentConnector_ms': 0.04621744155883789}, 'num_episodes': 2, 'episode_return_max': 0.5413157894736842, 'episode_return_min': 0.40394736842105244, 'episode_return_mean': 0.4726315789473683} | {} | 140.849 | {'learner': {'default_policy': {'learner_stats': {'cur_kl_coeff': 0.0003906250058207661, 'cur_lr': 2.9999999242136255e-05, 'total_loss': 0.002937226, 'policy_loss': -0.0055964356, 'vf_loss': 0.008533249, 'vf_explained_var': -0.010654608, 'kl': 0.0010568084, 'entropy': 1.2708192, 'entropy_coeff': 0.0}, 'custom_metrics': {}, 'num_agent_steps_trained': 125.0, 'num_grad_updates_lifetime': 190.5, 'diff_num_grad_updates_vs_sampler_policy': 9.5}}, 'num_env_steps_sampled': 2500, 'num_env_steps_trained': 2500, 'num_agent_steps_sampled': 2500, 'num_agent_steps_trained': 2500} | 2500 | 2500 | 2500 | 2500 | 2500 | 250 | 141.002 | 2500 | 250 | 141.002 | 2 | 0 | 0 | 250 | {'cpu_util_percent': 23.15, 'ram_util_percent': 84.1} | {'training_iteration_time_ms': 1853.609, 'restore_workers_time_ms': 0.008, 'training_step_time_ms': 1853.58, 'sample_time_ms': 1729.096, 'learn_time_ms': 120.671, 'learn_throughput': 2071.752, 'synch_weights_time_ms': 3.59} |
(PPO pid=70339) WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
(PPO pid=70339) WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
2024-06-21 15:53:31,138 INFO tune.py:1007 -- Wrote the latest version of all result files and experiment state to '/Users/markstephenson/ray_results/PPO_2024-06-21_15-53-03' in 0.0166s.
(PPO pid=70339) /Users/markstephenson/avslab/refactor/.venv_refactor/lib/python3.10/site-packages/keras/src/initializers/__init__.py:144: UserWarning: The `keras.initializers.serialize()` API should only be used for objects of type `keras.initializers.Initializer`. Found an instance of type <class 'function'>, which may lead to improper serialization.
(PPO pid=70339) warnings.warn(
(PPO pid=70339) Checkpoint successfully created at: Checkpoint(filesystem=local, path=/Users/markstephenson/ray_results/PPO_2024-06-21_15-53-03/PPO_SatelliteTasking_Unpacked_04380_00000_0_2024-06-21_15-53-03/checkpoint_000000)
2024-06-21 15:53:31,305 INFO tune.py:1039 -- Total run time: 27.86 seconds (27.65 seconds for the tuning loop).
Loading the Policy Network
The policy network can be found in the model subdirectory of the checkpoint output.
Stepping Through the Environment
The environment is stepped through with random actions to give a sense of how it acts.
[7]:
env = SatelliteTasking(**env_args, log_level="INFO")
env.reset()
terminated = False
while not terminated:
action = env.action_space.sample()
observation, reward, terminated, truncated, info = env.step(action)
2024-06-21 15:53:32,734 gym INFO Resetting environment with seed=3627897200
2024-06-21 15:53:32,830 sats.satellite.Scanner-1 INFO <0.00> Scanner-1: Finding opportunity windows from 0.00 to 11400.00 seconds
2024-06-21 15:53:32,855 gym INFO <0.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,856 gym INFO <0.00> Environment reset
2024-06-21 15:53:32,856 gym INFO <0.00> === STARTING STEP ===
2024-06-21 15:53:32,856 sats.satellite.Scanner-1 INFO <0.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,857 sats.satellite.Scanner-1 INFO <0.00> Scanner-1: setting timed terminal event at 60.0
2024-06-21 15:53:32,857 sim.simulator INFO <0.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,861 sats.satellite.Scanner-1 INFO <60.00> Scanner-1: timed termination at 60.0 for action_downlink
2024-06-21 15:53:32,861 data.base INFO <60.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,862 gym INFO <60.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,862 gym INFO <60.00> Step reward: 0.0
2024-06-21 15:53:32,862 gym INFO <60.00> === STARTING STEP ===
2024-06-21 15:53:32,862 sats.satellite.Scanner-1 INFO <60.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,863 sats.satellite.Scanner-1 INFO <60.00> Scanner-1: setting timed terminal event at 120.0
2024-06-21 15:53:32,863 sim.simulator INFO <60.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,867 sats.satellite.Scanner-1 INFO <120.00> Scanner-1: timed termination at 120.0 for action_desat
2024-06-21 15:53:32,867 data.base INFO <120.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,868 gym INFO <120.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,868 gym INFO <120.00> Step reward: 0.0
2024-06-21 15:53:32,868 gym INFO <120.00> === STARTING STEP ===
2024-06-21 15:53:32,868 sats.satellite.Scanner-1 INFO <120.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,868 sats.satellite.Scanner-1 INFO <120.00> Scanner-1: setting timed terminal event at 180.0
2024-06-21 15:53:32,869 sim.simulator INFO <120.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,872 sats.satellite.Scanner-1 INFO <180.00> Scanner-1: timed termination at 180.0 for action_desat
2024-06-21 15:53:32,873 data.base INFO <180.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,873 gym INFO <180.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,874 gym INFO <180.00> Step reward: 0.0
2024-06-21 15:53:32,874 gym INFO <180.00> === STARTING STEP ===
2024-06-21 15:53:32,874 sats.satellite.Scanner-1 INFO <180.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:32,874 sats.satellite.Scanner-1 INFO <180.00> Scanner-1: setting timed terminal event at 360.0
2024-06-21 15:53:32,875 sim.simulator INFO <180.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,885 sats.satellite.Scanner-1 INFO <360.00> Scanner-1: timed termination at 360.0 for action_charge
2024-06-21 15:53:32,885 data.base INFO <360.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,886 gym INFO <360.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,886 gym INFO <360.00> Step reward: 0.0
2024-06-21 15:53:32,886 gym INFO <360.00> === STARTING STEP ===
2024-06-21 15:53:32,886 sats.satellite.Scanner-1 INFO <360.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:32,886 sats.satellite.Scanner-1 INFO <360.00> Scanner-1: setting timed terminal event at 540.0
2024-06-21 15:53:32,887 sim.simulator INFO <360.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,897 sats.satellite.Scanner-1 INFO <540.00> Scanner-1: timed termination at 540.0 for action_charge
2024-06-21 15:53:32,897 data.base INFO <540.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,897 gym INFO <540.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,898 gym INFO <540.00> Step reward: 0.0
2024-06-21 15:53:32,898 gym INFO <540.00> === STARTING STEP ===
2024-06-21 15:53:32,898 sats.satellite.Scanner-1 INFO <540.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,898 sats.satellite.Scanner-1 INFO <540.00> Scanner-1: setting timed terminal event at 600.0
2024-06-21 15:53:32,899 sim.simulator INFO <540.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,902 sats.satellite.Scanner-1 INFO <600.00> Scanner-1: timed termination at 600.0 for action_desat
2024-06-21 15:53:32,903 data.base INFO <600.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,903 gym INFO <600.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,904 gym INFO <600.00> Step reward: 0.0
2024-06-21 15:53:32,904 gym INFO <600.00> === STARTING STEP ===
2024-06-21 15:53:32,904 sats.satellite.Scanner-1 INFO <600.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,904 sats.satellite.Scanner-1 INFO <600.00> Scanner-1: setting timed terminal event at 660.0
2024-06-21 15:53:32,904 sim.simulator INFO <600.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,908 sats.satellite.Scanner-1 INFO <660.00> Scanner-1: timed termination at 660.0 for action_downlink
2024-06-21 15:53:32,908 data.base INFO <660.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,909 gym INFO <660.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,909 gym INFO <660.00> Step reward: 0.0
2024-06-21 15:53:32,910 gym INFO <660.00> === STARTING STEP ===
2024-06-21 15:53:32,910 sats.satellite.Scanner-1 INFO <660.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:32,910 sats.satellite.Scanner-1 INFO <660.00> Scanner-1: setting timed terminal event at 840.0
2024-06-21 15:53:32,910 sim.simulator INFO <660.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,920 sats.satellite.Scanner-1 INFO <840.00> Scanner-1: timed termination at 840.0 for action_charge
2024-06-21 15:53:32,920 data.base INFO <840.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,921 gym INFO <840.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,921 gym INFO <840.00> Step reward: 0.0
2024-06-21 15:53:32,922 gym INFO <840.00> === STARTING STEP ===
2024-06-21 15:53:32,922 sats.satellite.Scanner-1 INFO <840.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,922 sats.satellite.Scanner-1 INFO <840.00> Scanner-1: setting timed terminal event at 900.0
2024-06-21 15:53:32,922 sim.simulator INFO <840.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,926 sats.satellite.Scanner-1 INFO <900.00> Scanner-1: timed termination at 900.0 for action_downlink
2024-06-21 15:53:32,926 data.base INFO <900.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,927 gym INFO <900.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,927 gym INFO <900.00> Step reward: 0.0
2024-06-21 15:53:32,927 gym INFO <900.00> === STARTING STEP ===
2024-06-21 15:53:32,928 sats.satellite.Scanner-1 INFO <900.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,928 sats.satellite.Scanner-1 INFO <900.00> Scanner-1: setting timed terminal event at 960.0
2024-06-21 15:53:32,928 sim.simulator INFO <900.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,932 sats.satellite.Scanner-1 INFO <960.00> Scanner-1: timed termination at 960.0 for action_desat
2024-06-21 15:53:32,932 data.base INFO <960.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,933 gym INFO <960.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,933 gym INFO <960.00> Step reward: 0.0
2024-06-21 15:53:32,933 gym INFO <960.00> === STARTING STEP ===
2024-06-21 15:53:32,934 sats.satellite.Scanner-1 INFO <960.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,934 sats.satellite.Scanner-1 INFO <960.00> Scanner-1: setting timed terminal event at 1020.0
2024-06-21 15:53:32,934 sim.simulator INFO <960.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,938 sats.satellite.Scanner-1 INFO <1020.00> Scanner-1: timed termination at 1020.0 for action_desat
2024-06-21 15:53:32,938 data.base INFO <1020.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,939 gym INFO <1020.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,939 gym INFO <1020.00> Step reward: 0.0
2024-06-21 15:53:32,939 gym INFO <1020.00> === STARTING STEP ===
2024-06-21 15:53:32,939 sats.satellite.Scanner-1 INFO <1020.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,939 sats.satellite.Scanner-1 INFO <1020.00> Scanner-1: setting timed terminal event at 1080.0
2024-06-21 15:53:32,940 sim.simulator INFO <1020.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,943 sats.satellite.Scanner-1 INFO <1080.00> Scanner-1: timed termination at 1080.0 for action_desat
2024-06-21 15:53:32,944 data.base INFO <1080.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,944 gym INFO <1080.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,945 gym INFO <1080.00> Step reward: 0.0
2024-06-21 15:53:32,945 gym INFO <1080.00> === STARTING STEP ===
2024-06-21 15:53:32,945 sats.satellite.Scanner-1 INFO <1080.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,945 sats.satellite.Scanner-1 INFO <1080.00> Scanner-1: setting timed terminal event at 1140.0
2024-06-21 15:53:32,945 sim.simulator INFO <1080.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,949 sats.satellite.Scanner-1 INFO <1140.00> Scanner-1: timed termination at 1140.0 for action_desat
2024-06-21 15:53:32,949 data.base INFO <1140.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,950 gym INFO <1140.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,950 gym INFO <1140.00> Step reward: 0.0
2024-06-21 15:53:32,951 gym INFO <1140.00> === STARTING STEP ===
2024-06-21 15:53:32,951 sats.satellite.Scanner-1 INFO <1140.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,951 sats.satellite.Scanner-1 INFO <1140.00> Scanner-1: setting timed terminal event at 1200.0
2024-06-21 15:53:32,951 sim.simulator INFO <1140.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,955 sats.satellite.Scanner-1 INFO <1200.00> Scanner-1: timed termination at 1200.0 for action_downlink
2024-06-21 15:53:32,955 data.base INFO <1200.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,956 gym INFO <1200.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,956 gym INFO <1200.00> Step reward: 0.0
2024-06-21 15:53:32,956 gym INFO <1200.00> === STARTING STEP ===
2024-06-21 15:53:32,956 sats.satellite.Scanner-1 INFO <1200.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:32,957 sats.satellite.Scanner-1 INFO <1200.00> Scanner-1: setting timed terminal event at 1380.0
2024-06-21 15:53:32,957 sim.simulator INFO <1200.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,967 sats.satellite.Scanner-1 INFO <1380.00> Scanner-1: timed termination at 1380.0 for action_nadir_scan
2024-06-21 15:53:32,967 data.base INFO <1380.00> Data reward: {'Scanner-1_4913732896': 0.011666666666666665}
2024-06-21 15:53:32,968 gym INFO <1380.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,968 gym INFO <1380.00> Step reward: 0.011666666666666665
2024-06-21 15:53:32,968 gym INFO <1380.00> === STARTING STEP ===
2024-06-21 15:53:32,968 sats.satellite.Scanner-1 INFO <1380.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:32,969 sats.satellite.Scanner-1 INFO <1380.00> Scanner-1: setting timed terminal event at 1560.0
2024-06-21 15:53:32,969 sim.simulator INFO <1380.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,979 sats.satellite.Scanner-1 INFO <1560.00> Scanner-1: timed termination at 1560.0 for action_nadir_scan
2024-06-21 15:53:32,979 data.base INFO <1560.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:32,980 gym INFO <1560.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,980 gym INFO <1560.00> Step reward: 0.015789473684210527
2024-06-21 15:53:32,980 gym INFO <1560.00> === STARTING STEP ===
2024-06-21 15:53:32,980 sats.satellite.Scanner-1 INFO <1560.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,981 sats.satellite.Scanner-1 INFO <1560.00> Scanner-1: setting timed terminal event at 1620.0
2024-06-21 15:53:32,981 sim.simulator INFO <1560.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,984 sats.satellite.Scanner-1 INFO <1620.00> Scanner-1: timed termination at 1620.0 for action_desat
2024-06-21 15:53:32,985 data.base INFO <1620.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,985 gym INFO <1620.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,986 gym INFO <1620.00> Step reward: 0.0
2024-06-21 15:53:32,986 gym INFO <1620.00> === STARTING STEP ===
2024-06-21 15:53:32,986 sats.satellite.Scanner-1 INFO <1620.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,986 sats.satellite.Scanner-1 INFO <1620.00> Scanner-1: setting timed terminal event at 1680.0
2024-06-21 15:53:32,987 sim.simulator INFO <1620.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,990 sats.satellite.Scanner-1 INFO <1680.00> Scanner-1: timed termination at 1680.0 for action_downlink
2024-06-21 15:53:32,990 data.base INFO <1680.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,991 gym INFO <1680.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,991 gym INFO <1680.00> Step reward: 0.0
2024-06-21 15:53:32,992 gym INFO <1680.00> === STARTING STEP ===
2024-06-21 15:53:32,992 sats.satellite.Scanner-1 INFO <1680.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:32,992 sats.satellite.Scanner-1 INFO <1680.00> Scanner-1: setting timed terminal event at 1740.0
2024-06-21 15:53:32,992 sim.simulator INFO <1680.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:32,996 sats.satellite.Scanner-1 INFO <1740.00> Scanner-1: timed termination at 1740.0 for action_desat
2024-06-21 15:53:32,996 data.base INFO <1740.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:32,997 gym INFO <1740.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:32,997 gym INFO <1740.00> Step reward: 0.0
2024-06-21 15:53:32,997 gym INFO <1740.00> === STARTING STEP ===
2024-06-21 15:53:32,997 sats.satellite.Scanner-1 INFO <1740.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:32,998 sats.satellite.Scanner-1 INFO <1740.00> Scanner-1: setting timed terminal event at 1800.0
2024-06-21 15:53:32,998 sim.simulator INFO <1740.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,001 sats.satellite.Scanner-1 INFO <1800.00> Scanner-1: timed termination at 1800.0 for action_downlink
2024-06-21 15:53:33,002 data.base INFO <1800.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,003 gym INFO <1800.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,003 gym INFO <1800.00> Step reward: 0.0
2024-06-21 15:53:33,003 gym INFO <1800.00> === STARTING STEP ===
2024-06-21 15:53:33,003 sats.satellite.Scanner-1 INFO <1800.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,004 sats.satellite.Scanner-1 INFO <1800.00> Scanner-1: setting timed terminal event at 1980.0
2024-06-21 15:53:33,004 sim.simulator INFO <1800.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,014 sats.satellite.Scanner-1 INFO <1980.00> Scanner-1: timed termination at 1980.0 for action_nadir_scan
2024-06-21 15:53:33,014 data.base INFO <1980.00> Data reward: {'Scanner-1_4913732896': 0.011842105263157893}
2024-06-21 15:53:33,015 gym INFO <1980.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,015 gym INFO <1980.00> Step reward: 0.011842105263157893
2024-06-21 15:53:33,015 gym INFO <1980.00> === STARTING STEP ===
2024-06-21 15:53:33,015 sats.satellite.Scanner-1 INFO <1980.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,015 sats.satellite.Scanner-1 INFO <1980.00> Scanner-1: setting timed terminal event at 2160.0
2024-06-21 15:53:33,016 sim.simulator INFO <1980.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,026 sats.satellite.Scanner-1 INFO <2160.00> Scanner-1: timed termination at 2160.0 for action_nadir_scan
2024-06-21 15:53:33,026 data.base INFO <2160.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,027 gym INFO <2160.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,027 gym INFO <2160.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,027 gym INFO <2160.00> === STARTING STEP ===
2024-06-21 15:53:33,027 sats.satellite.Scanner-1 INFO <2160.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,028 sats.satellite.Scanner-1 INFO <2160.00> Scanner-1: setting timed terminal event at 2340.0
2024-06-21 15:53:33,028 sim.simulator INFO <2160.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,038 sats.satellite.Scanner-1 INFO <2340.00> Scanner-1: timed termination at 2340.0 for action_charge
2024-06-21 15:53:33,038 data.base INFO <2340.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,039 gym INFO <2340.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,039 gym INFO <2340.00> Step reward: 0.0
2024-06-21 15:53:33,039 gym INFO <2340.00> === STARTING STEP ===
2024-06-21 15:53:33,040 sats.satellite.Scanner-1 INFO <2340.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,040 sats.satellite.Scanner-1 INFO <2340.00> Scanner-1: setting timed terminal event at 2520.0
2024-06-21 15:53:33,040 sim.simulator INFO <2340.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,050 sats.satellite.Scanner-1 INFO <2520.00> Scanner-1: timed termination at 2520.0 for action_charge
2024-06-21 15:53:33,050 data.base INFO <2520.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,051 gym INFO <2520.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,051 gym INFO <2520.00> Step reward: 0.0
2024-06-21 15:53:33,051 gym INFO <2520.00> === STARTING STEP ===
2024-06-21 15:53:33,052 sats.satellite.Scanner-1 INFO <2520.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,052 sats.satellite.Scanner-1 INFO <2520.00> Scanner-1: setting timed terminal event at 2580.0
2024-06-21 15:53:33,052 sim.simulator INFO <2520.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,056 sats.satellite.Scanner-1 INFO <2580.00> Scanner-1: timed termination at 2580.0 for action_downlink
2024-06-21 15:53:33,056 data.base INFO <2580.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,057 gym INFO <2580.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,057 gym INFO <2580.00> Step reward: 0.0
2024-06-21 15:53:33,057 gym INFO <2580.00> === STARTING STEP ===
2024-06-21 15:53:33,057 sats.satellite.Scanner-1 INFO <2580.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,057 sats.satellite.Scanner-1 INFO <2580.00> Scanner-1: setting timed terminal event at 2760.0
2024-06-21 15:53:33,058 sim.simulator INFO <2580.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,068 sats.satellite.Scanner-1 INFO <2760.00> Scanner-1: timed termination at 2760.0 for action_charge
2024-06-21 15:53:33,068 data.base INFO <2760.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,069 gym INFO <2760.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,069 gym INFO <2760.00> Step reward: 0.0
2024-06-21 15:53:33,069 gym INFO <2760.00> === STARTING STEP ===
2024-06-21 15:53:33,069 sats.satellite.Scanner-1 INFO <2760.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,070 sats.satellite.Scanner-1 INFO <2760.00> Scanner-1: setting timed terminal event at 2940.0
2024-06-21 15:53:33,070 sim.simulator INFO <2760.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,080 sats.satellite.Scanner-1 INFO <2940.00> Scanner-1: timed termination at 2940.0 for action_charge
2024-06-21 15:53:33,080 data.base INFO <2940.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,081 gym INFO <2940.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,081 gym INFO <2940.00> Step reward: 0.0
2024-06-21 15:53:33,081 gym INFO <2940.00> === STARTING STEP ===
2024-06-21 15:53:33,081 sats.satellite.Scanner-1 INFO <2940.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,082 sats.satellite.Scanner-1 INFO <2940.00> Scanner-1: setting timed terminal event at 3000.0
2024-06-21 15:53:33,082 sim.simulator INFO <2940.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,086 sats.satellite.Scanner-1 INFO <3000.00> Scanner-1: timed termination at 3000.0 for action_desat
2024-06-21 15:53:33,086 data.base INFO <3000.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,087 gym INFO <3000.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,087 gym INFO <3000.00> Step reward: 0.0
2024-06-21 15:53:33,087 gym INFO <3000.00> === STARTING STEP ===
2024-06-21 15:53:33,087 sats.satellite.Scanner-1 INFO <3000.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,087 sats.satellite.Scanner-1 INFO <3000.00> Scanner-1: setting timed terminal event at 3180.0
2024-06-21 15:53:33,088 sim.simulator INFO <3000.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,098 sats.satellite.Scanner-1 INFO <3180.00> Scanner-1: timed termination at 3180.0 for action_nadir_scan
2024-06-21 15:53:33,098 data.base INFO <3180.00> Data reward: {'Scanner-1_4913732896': 0.012543859649122807}
2024-06-21 15:53:33,099 gym INFO <3180.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,099 gym INFO <3180.00> Step reward: 0.012543859649122807
2024-06-21 15:53:33,099 gym INFO <3180.00> === STARTING STEP ===
2024-06-21 15:53:33,099 sats.satellite.Scanner-1 INFO <3180.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,100 sats.satellite.Scanner-1 INFO <3180.00> Scanner-1: setting timed terminal event at 3240.0
2024-06-21 15:53:33,100 sim.simulator INFO <3180.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,103 sats.satellite.Scanner-1 INFO <3240.00> Scanner-1: timed termination at 3240.0 for action_desat
2024-06-21 15:53:33,104 data.base INFO <3240.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,104 gym INFO <3240.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,105 gym INFO <3240.00> Step reward: 0.0
2024-06-21 15:53:33,105 gym INFO <3240.00> === STARTING STEP ===
2024-06-21 15:53:33,105 sats.satellite.Scanner-1 INFO <3240.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,105 sats.satellite.Scanner-1 INFO <3240.00> Scanner-1: setting timed terminal event at 3420.0
2024-06-21 15:53:33,106 sim.simulator INFO <3240.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,116 sats.satellite.Scanner-1 INFO <3420.00> Scanner-1: timed termination at 3420.0 for action_nadir_scan
2024-06-21 15:53:33,116 data.base INFO <3420.00> Data reward: {'Scanner-1_4913732896': 0.012105263157894735}
2024-06-21 15:53:33,117 gym INFO <3420.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,117 gym INFO <3420.00> Step reward: 0.012105263157894735
2024-06-21 15:53:33,117 gym INFO <3420.00> === STARTING STEP ===
2024-06-21 15:53:33,117 sats.satellite.Scanner-1 INFO <3420.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,117 sats.satellite.Scanner-1 INFO <3420.00> Scanner-1: setting timed terminal event at 3480.0
2024-06-21 15:53:33,118 sim.simulator INFO <3420.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,121 sats.satellite.Scanner-1 INFO <3480.00> Scanner-1: timed termination at 3480.0 for action_desat
2024-06-21 15:53:33,122 data.base INFO <3480.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,122 gym INFO <3480.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,122 gym INFO <3480.00> Step reward: 0.0
2024-06-21 15:53:33,123 gym INFO <3480.00> === STARTING STEP ===
2024-06-21 15:53:33,123 sats.satellite.Scanner-1 INFO <3480.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,123 sats.satellite.Scanner-1 INFO <3480.00> Scanner-1: setting timed terminal event at 3660.0
2024-06-21 15:53:33,123 sim.simulator INFO <3480.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,133 sats.satellite.Scanner-1 INFO <3660.00> Scanner-1: timed termination at 3660.0 for action_charge
2024-06-21 15:53:33,133 data.base INFO <3660.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,134 gym INFO <3660.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,134 gym INFO <3660.00> Step reward: 0.0
2024-06-21 15:53:33,135 gym INFO <3660.00> === STARTING STEP ===
2024-06-21 15:53:33,135 sats.satellite.Scanner-1 INFO <3660.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,135 sats.satellite.Scanner-1 INFO <3660.00> Scanner-1: setting timed terminal event at 3840.0
2024-06-21 15:53:33,135 sim.simulator INFO <3660.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,145 sats.satellite.Scanner-1 INFO <3840.00> Scanner-1: timed termination at 3840.0 for action_charge
2024-06-21 15:53:33,146 data.base INFO <3840.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,146 gym INFO <3840.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,147 gym INFO <3840.00> Step reward: 0.0
2024-06-21 15:53:33,147 gym INFO <3840.00> === STARTING STEP ===
2024-06-21 15:53:33,147 sats.satellite.Scanner-1 INFO <3840.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,147 sats.satellite.Scanner-1 INFO <3840.00> Scanner-1: setting timed terminal event at 4020.0
2024-06-21 15:53:33,148 sim.simulator INFO <3840.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,158 sats.satellite.Scanner-1 INFO <4020.00> Scanner-1: timed termination at 4020.0 for action_charge
2024-06-21 15:53:33,158 data.base INFO <4020.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,159 gym INFO <4020.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,159 gym INFO <4020.00> Step reward: 0.0
2024-06-21 15:53:33,159 gym INFO <4020.00> === STARTING STEP ===
2024-06-21 15:53:33,159 sats.satellite.Scanner-1 INFO <4020.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,159 sats.satellite.Scanner-1 INFO <4020.00> Scanner-1: setting timed terminal event at 4080.0
2024-06-21 15:53:33,160 sim.simulator INFO <4020.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,163 sats.satellite.Scanner-1 INFO <4080.00> Scanner-1: timed termination at 4080.0 for action_desat
2024-06-21 15:53:33,164 data.base INFO <4080.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,164 gym INFO <4080.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,165 gym INFO <4080.00> Step reward: 0.0
2024-06-21 15:53:33,165 gym INFO <4080.00> === STARTING STEP ===
2024-06-21 15:53:33,165 sats.satellite.Scanner-1 INFO <4080.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,165 sats.satellite.Scanner-1 INFO <4080.00> Scanner-1: setting timed terminal event at 4260.0
2024-06-21 15:53:33,166 sim.simulator INFO <4080.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,176 sats.satellite.Scanner-1 INFO <4260.00> Scanner-1: timed termination at 4260.0 for action_nadir_scan
2024-06-21 15:53:33,176 data.base INFO <4260.00> Data reward: {'Scanner-1_4913732896': 0.012456140350877193}
2024-06-21 15:53:33,177 gym INFO <4260.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,177 gym INFO <4260.00> Step reward: 0.012456140350877193
2024-06-21 15:53:33,177 gym INFO <4260.00> === STARTING STEP ===
2024-06-21 15:53:33,177 sats.satellite.Scanner-1 INFO <4260.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,177 sats.satellite.Scanner-1 INFO <4260.00> Scanner-1: setting timed terminal event at 4320.0
2024-06-21 15:53:33,178 sim.simulator INFO <4260.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,181 sats.satellite.Scanner-1 INFO <4320.00> Scanner-1: timed termination at 4320.0 for action_desat
2024-06-21 15:53:33,182 data.base INFO <4320.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,182 gym INFO <4320.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,182 gym INFO <4320.00> Step reward: 0.0
2024-06-21 15:53:33,183 gym INFO <4320.00> === STARTING STEP ===
2024-06-21 15:53:33,183 sats.satellite.Scanner-1 INFO <4320.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,183 sats.satellite.Scanner-1 INFO <4320.00> Scanner-1: setting timed terminal event at 4380.0
2024-06-21 15:53:33,183 sim.simulator INFO <4320.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,187 sats.satellite.Scanner-1 INFO <4380.00> Scanner-1: timed termination at 4380.0 for action_downlink
2024-06-21 15:53:33,187 data.base INFO <4380.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,188 gym INFO <4380.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,188 gym INFO <4380.00> Step reward: 0.0
2024-06-21 15:53:33,188 gym INFO <4380.00> === STARTING STEP ===
2024-06-21 15:53:33,189 sats.satellite.Scanner-1 INFO <4380.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,189 sats.satellite.Scanner-1 INFO <4380.00> Scanner-1: setting timed terminal event at 4440.0
2024-06-21 15:53:33,189 sim.simulator INFO <4380.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,193 sats.satellite.Scanner-1 INFO <4440.00> Scanner-1: timed termination at 4440.0 for action_desat
2024-06-21 15:53:33,193 data.base INFO <4440.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,194 gym INFO <4440.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,194 gym INFO <4440.00> Step reward: 0.0
2024-06-21 15:53:33,194 gym INFO <4440.00> === STARTING STEP ===
2024-06-21 15:53:33,194 sats.satellite.Scanner-1 INFO <4440.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,195 sats.satellite.Scanner-1 INFO <4440.00> Scanner-1: setting timed terminal event at 4620.0
2024-06-21 15:53:33,195 sim.simulator INFO <4440.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,205 sats.satellite.Scanner-1 INFO <4620.00> Scanner-1: timed termination at 4620.0 for action_charge
2024-06-21 15:53:33,205 data.base INFO <4620.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,206 gym INFO <4620.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,206 gym INFO <4620.00> Step reward: 0.0
2024-06-21 15:53:33,206 gym INFO <4620.00> === STARTING STEP ===
2024-06-21 15:53:33,206 sats.satellite.Scanner-1 INFO <4620.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,207 sats.satellite.Scanner-1 INFO <4620.00> Scanner-1: setting timed terminal event at 4800.0
2024-06-21 15:53:33,207 sim.simulator INFO <4620.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,217 sats.satellite.Scanner-1 INFO <4800.00> Scanner-1: timed termination at 4800.0 for action_charge
2024-06-21 15:53:33,217 data.base INFO <4800.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,218 gym INFO <4800.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,218 gym INFO <4800.00> Step reward: 0.0
2024-06-21 15:53:33,218 gym INFO <4800.00> === STARTING STEP ===
2024-06-21 15:53:33,218 sats.satellite.Scanner-1 INFO <4800.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,219 sats.satellite.Scanner-1 INFO <4800.00> Scanner-1: setting timed terminal event at 4860.0
2024-06-21 15:53:33,219 sim.simulator INFO <4800.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,222 sats.satellite.Scanner-1 INFO <4860.00> Scanner-1: timed termination at 4860.0 for action_downlink
2024-06-21 15:53:33,223 data.base INFO <4860.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,223 gym INFO <4860.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,224 gym INFO <4860.00> Step reward: 0.0
2024-06-21 15:53:33,224 gym INFO <4860.00> === STARTING STEP ===
2024-06-21 15:53:33,224 sats.satellite.Scanner-1 INFO <4860.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,224 sats.satellite.Scanner-1 INFO <4860.00> Scanner-1: setting timed terminal event at 4920.0
2024-06-21 15:53:33,224 sim.simulator INFO <4860.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,228 sats.satellite.Scanner-1 INFO <4920.00> Scanner-1: timed termination at 4920.0 for action_desat
2024-06-21 15:53:33,228 data.base INFO <4920.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,229 gym INFO <4920.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,229 gym INFO <4920.00> Step reward: 0.0
2024-06-21 15:53:33,230 gym INFO <4920.00> === STARTING STEP ===
2024-06-21 15:53:33,230 sats.satellite.Scanner-1 INFO <4920.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,230 sats.satellite.Scanner-1 INFO <4920.00> Scanner-1: setting timed terminal event at 4980.0
2024-06-21 15:53:33,230 sim.simulator INFO <4920.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,234 sats.satellite.Scanner-1 INFO <4980.00> Scanner-1: timed termination at 4980.0 for action_desat
2024-06-21 15:53:33,234 data.base INFO <4980.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,235 gym INFO <4980.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,235 gym INFO <4980.00> Step reward: 0.0
2024-06-21 15:53:33,236 gym INFO <4980.00> === STARTING STEP ===
2024-06-21 15:53:33,236 sats.satellite.Scanner-1 INFO <4980.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,236 sats.satellite.Scanner-1 INFO <4980.00> Scanner-1: setting timed terminal event at 5160.0
2024-06-21 15:53:33,236 sim.simulator INFO <4980.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,246 sats.satellite.Scanner-1 INFO <5160.00> Scanner-1: timed termination at 5160.0 for action_charge
2024-06-21 15:53:33,246 data.base INFO <5160.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,247 gym INFO <5160.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,247 gym INFO <5160.00> Step reward: 0.0
2024-06-21 15:53:33,248 gym INFO <5160.00> === STARTING STEP ===
2024-06-21 15:53:33,248 sats.satellite.Scanner-1 INFO <5160.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,248 sats.satellite.Scanner-1 INFO <5160.00> Scanner-1: setting timed terminal event at 5340.0
2024-06-21 15:53:33,248 sim.simulator INFO <5160.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,258 sats.satellite.Scanner-1 INFO <5340.00> Scanner-1: timed termination at 5340.0 for action_charge
2024-06-21 15:53:33,258 data.base INFO <5340.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,259 gym INFO <5340.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,259 gym INFO <5340.00> Step reward: 0.0
2024-06-21 15:53:33,260 gym INFO <5340.00> === STARTING STEP ===
2024-06-21 15:53:33,260 sats.satellite.Scanner-1 INFO <5340.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,260 sats.satellite.Scanner-1 INFO <5340.00> Scanner-1: setting timed terminal event at 5520.0
2024-06-21 15:53:33,260 sim.simulator INFO <5340.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,270 sats.satellite.Scanner-1 INFO <5520.00> Scanner-1: timed termination at 5520.0 for action_charge
2024-06-21 15:53:33,270 data.base INFO <5520.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,271 gym INFO <5520.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,271 gym INFO <5520.00> Step reward: 0.0
2024-06-21 15:53:33,271 gym INFO <5520.00> === STARTING STEP ===
2024-06-21 15:53:33,272 sats.satellite.Scanner-1 INFO <5520.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,272 sats.satellite.Scanner-1 INFO <5520.00> Scanner-1: setting timed terminal event at 5700.0
2024-06-21 15:53:33,272 sim.simulator INFO <5520.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,282 sats.satellite.Scanner-1 INFO <5700.00> Scanner-1: timed termination at 5700.0 for action_nadir_scan
2024-06-21 15:53:33,282 data.base INFO <5700.00> Data reward: {'Scanner-1_4913732896': 0.013684210526315788}
2024-06-21 15:53:33,283 gym INFO <5700.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,283 gym INFO <5700.00> Step reward: 0.013684210526315788
2024-06-21 15:53:33,283 gym INFO <5700.00> === STARTING STEP ===
2024-06-21 15:53:33,284 sats.satellite.Scanner-1 INFO <5700.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,284 sats.satellite.Scanner-1 INFO <5700.00> Scanner-1: setting timed terminal event at 5760.0
2024-06-21 15:53:33,284 sim.simulator INFO <5700.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,288 sats.satellite.Scanner-1 INFO <5760.00> Scanner-1: timed termination at 5760.0 for action_downlink
2024-06-21 15:53:33,288 data.base INFO <5760.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,289 gym INFO <5760.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,289 gym INFO <5760.00> Step reward: 0.0
2024-06-21 15:53:33,289 gym INFO <5760.00> === STARTING STEP ===
2024-06-21 15:53:33,289 sats.satellite.Scanner-1 INFO <5760.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,290 sats.satellite.Scanner-1 INFO <5760.00> Scanner-1: setting timed terminal event at 5820.0
2024-06-21 15:53:33,290 sim.simulator INFO <5760.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,293 sats.satellite.Scanner-1 INFO <5820.00> Scanner-1: timed termination at 5820.0 for action_desat
2024-06-21 15:53:33,294 data.base INFO <5820.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,294 gym INFO <5820.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,295 gym INFO <5820.00> Step reward: 0.0
2024-06-21 15:53:33,295 gym INFO <5820.00> === STARTING STEP ===
2024-06-21 15:53:33,295 sats.satellite.Scanner-1 INFO <5820.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,295 sats.satellite.Scanner-1 INFO <5820.00> Scanner-1: setting timed terminal event at 6000.0
2024-06-21 15:53:33,296 sim.simulator INFO <5820.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,305 sats.satellite.Scanner-1 INFO <6000.00> Scanner-1: timed termination at 6000.0 for action_charge
2024-06-21 15:53:33,306 data.base INFO <6000.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,306 gym INFO <6000.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,307 gym INFO <6000.00> Step reward: 0.0
2024-06-21 15:53:33,307 gym INFO <6000.00> === STARTING STEP ===
2024-06-21 15:53:33,307 sats.satellite.Scanner-1 INFO <6000.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,307 sats.satellite.Scanner-1 INFO <6000.00> Scanner-1: setting timed terminal event at 6180.0
2024-06-21 15:53:33,307 sim.simulator INFO <6000.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,317 sats.satellite.Scanner-1 INFO <6180.00> Scanner-1: timed termination at 6180.0 for action_nadir_scan
2024-06-21 15:53:33,318 data.base INFO <6180.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,318 gym INFO <6180.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,318 gym INFO <6180.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,319 gym INFO <6180.00> === STARTING STEP ===
2024-06-21 15:53:33,319 sats.satellite.Scanner-1 INFO <6180.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,319 sats.satellite.Scanner-1 INFO <6180.00> Scanner-1: setting timed terminal event at 6240.0
2024-06-21 15:53:33,319 sim.simulator INFO <6180.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,323 sats.satellite.Scanner-1 INFO <6240.00> Scanner-1: timed termination at 6240.0 for action_downlink
2024-06-21 15:53:33,323 data.base INFO <6240.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,324 gym INFO <6240.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,324 gym INFO <6240.00> Step reward: 0.0
2024-06-21 15:53:33,324 gym INFO <6240.00> === STARTING STEP ===
2024-06-21 15:53:33,325 sats.satellite.Scanner-1 INFO <6240.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,325 sats.satellite.Scanner-1 INFO <6240.00> Scanner-1: setting timed terminal event at 6420.0
2024-06-21 15:53:33,325 sim.simulator INFO <6240.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,335 sats.satellite.Scanner-1 INFO <6420.00> Scanner-1: timed termination at 6420.0 for action_nadir_scan
2024-06-21 15:53:33,335 data.base INFO <6420.00> Data reward: {'Scanner-1_4913732896': 0.01219298245614035}
2024-06-21 15:53:33,336 gym INFO <6420.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,336 gym INFO <6420.00> Step reward: 0.01219298245614035
2024-06-21 15:53:33,337 gym INFO <6420.00> === STARTING STEP ===
2024-06-21 15:53:33,337 sats.satellite.Scanner-1 INFO <6420.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,337 sats.satellite.Scanner-1 INFO <6420.00> Scanner-1: setting timed terminal event at 6600.0
2024-06-21 15:53:33,337 sim.simulator INFO <6420.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,347 sats.satellite.Scanner-1 INFO <6600.00> Scanner-1: timed termination at 6600.0 for action_nadir_scan
2024-06-21 15:53:33,347 data.base INFO <6600.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,348 gym INFO <6600.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,348 gym INFO <6600.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,348 gym INFO <6600.00> === STARTING STEP ===
2024-06-21 15:53:33,349 sats.satellite.Scanner-1 INFO <6600.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,349 sats.satellite.Scanner-1 INFO <6600.00> Scanner-1: setting timed terminal event at 6660.0
2024-06-21 15:53:33,349 sim.simulator INFO <6600.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,353 sats.satellite.Scanner-1 INFO <6660.00> Scanner-1: timed termination at 6660.0 for action_downlink
2024-06-21 15:53:33,353 data.base INFO <6660.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,354 gym INFO <6660.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,354 gym INFO <6660.00> Step reward: 0.0
2024-06-21 15:53:33,354 gym INFO <6660.00> === STARTING STEP ===
2024-06-21 15:53:33,354 sats.satellite.Scanner-1 INFO <6660.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,355 sats.satellite.Scanner-1 INFO <6660.00> Scanner-1: setting timed terminal event at 6840.0
2024-06-21 15:53:33,355 sim.simulator INFO <6660.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,365 sats.satellite.Scanner-1 INFO <6840.00> Scanner-1: timed termination at 6840.0 for action_nadir_scan
2024-06-21 15:53:33,365 data.base INFO <6840.00> Data reward: {'Scanner-1_4913732896': 0.01219298245614035}
2024-06-21 15:53:33,366 gym INFO <6840.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,366 gym INFO <6840.00> Step reward: 0.01219298245614035
2024-06-21 15:53:33,366 gym INFO <6840.00> === STARTING STEP ===
2024-06-21 15:53:33,366 sats.satellite.Scanner-1 INFO <6840.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,367 sats.satellite.Scanner-1 INFO <6840.00> Scanner-1: setting timed terminal event at 7020.0
2024-06-21 15:53:33,367 sim.simulator INFO <6840.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,377 sats.satellite.Scanner-1 INFO <7020.00> Scanner-1: timed termination at 7020.0 for action_nadir_scan
2024-06-21 15:53:33,377 data.base INFO <7020.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,378 gym INFO <7020.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,378 gym INFO <7020.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,378 gym INFO <7020.00> === STARTING STEP ===
2024-06-21 15:53:33,378 sats.satellite.Scanner-1 INFO <7020.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,379 sats.satellite.Scanner-1 INFO <7020.00> Scanner-1: setting timed terminal event at 7080.0
2024-06-21 15:53:33,379 sim.simulator INFO <7020.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,382 sats.satellite.Scanner-1 INFO <7080.00> Scanner-1: timed termination at 7080.0 for action_desat
2024-06-21 15:53:33,383 data.base INFO <7080.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,383 gym INFO <7080.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,384 gym INFO <7080.00> Step reward: 0.0
2024-06-21 15:53:33,384 gym INFO <7080.00> === STARTING STEP ===
2024-06-21 15:53:33,384 sats.satellite.Scanner-1 INFO <7080.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,384 sats.satellite.Scanner-1 INFO <7080.00> Scanner-1: setting timed terminal event at 7260.0
2024-06-21 15:53:33,384 sim.simulator INFO <7080.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,394 sats.satellite.Scanner-1 INFO <7260.00> Scanner-1: timed termination at 7260.0 for action_charge
2024-06-21 15:53:33,395 data.base INFO <7260.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,395 gym INFO <7260.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,396 gym INFO <7260.00> Step reward: 0.0
2024-06-21 15:53:33,396 gym INFO <7260.00> === STARTING STEP ===
2024-06-21 15:53:33,396 sats.satellite.Scanner-1 INFO <7260.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,396 sats.satellite.Scanner-1 INFO <7260.00> Scanner-1: setting timed terminal event at 7320.0
2024-06-21 15:53:33,396 sim.simulator INFO <7260.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,400 sats.satellite.Scanner-1 INFO <7320.00> Scanner-1: timed termination at 7320.0 for action_desat
2024-06-21 15:53:33,400 data.base INFO <7320.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,401 gym INFO <7320.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,401 gym INFO <7320.00> Step reward: 0.0
2024-06-21 15:53:33,401 gym INFO <7320.00> === STARTING STEP ===
2024-06-21 15:53:33,402 sats.satellite.Scanner-1 INFO <7320.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,402 sats.satellite.Scanner-1 INFO <7320.00> Scanner-1: setting timed terminal event at 7380.0
2024-06-21 15:53:33,402 sim.simulator INFO <7320.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,406 sats.satellite.Scanner-1 INFO <7380.00> Scanner-1: timed termination at 7380.0 for action_downlink
2024-06-21 15:53:33,406 data.base INFO <7380.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,407 gym INFO <7380.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,407 gym INFO <7380.00> Step reward: 0.0
2024-06-21 15:53:33,407 gym INFO <7380.00> === STARTING STEP ===
2024-06-21 15:53:33,407 sats.satellite.Scanner-1 INFO <7380.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,408 sats.satellite.Scanner-1 INFO <7380.00> Scanner-1: setting timed terminal event at 7440.0
2024-06-21 15:53:33,408 sim.simulator INFO <7380.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,411 sats.satellite.Scanner-1 INFO <7440.00> Scanner-1: timed termination at 7440.0 for action_desat
2024-06-21 15:53:33,412 data.base INFO <7440.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,412 gym INFO <7440.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,413 gym INFO <7440.00> Step reward: 0.0
2024-06-21 15:53:33,413 gym INFO <7440.00> === STARTING STEP ===
2024-06-21 15:53:33,413 sats.satellite.Scanner-1 INFO <7440.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,413 sats.satellite.Scanner-1 INFO <7440.00> Scanner-1: setting timed terminal event at 7500.0
2024-06-21 15:53:33,413 sim.simulator INFO <7440.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,417 sats.satellite.Scanner-1 INFO <7500.00> Scanner-1: timed termination at 7500.0 for action_desat
2024-06-21 15:53:33,417 data.base INFO <7500.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,418 gym INFO <7500.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,418 gym INFO <7500.00> Step reward: 0.0
2024-06-21 15:53:33,419 gym INFO <7500.00> === STARTING STEP ===
2024-06-21 15:53:33,419 sats.satellite.Scanner-1 INFO <7500.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,419 sats.satellite.Scanner-1 INFO <7500.00> Scanner-1: setting timed terminal event at 7680.0
2024-06-21 15:53:33,419 sim.simulator INFO <7500.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,429 sats.satellite.Scanner-1 INFO <7680.00> Scanner-1: timed termination at 7680.0 for action_charge
2024-06-21 15:53:33,429 data.base INFO <7680.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,430 gym INFO <7680.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,430 gym INFO <7680.00> Step reward: 0.0
2024-06-21 15:53:33,431 gym INFO <7680.00> === STARTING STEP ===
2024-06-21 15:53:33,431 sats.satellite.Scanner-1 INFO <7680.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,431 sats.satellite.Scanner-1 INFO <7680.00> Scanner-1: setting timed terminal event at 7860.0
2024-06-21 15:53:33,431 sim.simulator INFO <7680.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,441 sats.satellite.Scanner-1 INFO <7860.00> Scanner-1: timed termination at 7860.0 for action_charge
2024-06-21 15:53:33,441 data.base INFO <7860.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,442 gym INFO <7860.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,442 gym INFO <7860.00> Step reward: 0.0
2024-06-21 15:53:33,443 gym INFO <7860.00> === STARTING STEP ===
2024-06-21 15:53:33,443 sats.satellite.Scanner-1 INFO <7860.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,443 sats.satellite.Scanner-1 INFO <7860.00> Scanner-1: setting timed terminal event at 7920.0
2024-06-21 15:53:33,443 sim.simulator INFO <7860.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,447 sats.satellite.Scanner-1 INFO <7920.00> Scanner-1: timed termination at 7920.0 for action_desat
2024-06-21 15:53:33,447 data.base INFO <7920.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,448 gym INFO <7920.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,448 gym INFO <7920.00> Step reward: 0.0
2024-06-21 15:53:33,448 gym INFO <7920.00> === STARTING STEP ===
2024-06-21 15:53:33,449 sats.satellite.Scanner-1 INFO <7920.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,449 sats.satellite.Scanner-1 INFO <7920.00> Scanner-1: setting timed terminal event at 8100.0
2024-06-21 15:53:33,449 sim.simulator INFO <7920.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,459 sats.satellite.Scanner-1 INFO <8100.00> Scanner-1: timed termination at 8100.0 for action_nadir_scan
2024-06-21 15:53:33,460 data.base INFO <8100.00> Data reward: {'Scanner-1_4913732896': 0.012280701754385963}
2024-06-21 15:53:33,501 gym INFO <8100.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,501 gym INFO <8100.00> Step reward: 0.012280701754385963
2024-06-21 15:53:33,502 gym INFO <8100.00> === STARTING STEP ===
2024-06-21 15:53:33,502 sats.satellite.Scanner-1 INFO <8100.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,502 sats.satellite.Scanner-1 INFO <8100.00> Scanner-1: setting timed terminal event at 8280.0
2024-06-21 15:53:33,502 sim.simulator INFO <8100.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,512 sats.satellite.Scanner-1 INFO <8280.00> Scanner-1: timed termination at 8280.0 for action_nadir_scan
2024-06-21 15:53:33,513 data.base INFO <8280.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,513 gym INFO <8280.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,513 gym INFO <8280.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,514 gym INFO <8280.00> === STARTING STEP ===
2024-06-21 15:53:33,514 sats.satellite.Scanner-1 INFO <8280.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,514 sats.satellite.Scanner-1 INFO <8280.00> Scanner-1: setting timed terminal event at 8340.0
2024-06-21 15:53:33,514 sim.simulator INFO <8280.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,518 sats.satellite.Scanner-1 INFO <8340.00> Scanner-1: timed termination at 8340.0 for action_desat
2024-06-21 15:53:33,518 data.base INFO <8340.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,519 gym INFO <8340.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,519 gym INFO <8340.00> Step reward: 0.0
2024-06-21 15:53:33,519 gym INFO <8340.00> === STARTING STEP ===
2024-06-21 15:53:33,520 sats.satellite.Scanner-1 INFO <8340.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,520 sats.satellite.Scanner-1 INFO <8340.00> Scanner-1: setting timed terminal event at 8520.0
2024-06-21 15:53:33,520 sim.simulator INFO <8340.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,530 sats.satellite.Scanner-1 INFO <8520.00> Scanner-1: timed termination at 8520.0 for action_charge
2024-06-21 15:53:33,530 data.base INFO <8520.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,531 gym INFO <8520.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,531 gym INFO <8520.00> Step reward: 0.0
2024-06-21 15:53:33,531 gym INFO <8520.00> === STARTING STEP ===
2024-06-21 15:53:33,532 sats.satellite.Scanner-1 INFO <8520.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,532 sats.satellite.Scanner-1 INFO <8520.00> Scanner-1: setting timed terminal event at 8580.0
2024-06-21 15:53:33,532 sim.simulator INFO <8520.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,536 sats.satellite.Scanner-1 INFO <8580.00> Scanner-1: timed termination at 8580.0 for action_downlink
2024-06-21 15:53:33,536 data.base INFO <8580.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,537 gym INFO <8580.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,537 gym INFO <8580.00> Step reward: 0.0
2024-06-21 15:53:33,537 gym INFO <8580.00> === STARTING STEP ===
2024-06-21 15:53:33,538 sats.satellite.Scanner-1 INFO <8580.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,538 sats.satellite.Scanner-1 INFO <8580.00> Scanner-1: setting timed terminal event at 8640.0
2024-06-21 15:53:33,538 sim.simulator INFO <8580.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,573 sats.satellite.Scanner-1 INFO <8640.00> Scanner-1: timed termination at 8640.0 for action_desat
2024-06-21 15:53:33,573 data.base INFO <8640.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,574 gym INFO <8640.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,574 gym INFO <8640.00> Step reward: 0.0
2024-06-21 15:53:33,575 gym INFO <8640.00> === STARTING STEP ===
2024-06-21 15:53:33,575 sats.satellite.Scanner-1 INFO <8640.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,575 sats.satellite.Scanner-1 INFO <8640.00> Scanner-1: setting timed terminal event at 8700.0
2024-06-21 15:53:33,575 sim.simulator INFO <8640.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,579 sats.satellite.Scanner-1 INFO <8700.00> Scanner-1: timed termination at 8700.0 for action_downlink
2024-06-21 15:53:33,579 data.base INFO <8700.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,580 gym INFO <8700.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,580 gym INFO <8700.00> Step reward: 0.0
2024-06-21 15:53:33,580 gym INFO <8700.00> === STARTING STEP ===
2024-06-21 15:53:33,581 sats.satellite.Scanner-1 INFO <8700.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,581 sats.satellite.Scanner-1 INFO <8700.00> Scanner-1: setting timed terminal event at 8760.0
2024-06-21 15:53:33,581 sim.simulator INFO <8700.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,585 sats.satellite.Scanner-1 INFO <8760.00> Scanner-1: timed termination at 8760.0 for action_desat
2024-06-21 15:53:33,585 data.base INFO <8760.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,586 gym INFO <8760.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,586 gym INFO <8760.00> Step reward: 0.0
2024-06-21 15:53:33,586 gym INFO <8760.00> === STARTING STEP ===
2024-06-21 15:53:33,586 sats.satellite.Scanner-1 INFO <8760.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,586 sats.satellite.Scanner-1 INFO <8760.00> Scanner-1: setting timed terminal event at 8940.0
2024-06-21 15:53:33,587 sim.simulator INFO <8760.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,596 sats.satellite.Scanner-1 INFO <8940.00> Scanner-1: timed termination at 8940.0 for action_charge
2024-06-21 15:53:33,597 data.base INFO <8940.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,597 gym INFO <8940.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,598 gym INFO <8940.00> Step reward: 0.0
2024-06-21 15:53:33,598 gym INFO <8940.00> === STARTING STEP ===
2024-06-21 15:53:33,598 sats.satellite.Scanner-1 INFO <8940.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,598 sats.satellite.Scanner-1 INFO <8940.00> Scanner-1: setting timed terminal event at 9120.0
2024-06-21 15:53:33,598 sim.simulator INFO <8940.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,608 sats.satellite.Scanner-1 INFO <9120.00> Scanner-1: timed termination at 9120.0 for action_charge
2024-06-21 15:53:33,609 data.base INFO <9120.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,609 gym INFO <9120.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,610 gym INFO <9120.00> Step reward: 0.0
2024-06-21 15:53:33,610 gym INFO <9120.00> === STARTING STEP ===
2024-06-21 15:53:33,610 sats.satellite.Scanner-1 INFO <9120.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,610 sats.satellite.Scanner-1 INFO <9120.00> Scanner-1: setting timed terminal event at 9180.0
2024-06-21 15:53:33,611 sim.simulator INFO <9120.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,614 sats.satellite.Scanner-1 INFO <9180.00> Scanner-1: timed termination at 9180.0 for action_downlink
2024-06-21 15:53:33,614 data.base INFO <9180.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,615 gym INFO <9180.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,615 gym INFO <9180.00> Step reward: 0.0
2024-06-21 15:53:33,616 gym INFO <9180.00> === STARTING STEP ===
2024-06-21 15:53:33,616 sats.satellite.Scanner-1 INFO <9180.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,616 sats.satellite.Scanner-1 INFO <9180.00> Scanner-1: setting timed terminal event at 9240.0
2024-06-21 15:53:33,616 sim.simulator INFO <9180.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,620 sats.satellite.Scanner-1 INFO <9240.00> Scanner-1: timed termination at 9240.0 for action_downlink
2024-06-21 15:53:33,620 data.base INFO <9240.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,621 gym INFO <9240.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,621 gym INFO <9240.00> Step reward: 0.0
2024-06-21 15:53:33,621 gym INFO <9240.00> === STARTING STEP ===
2024-06-21 15:53:33,621 sats.satellite.Scanner-1 INFO <9240.00> Scanner-1: action_downlink tasked for 60.0 seconds
2024-06-21 15:53:33,622 sats.satellite.Scanner-1 INFO <9240.00> Scanner-1: setting timed terminal event at 9300.0
2024-06-21 15:53:33,622 sim.simulator INFO <9240.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,625 sats.satellite.Scanner-1 INFO <9300.00> Scanner-1: timed termination at 9300.0 for action_downlink
2024-06-21 15:53:33,626 data.base INFO <9300.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,626 gym INFO <9300.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,626 gym INFO <9300.00> Step reward: 0.0
2024-06-21 15:53:33,627 gym INFO <9300.00> === STARTING STEP ===
2024-06-21 15:53:33,627 sats.satellite.Scanner-1 INFO <9300.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,627 sats.satellite.Scanner-1 INFO <9300.00> Scanner-1: setting timed terminal event at 9480.0
2024-06-21 15:53:33,627 sim.simulator INFO <9300.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,637 sats.satellite.Scanner-1 INFO <9480.00> Scanner-1: timed termination at 9480.0 for action_charge
2024-06-21 15:53:33,637 data.base INFO <9480.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,638 gym INFO <9480.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,638 gym INFO <9480.00> Step reward: 0.0
2024-06-21 15:53:33,639 gym INFO <9480.00> === STARTING STEP ===
2024-06-21 15:53:33,639 sats.satellite.Scanner-1 INFO <9480.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,639 sats.satellite.Scanner-1 INFO <9480.00> Scanner-1: setting timed terminal event at 9660.0
2024-06-21 15:53:33,639 sim.simulator INFO <9480.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,649 sats.satellite.Scanner-1 INFO <9660.00> Scanner-1: timed termination at 9660.0 for action_charge
2024-06-21 15:53:33,649 data.base INFO <9660.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,650 gym INFO <9660.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,650 gym INFO <9660.00> Step reward: 0.0
2024-06-21 15:53:33,651 gym INFO <9660.00> === STARTING STEP ===
2024-06-21 15:53:33,651 sats.satellite.Scanner-1 INFO <9660.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,651 sats.satellite.Scanner-1 INFO <9660.00> Scanner-1: setting timed terminal event at 9840.0
2024-06-21 15:53:33,651 sim.simulator INFO <9660.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,661 sats.satellite.Scanner-1 INFO <9840.00> Scanner-1: timed termination at 9840.0 for action_charge
2024-06-21 15:53:33,661 data.base INFO <9840.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,662 gym INFO <9840.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,662 gym INFO <9840.00> Step reward: 0.0
2024-06-21 15:53:33,663 gym INFO <9840.00> === STARTING STEP ===
2024-06-21 15:53:33,663 sats.satellite.Scanner-1 INFO <9840.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,663 sats.satellite.Scanner-1 INFO <9840.00> Scanner-1: setting timed terminal event at 10020.0
2024-06-21 15:53:33,663 sim.simulator INFO <9840.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,673 sats.satellite.Scanner-1 INFO <10020.00> Scanner-1: timed termination at 10020.0 for action_charge
2024-06-21 15:53:33,673 data.base INFO <10020.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,674 gym INFO <10020.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,674 gym INFO <10020.00> Step reward: 0.0
2024-06-21 15:53:33,674 gym INFO <10020.00> === STARTING STEP ===
2024-06-21 15:53:33,675 sats.satellite.Scanner-1 INFO <10020.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,675 sats.satellite.Scanner-1 INFO <10020.00> Scanner-1: setting timed terminal event at 10080.0
2024-06-21 15:53:33,675 sim.simulator INFO <10020.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,679 sats.satellite.Scanner-1 INFO <10080.00> Scanner-1: timed termination at 10080.0 for action_desat
2024-06-21 15:53:33,679 data.base INFO <10080.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,680 gym INFO <10080.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,680 gym INFO <10080.00> Step reward: 0.0
2024-06-21 15:53:33,680 gym INFO <10080.00> === STARTING STEP ===
2024-06-21 15:53:33,680 sats.satellite.Scanner-1 INFO <10080.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,680 sats.satellite.Scanner-1 INFO <10080.00> Scanner-1: setting timed terminal event at 10140.0
2024-06-21 15:53:33,681 sim.simulator INFO <10080.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,684 sats.satellite.Scanner-1 INFO <10140.00> Scanner-1: timed termination at 10140.0 for action_desat
2024-06-21 15:53:33,685 data.base INFO <10140.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,685 gym INFO <10140.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,685 gym INFO <10140.00> Step reward: 0.0
2024-06-21 15:53:33,686 gym INFO <10140.00> === STARTING STEP ===
2024-06-21 15:53:33,686 sats.satellite.Scanner-1 INFO <10140.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,686 sats.satellite.Scanner-1 INFO <10140.00> Scanner-1: setting timed terminal event at 10200.0
2024-06-21 15:53:33,686 sim.simulator INFO <10140.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,690 sats.satellite.Scanner-1 INFO <10200.00> Scanner-1: timed termination at 10200.0 for action_desat
2024-06-21 15:53:33,690 data.base INFO <10200.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,691 gym INFO <10200.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,691 gym INFO <10200.00> Step reward: 0.0
2024-06-21 15:53:33,691 gym INFO <10200.00> === STARTING STEP ===
2024-06-21 15:53:33,691 sats.satellite.Scanner-1 INFO <10200.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,692 sats.satellite.Scanner-1 INFO <10200.00> Scanner-1: setting timed terminal event at 10380.0
2024-06-21 15:53:33,692 sim.simulator INFO <10200.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,702 sats.satellite.Scanner-1 INFO <10380.00> Scanner-1: timed termination at 10380.0 for action_charge
2024-06-21 15:53:33,702 data.base INFO <10380.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,748 gym INFO <10380.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,748 gym INFO <10380.00> Step reward: 0.0
2024-06-21 15:53:33,749 gym INFO <10380.00> === STARTING STEP ===
2024-06-21 15:53:33,749 sats.satellite.Scanner-1 INFO <10380.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,749 sats.satellite.Scanner-1 INFO <10380.00> Scanner-1: setting timed terminal event at 10560.0
2024-06-21 15:53:33,749 sim.simulator INFO <10380.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,759 sats.satellite.Scanner-1 INFO <10560.00> Scanner-1: timed termination at 10560.0 for action_charge
2024-06-21 15:53:33,760 data.base INFO <10560.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,760 gym INFO <10560.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,761 gym INFO <10560.00> Step reward: 0.0
2024-06-21 15:53:33,761 gym INFO <10560.00> === STARTING STEP ===
2024-06-21 15:53:33,761 sats.satellite.Scanner-1 INFO <10560.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,761 sats.satellite.Scanner-1 INFO <10560.00> Scanner-1: setting timed terminal event at 10620.0
2024-06-21 15:53:33,761 sim.simulator INFO <10560.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,765 sats.satellite.Scanner-1 INFO <10620.00> Scanner-1: timed termination at 10620.0 for action_desat
2024-06-21 15:53:33,765 data.base INFO <10620.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,766 gym INFO <10620.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,766 gym INFO <10620.00> Step reward: 0.0
2024-06-21 15:53:33,766 gym INFO <10620.00> === STARTING STEP ===
2024-06-21 15:53:33,767 sats.satellite.Scanner-1 INFO <10620.00> Scanner-1: action_desat tasked for 60.0 seconds
2024-06-21 15:53:33,767 sats.satellite.Scanner-1 INFO <10620.00> Scanner-1: setting timed terminal event at 10680.0
2024-06-21 15:53:33,767 sim.simulator INFO <10620.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,771 sats.satellite.Scanner-1 INFO <10680.00> Scanner-1: timed termination at 10680.0 for action_desat
2024-06-21 15:53:33,771 data.base INFO <10680.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,772 gym INFO <10680.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,772 gym INFO <10680.00> Step reward: 0.0
2024-06-21 15:53:33,772 gym INFO <10680.00> === STARTING STEP ===
2024-06-21 15:53:33,773 sats.satellite.Scanner-1 INFO <10680.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,773 sats.satellite.Scanner-1 INFO <10680.00> Scanner-1: setting timed terminal event at 10860.0
2024-06-21 15:53:33,773 sim.simulator INFO <10680.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,783 sats.satellite.Scanner-1 INFO <10860.00> Scanner-1: timed termination at 10860.0 for action_nadir_scan
2024-06-21 15:53:33,784 data.base INFO <10860.00> Data reward: {'Scanner-1_4913732896': 0.012368421052631579}
2024-06-21 15:53:33,784 gym INFO <10860.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,785 gym INFO <10860.00> Step reward: 0.012368421052631579
2024-06-21 15:53:33,785 gym INFO <10860.00> === STARTING STEP ===
2024-06-21 15:53:33,785 sats.satellite.Scanner-1 INFO <10860.00> Scanner-1: action_charge tasked for 180.0 seconds
2024-06-21 15:53:33,785 sats.satellite.Scanner-1 INFO <10860.00> Scanner-1: setting timed terminal event at 11040.0
2024-06-21 15:53:33,786 sim.simulator INFO <10860.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,796 sats.satellite.Scanner-1 INFO <11040.00> Scanner-1: timed termination at 11040.0 for action_charge
2024-06-21 15:53:33,796 data.base INFO <11040.00> Data reward: {'Scanner-1_4913732896': 0.0}
2024-06-21 15:53:33,796 sats.satellite.Scanner-1 INFO <11040.00> Scanner-1: Finding opportunity windows from 11400.00 to 12000.00 seconds
2024-06-21 15:53:33,801 sats.satellite.Scanner-1 INFO <11040.00> Scanner-1: Finding opportunity windows from 12000.00 to 12600.00 seconds
2024-06-21 15:53:33,806 gym INFO <11040.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,806 gym INFO <11040.00> Step reward: 0.0
2024-06-21 15:53:33,807 gym INFO <11040.00> === STARTING STEP ===
2024-06-21 15:53:33,807 sats.satellite.Scanner-1 INFO <11040.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,807 sats.satellite.Scanner-1 INFO <11040.00> Scanner-1: setting timed terminal event at 11220.0
2024-06-21 15:53:33,807 sim.simulator INFO <11040.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,818 sats.satellite.Scanner-1 INFO <11220.00> Scanner-1: timed termination at 11220.0 for action_nadir_scan
2024-06-21 15:53:33,818 data.base INFO <11220.00> Data reward: {'Scanner-1_4913732896': 0.013421052631578946}
2024-06-21 15:53:33,819 gym INFO <11220.00> Satellites requiring retasking: ['Scanner-1_4913732896']
2024-06-21 15:53:33,819 gym INFO <11220.00> Step reward: 0.013421052631578946
2024-06-21 15:53:33,819 gym INFO <11220.00> === STARTING STEP ===
2024-06-21 15:53:33,820 sats.satellite.Scanner-1 INFO <11220.00> Scanner-1: action_nadir_scan tasked for 180.0 seconds
2024-06-21 15:53:33,820 sats.satellite.Scanner-1 INFO <11220.00> Scanner-1: setting timed terminal event at 11400.0
2024-06-21 15:53:33,820 sim.simulator INFO <11220.00> Running simulation at most to 11400.00 seconds
2024-06-21 15:53:33,830 data.base INFO <11400.00> Data reward: {'Scanner-1_4913732896': 0.015789473684210527}
2024-06-21 15:53:33,831 gym INFO <11400.00> Step reward: 0.015789473684210527
2024-06-21 15:53:33,831 gym INFO <11400.00> Episode terminated: True
2024-06-21 15:53:33,831 gym INFO <11400.00> Episode truncated: True