README.md

Important Notice

We are working on implement the one-to-one within-visual range dogfighting algorithm based on Harfang3D Dog-Fight on this project, thus some files may not work properly. Please use version 2a6b47a until complete.

---

DBRL: A Gym Dogfighting Simulation Benchmark for Reinforcement Learning Research

Reference Manual | 简体中文使用手册

Introduction

DBRL is an air combat simulation benchmark based on JSBSim and Dogfight 2.

We adopt JSBSim as flight dynamic model to build our dogfight environment, and Dogfight 2 to simulate the situation when the plane is confronted with a missile.

If you are new to air combat simulation or reinforcement learning algorithm, we advise you to learn DBRL tutorial first.

Gym Parameters

# JSBSim
observation_space = Box(
    low=np.array([
        -360,  # Latitude
        -360,  # Longitude
        0,     # Height above sea level
        -360,  # Yaw
        -360,  # Pitch
        -360,  # Roll
    ] * 2),
    high=np.array([
        360,
        360,
        60000,
        360,
        360,
        360,
    ] * 2)
)

action_space = Box(
    low=np.array([
        -1,  # Aileron
        -1,  # Elevator
        -1,  # Rudder
        0,   # Throttle
        0,   # Flap
        0,   # Speed brake
        0,   # Spoiler
    ]),
    high=np.array([
        1,
        1,
        1,
        1,
        1,
        1,
        1,
    ]),
)


# Dogfight 2
observation_space = Box(
    low=np.array([  # simple normalized
        # Plane
        -300,  # x / 100
        -300,  # y / 100
        -1,    # z / 50
        0,     # heading
        -360,  # pitch_attitude * 4
        -360,  # roll_attitude * 4
        # Missile
        -300,  # x / 100
        -300,  # y / 100
        -1,    # z / 50
        -315,  # heading * 100
        -315,  # pitch_attitude * 100
        -315,  # roll_attitude * 100
    ]),
    high=np.array([
        300,
        300,
        200,
        360,
        360,
        360,
        300,
        300,
        200,
        315,
        315,
        315,
    ])
)

action_space = Box(
    low=np.array([
        0,  # Flaps
        -1,  # Pitch
        -1,  # Roll
        -1,  # Yaw
    ]),
    high=np.array([
        1,
        1,
        1,
        1,
    ]),
)

Welcome PR

If you find any mistakes while using, or have any suggestions and advices, please point it out in Github Issues. We're also looking forward to your contributions, such as your air combat reinforcement learning models, to this dogfight benchmark. If you are interesting in this project, feel free to contact [email protected].