DDPG for aircraft/quadrotor control

[aminrbspace]

Hello everyone. I am planning to create my own environment in Python using my aircraft's specifications. Most of the code I see on GitHub uses pre-prepared environments from Gym. How can I use my own 6DOF (six degrees of freedom) equations of the aircraft with its own specifications instead of using ready-made packages? Does anyone have any code for this? I want to use DDPG (Deep Deterministic Policy Gradient) for aircraft control.
Thank you.