Skip to content

Flighthub 2 Integration via SenseAeronautics

For leveraging FlightHub 2 integration with Sense Aeronautic's AI processing API, you will need to configure FlightHub Sync and obtain your Organisation Key.

The general workflow for FlightHub 2 integration is the following:

  1. Enter your Organisation Key.

  2. Select your project.

  3. Select your drone and camera. You need to be logged into FlighHub on the drone's controller.

Note: the DJI FlightHub 2 Sync does not provide information about currently available drones and cameras. The correct drone/camera pair must be selected here.

  1. Click on 'Register FlightHub source'. This will register the correct source and output for this drone/camera pair. This only needs to be done once.

For this registration to work, the selected drone and camera must be available. DJI's streamForwarding will be activated for a few seconds to validate the integration and obtain the streaming parameters

  1. Go to the information page. You will see a source and output registered for the selected drone/camera. The resources follow the naming convention FH_${droneName}_CAM_${cameraName}.

  2. Starting a FH source will automatically start stream forwarding and attach the corresponding output. This output can be checked on the Outputs or Active outputs sections. This link is always the same for each drone-camera pair.

Warning: processing DJI streams requires enabling stream Fowarding, which consumes FlightHub streaming minutes.

  1. Once your operation is concluded, click on 'Stop' to stop the process and stream forwarding.

The next sections describe how to integrate your DJIs Flighthub 2 account with Sense Aeronautics Automatic Target Recognition (ATR) system. This integration incorporates AI Video Detection capabilities to your DJI drones video streams, and allows incorporation of the streams of your Flighthub drones directly from the web client.

Configuring your FlightHub 2 account

  1. Log into your FlightHub 2 (FH2) account: Go to https://fh.dji.com/login and log in with your credentials.

  2. Access your organization information: Once logged in, click on your account mail on the top-right side and select My organization.

Accessing your organization information on FH2

At this point, you may need to create an organization should you not have one yet.

  1. Open your organization settings by clicking on the gear icon.

Accessing your organization settings 4. Get your organization key by clicking on the FlightHub Sync (Beta) icon. Should you not have a key, you will need to generate one at this point. This tab also allows you to configure the MQTT broker and the RTMP media server, as explained further down.

Accessing your organization key on FlightHub 2 Sync

  1. Take note of your Organization Key

Your organization key is the only information you will need to link FlightHub 2 to Sense Aeronautics system

Configure the Telemetry Data and Stream Forwarding

Sense Aeronautics' ATR system exploits telemetry information, if available, to optimize the target detection process and provide drone location as output.

  1. Configure Telemetry:

Configuration of Telemetry and Stream Forwarding

For telemetry data to be available on Sense Aeronautics system, the MQTT broker needs to be configured on the Flighthub Sync menu. Use the following configuration as illustrated in the figure:

MQTT Host: 34.147.91.49

MQTT Port: 1883

  1. Configure Stream Forwarding:

After configuring telemetry, on the FlightHub Sync menu, configure Stream Forwarding to ensure video from Flighthub is forwarded to Sense Aeronautics by using the following rtmp address, as illustrated in the figure.

RTMP Server: rtmp://media.senseaeronautics.com:1935/username

Configuring MQTT and RTMP Notes:

  • Configuration of the MQTT broker is optional. The ATR system will work without it. Telemetry data will only be exploited if available.
  • For RTMP configuration, username can be any unique, identifiable name in lower case with no spaces.
  • It is recommended that you use your_company_name or similar MQTT and RTMP Configuration

Create a project and bind the drones

Once the configuration is ready, the drone needs to be bound to the project. To do so, follow these steps:

  1. Create a project: On the FlightHub Sync menu, click on the Projects tab and create a new project if you have not done so.

  2. Bind the drone: Once the project is created, you can bind the drone that you need to use. To do so, open the DJI Pilot App in the remote controller, go to Cloud Service and click on FlighHub 2. Then bind the device. For further information about FlightHub configuration, you can follow the official Flighthub 2 user manual

Linking FlightHub 2 to Sense Aeronautics' API

Once your FlightHub 2 has been configured to provide video and, optionally, telemetry data, you can use Sense Aeronautics' web client to register your drones and use them with the API. To do so, once logged on with your API Key, go to the FlightHub2 section in the Setup Page and register your drones as input sources following:

  1. Enter FlightHub information: Use the organization key you have have got for FlightHub 2.

  2. Select your drone and add it as a source. Once saved, the FlightHub Stream Forwarding section will show your FlightHub Projects and the drones that have been configured for those projects.

At this point, you can start and stop the ATR target detection system on your drones any time by using the start and stop buttons on the info tab for that source.

  1. Visualize processed video:

All video streams for which ATR analysis has been started can be accessed from the info tab as with any other sources.

Please notice that, depending on your FlightHub 2 plan, use of Stream Forwarding will be billed as FlightHub livestream minutes.

Troubleshooting

  • If your drone has more than one camera, only a single stream forwarding may be active at the same time. Stop the process with the first camera before launching the other one, or it will fail to receive the stream.
  • If the drone is switched off without explicitly stopping the stream forwarding, FlightHub may not be able to provide a reliable status on stream forwarding. The web client accounts for this and tries to ensure a correct state before launching a source. If you still run into problems when starting a process, you force a reset on FlightHub stream forwarding. For doing this, select your drone and camera on the Setup page and click on Manual stop to manually stop stream forwarding and clean the reported state.