Flysto upload - flight duplicates

[ve0kog]

I'm uploading the HDX user data exports to flyst for post flight analytics. (if you haven't tried it - it's pretty amazing)

One issue is that flysto does not recognize and discard previously uploaded telemetry and you end up with numerous duplicate flight entries as opposed to just the new flights since the last upload.

One way to address this is to truncate the csv HDX files to just the new data, but this seems tedios.

I'm curious if Dynon would consider adding an option to allow user data export which includes telemetry only since the last successful export. This can have a side benefit of competing this delta export to a usb stick much faster than the full dump.

Would this be a difficult option to add?


cheers

 

[ve0kog]

clear the data logs after downloading them

that's an idea, although I'm a data hoarder and would rather let Dynon roll off the flight telemetry on its own. My recording is set to a 2 second interval and estimate about 64 hours of data in the circular log.

 

[ve0kog]

I have not heard back from flysto but found a great tool to manipulate/filter the downloaded HDX logs - the Datawrangler plugin in vscode . I merged all my exports, removed the duplicates and missing Date field rows, and filtered by a specific date range I was interested in. Deleted all flights from flysto and re-imported the clean data. In the future I would just need to trim the rows before the last upload date (this can be done even in excel)

This is a really awesome plugin once past the learning curve. If familiar with VSCODE then there is no learning curve

Getting Started with Data Wrangler in VS Code

Full documentation on working with the Data Wrangler extension in Visual Studio Code.

code.visualstudio.com

 

[TrevorMills]

I'm uploading the HDX user data exports to flyst for post flight analytics. (if you haven't tried it - it's pretty amazing)

One issue is that flysto does not recognize and discard previously uploaded telemetry and you end up with numerous duplicate flight entries as opposed to just the new flights since the last upload.

One way to address this is to truncate the csv HDX files to just the new data, but this seems tedios.

I'm curious if Dynon would consider adding an option to allow user data export which includes telemetry only since the last successful export. This can have a side benefit of competing this delta export to a usb stick much faster than the full dump.

Would this be a difficult option to add?


cheers

Hi,

I religiously download HDX data after each flight and the clear the memory in each screen which makes it much faster to download. I upload the data into a free Savvy Aviation account that displays the information in a variety of ways. I then complete my logbooks from that data. It works very well and visually shows and degradation of sensors or engine performance. Savvy identifies data that doesn’t contain flight information and suggests discarding them. It also allows easy deletion of duplicates.

The clearance of data in each screen is a bit of a faff as the option to clear the data is in a completely different area of the menu system from where you export to the USB sticks. I’ve asked Dynon to incorporate a ‘Clear Data’ option immediately after the Export has been completed. They assure me that it’s in the pipeline to implement.

I know there are a number of analysis sites out the but Savvy is excellent. If you’re interested in giving it a go here’s the link. You only need a free account. www.savvyaviation.com

 

[ve0kog]

download HDX data after each flight and the clear the memory in each screen which makes it much faster to download

this is what @RV8JD suggested above. One drawback is that the EFIS will no longer have the data if for some reason there is a need to download it again. The correct fix would be an option to export only the new data logged after the most recent export. It would solve all problems at once - faster downloads, no duplication, and the original data is preserved in the EFIS.

Savvy is excellent

I have tried Savvy. They seem to be focused more on engine maint issues as opposed to blending all of the EFIS data, traffic, weather, and maps, and computing trends over a wide range of flights. Flysto is light years ahead for post flight debrief IMO. Hope it works for EU flights as well as it does in the U.S.

 

[TrevorMills]

this is what @RV8JD suggested above. One drawback is that the EFIS will no longer have the data if for some reason there is a need to download it again. The correct fix would be an option to export only the new data logged after the most recent export. It would solve all problems at once - faster downloads, no duplication, and the original data is preserved in the EFIS.


I have tried Savvy. They seem to be focused more on engine maint issues as opposed to blending all of the EFIS data, traffic, weather, and maps, and computing trends over a wide range of flights. Flysto is light years ahead for post flight debrief IMO. Hope it works for EU flights as well as it does in the U.S.

I missed RV8JD's post when I visited the forum so sorry for repeating what had already been said and responded to.

I think whichever way Dynon decide to implement it will hopefully be better than we have now and will result in a faster post flight download of data. I've also upgraded from the supplied Dynon USB sticks to faster 32GB Kingston memory that makes it faster to download and upload and access Airmate data and maps.

I've kept all the HDX data since she first flew in 2019 (over 550 flights) so I can go back if necessary. One that time it would have been overwritten in any case.

Savvy met my needs at the time. I've got a Flysto account and had uploaded a couple of flights after a I saw it at Oshkosh in 2023. As you say its excellent and I'm not sure why I didn't persist with it but it looks like I'll be loading up my history of flights over the next few weeks!

Let's hope Dynon includes an update to the data download issue in a future release sometime soon.

Cheers

 

[ve0kog]

upgraded from the supplied Dynon USB sticks to faster 32GB Kingston memory that makes it faster to download

I did the same. using SanDisk sticks, not even the most recent ones, and they work much faster than the original dynon

P.S. apologies for lumping the U.K. with the EU

 

[TrevorMills]

this is what @RV8JD suggested above. One drawback is that the EFIS will no longer have the data if for some reason there is a need to download it again. The correct fix would be an option to export only the new data logged after the most recent export. It would solve all problems at once - faster downloads, no duplication, and the original data is preserved in the EFIS.


I have tried Savvy. They seem to be focused more on engine maint issues as opposed to blending all of the EFIS data, traffic, weather, and maps, and computing trends over a wide range of flights. Flysto is light years ahead for post flight debrief IMO. Hope it works for EU flights as well as it does in the U.S.

I spent the evening playing with Flysto. I found the option to upload all the ADSB data for my aircraft and then have added some HDX data. I must admit I was blown away by the way it’s presented. Quite amazing really. Unfortunately I couldn’t find the option to view Hobbs and Tacho time but I’m sure it’s there somewhere.

Thanks for reminding me of this great package. It’ll keep me amused whilst it’s not flyable here

 

[PhatRV]

Load a flight that you uploaded to Flysto
Click the graph icon

Scroll to the bottom of the page and click on the Raw Log Data

It should then display all the raw Dynon information.

 

[TrevorMills]

Load a flight that you uploaded to Flysto
Click the graph icon
View attachment 6423


Scroll to the bottom of the page and click on the Raw Log Data

View attachment 6425

It should then display all the raw Dynon information.

Thanks - I've found those but strangely it doesn't show Tacho and Hobbs in the unprocessed/ raw data logs - I must be missing something. I can easily work round it but it would be good if it had those values displayed. If you have found them could you point me to where they are please?

 

[ve0kog]

it shows up in my list

 

[TrevorMills]

it shows up in my list

View attachment 6426

Great found it now - Many thanks for your help. I can now move to Flysto and ditch Savvy!

Couldn't find a place to subscribe so assume that will come later...

 

[ve0kog]

Couldn't find a place to subscribe so assume that will come later...

we will see what flysto comes up with. I hope experimental aviation will have some options

FlySto is free of charge for your log uploads amounting to a generous number of flight hours per year. To make FlySto's ongoing development sustainable in the long term we will offer paid subscription plans for processing large amounts of data as well as advanced functionality.

 

[BlueCrab]

Just another endorsement of flysto... I've been using it since I stumbled across their booth at Sun'N'Fun last year. I showed it to my instructor (I'm a rusty pilot) and it's great for evaluating flights. My instructor now uses it in his own plane. The duplication of flights is a nuisance and I now use the technique noted above.

 

[JPSchultz]

I'm uploading the HDX user data exports to flyst for post flight analytics. (if you haven't tried it - it's pretty amazing)

One issue is that flysto does not recognize and discard previously uploaded telemetry and you end up with numerous duplicate flight entries as opposed to just the new flights since the last upload.

One way to address this is to truncate the csv HDX files to just the new data, but this seems tedios.

I'm curious if Dynon would consider adding an option to allow user data export which includes telemetry only since the last successful export. This can have a side benefit of competing this delta export to a usb stick much faster than the full dump.

Would this be a difficult option to add?


cheers

I clear my data logs after I have a successful download (and successful upload to my computer). That eliminates the double-logging.
“Navigate to SETUP MENU > SYSTEM SETUP > DATA LOG SETUP > CLEAR ALL DATA to erase the User Data Log, Recent Flight Data Log, and Alert Data Log.“

 

[TrevorMills]

we will see what flysto comes up with. I hope experimental aviation will have some options

Let’s hope they’re kind to us