locked Slow ADIF import - Confirmed


HamApps Support (VK3AMA)
 

On 14/04/2021 1:35 am, John Holmes W9ILY wrote:

As you may recall my ADI fie is over 85 MB for over 249,000 records and the load time took over 116,000 ms to complete. Can this be improved? Thanks for all of your latest enhancements!

 

John W9ILY


John,

I can confirm this abnormal behavior.

The adif import code of 2.50.0 is an exact copy of the old 2.16.17 import code. The only difference is the underlying .NET runtime used.

After much head scratching and tests it was tracked down to the code used for locating the position of an adif tag within an adif record. I don't use regex for this has proved even slower when processing thousands of records in a tight loop.

I don't have an explanation as to why the new NET5 runtime version of the inbuilt command is so much slower than the old NET4.7.2 Framework version.

Results for a 183K record adif...
  •  JTAlert 2.16.17      : Elapsed time ~16.3 secs (~11.2k records per sec)
  •  JTAlert 2.50.0       : Elapsed time ~70.7 secs (~2.5K records per sec)
  •  JTAlert 2.50.0 fixed : Elapsed time ~7.0 secs  (~26K records per sec)

I'll send you a new build to test later today.

de Laurie VK3AMA
 
JTAlert 2.16.17
   

JTAlert 2.50.0
   

Fixed JTAlert 2.50.0