eIQ AI Toolkit 2.0 (Fairy)¶
Backend¶
Fixed¶
Redis keys in optimization pipeline were not unique and did not allow two pipelines to run at the same time
Incorrect vela profiling inference time after failed run
Prevented hangs during parallel profiling on a single board by failing concurrent runs early
Added¶
Acceleration ratio in profiling runs
Add Pydoclint - docstring linter
List of kernel kinds for Neutron 3.0.1 release.
OnnxOpVersionConversion pass
Model explorer graph conversion
OnnxPeepholeOptimizer pass
Enable to set number of warmup and regular inference runs for on-device profiling, add statistics for warmup and regular inferences, add total and init memory footprint to on-device profiling result
Profiling detection of Neutron models
Changed¶
Remove properties ‘inputs’, ‘outputs’, ‘input_shape’, ‘output_shape’, ‘order’ from structure ‘Node’ of profiled model graph and edit all parsers according to it
Update MCU profiling input file schema
Updated Neutron simulated profiling parsing, option to dump statistics to JSON file was removed from converter.
Pinned numpy to 2.3.5
Migrated to eiq-olive 0.9.0
Redesigned resource download endpoints to two-step utilizing pre-signed URLs
GUI¶
Added¶
Artifact table in optimization detail
General statistics cards to profiling detail
Chip in the list of models for optimization pipeline input that shows if model was converted for vela or neutron
Functionality to save optimization pipeline configurations as templates
Enable to set warmup and regular inference number in on-device profiling form
Warnings for possibly incompatible model selection in profiling
Make table rows clickable
Spinner on download button
Model Explorer
Model detail page
Dataset detail page
Show Profiling tag for Neutron profiling models
Fixed¶
Download optimization artifact from optimization history table
Changed¶
Redesigned resource download endpoints to two-step utilizing pre-signed URLs