Compile models ahead-of-time for edge devices
Support LLM implementation with tokenizer integration
Enable quantization for various schemes
Distribute models across heterogeneous systems
Switch seamlessly between target devices using Python
Integrate SDK into existing workflows with minimal overhead
Optimize performance for TFLite, PyTorch, and ONNX models
Handle dynamic shapes with input padding and constrained input shapes