Execute compiled models on device
Support heterogeneous execution across CPUs, GPUs, and NPUs
Handle dynamic shapes for models like LLMs
Extend to custom NPUs through hardware abstraction layers
Run on Linux, macOS, Windows, and bare-metal systems
Monitor performance of deployed models with a dashboard
Generate runtime executable ahead-of-time
Integrate seamlessly into existing workflows