Joint Quantization and Dynamic Partitioning for Edge Vision Transformers
This arXiv paper proposes an edge orchestration framework for deploying vision transformers across connected and automated vehicles. It jointly selects model partition points, per-layer quantization bitwidths, and execution placement, formulated as a MILP that minimizes compute and communication energy under latency and task-quality constraints. Evaluated on Jetson Orin Nano, NX, and AGX Orin nodes with OPV2V multi-stream workloads, it reports 33.3–36.0% lower V2V communication energy than a Uniform INT8 split and up to 34.0% lower end-to-end latency at K=8, with 3.1–4.1 percentage-point mAP50 reduction versus FP16.
It offers a concrete optimization method and measured trade-offs for running vision transformers across bandwidth-constrained edge devices.
Comments & Questions (0)
No comments yet
Be the first to comment!