arXiv Computer Vision

TinyFlow: Breaking the Warping Bottleneck for Edge Optical Flow

arXiv Computer Vision
1d ago

MCUFlowNet: Hardware-Aware Neural Architecture Search for Optical Flow on Microcontrollers

MCUFlowNet introduces a hardware‑aware neural architecture search framework, PACE‑NAS, that separates memory usage from latency for optical flow networks on microcontrollers. By fixing the backbone’s peak SRAM and searching for efficient operators and depths, the authors reduce peak SRAM usage by 18% and improve accuracy with lightweight context modules. The resulting MCUFlowNet models, particularly MCUFlowNet‑S, run 1.76× faster than a retrained EdgeFlowNet while achieving comparable or better performance in simulated drone flight tests, and the approach also benefits semantic segmentation tasks.

By Enmin Lin, Jona Beysens
arXiv Machine Learning
Jul 1

FlexViT: A Flexible FPGA-based Accelerator for Edge Vision Transformers

arXiv:2606. 31938v1 Announce Type: cross Abstract: Deploying Vision Transformer (ViT) models on edge platforms remains challenging due to their high computational demands and the architectural heterogeneity of modern hybrid ViT models, which incorporate both fully connected and convolutional layers.

By Hubert Dymarkowski, Xingjian Fu, Rappy Saha, Jude Haris, Jos\'e Cano
arXiv Machine Learning
Oct 16

ShiftQAT: Quantization-Aware Training for the Numerical Contract of a Fixed-Function Edge CNN Accelerator

ShiftQAT is a quantization‑aware training workflow designed for the MAX7800x family of fixed‑function CNN accelerators. It enforces the accelerator’s numerical contract—power‑of‑two, per‑tensor symmetric scales, 8‑bit activations and biases, integer‑only arithmetic, and a single statically configured shift per layer—by training weights and biases on a joint power‑of‑two grid and resolving dependencies so that activation scales propagate statically. Compared to other methods, ShiftQAT uniquely satisfies all contract constraints while matching the accuracy of less constrained QAT approaches, achieving ImageNet performance within 2.9 percentage points of FP32 at W4A8 and enabling fast, energy‑efficient inference on MAX78002 silicon.

By Oguzhan Buyuksolak, Osman Erman Okman, Mehmet Gorkem Ulkar
Hugging Face Trending Papers
Sep 10

FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation

FreeFlow is a hierarchical transformer for optical flow estimation that eliminates traditional flow-specific inductive biases such as correlation volumes and feature warping. It relies on a single feed-forward encoder–decoder architecture that incorporates window attention, shifted-window attention, and reduced-resolution global attention. This design allows the model to scale with capacity while achieving state‑of‑the‑art accuracy on Sintel, KITTI‑2015, and Spring benchmarks, all while remaining memory efficient at 1080p inference.

arXiv Machine Learning
Sep 24

RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

The paper introduces RAMP, a method for robust adaptive mixed‑precision quantization of vision models on edge CPUs. It evaluates 13 sensitivity metrics across four neural networks, finding that Jensen‑Shannon Divergence consistently identifies layers that can be safely quantized. Using K‑Means clustering on these metrics, RAMP achieves near‑lossless accuracy with an average 1.81× speed‑up, while cautioning against excluding low‑speed‑up layers that can fragment the computational graph.

By David Poblaci\'on-Criado, Dario Garcia-Gasulla, Eduardo Quinones
arXiv Computer Vision
Sep 11

FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation

FreeFlow is a hierarchical transformer for optical flow estimation that eliminates traditional flow-specific inductive biases such as correlation volumes, feature warping, and iterative refinement. It relies on a single feed-forward encoder–decoder architecture that integrates window attention for local processing, shifted-window attention for cross-window communication, and global attention at reduced resolution. This design allows the model to scale naturally with capacity, achieving state-of-the-art performance on Sintel, KITTI-2015, and Spring benchmarks while remaining memory efficient at 1080p inference.

By Vladislav Bargatin, Alexander Yakovenko, Khaled Abud, Dmitriy Vatolin
Hugging Face Trending Papers
Aug 6

Energy-Guided Flow Matching

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.

arXiv Machine Learning
Sep 16

Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators

The study evaluates the portability of INT8 post‑training quantization across seven hardware platforms, including CPUs, GPUs, and vendor NPUs, by keeping the ONNX model and quantization scales constant. It finds that INT8 performance and output consistency vary significantly: CPU dot‑product instructions determine speedup, identical INT8 outputs only occur when integer kernels match, and vendor NPUs require their own quantization pipelines. The authors also show that edge‑NPU latency is dominated by data transfer rather than compute and provide scripts and reports for reproducibility.

By Yuyeong Shin