CAREER: Toward Scalable and Resilient Collaborative Inference for Edge Intelligence through Network-Aware Design

Collaborative inference at the network edge enables low-latency and privacy-sensitive artificial intelligence (AI) services without relying on remote cloud infrastructure. Distributing increasingly complex neural network models across nearby edge devices enables the pooling of their compute and memory resources to perform inference beyond the…