YAVIN: A Unified Architecture for Secure Edge Processing in Memory

2026-08-13Hardware Architecture

Hardware Architecture
AI summary

The authors address a key problem in secure computing on edge devices, where both the processor and memory need protection but current systems only secure the processor. They introduce YAVIN, which extends trusted execution environments (TEEs) to include processing inside memory, allowing data to be securely decrypted, processed, and encrypted within memory without trusting the memory bus. To do this, they implement special encryption algorithms designed to work efficiently in memory hardware. Their approach significantly speeds up secure processing compared to previous solutions while only slightly slowing down machine learning tasks that run on these edge devices.

processing-in-memory (PIM)trusted execution environment (TEE)post-quantum cryptographyLightSaber KEMASCON-128 authenticated encryptioncryptographic stateVon Neumann bottleneckedge computingtensor-based workloadsquantized neural networks
Authors
Shouzhi Fang, William C. Tegge, Md Omar Faruque, Peipei Zhou, Endadul Hoque, Alex K. Jones
Abstract
Secure, private multi-tenant execution spanning processors, memory, and accelerators remains one of the most significant challenges in modern edge computing systems. Simultaneously, processing-in-memory (PIM) has emerged as an effective approach for reducing the Von Neumann bottleneck by moving computation closer to data. Existing trusted execution environments (TEEs) establish trust only within the processor, protecting data while it traverses untrusted resources such as the memory bus. Consequently, trusted computation cannot be performed directly within memory. We present YAVIN, a unified trusted computing base (TCB) that extends the TEE beyond the processor to encompass both processor execution and a dedicated memory region supporting trusted processing-in-memory execution while treating the memory bus as untrusted. Leveraging the dedicated protected memory regions already established by conventional TEE architectures, YAVIN enables data to be decrypted, processed, and re-encrypted by either processor or PIM execution while remaining within the TEE. To realize this unified TCB, YAVIN presents the first PIM implementations of the LightSaber KEM post-quantum cryptosystem and ASCON-128 authenticated encryption, co-designing both algorithms for efficient DRAM execution to establish and maintain shared cryptographic state. Finally, we demonstrate how cryptography-PIM co-design for tensor-based workloads reorganizes computation to satisfy the ordering constraints imposed by authenticated encryption with minimal performance overhead while simultaneously enabling bit-sliced ordering that limits temporary plaintext exposure. Compared to the latest PIM AES implementation, YAVIN achieves more than a 20x speedup while incurring only 34% and 9.3% overhead when executing INT8 and INT32 quantized edge-class LLMs, respectively, relative to plaintext execution.