About Jinane Bazzi Jinane Bazzi Ph.D. Student, Electrical and Computer Engineering In-memory computing Computer architecture Deep learning artificial intelligence Hardware acceleration Projects Related Projects 2025 EdgeCIM: A Hardware-Software Co-Design for CIM-Based Acceleration of Small Language Models Thu, Sep 25 2025 Research AI accelerator The deployment of language models is rapidly shifting from datacenters to edge devices such as laptops, smartphones, and embedded platforms, driven by the demand for interactive, low-latency, and privacy-preserving applications. In this context, Small Language Models (SLMs) have emerged as practical candidates, yet their inference reveals inefficiencies in conventional accelerators. While GPUs and NPUs process the GEMM-heavy prefill stage efficiently, they remain underutilized during the GEMV-dominated decoding phase, resulting in limited throughput and excessive energy consumption at the edge
EdgeCIM: A Hardware-Software Co-Design for CIM-Based Acceleration of Small Language Models Thu, Sep 25 2025 Research AI accelerator The deployment of language models is rapidly shifting from datacenters to edge devices such as laptops, smartphones, and embedded platforms, driven by the demand for interactive, low-latency, and privacy-preserving applications. In this context, Small Language Models (SLMs) have emerged as practical candidates, yet their inference reveals inefficiencies in conventional accelerators. While GPUs and NPUs process the GEMM-heavy prefill stage efficiently, they remain underutilized during the GEMV-dominated decoding phase, resulting in limited throughput and excessive energy consumption at the edge
Engage ORCID LinkedIn KAUST Repository ShareClipboard Related Sites Electrical and Computer Engineering (ECE) Communication and Computing Systems Lab (CCSL) Related Content Projects 1 Related Links Google Scholar
