In-Memory Computing
CIM architectures that move computation into the memory array, collapsing the data-movement bottleneck that dominates modern AI accelerators.
He XiaoPh.D. Electrical and Electronic Engineering
Ph.D. Student @ The University of Hong Kong
Bridging advanced AI algorithms with practical high-performance hardware.
I am a Ph.D. student in Electrical and Electronic Engineering at The University of Hong Kong, where I work on making large AI models cheap enough to run everywhere. Before that I was a research scientist intern at PIMIC Inc., working on on-device speech dialogue, 4-bit inference and preliminary ASIC design.
My research sits at the intersection of algorithms and circuits: in-memory computing architectures, ultra-low-bit quantization for large language models, and hardware–software co-optimization for ASIC design. I am passionate about building efficient AI systems that deliver real-world impact on edge devices.
- Affiliation
- The University of Hong Kong
- Advisors
- Prof. Ngai Wong · Prof. Can Li
- Location
- Hong Kong SAR, China
Research
Mission: make large AI models cheap enough to run anywhere.
Ultra-Low-Bit Quantization
Post-training quantization down to 2–4 bits, including trit-plane representations that push LLM inference into genuinely low-precision territory.
Hardware–Software Co-Design
Joint algorithm-and-ASIC design — from kernel fusion and token-aware dataflow to tape-out ready circuits that exploit memristor devices.
Education & Work
-
Sep 2024 – Aug 2028
The University of Hong Kong
Ph.D. in Electrical and Electronic Engineering
Advisors: Prof. Ngai Wong, Prof. Can Li
-
Jul 2019 – Nov 2021
The University of Western Australia
M.Sc. in Electrical and Electronic Engineering
Advisor: Prof. Wen Lei
-
Sep 2016 – Jun 2020
Southwest University
B.Eng. in Automation
Advisor: Prof. Xiaofang Hu
-
Fall 2025
Teaching Assistant – Math 1853
The University of Hong Kong, Faculty of Engineering
-
Aug 2025 – Oct 2025
Visiting Scholar – Tape-out Project Collaboration
Institute of Microelectronics, Southern University of Science and Technology
-
Jun 2022 – Jan 2024
Research Assistant & Team Leader
School of Artificial Intelligence, Southwest University
-
Sep 2024 – Aug 2025
Research Scientist Intern – Efficient AI & Edge Deployment
PIMIC Inc. (USA), Hong Kong Science and Technology Park
- Led development of an on-device speech-dialogue chatbot enabling LLM interaction on edge hardware
- Conducted model fine-tuning and quantization to achieve real-time 4-bit inference
- Initiated preliminary ASIC research for specialized AI accelerators
Publications
Journal Articles 5
-
HKPIM: A Hybrid Kernel-fused Processing-In-Memory Framework for Efficient Large Language Model Inference Journal Under review
-
Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AI Journal
-
Efficient Low-bit Neural Network with Memristor-Based Reconfigurable Circuits Journal
-
Memristor-Based Light-Weight Transformer Circuit Implementation for Speech Recognition Journal
-
Pure-Attention-Based Multi-Function Memristive Neuromorphic Circuit and System Journal
Conference Papers & Preprints 5
-
TIA: Token-Aware In-Memory Attention Architecture for Large Language Models Preprint Under review
-
Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models Preprint Under review
-
PTQTP: Post-Training Quantization to Trit-Planes for Large Language Models Preprint Under review
-
A Unified Compute-In-Memory Framework for Multisensory Emotion Recognition Conference Poster
-
Brain-Inspired Quantized Spiking Neural Networks with Efficient Analog Neurons Conference Best poster
Patents 3
-
Speech Recognition System Based on Light-Weight Transformer Patent
-
Memristor-Based Text Sentiment Detection System Patent
-
Image Restoration Method Based on Brain-Inspired Vision Transformer for Edge ADAS Devices Patent
Awards & Service
Honors 2
- The University of Hong Kong PGS
- Chongqing Outstanding Individual
Service & Leadership 4
- Reviewer — IEEE TCAS-I, IEEE TCAS-II, AAAI, NeurIPS Sep 2024 – Present
- Chairman — Youth Volunteers Association, Southwest University Jun 2018 – Jun 2019
- Main Committee Member — Student Association, Southwest University Jun 2018 – Jun 2019
- Volunteer — Serving left-behind children, the elderly, and children with special needs 100+ hours
News
- 2025.09 PTQTP — post-training quantization to trit-planes for large language models — is now available on arXiv. arXiv ›
- 2025.08 Joined the Institute of Microelectronics, Southern University of Science and Technology as a visiting scholar for a tape-out project collaboration (Aug – Oct 2025).
- 2025 Brain-Inspired Quantized Spiking Neural Networks with Efficient Analog Neurons received the best poster award at MIND 2025.
- 2025 A Unified Compute-In-Memory Framework for Multisensory Emotion Recognition was presented at ASP-DAC 2025.
- 2025 Served as a teaching assistant for Math 1853 at the Faculty of Engineering, The University of Hong Kong (Fall 2025).
- 2024.09 Started the Ph.D. programme in Electrical and Electronic Engineering at The University of Hong Kong, advised by Prof. Ngai Wong and Prof. Can Li.
- 2024.09 Started reviewing for IEEE TCAS-I, IEEE TCAS-II, AAAI and NeurIPS.
- 2024.09 Joined PIMIC Inc. as a research scientist intern, working on on-device speech-dialogue LLMs, 4-bit inference and preliminary ASIC design (Sep 2024 – Aug 2025).
- 2024 Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AI was published in IEEE TCAS-I 71(5).
- 2024 Efficient Low-bit Neural Network with Memristor-Based Reconfigurable Circuits was published in IEEE TCAS-II 71(1).
- 2023 Memristor-Based Light-Weight Transformer Circuit Implementation for Speech Recognition was published in IEEE JETCAS 13(1).
- 2023 Pure-Attention-Based Multi-Function Memristive Neuromorphic Circuit and System was published in the International Journal of Bifurcation and Chaos 33(9).