He Xiao

Biography

I am a Ph.D. student in Electrical and Electronic Engineering at The University of Hong Kong, where I work on making large AI models cheap enough to run everywhere. Before that I was a research scientist intern at PIMIC Inc., working on on-device speech dialogue, 4-bit inference and preliminary ASIC design.

My research sits at the intersection of algorithms and circuits: in-memory computing architectures, ultra-low-bit quantization for large language models, and hardware–software co-optimization for ASIC design. I am passionate about building efficient AI systems that deliver real-world impact on edge devices.

A full account of my education, research experience and service is on the about page; the CV page has the same in a compact form.

Recent News

• 2025.09 — PTQTP — post-training quantization to trit-planes for large language models — is now available on arXiv. [arXiv]
• 2025.08 — Joined the Institute of Microelectronics, Southern University of Science and Technology as a visiting scholar for a tape-out project collaboration (Aug – Oct 2025).
• 2025 — Brain-Inspired Quantized Spiking Neural Networks with Efficient Analog Neurons received the best poster award at MIND 2025.
• 2025 — A Unified Compute-In-Memory Framework for Multisensory Emotion Recognition was presented at ASP-DAC 2025.
• 2025 — Served as a teaching assistant for Math 1853 at the Faculty of Engineering, The University of Hong Kong (Fall 2025).
• 2024.09 — Started the Ph.D. programme in Electrical and Electronic Engineering at The University of Hong Kong, advised by Prof. Ngai Wong and Prof. Can Li.
• 2024.09 — Started reviewing for IEEE TCAS-I, IEEE TCAS-II, AAAI and NeurIPS.
• 2024.09 — Joined PIMIC Inc. as a research scientist intern, working on on-device speech-dialogue LLMs, 4-bit inference and preliminary ASIC design (Sep 2024 – Aug 2025).
• 2024 — Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AI was published in IEEE TCAS-I 71(5).
• 2024 — Efficient Low-bit Neural Network with Memristor-Based Reconfigurable Circuits was published in IEEE TCAS-II 71(1).
• 2023 — Memristor-Based Light-Weight Transformer Circuit Implementation for Speech Recognition was published in IEEE JETCAS 13(1).
• 2023 — Pure-Attention-Based Multi-Function Memristive Neuromorphic Circuit and System was published in the International Journal of Bifurcation and Chaos 33(9).

Full news archive →

Publications & Preprints

• HKPIM: A Hybrid Kernel-fused Processing-In-Memory Framework for Efficient Large Language Model Inference

  • H. Xiao, H. Liu, D. Cheng, W. Xu, J. Xiong, Z. Liu, N. Wong
  • IEEE TCAD Journal Under review

• Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AI

  • H. Xiao, D. Xie, X. Hu, Y. Zhou, S. Duan
  • IEEE TCAS-I, 71(5):2294–2307 Journal

• TIA: Token-Aware In-Memory Attention Architecture for Large Language Models

  • H. Xiao, H. Liu, D. Cheng, W. Xu, J. Xiong, Z. Liu, N. Wong
  • 2026 Preprint Under review

• Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models

  • H. Xiao, Q. Yang, D. Xie, W. Xu, W. Zhou, H. Liu, Z. Liu, N. Wong
  • AAAI 2026 Preprint Under review [arXiv]

• PTQTP: Post-Training Quantization to Trit-Planes for Large Language Models

  • H. Xiao, R. Yang, Q. Yang, W. Xu, Z. Li, Y. Su, Z. Liu, H. Yang, N. Wong
  • NeurIPS 2025 Preprint Under review [arXiv]

Full publication list →

Education & Experience

Education

• Ph.D. in Electrical and Electronic Engineering, The University of Hong Kong, Sep 2024 – Aug 2028
  Advisors: Prof. Ngai Wong, Prof. Can Li
• M.Sc. in Electrical and Electronic Engineering, The University of Western Australia, Jul 2019 – Nov 2021
  Advisor: Prof. Wen Lei
• B.Eng. in Automation, Southwest University, Sep 2016 – Jun 2020
  Advisor: Prof. Xiaofang Hu

Academic Experience

• Teaching Assistant – Math 1853, The University of Hong Kong, Faculty of Engineering, Fall 2025
• Visiting Scholar – Tape-out Project Collaboration, Institute of Microelectronics, Southern University of Science and Technology, Aug 2025 – Oct 2025
• Research Assistant & Team Leader, School of Artificial Intelligence, Southwest University, Jun 2022 – Jan 2024

Internship

• Research Scientist Intern – Efficient AI & Edge Deployment, PIMIC Inc. (USA), Hong Kong Science and Technology Park, Sep 2024 – Aug 2025
  • Led development of an on-device speech-dialogue chatbot enabling LLM interaction on edge hardware
  • Conducted model fine-tuning and quantization to achieve real-time 4-bit inference
  • Initiated preliminary ASIC research for specialized AI accelerators

Service & Leadership

• Reviewer, IEEE TCAS-I, IEEE TCAS-II, AAAI, NeurIPS, Sep 2024 – Present
• Chairman, Youth Volunteers Association, Southwest University, Jun 2018 – Jun 2019
• Main Committee Member, Student Association, Southwest University, Jun 2018 – Jun 2019
• Volunteer, Serving left-behind children, the elderly, and children with special needs, 100+ hours

Awards & Honors

Awards & Honors

• The University of Hong Kong PGS
• Chongqing Outstanding Individual

(Last updated on Oct, 2026)