Skip to content
He Xiao

He XiaoPh.D. Electrical and Electronic Engineering

Ph.D. Student @ The University of Hong Kong

Bridging advanced AI algorithms with practical high-performance hardware.

I am a Ph.D. student in Electrical and Electronic Engineering at The University of Hong Kong, where I work on making large AI models cheap enough to run everywhere. Before that I was a research scientist intern at PIMIC Inc., working on on-device speech dialogue, 4-bit inference and preliminary ASIC design.

My research sits at the intersection of algorithms and circuits: in-memory computing architectures, ultra-low-bit quantization for large language models, and hardware–software co-optimization for ASIC design. I am passionate about building efficient AI systems that deliver real-world impact on edge devices.

Affiliation
The University of Hong Kong
Advisors
Prof. Ngai Wong · Prof. Can Li
Location
Hong Kong SAR, China
Email
hexiaoriver@connect.hku.hk

Research

3 directions

Mission: make large AI models cheap enough to run anywhere.

In-Memory Computing

CIM architectures that move computation into the memory array, collapsing the data-movement bottleneck that dominates modern AI accelerators.

Ultra-Low-Bit Quantization

Post-training quantization down to 2–4 bits, including trit-plane representations that push LLM inference into genuinely low-precision territory.

Hardware–Software Co-Design

Joint algorithm-and-ASIC design — from kernel fusion and token-aware dataflow to tape-out ready circuits that exploit memristor devices.

News

Education & Work

  1. Sep 2016 – Jun 2020

    Southwest University

    B.Eng. in Automation

    Advisor: Prof. Xiaofang Hu

  2. Jul 2019 – Nov 2021

    The University of Western Australia

    M.Sc. in Electrical and Electronic Engineering

    Advisor: Prof. Wen Lei

  3. Jun 2022 – Jan 2024

    Research Assistant & Team Leader

    School of Artificial Intelligence, Southwest University

  4. Sep 2024 – Aug 2028

    The University of Hong Kong

    Ph.D. in Electrical and Electronic Engineering

    Advisors: Prof. Ngai Wong, Prof. Can Li

  5. Sep 2024 – Aug 2025

    Research Scientist Intern – Efficient AI & Edge Deployment

    PIMIC Inc. (USA), Hong Kong Science and Technology Park

    • Led development of an on-device speech-dialogue chatbot enabling LLM interaction on edge hardware
    • Conducted model fine-tuning and quantization to achieve real-time 4-bit inference
    • Initiated preliminary ASIC research for specialized AI accelerators
  6. Aug 2025 – Oct 2025

    Visiting Scholar – Tape-out Project Collaboration

    Institute of Microelectronics, Southern University of Science and Technology

  7. Fall 2025

    Teaching Assistant – Math 1853

    The University of Hong Kong, Faculty of Engineering

Awards & Service

Honors 2

  • The University of Hong Kong PGS
  • Chongqing Outstanding Individual

Service & Leadership 4

  • Reviewer — IEEE TCAS-I, IEEE TCAS-II, AAAI, NeurIPS Sep 2024 – Present
  • Chairman — Youth Volunteers Association, Southwest University Jun 2018 – Jun 2019
  • Main Committee Member — Student Association, Southwest University Jun 2018 – Jun 2019
  • Volunteer — Serving left-behind children, the elderly, and children with special needs 100+ hours

Publications

Journal Articles 6

  • High-Performance Method and Architecture for Attention Computation in DNN Inference Journal
    Q. Cheng, X. Hu, H. Xiao, Y. Zhou, S. Duan
    IEEE TBCAS, 19(2):404–415 ·2025
  • Neuromorphic Vision Restoration Network for Advanced Driver Assistance System Journal
    D. Xie, H. Xiao, X. Hu, Y. Zhou, G. Zhou, S. Duan
    IEEE TCE, 70(1):3658–3668 ·2024
  • Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AI Journal
    H. Xiao, D. Xie, X. Hu, Y. Zhou, G. Zhou, S. Duan
    IEEE TCAS-I, 71(5):2294–2307 ·2024
  • Efficient Low-Bit Neural Network With Memristor-Based Reconfigurable Circuits Journal
    H. Xiao, X. Hu, T. Gao, Y. Zhou, S. Duan, Y. Chen
    IEEE TCAS-II, 71(1):66–70 ·2024
  • Memristor-Based Light-Weight Transformer Circuit Implementation for Speech Recognizing Journal
    H. Xiao, Y. Zhou, T. Gao, S. Duan, G. Chen, X. Hu
    IEEE JETCAS, 13(1):344–356 ·2023
  • Pure-Attention-Based Multifunction Memristive Neuromorphic Circuit and System Journal
    H. Xiao, H. Sun, T. Zhao, Y. Zhou, X. Hu
    Int. J. Bifurcation Chaos, 33(9):2330023 ·2023

Conference Papers & Preprints 4

  • Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models Conference Findings
    H. Xiao, Q. Yang, D. Xie, W. Xu, Z. Su, R. Yang, H. Liu, W. Zhou, Z. Liu, N. Wong
    ACL 2026 Findings, 15753–15764 ·2026
  • A Unified Compute-In-Memory Framework for Multisensory Emotion Recognition Conference Poster
    H. Xiao, Y. Zhou, D. Xie, Q. Cheng, X. Hu, Z. Liu, N. Wong
    ASP-DAC, 1329–1335 ·2026
  • Brain-Inspired Quantized Spiking Neural Networks with Efficient Analog Neurons Conference Best poster
    H. Xiao, H. Liu, Z. Liu, N. Wong
    MIND, 245–246 ·2025
  • PTQTP: Post-Training Quantization to Trit-Planes for Large Language Models Preprint Under review
    H. Xiao, R. Yang, Q. Yang, W. Xu, Z. Li, Y. Su, Z. Liu, H. Yang, N. Wong
    2025

Patents 3

  • Speech Recognition System and Method Based on a Lightweight Transformer Network Patent Granted
    Y. Zhou, H. Xiao, X. Hu, H. Hong, S. Duan
    Chinese Patent, CN116013309B ·2025
  • Memristor-Based Text Sentiment Detection System and Method Patent Granted
    Y. Zhou, H. Xiao, X. Hu, H. Hong, S. Duan
    Chinese Patent, CN115994221B ·2025
  • Image Restoration Method Based on a Brain-Inspired Vision Transformer and ADAS Edge Devices Patent Granted
    X. Hu, D. Xie, Y. Zhou, H. Xiao
    Chinese Patent, CN117392020B ·2025