Skip to content
View chenxuniu's full-sized avatar

Block or report chenxuniu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
chenxuniu/README.md

Typing SVG

Solutions Architect @ NVIDIA · HPC · AI Infrastructure · Energy Efficiency
Santa Clara, CA

Website LinkedIn Google Scholar ORCID


🧠 About Me

I design and optimize large-scale AI systems at NVIDIA, focusing on:

  • 🏗️ HPC + AI infrastructure design (multi-node, scheduling, deployment)
  • ⚡ LLM inference optimization (vLLM · TensorRT-LLM · DeepSpeed)
  • 🔥 Performance-per-watt benchmarking across GPU clusters

How fast can we run — and at what energy cost?


📚 Selected Publications

  • NeurIPS 2026 · Accepted
    The 1/W Law: Context Length is the Dominant Energy Lever in LLM Inference Fleets
    Proceedings forthcoming.

  • ICCAD 2026 · Accepted
    MicroEvo: Knowledge-Guided LLM Sampling for Efficient Microarchitecture Design Space Exploration
    Preprint · Code
    Proceedings forthcoming.

  • AAAI 2026
    TokenPowerBench: Benchmarking the Power Consumption of LLM Inference
    Paper · Code

  • AAAI 2026
    FIXME: Towards End-to-End Benchmarking of LLM-Aided Design Verification
    Paper

More publications · Google Scholar


📊 System Activity

Chenxu Niu GitHub streak


🚀 Featured Work

⚡ LLM Inference Benchmarking

  • Multi-node GPU benchmarking across:
    • vLLM · TensorRT-LLM · DeepSpeed · HuggingFace
  • Throughput · Latency · Memory · Power efficiency

🔋 GPU Energy Efficiency

  • Performance-per-watt analysis across workloads
  • Sustainable AI system design
  • Trade-offs: performance vs energy cost

🏗️ AI / HPC Infrastructure

  • Slurm-based HPC scheduling
  • Kubernetes-based AI deployment
  • Hybrid cluster orchestration
  • Multi-node GPU scaling

⚙️ Tech Stack

AI / ML

PyTorch vLLM TensorRT-LLM DeepSpeed Hugging Face

GPU / Systems

NVIDIA CUDA Multi-Node GPU Power Profiling

Infrastructure

Slurm Kubernetes Docker Linux

Languages

Python C++ Bash YAML


📌 Focus Areas

  • LLM inference engine benchmarking
  • GPU power and energy-efficiency profiling
  • Multi-node AI cluster performance analysis
  • HPC scheduling and AI infrastructure design
  • Sustainable AI system optimization

🔗 Links

Website · LinkedIn · Google Scholar · ORCID

Pinned Loading

  1. TokenPowerBench TokenPowerBench Public

    TokenPowerBench: Benchmarking the power consumption of LLM inference across engines and deployment configurations

    Python 19 2

  2. LLM-Inference-Engine-Benchmark LLM-Inference-Engine-Benchmark Public

    A comprehensive benchmarking tool for measuring energy consumption and power efficiency of Large Language Model (LLM) inference engines including vLLM, DeepSpeed, TensorRT-LLM, and Transformers. Fe…

    Python 7

  3. llm-power-profiler llm-power-profiler Public

    Lightweight local monitor for watts, tokens, and joules per token on OpenAI-compatible LLM servers.

    Python

  4. vllm-project/semantic-router vllm-project/semantic-router Public

    An open, programmable decision layer for models and compute.

    Go 6.4k 1.1k