Zechen Zhang

evaluating-llms-harness ai

Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking...

implementing-llms-litgpt ai

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen,...

llama-cpp ai

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment,...

transformer-lens-interpretability ai

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate...

tensorrt-llm ai

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production...

simpo-training ai

Simple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4...

mlflow ai

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments...

ray-data ai

Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images....

weights-and-biases ai

Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps,...

distributed-llm-pretraining-torchtitan ai

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use...

crewai-multi-agent ai

Multi-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agents...

llamaguard ai

Meta's 7-8B specialized moderation model for LLM input/output filtering. 6 safety categories - violence/hate, sexual...

llamaindex ai

Data framework for building LLM applications with RAG. Specializes in document ingestion (300+ connectors),...

torchforge-rl-training ai

Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms....

huggingface-accelerate ai

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for...

ml-paper-writing ai

Write publication-ready ML/AI papers for NeurIPS, ICML, ICLR, ACL, AAAI, COLM. Use when drafting papers from...

mamba-architecture ai

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV...

huggingface-tokenizers ai

Fast tokenizers optimized for research and production. Rust-based implementation tokenizes 1GB in <20 seconds....

fine-tuning-with-trl ai

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment,...

deepspeed ai

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism,...