CausalGate: Causal Importance Distillation for Transformer Module Pruning⭐8

CausalGate uses causal importance distillation to prune transformer modules, reducing compute and latency in LLMs without runtime overhead.