Emergent Sparsity in Frozen Random CNN Feature Extractors for Deep Reinforcement Learning⭐7

Deep RL agents using frozen random CNN extractors spontaneously form extremely sparse FC layers, using as few as 1–3 neurons for Pong. Ablation confirms these f...