Understanding the Architecture of the Fifth Layer