OpenAI has developed a method for extracting interpretable features from their GPT-4 model, resulting in 16 million patterns they believe hold meaning. via @simonw