Google's John Mueller answers whether llms.txt could be seen as duplicate content and whether it makes sense to use a noindex header with it.

Google's John Mueller said it may make sense to noindex your LLMs.txt file. This way, the file doesn't get indexed by search engines, and then somehow a user lands on it and is confused.