The question is, will we do this manually since Robots doesn't allow wildcarding/regex rules or perhaps create a directory called "files" where we disallow indexing (yeah probably).

Let's grab the tiny, friendly gif of Garak doing jazz hands for the index.html page of the files directory.