Resolve "Add a robots.txt"

What does this MR do?

Adds a robots.txt file hiding the admin login routes from search engines!

Closes #163 (closed)

Does this MR meet the acceptance criteria?

• I have added tests to validate the new functionality.
• I have updated the documentation accordingly.
• I have added translations for all new client-side text.