mirror of
https://git.pleroma.social/sjw/pleroma.git
synced 2024-12-26 16:15:06 +01:00
3dadaa4432
Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
3 lines
25 B
Plaintext
3 lines
25 B
Plaintext
User-Agent: *
|
|
Disallow:
|