mirror of
https://github.com/zedeus/nitter
synced 2024-11-22 18:07:14 +01:00
6 lines
74 B
Plaintext
6 lines
74 B
Plaintext
User-agent: *
|
|
Disallow: /
|
|
Crawl-delay: 1
|
|
User-agent: Twitterbot
|
|
Disallow:
|