Wouter Groeneveld
|
15d2593ada
|
update robots.txt for https://darkvisitors.com/docs/set-up-a-robots-txt
|
2024-04-18 14:41:29 +02:00 |
Wouter Groeneveld
|
58eea30829
|
GPTBot robots.txt disallow
|
2023-08-07 19:58:39 +02:00 |
Wouter Groeneveld
|
3af74badc3
|
change license to CC BY 4.0; is your website training AI?
|
2023-04-23 14:46:21 +02:00 |
Wouter Groeneveld
|
854351610c
|
fuck off ChatGPT.
|
2023-03-29 14:46:07 +02:00 |
wgroeneveld
|
09c6712527
|
google robots stuff updated
|
2020-11-19 10:50:03 +01:00 |
wgroeneveld
|
fe9f1b6b5d
|
add sitemap to robots.txt
|
2020-11-12 12:34:21 +01:00 |