Lightemerald/fmhy
1
0
Fork 0
mirror of https://github.com/fmhy/edit.git synced 2026-01-11 02:46:16 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update robots.txt (#3941)

Browse Source 
* update robots.txt

disallow crawlers from /assets/
they treat it as junk/bad content

* Update robots.txt

make it so image files in the base directory don't get indexed
This commit is contained in:
Royiex
2025-08-17 02:52:54 +02:00
committed by GitHub
parent a3a2fa7173
commit 49f816991d
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/public/robots.txt
View File

@@ -1,3 +1,6 @@
User-agent: *
Disallow: /assets/
Disallow: /*.png$
Disallow: /*.svg$
Disallow: /*.ico$
Allow: /