Default directories NOT to include in robots.txt

Posted by Community Admin on 04-Aug-2018 22:24

Default directories NOT to include in robots.txt

All Replies

Posted by Community Admin on 28-Feb-2017 00:00

Does anyone have a standard protocol for which directories to disallow in a robots.txt file for Sitefinity deployment?   For example, platforms like wordpress recommend certain directories to disallow (/wp-admin/, /wp-content/, /wp-includes/, etc.).   

Obviously Sitefinity is far more advanced than wordpress, but the principle is the same.  

So, I'm curious if such advice exists from fellow users or from Sitefinity themselves.  

 

Thanks,

Liz

 

This thread is closed