Problem with Robots.txt

Ramsodm

My problem is i have to change my robots.txt as i get notification from google search saying robots.txt blocked their crawler and sitemap marked no index.so i looked for robots.txt in a root folder on my host there was no robots.txt file so i created and uploaded robots.txt file that allow google and other bots but when i go to myurl.com/robots.txt it redirect to my host and show error 404 and finally i found the different robots.txt of my site located at https://www.byforums.com/index.php?p=/robots.txt and it is different from what i uploaded there so how can i edit it?

Shadowdare

Your web server needs to be configured to enable rewrite URLs. If you have Apache, it should work okay with the included .htaccess file if it's been added correctly. If you use Nginx, you'll need to set up some rewrite rules. Rewrite URLs will allow Vanilla to hide index.php?p= from the URLs.

charrondev

https://open.vanillaforums.com/discussion/comment/257792#Comment_257792

Exactly right!

Once you have your URL rewriting configured properly, I would highly recommend going and grabbing the sitemaps plugin.

https://open.vanillaforums.com/addon/sitemaps-plugin-2.2.1