Category / Section
How to Edit Robots.txt Content
Published:
Robots.txt files are crucial for search engine optimization as they guide search engine crawlers on which pages of your website should be indexed or excluded. In BoldDesk, you can edit the robots.txt file to specify URLs that you want to permit or block from Google indexing.
Robots.txt in SEO settings
Follow the given steps to set up Robots.txt in SEO settings:
- Navigate to Admin Module and click the Customer Portal option in the Settings section.
- Select the Knowledge Base tab and navigate to the SEO section.
- Select the Edit icon in Robots.txt section.
After clicking the edit icon, the following screen will be shown.
- You can edit the robots.txt content and click Update.
- To view the edited robots.txt content, click the Navigation icon highlighted in the following image.
How to view and manage the robots.txt content
The edited robots.txt content will be visible in the self-service portal.
The edited robots.txt file can include a Sitemap URL. If a Sitemap tag is not added, the Sitemap URL will be automatically appended.
Note: Robots.txt generation is available only for the custom domain mapped portals. To learn more about mapping a custom domain, click here.
