Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate a sitemap and robots.txt for search engine indexing #534

Merged
merged 2 commits into from
Nov 4, 2024

Conversation

blms
Copy link
Contributor

@blms blms commented Nov 4, 2024

In this PR

To allow search engines to crawl and index full-text contents:

  • Install sitemap generator gem and configure to index each document's URL
  • Create robots.txt generator to allow hostname configuration per instance
  • If Amazon S3 is used as a storage backend, configure sitemap generator to store the sitemap there, and configure a route to redirect sitemap.xml.gz to the appropriate S3 url

blms added 2 commits November 4, 2024 11:51

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
@blms blms merged commit 5615226 into develop Nov 4, 2024
@blms blms deleted the feature/sitemap branch November 4, 2024 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant