Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Robots.txt generation should allow for path limiters #3414

Open
HitmanInWis opened this issue Aug 14, 2024 · 0 comments
Open

Robots.txt generation should allow for path limiters #3414

HitmanInWis opened this issue Aug 14, 2024 · 0 comments

Comments

@HitmanInWis
Copy link
Contributor

On a multi-site implementation it's possible that different sites/domains will share the same sling:resourceType for their pages. However, different sites/domains will want their own robots.txt file if for no other reason than specifying different sitemap URLs.

In order to enable this, it would be great if com.adobe.acs.commons.wcm.impl.RobotsServlet.RobotsServletConfig allowed for a list of paths that, if specified, would limit the config to only be honored for those paths. If the list is empty, the servlet would work for any path with the configured sling:resourceType as it does today, preserving backward compatibility.

I might try to find some time to submit a PR for this.

HitmanInWis added a commit to HitmanInWis/acs-aem-commons that referenced this issue Aug 15, 2024
@kwin kwin added this to the 6.6.6 milestone Sep 11, 2024
davidjgonzalez pushed a commit that referenced this issue Oct 1, 2024
* Add feature #3414 (Robots.txt generation should allow for path limiters)
@davidjgonzalez davidjgonzalez removed this from the 6.6.6 milestone Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants