weird sitemap crawl results after urlscanner update
Installation and Configuration
soaringeagle:
now does the sm module know that if you get over 50,000 profiles it needs to start a new file? sitemaps have a size and url mlimit 50k urls but sites with long urls might need to linmit it t 4ok so the long urls dont push it past size limits
Yes - it adheres to all the sitemap limits and specifications.
The sitemap has no idea you created this custom page right now. What I think needs to be done here is it needs to be updated to work with SiteBuilder for sure, as well as look for custom skin templates. That should handle most pages - any remaining will be found by the crawler if linked to.
Quote:
additionally every single page has priority 1
I'm not sure what to do here. For profiles we can certainly change it based on updated time, but for the rest of the site I'd prefer to NOT make the site owner have to decide. So we need a good default, and daily works. I'll think about it.
Thanks!
