Forum Activity for @brian

weird sitemap crawl results after urlscanner update

Installation and Configuration

You're continuing to post here without reading my follow ups.

weird sitemap crawl results after urlscanner update

Installation and Configuration

You're correct - they help with SEO. But none of it refutes what I have posted. You're line of reasoning is that Google bot is flawed and can't figure out how to follow a URL. with 20+ years experience crawling the web, that's not an issue Google is still dealing with

weird sitemap crawl results after urlscanner update

Installation and Configuration


Again - it's to help search engines find pages that are NOT discoverable - i.e. they are not linked anywhere from your site. I suspect you have very little URLs that fall into this category.

weird sitemap crawl results after urlscanner update

Installation and Configuration


Unless your URLs are hidden, this just doesn't happen.

Ability to sort Smileys manually

Suggestions

There's currently a caching issue - have found it and am fixing it. I'll have a fixed up out shortly.

Ability to sort Smileys manually

Suggestions

Nevermind - I think I see what is going on here based on your last screenshot. Note that for now you can just enter "sad-mad" in the NEW category field. I will try to find out why it is not showing in the drop down.

weird sitemap crawl results after urlscanner update

Installation and Configuration


But which one is accurate? If you actually DO have a million pages on your site then that's fine, but there's no reason to list them all in your sitemap. The Sitemap file is used by crawlers to identify the starting point for a crawl. There is no need to list ALL PAGES in a sitemap file, since Google will automatically follow any URLs that are found on a page.

So for example - in your site map file you only need the URL to a profile. You do not need to list every single page in the profile. Google/Bing/etc will easily find all those sub pages without being "told" they are there.
updated by @brian: 01/27/17 08:50:25AM

Ability to sort Smileys manually

Suggestions

I'm testing this and don't see this here. I changed the category for an existing smiley to "food/party" and I don't see a "food-party" category - only "food/party".

weird sitemap crawl results after urlscanner update

Installation and Configuration

Can you point me to a JR page that has a malformed URL for YouTube?

Thanks!

Ability to sort Smileys manually

Suggestions

So what you're saying is if you enter a category like:

cats/dogs

It is creating TWO categories?