Forum Activity for @soaringeagle

soaringeagle
@soaringeagle
09/23/15 07:07:37PM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

No it does not I know both of those post the lost most of the images when I ran Paul's script that was supposed to remove duplicate images from the gallery but accidentally ran amok and started deleting every image everywhere. It deleted 800,000 images.

"There were a lot of quoted post with images linking back and forth between each other. Maybe the screwup somewhere in there. I did block them from being crawled in the site map crawler, but maybe I should also block them in the robots text so web crawlers don't get lost too
soaringeagle
@soaringeagle
09/23/15 11:25:09AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

no errors in any templates
cant find the repeating topic in the gallery although it was there
its a very odd issue
heres the entire grep results searhing /topic/topic/
topic.zip - 8.1MB

updated by @soaringeagle: 09/23/15 11:27:52AM
soaringeagle
@soaringeagle
09/23/15 10:30:01AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

seems to be only 2 discussions generating it though i know i saw it in gallery too
and each has something about cache attached
heres an example its poorly formatted

/dreadlocks-forums/forum/dreadlock-picture-gallery/19407/before-and-after-dreadlocks-pictures-comparing-dreads-no-dreads/<br /<br /<br /<br /<br /topic/topic/<br /<br /topic/topic/topic/<br /<br /<br /
/home/greentechnologyf/topic.txt:78594:/home/greentechnologyf/tmp/analog/cache:5900718:1	1	0	0	0	24036136	0	0	24036136	0	0	8108	/dreadlocks-forums/forum/dreadlock-picture-gallery/19407/before-and-after-dreadlocks-pictures-comparing-dreads-no-dreads/topic/<br /<br /<br /<br /<br /<br /<br /topic/<br /<br /<br /<br /topic/topic/<br /p=8
/home/greentechnologyf/topic.txt:78595:/home/greentechnologyf/tmp/analog/cache:5900719:1	1	0	0	0	24035918	0	0	24035918	0	0	7484	/dreadlocks-forums/forum/dreadlock-picture-gallery/19407/before-and-after-dreadlocks-pictures-comparing-dreads-no-dreads/topic/<br /<br /<br /<br /<br /<br /<br /topic/<br /<br /<br /<br /topic/topic/<br /p=7
/home/greentechnologyf/topic.txt:78596:/home/greentechnologyf/tmp/analog/cache:5900723:1	1	0	0	0	24035758	0	0	24035758	0	0	8756	/dreadlocks-forums/forum/dreadlock-picture-gallery/19407/before-and-after-dreadlocks-pictures-comparing-dreads-no-dreads/topic/<br /<br /<br /<br /<br /<br /<br /topic/<br /<br /<br /<br /topic/topic/<br /p=6
/home/greentechnologyf/topic.txt:78597:/home/greentechnologyf/tmp/analog/cache:5900724:1	1	0	0	0	24035620	0	0	24035620	0	0	7895	/dreadlocks-forums/forum/dreadlock-picture-gallery/19407/before-and-after-dreadlocks-pictures-comparing-dreads-no-dreads/topic/<br /<br /<br /<br /<br /<br /<br /topic/<br /<br /<br /<br /topic/topic/<br /p=5

updated by @soaringeagle: 09/23/15 10:31:40AM
soaringeagle
@soaringeagle
09/23/15 10:23:55AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

only in unmodified 404 ill go through all my modified templates in the template tabs
soaringeagle
@soaringeagle
09/23/15 09:56:14AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

i could see the br being a mistype but the repeating topics thats not anything i would have done
the file was taking forever to open so ill try again
alot i saw were from cache though
ill try sifting through it today
soaringeagle
@soaringeagle
09/22/15 12:29:09PM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

Yikes the file with just the repeating topics is 162 megs, so there's a hell of a lot of those weird URLs
soaringeagle
@soaringeagle
09/22/15 08:20:27AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

I'm using grep through ssh had to start over using the output file but so far away looks like was most of them were being found in cache and in a particular discussion but I'm sure there will be way more once he gets farther through it
soaringeagle
@soaringeagle
09/22/15 07:29:56AM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

I tried using it. I got the trial version because the full version was way more than I can afford. I cannot figure it out and gave me memory errors and then crashed
soaringeagle
@soaringeagle
09/21/15 10:04:16PM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

i use both the template tabs and creating custom skins
ok ill try to find php storm and try it out
'
soaringeagle
@soaringeagle
09/21/15 06:46:09PM
3,304 posts

sitemap crawls neverending weird url generation


Ning To Jamroom

by search of my code base you mean what exactly
the repeating topics are somewhere in the galery module it could possibly be in my custom galery pages but i dont believe so i believe it was in the gallery itself and why thered be a topic in the url at all in the gallery confuses me
  149