Forum Activity for @soaringeagle

embed media missing upload photo button solution

Design and Skin Customization

don't ask me why this worked but it was just a wild hunch that paid off
a couple weeks back I reported that the upload photo button was missing in some browsers, but not others
well today it was working in firefox..until it wasn't.. it stoped showing up in every browser and looking at the code reveiled the javascript was missing, only the "noscript' portion was there
I tried disabling all cacheing and performance options in cloudflare deleting server site browser and cloudflare caches
nothing worked till I decided to try 1 last thing

went into the embed media global settings and made upload photo the default tab
and it fixed it!
my theory:
the javascript doesn't load in the page when you switch from another tab to that tab
but, if that tab loads 1st as the default.. the js loads just fine
and... works perfectly in every browser

jr team you might want to see if u can duplicate it or figure out why
ps I did also change it to 'current profile only' could it be a issue with the allowing global file access

and on that note wether you alow global or only profile when you look at the gallery or search (or any other tab) only a very few results show in that popout container the rest are hidden by overflow
can we make that scrollable with the ajax pagination within the embed media container

pleeeeaseeeee
that is 1 very annoying limitation of the embed media module
updated by @soaringeagle: 09/22/15 03:16:56PM

performance test odd results

Using Jamroom

these are the crawl settings i use
and like i said when 1 crawl finishes i start another right away
ideally i want a fresh sitemap every 3-4 days but due to connection issues, having to reboot for 1 reason or anjother or whatever sometimes i cant get a full crawl done for a week or 2

performance test odd results

Using Jamroom

becausethey just upgraded versions thier support was slower then usual latelly i tend to deal with dan santori directly most often
ya know i hadnt thought to exclude the cropped photos
i dont think of any pages as unimportant just less important (except the ones u wantexcluded ofcourse)

i have it olisting over 1000 vids in my sitemaap
you just this box checked
see screenshot
ofourse the incluee all content types and..on the crawler page set the maximum fize size to 0

i run it back to back my small sites i run as a scheduled task on a real slow crawl rate so it doesnt impact the other crawl my big site i run at under 4 urls a sec crawl rate typically any higher and u run the risk of timeouts or server errors especialy during the backup cycle when cpu use goes up
i found keeping it under 400k urls per day works best (i dont have the fastest connection its through my sis's work, but is the connection speed they offered businesses 6 years ago and is lessthen 1/2 the slowest speed they offer home users now) but i dont think its my connection causing issues as much as it is the database and router.php using too much cpu when crawling faster
id only limit things you do not want seen
or things that cause runaway crawls likeoddly generated urls (wich i found was caused by the 'parse form action atributes" in advanced settings
stuff like sign in pages etc

instead of excluding unimportant content give them a very low priority like 0.0 or 0.1 and a very low change freq like yearly or never so they arent crawled often
even cropped images are a pathway into your site when someone searches for something like a photo of ____ witch small dimensions ..granted a very small number might take that photo and click through to your site and turnm into asale or a join but theres still that chance that limiting those could mean a few that 'escape' and go to a rival site instead
so index as much as you can..only limit the truly useless pages to index...

performance test odd results

Using Jamroom

inspyders the best and like jr super awesome guys you would be amazed how many of the features were added specificly for me and they often send me a beta within hours of requesting a feature or a fix im using the beta of the next version to come out v5
i dont run flat out, i set it between 2-4 threads with a 0.10-0.20 server delay checking that my cpuload (in whm or top not the 1 in the dashboard) is 1.25 max preferably under 0.90
and watch for errors in the log if i get more then 1 or 2 i slow it a tad till i get a cleAn run in a reasonable time
to get a vid sitemap just check the extract video data for images use the no title no description options
make sure u set no file size limits and include all content types

my sites 1.4 million pages about so it takes 3-4 days to get a crawl done at the best speed i can get cleanly

id also recomend really taking advantage of the priority and change frequency options to influence crawling dont just use the automatic priority thing set your own costom rules for whats most importantto you to keep fresh and crawled most often

performance test odd results

Using Jamroom

maybe it should be changed to say best run under various server loads instead of low server loads that way you get a idea of how it might perform under more varied conditions

performance test odd results

Using Jamroom

I know for best most accurate results you should run it while the servers not getting a lot of traffic, but this is where the odd results come in
I run a sitemap crawler wich hits the site kinda fast keeping the cpu usage around 0.89-1.24 when I run the test and cpu usage is at around 0.98 to 1.24 I get a 2,500+ result
I pause the sitemap crawler wait for cpu usage to drop to the 0.36-0.58 range and run the test and I lose 500 points averaging 1,800+ to just barely over 2,000

the cpu results vary from 0.23-0.30 based on how much the servers being hit.. the cpu fluctuations are minimal and do improve slightly with less traffic, (disk is pretty consistent around 0.47)
however the odd part is the database

under stress I get 3.34 ish but when theres no traffic its over 4.0 or higher

wich doesn't make much sense to me since I think the rest bypasses cache ..ignoring most cache tweaks and buffers and measures pure db performance when accessing the db (as aposaed to ram cache)

I would expect a higher rating when the db is basicly idle then when its under stress (ps MySQL accounts for most of the cpu usage although router.php tends to use more cpu then id expect..)

so can anyone explain why id get better performance readings while my sitemap crawlers hitting it semi fast (I slowed it from 500-600k pages a day to about 300k just for reference)

just confuses me why the results are better with more traffic then with next to none
updated by @soaringeagle: 09/26/15 04:57:38AM

need help developing advanced search (partially completed)

Jamroom Developers

only searches documents indexed by google
not entire site
thats why i rejected it
solr is a free option if it wasnt too complicated for me to figure out on my own

need help developing advanced search (partially completed)

Jamroom Developers

no offence to the jr team who I have massive love and respect for (and I am eternally greatful) but the jr search is just not useable for my needs I search by the exact title of a forum post, and that post shows up on page 20 buried beneath a ton of irrelevant, or barely relevant posts..in fact yesterday looking for a video on my video list I had to go through 87 pages of search results to find the 1 I wanted

so my solution
build a full search engine using solr

note; cannot be used on jr hosted sites because it requires solr installed on the server (or can be run on a separate server or even multiple servers (possibly can be added to the cloud?) (now that I think if it it might be possible to use on jr servers if jr is willing to maintain a solr search server for all jr hosted sites)

also because every sites diferent this would be considered an advanced module requiring customization to your sites needs

anyway, before this gets too long, the solr search has customizable relevance, it has the ability to offer suggested searches as you type,related searches, "people who searched for this also searched for...." results (more geared towards e-commerce like related products searches)
in short its extremely powerful scalable and customizable

now because I lack the php skills I might need a lil help finishing it off
I hired a freelancer through freelancer.com but it seems hes delivering less then I originaly expected, and now wanting twice, three times the money and that's not even to get it 1/3 completed.
(although from the parts he does I can duplicate and modify to complete 2 other related sections)

I might after doing that be able to figure out enough to eventualy get some of the other sections together, and then pull it all together into a full site search..
however, if anyones else finds the jr search seriously lacking and would like to help build it on my site 1st as a test.demo site then adapt it to your own and other sites (and maybe package it as a module) I would love to collaborate cause I just cant afford to pay this guy any more then I have already.

so far, I have a completed script that indexes my featured forums posts and my main site forums (but not other profile forums (there aren't any really in use right now so low priority but should be included in final version) I should have the photos indexing script done soon, and the site search integration complete soon

working from what hes put together so far (slowly) it shouldn't be hard at all for someone who knows the code and module development to recreate and adapt it to each section

i'm going to try to do as much as I can on my own, but its a lot of trial and error (mostly error) for me to get it done i'm sure many of you could do more in an hour then I can in 4 days

once complete id love to share it with everyone whod want to use it (if I get help from an established developer whod want to offer it for sale that would be quite alright with me but since I have invested much more then I can afford already, if ya wanna share a lil % that would be cool)

if I don't get help, i'll probably just offer it as a detailed advanced tip free)

final note, although I'm developing this for a far better site search, what its built on can be used to develop a full web search engine, in fact duckduckgo is built on it,

I had literaly tried 100 other site search solutions even bought a couple that were total failures
looked into hosted solutions (because of the size of my site most would charge me 50,000 a month!)
after a good 4 months of searching ..solr was the only option that made sense and will be a massive improvement on the jr search

I should have a partial demo on at least a couple site sections in a couple weeks..ish

anyone willing to help can help offer a drasticly improved search option
updated by @soaringeagle: 09/28/15 11:14:50AM

couple possible bugs and a suggestion

Design and Skin Customization

s i said when i8 switch over i haveto rebuild the front page, theres like 20 empty widgets with an error message,above the widget containers that got to be removed 1st, then, wheni rebuild the widgets its as if theres a doubled containing div causing the styling to be all wonky, like you see how the activity is inside a div with a box shadoe and border radius, well they are all doubled, 1 inside another
that goes for everything
so it just looks a complete mess with no easy way to fix it that i could find

couple possible bugs and a suggestion

Design and Skin Customization

here u go
passing out so if u need anything more it will have to wait
if u wajnt you can login to my site and test it see if its the jamroom or perhaps its the cloudflare performance issue but its weird that it ionly affects that 1 button

although i have noticed when editinga widget (still havent upgrasded to thenew sitebuilder core) when i click the edit button the totles there but no text feild till i click code, then back to html then it shows up but i figured thats just cache or something