Trouble getting Technorati to craw and update your blog?

sasha · Post by **sasha** » Thu Jul 13, 2006 10:57 pm

Technorati wouldn't update our blog. We contacted technorati and they asked about our plugins and if we changed or added any lately.

Long story short we tried turning off the "extended authors" plugin and now Technorati can craw our site. Apparently some plugins prevent their servers from crawling sites.

We have s9y on other domains using the same hostand were getting crawed and didn't have that plugin so we are certain that it's the "extended authors" plugin now that it's working.

Post by **garvinhicking** » Fri Jul 14, 2006 12:01 pm

Hi!

Hm, the technorati people will need to answer this. I don't know what their bot is choking on, so they need to tell us.

Is it because of HTML output, because of links, or what? They surely have some kind of error output for their crawler?

Best regards,
Garvin

judebert · Post by **judebert** » Fri Jul 14, 2006 4:58 pm

I'm trying to get Technorati involved. Sasha, could you please give us a link to your blog so they'll know what we're talking about?

sogua · Post by **sogua** » Tue Jul 18, 2006 8:20 am

i'm also having the same problem.
Currently using Serendipity Version 1.0.
and this issue has been there for quite sometime and i didnt notice until i read this post.

Hopefully this issue can be solved in the next release.

Here is my link http://sogua.mamakcorner.com

sasha · Post by **sasha** » Tue Jul 18, 2006 8:45 am

They didn't know what it was either. They just asked me if we were using any special plugins or if we added/changed anything with plugins in the past two months (when they stopped crawing). At first I thought no then remembered and immeidately deleted it.

The tech at Technorati e-mailed me and was unable to force craw the site then after I deleted it they were able to do it immediately.

judebert · Post by **judebert** » Thu Jul 20, 2006 7:37 am

sogua: Thanks for the link. It should make things a little easier.

Technorati hasn't gotten back to me yet. I'll try to revisit this in about a week, manually going through the source if Technorati hasn't helped out. If I don't get back to you in two weeks, remind me here and give me a kick in the butt.

hynek · Post by **hynek** » Sun Aug 06, 2006 5:16 pm

judebert wrote:Technorati hasn't gotten back to me yet. I'll try to revisit this in about a week, manually going through the source if Technorati hasn't helped out. If I don't get back to you in two weeks, remind me here and give me a kick in the butt.

Well...*cough*: *kick*

My Blog ( http://blog.ox.cx/ ) hasn't been crawled by Technorati for 23 days although I even ping them manually and added the rel="bookmark" as they prefer it to the template...nothing.

Interestingly, http://www.workfriendly.net/ does also have problems with it...it simply doesn't show anything.

Maybe some Feed-Issues? I had to stop to use Feedburner because of strange problems I never had with WP or MT...and at least Technorati uses AFAIK the Atom feed for some stuff.

Post by **garvinhicking** » Sun Aug 06, 2006 5:20 pm

Hi!

Hm, did your feedburner feed medic tell you about any problems? I am using FB for some time and don't have problems with them. But I made them subscribe to my "rss.php?version=2.0&nocache=true" feed, maybe that made some problems.

As for technorati, I'm afraid only the technorati guys can help us out what they have problems with

Best regards,
Garvin

hynek · Post by **hynek** » Sun Aug 06, 2006 5:33 pm

Hi,

garvinhicking wrote: Hm, did your feedburner feed medic tell you about any problems? I am using FB for some time and don't have problems with them. But I made them subscribe to my "rss.php?version=2.0&nocache=true" feed, maybe that made some problems.

Wow, that solved it immediately! Thanks alot! I let them just subscribe to my plain Atom-feed...I guess I missed some RTFM... :/

garvinhicking wrote:As for technorati, I'm afraid only the technorati guys can help us out what they have problems with

Before I realized that it's s9y-related, I asked them about it too a few days ago (they also screw up my link count). No answer from them. Not a single one.

Post by **garvinhicking** » Sun Aug 06, 2006 5:38 pm

Hi!

Wow, that solved it immediatly! Thanks alot! I let them just subscribe to my plain Atom-feed...I guess I missed some RTFM... :/

Good to hear.

But the fault was probably not with you, but with us not properly documenting the possible usage scenarios. So I'm sorry for that!

Before I realized that it's s9y-related, I asked them about it too a few days ago (they also screw up my link count). No answer from them. Not a single one.

That's my experience from technorati as well...it's really sad, because I really don't know what could be causing the trouble; both the HTML and your RSS seem to properly validate, so there shouldn't be anything wrong with that?!

Best regards,
Garvin

hynek · Post by **hynek** » Mon Aug 07, 2006 3:04 pm

JFTR: Anyone not having problems with Technorati ATM?

NB: I've just checked my server logs and have no traces of a Technorati-bot...anyone aware how it identifies itself? I've pinged them zillion times by hand and whenever I post a new entry.

judebert · Post by **judebert** » Tue Aug 08, 2006 4:38 pm

Sorry about the delay; glad you got things fixed.

Technorati did eventually get back to me. I followed up, but got no response. I'll follow up again today. Maybe persistence will win out.

Thanks for the kick.

Freedom · Post by **Freedom** » Sun Aug 20, 2006 3:49 pm

Hello,
Does anyone know of a list of possible plugins that Technorati is having a problem with?

I didn't have a problem with their bot crawling my site for the first 6 months than all of a sudden it stopped. It's been 60 days since it updated.

Now I probably did add a plugin that is causing the problem but I'll be damned if I can find which one it is.

I also upgraded to v.1.0 if anyone has had a problem with the upgrade.

Any help would be greatly appreciated.

Freedom

http://www.freedomforsome.com/weblog/

gotchi · Post by **gotchi** » Sun Aug 20, 2006 6:09 pm

hello

i have installed the newest version and the same problems. no successful ping since 33 days.

i added the javascript code to my blog into a html nugget and my blog was found by the wizzard but there were now new posts claimed.

i also tried to deactivate the feedburner force option - reinitialize or ping - same then before.

also trying to write new posts viea S9Y or ecto with the notification service makes no difference - no update.

since some days I also add technorati tags to my posts - no chance.
so were is the problem, is it by s9y or technorati. is it a plugin or something else.

can I help with some infos?

blog: http://blog.gotchi.at
technorati site: http://www.technorati.com/blogs/http://blog.gotchi.at

installed plugins:
Ereignis Plugins
Textformatierung: Serendipity
Textformatierung: Smilies
Textformatierung: NL2BR
Browser-Kompatibilität
Spamschutz
Übliche XHTML-Fehler beseitigen
HTML Validator
Einträge ankündigen
Regeln für Veröffentlichungen
Spartacus
Statistiken
Spamschutz (SURBL)
Kategorien zuweisen
Gravatar / Favatar
Lightbox/Thickbox JS
Google Sitemap Generator
Live-Preview of Comments
Searches comments on quicksearch

hynek · Post by **hynek** » Sun Aug 20, 2006 7:40 pm

Started to work here today or yesterday. Updated all plugins today and looked to Technorati and it was correctly indexed..I think that it's a coincidence.

Judebert? Are you to praise?

Trouble getting Technorati to craw and update your blog?

Trouble getting Technorati to craw and update your blog?

Re: Trouble getting Technorati to craw and update your blog?

Technorati doesn't like me...