RSS aggregator questions

RJH · Post by **RJH** » Tue Feb 12, 2008 4:06 am

I am using the RSS aggregator plugin and am having some odd problems. It will often post duplicates, sometimes as many as 5 copies, of each article.

Plus, about half of all articles in the RSS feeds end up as "drafts" rather than "published". So far I have had to manually publish the "drafts" as well as deleting the duplicates.

I am using ver 1.2.1 Serendipity and ver 1.2 Bulletproof.

Any suggestions?

Post by **garvinhicking** » Tue Feb 12, 2008 10:03 am

Hi!

How have you configured the RSS aggregator plugin? Did you turn on the debugging log so that you will see the output why a new article is saved again instead of looked up? Often this already tells you why articles are re-imported time and again.

Which feeds misbehave? Often it is a problem on their end because their permalinks, publish dates or uids change.

Articles can ONLY be saved as draft if you change them in your database or through the backend. The aggregator ONLY saves them as publish. It has NO CODE to store an article as draft. So your problem must stem from a user account problem, not the aggregagor plugin. Like if you import articles when your s9y user account has no publish privileges, the saving of an entry will be restricted to the privileges the executing user has.

Regards,
Garvin

RJH · Post by **RJH** » Tue Feb 12, 2008 3:16 pm

Ok, I will enable debugging to see what it says. I had considered it as a possible permissions issue but at times there will be several copies of the same article and some will publish and some will be drafts. Last nite as I was writing the post above it was especially bad about saving almost all articles as drafts. But this morning there was only a couple. I will post what the log says as soon as I have some info. Thanks for the info.

RJH · Post by **RJH** » Tue Feb 12, 2008 9:14 pm

Another quirky thing is that it often cuts the article short after justa few lines and ends it with several periods like this "..." But other times it will post paragraph after paragraph. You can see it here:

http://www.thatpoliticalblog.com/refeeds

Also, where is the debug log accesssed?

(Please dont tell me it is a SQL query)

RJH · Post by **RJH** » Wed Feb 13, 2008 3:08 am

This is a screenshot of the admin console showing the mix of drafts and published entries from the RSS aggregator plugin.

http://www.thatpoliticalblog.com/refeed ... issues.jpg

And thats about average. Maybe a few less duplicate posts than normal.

One thing I did find is that the articles that are cut off seem to be due to something in the feed itself as it is fairly consistent for all articles in any given feed.

Also when I manually update the feed it posts what I suspect is the debug log on the page it loads? Ill PM a link to it if you want to see it.

Post by **garvinhicking** » Wed Feb 13, 2008 10:56 am

Hi!

The logfile is produced when you open the URL with which you execute the aggegator (i.e. that index.php?/plugin/aggregator thingie, the URL you define in the configuration of the plugin).

The aggregator only fetches what's in the RSS feeds. If the RSS feeds you import do not contain more than one paragraph, the aggregator cannot import more. So you must complain at the RSS feeds creator.

As for the drafts, you really need to check your author privileges. The aggregator plugin does not cause this.

Regards,
Garvin

RJH · Post by **RJH** » Wed Feb 13, 2008 6:20 pm

The plugin posts the article using the name of the feed as the authors name. There are no author accounts by those names. Besides some post and some are drafts. I dont see how this can be a permissions issue.

Post by **garvinhicking** » Wed Feb 13, 2008 6:30 pm

Hi!

But it must be, because the aggregator itself ONLY ALWAYS saves entries as publish, NEVER as draft.

Whatever the reasons for your draft state - they are NOT CAUSED by the aggregator, but by something else. Either permission issues or maybe a plugin like "Outdate entries", that depends on your event list.

Regards,
Garvin

RJH · Post by **RJH** » Thu Feb 14, 2008 1:55 am

Thank you very much for the information. I will keep working on this.

RJH · Post by **RJH** » Sat Feb 23, 2008 6:40 pm

It got to the point that over 90% of the articles from the RSS feeds were saved as "Drafts" rather than "Published". I was ready to shut down the site as it was just too time consuming to manually publish all of the articles.

In the plugin configuration I selected "MagpieRSS [GPL]" rather than "Onyx [BSD]" (which is the default) and it saves all articles as "published" rather than as "drafts" correctly now.

Do you still think it is some authors permission issue? I tried giving the author accounts all levels of access right up to administrator and it didn't change a thing.

RJH · Post by **RJH** » Sun Feb 24, 2008 5:59 pm

I enabled the debug log and get these error messages repeatedly.

"Warning: Invalid argument supplied for foreach() in /home/content/d/a/r/darkhalo/html/refeeds/plugins/serendipity_event_aggregator/serendipity_event_aggregator.php on line 1119"

"Warning: MagpieRSS: Failed to parse RSS file. (mismatched tag at line 335, column 3) in /home/content/d/a/r/darkhalo/html/refeeds/plugins/serendipity_event_aggregator/magpierss/rss_fetch.inc on line 238"

Post by **garvinhicking** » Mon Feb 25, 2008 12:23 pm

Hi!

I cannot confirm that switching Onyx / Magpie changes anything regarding the 'draft' state.

Which other event plugins are you using? Maybe the plugin to "outdate entries", this one sets old entries to draft state.

This cannot possibly be caused by an original, unmodified aggregator plugin (version 0.19). There is only one code line that sets the "draft" state of an entry, and it's fixed to "false". No other code influences this array key within that plugin.

As for your errors in the output log, those are caused by a malformed RSS feed. Inside the log you should see the URL of that malformed feed, when its URL is opened. You need to either unsubscribe frmo that feed or tell the author of that feed that it is malformed.

Regards,
Garvin

RJH · Post by **RJH** » Wed Feb 27, 2008 2:54 am

I am using these plugins...

Sidebar plugins:
statistics
categories
calendar
archives
blog administration login
4 html nuggets in the sidebar

Event plugins:
extended properties for entries
site map generator
announce entries
spam protector
spartacus
RSS aggregator
contact form
extended options for media manager
live search
related entries/links
cron job scheduler
backup interface (works only occasinally)
comics
statistics
links to next/previous entry

And they are in the above order as well. I ran it briefly in a completely different install of Serendipity and had the exact same problems.

Post by **garvinhicking** » Wed Feb 27, 2008 10:28 am

Hi!

Can you provide me with FTP and s9y login credentials to one of your blogs where the error occurs, so that I can debug that installation?

Regards,
Garvin

RJH · Post by **RJH** » Sun Mar 02, 2008 2:34 am

info has been PM'ed to you. Thanks for the assistance.

RSS aggregator questions

RSS aggregator questions

Re: RSS aggregator questions