Page 1 of 1

FreeTag - problem with "reparse automatted tags"

Posted: Wed Mar 04, 2009 9:26 pm
by Don Chambers
So I'm messing around with the keyword tags plugin because I wanted to get better utilization out of it. I wanted to use automated keywords, so that an entry, if it contains those words, gets certain tags assigned automagically. I had just never gotten around to it.

So I took one of my tags and added 3 automatic keywords. to it. Then I created a entry as a test using the one of the keywords, and sure enough, the proper tag was assigned as soon as I saved the entry. So far so good.

So the site had about 30-40 existing tags, but this one example was the only one that I supplied automated keywords for. I did a quicksearch and discovered that there were a total of 4 entries containing this same keyword. Rather than edit each entry, I see this option in the plugin that says "Reparse all automatted keywords".... so I'm thinking, "cool"... it will scan all entries for those automated keywords, assign the proper tag and save the entry.

I selected the option, and received a warning that all entries would, in fact, be scanned, but that it could also potentially cause problems... I'm thinking to myself that the problems could not be too bad, afterall, I had only supplied 3 automatic keywords to a single tag..... boy was I wrong about that!!!!

First, it tagged many more entries than what actually had the keywords according to quicksearch... now maybe quicksearch didn't return the correct result in the first place, I didn't take much time to investigate because I quickly became aware of the next problem: ALL other tags except that automated one were deleted..gone, vanished!!!

Next, ALL entries lost ALL categorization!! This is especially problematic because I was using the multi-category plugin and many entries had been assigned to more than a single category. The categories still exist, but none of the entries were assigned to ANY category.

And for the icing on the cake, all values stored in custom extended property fields were deleted. Every single one. The template was using 5 custom property fields per entry, and although the field itself still seems to exist for every entry, the values are all blank. Gone... all of it. Wierd because the table that holds that info also holds the cached entry body and cached extended body.

I'd love to say that fortunately I had a backup and recovered quickly... unfortunately, the backup was either corrupt, or not created correctly in the first place... I didn't actually create the backup, so I cannot be sure of anything other than mysql would not import it.

So, the only choice now is to reconstruct all these entries, recategorize them, create new tags, and populate all the extended property fields.

Info: Version 3.0 of the freetag plugin

Plugin queue:
Tagging of Entries
Markup: nl2br
google analytics
browser compat.
spam protector
category assignment
forgot password
contact form
spartacus
static pages
another contact form
extended properties for entries.

Re: FreeTag - problem with "reparse automatted tags"

Posted: Thu Mar 05, 2009 9:52 am
by garvinhicking
Hi!

I think the problem could have been that the freetag plugin was the first in your queue.

The technique behind reparsing is quite brute force, it's like editing an entry and resaving it. In my tests, all categories etc. were kept, so I can't really tell what went wrong - it takes some while to set up a testcase scenario for this and debug it.

I'll see what I can do about that.

Did you use the caching option of the entryproperties plugin?

Regards,
Garvin

Re: FreeTag - problem with "reparse automatted tags"

Posted: Thu Mar 05, 2009 3:26 pm
by Don Chambers
I believe the caching option was turned on. My concern is that something this catastrophic is even possible with this plugin. The plugin does issue a warning about potential problems, but that warning was not sufficient to stop me. If plugin order and entry caching are critical, then somehow that should be addressed in the warning.

If I had a decent backup, which I do not, I would happily configure a sandbox to test just this one issue. If/when I find the time, maybe I can take a backup of some other site, then put that on a sandbox, and configure its plugins the same way, then try to crash it.

Until anything is determined, I would advise everyone not to even consider selecting the option to reparse automatted tags using the freetag plugin. It caused me one hell of a headache yesterday!

Re: FreeTag - problem with "reparse automatted tags"

Posted: Fri Mar 06, 2009 10:34 am
by garvinhicking
Hi!

It's hard for me to reproduce this; in a test I made yesterday (and when I initially developed the plugin) it all worked properly, so I can't reproduce your problem actually. If you can supply me with a FTP und SQL dump, I could try that with your actual installation.

Regards,
Garvin