Little problem with russian utf-8 letters

Found a bug? Tell us!!
Post Reply
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Little problem with russian utf-8 letters

Post by Toronto »

Hello,
little problem: two letters 'ш' ('sh') and 'И' ('I') are showed as '??'.
I have tried edit this letters in serendipity_lang_ru.inc.php but it didnt help.
It is possible to fix it?
Thanks
judebert
Regular
Posts: 2478
Joined: Sat Oct 15, 2005 6:57 am
Location: Orlando, FL
Contact:

Post by judebert »

Languages are my weakest point, but I've been around long enough to know that someone will be asking you what your blog's encoding is, and what the database encoding is set to. And I remember they should match.

Are you using UTF-8 for the blog and the database?
Judebert
---
Website | Wishlist | PayPal
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

judebert wrote:Are you using UTF-8 for the blog and the database?
Yes, utf-8.
I have noticed this problem since my first meeting with s9y in 2006.
I thought this problem will be fixed, but it still alive,
so I've decided to write this topic.
garvinhicking
Core Developer
Posts: 30022
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking »

Hi!

Can you give us the URL to your blog and tell us where that wrong character shows up?

Best regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

garvinhicking wrote:Hi!

Can you give us the URL to your blog and tell us where that wrong character shows up?

Best regards,
Garvin
Hello,

My blog is a little adult(don't be strict), so I've just copy url direct to one post not to a whole blog.
http:// Deleted
Last edited by Toronto on Tue Feb 06, 2007 3:55 pm, edited 1 time in total.
garvinhicking
Core Developer
Posts: 30022
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking »

Hi!

Okay, I see the problem. Are you using the WYSIWYG editor to post s9y entries, or are you using plain text?

And which browser are you using to enter those entries?

One thing, that I don't know much off - the character you try to add, is it a character that exists in the UTF-8 charset?

Best regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

garvinhicking wrote:Hi!

Okay, I see the problem. Are you using the WYSIWYG editor to post s9y entries, or are you using plain text?

And which browser are you using to enter those entries?

One thing, that I don't know much off - the character you try to add, is it a character that exists in the UTF-8 charset?

Best regards,
Garvin
Hello,

-plaintext
-FF2, IE6
-Characters in the UTF-8 charset(I hope), I coudnt use this 2 letters since my first meeting with s9y, when I used SLES10(UTF-8) & MySQL(UTF-8)

P.S. Strange thing: Then look at the post in preview mode - all show fine, but then I save the post I get this problem
garvinhicking
Core Developer
Posts: 30022
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking »

Hi!

Hm, sigh. I had hoped you were using the WYSIWYG editor because that would easily be the reason.

Since you already tried two different browsers, it should also not be a browser issue.

So the only idea that's left is a database issue. When you do the preview, the data is read from the GET/POST data, but when you view a final entry it's fetched frmo the database.

If you set the "Use dbNames command" inside the s9y configuration panel to the oppositve value of what you have now, does that help?

If not, then the collation of the database table might need some change, but because I know next to nothing to russian characters it is impossible for me to debug it properly...I can'T even produce the character you seem to want to enter :(

Best regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

garvinhicking wrote: If you set the "Use dbNames command" inside the s9y configuration panel to the oppositve value of what you have now, does that help?
I have tried to use dbNames in s9y panel, but it didnt help
BTW, I have tried to edit this post in WYSIWYG-mode and 1 of this 2 letters shows fine...strange.
Thanks anyway!
garvinhicking
Core Developer
Posts: 30022
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking »

After you switched the dbNames setting you will need to create a new s9y posting, did you try that? Changing the db charsets will not change how already stored entries will be handled...
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

garvinhicking wrote:After you switched the dbNames setting you will need to create a new s9y posting, did you try that? Changing the db charsets will not change how already stored entries will be handled...
http:// Deleted
eh, the same situation..
Last edited by Toronto on Tue Feb 06, 2007 3:55 pm, edited 1 time in total.
garvinhicking
Core Developer
Posts: 30022
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking »

Hi!

Hm. Sigh. I'm at the end of knowledge to UTF-8 here. I don'T really understand how those characters you enter are different from the other ones.

Can it be the characters you try to enter are only part of UTF-16 and not of UTF-8?

Regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/
Toronto
Regular
Posts: 16
Joined: Sat Nov 11, 2006 11:48 pm

Post by Toronto »

garvinhicking wrote:Hi!
Can it be the characters you try to enter are only part of UTF-16 and not of UTF-8?
Regards,
Garvin
Hmm, I dont think that it might be UTF-16... It could be a bug of mysql5,imho.
Thanks for help anyway, garvinhicking!
I will continue make posts without this 2 letters, he he, until anybody find a solution to fix this discomfort.
xel-lj
Posts: 2
Joined: Sun Mar 11, 2007 10:39 pm

Post by xel-lj »

I have like problem too, and not understand: topic-starter solve it or no

I use Opera 9.02 and posting plain-text russian entries in UTF-8 codepage.

LiveJournal receive muar (like ÑÑÑÑ), but not for two letters - for all.
judebert
Regular
Posts: 2478
Joined: Sat Oct 15, 2005 6:57 am
Location: Orlando, FL
Contact:

Post by judebert »

The original poster's problem was not solved.

We know that the Serendipity encoding and the database encoding must be UTF-8. Entries made before changing the database to UTF-8 will not be updated; only new entries will be properly encoded.

LiveJournal may have other problems. I'm not familiar enough with it to help with it.
Judebert
---
Website | Wishlist | PayPal
Post Reply