Subject: Display of UTF-8

From: Ed Greshko <[email-masked]>
Date: 08 Oct 2003 09:05:28 +0800

Hi,

In my configuration my character set is defined at utf-8.

A message arrives marked as utf-8 with 8-bit C-T-E.

If I cat or use vi or use pico to view the folder/file containing the
message it will display properly on my screen.

However, it does not display correctly when viewed inline within pine.

Also, exporting the message results in a file that has the same
incorrect view in vi, pico, etc. as when viewing the message in pine.

What can be done to have the message displayed correctly and exported
correctly?

Thanks,

-- 
http://www.shorewall.net       Shorewall, for all your firewall needs
-- 
"An opinion is like an asshole - everybody has one."
    - Clint Eastwood as Harry Callahan, The Dead Pool - 1988.

-- 
-----------------------------------------------------------------
 For information about this mailing list, and its archives, see: 
 http://www.washington.edu/pine/pine-info/
-----------------------------------------------------------------

---

From: Bernhard Kaindl <[email-masked]>
Date: Wed, 8 Oct 2003 12:02:02 +0200

> message it will display properly on my screen.

Ok, your display is correctly configured for UTF-8 then.

> However, it does not display correctly when viewed inline within pine.

I went thru this a few months ago.

The reason for this is that the control char and escape sequence filter
in pine is not aware of UTF-8. Some legal UTF-8 byte sequences are treated
as Control sequences by this code.

> incorrect view in vi, pico, etc. as when viewing the message in pine.

Yes, pine export uses the same filter chain as view.

> What can be done to have the message displayed correctly and exported

Currently, there is no clean fix, you can only disable the
control char and escape sequcent filter completely by enabing

	pass-control-characters-as-is

in the pine configuration menu.

I hope some people will yell now, fix the the control char filter and
send the fix here.

More information is found at:
http://www.suse.de/~bk/pine/FAQ.html
http://www.math.washington.edu/~chappa/pine/info/utf8.html

There you can find some information on approaches to have pine convert
all mail which is not encoded in UTF-8 8-bit CTE to UTF-8 for correct
display. The patch there is an universal translation patch, not limited
to an UTF-8 configuration.

Bernhard

Software patents set sail:
http://www.infoworld.com/article/03/10/03/39OPcurve_1.html
http://wiki.ael.be/index.php/SwpatDirectiveQuestions

---

From: Ed Greshko <[email-masked]>
Date: 08 Oct 2003 19:46:03 +0800

> to an UTF-8 configuration.

Thanks for all the information.....  It is now working fairly well....

Ed