Community Discussions and Support
Please explain why some emails display unwanted characters?

[quote user="Thomas R. Stephenson"]... use UTF-8 all the time and it will be able to handle your mixing of plain text and high bit characters.[/quote]

I changed Pegasus advanced settings to UTF-8 charset and forwarded the offending document to myself. The subject line still contained –. Then I noticed that the dash in the original email (in Pegasus) was longer than usual so I replaced it with a normal -. Now the dash displays correctly. As you say, I must have pasted the original from Word.

 Thanks, Stan Hilliard
 

<p>[quote user="Thomas R. Stephenson"]... use UTF-8 all the time and it will be able to handle your mixing of plain text and high bit characters.[/quote]</p><p>I changed Pegasus advanced settings to UTF-8 charset and forwarded the offending document to myself. The subject line still contained <font color="black" face="Verdana, Arial, Helvetica, sans-serif" size="-2"><b>–</b>. </font>Then I noticed that the dash in the original email (in Pegasus) was longer than usual so I replaced it with a normal -. Now the dash displays correctly. As you say, I must have pasted the original from Word.</p><p> Thanks, Stan Hilliard  </p>

I send email with Pegasus through a Comcast SMTP. I receive emails on the POP3 of the Internet provider of my website. I download them with Pegasus  or view the email subject lines on the provider's server with Firefox browser.

I sent an email to myself with a "-" (minus sign) in the title. When I read the email subject lines on my provider's server using Firefox. The "-" appears as "–". I downloaded the email with Pegasus to the newmail folder and character is back to being displayed as "-".

This may seem like a trivial issue, but in other areas I have more serious problems with unwanted character representations.

 My OS is Windows XP Pro. What is the explanation for this?
 

Sincerely, Stan Hilliard
 

<p>I send email with Pegasus through a Comcast SMTP. I receive emails on the POP3 of the Internet provider of my website. I download them with Pegasus  or view the email subject lines on the provider's server with Firefox browser. </p><p>I sent an email to myself with a "-" (minus sign) in the title. When I read the email subject lines on my provider's server using Firefox. The "-" appears as "–". I downloaded the email with Pegasus to the newmail folder and character is back to being displayed as "-".</p><p>This may seem like a trivial issue, but in other areas I have more serious problems with unwanted character representations. </p><p> My OS is Windows XP Pro. What is the explanation for this?  </p><p>Sincerely, Stan Hilliard  </p>

More Information:

I have determined that this is an intermittent problem. It occurred Sunday and Monday but I could not repeat it today (Tuesday). However, Sunday's example is still on my provider's server and still displays the –. When I view the subject line on the server with Firefox I still see the – but when I view it in the Pegasus "Selective Mail Download" window the character shows as a vertical bar.

I think this issue widespread. I did a Google search on – and got 141,000,000 hits.

Even though I cannot repeat the problem now, I would still like to know some hypotheses about the cause. It has happened before (unrelated to Pegasus) and has gotten into the text of messages on a phpBB forum that I administer. I expect it will happen again.
Stan Hilliard
 

<p>More Information:</p><p>I have determined that this is an intermittent problem. It occurred Sunday and Monday but I could not repeat it today (Tuesday). However, Sunday's example is still on my provider's server and still displays the –. When I view the subject line on the server with Firefox I still see the – but when I view it in the Pegasus "Selective Mail Download" window the character shows as a vertical bar. I think this issue widespread. I did a Google search on – and got 141,000,000 hits. Even though I cannot repeat the problem now, I would still like to know some hypotheses about the cause. It has happened before (unrelated to Pegasus) and has gotten into the text of messages on a phpBB forum that I administer. I expect it will happen again. Stan Hilliard  </p>

This is the sender's problem. They have specified the charset ISO-8859-1 when they should have coded the charset CP1252. This is very commonly seen in email messages sent from MS Outlook where the extended characters are used (commonly the bullet character or hyphen).

Martin

<p>This is the sender's problem. They have specified the charset ISO-8859-1 when they should have coded the charset CP1252. This is very commonly seen in email messages sent from MS Outlook where the extended characters are used (commonly the bullet character or hyphen).</p><p>Martin </p>

[quote user="irelam"]This is the sender's problem. ...[/quote]

I am the sender, and used Pegasus. I noticed the problem in a copy that I emailed to myself. Below is the header code from my "copy to self" folder. It shows the specified charset as ISO-8859-1.
(I modified the email addresses.)

X-cs: R
X-CS-Version: 1.0
From: Stan Hilliard <x@samplingplans.com>
X-RS-ID: ToPerson
X-RS-Flags: 1,1,1,1,0,0,0
X-RS-Header: In-reply-to: <001301c8ed30$8f3be760$f900a8c0@OWNERPF68LBC21>
X-RS-Header: References: <001301c8ed30$8f3be760$f900a8c0@OWNERPF68LBC21>
X-RS-Sigset: 1
To: "Becky x" <x@comcast.net>
Subject: =?UTF-8?Q?For_Peoples_Church_Newsletter_=E2=80=93_September_2008?=
Cc: "x" <x@ix.netcom.com>, "x" <x@comcast.net >,
 "x" <x@pressenter.com>, "x" <x@peoplescongregational.org>,
 me@samplingplans.com
Comments: Confirmation of reading was requested.
Comments: Confirmation of delivery was requested.
MIME-Version: 1.0
Content-type: text/html; charset=ISO-8859-1
Content-transfer-encoding: 8BIT
Date: Sun, 17 Aug 2008 15:47:49 -0500

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
          "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html  xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"><head>
<title></title>
<meta http-equiv="content-type" content="text/html;charset=utf-8"/>
<meta http-equiv="Content-Style-Type" content="text/css"/>
</head>
<body>
<div align="left">
<font face="Arial" size="2">
<span style=" font-size:10pt">
Hi Becky,</span></font>
 

I don't think I ever messed with the charset. I don't know how. Could it be that Comcast's SMTP or my provider's POP3 changes the header?

Notice, as I said previously, that this effect is not always repeatable. I sent test-messages to myself today and the conversion did not occur.

Stan Hilliard 

&lt;p&gt;[quote user=&quot;irelam&quot;]This is the sender&#039;s problem. ...[/quote]&lt;/p&gt;&lt;p&gt;I am the sender, and used Pegasus. I noticed the problem in a copy that I emailed to myself. Below is the header code from my &quot;copy to self&quot; folder. It shows the specified charset as ISO-8859-1. (I modified the email addresses.)&lt;/p&gt;&lt;p&gt;X-cs: R X-CS-Version: 1.0 From: Stan Hilliard &amp;lt;x@samplingplans.com&amp;gt; X-RS-ID: ToPerson X-RS-Flags: 1,1,1,1,0,0,0 X-RS-Header: In-reply-to: &amp;lt;001301c8ed30$8f3be760$f900a8c0@OWNERPF68LBC21&amp;gt; X-RS-Header: References: &amp;lt;001301c8ed30$8f3be760$f900a8c0@OWNERPF68LBC21&amp;gt; X-RS-Sigset: 1 To: &quot;Becky x&quot; &amp;lt;x@comcast.net&amp;gt; Subject: =?UTF-8?Q?For_Peoples_Church_Newsletter_=E2=80=93_September_2008?= Cc: &quot;x&quot; &amp;lt;x@ix.netcom.com&amp;gt;, &quot;x&quot; &amp;lt;x@comcast.net &amp;gt;, &amp;nbsp;&quot;x&quot; &amp;lt;x@pressenter.com&amp;gt;, &quot;x&quot; &amp;lt;x@peoplescongregational.org&amp;gt;, &amp;nbsp;me@samplingplans.com Comments: Confirmation of reading was requested. Comments: Confirmation of delivery was requested. MIME-Version: 1.0 Content-type: text/html; charset=ISO-8859-1 Content-transfer-encoding: 8BIT Date: Sun, 17 Aug 2008 15:47:49 -0500 &amp;lt;!DOCTYPE html PUBLIC &quot;-//W3C//DTD XHTML 1.0 Transitional//EN&quot; &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; &quot;http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd&quot;&amp;gt; &amp;lt;html&amp;nbsp; xmlns=&quot;http://www.w3.org/1999/xhtml&quot; xml:lang=&quot;en&quot; lang=&quot;en&quot;&amp;gt;&amp;lt;head&amp;gt; &amp;lt;title&amp;gt;&amp;lt;/title&amp;gt; &amp;lt;meta http-equiv=&quot;content-type&quot; content=&quot;text/html;charset=utf-8&quot;/&amp;gt; &amp;lt;meta http-equiv=&quot;Content-Style-Type&quot; content=&quot;text/css&quot;/&amp;gt; &amp;lt;/head&amp;gt; &amp;lt;body&amp;gt; &amp;lt;div align=&quot;left&quot;&amp;gt; &amp;lt;font face=&quot;Arial&quot; size=&quot;2&quot;&amp;gt; &amp;lt;span style=&quot; font-size:10pt&quot;&amp;gt; Hi Becky,&amp;lt;/span&amp;gt;&amp;lt;/font&amp;gt; &amp;nbsp;&lt;/p&gt;&lt;p&gt;I don&#039;t think I ever messed with the charset. I don&#039;t know how. Could it be that Comcast&#039;s SMTP or my provider&#039;s POP3 changes the header? &lt;/p&gt;&lt;p&gt;Notice, as I said previously, that this effect is not always repeatable. I sent test-messages to myself today and the conversion did not occur. Stan Hilliard&amp;nbsp;&lt;/p&gt;

Please check the value of the Mime charset in menu Tools/Options/Advanced settings  It should be Utf-8 or Windows-1252 See web Url:

http://en.wikipedia.org/wiki/Windows-1252 for 1252 definition. Note that 8-Bit coding is invalid with ISO-8859-1 charset.  The character you are seeing is likely xA6 or xC6   The ISO-8859-1 definition is shown at http://en.wikipedia.org/wiki/Iso-8859-1

 HTH

 Martin

&lt;p&gt;Please check the value of the Mime charset in menu Tools/Options/Advanced settings&amp;nbsp; It should be Utf-8 or Windows-1252 See web Url:&lt;/p&gt;&lt;p&gt;http://en.wikipedia.org/wiki/Windows-1252 for 1252 definition. Note that 8-Bit coding is invalid with ISO-8859-1 charset.&amp;nbsp; The character you are seeing is likely xA6 or xC6&amp;nbsp;&amp;nbsp; The ISO-8859-1 definition is shown at http://en.wikipedia.org/wiki/Iso-8859-1&lt;/p&gt;&lt;p&gt;&amp;nbsp;HTH&lt;/p&gt;&lt;p&gt;&amp;nbsp;Martin &lt;/p&gt;

[quote user="irelam"]Please check the value of the Mime charset in menu Tools/Options/Advanced settings  It should be Utf-8 or Windows-1252[/quote]

The setting is ISO-8859-1. This confuses me because the header code that I pasted above refers to both ISO-8859-1 and utf-8:

Content-type: text/html; charset=ISO-8859-1
Content-transfer-encoding: 8BIT

and

<meta http-equiv="content-type" content="text/html;charset=utf-8"/>

Q1: Why do I see both charsets referred to in the heading? 

Q2: How  should I decide whether to select Windows-1252 or UTF-8 in Tools/Options/Advanced settings?

Q3: Am I right that UTF-8 files are twice as large but can represent more different kinds of characters?

A - The three day old email on serve lists the subject with the – . But on the server if I open that email in a Firefox tab the - (dash) in the subject-line of the email displays as a dash.
B - I forwarded that same email from my "copy to myself" folder to myself. This time the – shows up in both the server's email list and the opened email.
C - I sent a test email to myself with the title "test - test". The dash displayed as a dash on the server.

Q4: Comparing A,B, & C, what might explains that apparent instability?

Stan Hilliard

[quote user=&quot;irelam&quot;]Please check the value of the Mime charset in menu Tools/Options/Advanced settings&amp;nbsp; It should be Utf-8 or Windows-1252[/quote]&lt;p&gt;The setting is ISO-8859-1. This confuses me because the header code that I pasted above refers to both ISO-8859-1 and utf-8:&lt;/p&gt;&lt;p&gt;Content-type: text/html; charset=ISO-8859-1 Content-transfer-encoding: 8BIT&lt;/p&gt;&lt;p&gt;and&lt;/p&gt;&lt;p&gt;&amp;lt;meta http-equiv=&quot;content-type&quot; content=&quot;text/html;charset=utf-8&quot;/&amp;gt; &lt;/p&gt;&lt;p&gt;Q1: Why do I see both charsets referred to in the heading?&amp;nbsp;&lt;/p&gt;&lt;p&gt;Q2: How&amp;nbsp; should I decide whether to select Windows-1252 or UTF-8 in Tools/Options/Advanced settings?&lt;/p&gt;&lt;p&gt;Q3: Am I right that UTF-8 files are twice as large but can represent more different kinds of characters?&lt;/p&gt;&lt;p&gt;A - The three day old email on serve lists the subject with the &acirc;&euro;&ldquo; . But on the server if I open that email in a Firefox tab the - (dash) in the subject-line of the email displays as a dash. B - I forwarded that same email from my &quot;copy to myself&quot; folder to myself. This time the &acirc;&euro;&ldquo; shows up in both the server&#039;s email list and the opened email. C - I sent a test email to myself with the title &quot;test - test&quot;. The dash displayed as a dash on the server. &lt;/p&gt;&lt;p&gt;Q4: Comparing A,B, &amp;amp; C, what might explains that apparent instability?&lt;/p&gt;&lt;p&gt;Stan Hilliard&lt;/p&gt;

Q1: Why do I see both charsets referred to in the heading?
You are using both in the message.  You are using high bit characters that are being converted. You probably did a bit of cut and paste for this.  

Q2: How  should I decide whether to select Windows-1252 or UTF-8 in Tools/Options/Advanced settings?

Not necessary, use UTF-8 all the time and it will be able to handle your mixing of plain text and high bit characters.

Q3: Am I right that UTF-8 files are twice as large but can represent more different kinds of characters?

They are not twice as large but the UTF-8 can handle all sorts of characters.   The only problem would be is if you ran into older mail clients that could not handle UTF-8.  If you want to continue using ISO-8859-1 use the "Paste special" to ensure that you are always pasting characters that are valid in this character set by pasting "Text only, without styles and pictures"

 

&lt;blockquote&gt;Q1: Why do I see both charsets referred to in the heading? &lt;/blockquote&gt;You are using both in the message.&amp;nbsp; You are using high bit characters that are being converted. You probably did a bit of cut and paste for this. &amp;nbsp; &lt;blockquote&gt;Q2: How&amp;nbsp; should I decide whether to select Windows-1252 or UTF-8 in Tools/Options/Advanced settings?&lt;/blockquote&gt;&lt;p&gt;Not necessary, use UTF-8 all the time and it will be able to handle your mixing of plain text and high bit characters.&lt;/p&gt;&lt;blockquote&gt;Q3: Am I right that UTF-8 files are twice as large but can represent more different kinds of characters?&lt;/blockquote&gt;&lt;p&gt;They are not twice as large but the UTF-8 can handle all sorts of characters.&amp;nbsp;&amp;nbsp; The only problem would be is if you ran into older mail clients that could not handle UTF-8.&amp;nbsp; If you want to continue using ISO-8859-1 use the &quot;Paste special&quot; to ensure that you are always pasting characters that are valid in this character set by pasting &quot;Text only, without styles and pictures&quot;&lt;/p&gt;&lt;p&gt;&amp;nbsp;&lt;/p&gt;
live preview
enter atleast 10 characters
WARNING: You mentioned %MENTIONS%, but they cannot see this message and will not be notified
Saving...
Saved
With selected deselect posts show selected posts
All posts under this topic will be deleted ?
Cancel
Delete
Pending draft ... Click to resume editing
Discard draft