I have been using Pegasus Mail since the 1990s. I occasionally have had the odd issue, but I am now suffering an issue which may lead me to have to consider an alternative.

The issue is a frequent loss of the Mail Directory Structure, whereby Filing Trays are deleted, and message folders and many messages are dumped into the root of the structure, and some messages appear to be lost.

I am running V4.8, not having become aware of 4.91 although I do check quite regularly.

Is there any advice on offer,
A. To best correct this situation, and
B. To recover missing messages?

In hope,

Kenneth A. Spencer

The Folder list tray structure is a virtual structure whose records are stored in a file named HIERARCH.PM. When HIERARCH.PM gets corrupted, a new one is created by polling each folder file in the mailbox directory. Unfortunately, the mailbox files do maintain a record of any parent Tray they might have been in. The recovery method is to restore HIERARCH.PM from a recent backup. This may not work if the backup is too old. Do the restoration with Pegasus Mail closed.

A corrupted HIERARCH.PM will not result in any missing messages. The resulting rebuild can result in duplicate named folders not being displayed in the Folder list. If that is not it, post back with more specifics about the missing messages.

Best practices to prevent issues with HIERARCH.PM corruption included:

• Exclude the mailbox directory from active scanning by an anti-virus/anti-malware product.
• Never run two instances of Pegasus Mail that access the same mailbox.
• Backup regularly
• Use unique folder names. I practice I followed and encouraged all of my users to follow was to prefix the name of every nested folder with something the identified its parent Tray (eg: Tray name: "Accounting", Subfolder names prefixed with "Acc-"). This way, if an event resulted in being unable to restore HIERARCH.PM, then the folders would be sorted in the Folder list in a way that would group them by the parent Tray they had been in. Also, it helps minimize duplicate folder names.

Note: An abend during shutdown or an abrupt shutdown due to a power outage are unavoidable events that might result in a corrupted HIERARCH.PM.

Thank you Brian, for replying to my email.

First, some anwers to your implied questions:

1. I do a complete backup each night at 2:30am. This includes some 150GB of my most frequently changing data. Other material is backed up monthly (several TB).Copies of the most recent three backups are retained.

2. On this occasion there was no sudden crash or disconnection. I always allow adequate time for LAN activity after a logout to quieten before turning off a workstation.

3. I have a backup power supply unit on my servers and the principal workstation.

4. I think that I have recovered quite a lot by copying in my sub-directory from the backup 3 days ago, after forwarding to myself most (possibly not quite all) activity that occurred in the 3 days since the backup I used. I have collected those forwardings as replacements for most of the new data.

There is still some data missing, but I can't seem to find that, although very detailed searching is tedious and so I am tempted to leave it at that.

Thanks for your help.

What kind of data is missing?

I'm curious about exactly what you did. I assume a backup of your mail directory that would capture HIERARCH.PM is not included in your 2:30am backup so it sounds like you are restoring from the last monthly backup. If you made a copy(backup) of the mailbox directory before the restore then a sort by date comparison should identify the files that are newer than what is in the backup. Data files are .PMM, .PMI, and .CNM. The .PMM/.PMI file pair make up a folder, .CNM are new mail messages.

Thanks again, Brian, and I'll try to answer the questions:

1. The nightly backup is of the entire pmail directory, so it includes all users and their entire user data, so HIERARCH.PMs are included.

2. I have on occasion been able to restore the directory structure by copying in the backed-up HIERARCHY.PM when it has been unexpectedly lost, but on this occasion that did not work. Reverting to the backup from three days earlier more-or-less worked, but did not quite restore all data. The most important data lost was a single mail folder containing perhaps 100+ messages, but it seems to have disappeared completely.

3. Your information identifying the file extensions and their significance is helpful, and I shall keep it so as to help should I suffer any more incidents, so thanks for that.

If I may, one more question: is there a most frequent cause of this kind of failure (i.e. loss of directory structure) that I should be aware of? I do know that sudden disconnection or shutdown is significant, but anything else would be useful - I always watch for LAN activity to subside after closing Pegasus before shutting down a machine. Do you find that those who keep the data files on a workstation suffer fewer loss incidents than those who use a network server for data storage?

I shall fairly soon update to the latest version of PMAIL.

Many thanks for your attention,

Kenneth

Kenneth A. Spencer

There are no known issues with Pegasus Mail deleting folder files but disappearance from the Folder list due to a duplicate folder name is something I have seen numerous times. A tool that can help with analyzing what might be going on is called PegFolders. It will examine the folder files in the directory from which it is run and produce a report showing details the include folder name and filename. Running this on the current mailbox and then on a backup might reveal something.
PegFolder is available in the Add-on for Pegasus Mail category on this site.

If you found that helpful, you may find Hans' Guide to Filenames and Extensions even more so. https://www.vandenbogaerde.net/pegasusmail/pf_pmfiles.html

The issue is associated with a failure in the process of updating the HIERARCH.PM file during Pegasus Mail shutdown. An abend during shutdown can do it as can interference from an anti-virus/anti-malware product. The later is why excluding the mailbox directories from active scanning is encouraged.

Thanks again for the reply Brian.

I think we've gone as far as I need, except for one final question:
Since I started using the backup copy of my pmail directory, I have noted that I am no longer asked for a password (i.e. the directory username) at logon to Pegasus mail. Is there anyway in which I can persuade the system start asking me for the password at startup, once more?

Many thanks.

Kenneth

Kenneth A. Spencer

This is how that works...
In a single-user installation you will not be prompted for the username on startup.
In a multi-use installation, you will always be prompted for the username on startup unless you instruct Pegasus Mail to startup as a specific user. The is done by using the -I command line parameter in the shortcut.

Pegasus Mail determines whether the installation is single or multi-user by looking for a PMAIL.USR file in the root mailbox directory. If none exists then it assumes single-user.

So, if you are not using the -I parameter in the command line then you probably don't have a PMAIL.USR file in the root mailbox directory. If you do, go to the Help menu item in Pegasus Mail and click its "About Pegasus Mail..." option. Click the Info... button in the resulting display. This will produce an information report showing details about your Pegasus Mail installation. Find the following four entries and post back with their values. You can select content and then Ctrl+C (or right-click > Copy) to copy directly from that information window.
User name and ID:
Home mailbox location:
New mailbox location:
Commandline:

Thanks for the hint! actually I was looking for the reason, why I cant connet to my mailbox with the new version 4.9 on my PC running Windows 11 next to Linux, but I also have coruppte directory and will try to fix it by editing HIERARCH.PM
I found some line wit the remark "unavailable, which I deleted, but it didn't fix the Problem yet.
The only reason, I still use Windows as a second sytem ist Pegasus Mail - which I use since I have my first e-mail account arround 1995

warm regars
Mike

@MikeW9 , a problem in HIERARCH.PM only affects that way Pegasus Mail folders are listed in its Folder list. Your words "cant connet to my mailbox" indicate something different. Please don't hesitate to start a new discussion describing your problem. We're here to help if we can.

Thanks, Brian,

That explained it - I should have realised, because at the moment on my workstation there is only one user file in the pmail directory.

Therefore, as far as I'm concerned this topic can now be closed - I'm sure it's taken up too much of your time!

Best wsihes,

Kenneth

Kenneth A. Spencer

Thanks for the help.
I have 2 Problems with Pmail.
On the present notebook I use V4,7 on Windows 10.
And some directories are korrupted, since Windows started "deep scan" (or some other Windows Program) and after 15h or so it hadn't finished so I switched the PC at 2 am off.
I had a look at look at the HIERARCH.PM file an found some lines that said: "name unavailable" like that;

0,0,"0EBFA0C9:72AF:CAPPEL","0F79591:My mailbox",Name_Unavailable
1,3,"32766842V","755E603olar","PV"
0,0,"2181F8B:5547:FOL0403C","32766842V","S-PV-Kunden"
0,0,"200A204F:1B98:FOL03D1C","755E598:Neuemail",Name_Unavailable
0,0,"053339F7:0F3B:FOL0756D","0F79591:My mailbox",Name_Unavailable
0,0,"5140669D:0E5E:FOL047FA","0F79591:My mailbox",Name_Unavailable
0,0,"JG5KB145:4FF1:FOL008B9","755E598:Neuemail",Name_Unavailable
0,0,"M7SLK5JM:7536:FOL02383","755E594:Computer","C-E-bay"
0,0,"JUJCBC46:0540:FOL01D04","0F79591:My mailbox",Name_Unavailable

and some at the End that look like that:

0,0,"v1­HB£®±ßÞÚd\(eoIx¢>3´6BS%ÌØ0F79591:My mailbox","0F79591:My mailbox","$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌ"

I can still use Pmail, as long as I don't try to erase the later ones.
I should also mention, that I have many mails in my folders, - maybe about 3000 as I needed some very ols mails as proof in a court case.

I hoped I could start Pmail 4.9 anew on a new notebook using Windows 11, but ran into a problem connecting to my mail server.
I compared all settings with the ones of V4.7 on the old one, but found no reason, why it would'nt connect.
Thunderbird works OK.

Another issue:
I often use "free" software, but as soon I find it valuable for me and use it a lot, I'm willing to pay for which mostly works via donations. How can I do this with You guys? Your work is very precious to me and I realy are impressed, that there is even free support!
Warm regards
Mike from Germany
I compared all

Those entries are benign. The will occur upon disconnection of a mailbox or directory added to the Folder list as an added mailbox, and will occur if a folder file .PMM) is deleted using a file explorer.

I have never seen anything like this so don't have any thoughts on how or why.
If you do not use Trays in your folder structure then rebuilding HIERARCH.PM is the way to go about fixing it. To do this, close Pegasus Mail, rename HIERARCH.PM to something like HIERARCH_PM.bad, start Pegasus Mail. On startup, a new HIERARCH.PM file will be created and all folder files will be polled for the information needed to populate it. Rebuilding HIERARCH.PM will result in all Tray structure being lost so this may be an option when a Tray structure is easy to recreate but is only a last resort move when there is an extensive Tray structure.

There is no know reason why 4.91 will not connect to a mail server that 4.7 can connect to so I suggest starting a new discussion on this so that it is not on the end of a discussion about directory structure. Provide as much detail as you can (Does "mail server" mean email host? If so, connection type (POP3?, IMAP?, SMTP?).

There is a donation link on the main Pegasus Mail and Mercury website: www.pmail.com

Thanks for the answer.
Will it help if I send screenshots?

About donation - I don't want Paypal to either earn money, nor have my data - Thiel and others are trieing to do as mush damage as possible to Europa and democracy, so why should I support them?
You don't have Klarna or any others. We use also remitly etc. for sending money abroad.
I will also try Visa.
Is there any way, I can add files here, or will I have to do this ansering Your e-mail?

@MikeW9 , start a new discussion please.

In it you can add screenshots and upload files using this toolbar icon.