PostqueueStore Objects¶

class pyqueue.store.PostqueueStore[source]¶

Postfix mails queue informations storage.

The PostqueueStore provides methods to load Postfix queued mails informations into Python structures. Thoses structures are based on Mail and MailHeaders classes which can be processed by a MailSelector instance.

The PostqueueStore class defines the following attributes:

mails¶

Loaded MailClass objects list().

loaded_at¶

datetime.datetime instance to store load date and time informations, useful for datas deprecation tracking. Updated on load() call with datetime.datetime.now() method.

postqueue_cmd¶

list() object to store Postfix command and arguments to view the mails queue content. Default is ["/usr/sbin/postqueue", "-p"].

spool_path¶

Postfix spool path string. Default is "/var/spool/postfix".

postqueue_mailstatus¶

Postfix known queued mail status list. Default is ['active', 'deferred', 'hold'].

mail_id_re¶

Python compiled regular expression object (re.RegexObject) provided by re.compile() method to match postfix IDs. Recognized IDs are hexadecimals, may be 10 to 12 chars length and followed with * or !. Default used regular expression is: r"^[A-F0-9]{10,12}[*!]?$".

mail_addr_re¶

Python compiled regular expression object (re.RegexObject) provided by re.compile() method to match email addresses. Default used regular expression is: r"^[A-Za-z0-9._%+-]+@[A-Za-z0-9.-]+\.[A-Za-z]+$"

MailClass¶

The class used to manipulate/parse mails individually. Default is Mail.

See also

Python modules:

datetime – Basic date and time types

re – Regular expression operations

Postfix manual:

postqueue – Postfix queue control

RFC 3696 – Checking and Transformation of Names

The PostqueueStore instance provides the following methods:

PostqueueStore.load([method])[source]¶

Load content from postfix mails queue.

Mails are loaded using postqueue command line tool or reading directly from spool. The optionnal argument, if present, is a method string and specifies the method used to gather mails informations. By default, method is set to "postqueue" and the standard Postfix queue control tool: postqueue is used.

Parameters:	method (str) – Method used to load mails from Postfix queue

Provided method str() name is directly used with getattr() to find a self._load_from_<method> method.

PostqueueStore._load_from_postqueue()[source]¶

Load content from postfix queue using postqueue command output.

Output lines from _get_postqueue_output are parsed to build Mail objects. Sample Postfix queue control tool (postqueue) output:

C0004979687     4769 Tue Apr 29 06:35:05  sender@domain.com
(error message from mx.remote1.org with parenthesis)
                                         first.rcpt@remote1.org
(error message from mx.remote2.org with parenthesis)
                                         second.rcpt@remote2.org
                                         third.rcpt@remote2.org

Parsing rules are pretty simple:

• Line starts with a valid Mail.qid: create new Mail object with qid, size, date and sender informations from line.

  Queue ID	Size	Reception date and time				Sender
  C0004979687	4769	Tue	Apr	29	06:35:05	user@domain.com

• Line starts with a parenthesis: store error messages to last created Mail object’s errors attribute.

• Any other matches: add new recipient to the recipients attribute of the last created Mail object.

Optionnal argument filename can be set with a file containing output of the postqueue command. In this case, output lines of postqueue command are directly read from filename and parsed, the postqueue command is never used.

PostqueueStore._load_from_spool()[source]¶

Load content from postfix queue using files from spool.

Mails are loaded using the command defined in postqueue_cmd attribute. Some informations may be missing using the _load_from_spool() method, including at least Mail.status field.

Loaded mails are stored as Mail objects in mails attribute.

Warning

Be aware that parsing mails on disk is slow and can lead to high load usage on system with large mails queue.

PostqueueStore._get_postqueue_output()[source]¶

Get Postfix postqueue command output.

This method used the postfix command defined in postqueue_cmd attribute to view the mails queue content.

Command defined in postqueue_cmd attribute is runned using a subprocess.Popen instance.

Returns:	Command’s output lines.
Return type:	list()

See also

Python module:

subprocess – Subprocess management

PostqueueStore._is_mail_id(mail_id)[source]¶

Check mail_id for a valid postfix queued mail ID.

Validation is made using a re.RegexObject stored in the mail_id_re attribute of the PostqueueStore instance.

Parameters:	mail_id (str) – Mail Postfix queue ID string
Returns:	True or false
Return type:	bool()

Mail Objects¶

class pyqueue.store.Mail(mail_id[, size[, date[, sender]]])[source]¶

Simple object to manipulate email messages.

This class provides the necessary methods to load and inspect mails content. This object functionnalities are mainly based on email module’s provided class and methods. However, email.message.Message instance’s stored informations are extracted to extend Mail instances attributes.

Initialization of Mail instances are made the following way:

Parameters:	mail_id (str) – Mail’s queue ID string size (int) – Mail size in Bytes (Default: 0) date (datetime.datetime) – Acceptance date and time in mails queue. (Default: None) sender (str) – Mail sender string as seen in mails queue. (Default: empty str())

The Mail class defines the following attributes:

qid¶

Mail Postfix queue ID string, validated by _is_mail_id() method.

size¶

Mail size in bytes. Expected type is int().

parsed¶

bool() value to track if mail’s content has been loaded from corresponding spool file.

parse_error¶

Last encountered parse error message str().

date¶

datetime object of acceptance date and time in mails queue.

status¶

Mail’s queue status str().

sender¶

Mail’s sender str() as seen in mails queue.

recipients¶

Recipients list() as seen in mails queue.

errors¶

Mail deliver errors list() as seen in mails queue.

head¶

Mail’s headers MailHeaders structure.

postcat_cmd¶

Postfix command and arguments list() for mails content parsing. Default command and arguments list is build at initialization with: ["postcat", "-qv", self.qid]

The Mail instance provides the following methods:

Mail.parse()[source]¶

Parse message content.

This method use Postfix mails content parsing command defined in postcat_cmd attribute. This command is runned using subprocess.Popen instance.

Parsed headers become attributes and are retrieved with help of message_from_string() function provided by the email module.

See also

Postfix manual:

postcat – Show Postfix queue file contents

Mail.dump()[source]¶

Dump mail’s gathered informations to a dict object.

Mails informations are splitted in two parts in dictionnary. postqueue key regroups every informations directly gathered from Postfix queue, while headers regroups MailHeaders attributes converted from mail content with the parse() method.

If mail has not been parsed with the parse() method, informations under the headers key will be empty.

Returns:	Mail gathered informations
Return type:	dict

MailHeaders Objects¶

class store.MailHeaders[source]¶

Simple object to store mail headers.

Object’s attributes are dynamicly created while parent Mail object’s method parse() is called. Those attributes are retrieved with help of message_from_string() method provided by the email module.

Standard RFC 822-style mail headers becomes attributes including but not limited to:

• Received
• From
• To
• Cc
• Bcc
• Sender
• Reply-To
• Subject

Case is kept while creating attribute and access will be made with Mail.From or Mail.Received for example. All those attributes will return list of values.

See also

Python modules:

email – An email and MIME handling package

email.message.Message – Representing an email message

RFC 822 – Standard for ARPA Internet Text Messages

MailSelector Objects¶

class selector.MailSelector(store)[source]¶

Mail selector class to request mails from store matching criterias.

The MailSelector instance provides the following attributes:

mails¶

Currently selected Mail objects list()

store¶

Linked PostqueueStore at the MailSelector instance initialization.

filters¶

Applied filters list() on current selection. Filters list entries are tuples containing (function.__name__, args, kwargs) for each applied filters. This list is filled by the filter_registration() decorator while calling filtering methods. It is possible to replay registered filter using replay_filters() method.

The MailSelector instance provides the following methods:

MailSelector.filter_registration(function)[source]¶

Decorator to register applied filter.

This decorated is used to wrap selection methods lookup_*. It registers a (function.__name__, args, kwargs) tuple() in the filters attribute.

MailSelector.reset()[source]¶

Reset mail selector with initial store mails list.

Selected Mail objects are deleted and the mails attribute is removed for memory releasing purpose (with help of gc.collect()). Attribute mails is then reinitialized a copy of store‘s mails attribute.

Registered filters are also emptied.

MailSelector.replay_filters()[source]¶

Reset selection with store content and replay registered filters.

Like with the reset() method, selected Mail objects are deleted and reinitialized with a copy of store‘s mails attribute.

However, registered filters are kept and replayed on resetted selection. Use this method to refresh your store content while keeping your filters.

MailSelector.lookup_status(status)[source]¶

Lookup mails with specified postqueue status.

Parameters:	status (list) – List of matching status to filter on.
Returns:	List of newly selected Mail objects
Return type:	list()

MailSelector.lookup_sender(sender[, partial])[source]¶

Lookup mails send from a specific sender.

Optionnal parameter partial allow lookup of partial sender like @domain.com or sender@. By default, partial is False and selection is made on exact sender.

Note

Matches are made against Mail.sender attribute instead of real mail header Sender.

Parameters:	sender (str) – Sender address to lookup in Mail objects selection. partial (bool) – Allow lookup with partial match
Returns:	List of newly selected Mail objects
Return type:	list()

MailSelector.lookup_error(error_msg)[source]¶

Lookup mails with specific error message (message may be partial).

Parameters:	error_msg (str) – Error message to filter on
Returns:	List of newly selected Mail objects`
Return type:	list()

MailSelector.lookup_date([start[, stop]])[source]¶

Lookup mails send on specific date range.

Both arguments start and stop are optionnal and default is set to None. However, it is required to pass at least one of those arguments. This method will raise TypeError if both arguments start and stop are set to None.

Parameters:	start (datetime.datetime) – Start date (default: datetime(1970,1,1)) stop (datetime.datetime) – Stop date (default: datetime.now())
Returns:	List of newly selected Mail objects
Return type:	list()

MailSelector.lookup_size([smin[, smax]])[source]¶

Lookup mails send with specific size.

Both arguments smin and smax are optionnal and default is set to 0. Maximum size is ignored if setted to 0. If both smin and smax are setted to 0, no filtering is done and the entire Mail objects selection is returned.

Parameters:	smin (int) – Minimum size (Default: 0) smax (int) – Maximum size (Default: 0)
Returns:	List of newly selected Mail objects
Return type:	list()

QueueControl Objects¶

class control.QueueControl[source]¶

Postfix queue control using postsuper command.

The QueueControl instance defines the following attributes:

postsuper_cmd¶

Postfix command and arguments list() for mails queue administrative operations. Default is ["postsuper"]

known_operations¶

Known Postfix administrative operations dict to associate operations to command arguments. Known associations are:

 delete: -d
   hold: -h
release: -H
requeue: -r

Warning

Default known associations are provided for the default mails queue administrative command postsuper.

See also

Postfix manual:

postsuper – Postfix superintendent

The QueueControl instance provides the following methods:

QueueControl._operate(operation, messages)[source]¶

Generic method to lead operations messages from postfix mail queue.

Operations can be one of Postfix known operations stored in known_operations attribute. Operation argument is directly converted and passed to the postsuper_cmd command.

Parameters:	operation (str) – Known operation from known_operations. messages (list) – List of Mail objects targetted for operation.
Returns:	Command’s stderr output lines
Return type:	list()

QueueControl.delete_messages(messages)[source]¶

Delete several messages from postfix mail queue.

This method is a partial() wrapper on _operate(). Passed operation is delete

QueueControl.hold_messages(messages)[source]¶

Hold several messages from postfix mail queue.

This method is a partial() wrapper on _operate(). Passed operation is hold

QueueControl.release_messages(messages)[source]¶

Release several messages from postfix mail queue.

This method is a partial() wrapper on _operate(). Passed operation is release

QueueControl.requeue_messages(messages)[source]¶

Requeue several messages from postfix mail queue.

This method is a partial() wrapper on _operate(). Passed operation is requeue

DESCRIPTION¶

pqshell is a shell-like to interact with Postfix mails queue. It provide simple means to view the queue content, filter mails on criterias like Sender or delivery errors and lead administrative operations.

SYNOPSIS¶

pqshell [options]

FEATURES¶

• Asynchronous interactions with Postfix mails queue.
• Mails filtering on various criterias.
• Administrative operations on mails queue
• History and autocomplete via readline, if installed.

OPTIONS¶

No options supported.

SHELL COMMANDS¶

An inside help is available with the help command. Each provided command takes subcommands and command’s help can be obtained while running it without argument.