From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id E887AB7DA for ; Thu, 24 Nov 2022 13:21:54 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 5B4602F173 for ; Thu, 24 Nov 2022 13:21:24 +0100 (CET) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Thu, 24 Nov 2022 13:21:19 +0100 (CET) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id B5BA44395A for ; Thu, 24 Nov 2022 13:21:13 +0100 (CET) From: Dominik Csapak To: pmg-devel@lists.proxmox.com Date: Thu, 24 Nov 2022 13:21:00 +0100 Message-Id: <20221124122112.666868-1-d.csapak@proxmox.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.064 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [utils.pm, spam.pm, ldap.pm, pmgqm.pm, htmlmail.pm, group.pm, statistic.pm, ldapuser.pm, remove.pm, ldapcache.pm, matchfield.pm, notify.pm, matchfilename.pm, mailqueue.pm, accept.pm, rule.pm, whoregex.pm, modfield.pm, disclaimer.pm, bcc.pm] Subject: [pmg-devel] [PATCH pmg-api v4 00/12] ruledb - improve experience for non-ascii tests and mails X-BeenThere: pmg-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Mail Gateway development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Nov 2022 12:21:54 -0000 as replacement for the v3 from stoiko (i did not resend the gui patches, as they are ok and still valid) i added some of my notes as follow ups (ldap/bwlist/refactors) as well as modified some commit messages of stoiko i tested with various configurations with ldap, including unicode characters of the local part of the account/email (i only got this to work in active directory...) Dominik Csapak (4): quarantine: fix adding non-ascii senders to wl/bl utils: refactor rfc1522_to_html ldap: improve unicode support statistics: refactor filter_text generation Stoiko Ivanov (8): utils: return perl string from decode_rfc1522 ruledb: properly substitute prox_vars in headers fix #2541 ruledb: encode relevant values as utf-8 in database ruledb: encode e-mail addresses for syslog partially fix #2465: handle smtputf8 addresses in the rule-system quarantine: handle utf8 data pmgqm: handle smtputf8 data statistics: handle utf8 data. src/PMG/API2/Quarantine.pm | 14 +++---- src/PMG/CLI/pmgqm.pm | 24 ++++++----- src/PMG/HTMLMail.pm | 7 ++-- src/PMG/LDAPCache.pm | 31 ++++++++------ src/PMG/MailQueue.pm | 10 +++-- src/PMG/Quarantine.pm | 13 +++--- src/PMG/RuleDB.pm | 24 +++++++---- src/PMG/RuleDB/Accept.pm | 2 +- src/PMG/RuleDB/BCC.pm | 23 ++++++++-- src/PMG/RuleDB/Block.pm | 2 +- src/PMG/RuleDB/Disclaimer.pm | 2 +- src/PMG/RuleDB/Group.pm | 4 +- src/PMG/RuleDB/LDAP.pm | 11 +++-- src/PMG/RuleDB/LDAPUser.pm | 13 +++--- src/PMG/RuleDB/MatchField.pm | 8 +++- src/PMG/RuleDB/MatchFilename.pm | 5 ++- src/PMG/RuleDB/ModField.pm | 19 +++------ src/PMG/RuleDB/Notify.pm | 24 ++++++++--- src/PMG/RuleDB/Quarantine.pm | 19 +++++++-- src/PMG/RuleDB/Remove.pm | 20 ++++++--- src/PMG/RuleDB/Rule.pm | 2 +- src/PMG/RuleDB/Spam.pm | 17 ++++---- src/PMG/RuleDB/WhoRegex.pm | 5 ++- src/PMG/Statistic.pm | 74 +++++++++++++++++++++++++-------- src/PMG/Utils.pm | 48 ++++++++++++--------- src/bin/pmg-smtp-filter | 7 ++-- 26 files changed, 277 insertions(+), 151 deletions(-) -- 2.30.2