From: Wolfgang Bumiller <w.bumiller@proxmox.com>
To: Christian Ebner <c.ebner@proxmox.com>
Cc: pbs-devel@lists.proxmox.com
Subject: Re: [pbs-devel] [RFC pxar 4/20] fix #3174: metadata: impl fn to calc byte size
Date: Wed, 27 Sep 2023 13:38:28 +0200 [thread overview]
Message-ID: <fsvlsin42ytzfoggoiwh4vgkeciwf7m5tflht36q4nadvky2ka@bqdsf7yrdovx> (raw)
In-Reply-To: <20230922071621.12670-5-c.ebner@proxmox.com>
On Fri, Sep 22, 2023 at 09:16:05AM +0200, Christian Ebner wrote:
> Add a helper function to calculate the byte size of pxar Metadata
> objects, needed to be able to recalculate offsets when creating archives
> with appendix sections.
>
> Signed-off-by: Christian Ebner <c.ebner@proxmox.com>
> ---
> src/lib.rs | 44 ++++++++++++++++++++++++++++++++++++++++++++
> 1 file changed, 44 insertions(+)
>
> diff --git a/src/lib.rs b/src/lib.rs
> index 210c4b1..ed7ba40 100644
> --- a/src/lib.rs
> +++ b/src/lib.rs
> @@ -144,6 +144,50 @@ impl Metadata {
> pub fn builder_from_stat(stat: &libc::stat) -> MetadataBuilder {
> MetadataBuilder::new(0).fill_from_stat(stat)
> }
> +
> + /// Calculate the number of bytes when serialized in pxar archive
> + pub fn calculate_byte_len(&self) -> usize {
This looks like a maintenance nightmare with extra sprinkles.
Can we instead create a specialized `SeqWrite` type that just counts
bytes instead of actually writing anything and call the encoder's
`encode_metadata()` with it?
(Either by factorizing `encode_metadat()` out further or by creating an
actual `EncoderImpl` instance with it...)
> + let mut bytes = mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(&self.stat);
> + for xattr in &self.xattrs {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(xattr);
> + }
> + for acl_user in &self.acl.users {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(acl_user);
> + }
> + for acl_group in &self.acl.groups {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(acl_group);
> + }
> + if let Some(group_obj) = &self.acl.group_obj {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(group_obj);
> + }
> + if let Some(default) = &self.acl.default {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(default);
> + }
> + for acl_default_user in &self.acl.default_users {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(acl_default_user);
> + }
> + for acl_default_group in &self.acl.default_groups {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(acl_default_group);
> + }
> + if let Some(fcaps) = &self.fcaps {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(fcaps);
> + }
> + if let Some(quota_project_id) = &self.quota_project_id {
> + bytes += mem::size_of::<format::Header>();
> + bytes += mem::size_of_val(quota_project_id);
> + }
> +
> + bytes
> + }
> }
>
> impl From<MetadataBuilder> for Metadata {
> --
> 2.39.2
next prev parent reply other threads:[~2023-09-27 11:39 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-09-22 7:16 [pbs-devel] [RFC pxar proxmox-backup 00/20] fix #3174: improve file-level backup Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 1/20] fix #3174: encoder: impl fn new for LinkOffset Christian Ebner
2023-09-27 12:08 ` Wolfgang Bumiller
2023-09-27 12:26 ` Christian Ebner
2023-09-28 6:49 ` Wolfgang Bumiller
2023-09-28 7:52 ` Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 2/20] fix #3174: decoder: factor out skip_bytes from skip_entry Christian Ebner
2023-09-27 11:32 ` Wolfgang Bumiller
2023-09-27 11:53 ` Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 3/20] fix #3174: decoder: impl skip_bytes for sync dec Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 4/20] fix #3174: metadata: impl fn to calc byte size Christian Ebner
2023-09-27 11:38 ` Wolfgang Bumiller [this message]
2023-09-27 11:55 ` Christian Ebner
2023-09-28 8:07 ` Christian Ebner
2023-09-28 9:00 ` Wolfgang Bumiller
2023-09-28 9:27 ` Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 5/20] fix #3174: enc/dec: impl PXAR_APPENDIX_REF entrytype Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 6/20] fix #3174: enc/dec: impl PXAR_APPENDIX entrytype Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 7/20] fix #3174: encoder: add helper to incr encoder pos Christian Ebner
2023-09-27 12:07 ` Wolfgang Bumiller
2023-09-27 12:20 ` Christian Ebner
2023-09-28 7:04 ` Wolfgang Bumiller
2023-09-28 7:50 ` Christian Ebner
2023-09-28 8:32 ` Wolfgang Bumiller
2023-09-22 7:16 ` [pbs-devel] [RFC pxar 8/20] fix #3174: enc/dec: impl PXAR_APPENDIX_TAIL entrytype Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 09/20] fix #3174: index: add fn index list from start/end-offsets Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 10/20] fix #3174: index: add fn digest for DynamicEntry Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 11/20] fix #3174: api: double catalog upload size Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 12/20] fix #3174: catalog: incl pxar archives file offset Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 13/20] fix #3174: archiver/extractor: impl appendix ref Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 14/20] fix #3174: extractor: impl seq restore from appendix Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 15/20] fix #3174: archiver: store ref to previous backup Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 16/20] fix #3174: upload stream: impl reused chunk injector Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 17/20] fix #3174: chunker: add forced boundaries Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 18/20] fix #3174: backup writer: inject queued chunk in upload steam Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 19/20] fix #3174: archiver: reuse files with unchanged metadata Christian Ebner
2023-09-26 7:01 ` Christian Ebner
2023-09-22 7:16 ` [pbs-devel] [RFC proxmox-backup 20/20] fix #3174: client: Add incremental flag to backup creation Christian Ebner
2023-09-26 7:11 ` Christian Ebner
2023-09-26 7:15 ` [pbs-devel] [RFC pxar proxmox-backup 00/20] fix #3174: improve file-level backup Christian Ebner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=fsvlsin42ytzfoggoiwh4vgkeciwf7m5tflht36q4nadvky2ka@bqdsf7yrdovx \
--to=w.bumiller@proxmox.com \
--cc=c.ebner@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox