Re: [pve-devel] [PVE-User] Proxmox Backup Server (beta)

Re: [pve-devel] [PVE-User] Proxmox Backup Server (beta)

[Lee Lists]

Hi Thomas,

Thank you, it was effectively a missing clang installation.

Finally i managed to compile pbs on armbian / aarch64 (https://kobol.io/).

First tests gives good results on this rk3399 platform.

┌───────────────────────────────────┬───────────────────┐
│ Name                              │ Value             │
╞═══════════════════════════════════╪═══════════════════╡
│ TLS (maximal backup upload speed) │ not tested        │
├───────────────────────────────────┼───────────────────┤
│ SHA256 checksum computation speed │ 885.79 MB/s (44%) │
├───────────────────────────────────┼───────────────────┤
│ ZStd level 1 compression speed    │ 139.33 MB/s (19%) │
├───────────────────────────────────┼───────────────────┤
│ ZStd level 1 decompression speed  │ 326.64 MB/s (27%) │
├───────────────────────────────────┼───────────────────┤
│ Chunk verification speed          │ 271.91 MB/s (36%) │
├───────────────────────────────────┼───────────────────┤
│ AES256 GCM encryption speed       │ 561.27 MB/s (15%) │
└───────────────────────────────────┴───────────────────┘

Regards,
Lee

----- Mail original -----
De: "Thomas Lamprecht" <t.lamprecht@proxmox.com>
À: "Proxmox VE user list" <pve-user@lists.proxmox.com>, "Lee Lists" <lists@jave.fr>
Cc: "PVE User List" <pve-user@pve.proxmox.com>, "pbs-devel" <pbs-devel@lists.proxmox.com>, "pve-devel" <pve-devel@pve.proxmox.com>
Envoyé: Jeudi 8 Octobre 2020 10:21:47
Objet: Re: [PVE-User] Proxmox Backup Server (beta)

On 06.10.20 15:12, Lee Lists wrote:
> I'm trying to build proxmox backup server from source,
> but the build failed in compiling zstd lib bindings.
> 
> Any clues ?

Some more hints about the build environment and the executed steps would
be great.

Are all build dependencies installed, this error comes sometimes up if
clang isn't correctly installed.

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [pve-devel] [PVE-User] Proxmox Backup Server (beta)

[Lee Lists]

Hi Thomas,

Thank you, it was effectively a missing clang installation.

Finally i managed to compile pbs on armbian / aarch64 (https://kobol.io/).

First tests gives good results on this rk3399 platform.

┌───────────────────────────────────┬───────────────────┐
│ Name                              │ Value             │
╞═══════════════════════════════════╪═══════════════════╡
│ TLS (maximal backup upload speed) │ not tested        │
├───────────────────────────────────┼───────────────────┤
│ SHA256 checksum computation speed │ 885.79 MB/s (44%) │
├───────────────────────────────────┼───────────────────┤
│ ZStd level 1 compression speed    │ 139.33 MB/s (19%) │
├───────────────────────────────────┼───────────────────┤
│ ZStd level 1 decompression speed  │ 326.64 MB/s (27%) │
├───────────────────────────────────┼───────────────────┤
│ Chunk verification speed          │ 271.91 MB/s (36%) │
├───────────────────────────────────┼───────────────────┤
│ AES256 GCM encryption speed       │ 561.27 MB/s (15%) │
└───────────────────────────────────┴───────────────────┘

Regards,
Lee

----- Mail original -----
De: "Thomas Lamprecht" <t.lamprecht@proxmox.com>
À: "Proxmox VE user list" <pve-user@lists.proxmox.com>, "Lee Lists" <lists@jave.fr>
Cc: "PVE User List" <pve-user@pve.proxmox.com>, "pbs-devel" <pbs-devel@lists.proxmox.com>, "pve-devel" <pve-devel@pve.proxmox.com>
Envoyé: Jeudi 8 Octobre 2020 10:21:47
Objet: Re: [PVE-User] Proxmox Backup Server (beta)

On 06.10.20 15:12, Lee Lists wrote:
> I'm trying to build proxmox backup server from source,
> but the build failed in compiling zstd lib bindings.
> 
> Any clues ?

Some more hints about the build environment and the executed steps would
be great.

Are all build dependencies installed, this error comes sometimes up if
clang isn't correctly installed.

Re: [pve-devel] [PVE-User] Proxmox Backup Server (beta)

[Thomas Lamprecht]

On 06.10.20 15:12, Lee Lists wrote:
> I'm trying to build proxmox backup server from source,
> but the build failed in compiling zstd lib bindings.
> 
> Any clues ?

Some more hints about the build environment and the executed steps would
be great.

Are all build dependencies installed, this error comes sometimes up if
clang isn't correctly installed.

Re: [pve-devel] [PVE-User] Proxmox Backup Server (beta)

[Lee Lists]

Hi,

I'm trying to build proxmox backup server from source,
but the build failed in compiling zstd lib bindings.

Any clues ?

Thanks,
Jurgen

       Fresh pxar v0.6.1 (/root/pxar)
       Fresh proxmox-fuse v0.1.0 (/root/proxmox-fuse)
       Fresh hyper v0.13.8
   Compiling proxmox v0.4.2 (/root/proxmox/proxmox)
       Fresh bindgen v0.49.4
     Running `rustc --crate-name proxmox --edition=2018 /root/proxmox/proxmox/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="api-macro"' --cfg 'feature="cli"' --cfg 'feature="default"' --cfg 'feature="futures"' --cfg 'feature="hyper"' --cfg 'feature="openssl"' --cfg 'feature="proxmox-api-macro"' --cfg 'feature="proxmox-sortable-macro"' --cfg 'feature="router"' --cfg 'feature="sortable-macro"' --cfg 'feature="tokio"' --cfg 'feature="websocket"' -C metadata=494ea91d58d02b19 -C extra-filename=-494ea91d58d02b19 --out-dir /root/proxmox-backup/target/debug/deps -C incremental=/root/proxmox-backup/target/debug/incremental -L dependency=/root/proxmox-backup/target/debug/deps --extern anyhow=/root/proxmox-backup/target/debug/deps/libanyhow-547643689d8f1fe1.rmeta --extern base64=/root/proxmox-backup/target/debug/deps/libbase64-75b6df1cdb5dcedb.rmeta --extern bytes=/root/proxmox-backup/target/debug/deps/libbytes-de79ab6ad237b260.rmeta --extern endian_trait=/root/proxmox-backup/target/debug/deps/libendian_trait-8410c7a3f7fc6de5.rmeta --extern futures=/root/proxmox-backup/target/debug/deps/libfutures-68cbc13a6c4e5d08.rmeta --extern http=/root/proxmox-backup/target/debug/deps/libhttp-4f2085239d8db6c5.rmeta --extern hyper=/root/proxmox-backup/target/debug/deps/libhyper-33e2f11afaf2d6cd.rmeta --extern lazy_static=/root/proxmox-backup/target/debug/deps/liblazy_static-9441bed367485869.rmeta --extern libc=/root/proxmox-backup/target/debug/deps/liblibc-85afcfd6d5dd745a.rmeta --extern nix=/root/proxmox-backup/target/debug/deps/libnix-19850f768394dcc5.rmeta --extern openssl=/root/proxmox-backup/target/debug/deps/libopenssl-a45d25e9645a7846.rmeta --extern percent_encoding=/root/proxmox-backup/target/debug/deps/libpercent_encoding-00fe2006917413e4.rmeta --extern proxmox_api_macro=/root/proxmox-backup/target/debug/deps/libproxmox_api_macro-45b1df18057a8628.so --extern proxmox_sortable_macro=/root/proxmox-backup/target/debug/deps/libproxmox_sortable_macro-e0ce43c23fa4803c.so --extern regex=/root/proxmox-backup/target/debug/deps/libregex-37b4c1de7b101096.rmeta --extern rustyline=/root/proxmox-backup/target/debug/deps/librustyline-201c56bc71ec2bb7.rmeta --extern serde=/root/proxmox-backup/target/debug/deps/libserde-75724b33e89dcb58.rmeta --extern serde_derive=/root/proxmox-backup/target/debug/deps/libserde_derive-e6d2c9cdac5acf10.so --extern serde_json=/root/proxmox-backup/target/debug/deps/libserde_json-caf74f34e0a23558.rmeta --extern textwrap=/root/proxmox-backup/target/debug/deps/libtextwrap-8dccd2a72ee64e9e.rmeta --extern tokio=/root/proxmox-backup/target/debug/deps/libtokio-8c2cdd714cabf70e.rmeta --extern url=/root/proxmox-backup/target/debug/deps/liburl-0b6b3b5adf147475.rmeta`
   Compiling zstd-sys v1.4.13+zstd.1.4.3
     Running `/root/proxmox-backup/target/debug/build/zstd-sys-0efc8671c6ad61e7/build-script-build`
error: failed to run custom build command for `zstd-sys v1.4.13+zstd.1.4.3`

Caused by:
  process didn't exit successfully: `/root/proxmox-backup/target/debug/build/zstd-sys-0efc8671c6ad61e7/build-script-build` (exit code: 101)
...
...
...
  running: "ar" "crs" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/libzstd.a" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/debug.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/entropy_common.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/error_private.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/fse_decompress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/pool.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/threading.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/xxhash.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/common/zstd_common.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/fse_compress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/hist.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/huf_compress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_compress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_compress_literals.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_compress_sequences.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_double_fast.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_fast.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_lazy.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_ldm.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstd_opt.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/compress/zstdmt_compress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/decompress/huf_decompress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/decompress/zstd_ddict.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/decompress/zstd_decompress.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/decompress/zstd_decompress_block.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v01.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v02.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v03.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v04.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v05.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v06.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/legacy/zstd_v07.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/dictBuilder/cover.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/dictBuilder/divsufsort.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/dictBuilder/fastcover.o" "/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out/zstd/lib/dictBuilder/zdict.o"
  exit code: 0
  cargo:rustc-link-lib=static=zstd
  cargo:rustc-link-search=native=/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out
  cargo:root=/root/proxmox-backup/target/debug/build/zstd-sys-c18e259b2d671f1b/out

  --- stderr
  ./zstd/lib/zstd.h:18:10: fatal error: 'stddef.h' file not found
  ./zstd/lib/zstd.h:18:10: fatal error: 'stddef.h' file not found, err: true
  thread 'main' panicked at 'Unable to generate bindings: ()', /root/.cargo/registry/src/github.com-1ecc6299db9ec823/zstd-sys-1.4.13+zstd.1.4.3/build.rs:33:40
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace