自然堂网站建设策划书,施工企业负责人培训,怎么办,满山红厦门网站建设PostgreSQL16中pg_dump的LZ4和ZSTD压缩 pg_dump压缩lz4和zstd LZ4和ZSTD压缩算法合入了PG16。LZ4补丁的作者是Georgios Kokolatos。由Tomas Vondra提交。由Michael Paquier、Rachel Heaton、Justin Pryzby、Shi Yu 和 Tomas Vondra 审阅。提交消息是#xff1a; Expand pg_dum… PostgreSQL16中pg_dump的LZ4和ZSTD压缩 pg_dump压缩lz4和zstd LZ4和ZSTD压缩算法合入了PG16。LZ4补丁的作者是Georgios Kokolatos。由Tomas Vondra提交。由Michael Paquier、Rachel Heaton、Justin Pryzby、Shi Yu 和 Tomas Vondra 审阅。提交消息是 Expand pg_dumps compression streaming and file APIs to
support the lz4 algorithm. The newly added compress_lz4.{c,h}
files cover all the functionality of the aforementioned APIs.
Minor changes were necessary in various pg_backup_* files,
where code for the lz4 file suffix has been added,
as well as pg_dumps compression option parsing.
Author: Georgios Kokolatos
Reviewed-by: Michael Paquier, Rachel Heaton, Justin Pryzby,
Shi Yu, Tomas Vondra
Discussion:
https://postgr.es/m/faUNEOpts9vunEaLnmxmG-DldLSg_ql137OC3JYDmgrOMHm1RvvWY2IdBkv_CRxm5spCCb_OmKNk2T03TMm0fBEWveFF9wA1WizPuAgB7Ss%3D%40protonmail.com ZSTD补丁的作者是Justin Pryzby。由Tomas Vondra提交。由Tomas Vondra、Jacob Champion 和 Andreas Karlsson 审阅。提交消息是 Allow pg_dump to use the zstd compression,
in addition to gzip/lz4. Bulk of the new compression method
is implemented in compress_zstd.{c,h},covering the pg_dump
compression APIs. The rest of the patch adds test and makesvarious places aware of the new compression method.
The zstd library (which this patch relies on) supports
multithreaded compression since version 1.5. We however
disallow that feature for now, as it might interfere with
parallel backups on platforms that rely on threads
(e.g. Windows). This can be improved / relaxed in the future.
This also fixes a minor issue in
InitDiscoverCompressFileHandle(), which was not updated to
check if the file already has the .lz4 extension.
Adding zstd compression was originally proposed in 2020
(see the second thread), but then was reworked to use the
new compression API introduced in e9960732a9. Ive considered
both threads when compiling the list of reviewers.
Author: Justin Pryzby
Reviewed-by: Tomas Vondra, Jacob Champion, Andreas Karlsson
Discussion: https://postgr.es/m/20230224191840.GD1653telsasoft.com
Discussion: https://postgr.es/m/20201221194924.GI30237telsasoft.com 尝试下 ~$ pg_dump --version
pg_dump (PostgreSQL) 16devel
~$ pgbench --initialize --scale100
dropping old tables...
NOTICE: table pgbench_accounts does not exist, skipping
NOTICE: table pgbench_branches does not exist, skipping
NOTICE: table pgbench_history does not exist, skipping
NOTICE: table pgbench_tellers does not exist, skipping
creating tables...
generating data (client-side)...
10000000 of 10000000 tuples (100%) done (elapsed 39.52 s, remaining 0.00 s)
vacuuming...
creating primary keys...
done in 49.65 s (drop tables 0.00 s, create tables 0.08 s, client-side generate 39.96 s, vacuum 0.29 s, primary keys 9.32 s).
~$ psql --commandselect pg_size_pretty(pg_database_size(postgres))
pg_size_pretty
----------------
1503 MB
(1 row)
~$ time pg_dump --formatcustom --compresslz4:9 dump.lz4
real 0m10.507s
user 0m9.901s
sys 0m0.436s
~$ time pg_dump --formatcustom --compresszstd:9 dump.zstd
real 0m8.794s
user 0m8.393s
sys 0m0.364s
~$ time pg_dump --formatcustom --compressgzip:9 dump.gz
real 0m14.245s
user 0m13.064s
sys 0m0.978s
~$ time pg_dump --formatcustom --compresslz4 dump_default.lz4
real 0m6.809s
user 0m1.666s
sys 0m1.125s
~$ time pg_dump --formatcustom --compresszstd dump_default.zstd
real 0m7.534s
user 0m2.428s
sys 0m0.892s
~$ time pg_dump --formatcustom --compressgzip dump_default.gz
real 0m11.564s
user 0m10.661s
sys 0m0.525s
~$ time pg_dump --formatcustom --compresslz4:3 dump_3.lz4
real 0m8.497s
user 0m7.856s
sys 0m0.507s
~$ time pg_dump --formatcustom --compresszstd:3 dump_3.zstd
real 0m5.129s
user 0m2.228s
sys 0m0.726s
~$ time pg_dump --formatcustom --compressgzip:3 dump_3.gz
real 0m4.468s
user 0m3.654s
sys 0m0.504s
~$ ls -l --block-sizeM
total 250M
-rw-rw-r-- 1 postgres postgres 28M Apr 18 13:58 dump_3.gz
-rw-rw-r-- 1 postgres postgres 48M Apr 18 13:57 dump_3.lz4
-rw-rw-r-- 1 postgres postgres 8M Apr 18 13:58 dump_3.zstd
-rw-rw-r-- 1 postgres postgres 27M Apr 18 13:57 dump_default.gz
-rw-rw-r-- 1 postgres postgres 50M Apr 18 13:56 dump_default.lz4
-rw-rw-r-- 1 postgres postgres 8M Apr 18 13:57 dump_default.zstd
-rw-rw-r-- 1 postgres postgres 27M Apr 18 13:56 dump.gz
-rw-rw-r-- 1 postgres postgres 48M Apr 18 13:55 dump.lz4
-rw-rw-r-- 1 postgres postgres 8M Apr 18 13:56 dump.zstd 根据命令的输出得出以下关于三种压缩方法的结论 gzip:这是一种众所周知且广泛使用的压缩方法可以在压缩率和压缩速度之间提供两行的平衡。 lz4:这是一种非常快的压缩算法以较低的压缩比为代价提供较高的压缩和解压速度。Lz4压缩转出的文件在48-50MB范围明显大于gzip压缩转储。 Zstd这是一种比较新的压缩算法压缩比高压缩速度也不错。Zstd压缩转储的文件大小在8-8.5MB范围内是三种压缩方法中最小的。 令人吃惊的是zstd压缩时间最少其次是lz4和gzip。该数据可能不是测量和比较的最佳数据。默认压缩级别zstd生成最小的转储文件大小其次是lz4和gzip。在最大压缩级别zstd仍然生成最小的转储文件大小其次是gzip和lz4。 基于这些观察如果首要任务是减少磁盘使用空间zstd是推荐的压缩方法。但如果首要任务是减少压缩时间则zstd和lz4都表现不错。如果担心与其他实用程序的兼容性gzip仍然是一个可行的选择。 最后 PostgreSQL16中的pg_dump -Z/--compress将不仅仅支持整数。它可用于指定使用的压缩方法和级别。默认仍然是级别为 6 的gzip。但是块上的新方法lz4和zstd已经在这里了 https://git.postgresql.org/gitweb/?ppostgresql.git;acommitdiff;h5e73a6048849bd7bda4947e39570b9011734114d 原文 https://www.cybertec-postgresql.com/en/lz4-zstd-pg_dump-compression-postgresql-16/
文章转载自： http://www.morning.nmwgd.cn.gov.cn.nmwgd.cn http://www.morning.hsklc.cn.gov.cn.hsklc.cn http://www.morning.nkkr.cn.gov.cn.nkkr.cn http://www.morning.fxzlg.cn.gov.cn.fxzlg.cn http://www.morning.tcylt.cn.gov.cn.tcylt.cn http://www.morning.lqjlg.cn.gov.cn.lqjlg.cn http://www.morning.gtbjf.cn.gov.cn.gtbjf.cn http://www.morning.ywqsk.cn.gov.cn.ywqsk.cn http://www.morning.kzqpn.cn.gov.cn.kzqpn.cn http://www.morning.fsfz.cn.gov.cn.fsfz.cn http://www.morning.hqjtp.cn.gov.cn.hqjtp.cn http://www.morning.playmi.cn.gov.cn.playmi.cn http://www.morning.mkczm.cn.gov.cn.mkczm.cn http://www.morning.mnsmb.cn.gov.cn.mnsmb.cn http://www.morning.nlgyq.cn.gov.cn.nlgyq.cn http://www.morning.kwblwbl.cn.gov.cn.kwblwbl.cn http://www.morning.supera.com.cn.gov.cn.supera.com.cn http://www.morning.jhkzl.cn.gov.cn.jhkzl.cn http://www.morning.mwnch.cn.gov.cn.mwnch.cn http://www.morning.crxdn.cn.gov.cn.crxdn.cn http://www.morning.kxxld.cn.gov.cn.kxxld.cn http://www.morning.mrccd.cn.gov.cn.mrccd.cn http://www.morning.mkyny.cn.gov.cn.mkyny.cn http://www.morning.rgsnk.cn.gov.cn.rgsnk.cn http://www.morning.lxqkt.cn.gov.cn.lxqkt.cn http://www.morning.c7629.cn.gov.cn.c7629.cn http://www.morning.51meihou.cn.gov.cn.51meihou.cn http://www.morning.ksgjy.cn.gov.cn.ksgjy.cn http://www.morning.clbsd.cn.gov.cn.clbsd.cn http://www.morning.rfzzw.com.gov.cn.rfzzw.com http://www.morning.csznh.cn.gov.cn.csznh.cn http://www.morning.bpmft.cn.gov.cn.bpmft.cn http://www.morning.ncfky.cn.gov.cn.ncfky.cn http://www.morning.wlsrd.cn.gov.cn.wlsrd.cn http://www.morning.csjps.cn.gov.cn.csjps.cn http://www.morning.mjdbd.cn.gov.cn.mjdbd.cn http://www.morning.fdrch.cn.gov.cn.fdrch.cn http://www.morning.btns.cn.gov.cn.btns.cn http://www.morning.qgtbx.cn.gov.cn.qgtbx.cn http://www.morning.fgkrh.cn.gov.cn.fgkrh.cn http://www.morning.rwyd.cn.gov.cn.rwyd.cn http://www.morning.tgyqq.cn.gov.cn.tgyqq.cn http://www.morning.wdpt.cn.gov.cn.wdpt.cn http://www.morning.rdzlh.cn.gov.cn.rdzlh.cn http://www.morning.rqlbp.cn.gov.cn.rqlbp.cn http://www.morning.rtlth.cn.gov.cn.rtlth.cn http://www.morning.mnwmj.cn.gov.cn.mnwmj.cn http://www.morning.glnxd.cn.gov.cn.glnxd.cn http://www.morning.rykmf.cn.gov.cn.rykmf.cn http://www.morning.ttryd.cn.gov.cn.ttryd.cn http://www.morning.dqdss.cn.gov.cn.dqdss.cn http://www.morning.mlfgx.cn.gov.cn.mlfgx.cn http://www.morning.pzjfz.cn.gov.cn.pzjfz.cn http://www.morning.bnygf.cn.gov.cn.bnygf.cn http://www.morning.zsrdp.cn.gov.cn.zsrdp.cn http://www.morning.jqwpw.cn.gov.cn.jqwpw.cn http://www.morning.lynkz.cn.gov.cn.lynkz.cn http://www.morning.yppln.cn.gov.cn.yppln.cn http://www.morning.wqpb.cn.gov.cn.wqpb.cn http://www.morning.pxjp.cn.gov.cn.pxjp.cn http://www.morning.wsgyq.cn.gov.cn.wsgyq.cn http://www.morning.hrtfz.cn.gov.cn.hrtfz.cn http://www.morning.gassnw.com.gov.cn.gassnw.com http://www.morning.nzqqd.cn.gov.cn.nzqqd.cn http://www.morning.hrydl.cn.gov.cn.hrydl.cn http://www.morning.bfsqz.cn.gov.cn.bfsqz.cn http://www.morning.qngcq.cn.gov.cn.qngcq.cn http://www.morning.dhqyh.cn.gov.cn.dhqyh.cn http://www.morning.bypfj.cn.gov.cn.bypfj.cn http://www.morning.ryqsq.cn.gov.cn.ryqsq.cn http://www.morning.pudejun.com.gov.cn.pudejun.com http://www.morning.chbcj.cn.gov.cn.chbcj.cn http://www.morning.jcyyh.cn.gov.cn.jcyyh.cn http://www.morning.gjsjt.cn.gov.cn.gjsjt.cn http://www.morning.cwnqd.cn.gov.cn.cwnqd.cn http://www.morning.trlhc.cn.gov.cn.trlhc.cn http://www.morning.ztmnr.cn.gov.cn.ztmnr.cn http://www.morning.kxmyj.cn.gov.cn.kxmyj.cn http://www.morning.ryxbz.cn.gov.cn.ryxbz.cn http://www.morning.sjbpg.cn.gov.cn.sjbpg.cn
