Quantcast
Channel: Speedup restore of 160 GB SQL in 24 core + Optane NVME system - Database Administrators Stack Exchange
Viewing all articles
Browse latest Browse all 2

Speedup restore of 160 GB SQL in 24 core + Optane NVME system

$
0
0

i set up a new sql-server, ubuntu 18.4 (MYSQL 5.7), 24 core (48 threads), 256G RAM, System is SATA Raid1 XFS SSD /var/lib/ is mounted on Optane SSD XFS.

In restore i can see that the server has unter 1.0 load so it is quit sleeping. I dont know what i can improve to speedup the restore.

Dump size is 30 GB gzip about 160gb 300 mio entries, attached my mysql.cnfIt is a stand alone server just for mysql.

The old server ist mysql 5.6, i dont know if it is able to copy the ibdata files?

[mysqld_safe]socket      = /var/run/mysqld/mysqld.socknice        = 0[mysqld]## * Basic Settings#user        = mysqlpid-file    = /var/run/mysqld/mysqld.pidsocket      = /var/run/mysqld/mysqld.sockport        = 3306basedir     = /usrdatadir     = /var/lib/mysqltmpdir      = /tmplc-messages-dir = /usr/share/mysqlskip-external-lockingskip-name-resolveexplicit_defaults_for_timestamp = 1#key_buffer_size     = 6M#max_allowed_packet = 16M#thread_stack       = 192K# This replaces the startup script and checks MyISAM tables if needed# the first time they are touchedmyisam-recover-options  = BACKUPmax_connections        = 10000table_open_cache       = 15000open_files_limit= 17000innodb_doublewrite = 0log_error_verbosity = 1innodb_buffer_pool_size = 220Ginnodb_thread_concurrency = 0innodb_read_io_threads = 64innodb_write_io_threads = 64innodb_buffer_pool_instances = 48innodb_lock_wait_timeout=120innodb_io_capacity = 400000max_heap_table_size = 5Gmax_allowed_packet=1Gsort_buffer_size=9Mjoin_buffer_size=9M# * Query Cache Configuration#query_cache_limit   = 16Mquery_cache_size        = 512Mquery_cache_type    = 1## * Logging and Replication## Both location gets rotated by the cronjob.# Be aware that this log type is a performance killer.# As of 5.1 you can enable the log at runtime!#general_log_file        = /var/log/mysql/mysql.log#general_log             = 1## Error log - should be very few entries.#log_error = /var/log/mysql/error.log## Here you can see queries with especially long duration#slow_query_log     = 1#slow_query_log_file    = /var/log/mysql/mysql-slow.log#long_query_time = 2#log-queries-not-using-indexes## The following can be used as easy to replay backup logs or for replication.# note: if you are setting up a replication slave, see README.Debian about#       other settings you may need to change.#server-id      = 1#log_bin            = /var/log/mysql/mysql-bin.logexpire_logs_days    = 10max_binlog_size   = 100M#binlog_do_db       = include_database_name#binlog_ignore_db   = include_database_name## * InnoDB## InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/.# Read the manual for more InnoDB related options. There are many!## * Security Features## Read the manual, too, if you want chroot!# chroot = /var/lib/mysql/## For generating SSL certificates I recommend the OpenSSL GUI "tinyca".## ssl-ca=/etc/mysql/cacert.pem# ssl-cert=/etc/mysql/server-cert.pem# ssl-key=/etc/mysql/server-key.pem

Viewing all articles
Browse latest Browse all 2

Latest Images

Trending Articles





Latest Images