Recent Posts

Pages: [1] 2 3 ... 10
1
My main problem is I can not copy and past from tmux, so I can not show what is happening but, basically I get multiple loop of:

Process Releases -> Create release from complete collections, each of which state
Added 5000 releases.

Finally after 4,8, 10, 20 loops (it depends) I see one that is not 5000 and it then actually creates some NZBs.  It is only at this point that it loops, however the process of handling these batches of 5000 releases (that add nothing), are concerning and seem to slow down the whole system.

I seem to be update date on groups and nothing is set to backfill, so I do not know where all of these releases come from or why there are so many.

I'm wondering why I have these loops and is there some way to clear the backlog (as I expect this is what I'm seeing)?

Thanks,
ERIC
2
Support / Re: Any sample my.cnf files?
« Last post by ebro on Today at 04:31:39 AM »
And here is Mysqltuner output

-------- Performance Metrics -------------------------------------------------
[--] Up for: 4d 16h 34m 17s (35M q [88.781 qps], 412K conn, TX: 11B, RX: 18B)
[--] Reads / Writes: 53% / 47%
[--] Binary logging is disabled
[--] Total buffers: 10.6G global + 32.4M per thread (40 max threads)
[OK] Maximum reached memory usage: 11.5G (74.04% of installed RAM)
[OK] Maximum possible memory usage: 11.8G (76.49% of installed RAM)
[OK] Slow queries: 0% (188/35M)
[OK] Highest usage of available connections: 70% (28/40)
[OK] Aborted connections: 0.00%  (11/412216)
[OK] Query cache efficiency: 22.5% (5M cached / 23M selects)
[!!] Query cache prunes per day: 47255
[OK] Sorts requiring temporary tables: 0% (465 temp sorts / 1M sorts)
[!!] Joins performed without indexes: 144541
[OK] Temporary tables created on disk: 11% (199K on disk / 1M total)
[OK] Thread cache hit rate: 99% (1K created / 412K connections)
[OK] Table cache hit rate: 29% (256 open / 872 opened)
[OK] Open file limit used: 5% (60/1K)
[OK] Table locks acquired immediately: 99% (55M immediate / 55M locks)

-------- MyISAM Metrics -----------------------------------------------------
[!!] Key buffer used: 18.3% (24M used / 134M cache)
[OK] Key buffer size / total MyISAM indexes: 128.0M/1.6M
[OK] Read Key buffer hit rate: 99.3% (753K cached / 4K reads)
[!!] Write Key buffer hit rate: 4.6% (40K cached / 39K writes)

-------- InnoDB Metrics -----------------------------------------------------
[--] InnoDB is enabled.
[OK] InnoDB buffer pool / data size: 10.0G/9.6G
[OK] InnoDB buffer pool instances: 10
[OK] InnoDB Used buffer: 98.42% (645003 used/ 655350 total)
[OK] InnoDB Read buffer efficiency: 100.00% (273964844843 hits/ 273965294280 total)
[!!] InnoDB Write buffer efficiency: 0.00% (0 hits/ 1 total)
[OK] InnoDB log waits: 0.00% (0 waits / 2227498 writes)

-------- AriaDB Metrics -----------------------------------------------------
[--] AriaDB is disabled.

-------- Replication Metrics -------------------------------------------------
[--] No replication slave(s) for this server.
[--] This is a standalone server..
3
Support / Re: Any sample my.cnf files?
« Last post by ebro on Today at 04:23:18 AM »
This is working for me. Ubunut 16 / 64 bit / 16 gig ram . 240gig SSD 1gig RAM disk.

[client]
user=????
password=????


[mysqld]
tmpdir = /mnt/ramdisk
innodb_file_per_table = 1
innodb_flush_method=O_DIRECT
innodb_log_file_size = 128M
innodb_log_buffer_size = 16M
innodb_buffer_pool_size = 10G
innodb_buffer_pool_instances = 10

max_allowed_packet = 16M
group_concat_max_len = 8192
query_cache_size = 10M
query_cache_limit = 10M
tmp_table_size = 128M
key_buffer_size = 128M
max_heap_table_size = 256M
max_connections = 40
sort_buffer = 16M
read_rnd_buffer_size = 16M
tmp_table_size = 256M
4
Support / Any sample my.cnf files?
« Last post by david_ritterhous on Today at 03:36:51 AM »
Would anyone be willing to share their my.cnf files?  I am looking at moving to innodb this week but have 0 in my cnf file about it.
Here is mine, server has 48gb ram and I do run mysqltune on it often to adjust.
Code: [Select]
[client]
port            = 3306
socket          = /var/run/mysqld/mysqld.sock

[mysqld_safe]
socket          = /var/run/mysqld/mysqld.sock
nice            = 0

[mysqld]
user            = mysql
pid-file        = /var/run/mysqld/mysqld.pid
socket          = /var/run/mysqld/mysqld.sock
port            = 3306
basedir         = /usr
datadir         = /var/lib/mysql
tmpdir          = /tmp
lc-messages-dir = /usr/share/mysql
skip-external-locking
ignore_builtin_innodb
default_storage_engine=MyISAM
join_buffer_size        = 2048M
tmp_table_size                 = 1024M
max_heap_table_size            = 1024M
query_cache_type               = 0
query_cache_size               = 48M
query_cache_limit               = 5548M
max_connections                = 50
thread_cache_size              = 150
open_files_limit               = 165535
table_definition_cache         = 3024
table_open_cache               = 12000
group_concat_max_len    = 32840
max_allowed_packet      = 1500M
table_cache = 7500
expire_logs_days        = 10
max_binlog_size         = 100M

[mysqldump]
quick
quote-names

[mysql]

[isamchk]
key_buffer              = 15G
key_buffer_size         = 15G
!includedir /etc/mysql/conf.d/


I am seeing a lot of "Copying to tmp table on disk" and "Waiting for table level lock"
5
Support / Re: removeCrapReleases.php Removing from query but not front end
« Last post by Tempest on 2017-01-20, 10:45:33 PM »
Thanks for the reply kaibosh,

I see two procedures, "delete_release" and "loop_cbpm".

I'll update and edit this later with my findings.
6
Support / Re: Can't Convert to InnoDB
« Last post by david_ritterhous on 2017-01-20, 05:30:16 PM »
@david_ritterhous While I can't quite answer the question, I can say that I have a very large collection ( > 20M nzbs - for absolutely no good reason I admit) but can say that innodb runs very well. I don't use compression. ... so I can't really give any subjective commentary on "worth it" other than to say I'm there and it runs very stable. HTH
Thanks, maybe I will look at converting.  Even on new box, I am pegging the CPU with mysql.  Wondering if innodb would help that.
7
Support / Re: Can't Convert to InnoDB
« Last post by NZBmets on 2017-01-20, 12:59:41 PM »
@david_ritterhous While I can't quite answer the question, I can say that I have a very large collection ( > 20M nzbs - for absolutely no good reason I admit) but can say that innodb runs very well. I don't use compression. ... so I can't really give any subjective commentary on "worth it" other than to say I'm there and it runs very stable. HTH
8
Support / Re: Why am I seeing this on the utils tab in tmux?
« Last post by kaibosh on 2017-01-19, 11:20:09 PM »
IMO, 100 is quite high. Running here at 60 with reasonably fast hardware, anything much higher sometimes hits that limit.
9
Support / Re: Why am I seeing this on the utils tab in tmux?
« Last post by david_ritterhous on 2017-01-19, 02:38:57 PM »
Thank you.  I lowered it to 3 threads of 100 each to see if that helps.
Will post a follow up to let others know.
10
Support / Re: PDO error
« Last post by kaibosh on 2017-01-19, 02:18:30 PM »
Looks like database cannot keep up with the application if it's refusing connections like this.

Perhaps max_connections needs to be increased. mysqltuner is one useful tool to check this and other params. There's a basic DB tuning page in the github wiki.
Pages: [1] 2 3 ... 10