在日常工作中,对于数据库难免处理一些最大连接数相关的问题,原因都是大同小异,一般都是业务做统计完成之后不关掉,访问量过高,或者timeout时间设置不合理等问题导致监控报警。

对于最大连接数的调整,如果服务器的并发请求量比较大,可以调高这个值,当然这是要建立在机器能够支撑的情况下,因为如果连接数越来越多,数据库实例为每个连接提供缓冲区,就会开销越多的内存,所以需要适当的调整该值,较合理的最大连接数一般 used_connections/max_connections在85%~90%左右正好。
对于PostgreSQL而言,最大连接数默认值是100。并没有在线设置最大连接数相关的配置,而且即使可以设置,也是一刀切,并没有真正处理掉已经很久的 state = 'idle' 连接。
处理流程:
a. 查询当前连接数
selelct count(1) from pg_stat_activity;
b. 查询最大连接数
show max_connections;
c. 查询分析维度
select client_addr,count(*) from pg_stat_activity where state = 'idle' group by 'client_addr';select * from pg_stat_activity where state = 'idle' and client_addr = 'x.x.x.x' and state_change < (now()-interval '5h')::timestamp;select * from pg_stat_activity where state = 'idle' and application_name='NAVICAT' and client_addr = 'x.x.x.x' and state_change < (now()-interval '5h')::timestamp;
d. 处理
select pg_terminate_backend(pid) from pg_stat_activity where state = 'idle' and client_addr = 'x.x.x.x' and application_name='NAVICAT' and state_change < (now()-interval '5h')::timestamp;
如果通过计算,确实存在设置不合理的情况,可以设置适当重载,但不建议立即重启!
2. MySQL
对于MySQL而言,最大连接数默认值是151,其实可以连接151+
本地socket个连接。MySQL是有在线设置参数的功能,但是治标不治本。
监控中可能会遇到MySQL: ERROR 1040: Too many connections的异常情况,造成这种情况的一种原因是访问量过高,MySQL服务器抗不住,这个时候就要考虑增加从服务器分散读压力;另一种原因就是MySQL配置文件中max_connections值过小。
处理流程:
a. 查看mysql的最大连接数和默认连接超时
show variables like '%max_connections%';select @@max_connections;+-------------------+| @@max_connections |+-------------------+| 151 |+-------------------+1 row in set (0.00 sec)show global variables like 'wait_timeout';+---------------+-------+| Variable_name | Value |+---------------+-------+| wait_timeout | 28800 |+---------------+-------+1 row in set (0.00 sec)默认连接释放8小时
b. 调整时的参考值
show global status like 'Max_used_connections';+----------------------+-------+| Variable_name | Value |+----------------------+-------+| Max_used_connections | 114 |+----------------------+-------+1 row in set (0.00 sec)
对于MySQL服务器最大连接数值的设置范围比较理想的是:服务器响应的最大连接数值占服务器上限连接数值的比例值在10%以上,如果在10%以下,说明MySQL服务器最大连接上限值设置过高。
max_used_connections max_connections * 100% (理想值≈ 85%)select concat(round(114/151*100),'%') as percent;+---------+| percent |+---------+| 75% |+---------+1 row in set (0.00 sec)
c.查询MySQL线程
show processlist;+----+------+-----------+------+---------+------+----------+------------------+| Id | User | Host | db | Command | Time | State | Info |+----+------+-----------+------+---------+------+----------+------------------+| 2 | root | localhost | NULL | Query | 0 | starting | show processlist || 3 | root | localhost | NULL | Sleep | 199 | | NULL |+----+------+-----------+------+---------+------+----------+------------------+2 rows in set (0.00 sec)
4.处理方式:
方式一: kill或者pt-kill掉Command='sleep'kill 3;Query OK, 0 rows affected (0.00 sec)show full processlist;+----+------+-----------+------+---------+------+----------+-----------------------+| Id | User | Host | db | Command | Time | State | Info |+----+------+-----------+------+---------+------+----------+-----------------------+| 2 | root | localhost | NULL | Query | 0 | starting | show full processlist |+----+------+-----------+------+---------+------+----------+-----------------------+1 row in set (0.00 sec)方式二:根据参考值计算百分比适当在线调参select @@max_connections;+-------------------+| @@max_connections |+-------------------+| 151 |+-------------------+1 row in set (0.00 sec)set global max_connections=200;Query OK, 0 rows affected (0.00 sec)set global wait_timeout=600;Query OK, 0 rows affected (0.00 sec)select @@max_connections;+-------------------+| @@max_connections |+-------------------+| 200 |+-------------------+1 row in set (0.00 sec)show global variables like 'wait_timeout';+---------------+-------+| Variable_name | Value |+---------------+-------+| wait_timeout | 600 |+---------------+-------+1 row in set (0.00 sec)
在线修改完成之后需要手动修改my.cnf配置文件,防止重启之后在线设置失效。
3. ClickHouse
对于ClickHouse而言,配置文件实时生效很是方便。
vim /etc/clickhouse/config.xml<max_connections>4096</max_connections><keep_alive_timeout>3</keep_alive_timeout><max_concurrent_queries>100</max_concurrent_queries>
除过以上参数的资源限制,更多查询配额、权限相关详细信息请点击:ClickHouse的用户配置详解及SQL化用户配置
更多精彩内容欢迎关注

上一篇:Clickhouse - System Tables 集合(二)
近期文章推荐:




