Mysql remote connections very slow - host lookups already disabled

Mysql remote connections very slow - host lookups already disabled

I followed every instruction about this issue and nothing helped. Remote
communication with MySQL server takes 4-30 seconds on simple query like
select 1 from table_name and connection attempt often ends up with
SQLSTATE[HY000] [2013] Lost connection to MySQL server at 'reading
authorization packet', system error: 104. This is what I did so far:
[mysqld]
skip-name-resolve
skip-host-cache
bind-address = 37.187.60.211
I set all Host column values in the grant tables to remote IP address or
localhost.
I allowed incoming traffic on port 3306.
Performed tests with every service disabled on the host except MySQL
server. Tested from my home and other vps using mysql client.
I hope you can help me, thank you