Redis 集群方法

Redis 集群方法

配置Redis

为了方便管理,我们将统一的配置放到 cluster.conf 文件中,别的文件引入该文件:

bind 127.0.0.1
protected-mode yes
port 6370
tcp-backlog 511
timeout 0
tcp-keepalive 0
loglevel notice
logfile "./redis.log"
databases 100
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename master.rdb
dir ./
#slaveof 10.1.1.105 6379
#masterauth  admin123
#将次 Redis 实例中启用 Redis Cluster 支持。否则,实例通常作为独立实例启动 
cluster-enabled yes  
#这是集群中的节点能够失联的最大时间,超过这个时间,该节点就会被认为故障。 
cluster-node-timeout 15000 
#此配置文件不能人工编辑,它是集群节点自动维护的文件,主要用于记录集群中有哪些节点、他们的状态以及一些持久化参数等,方便在重启时恢复这些状态
cluster-config-file master-cluster.config
slave-serve-stale-data yes
slave-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-disable-tcp-nodelay no
slave-priority 100
#密码,这里可以不设置,设置的话启动集群管理的时候会报错,下文会讲解错误的解决方法
requirepass admin123
appendonly no
appendfilename "appendonly6370.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes
文件目录如下
└── cluster
    ├── 6370
    │   ├── 6370.conf
    │   ├── master-cluster.config
    │   ├── master.rdb
    │   └── redis.log
    ├── 6371
    │   ├── 6371.conf
    │   ├── master-cluster.config
    │   ├── master.rdb
    │   └── redis.log
    ├── 6372
    │   ├── 6372.conf
    │   ├── master-cluster.config
    │   └── redis.log
    ├── 6373
    │   ├── 6373.conf
    │   ├── master-cluster.config
    │   └── redis.log
    ├── 6374
    │   ├── 6374.conf
    │   ├── master-cluster.config
    │   └── redis.log
    ├── 6375
    │   ├── 6375.conf
    │   ├── master-cluster.config
    │   └── redis.log
    └── cluster.conf

其中文件夹名为端口号,我们只拿 6370 看一眼看(别的只是修改一下端口号):

参考更多免费资料请加入Redis缓存技术交流组:288724942


include /root/redis/cluster/cluster.conf
port 6370

怎么样是不是很简单呢?

我们在每个端口的目录下启动各自的 redis :

[coderknock 6370]# redis-server 6370.conf

按照上面的模式我们将设置的 6 个 redis 启动。

安装 ruby

参考更多免费资料请加入Redis缓存技术交流组:288724942

[root@iZ28glf0u1jZ ~]# sudo yum install ruby
Loaded plugins: security
Setting up Install Process
base                                                                                                                 | 3.7 kB     00:00
elrepo                                                                                                               | 2.9 kB     00:00
epel                                                                                                                 | 4.3 kB     00:00
extras                                                                                                               | 3.3 kB     00:00
fpco                                                                                                                 | 2.9 kB     00:00
updates                                                                                                              | 3.4 kB     00:00
updates/primary_db                                                                                                   | 817 kB     00:00
Resolving Dependencies
--> Running transaction check
---> Package ruby.i686 0:1.8.7.374-5.el6 will be installed
--> Processing Dependency: ruby-libs = 1.8.7.374-5.el6 for package: ruby-1.8.7.374-5.el6.i686
--> Processing Dependency: libruby.so.1.8 for package: ruby-1.8.7.374-5.el6.i686
--> Running transaction check
---> Package ruby-libs.i686 0:1.8.7.374-5.el6 will be installed
--> Processing Dependency: libreadline.so.5 for package: ruby-libs-1.8.7.374-5.el6.i686
--> Running transaction check
---> Package compat-readline5.i686 0:5.2-17.1.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

============================================================================================================================================
 Package                                Arch                       Version                                 Repository                  Size
============================================================================================================================================
Installing:
 ruby                                   i686                       1.8.7.374-5.el6                         base                       538 k
Installing for dependencies:
 compat-readline5                       i686                       5.2-17.1.el6                            base                       128 k
 ruby-libs                              i686                       1.8.7.374-5.el6                         base                       1.6 M

Transaction Summary
============================================================================================================================================
Install       3 Package(s)

Total download size: 2.3 M
Installed size: 7.8 M
Is this ok [y/N]: 也
Is this ok [y/N]: y
Downloading Packages:
(1/3): compat-readline5-5.2-17.1.el6.i686.rpm                                                                        | 128 kB     00:00
(2/3): ruby-1.8.7.374-5.el6.i686.rpm                                                                                 | 538 kB     00:00
(3/3): ruby-libs-1.8.7.374-5.el6.i686.rpm                                                                            | 1.6 MB     00:01
--------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                       1.1 MB/s | 2.3 MB     00:02
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : compat-readline5-5.2-17.1.el6.i686                                                                                       1/3
  Installing : ruby-libs-1.8.7.374-5.el6.i686                                                                                           2/3
  Installing : ruby-1.8.7.374-5.el6.i686                                                                                                3/3
  Verifying  : compat-readline5-5.2-17.1.el6.i686                                                                                       1/3
  Verifying  : ruby-1.8.7.374-5.el6.i686                                                                                                2/3
  Verifying  : ruby-libs-1.8.7.374-5.el6.i686                                                                                           3/3

Installed:
  ruby.i686 0:1.8.7.374-5.el6

Dependency Installed:
  compat-readline5.i686 0:5.2-17.1.el6                                   ruby-libs.i686 0:1.8.7.374-5.el6

Complete!

安装 rubygems

参考更多免费资料请加入Redis缓存技术交流组:288724942

[root@iZ28glf0u1jZ ~]# yum -y install ruby rubygems
Loaded plugins: security
Setting up Install Process
Package ruby-1.8.7.374-5.el6.i686 already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package rubygems.noarch 0:1.3.7-5.el6 will be installed
--> Processing Dependency: ruby-rdoc for package: rubygems-1.3.7-5.el6.noarch
--> Running transaction check
---> Package ruby-rdoc.i686 0:1.8.7.374-5.el6 will be installed
--> Processing Dependency: ruby-irb = 1.8.7.374-5.el6 for package: ruby-rdoc-1.8.7.374-5.el6.i686
--> Running transaction check
---> Package ruby-irb.i686 0:1.8.7.374-5.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================================================================================
 Package                                         Arch                                         Version                                                 Repository                                  Size
=======================================================================================================================================================================================================
Installing:
 rubygems                                        noarch                                       1.3.7-5.el6                                             base                                       207 k
Installing for dependencies:
 ruby-irb                                        i686                                         1.8.7.374-5.el6                                         base                                       318 k
 ruby-rdoc                                       i686                                         1.8.7.374-5.el6                                         base                                       381 k

Transaction Summary
=======================================================================================================================================================================================================
Install       3 Package(s)

Total download size: 905 k
Installed size: 3.0 M
Downloading Packages:
(1/3): ruby-irb-1.8.7.374-5.el6.i686.rpm                                                                                                                                        | 318 kB     00:00     
(2/3): ruby-rdoc-1.8.7.374-5.el6.i686.rpm                                                                                                                                       | 381 kB     00:00     
(3/3): rubygems-1.3.7-5.el6.noarch.rpm                                                                                                                                          | 207 kB     00:00     
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                  1.7 MB/s | 905 kB     00:00     
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : ruby-irb-1.8.7.374-5.el6.i686                                                                                                                                                       1/3 
  Installing : ruby-rdoc-1.8.7.374-5.el6.i686                                                                                                                                                      2/3 
  Installing : rubygems-1.3.7-5.el6.noarch                                                                                                                                                         3/3 
  Verifying  : ruby-rdoc-1.8.7.374-5.el6.i686                                                                                                                                                      1/3 
  Verifying  : rubygems-1.3.7-5.el6.noarch                                                                                                                                                         2/3 
  Verifying  : ruby-irb-1.8.7.374-5.el6.i686                                                                                                                                                       3/3 

Installed:
  rubygems.noarch 0:1.3.7-5.el6                                                                                                                                                                        

Dependency Installed:
  ruby-irb.i686 0:1.8.7.374-5.el6                                                                   ruby-rdoc.i686 0:1.8.7.374-5.el6                                                                  

Complete!
安装配置集群管理

安装 ruby 下的 redis 管理工具

gem install redis

启动集群管理

找到 redis 源码包中 src 下的 redis-trib.rb 或者下载一个该文件也可以

[coderknock redis]# /root/redis-3.2.0/src/redis-trib.rb create --replicas 1 127.0.0.1:6370 127.0.0.1:6371 127.0.0.1:6372 127.0.0.1:6373 127.0.0.1:6374 127.0.0.1:6375
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
127.0.0.1:6370
127.0.0.1:6371
127.0.0.1:6372
Adding replica 127.0.0.1:6373 to 127.0.0.1:6370
Adding replica 127.0.0.1:6374 to 127.0.0.1:6371
Adding replica 127.0.0.1:6375 to 127.0.0.1:6372
M: f9acf4403c84c23ee9a79952e1f26a02cca40647 127.0.0.1:6370
   slots:0-5460 (5461 slots) master
M: f070ba8fedc4e9240c35b33684554080d0e2f7da 127.0.0.1:6371
   slots:5461-10922 (5462 slots) master
M: ae1502fbdfe2823dff2836ff61664da5affbd7e4 127.0.0.1:6372
   slots:10923-16383 (5461 slots) master
S: b1c4a2eeff66c8d5f1997d3a3210120552f7bc72 127.0.0.1:6373
   replicates f9acf4403c84c23ee9a79952e1f26a02cca40647
S: 8d661ae944b842b21739aff41ce7005ed30ccaad 127.0.0.1:6374
   replicates f070ba8fedc4e9240c35b33684554080d0e2f7da
S: 429fea95c1428e6cfa39a3a0b0d67fa8e2c606d2 127.0.0.1:6375
   replicates ae1502fbdfe2823dff2836ff61664da5affbd7e4
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join.....
>>> Performing Cluster Check (using node 127.0.0.1:6370)
M: f9acf4403c84c23ee9a79952e1f26a02cca40647 127.0.0.1:6370
   slots:0-5460 (5461 slots) master
M: f070ba8fedc4e9240c35b33684554080d0e2f7da 127.0.0.1:6371
   slots:5461-10922 (5462 slots) master
M: ae1502fbdfe2823dff2836ff61664da5affbd7e4 127.0.0.1:6372
   slots:10923-16383 (5461 slots) master
M: b1c4a2eeff66c8d5f1997d3a3210120552f7bc72 127.0.0.1:6373
   slots: (0 slots) master
   replicates f9acf4403c84c23ee9a79952e1f26a02cca40647
M: 8d661ae944b842b21739aff41ce7005ed30ccaad 127.0.0.1:6374
   slots: (0 slots) master
   replicates f070ba8fedc4e9240c35b33684554080d0e2f7da
M: 429fea95c1428e6cfa39a3a0b0d67fa8e2c606d2 127.0.0.1:6375
   slots: (0 slots) master
   replicates ae1502fbdfe2823dff2836ff61664da5affbd7e4
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.

这样就启动成功了。

[ERR] Sorry, can't connect to node 127.0.0.1:6370

出现这个可能的原因是 ruby 版本太低,升级之前安装的那几个东西。还有可能就是设置了 redis 密码的缘故。

找到 usr/lib/ruby/gems/1.8/gems/redis-3.3.3/lib/redis,编辑 client.rb:

require "redis/errors"
require "socket"
require "cgi"

class Redis
  class Client

    DEFAULTS = {
      :url => lambda { ENV["REDIS_URL"] },
      :scheme => "redis",
      :host => "127.0.0.1",
      :port => 6379,
      :path => nil,
      :timeout => 5.0,
      :password => "admin123",//这里设置你的密码
      :db => 0,
      :driver => nil,
      :id => nil,
      :tcp_keepalive => 0,
      :reconnect_attempts => 1,
      :inherit_socket => false
    } 

    def options
      Marshal.load(Marshal.dump(@options))
    end  

    def scheme
      @options[:scheme] 
    end

    def host
      @options[:host] 
    end

    def port
      @options[:port]
    end

    def path
      @options[:path]

然后就可以正常启动了。

测试

集群中使用 redis-cli 应该 使用 -c 参数启动,并且不支持 select 等操作(具体可以查看官网)

[coderknock redis]# redis-cli -c -p 6371 -a admin123
127.0.0.1:6371> keys *
(empty list or set)
127.0.0.1:6371> get admin
-> Redirected to slot [1358] located at 127.0.0.1:6370
"123"
127.0.0.1:6370> set admin aa123
OK
127.0.0.1:6370> get admin
"aa123"
127.0.0.1:6370> quit
[coderknock redis]# redis-cli -c -p 6370 -a admin123
127.0.0.1:6370> get admin
"aa123"
127.0.0.1:6370> 
[coderknock redis]# redis-cli -c -p 6373 -a admin123
127.0.0.1:6373> get admin
-> Redirected to slot [1358] located at 127.0.0.1:6370
"aa123"
127.0.0.1:6370> set admin 73
OK
127.0.0.1:6370> get admin
"73"
127.0.0.1:6370> quit
[coderknock redis]# redis-cli -c -p 6370 -a admin123
127.0.0.1:6370> get admin
"73"

Java Jedis 访问

import redis.clients.jedis.HostAndPort;
import redis.clients.jedis.JedisCluster;
import redis.clients.jedis.JedisPoolConfig;

import java.util.HashSet;
import java.util.Set;

/**
 *  *
 * @author 三产
 * @version 1.0
 * @date 2017-05-25
 * @QQGroup 213732117
 * @website http://www.coderknock.com
 * @copyright Copyright 2017 拿客 coderknock.com  All rights reserved.
 * @since JDK 1.8
 */
public class Test {
    /**
     * 获取配置的主从 Redis
     *
     * @param serverInfo
     * @return
     */
    private static Set
编辑于 2017-06-27 14:34