centos Samba文件共享
2019-05-06 06:51:53    38    0    0

安装samba

  1. yum -y install samba samba-client

配置

  1. cd /etc/samba/
  2. 备份smb.conf
  3. cp smb.conf smb.conf.origin
  4. vim smb.conf
  6. service smb restart
  8. smbpasswd -a root
  10. vi /etc/samba/smbusers
  11. root = admin xxx bbb

smb.conf

  1. [global]
  2.         interfaces = lo eth0 eth1
  3.         log file = /var/log/samba/log.%m
  4.         max log size = 50
  5.         netbios name = SMBSERVER
  6.         printcap name = cups
  7.         security = USER
  8.         server string = Samba Server Version %v
  9.         smb passwd file = /etc/samba/smbpasswd
  10.         username map = /etc/samba/smbusers
  11.         idmap config * : backend = tdb
  12.         cups options = raw
  13.         max connections = 10
  16. [ossdata]
  17.         admin users = root
  18.         browseable = No
  19.         comment = ossdata Directories
  20.         inherit acls = Yes
  21.         path = /ossdata/samba
  22.         read only = No
  23.         valid users = %S %D%w%S
  24.         write list = root
  27. [printers]
  28.         browseable = No
  29.         comment = All Printers
  30.         create mask = 0600
  31.
Centos nfs安装
2019-05-06 06:51:53    63    0    0

配置NFS SERVER

  1. yum -y install nfs-utils
  3. vi /etc/idmapd.conf
  4. # line 5: uncomment and change to your domain name
  5. Domain = vdevops.org
  7. vi /etc/exports
  8. # write settings for NFS exports
  9. /home 10.1.1.0/24(rw,no_root_squash)
  12. systemctl start rpcbind nfs-server
  13. systemctl enable rpcbind nfs-server 
  15. showmount -e    #查看NFS共享的目录
  17. #防火墙开启情况下，做如下配置
  18. firewall-cmd --add-service=nfs --permanent
  19. firewall-cmd --reload
阿里云oss挂载
2019-05-06 06:51:53    42    0    0

安装ossfs

  1. wget http://docs-aliyun.cn-hangzhou.oss.aliyun-inc.com/assets/attach/32196/cn_zh/1527232195135/ossfs_1.80.5_centos7.0_x86_64.rpm?spm=a2c4g.11186623.2.6.WVXUpG&file=ossfs_1.80.5_centos7.0_x86_64.rpm
  2. yum localinstall ossfs_1.80.5_centos7.0_x86_64.rpm

设置AccessKeyId

设置bucket name 和 AccessKeyId/Secret信息，将其存放在/etc/passwd-ossfs 文件中，注意这个文件的权限必须正确设置，建议设为640。

  1. echo my-bucket:my-access-key-id:my-access-key-secret > /etc/passwd-ossfs
  2. chmod 640 /etc/passwd-ossfs

将OSS bucket mount到指定目录。

  1. ossfs my-bucket my-mount-point -ourl=my-oss-endpoint

示例

  1. echo my-bucket:faint:123 > /etc/passwd-ossfs
  2. chmod 640 /etc/passwd-ossfs
  3. mkdir /tmp/ossfs
  4. ossfs my-bucket /tmp/ossfs -ourl=http://oss-cn-hangzhou.aliyuncs.com
Presto Installation
2019-05-06 06:51:53    113    0    0

Installing Presto

Download the Presto server tarball

https://repo1.maven.org/maven2/com/facebook/presto/presto-server/0.203/presto-server-0.203.tar.gz

and unpack it. The tarball will contain a single top-level directory, presto-server-0.203, which we will call the installation directory.

Configuring Presto

Create an etc directory inside the installation directory. This will hold the following configuration:

  • Node Properties: environmental configuration specific to each node
  • JVM Config: command line options for the Java Virtual Machine
  • Config Properties: configuration for the Presto server
  • Catalog Properties: configuration for Connectors (data sources)

Node Properties

The node properties file, etc/node.properties, contains configuration specific to each node. A node is a single installed instance of Presto on a machine. This file is typically created by the deployment system when Presto is first installed. The follow

ELK
2019-05-06 06:51:53    99    0    0

Elasticsearch

installation

Elasticsearch requires at least Java 8

  1. java -version
  2. echo $JAVA_HOME
  4. curl -L -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.1.0.tar.gz
  5. tar -xvf elasticsearch-6.1.0.tar.gz
  6. cd elasticsearch-6.1.0/bin
  8. //install x-pack
  9. bin/elasticsearch-plugin install x-pack

configuration

  1. cluster.name: cluster-01
  2. node.name: node-01
  3. path.data: /home/elk/elasticsearch-6.1.0/data
  4. path.logs: /home/elk/elasticsearch-6.1.0/logs
  5. network.host: 0.0.0.0
  6. http.port: 9200
  7. discovery.zen.ping.unicast.hosts: ["103.29.70.96","139.162.88.149"]
  8. discovery.zen.minimum_master_nodes: 2

starting

  1. ./elasticsearch -d -p pidfile
  2. tail -100f ../logs/cluster-01.log

Set the passwords for all built-in users

  1. bin/x-pack/setup-passwords interactive
  3. Enter password for [elastic]: 
  4. Reenter password for [elastic]: 
  5. Enter password for [kibana]: 
  6. Reenter password for [kibana]: 
  7. Enter password for [logstash_system]: 
  8. Reenter password for [logsta
Dubbo安装
2019-05-06 06:51:53    63    0    0

Zookeeper注册中心安装

Zookeeper安装

Simple 监控中心安装

  1. wget wget https://codeload.github.com/alibaba/dubbo/tar.gz/dubbo-2.5.7
  2. tar zxvf dubbo-2.5.7
  3. cd dubbo-dubbo-2.5.7/
  4. mvn -Dmaven.test.skip=true clean install 
  6. find . -name dubbo-monitor-simple*gz
  7. mkdir ~/dubbo-monitor
  8. mv ./dubbo-simple/dubbo-monitor-simple/target/dubbo-monitor-simple-2.5.7-assembly.tar.gz ~/dubbo-monitor
  9. cd ~/dubbo-monitor
  10. ./dubbo-simple/dubbo-monitor-simple/target/dubbo-monitor-simple-2.5.7-assembly.tar.gz
  11. tar zxvf dubbo-monitor-simple-2.5.7-assembly.tar.gz 
  12. cd dubbo-monitor-simple-2.5.7
  14. #修改配置
  15. vi conf/dubbo.properties
  16. dubbo.registry.address=zookeeper://112.74.198.224:21888
  17. dubbo.protocol.host=0.0.0.0
  19. #启动
  20. cd bin
  21. ./start.sh
  22. ./bin/start.sh debug
  24. #总控入口:
  25. ./bin/server.sh start
  26. ./bin/server.sh stop
  27. ./bin/server.sh restart
  28. ./bin/server.sh debug
  29. ./bin/server.sh dump
  31. #命令行 
  32. telnet 127.0.0.1 7070
  33. help
  35. echo status | nc -i 1 127.0.0.1 7070
  37. #访问
  38. http://127.0.0.1:8080

dubbo管理控制台

  1. find . -name dubbo-admin*war
  2. w
SaltStack
2019-05-06 06:51:53    15    0    0

http://docs.saltstack.cn/topics/installation/rhel.html

kettle安装部署
2019-05-06 06:51:53    34    0    0

下载安装

  1. https://nchc.dl.sourceforge.net/project/pentaho/Data%20Integration/7.1/pdi-ce-7.1.0.0-12.zip
  2. unzip pdi-ce-7.1.0.0-12.zip

carte

  1. 启动carte web服务器
  3. ./carte.sh 127.0.0.1 8081
  5. 密码文件

spoon

修改文件编码

  1. vi spoon.sh
  2. # add -Dfile.encoding=UTF-8
  4. if "%PENTAHO_DI_JAVA_OPTIONS%"=="" set PENTAHO_DI_JAVA_OPTIONS="-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dfile.encoding=UTF-8"
PgAgent Jobs
2019-05-06 06:51:53    71    0    0

pgAgent is a job scheduling agent for PostgreSQL, capable of running multi-step batch/shell and SQL tasks on complex schedules.

Codis集群搭建
2019-05-06 06:51:53    367    0    0

Codis组件说明

title

Codis Server

基于 redis-3.2.8 分支开发。增加了额外的数据结构，以支持 slot 有关的操作以及数据迁移指令。具体的修改可以参考文档 redis 的修改。

Codis Proxy

客户端连接的 Redis 代理服务, 实现了 Redis 协议。 除部分命令不支持以外(不支持的命令列表)，表现的和原生的 Redis 没有区别（就像 Twemproxy）

  • 对于同一个业务集群而言，可以同时部署多个 codis-proxy 实例
  • 不同 codis-proxy 之间由 codis-dashboard 保证状态同步。

Codis Dashboard

集群管理工具，支持 codis-proxy、codis-server 的添加、删除，以及据迁移等操作。在集群状态发生改变时，codis-dashboard 维护集群下所有 codis-proxy 的状态的一致性。

  • 对于同一个业务集群而言，同一个时刻 codis-dashboard 只能有 0个或者1个；
  • 所有对集群的修改都必须通过 codis-dashboard 完成。

Codis Admin

集群管理的命令行工具。

可用于控制 codis-proxy、codis-dashboard 状态以及访问外部存储。

Codis FE

集群管理界面

  • 多个集群实例共享可以共享同一个前端展示页面；
  • 通过配置文件管理后端 codis-dashboard 列表，配置文件可自动更新。

Storage

为集群状态提供外部存储。

  • 提供 Namespace 概念，不同集群的会按照不同 product name 进行组织；
  • 目前仅提供了 Zookeeper、Etcd、Fs 三种实现，但是提供了抽象的 interface 可自行扩展。

Codis集群搭建

安装zookeeper

zookeeper集群安装

下载codis

https://github.com/CodisLabs/codis/releases

修改Codis配置

修改dashboard配置

  1. # Set Coordinat
4/9
Proudly powered by Leanote