cdh5beta2集群配置文件的示例分析
这篇文章给大家分享的是有关cdh5 beta2集群配置文件的示例分析的内容。小编觉得挺实用的,因此分享给大家做个参考,一起跟随小编过来看看吧。
目前创新互联建站已为超过千家的企业提供了网站建设、域名、网页空间、网站改版维护、企业网站设计、建瓯网站维护等服务,公司将坚持客户导向、应用为本的策略,正道将秉承"和谐、参与、激情"的文化,与客户和合作伙伴齐心协力一起成长,共同发展。
注意:需要自己配置java环境,ssh通信 版本:hadoop:hadoop-2.2.0-cdh6.0.0-beta-2.tar.gz zookeeper:zookeeper-3.4.5-cdh6.0.0-beta-2.tar.gz hbase:hbase-0.96.1.1-cdh6.0.0-beta-2.tar.gz 下载地址:http://archive.cloudera.com/cdh6/cdh/5/ Hadoop: core-site.xml ============================================================================================= hdfs-site.xml ================================================== fs.default.name hdfs://master:8020 true dfs.namenode.name.dir /usr/local/hd/dfs/name hadoop.tmp.dir /usr/local/hd/tmp A base for other temporary directories. hadoop.proxyuser.hadoop.hosts * hadoop.proxyuser.hadoop.groups * =============================================================== maped-site.xml =============================================================== dfs.datanode.data.dir /usr/local/hd/dfs/data dfs.replication 2 dfs.permissions false dfs.namenode.secondary.http-address master:8021 dfs.webhdfs.enabled true dfs.web.ugi hadoop,supergroup,zzg ================================================================= yarn-site.xml =============================================================== mapreduce.framework.name yarn mapreduce.jobhistory.address master:10020 mapreduce.jobhistory.webapp.address master:19888 ============================================================ zookeeper zoo.cfg ========================================================== # The number of milliseconds of each tick tickTime=2000 # The number of ticks that the initial # synchronization phase can take initLimit=10 # The number of ticks that can pass between # sending a request and getting an acknowledgement syncLimit=5 # the directory where the snapshot is stored. # do not use /tmp for storage, /tmp here is just # example sakes. dataDir=/usr/local/hd/zookeeper/data # the port at which the clients will connect clientPort=2181 server.1=master:2888:3888 server.2=slave1:2888:3888 server.3=slave2:2888:3888 # # Be sure to read the maintenance section of the # administrator guide before turning on autopurge. # # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance # # The number of snapshots to retain in dataDir #autopurge.snapRetainCount=3 # Purge task interval in hours # Set to "0" to disable auto purge feature #autopurge.purgeInterval=1 ========================================================== hbase hbase-site.xml ======================================================== yarn.resourcemanager.address master:8032 yarn.resourcemanager.scheduler.address master:8030 yarn.resourcemanager.resource-tracker.address master:8031 yarn.resourcemanager.admin.address master:8033 yarn.resourcemanager.webapp.address master:8088 yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler =========================================================== hbase.rootdir hdfs://master:8020/hbase hbase.cluster.distributed true hbase.zookeeper.quorum master,slave1,slave2 hbase.zookeeper.property.clientPort 2181 hbase.zookeeper.property.dataDir /usr/local/hd/zookeeper/data
感谢各位的阅读!关于“cdh5 beta2集群配置文件的示例分析”这篇文章就分享到这里了,希望以上内容可以对大家有一定的帮助,让大家可以学到更多知识,如果觉得文章不错,可以把它分享出去让更多的人看到吧!
文章题目:cdh5beta2集群配置文件的示例分析
网站链接:http://scgulin.cn/article/ihcdjo.html