47 Star 134 Fork 71

supermy / hadoop-docker-nn

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
build-snappy-spark.sh 1.89 KB
一键复制 编辑 原始数据 按行查看 历史
supermy 提交于 2015-12-15 09:28 . 升级优化
#!/usr/bin/env bash
# build all docker images except supermy/cloud-cdh5:latest
# base
# hdfs
##第一次构造的时候放开,从网络同步资源,需要较好的带宽
docker build -t supermy/cloud-cdh5:snappy -f Dockerfile-snappy-spark.conf .
#sed s/cdh5\:latest/cdh5\:snappy/ hdfs/nn/Dockerfile > hdfs/nn/Dockerfile-snappy-spark
#sed s/cdh5\:latest/cdh5\:snappy/ hdfs/dn/Dockerfile > hdfs/dn/Dockerfile-snappy-spark
#sed s/cdh5\:latest/cdh5\:snappy/ hdfs/yarn/Dockerfile > hdfs/yarn/Dockerfile-snappy-spark
docker build -t supermy/cloud-nn:snappy -f hdfs/nn/Dockerfile-snappy-spark hdfs/nn/
docker build -t supermy/cloud-dn:snappy -f hdfs/dn/Dockerfile-snappy-spark hdfs/dn/
docker build -t supermy/cloud-yarn:snappy -f hdfs/yarn/Dockerfile-snappy-spark hdfs/yarn/
# hbase+hive
#第一次构造的时候放开,从网络同步资源,需要较好的带宽
#加入压缩
docker build -t supermy/cloud-hbase:snappy -f hbase/Dockerfile-snappy-spark hbase/
#sed s/hbase\:cdh5/hbase\:snappy/ hbase/hmaster/Dockerfile > hbase/hmaster/Dockerfile-snappy-spark
#sed s/hbase\:cdh5/hbase\:snappy/ hbase/hregionserver/Dockerfile > hbase/hregionserver/Dockerfile-snappy-spark
#sed s/hbase\:cdh5/hbase\:snappy/ hbase/init-hive-hbase/Dockerfile > hbase/init-hive-hbase/Dockerfile-snappy-spark
docker build -t supermy/cloud-hb:snappy -f hbase/hmaster/Dockerfile-snappy-spark hbase/hmaster/
docker build -t supermy/cloud-rs:snappy -f hbase/hregionserver/Dockerfile-snappy-spark hbase/hregionserver/
docker build -t supermy/cloud-initdb:snappy -f hbase/init-hive-hbase/Dockerfile-snappy-spark hbase/init-hive-hbase/
#减少空间占用,删除压缩模式的镜像包
#docker images|grep cdh5|grep -v snappy-spark|grep -v hbase|grep -v yarn|grep -v latest|awk '{print $3}'|xargs docker rmi
#docker ps -a|awk '{print $1}'|xargs docker rm
docker images|grep none|awk '{print $3}'|xargs docker rmi
docker images|grep jamesmo
Docker
1
https://gitee.com/supermy/hadoop-docker-nn.git
git@gitee.com:supermy/hadoop-docker-nn.git
supermy
hadoop-docker-nn
hadoop-docker-nn
master

搜索帮助