安装配置视频教程
创建solr索引视频教程
启动atlas视频教程
安装步骤
1、solrC1节点，启动整个集群
2、solrC2节点，在hadoop用户下，cd /hadoop/Atlas
3、tar -xf apache-atlas-2.1.0-server.tar.gz
4、cd apache-atlas-2.1.0
5、修改conf/atlas-application.properties
1)HBase相关配置
atlas.graph.storage.hostname=app-11:2181,app-12:2181,app-13:2181
2)Solr相关配置
atlas.graph.index.search.solr.zookeeper-url=app-11:2181,app-12:2181,app-13:2181
3)Kafka相关配置
atlas.notification.embedded=false
atlas.kafka.data=/hadoop/Kafka/kafka_2.11-2.2.0/kafka-logs
atlas.kafka.zookeeper.connect=app-11:2181,app-12:2181,app-13:2181
atlas.kafka.bootstrap.servers=app-11:9092,app-12:9092,app-13:9092
4)Atlas Server相关配置
atlas.rest.address=http://app-12:21000
atlas.server.run.setup.on.start=false
atlas.audit.hbase.zookeeper.quorum=app-11:2181,app-12:2181,app-13:2181
5)增加Hive相关配置
#Apache Atlas Hook & Bridge for Apache Hive
atlas.hook.hive.synchronous=false
atlas.hook.hive.numRetries=3
atlas.hook.hive.queueSize=10000
atlas.cluster.name=primary
6、修改atlas-env.sh
增加
export HBASE_CONF_DIR=/hadoop/HBase/hbase-2.2.0/conf
7、集成Hive
1)在/hadoop/Hive/apache-hive-3.1.1-bin/conf/hive-site.xml中增加
<property><name>hive.exec.post.hooks</name><value>org.apache.atlas.hive.hook.HiveHook</value></property>
2)拷贝atlas-application.properties到hive的conf目录下
cp /hadoop/Atlas/apache-atlas-2.1.0/conf/atlas-application.properties /hadoop/Hive/apache-hive-3.1.1-bin/conf/
3)解压hive-hook到atlas-2.1.0目录下
tar -xf /hadoop/Atlas/apache-atlas-2.1.0-hive-hook.tar.gz -C /hadoop/Atlas/apache-atlas-2.1.0/ --strip-components 1
4)拷贝hive-hook的所有jar包到hive的lib目录下
cp -r /hadoop/Atlas/apache-atlas-2.1.0/hook/hive/* /hadoop/Hive/apache-hive-3.1.1-bin/lib/
8、创建solr索引
/hadoop/Solr/solr-7.7.3/bin/solr create -c vertex_index -d /hadoop/Atlas/apache-atlas-2.1.0/conf/solr -shards 3 -replicationFactor 2
/hadoop/Solr/solr-7.7.3/bin/solr create -c edge_index -d /hadoop/Atlas/apache-atlas-2.1.0/conf/solr -shards 3 -replicationFactor 2
/hadoop/Solr/solr-7.7.3/bin/solr create -c fulltext_index -d /hadoop/Atlas/apache-atlas-2.1.0/conf/solr -shards 3 -replicationFactor 2
9、启动Atlas
nohup /bin/python /hadoop/Atlas/apache-atlas-2.1.0/bin/atlas_start.py > /hadoop/Atlas/apache-atlas-2.1.0/startAtlas.log 2>&1 &