Apache Flink 是一個分布式大數(shù)據(jù)計算引擎，專為處理無界和有界數(shù)據(jù)流上的有狀態(tài)計算而設(shè)計，以其高吞吐量、低延遲和高性能在實時流處理和批量計算領(lǐng)域脫穎而出，F(xiàn)link 支持批流一體化，即能夠同時處理實時數(shù)據(jù)流和靜態(tài)數(shù)據(jù)集，使得數(shù)據(jù)處理更加靈活高效

華為云端口放行

?服務(wù)器放行對應(yīng)端口 8082

Docker 安裝并配置鏡像加速

1、購買華為云 Flexus X 實例

Flexus云服務(wù)器X實例-華為云 (huaweicloud.com)

2、docker 安裝

yuminstall -ydocker-ce

3、驗證 Docker 是否安裝成功，啟動 docker 服務(wù)并設(shè)置開機自啟動，且查看 docker 狀態(tài)

docker --versionsystemctl enable dockersystemctl start dockersystemctl status docker

4、docker-ce 下載

wget-O/etc/yum.repos.d/docker-ce.repo https://mirrors.huaweicloud.com/docker-ce/linux/centos/docker-ce.repo

5、路徑/etc/yum.repos.d 修改配置文件

[docker-ce-stable]name=Docker CEStable -$basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/$basearch/stableenabled=1gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-stable-debuginfo]name=Docker CEStable -Debuginfo $basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/debug-$basearch/stableenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-stable-source]name=Docker CEStable -Sourcesbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/source/stableenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-test]name=Docker CETest -$basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/$basearch/testenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-test-debuginfo]name=Docker CETest -Debuginfo $basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/debug-$basearch/testenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-test-source]name=Docker CETest -Sourcesbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/source/testenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-nightly]name=Docker CENightly -$basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/$basearch/nightlyenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-nightly-debuginfo]name=Docker CENightly -Debuginfo $basearchbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/debug-$basearch/nightlyenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg[docker-ce-nightly-source]name=Docker CENightly -Sourcesbaseurl=https://repo.huaweicloud.com/docker-ce/linux/centos/9.9/source/nightlyenabled=0gpgcheck=1gpgkey=https://repo.huaweicloud.com/docker-ce/linux/centos/gpg

6、清除和構(gòu)建緩存

yumclean allyummakecache

7、docker 配置鏡像加速（在華為云鏡像中心可獲取自己的鏡像加速配置）

8、創(chuàng)建鏡像加速配置文件

vim/etc/docker/daemon.json

{"registry-mirrors":[ "https://fd0cfec0ac0d446db7fd9d27e92d4a8e.mirror.swr.myhuaweicloud.com"]}

9、重新加載配置文件，重新啟動 docker，查看是否配置成功

systemctldaemon-reloadsystemctlrestart docker.service

10、docker info 查看配置信息，是否配置成功鏡像加速

dockerinfo

搭建 Flink

1、創(chuàng)建文件夾

mkdir /flink

2、編寫 docker-compose.yml 文件

vim docker-compose.yml

version:"2.2"services:jobmanager:image:flink:1.14.4-scala_2.11ports:-"8082:8082"command:jobmanagerenvironment:-|FLINK_PROPERTIES=jobmanager.rpc.address:jobmanager taskmanager:image:flink:1.14.4-scala_2.11depends_on:-jobmanagercommand:taskmanagerscale:1environment:-|FLINK_PROPERTIES=jobmanager.rpc.address:jobmanagertaskmanager.numberOfTaskSlots:2

3、運行 docker-compose.yml 文件

docker-composeup -d

4、關(guān)閉服務(wù)器防火墻

systemctlstop firewalldsystemctlstatus firewalld

5、瀏覽器地址訪問公網(wǎng) IP:8082

總結(jié)

華為云服務(wù)器 Flexus X 實例，Docker 集成搭建搭建 Flink，F(xiàn)link 能夠同時處理實時數(shù)據(jù)流和靜態(tài)數(shù)據(jù)集，使得數(shù)據(jù)處理更加靈活高效，歡迎搭建一起購買華為云服務(wù)器搭建，目前服務(wù)器正在大力促銷優(yōu)惠，有需要的小伙伴可以購買！

華為云828 Flexus X實例

審核編輯 黃宇