91ÊÓƵרÇø

Apache Pulsarxuexibiji14: shiyongHelmzaiKubernetesjiqunzhongbushuPulsaryuanchuang2021-12-31 18:22¡¤jiagouxiaobaishijianguodebijiaojiuliao£¬zaikaishijintiandexuexizhiqianxianhuiguyixiaqianmianyijingxuexide13jiedeneirong¡£0.jieduanfuxiPulsarshiyigezhichiduozuhude¡¢gaoxingnengde¡¢fenbushidePub-Subxiaoxixitong¡£liaojiePulsardejiagou¡£PulsartigongliaoyigebiClustergenggaojibiedechouxiangInstance¡£yigePulsar InstanceyouduogePulsar ClusterzuchengyigeInstancezhongdeClusterzhijiankeyixianghukuadiyufuzhishujudangePulsarjiqunyouyixiabufenzucheng:Pulsar Proxy: shiwuzhuangtaide£¬Proxyzuoweijiqundezhinengluyouceng£¬shifuzePulsarkehuduanyuPulsarjiqunjiaohudetongyiwangguanPulsar Brokers: yeshiwuzhuangtaide£¬shijiqundefuwuceng£¬ProxyhuijiangkehuduandefangwenqingqiuzhuanfadaozhengquedeBrokershang¡£BrokerzuoweifuwucengyuPulsardecunchucengjinxingjiaohuBookies: yigejiqunyouduogeBookiejiedian(zuchengBookeeperjiqun)fuzexiaoxidechijiuhuacunchuZookeeper: yongyujiqunjibiedepeizhihexiediao£¬bingcunchuPulsarjiqundesuoyouyuanshujuyidockerrongqiyunxingdanjiPulsarxuexishiyongminglingxinggongjupulsar-adminchuangjiantenant¡¢namespace¡¢topicliaojiePulsar Admin REST APItenant¡¢namespace¡¢topicdejibengainianPulsarjiyuzuhu¡¢mingmingkongjian¡¢zhutideluojicengcijiegouzhichiduozuhufenquTopicdegainianTopic URLgeshichijiuhuaTopichefeichijiuhuaTopicdegainianshengchanzhehexiaofeizhe¡¢dingyuehedingyuemoshiPulsarzhichi: exclusive(duzhan), failover(guzhangzhuanyi/zaibei), shared(gongxiang), key-shared(jiyukeydegongxiangmoshi) 4zhongdingyuemoshishiyongminglingxinggongjupulsar-clientjinxingshengchanzhehexiaofeizheceshishiyongPulsar Javakehuduankuchuangjianshengchanzhe¡¢xiaofeizhe¡¢Readerxiaofeizheduankeyishiyong"tongbujieshouxiaoxi", "yibujieshouxiaoxi", "MessageListenerjieshou" 3zhongmoshi£¬qizhongMessageListenerzidaixianchengchichuangjianxiaofeizheshikeyishezhixiaofeizhedepiliangjieshoucelueduozhutidingyue: shezhidangexiaofeizhedingyueduogezhutixiaofeiyichangchulikeyishiyong"wuxianzhongshi", "bohuobinghulueyichang", "sixinzhuti£¨Dead Letter Topic)"sanzhongfangshishiyongxiaoxiReaderkeyiyouyonghuzijishoudongzaiTopiczhongdingwei£¬duquxiangyaoduqudexiaoxishiyongPulsar Gokehuduankuxiaofeizheduanzhichiconsumer.Receive()heconsumer.Chan()liangzhongfangshixiaofeixiaoxi¡£qianzheduichannelguanbihecontext canceldeqingkuangzuoliaofengzhuang£¬houzheyaowomenzijichulihechanneldejiaohu£¬danyetigongliaozuidadelinghuoxing¡£duozhutidingyuesixinceluehesixinzhutishiyongxiaoxiReadershiyongPulsar SchemaguanlixiaoxishujudeleixinganquanxingWebtuxinghuaguanligongjuPulsar ManageryanchixiaoxitouditexingzhidingduochangshijianhoutoudideliverAfterzhidingzaijianglaimougeshijiandiantoudideliverAtfenquTopicheluyoumoshirenzhengheshouquankaiqiJWTshenfenrenzhengshouquanhequanxianguanliqianmiandexuexiyizhishijiyuyidockerrongqiqidongdedanjiPulsar¡£jintianjiangxuexishiyongHelmzaiKubernetesjiqunzhongbushuPulsarjiqun¡£1.huanjingzhunbeizhelishiyongdeKubernetesjiqundebanbenshi1.22.4£¬Helmdebanbenshi3.7.1¡£1.1 PulsarjiqunzujianheK8S NodejiedianguihuaxiamianzuoyixiaPulsarjiqungegezujianbushujiediandeguihua¡£shiyongPulsarguanfangdeHelm Chartbushushi£¬kexuanzebushugegezujian¡£ zaihoubiandepeizhizhongjiangjinyongjiankongxiangguandezujian(promethues, grafanadeng)£¬womenzhelixuanzeyihouchangshishiyongwaibudequanjuPrometheusshixianduiPulsarjiqundejiankong¡£benjiexuanzebushudejiqunzujianruxia:proxy: wuzhuangtai, danpulsardehelm chartshiyongStatefulSetbushubroker: wuzhuangtai, danpulsardehelm chartshiyongStatefulSetbushubookie: youzhuangtai, pulsardehelm chartshiyongStatefulSetbushuzookeeper: youzhuangtai, pulsardehelm chartshiyongStatefulSetbushurecovery: wuzhuangtai, danpulsardehelm chartshiyongStatefulSetbushutoolset: wuzhuangtai, danpulsardehelm chartshiyongStatefulSetbushupulsar-manager: wuzhuangtai, pulsardehelm chartshiyongDeploymentbushuzhuyi, pulsar-managerssuiranshiwuzhuangtaide£¬danyinweitaxuyaoshiyongPostgreSQLshujuku£¬pulsar-managersdedockerjingxiangzhongneizhiyigePostgreSQL, zhegewomenzaihoubiandepeizhizhongjianggaiweishiyongjiqunwaibudePostgreSQL¡£xiamianshuoyixiayishanggegezujiandebushujiedianxuanze¡£duiyuproxy, broker, recovery, toolset, pulsar-managerzhe5gewuzhuangtaizujian£¬keyirangk8sjiangqidiaodudaorenyijiedianshang¡£duiyubookie, zookeeperzhe2geyouzhuangtaizujian£¬xuyaowomengenjuqicunchujuandeleixing£¬jiangqiguihuadaoheshidek8sjiedian¡£womenzaixianshanghuanjingduiyuyouzhuangtaifuwudebushu£¬zaicunchujuandexuanzeshang£¬weiliaogenghaodexingneng£¬yibandushixuanzeLocal Persistent Volumes zai¡£yinci£¬ruguonizaiguihuayigexianshangbanbendePulsarjiqunbushudehua£¬duiyubookiehezookeeperkendingxuyaodandudedulidek8sjiedian£¬bingshiyongzhexiejiedianshangchuangjiandeLocal PV¡£ liru£¬yigexianshangshengchankeyongdePulsarjiqunkenengguihuaruxia:pulsar zookeeperjiqunzhishaoxuyao3gedulidek8sjiedian, zaizhexiejiedianshangchuangjianzookeeperdelocal pvpulsar bookeeperjiqun(bookiejiedianzucheng)genjuguihuaderongliangxuyaoNgedulidek8sjiedian, zaizhexiejiedianshangchuangjianbookiedelocal pv¡£ruguohouxuxuyaokuorongzengjiabookiejiedianshi£¬zhixuyaoyouxindechuangjianhaolocal pvdek8sjiedian£¬bingduibookiedeStatefulSetkuorongjike¡£pulsar proxy, brokerdengwuzhuangtaifuwu£¬zhixuyaoyouzugoudeshuliangdek8sjiedian£¬bingzaixuyaoshianxukuorongjikeyinbenwenzheliyongyushiyandek8sjiqunziyuanyouxian£¬suoyijinliangjiangshangmiangezujianzai3gek8sjiedianshanghunbu£¬jiangyigeyongyuceshihuanjingdedePulsarjiqunguihuaruxia:k8sjiedianbushupulsarzujianbeizhunode1zookeeper-0, bookie-0, broker-0, proxy-0xianshanghuanjingbookiehezookeeperyidingyaozaidandudejiedianshangnode2zookeeper-1, bookie-1, broker-1, proxy-1xianshanghuanjingbookiehezookeeperyidingyaozaidandudejiedianshangnode3zookeeper-2, bookie-2, broker-2, proxy-2xianshanghuanjingbookiehezookeeperyidingyaozaidandudejiedianshangnode1huonode2huonode3recovery-0, toolset-0, pulsar-managerjiyushangmianceshihuanjingdeguihua£¬womenjiangnode1~node3sangejiediandashangLabelheTaint:kubectl label node node1 node-role.kubernetes.io/pulsar=pulsarkubectl label node node2 node-role.kubernetes.io/pulsar=pulsarkubectl label node node3 node-role.kubernetes.io/pulsar=pulsarkubectl taint nodes node1 dedicated=pulsar:NoSchedulekubectl taint nodes node2 dedicated=pulsar:NoSchedulekubectl taint nodes node3 dedicated=pulsar:NoScheduleLabel node-role.kubernetes.io/pulsar=pulsaryongyubiaojijiedianshizhuanmenyongyuyunxingpulsarjiqunzujiandek8sjiedian¡£Taint dedicated=pulsar:NoSchedulebeidadaojiedianshanghou£¬morenpeizhixiak8sjiqunzhongdeqitabushuyupulsarjiqunzujiandepodjiangbuhuibeidiaodudaozhe3gejiedianshang£¬erhoubianwomenjiangyaobushudepulsarzujianshangjianghuishiyongTolerationpeizhiyunxudedicated=pulsar:NoScheduledeTaint¡£zhuyizhelizhishigenjuceshihuanjingPulsarjiqundeguihua£¬zuoliaoshangmiandeLabelheTaintdeshezhi£¬ruguoshishengchanhuanjing£¬zhelideLabelheTaintyinggaizuogenghelihexilidudeguihua£¬quebaoshixianshangmianshengchankeyongPulsarjiqundeNodejiedianguihua1.2 PulsarjiqunzujianrongqijingxiangzhunbeiqianmianwomenxuanzeyaobushuPulsarjiqundeproxy, broker, bookie, zookeeper, recovery, toolset, pulsar-manager 7dazujian¡£qizhongproxy, broker, bookie, zookeeper, recovery, toolsetdeguanfangrongqijingxiangdushiapachepulsar/pulsar-all¡£ pulsar-managerdeguanfangjingxiangshiapachepulsar/pulsar-manager¡£benwenshiyongdepulsarguanfangdehelm chart https://github.com/apache/pulsar-helm-chart/releases¡£pulsar-helm-chartdebanbenwei2.7.7£¬gaibanbenzhongpulsardebanbenwei2.7.4, pulsar-managerbanbenweiv0.1.0:apachepulsar/pulsar-all:2.7.4apachepulsar/pulsar-manager:v0.1.0zhuyiyinweipulsar-manager:v0.1.0youzhegeISSUE https://github.com/apache/pulsar-helm-chart/issues/133zhongmiaoshudewenti£¬suoyizaihoubiandebushujiangjingxiangpulsar-manager:v0.1.0genghuanchengliaopulsar-manager:v0.2.0¡£weiliaotigaoxiaolv£¬zhelijiangapachepulsar/pulsar-all:2.7.4heapachepulsar/pulsar-manager:v0.2.0zhelianggejingxiangzhuancundaoliaok8sjiqunsuoshiyongdesiyoujingxiangcangkuzhong£¬liru:harbor.example.com/library/apachepulsar/pulsar-all:2.7.4harbor.example.com/library/apachepulsar/pulsar-manager:v0.2.01.3 chuangjianJWTrenzhengsuoxudeK8S SecretzhelibushudePulsarjiqunxuyaozaianquanshangkaitongJWTrenzheng¡£genjuqianmianxuexideneirong£¬JWTzhichitongguoliangzhongbutongdemiyueshengchengheyanzhengToken:duichengmiyue£ºshiyongdangeSecret keylaishengchengheyanzhengTokenfeiduichengmiyue£ºbaohanyousiyuehegongyuezuchengdeyiduimiyueshiyongPrivate keyshengchengTokenshiyongPublic keyyanzhengTokentuijianshiyongfeiduichengmiyuedefangshi£¬xuyaoxianshengchengmiyuedui£¬zaiyongmiyueshengchengtoken¡£yinweiPulsarbeibushuzaiK8Sjiqunzhong£¬zaiK8SjiqunzhongcunchuzhexiemiyueheTokendezuihaodefangshishishiyongK8SdeSecret¡£pulsar-helm-chartzhuanmentigongliaoyigeprepare_helm_release.shjiaoben£¬keyiyonglaishengchengzhexieSecret¡£xiamianwomenjiangpulsar-helm-chartdeyuanmaclonedaoK8Sdekongzhijiedianshang(kubectlhehelmkeyongdejiedian):git clone -b pulsar-2.7.7 --depth 1 https://github.com/apache/pulsar-helm-chart.gitcd pulsar-helm-chart/zhixingxiamiandeminglingshengchengmiyueduiheTokendeSecretdeManifest:./scripts/pulsar/prepare_helm_release.sh \ -n pulsar \ -k pulsar \ -lshangmiandeminglingzhong:-nzhidingdeshengchengSecret Manifestzhonganzhuangdemingmingkongjian£¬zheliwoshijiangqibushudaoK8Szhongdepulsar namespacezhong£¬suoyizhidingweipulsar£¬dangranyekeyizhidingbushudaoqitadenamespacezhong¡£-kzhidingdeshishiyonghelmbushushidehelm releasemingcheng£¬zhelizhidingweipulsar¡£-lzhidingzhijiangshengchengdeneirongshuchudadaobendi£¬erbuhuizidongbushudaoK8Szhong¡£bijiaoxihuanzhezhongshoudongdefangshi£¬yinweiyiqiebijiaokekong¡£zhuyizhegejiaobenhuanyouyige-s,--symmetriccanshu£¬ruguogeizhegecanshudehua£¬JWTrenzhengjiangshiyongduichengmiyuedefangshi£¬zhelimeiyougeizhegecanshu£¬jiushiyongfeiduichengmiyuedefangshi¡£zhixingshangmiandejiaobenhuishuchuyixianeirong:generate the token keys for the pulsar cluster---The private key and public key are generated to ... successfully.apiVersion: v1data: PRIVATEKEY: <...> PUBLICKEY: <...>kind: Secretmetadata: creationTimestamp: null name: pulsar-token-asymmetric-key namespace: pulsargenerate the tokens for the super-users: proxy-admin,broker-admin,admingenerate the token for proxy-admin---pulsar-token-asymmetric-keyapiVersion: v1data: TOKEN: <...> TYPE: YXN5bW1ldHJpYw==kind: Secretmetadata: creationTimestamp: null name: pulsar-token-proxy-admin namespace: pulsargenerate the token for broker-admin---pulsar-token-asymmetric-keyapiVersion: v1data: TOKEN: <...> TYPE: YXN5bW1ldHJpYw==kind: Secretmetadata: creationTimestamp: null name: pulsar-token-broker-admin namespace: pulsargenerate the token for admin---pulsar-token-asymmetric-keyapiVersion: v1data: TOKEN: <...> TYPE: YXN5bW1ldHJpYw==kind: Secretmetadata: creationTimestamp: null name: pulsar-token-admin namespace: pulsar-------------------------------------The jwt token secret keys are generated under: - 'pulsar-token-asymmetric-key'The jwt tokens for superusers are generated and stored as below: - 'proxy-admin':secret('pulsar-token-proxy-admin') - 'broker-admin':secret('pulsar-token-broker-admin') - 'admin':secret('pulsar-token-admin')congshuchukeyikanchu£¬gaijiaobenshengchengliao4geK8S SecretdeManifest:pulsar-token-asymmetric-keyzhegeSecretzhongshiyongyushengchengTokenheyanzhengTokendesiyuehegongyuepulsar-token-proxy-adminzhegeSecretzhongshiyongyuproxydechaojiyonghujiaoseTokenpulsar-token-broker-adminzhegeSecretzhongshiyongyubrokerdechaojiyonghujiaoseTokenpulsar-token-adminzhegeSecretzhongshiyongyuguanlikehuduandechaojiyonghujiaoseTokenjiexialaishoudongjiangzhe4geSecretshiyongkubectl applychuangjiandaoK8Sdepulsarmingmingkongjianzhong¡£ chuangjianwanchenghou£¬keyishiyongkubectlzhaodaotamen:kubectl get secret -n pulsar | grep pulsar-tokenpulsar-token-admin Opaque 2 5mpulsar-token-asymmetric-key Opaque 2 5mpulsar-token-broker-admin Opaque 2 5mpulsar-token-proxy-admin Opaque 2 5m1.4 chuangjianZookeeperheBookiedeLocal PVgenjubushuPulsardeK8Sjiediandeguihua£¬xiamianxuyaoweizookeeper, bookiesuozaidejiedianzaiK8SshangchuangjianLocal Persistent Volume¡£zhuyimeigezookeeperjiedianxuyaoyigedatadelocal volume£¬meigebookiejiedianxuyaojournalheledgersgonglianggelocal volume¡£zaichuangjianLocal PVzhiqian£¬xuyaoquerenyixiak8szhongcunzaiStorageClasslocal-storage£¬ruguomeiyoukeyishiyongxiamiandemanifestchuangjian¡£apiVersion: storage.k8s.io/v1kind: StorageClassmetadata: name: local-storageprovisioner: kubernetes.io/no-provisionervolumeBindingMode: WaitForFirstConsumerreclaimPolicy: RetainzhuyixianzaideK8Szhongbuzaizhijietigonglocal volumedeprovisioner£¬zheliyemeiyoushiyongprovisioner£¬yincihouxuduilocal volumedechuangjianheguanlidushixuyaoK8Sjiqunguanliyuandeshoudongjinxing¡£ yeshishuomuqianKuberneteshexinzhongbubaohanduiduibendijuanjinxingdongtaifafangheguanlideprovisioner£¬ruguoxiangyaotiyandongtaifafangheguanlidegongneng£¬keyishiyixiayouRanchertigongdeLocal Path Provisioner¡£wozheliyiranshiyongshoudongguanlidefangshi£¬jitongguoshoudongzaiK8SjiedianshangchuangjianLocal Volume£¬shoudongbangdingLocal VolumeyuPulsar ZookeeperheBookiedePVC(PersistentVolumeClaim)zhijiandeguanxi¡£xiamian£¬xianshoudongzainode1, node2, node3shangchuangjianlocal volumeduiyingdeshujumulu:mkdir -p /home/puslar/data/zookeeper-datamkdir -p /home/puslar/data/bookie-data/ledgersmkdir -p /home/puslar/data/bookie-data/journalzookeeper datadelocal pvdemanifestruxia:---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-zookeeper-data-pulsar-zookeeper-0spec: capacity: storage: 20Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/zookeeper-data claimRef: name: pulsar-zookeeper-data-pulsar-zookeeper-0 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node1---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-zookeeper-data-pulsar-zookeeper-1spec: capacity: storage: 20Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/zookeeper-data claimRef: name: pulsar-zookeeper-data-pulsar-zookeeper-1 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node2---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-zookeeper-data-pulsar-zookeeper-2spec: capacity: storage: 20Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/zookeeper-data claimRef: name: pulsar-zookeeper-data-pulsar-zookeeper-2 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node3shangmiandemanifestrengzhongjiang3geLocal PVtongguonodeAffinitychuangjianbingguanliandaodaonode1~node3shang£¬tongshishiyongclaimRefjiangzhe3geLocal PVyujijiangzaiK8Sjiqunzhongbushudezookeeper SatefulSetzhongdePVCbangding¡£ shiyongkubectl applychuangjianshangmiandemanifest¡£bookie ledgershejournaldelocal pvdemanifestruxia:---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-ledgers-pulsar-bookie-0spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/ledgers claimRef: name: pulsar-bookie-ledgers-pulsar-bookie-0 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node1---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-journal-pulsar-bookie-0spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/journal claimRef: name: pulsar-bookie-journal-pulsar-bookie-0 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node1---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-ledgers-pulsar-bookie-1spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/ledgers claimRef: name: pulsar-bookie-ledgers-pulsar-bookie-1 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node2---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-journal-pulsar-bookie-1spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/journal claimRef: name: pulsar-bookie-journal-pulsar-bookie-1 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node2---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-ledgers-pulsar-bookie-2spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/ledgers claimRef: name: pulsar-bookie-ledgers-pulsar-bookie-2 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node3---apiVersion: v1kind: PersistentVolumemetadata: name: pulsar-bookie-journal-pulsar-bookie-2spec: capacity: storage: 50Gi accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Retain storageClassName: local-storage local: path: /home/puslar/data/bookie-data/journal claimRef: name: pulsar-bookie-journal-pulsar-bookie-2 namespace: pulsar nodeAffinity: required: nodeSelectorTerms: - matchExpressions: - key: kubernetes.io/hostname operator: In values: - node3shangmiandemanifestrengzhongjiang6geLocal PVtongguonodeAffinitychuangjianbingguanliandaodaonode1~node3shang£¬tongshishiyongclaimRefjiangzhe3geLocal PVyujijiangzaiK8Sjiqunzhongbushudezookeeper SatefulSetzhongdePVCbangding¡£ shiyongkubectl applychuangjianshangmiandemanifest¡£1.5 zhunbeiPulsar ManagerdePostgreSQLshujukuzhelizhunbeirangPulsar Managershiyongwaibushujuku£¬xuyaotiqianzaiwaibudePostgreSQLzhongchuangjianhaoyonghuheshujukubiaojiegou¡£chuangjianshujukuheyonghu:CREATE USER pulsar_manager WITH PASSWORD '';CREATE DATABASE pulsar_manager OWNER pulsar_manager;GRANT ALL PRIVILEGES ON DATABASE pulsar_manager to pulsar_manager;GRANT ALL PRIVILEGES ON ALL TABLES IN SCHEMA pulsar_manager TO pulsar_manager;ALTER SCHEMA public OWNER to pulsar_manager;GRANT ALL PRIVILEGES ON ALL TABLES IN SCHEMA public TO pulsar_manager;GRANT ALL PRIVILEGES ON ALL SEQUENCES IN SCHEMA public TO pulsar_manager;chuangjianbiaojiegou(jianbiaojiaobenkeyizaipulsar-managerdejingxiangzhongzhaodao):CREATE TABLE IF NOT EXISTS environments ( name varchar(256) NOT NULL, broker varchar(1024) NOT NULL, CONSTRAINT PK_name PRIMARY KEY (name), UNIQUE (broker));CREATE TABLE IF NOT EXISTS topics_stats ( topic_stats_id BIGSERIAL PRIMARY KEY, environment varchar(255) NOT NULL, cluster varchar(255) NOT NULL, broker varchar(255) NOT NULL, tenant varchar(255) NOT NULL, namespace varchar(255) NOT NULL, bundle varchar(255) NOT NULL, persistent varchar(36) NOT NULL, topic varchar(255) NOT NULL, producer_count BIGINT, subscription_count BIGINT, msg_rate_in double precision , msg_throughput_in double precision , msg_rate_out double precision , msg_throughput_out double precision , average_msg_size double precision , storage_size double precision , time_stamp BIGINT);CREATE TABLE IF NOT EXISTS publishers_stats ( publisher_stats_id BIGSERIAL PRIMARY KEY, producer_id BIGINT, topic_stats_id BIGINT NOT NULL, producer_name varchar(255) NOT NULL, msg_rate_in double precision , msg_throughput_in double precision , average_msg_size double precision , address varchar(255), connected_since varchar(128), client_version varchar(36), metadata text, time_stamp BIGINT, CONSTRAINT fk_publishers_stats_topic_stats_id FOREIGN KEY (topic_stats_id) References topics_stats(topic_stats_id));CREATE TABLE IF NOT EXISTS replications_stats ( replication_stats_id BIGSERIAL PRIMARY KEY, topic_stats_id BIGINT NOT NULL, cluster varchar(255) NOT NULL, connected BOOLEAN, msg_rate_in double precision , msg_rate_out double precision , msg_rate_expired double precision , msg_throughput_in double precision , msg_throughput_out double precision , msg_rate_redeliver double precision , replication_backlog BIGINT, replication_delay_in_seconds BIGINT, inbound_connection varchar(255), inbound_connected_since varchar(255), outbound_connection varchar(255), outbound_connected_since varchar(255), time_stamp BIGINT, CONSTRAINT FK_replications_stats_topic_stats_id FOREIGN KEY (topic_stats_id) References topics_stats(topic_stats_id));CREATE TABLE IF NOT EXISTS subscriptions_stats ( subscription_stats_id BIGSERIAL PRIMARY KEY, topic_stats_id BIGINT NOT NULL, subscription varchar(255) NULL, msg_backlog BIGINT, msg_rate_expired double precision , msg_rate_out double precision , msg_throughput_out double precision , msg_rate_redeliver double precision , number_of_entries_since_first_not_acked_message BIGINT, total_non_contiguous_deleted_messages_range BIGINT, subscription_type varchar(16), blocked_subscription_on_unacked_msgs BOOLEAN, time_stamp BIGINT, UNIQUE (topic_stats_id, subscription), CONSTRAINT FK_subscriptions_stats_topic_stats_id FOREIGN KEY (topic_stats_id) References topics_stats(topic_stats_id));CREATE TABLE IF NOT EXISTS consumers_stats ( consumer_stats_id BIGSERIAL PRIMARY KEY, consumer varchar(255) NOT NULL, topic_stats_id BIGINT NOT NUll, replication_stats_id BIGINT, subscription_stats_id BIGINT, address varchar(255), available_permits BIGINT, connected_since varchar(255), msg_rate_out double precision , msg_throughput_out double precision , msg_rate_redeliver double precision , client_version varchar(36), time_stamp BIGINT, metadata text);CREATE TABLE IF NOT EXISTS tokens ( token_id BIGSERIAL PRIMARY KEY, role varchar(256) NOT NULL, description varchar(128), token varchar(1024) NOT NUll, UNIQUE (role));CREATE TABLE IF NOT EXISTS users ( user_id BIGSERIAL PRIMARY KEY, access_token varchar(256), name varchar(256) NOT NULL, description varchar(128), email varchar(256), phone_number varchar(48), location varchar(256), company varchar(256), expire BIGINT, password varchar(256), UNIQUE (name));CREATE TABLE IF NOT EXISTS roles ( role_id BIGSERIAL PRIMARY KEY, role_name varchar(256) NOT NULL, role_source varchar(256) NOT NULL, description varchar(128), resource_id BIGINT NOT NULL, resource_type varchar(48) NOT NULL, resource_name varchar(48) NOT NULL, resource_verbs varchar(256) NOT NULL, flag INT NOT NULL);CREATE TABLE IF NOT EXISTS tenants ( tenant_id BIGSERIAL PRIMARY KEY, tenant varchar(255) NOT NULL, admin_roles varchar(255), allowed_clusters varchar(255), environment_name varchar(255), UNIQUE(tenant));CREATE TABLE IF NOT EXISTS namespaces ( namespace_id BIGSERIAL PRIMARY KEY, tenant varchar(255) NOT NULL, namespace varchar(255) NOT NULL, UNIQUE(tenant, namespace));CREATE TABLE IF NOT EXISTS role_binding( role_binding_id BIGSERIAL PRIMARY KEY, name varchar(256) NOT NULL, description varchar(256), role_id BIGINT NOT NULL, user_id BIGINT NOT NULL);shangmianyijingzuohaoliaobushudezhunbeigongzuo£¬xiamianjiangshiyongHelmzaiK8SjiqunzhongbushuPulsarjiqun¡£2.shiyongHelmzaiK8SzhongbushuPulsarconghttps://github.com/apache/pulsar-helm-chart/releasesxiazaipulsar helm chart 2.7.7daoK8Sdekongzhijiedianshang(kubectlhehelmkeyong)¡£https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.7/pulsar-2.7.7.tgz2.1 dingzhibianxiehelm chartdevalues.yamldingzhibianxiehelm chartdevalues.yamlwenjianruxia, dingzhideneirongbijiaoduo£¬jutijianxiamianwenjiandezhushi:auth: authentication: enabled: true # kaiqijwtrenzheng provider: "jwt" jwt: usingSecretKey: false # jwtrenzhengshiyongfeiduichengmiyuedui authorization: enabled: true # kaiqishouquan superUsers: # broker to broker communication broker: "broker-admin" # proxy to broker communication proxy: "proxy-admin" # pulsar-admin client to broker/proxy communication client: "admin"components: # qiyongdezujian autorecovery: true bookkeeper: true broker: true functions: true proxy: true pulsar_manager: true toolset: true zookeeper: truemonitoring: # guanbijiankongzujian, houxuchangshishiyongwaibuPrometheusduipulsarjiqunjinxingjiankong grafana: false prometheus: false node_exporter: falsevolumes: local_storage: true # shujujuanshiyonglocal storageproxy: # proxydepeizhi(zhelishiceshihuanjing, jiangproxyyediaodudaonode1huonode2huonode3) nodeSelector: node-role.kubernetes.io/pulsar: pulsar tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule" configData: PULSAR_PREFIX_authenticateMetricsEndpoint: "false"broker: # brokerdepeizhi(zhelishiceshihuanjing, jiangproxyyediaodudaonode1huonode2huonode3) nodeSelector: node-role.kubernetes.io/pulsar: pulsar tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule" zookeeper: # brokerdepeizhi replicaCount: 3 tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule" volumes: data: # peizhishiyonglocal pv, xuyaoyuqianmianshoudongchuangjiandelocal pvxinxiyizhi local_storage: true size: 20Gibookkeeper: # bookkeeperdepeizhi replicaCount: 3 tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule" volumes: journal: # peizhishiyonglocal pv, xuyaoyuqianmianshoudongchuangjiandelocal pvxinxiyizhi local_storage: true size: 50Gi ledgers: # peizhishiyonglocal pv, xuyaoyuqianmianshoudongchuangjiandelocal pvxinxiyizhi local_storage: true size: 50Gipulsar_manager: # pulsar_managerdepeizhi(zhelishiceshihuanjing, jiangpulsar_manageryediaodudaonode1huonode2huonode3) replicaCount: 1 admin: # wendangzhongmiaoshuzhelishipulsar manager webjiemiandengluyonghumima£¬danshijishangdangshiyongwaibuPostgreSQLshujukushi£¬zhelixuyaozhidingPostgreSQLdeshujukuhemima£¬buzhidaoshifoushipulsar-helm-chart 2.7.7dewenti user: pulsar_manager password: 05aM3Braz_M4RWpn configData: DRIVER_CLASS_NAME: org.postgresql.Driver URL: jdbc:postgresql://:5432/pulsar_manager # wendangzhongmiaoshuzheliPostgreSQLshujukudemima£¬danshijishangzhelibunengzhidingUSERNAMEhePASSWORD, buzhidaoshifoushipulsar-helm-chart 2.7.7dewenti # USERNAME: pulsar_manager # PASSWORD: 05aM3Braz_M4RWpn LOG_LEVEL: INFO ## kaiqiJWTrenzhenghou, zhelixuyaozhidingpulsar-token-adminzhegeSecretzhongdeJWT Token JWT_TOKEN: autorecovery: # autorecoverydepeizhi(zhelishiceshihuanjing, jiangautorecoveryyediaodudaonode1huonode2huonode3) replicaCount: 1 nodeSelector: node-role.kubernetes.io/pulsar: pulsar tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule"toolset: # toolsetdepeizhi(zhelishiceshihuanjing, jiangtoolsetyediaodudaonode1huonode2huonode3) replicaCount: 1 nodeSelector: node-role.kubernetes.io/pulsar: pulsar tolerations: - key: "dedicated" operator: "Equal" value: "pulsar" effect: "NoSchedule"images: # duigezujianshiyongsiyoujingxiangcangkudepeizhi imagePullSecrets: - regsecret # siyoujingxiangcangkudeimage pull secret, xuyaotiqianzaik8smingmingkongjianzhongchuangjian autorecovery: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4 bookie: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4 broker: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4 functions: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4 proxy: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4 pulsar_manager: repository: harbor.example.com/library/apachepulsar/pulsar-manager tag: v0.2.0 zookeeper: repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4pulsar_metadata: component: pulsar-init image: # the image used for running `pulsar-cluster-initialize` job repository: harbor.example.com/library/apachepulsar/pulsar-all tag: 2.7.4yinweidangqianzaipulsar-helm-chart 2.7.7 zhonghaoxiangbuzhichiweipulsar-initshezhisiyoucangkudeimagePullSecret£¬suoyixiamianweipulsar namespacezhongdedefault servcieaccount tianjiashangimagePullSecret¡£kubectl patch serviceaccount default -p '{"imagePullSecrets": [{"name": "regsecret"}]}' -n pulsar2.2 shiyonghelm installanzhuangpulsardingzhiwanvalue.yamlzhihou£¬shiyongxiamiandeminglingxiangK8Sjiqunbushupulsar¡£helm install \ --values values.yaml \ --set initialize=true \ --namespace pulsar \ pulsar pulsar-2.7.7.tgzanzhuangwanchenghoushiyongxiamiandeminglingchakanyixialianggechushihuajob pulsar-pulsar-inithepulsar-bookie-initdepodzhuangtaiweiComplete:kubectl get pod -n pulsar | grep initpulsar-bookie-init--1-h65bp 0/1 Completed 0 5m14spulsar-pulsar-init--1-t4thq 0/1 Completed 0 5m5sshiyongxiamiandeminglingchakanyixiapulsarjiqungegezujiandePodzhuangtaiquanbuduweiRunning:kubectl get pod -n pulsar -l cluster=pulsar -o wideNAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATESpulsar-bookie-0 1/1 Running 0 14m 10.244.226.91 node1 pulsar-bookie-1 1/1 Running 0 14m 10.244.63.90 node2 pulsar-bookie-2 1/1 Running 0 14m 10.244.46.92 node3 pulsar-broker-0 1/1 Running 0 14m 10.244.226.90 node1 pulsar-broker-1 1/1 Running 0 14m 10.244.63.89 node2 pulsar-broker-2 1/1 Running 0 14m 10.244.46.90 node3 pulsar-proxy-0 1/1 Running 0 14m 10.244.226.93 node1 pulsar-proxy-1 1/1 Running 0 14m 10.244.63.91 node2 pulsar-proxy-2 1/1 Running 0 14m 10.244.46.93 node3 pulsar-pulsar-manager-7b98666cff-5626f 1/1 Running 0 14m 10.244.63.88 node2 pulsar-recovery-0 1/1 Running 0 14m 10.244.46.89 node3 pulsar-toolset-0 1/1 Running 0 14m 10.244.46.91 node3 pulsar-zookeeper-0 1/1 Running 0 14m 10.244.226.92 node1 pulsar-zookeeper-1 1/1 Running 0 14m 10.244.63.92 node2 pulsar-zookeeper-2 1/1 Running 0 13m 10.244.46.94 node3 ruguohoubiandiaozhengliaovalues.yaml£¬xuyaogengxinbushushi£¬shiyongxiamiandemingling:helm upgrade pulsar pulsar-2.7.7.tgz \ --namespace pulsar \ -f values.yaml2.3 zaitoolset podzhongceshichuangjiantenant, namespacehetopictoolset podzhongbaohanliaogezhongguanliheceshipulsardeminglingxinggongju£¬lirupulsar-admin, pulsar-clientdeng¡£xiamianjinrutoolset podzhong£¬shiyongpulsar-adminminglingxinggongjuceshiyixiatenant, namespacehetopicdechuangjian£¬jinyibuquerenpulsarjiqungongzuozhengchang¡£kubectl exec -it -n pulsar pulsar-toolset-0 -- /bin/bashbin/pulsar-admin tenants create test-tenantbin/pulsar-admin tenants list"public""pulsar""test-tenant"bin/pulsar-admin namespaces create test-tenant/test-nsbin/pulsar-admin namespaces list test-tenant"test-tenant/test-ns"bin/pulsar-admin topics create-partitioned-topic test-tenant/test-ns/test-topic -p 3bin/pulsar-admin topics list-partitioned-topics test-tenant/test-ns"persistent://test-tenant/test-ns/test-topic"2.4 chuangjianpulsar-managerdeguanliyuanyonghubingdengluchakanxiamianceshiyixiapulsar managershifoukeyishiyong¡£qianmianshiyonghelm chartbushudepulsarjiqun£¬zaik8szhongchuangjianliaoxiamian7geService¡£kubectl get svc -l app=pulsar -n pulsarNAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGEpulsar-bookie ClusterIP None 3181/TCP,8000/TCP 40mpulsar-broker ClusterIP None 8080/TCP,6650/TCP 40mpulsar-proxy LoadBalancer 10.104.105.137 80:31970/TCP,6650:32631/TCP 40mpulsar-pulsar-manager LoadBalancer 10.110.207.9 9527:32764/TCP 40mpulsar-recovery ClusterIP None 8000/TCP 40mpulsar-toolset ClusterIP None 40mpulsar-zookeeper ClusterIP None 8000/TCP,2888/TCP,3888/TCP,2181/TCP 40mcongshangmianminglingdeshuchukeyikanchu£¬bookie, broker, recovery, toolset, zookeeperzhe5geServicedeleixingdushiClusterIPde£¬bingqiecluser-ipweiNone£¬dushiHeadlessdeService£¬yinweitamenzhixuyaozaik8sjiqunneibushiyong¡£pulsar-proxyhepulsar-pulsar-managerweiLoadBalancerleixing£¬bingqiedupeizhiliaoNodePort£¬tigongliaocongK8Sjiqunwaibufangwendenengli¡£congjiqunwaibufangwenpulsar-managerdedizhishihttp://node1:32764£¬diyicifangwenpulsar managerzhiqian£¬xuyaoweiqichuangjianyigeguanliyonghu:CSRF_TOKEN=$(curl http://node1:32764/pulsar-manager/csrf-token)curl \ -H 'X-XSRF-TOKEN: $CSRF_TOKEN' \ -H 'Cookie: XSRF-TOKEN=$CSRF_TOKEN;' \ -H "Content-Type: application/json" \ -X PUT http://node1:32764/pulsar-manager/users/superuser \ -d '{"name": "admin", "password": "pulsar", "description": "test", "email": "username@test.org"}'shangmiandeminglingweipulsar-managerchuangjianyonghumingweiadmin, mimaweipulsardeguanliyonghu¡£shiyonggaiyonghujiukeyidenglupulsar manager¡£beizhu, zaixianshangshiyongshi£¬jinliangbimianyiNodePortbaolufuwu£¬zhelidepulsar-managerdeServicekeyixiugaiweiCluserIPleixing£¬bingguanbiNodePort£¬tongshichuangjianIngress£¬yiIngress+yumingdexingshibaoluchulai¡£ kanliaoyixiapulsar-helm-chartyeshizhichide£¬zhishimuqianpulsar-helm-chart 2.7.7zhongchuangjianIngressshi£¬shiyongdeshiapiVersion: extensions/v1beta1 API£¬zhegeAPIcongk8s 1.19beibiaojiweifeiqi£¬zaik8s 1.22yibeiyichu¡£ suoyiyaozhijieshishiyongpulsar-helm-chartchuangjianIngressdehua£¬xuyaodengdaipulsar-helm-chartdegengxin¡£cankaohttps://github.com/apache/pulsar-helm-charthttps://pulsar.apache.org/docs/zh-CN/kubernetes-helm/https://github.com/apache/pulsar-helm-chart/issues/133https://github.com/rancher/local-path-provisionerhttps://kubernetes.io/zh/docs/tasks/configure-pod-container/configure-service-account/buranmafanshiermeiwanmeiliao¡£

¹Ø(Guan)ÓÚ(Yu)±È(Bi)ÑÇ(Ya)µÏ(Di)ËÎ(Song)Pro DM-i³µ(Che)ÐÍ(Xing)£¬´ó(Da)¸Å(Gai)»á(Hui)ÓÐ(You)¿É(Ke)ÄÜ(Neng)ÊÇ(Shi)ÒÔ(Yi)ÏÂ(Xia)Á½(Liang)ÖÖ(Zhong)µÄ(De)¶¨(Ding)¼Û(Jia)½á(Jie)¹û(Guo)¡£µÚ(Di)Ò»(Yi)ÖÖ(Zhong)ÊÇ(Shi)ÔÙ(Zai)±ã(Bian)ÒË(Yi)Ò»(Yi)Íò(Wan)Ôª(Yuan)£¬µ«(Dan)Õâ(Zhe)ÖÖ(Zhong)¿É(Ke)ÄÜ(Neng)ÐÔ(Xing)ºÜ(Hen)С(Xiao)£¬Ê×(Shou)ÏÈ(Xian)120kWµç(Dian)»ú(Ji)+С(Xiao)µç(Dian)³Ø(Chi)µÄ(De)×é(Zu)ºÏ(He)½µ(Jiang)±¾(Ben)Ч(Xiao)¹û(Guo)»á(Hui)¸ü(Geng)¸ß(Gao)£¬µ«(Dan)Õâ(Zhe)Ì×(Tao)×é(Zu)ºÏ(He)µÄ(De)¶¯(Dong)Á¦(Li)»á(Hui)±È(Bi)ÏÖ(Xian)¿î(Kuan)ÓÐ(You)±È(Bi)½Ï(Jiao)Ã÷(Ming)ÏÔ(Xian)µÄ(De)ÏÂ(Xia)½µ(Jiang)£¬Õ¾(Zhan)ÔÚ(Zai)²ú(Chan)Æ·(Pin)µü(Die)´ú(Dai)·(Lu)Ïß(Xian)ÉÏ(Shang)µÄ(De)·¢(Fa)Õ¹(Zhan)À´(Lai)¿´(Kan)£¬³ö(Chu)ÏÖ(Xian)µÄ(De)¿É(Ke)ÄÜ(Neng)ÐÔ(Xing)²»(Bu)´ó(Da)¡£

6¡¢²µ³Ü±è¾±²¹´Ç²ú±ð¾±³Ù²¹´Ç²õ³ó¾±£¬²ú³Ü²â²¹´Ç³¾²¹²Ô²µ³¾³ÜÂá¾±²¹³¦²¹²Ô²µ£¬³ó±ð²Ô»å³Ü´Ç²õ²¹²Ô³ó³Ü³æ¾±³ó³Ü²¹²Ô³ú²¹¾±²µ³Ü±è¾±²¹´Ç³æ¾±²¹»å¾±±ð²õ³ó¾±£¬±è¾±²Ô´Ú²¹²Ô±ç³ÜÂá¾±²¹³¦²¹²Ô²µ£¬³æ¾±²¹²Ô²µ°ì³Ü²¹¾±²õ³Ü³ó³Ü¾±²ú±ð²Ô£¬²õ³ó¾±³ú²¹¾±²õ³ó±ð²ú³Ü»å±ð²µ±ð°ù´Ç³Ü£¬²â±ð²ú³Ü²â²¹´Ç³ú²¹¾±³¾¾±²Ô²µ³æ¾±²¹²Ô³æ¾±²¹»å¾±±ð²µ³Ü´Ç³¦³ó±ð²Ô²µ²ú³Ü³¦²¹²Ô²µ£¬»å±ð²Ô²µ³ú³ó¾±»å¾±±ð³¦³ó³Ü³æ¾±²¹²Ô´Ú²¹²Ô²µ±ô¾±²¹²Ô²µ²â²¹²Ô²µ³æ¾±²¹²Ô³ó´Ç³Ü³ú²¹¾±°ì²¹´Ç±ô±¹£»»å²¹²Ô²µ²â´Ç³Ü°ù±ð²Ô²ú¾±²¹´Ç²õ³ó¾±³Ù²¹±ç¾±²õ³ó¾±²õ³ó¾±³ú²¹¾±²Ô²¹³ú¾±Âá¾±»å±ð²Ô±¹±ð°ù·É±ð¾±³ú¾±Âá¾±³æ¾±²ú²¹¾±£¬±ð°ù³Ù²¹»å±ð³ó³Ü¾±´Ú³Ü±ç³Ü±ð²õ³ó¾±£º

ÔÚ(´Ü²¹¾±)Ïû(³Ý¾±²¹´Ç)·Ñ(¹ó±ð¾±)Íú(°Â²¹²Ô²µ)¼¾(´³¾±)µç(¶Ù¾±²¹²Ô)Á¦(³¢¾±)¹©(³Ò´Ç²Ô²µ)Ó¦(³Û¾±²Ô²µ)Æ«(±Ê¾±²¹²Ô)½ô(´³¾±²Ô)±³(µþ±ð¾±)¾°(´³¾±²Ô²µ)ÏÂ(³Ý¾±²¹)£¬Ðé(³Ý³Ü)Äâ(±·¾±)µç(¶Ù¾±²¹²Ô)³§(°ä³ó²¹²Ô²µ)Ó­(³Û¾±²Ô²µ)À´(³¢²¹¾±)Ͷ(°Õ´Ç³Ü)×Ê(´Ü¾±)½¨(´³¾±²¹²Ô)Éè(³§³ó±ð)ÈÈ(¸é±ð)³±(°ä³ó²¹´Ç)£¬Ïà(³Ý¾±²¹²Ô²µ)¹Ø(³Ò³Ü²¹²Ô)Õþ(´Ü³ó±ð²Ô²µ)²ß(°ä±ð)ÃÜ(²Ñ¾±)¼¯(´³¾±)Âä(³¢³Ü´Ç)µØ(¶Ù¾±)£¬·Ö(¹ó±ð²Ô)Îö(³Ý¾±)ÈË(¸é±ð²Ô)Ê¿(³§³ó¾±)·×(¹ó±ð²Ô)·×(¹ó±ð²Ô)±í(µþ¾±²¹´Ç)ʾ(³§³ó¾±)£¬Ëæ(³§³Ü¾±)×Å(´Ü³ó³Ü´Ç)ÐÂ(³Ý¾±²Ô)ÐÍ(³Ý¾±²Ô²µ)µç(¶Ù¾±²¹²Ô)Á¦(³¢¾±)ϵ(³Ý¾±)ͳ(°Õ´Ç²Ô²µ)½¨(´³¾±²¹²Ô)Éè(³§³ó±ð)ÍÆ(°Õ³Ü¾±)½ø(´³¾±²Ô)£¬Ðé(³Ý³Ü)Äâ(±·¾±)µç(¶Ù¾±²¹²Ô)³§(°ä³ó²¹²Ô²µ)ÓÐ(³Û´Ç³Ü)Íû(°Â²¹²Ô²µ)Ó­(³Û¾±²Ô²µ)À´(³¢²¹¾±)¿ì(°­³Ü²¹¾±)ËÙ(³§³Ü)·¢(¹ó²¹)Õ¹(´Ü³ó²¹²Ô)¡£

¿´ËûÃǼÒÀïµÄÌõ¼þ£¬¼òªµÄ×°ÐÞ£¬ÁñÁ«¶ÔÕâ¸ö¼ÒÀ´ËµÊµÔÚÊǸöÉݳÞÆ·£¬Èç¹ûż¶û³ÔÒ»´Î¾ÍËãÁË£¬µ«ÊÇС»ïµÄÆÞ×ÓÿÐÇÆÚÒª³ÔºÃ¼¸´Î£¬Õâ¾ÍÓеãÀË·ÑÁË¡£2022Ä꣬Êг¡¼à¹Ü×ܾÖ(¹ú¼Ò·´Â¢¶Ï¾Ö)½ô½ôΧÈƼӿ콨ÉèÈ«¹úͳһ´óÊг¡¡¢Íƶ¯¸ßÖÊÁ¿·¢Õ¹ºÍÔö½øÃñÉú¸£ìí£¬Íê³É¡¶·´Â¢¶Ï·¨¡·°ä²¼15ÄêÀ´µÄÊ×´ÎÐ޸ģ¬¼Ó¿ìÍêÉÆ·´Â¢¶ÏÅäÌ×Á¢·¨£¬¹«Æ½¾ºÕù·¨Öλù´¡¸ü¼ÓÔúʵÎȹ̣»ÒÀ·¨°ì½á¸÷Àࢶϰ¸¼þ187¼þ£¬·£Ã»½ð¶î7.84ÒÚÔª£¬Éó½á¾­ÓªÕß¼¯Öа¸¼þ794¼þ£¬ÆäÖи½¼ÓÏÞÖÆÐÔÌõ¼þÅú×¼5¼þ£¬ÓÐÁ¦±£»¤Êг¡¹«Æ½¾ºÕù£¬´Ù½øÈ«¹úͳһ´óÊг¡½¨Éè¼ÓÁ¦ÌáËÙ£»¾Ù°ìÊ×½ìÖйú¹«Æ½¾ºÕùÕþ²ßÐû´«Öܺ͵ھŽìÖйú¹«Æ½¾ºÕùÕþ²ß¹ú¼ÊÂÛ̳£¬¹«Æ½¾ºÕùÀíÄî¸ü¼ÓÉîÈëÈËÐÄ£¬Êг¡»¯¡¢·¨Öλ¯¡¢¹ú¼Ê»¯ÓªÉÌ»·¾³³ÖÐøÓÅ»¯¡£¡¶Òø¿ó¡·-¸ßÇåµçÓ°-ÍêÕû°æÔÚÏß¹Û¿´¡¶ÒøÊΡ·Ãâ·ÑÔÚÏß¹Û¿´¸ßÇå°æ-¾çÇéƬ Ðdz½Ó°Ôº¡¶ÒøºÓ»¤ÎÀ¶Ó1¡·-¸ßÇåµçÓ°-ÍêÕû°æÔÚÏß¹Û¿´

½á¹ûÅóÓѾ¹È»²»ÔÚ×óµÈÓÒµÈÅóÓÑҲû»ØÀ´

ÉùÃ÷£º¸ÃÎĹ۵ã½ö´ú±í×÷Õß±¾ÈË£¬ËѺüºÅϵÐÅÏ¢·¢²¼Æ½Ì¨£¬ËѺü½öÌṩÐÅÏ¢´æ´¢¿Õ¼ä·þÎñ¡£