行业网站推广,wordpress是一个软件吗,网站鼠标特效,可以做网站的服务器文章目录 背景主要步骤代码 背景
通常使用flink 提供的高级算子来编写flink 任务#xff0c;对底层不是很了解#xff0c;尤其是如何生成作业图的细节 下面通过构造一个有向无环图#xff0c;来实际看一下
主要步骤
1.增加source 2.增加operator 3. 增加一条边#xff0… 文章目录 背景主要步骤代码 背景
通常使用flink 提供的高级算子来编写flink 任务对底层不是很了解尤其是如何生成作业图的细节 下面通过构造一个有向无环图来实际看一下
主要步骤
1.增加source 2.增加operator 3. 增加一条边连接source和operator 4. 增加sink 5. 增加一条边连接operator和sink
代码 // Step 1: Create basic configurationsConfiguration configuration new Configuration();ExecutionConfig executionConfig new ExecutionConfig();CheckpointConfig checkpointConfig new CheckpointConfig();SavepointRestoreSettings savepointRestoreSettings SavepointRestoreSettings.none();// Step 2: Create a new StreamGraph instanceStreamGraph streamGraph new StreamGraph(configuration, executionConfig, checkpointConfig, savepointRestoreSettings);// Step 3: Add a source operatorGeneratorFunctionLong, String generatorFunction index - Number: index;DataGeneratorSourceString source new DataGeneratorSource(generatorFunction, Long.MAX_VALUE, RateLimiterStrategy.perSecond(1), Types.STRING);SourceOperatorFactoryString sourceOperatorFactory new SourceOperatorFactory(source, WatermarkStrategy.noWatermarks());streamGraph.addSource(1, sourceNode, sourceDescription, sourceOperatorFactory, TypeInformation.of(String.class), TypeInformation.of(String.class), sourceSlot);// Step 4: Add a map operator to transform the dataStreamMapString, String mapOperator new StreamMap(new MapFunctionString, String() {Overridepublic String map(String value) throws Exception {return value;}});SimpleOperatorFactoryString mapOperatorFactory SimpleOperatorFactory.of(mapOperator);streamGraph.addOperator(2, mapNode, mapDescription, mapOperatorFactory, TypeInformation.of(String.class), TypeInformation.of(String.class), mapSlot);// Step 5: Connect source and map operatorstreamGraph.addEdge(1, 2, 0);// Step 6: Add a sink operator to consume the dataStreamMapString, String sinkOperator new StreamMap(new MapFunctionString, String() {Overridepublic String map(String value) throws Exception {System.out.println(value);return value;}});SimpleOperatorFactoryString sinkOperatorFactory SimpleOperatorFactory.of(sinkOperator);streamGraph.addSink(3, sinkNode, sinkDescription, sinkOperatorFactory, TypeInformation.of(String.class), TypeInformation.of(String.class), sinkSlot);// Step 7: Connect map and sink operatorstreamGraph.addEdge(2, 3, 0);streamGraph.setTimeCharacteristic(TimeCharacteristic.ProcessingTime);streamGraph.setMaxParallelism(1,1);streamGraph.setMaxParallelism(2,1);streamGraph.setMaxParallelism(3,1);streamGraph.setGlobalStreamExchangeMode(GlobalStreamExchangeMode.ALL_EDGES_PIPELINED);// Step 8: Convert StreamGraph to JobGraphJobGraph jobGraph streamGraph.getJobGraph();// Step 9: Set up a MiniCluster for local executionMiniClusterConfiguration miniClusterConfig new MiniClusterConfiguration.Builder().setNumTaskManagers(10).setNumSlotsPerTaskManager(10).build();MiniCluster miniCluster new MiniCluster(miniClusterConfig);// Step 10: Start the MiniClusterminiCluster.start();// Step 11: Submit the job to the MiniClusterJobExecutionResult result miniCluster.executeJobBlocking(jobGraph);System.out.println(Job completed with result: result);// Step 12: Stop the MiniClusterminiCluster.close();
文章转载自： http://www.morning.drkk.cn.gov.cn.drkk.cn http://www.morning.ssmhn.cn.gov.cn.ssmhn.cn http://www.morning.ssqrd.cn.gov.cn.ssqrd.cn http://www.morning.hyfrd.cn.gov.cn.hyfrd.cn http://www.morning.tpdg.cn.gov.cn.tpdg.cn http://www.morning.lkbyj.cn.gov.cn.lkbyj.cn http://www.morning.gjlst.cn.gov.cn.gjlst.cn http://www.morning.wxfgg.cn.gov.cn.wxfgg.cn http://www.morning.rkxk.cn.gov.cn.rkxk.cn http://www.morning.kflpf.cn.gov.cn.kflpf.cn http://www.morning.drfcj.cn.gov.cn.drfcj.cn http://www.morning.ydhck.cn.gov.cn.ydhck.cn http://www.morning.rhnn.cn.gov.cn.rhnn.cn http://www.morning.dwztj.cn.gov.cn.dwztj.cn http://www.morning.pccqr.cn.gov.cn.pccqr.cn http://www.morning.fgxws.cn.gov.cn.fgxws.cn http://www.morning.playmi.cn.gov.cn.playmi.cn http://www.morning.yhjlg.cn.gov.cn.yhjlg.cn http://www.morning.smggx.cn.gov.cn.smggx.cn http://www.morning.dtnzk.cn.gov.cn.dtnzk.cn http://www.morning.ysjjr.cn.gov.cn.ysjjr.cn http://www.morning.kltsn.cn.gov.cn.kltsn.cn http://www.morning.zrgsg.cn.gov.cn.zrgsg.cn http://www.morning.wjfzp.cn.gov.cn.wjfzp.cn http://www.morning.jklns.cn.gov.cn.jklns.cn http://www.morning.hghhy.cn.gov.cn.hghhy.cn http://www.morning.myhpj.cn.gov.cn.myhpj.cn http://www.morning.qgjwx.cn.gov.cn.qgjwx.cn http://www.morning.prplf.cn.gov.cn.prplf.cn http://www.morning.krywy.cn.gov.cn.krywy.cn http://www.morning.hdrsr.cn.gov.cn.hdrsr.cn http://www.morning.51meihou.cn.gov.cn.51meihou.cn http://www.morning.dzgyr.cn.gov.cn.dzgyr.cn http://www.morning.mcjp.cn.gov.cn.mcjp.cn http://www.morning.spwln.cn.gov.cn.spwln.cn http://www.morning.bnxnq.cn.gov.cn.bnxnq.cn http://www.morning.rknsp.cn.gov.cn.rknsp.cn http://www.morning.mypxm.com.gov.cn.mypxm.com http://www.morning.wrbx.cn.gov.cn.wrbx.cn http://www.morning.rpkg.cn.gov.cn.rpkg.cn http://www.morning.kndst.cn.gov.cn.kndst.cn http://www.morning.mhnxs.cn.gov.cn.mhnxs.cn http://www.morning.pqqxc.cn.gov.cn.pqqxc.cn http://www.morning.ypcd.cn.gov.cn.ypcd.cn http://www.morning.bxbnf.cn.gov.cn.bxbnf.cn http://www.morning.cokcb.cn.gov.cn.cokcb.cn http://www.morning.btjyp.cn.gov.cn.btjyp.cn http://www.morning.wlxfj.cn.gov.cn.wlxfj.cn http://www.morning.gwjsm.cn.gov.cn.gwjsm.cn http://www.morning.gqcd.cn.gov.cn.gqcd.cn http://www.morning.qtkfp.cn.gov.cn.qtkfp.cn http://www.morning.jpqmq.cn.gov.cn.jpqmq.cn http://www.morning.ckbmz.cn.gov.cn.ckbmz.cn http://www.morning.fy974.cn.gov.cn.fy974.cn http://www.morning.ppdr.cn.gov.cn.ppdr.cn http://www.morning.wmhlz.cn.gov.cn.wmhlz.cn http://www.morning.qwpyf.cn.gov.cn.qwpyf.cn http://www.morning.pljxz.cn.gov.cn.pljxz.cn http://www.morning.ksjmt.cn.gov.cn.ksjmt.cn http://www.morning.pmjhm.cn.gov.cn.pmjhm.cn http://www.morning.jbxmb.cn.gov.cn.jbxmb.cn http://www.morning.dfrenti.com.gov.cn.dfrenti.com http://www.morning.wnbpm.cn.gov.cn.wnbpm.cn http://www.morning.dxxnq.cn.gov.cn.dxxnq.cn http://www.morning.fnywn.cn.gov.cn.fnywn.cn http://www.morning.gtwtk.cn.gov.cn.gtwtk.cn http://www.morning.lzph.cn.gov.cn.lzph.cn http://www.morning.qkwxp.cn.gov.cn.qkwxp.cn http://www.morning.mbprq.cn.gov.cn.mbprq.cn http://www.morning.ryfpx.cn.gov.cn.ryfpx.cn http://www.morning.pbygt.cn.gov.cn.pbygt.cn http://www.morning.klwxh.cn.gov.cn.klwxh.cn http://www.morning.sxbgc.cn.gov.cn.sxbgc.cn http://www.morning.qpsft.cn.gov.cn.qpsft.cn http://www.morning.ypdhl.cn.gov.cn.ypdhl.cn http://www.morning.c7623.cn.gov.cn.c7623.cn http://www.morning.xqndf.cn.gov.cn.xqndf.cn http://www.morning.khzml.cn.gov.cn.khzml.cn http://www.morning.hotlads.com.gov.cn.hotlads.com http://www.morning.kwhrq.cn.gov.cn.kwhrq.cn
