Skip to content

ChenShuai1981/flink190

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

61 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

flink190

Examples about Apache Flink 1.9.0 for self learning purpose.

Flink中延时调用设计与实现 DetectDelayJob

滑动窗口优化 ScottyWindowJob

计算实时热门商品 HotItems

Hbase维表关联:LRU策略 (新增了异步mini batch访问hbase方式) HbaseAsyncLRUJob

如何做定时输出 BatchIntervalSinkJob

自定义metric监控流入量 JobMetricsExample ParseKafkaSourceMetricsJob

Mysql维表关联:全量加载 ScheduleMySQLSideFullLoadJob

维表服务与Flink异步IO MySqlAsyncIOJob

kafka维表关联:广播方式 KafkaBroadcastRuleJob CustomerPurchaseBehaviorTracker

自定义异步查询 CustomizeAsyncFunctionJob

基于 Flink 实现的商品实时推荐系统

基于Kafka+Flink+Redis的电商大屏实时计算案例 DashboardJob

Watermark测试 WatermarkTest

Flink intervalJoin 使用与原理分析 IntervalJoinDemo

Flink DataStream中CoGroup实现原理与三种 join 实现 CoGroupDemo

Flink时间系统系列之ProcessFunction 使用分析 ProcessFunctionExample

PurgingTrigger使用 WindowAnatomy

But most of the cases we want to clear the records once window evaluates, rather than keeping forever. In those situations we need to use purge trigger with count trigger. Purging trigger is a trigger which normally wraps the other triggers. Purging trigger is responsible for purging all the values which are passed to the trigger from the window once window evaluates. 简言之,使用PurgingTrigger之后,状态不再累积,而是一次性的。PurgingTrigger通常需要配合其他Trigger使用。

ContinuousEventTimeTrigger使用,基于事件时间持续周期性地触发 ContinuousEventTimeTriggerDemo

FavouriteColour & FavouriteColourTable 分别用stream api和table api实现对favorite colour统计

StudentScoreExample 使用ROW_NUMBER() OVER窗口进行统计 + TopN统计

flink exactly-once系列之StreamingFileSink分析 StreamingFileSinkExample

flink自定义trigger-实现窗口随意输出 KafkaSourceTriggerTest

三流join FlinkWindow

延时自动过期元素窗口(最近30分钟打电话次数) CustomWindowExample

采用Data Stream API构建interval join IntervalJoinExample

订单超时未运发出警告 TimeoutAlert

[Flink实践|Flink Window的5个使用小技巧](https://mp.weixin.qq.com/s/Pmnc1uV-stTZ5LLQhSupcw) MapStateDedup WindowDedup DailyWindowContinuousTrigger WindowAggregationDiff RegularTriggerWindow

不过需要注意的是,如果同时指定了Evictor的话,那么即使使用 ReduceFunction/AggregateFunction/FoldFunction,Window也会缓存所有数据,以提供给Evictor进行过滤,因此要慎重使用。

阿粉带你学习Flink中的Watermark TestWatermark

Flink维表关联系列之Redis维表关联:实时查询 LookupRedis

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published