Skip to content

D3luxee/mirrormaker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

mirrormaker

A simple mirrormaker written in go, supporting compression and different partitioners for mirroring.

Features

  • Compression of messages (gzip,lz4,snappy,none)
  • Partitioning in different ways:
    • hash (it will read the partition key of the source message and partition it again)
    • keepPartition (it will write the message to the same partition on the target topic as it was read from the source topic)
    • random (just a random partitioner)
    • modulo (SourcePartiton % NumPartitionsOfTargetTopic) this works good if you want to replicate from many to less partitions. If the source topic has less or the same number of partitions this will work like keepPartition.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published