Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for master data sequences #114

Open
BEagle1984 opened this issue Jan 11, 2021 · 0 comments
Open

Support for master data sequences #114

BEagle1984 opened this issue Jan 11, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@BEagle1984
Copy link
Owner

Support a new type of sequence to deal with master data replication. Some headers will be used to delimit the dataset.

It should ideally be possible to publish a collection of messages and have the Silverback producer automatically add the necessary headers.
The consumer should recognize the dataset and create an ISequence to deal with it as a unit of work, where the subscriber recognizes when all messages have been received (subscribing to the IMessageStreamEnumerable, that will complete when the entire set has been consumed).

The headers should be as follows.

Header Description
x-dataset-last Marks the last dataset element in this partition.
x-dataset-first-offset Starting offset of the dataset in this partition. Present in all records except the first one of each partition.
x-dataset-version Optional. Monotonic increasing number identifying the dataset version.
x-dataset-index Sequence number, within a version. Starts with zero.
x-dataset-count Optional. Total number of records.
@BEagle1984 BEagle1984 added the enhancement New feature or request label Feb 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant