[FEATURE] BackfillRequest

[george-zubrienko]

Description

Using annotation to do a backfill turned out to be slightly cumbersome. Here are a few issues we have to manually tackle:

• Rows per group for backfills needs to be much higher to speed up loading
• Backfill with MERGE behaviour is only possible as a lookback, but we cannot specify a custom date range to "fill the missing holes" in data
• Backfill must perform a lookback on completion, for the duration of the backfill itself + some buffer, to avoid dataloss after streaming container starts
• There is little control of a timestamp the backfill starts from. While this is not critical for many plugins, for Synapse this is crucial due to lack of snapshot table that can be used as a baseline

Possible solution

No response

Alternatives

No response

Context

No response