Onyx 0.14.4 API documentation

Returns true if this all of this output's data has been emitted, and it is
safe to complete the job. Streaming inputs should always return false.

Returns a bool for whether it is safe to advance to the next epoch.
All reads from the previous epoch must be completely emitted / discarded before it is safe to return true.

Pure function that returns the full checkpoint state,
that allows the plugin state to be recovered. This checkpoint value
will be passed in to recover when restarting the task and recovering
the plugin's state.

checkpointed! is called whenever an epoch has been fully snapshotted 
over the job's entire directed acyclic graph. At this point it is safe to
do any un-recoverable housekeeping for previous epoch's data.

Recover the state of the plugin from the supplied checkpoint.
Returns a new reader.

Polls the plugin for a new segment, or returns nil if none are currently available. Plugin should attempt to limit poll time to timeout-ms.

Called prior to write batch. Primarily used as an initial preparation step before write-batch is called repeatedly. Must return true or false depending on whether it is safe to advance to the next state.

Write the prepared batch to the storage medium. 
Must return true or false depending on whether the batch has been fully written. 
This is so that non-blocking functions can be used.

Initialize the plugin, generally assoc'ing any initial state.

Shutdown the input and close any resources that needs to be closed.
This can also be done using lifecycles.

Returns the latest high water mark timestamp for the input source