-
Notifications
You must be signed in to change notification settings - Fork 11
Data Ingest End
RyanRConaway edited this page Jun 13, 2023
·
1 revision
The data_ingest_end
event is published from Forklift to the EventStream after the final data message has been persisted to the database. This message is likely unnecessary and is recommended to be removed in future modifications. Currently, this event causes Andi to record the ingested_time, which is not used. It also causes Forklift to end it's data processing subprocesses and remove the dataset state in Redis. The subprocesses need to be terminated, but the remaining behavior is unused.
Field Name | Type | Description | Enum Values |
---|---|---|---|
type | string | Identifier of the event type. Used to filter and receive events | ingestion:update |
data | Dataset(TODO) | The Dataset entity that forklift wrote data to. | - |
author | string | The identifier of who sent the event. | - |
Performance: Negligible