Skip to content

Latest commit

 

History

History
26 lines (17 loc) · 1.03 KB

spark-sql-streaming-FileStreamSinkLog.adoc

File metadata and controls

26 lines (17 loc) · 1.03 KB

FileStreamSinkLog

FileStreamSinkLog is a concrete CompactibleFileStreamLog (of SinkFileStatus metadata) for…​FIXME

FileStreamSinkLog is created for FileStreamSink and MetadataLogFileIndex.

FileStreamSinkLog (like the parent CompactibleFileStreamLog) takes the following to be created:

  • Version

  • SparkSession

  • Path of the metadata log directory

FileStreamSinkLog uses 1 for the version.

compactLogs Method

compactLogs(logs: Seq[SinkFileStatus]): Seq[SinkFileStatus]
Note
compactLogs is part of the CompactibleFileStreamLog Contract to…​FIXME.

compactLogs…​FIXME