Skip to content
This repository has been archived by the owner on Jul 29, 2024. It is now read-only.

Misc fixes 1 #37

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 16 additions & 16 deletions src/pages/latest/delta-faq.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -6,27 +6,27 @@ menu: docs

_In this article:_

- [What is Delta Lake?](/latest/delta-faq.html#what-is-delta-lake)
- [What is Delta Lake?](/latest/delta-faq#what-is-delta-lake)

- [How is Delta Lake related to Apache Spark?](/latest/delta-faq.html#how-is-delta-lake-related-to-apache-spark)
- [How is Delta Lake related to Apache Spark?](/latest/delta-faq#how-is-delta-lake-related-to-apache-spark)

- [What format does Delta Lake use to store data?](/latest/delta-faq.html#what-format-does-delta-lake-use-to-store-data)
- [What format does Delta Lake use to store data?](/latest/delta-faq#what-format-does-delta-lake-use-to-store-data)

- [How can I read and write data with Delta Lake?](/latest/delta-faq.html#how-can-i-read-and-write-data-with-delta-lake)
- [How can I read and write data with Delta Lake?](/latest/delta-faq#how-can-i-read-and-write-data-with-delta-lake)

- [Where does Delta Lake store the data?](/latest/delta-faq.html#where-does-delta-lake-store-the-data)
- [Where does Delta Lake store the data?](/latest/delta-faq#where-does-delta-lake-store-the-data)

- [Can I copy my Delta Lake table to another location?](/latest/delta-faq.html#can-i-copy-my-delta-lake-table-to-another-location)
- [Can I copy my Delta Lake table to another location?](/latest/delta-faq#can-i-copy-my-delta-lake-table-to-another-location)

- [Can I stream data directly into and from Delta tables?](/latest/delta-faq.html#can-i-stream-data-directly-into-and-from-delta-tables)
- [Can I stream data directly into and from Delta tables?](/latest/delta-faq#can-i-stream-data-directly-into-and-from-delta-tables)

- [Does Delta Lake support writes or reads using the Spark Streaming DStream API?](/latest/delta-faq.html#does-delta-lake-support-writes-or-reads-using-the-spark-streaming-dstream-api)
- [Does Delta Lake support writes or reads using the Spark Streaming DStream API?](/latest/delta-faq#does-delta-lake-support-writes-or-reads-using-the-spark-streaming-dstream-api)

- [When I use Delta Lake, will I be able to port my code to other Spark platforms easily?](/latest/delta-faq.html#when-i-use-delta-lake-will-i-be-able-to-port-my-code-to-other-spark-platforms-easily)
- [When I use Delta Lake, will I be able to port my code to other Spark platforms easily?](/latest/delta-faq#when-i-use-delta-lake-will-i-be-able-to-port-my-code-to-other-spark-platforms-easily)

- [Does Delta Lake support multi-table transactions?](/latest/delta-faq.html#does-delta-lake-support-multi-table-transactions)
- [Does Delta Lake support multi-table transactions?](/latest/delta-faq#does-delta-lake-support-multi-table-transactions)

- [How can I change the type of a column?](/latest/delta-faq.html#how-can-i-change-the-type-of-a-column)
- [How can I change the type of a column?](/latest/delta-faq#how-can-i-change-the-type-of-a-column)

## What is Delta Lake?

Expand Down Expand Up @@ -54,8 +54,8 @@ provide ACID transactions.

You can use your favorite Apache Spark APIs to read and write data with

Delta Lake. See [Read a table](/latest/delta-batch#deltadataframereads) and
[Write to a table](/latest/delta-batch#deltadataframewrites).
Delta Lake. See [Read a table](/latest/delta-batch#read-a-table) and
[Write to a table](/latest/delta-batch#write-to-a-table).

## Where does Delta Lake store the data?

Expand All @@ -73,8 +73,8 @@ timestamps will be consistent.

Yes, you can use Structured Streaming to directly write data into Delta tables
and read from Delta tables. See [Stream data into Delta
tables](/latest/delta-streaming#stream-sink) and [Stream data from Delta
tables](/latest/delta-streaming#stream-source).
tables](/latest/delta-streaming#delta-table-as-a-sink) and [Stream data from Delta
tables](/latest/delta-streaming#delta-table-as-a-source).

## Does Delta Lake support writes or reads using the Spark Streaming DStream API?

Expand All @@ -94,4 +94,4 @@ Delta Lake supports transactions at the _table_ level.
## How can I change the type of a column?

Changing a column's type or dropping a column requires rewriting the table. For
an example, see [Change column type](delta-batch.md#change-column-type).
an example, see [Change column type](/latest/delta-batch/#change-column-type-or-name).
4 changes: 2 additions & 2 deletions src/pages/latest/delta-update.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -339,7 +339,7 @@ Here is a detailed description of the `merge` programmatic operation.

- `whenMatched` clauses are executed when a source row matches a target table row based on the match condition. These clauses have the following semantics.

- `whenMatched` clauses can have at most one `update` and one `delete` action. The `update` action in `merge` only updates the specified columns (similar to the `update` [operation](#delta-update)) of the matched target row. The `delete` action deletes the matched row.
- `whenMatched` clauses can have at most one `update` and one `delete` action. The `update` action in `merge` only updates the specified columns (similar to the `update` [operation](#update-a-table)) of the matched target row. The `delete` action deletes the matched row.

- Each `whenMatched` clause can have an optional condition. If this clause condition exists, the `update` or `delete` action is executed for any matching source-target row pair only when the clause condition is true.

Expand Down Expand Up @@ -404,7 +404,7 @@ Here is a detailed description of the `merge` programmatic operation.

- For `updateAll` and `insertAll` actions, the source dataset must have all the columns of the target Delta table. The source dataset can have extra columns and they are ignored.

If you do not want the extra columns to be ignored and instead want to update the target table schema to include new columns, see [merge schema evolution](#merge-schema-evolution).
If you do not want the extra columns to be ignored and instead want to update the target table schema to include new columns, see [Automatic schema evolution](#automatic-schema-evolution).

- For all actions, if the data type generated by the expressions producing the target columns are different from the corresponding columns in the target Delta table, `merge` tries to cast them to the types in the table.

Expand Down
2 changes: 1 addition & 1 deletion src/pages/latest/releases.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -21,4 +21,4 @@ The following table lists Delta Lake versions and their compatible Apache Spark
| 1.1.x | 3.2.x |
| 1.0.x | 3.1.x |
| 0.7.x and 0.8.x | 3.0.x |
| Below 0.7.0 | 2.4.2 - 2.4._latest_ |
| Below 0.7.0 | 2.4.2 - 2.4.4 |