Replies: 1 comment
-
Could you provide a small reproducible example? I’m not familiar with this area, but I may be able to help with debugging. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have a data in NDJSON format.
The thing is some fields there are optional and populated when needed.
As I understand, DF is using the first row only by default to infer schema. Than when it see that certain fields are missing in som of the next rows it shows an error
Fail to merge schema field 'my_fieldname' because the from data_type ... does not equal ...
.So is it possible to specify N rows which should be used to infer schema?
Beta Was this translation helpful? Give feedback.
All reactions