Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The data in the buildstock csv in Athena is not correct #428

Open
yingli-NREL opened this issue Jan 25, 2024 · 1 comment
Open

The data in the buildstock csv in Athena is not correct #428

yingli-NREL opened this issue Jan 25, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@yingli-NREL
Copy link

Describe the bug
In Athena, the data in the buildstock csv file is not correct, see the following figure.
image
There is a comma in some value of the output. In Athena, those kind of data is in two columns.

Work around
The buildstock csv in the S3 is correct. Can use that one.
Need make improvement for buildstockbath to figure out this problem.

Platform:

  • BuildStockBatch version: buildstock-2023.11.0
@yingli-NREL yingli-NREL added the bug Something isn't working label Jan 25, 2024
@afontani
Copy link
Collaborator

afontani commented Feb 7, 2024

From @nmerket : Upload the buildstock.parquet instead of the buildstock.csv. @rajeee second, but could also look at the crawler configuration to see if there is an easy way to fix this issue. The discussion seems to be leaning towards 1) upload both .csv and .parquet but only crawl the .parquet or 2) fix the crawler?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants