Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dbt tutorial my_first_dbt_model doesn't work with StarRocks #23

Open
alberttwong opened this issue Feb 10, 2024 · 6 comments · Fixed by StarRocks/starrocks#42198
Open
Assignees

Comments

@alberttwong
Copy link
Contributor

Stuck at step 5. https://docs.getdbt.com/guides/manual-install?step=5

(dbt-env) atwong@Albert-CelerData jaffle_shop % dbt run
23:59:46  Running with dbt=1.6.2
23:59:46  Registered adapter: starrocks=1.4.2
23:59:46  Unable to do partial parsing because profile has changed
23:59:46  Found 2 models, 4 tests, 0 sources, 0 exposures, 0 metrics, 335 macros, 0 groups, 0 semantic models
23:59:46
23:59:46  Concurrency: 1 threads (target='dev')
23:59:46
23:59:46  1 of 2 START sql table model testing.my_first_dbt_model ........................ [RUN]
23:59:46  1 of 2 ERROR creating sql table model testing.my_first_dbt_model ............... [ERROR in 0.05s]
23:59:46  2 of 2 SKIP relation testing.my_second_dbt_model ............................... [SKIP]
23:59:46
23:59:46  Finished running 1 table model, 1 view model in 0 hours 0 minutes and 0.18 seconds (0.18s).
23:59:46
23:59:46  Completed with 1 error and 0 warnings:
23:59:46
23:59:46    Compilation Error in model my_first_dbt_model (models/example/my_first_dbt_model.sql)
  '>' not supported between instances of 'int' and 'str'

  > in macro starrocks__create_table_as (macros/materializations/models/table.sql)
  > called by macro create_table_as (macros/materializations/models/table/create_table_as.sql)
  > called by macro default__get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro statement (macros/etc/statement.sql)
  > called by macro materialization_table_default (macros/materializations/models/table/table.sql)
  > called by model my_first_dbt_model (models/example/my_first_dbt_model.sql)
23:59:46
23:59:46  Done. PASS=0 WARN=0 ERROR=1 SKIP=1 TOTAL=2
imay referenced this issue in StarRocks/starrocks Mar 6, 2024
…sues/41016 (#42198)

Fixed #41016 which causes problems with version 3.2
Used to spit out
'>' not supported between instances of 'int' and 'str'
Signed-off-by: Fardin Sarker <[email protected]>
mergify bot referenced this issue in StarRocks/starrocks Mar 6, 2024
…sues/41016 (#42198)

Fixed #41016 which causes problems with version 3.2
Used to spit out
'>' not supported between instances of 'int' and 'str'
Signed-off-by: Fardin Sarker <[email protected]>
(cherry picked from commit 81219ae)
@alberttwong alberttwong reopened this Mar 8, 2024
@alberttwong
Copy link
Contributor Author

I see the PR merged but the dbt-starrocks connector hasn't be updated with the latest. https://pypi.org/project/dbt-starrocks/#history

@alberttwong alberttwong transferred this issue from StarRocks/starrocks Mar 11, 2024
@hhhonzik
Copy link

same issue here, would be great if this gets resolved as i can't create any tables / materialized_views in my dbt project.

@alberttwong
Copy link
Contributor Author

(dbt-env) atwong@Albert-CelerData jaffle_shop % dbt run -d
22:02:23  Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'start', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10190d190>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10511c580>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10511c490>]}
22:02:23  Running with dbt=1.6.10
22:02:23  running dbt with arguments {'printer_width': '80', 'indirect_selection': 'eager', 'log_cache_events': 'False', 'write_json': 'True', 'partial_parse': 'True', 'cache_selected_only': 'False', 'profiles_dir': '/Users/atwong/.dbt', 'fail_fast': 'False', 'version_check': 'True', 'log_path': '/Users/atwong/sandbox/dbt-tutorial/jaffle_shop/logs', 'debug': 'True', 'warn_error': 'None', 'use_colors': 'True', 'use_experimental_parser': 'False', 'no_print': 'None', 'quiet': 'False', 'log_format': 'default', 'static_parser': 'True', 'warn_error_options': 'WarnErrorOptions(include=[], exclude=[])', 'invocation_command': 'dbt run -d', 'target_path': 'None', 'introspect': 'True', 'send_anonymous_usage_stats': 'True'}
22:02:23  Sending event: {'category': 'dbt', 'action': 'project_id', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x105163580>]}
22:02:23  Sending event: {'category': 'dbt', 'action': 'adapter_info', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x105530070>]}
22:02:23  Registered adapter: starrocks=1.6.0
22:02:23  checksum: 28908e88b83a05550f08d8d5005b031bfd1e6cf5c944d3c74469cec401f04961, vars: {}, profile: , target: , version: 1.6.10
22:02:23  Partial parsing enabled: 0 files deleted, 0 files added, 0 files changed.
22:02:23  Partial parsing enabled, no changes found, skipping parsing
22:02:23  Sending event: {'category': 'dbt', 'action': 'load_project', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x1056b50d0>]}
22:02:23  Sending event: {'category': 'dbt', 'action': 'resource_counts', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10567bc70>]}
22:02:23  Found 2 models, 4 tests, 0 sources, 0 exposures, 0 metrics, 338 macros, 0 groups, 0 semantic models
22:02:23  Sending event: {'category': 'dbt', 'action': 'runnable_timing', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x1055fc220>]}
22:02:23
22:02:23  Acquiring new starrocks connection 'master'
22:02:23  Acquiring new starrocks connection 'list_schemas'
22:02:23  Using starrocks connection "list_schemas"
22:02:23  On list_schemas: /* {"app": "dbt", "dbt_version": "1.6.10", "profile_name": "jaffle_shop", "target_name": "dev", "connection_name": "list_schemas"} */
select distinct schema_name from information_schema.schemata
22:02:23  Opening a new connection, currently in state init
22:02:23  SQL status: SUCCESS 4 in 0.0 seconds
22:02:23  On list_schemas: Close
22:02:23  Re-using an available connection from the pool (formerly list_schemas, now list_None_testing)
22:02:23  Using starrocks connection "list_None_testing"
22:02:23  On list_None_testing: BEGIN
22:02:23  Opening a new connection, currently in state closed
22:02:23  SQL status: SUCCESS 0 in 0.0 seconds
22:02:23  Using starrocks connection "list_None_testing"
22:02:23  On list_None_testing: /* {"app": "dbt", "dbt_version": "1.6.10", "profile_name": "jaffle_shop", "target_name": "dev", "connection_name": "list_None_testing"} */

    select
      null as "database",
      tbl.table_name as name,
      tbl.table_schema as "schema",
      case when tbl.table_type = 'BASE TABLE' then 'table'
           when tbl.table_type = 'VIEW' and mv.table_name is null then 'view'
           when tbl.table_type = 'VIEW' and mv.table_name is not null then 'materialized_view'
           when tbl.table_type = 'SYSTEM VIEW' then 'system_view'
           else 'unknown' end as table_type
    from information_schema.tables tbl
    left join information_schema.materialized_views mv
    on tbl.TABLE_SCHEMA = mv.TABLE_SCHEMA
    and tbl.TABLE_NAME = mv.TABLE_NAME
    where tbl.table_schema = 'testing'

22:02:24  SQL status: SUCCESS 0 in 0.0 seconds
22:02:24  On list_None_testing: ROLLBACK
22:02:24  On list_None_testing: Close
22:02:24  Sending event: {'category': 'dbt', 'action': 'runnable_timing', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x1056a1d30>]}
22:02:24  Using starrocks connection "master"
22:02:24  On master: BEGIN
22:02:24  Opening a new connection, currently in state init
22:02:24  SQL status: SUCCESS 0 in 0.0 seconds
22:02:24  On master: COMMIT
22:02:24  Using starrocks connection "master"
22:02:24  On master: COMMIT
22:02:24  SQL status: SUCCESS 0 in 0.0 seconds
22:02:24  On master: Close
22:02:24  Concurrency: 1 threads (target='dev')
22:02:24
22:02:24  Began running node model.jaffle_shop.my_first_dbt_model
22:02:24  1 of 2 START sql table model testing.my_first_dbt_model ........................ [RUN]
22:02:24  Re-using an available connection from the pool (formerly list_None_testing, now model.jaffle_shop.my_first_dbt_model)
22:02:24  Began compiling node model.jaffle_shop.my_first_dbt_model
22:02:24  Writing injected SQL for node "model.jaffle_shop.my_first_dbt_model"
22:02:24  Timing info for model.jaffle_shop.my_first_dbt_model (compile): 15:02:24.024689 => 15:02:24.030388
22:02:24  Began executing node model.jaffle_shop.my_first_dbt_model
22:02:24  Opening a new connection, currently in state closed
22:02:24  Timing info for model.jaffle_shop.my_first_dbt_model (execute): 15:02:24.030982 => 15:02:24.071785
22:02:24  On model.jaffle_shop.my_first_dbt_model: Close
22:02:24  Compilation Error in model my_first_dbt_model (models/example/my_first_dbt_model.sql)
  '>' not supported between instances of 'int' and 'str'

  > in macro starrocks__create_table_as (macros/materializations/models/table.sql)
  > called by macro create_table_as (macros/materializations/models/table/create_table_as.sql)
  > called by macro default__get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro statement (macros/etc/statement.sql)
  > called by macro materialization_table_default (macros/materializations/models/table/table.sql)
  > called by model my_first_dbt_model (models/example/my_first_dbt_model.sql)
22:02:24  Sending event: {'category': 'dbt', 'action': 'run_model', 'label': '668cc995-a88e-452d-abab-4e1df267fe5a', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x1056fb7f0>]}
22:02:24  1 of 2 ERROR creating sql table model testing.my_first_dbt_model ............... [ERROR in 0.05s]
22:02:24  Finished running node model.jaffle_shop.my_first_dbt_model
22:02:24  Began running node model.jaffle_shop.my_second_dbt_model
22:02:24  2 of 2 SKIP relation testing.my_second_dbt_model ............................... [SKIP]
22:02:24  Finished running node model.jaffle_shop.my_second_dbt_model
22:02:24  Using starrocks connection "master"
22:02:24  On master: BEGIN
22:02:24  Opening a new connection, currently in state closed
22:02:24  SQL status: SUCCESS 0 in 0.0 seconds
22:02:24  On master: COMMIT
22:02:24  Using starrocks connection "master"
22:02:24  On master: COMMIT
22:02:24  SQL status: SUCCESS 0 in 0.0 seconds
22:02:24  On master: Close
22:02:24  Connection 'master' was properly closed.
22:02:24  Connection 'model.jaffle_shop.my_first_dbt_model' was properly closed.
22:02:24
22:02:24  Finished running 1 table model, 1 view model in 0 hours 0 minutes and 0.17 seconds (0.17s).
22:02:24  Command end result
22:02:24
22:02:24  Completed with 1 error and 0 warnings:
22:02:24
22:02:24    Compilation Error in model my_first_dbt_model (models/example/my_first_dbt_model.sql)
  '>' not supported between instances of 'int' and 'str'

  > in macro starrocks__create_table_as (macros/materializations/models/table.sql)
  > called by macro create_table_as (macros/materializations/models/table/create_table_as.sql)
  > called by macro default__get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro get_create_table_as_sql (macros/materializations/models/table/create_table_as.sql)
  > called by macro statement (macros/etc/statement.sql)
  > called by macro materialization_table_default (macros/materializations/models/table/table.sql)
  > called by model my_first_dbt_model (models/example/my_first_dbt_model.sql)
22:02:24
22:02:24  Done. PASS=0 WARN=0 ERROR=1 SKIP=1 TOTAL=2
22:02:24  Command `dbt run` failed at 15:02:24.096283 after 0.31 seconds
22:02:24  Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'end', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x10190d190>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x105530340>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x1056f02b0>]}
22:02:24  Flushing usage events

@alberttwong
Copy link
Contributor Author

FYI @MarkovWangRR

@alberttwong
Copy link
Contributor Author

@hhhonzik I'm testing some fixes on a 1.6 release of the adapter. I'm hoping it'll be released later this week.

@alberttwong
Copy link
Contributor Author

fail at step 5 of tutorial. #38

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants