-
Notifications
You must be signed in to change notification settings - Fork 352
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: Dimension lookup/update transform "Unable to retrieve data type of return fields because of an unexpected error" #3546
Comments
Currently I do the following work around: Open pipeline/transform in HOP. Change the type of return field to something else. Save. Change back to correct value. Save. Run in hop -> works - Strange |
On which field is the return type incorrect? Is this a date/datetime field? |
in the example above it is only one return field (see screenshot) and the type of that field is a String in Hop and a varchar(255) in the DB (Azure SQL Server). In other pipelines I have the same issue with fields that I declared as Integer in HOP and which are int in the DB. |
There may be a bug if the pipeline was created with a version < 2.7. When you return to the correct value, does the problem reappear in version 2.7? |
I have the same problem. I have tried with HOP 2.7.0 and HOP 2.5.0 executing (after tuning) workflows imported from kettle and 2.7.0 native workflows: same behaviour. |
Not 100% sure I get what you ask for. The pipeline was created before 2.7. |
Following your input I can confirm that clearing the database cache triggers the error for me as well. |
I rescue this issue to see if it can be moved to priority 1. Belén |
I suspect a problem loading/saving transformation metadata when changing the "Update dimension" mode. Step to reproduce:
There are 3 points to consider:
|
Apache Hop version?
2.7
Java version?
openjdk 11.0.21 2023-10-17
Operating system
macOS
What happened?
Running a pipeline with the dimension lookup/updated transform results in an error and exception.
The error message says that it could not retrieve the data type of the return fields although that is specified.
org.apache.hop.core.exception.HopTransformException:
Unable to retrieve data type of return fields because of an unexpected error
at java.lang.Thread.run (Thread.java:829)
at org.apache.hop.pipeline.transform.RunThread.run (RunThread.java:55)
at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.processRow (DimensionLookup.java:99)
at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookupMeta.getFields (DimensionLookupMeta.java:286)
Caused by: java.lang.NullPointerException
at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookupMeta.getFields(DimensionLookupMeta.java:286)
... 3 more
2024/01/12 13:39:24 - Lookup Building block.0 - ERROR: Unexpected error
2024/01/12 13:39:24 - Lookup Building block.0 - ERROR: org.apache.hop.core.exception.HopTransformException:
2024/01/12 13:39:24 - Lookup Building block.0 - Unable to retrieve data type of return fields because of an unexpected error
2024/01/12 13:39:24 - Lookup Building block.0 - at java.lang.Thread.run (Thread.java:829)
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transform.RunThread.run (RunThread.java:55)
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.processRow (DimensionLookup.java:99)
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookupMeta.getFields (DimensionLookupMeta.java:286)
2024/01/12 13:39:24 - Lookup Building block.0 -
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookupMeta.getFields(DimensionLookupMeta.java:307)
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.processRow(DimensionLookup.java:99)
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
2024/01/12 13:39:24 - Lookup Building block.0 - at java.base/java.lang.Thread.run(Thread.java:829)
2024/01/12 13:39:24 - Lookup Building block.0 - Caused by: java.lang.NullPointerException
2024/01/12 13:39:24 - Lookup Building block.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookupMeta.getFields(DimensionLookupMeta.java:286)
2024/01/12 13:39:24 - Lookup Building block.0 - ... 3 more
2024/01/12 13:39:24 - Lookup Building block.0 - child index = 3, logging object : org.apache.hop.core.logging.LoggingObject@3c86d77f parent=63896a50-b6ee-42c2-847a-e90562bac780
If helpful I am happy to provide more information
Issue Priority
Priority: 2
Issue Component
Component: Transforms
The text was updated successfully, but these errors were encountered: