Support Python UDF

[stdpain]

Feature request

support Python UDF for starrocks

grammar: extends the create function to support inline call

CREATE FUNCTION echo(int) 
RETURNS int 
properties(     
"symbol" = "add", 
"type" = "Python",     
"file" = "inline" ,
"input" = "arrow"
)  
AS
$$
def echo(a):
    return a;
$$;

UDFCall:
use grpc to call Python UDF
Be process

Python Env Support:
Since 3.8+ Arrow 16.0.0+
grpc

pip install pyarrow
pip install grpcio

make sure all package are install in PYTHONHOME (config in BE)

fe config:
enable_udf=true
be config:

python_envs=/root/python38

examples:

see test/sql/test_udf/test_python_udf

Additional context

PR Links

• [Feature] introduce thirdparty grpc #46247
• [Feature] (Python UDF) support create function grammar in Python UDF #46299
• [Feature] (Python UDF) support arrow call stub #46449

[dirtysalt]

linked to this issue

Python UDF support · Issue #45843 · StarRocks/starrocks
#45843

[WencongLiu]

@stdpain Hi, recently, I have been researching how to implement Python UDAF and UDTF. Can we add a WeChat conversation? Also, do you have any specific design documentation for your Python UDF?
My WeChat is Liuwenclever.😆

[stdpain]

@stdpain Hi, recently, I have been researching how to implement Python UDAF and UDTF. Can we add a WeChat conversation? Also, do you have any specific design documentation for your Python UDF? My WeChat is Liuwenclever.😆

We could open a public discussion in slack. https://starrocks.slack.com/archives/C02FAD0JSSD

[zhangm365]

@stdpain Hi,
I have heard the python UDF will be supported in version 3.4, so when is the expected time?
Thanks a lot.