dataframe.DataFrame.toSparkDf

DataFrame.toSparkDf()[source]

ClickHouse table >> spark dataframe.

Example

>>> import fast_causal_inference
>>> fast_causal_inference.set_default(tenant_id="",tenant_secret_key="")
>>> spark = fast_causal_inference.set_spark_session(group_id='', gaia_id='') # group_id,gaia_id 参考 notebook上默认文件！Spark 资源池.html
>>> df = fast_causal_inference.readClickHouse('test_data_small')
>>> spark_df = df.toSparkDf()