From be43105722b610228891df8c45663f57bbf3607c Mon Sep 17 00:00:00 2001 From: Yuqing Wei Date: Fri, 16 Dec 2022 15:59:32 +0800 Subject: [PATCH] #926 Signed-off-by: Yuqing Wei --- docs/how-to-guides/feathr-job-configuration.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/how-to-guides/feathr-job-configuration.md b/docs/how-to-guides/feathr-job-configuration.md index 25b6d6e9b..302089fd1 100644 --- a/docs/how-to-guides/feathr-job-configuration.md +++ b/docs/how-to-guides/feathr-job-configuration.md @@ -33,3 +33,11 @@ Examples when using the above job configurations when materializing features: ```python client.materialize_features(settings, execution_configurations=SparkExecutionConfiguration({"spark.feathr.inputFormat": "parquet", "spark.feathr.outputFormat": "parquet"})) ``` + +## Config not applied issue +Please note that `execution_configurations` argument only works when using a new job cluster in Databricks : [Cluster spark config not applied](https://learn.microsoft.com/en-us/azure/databricks/kb/clusters/cluster-spark-config-not-applied) + +If you are using an existing cluster, please manually add them to the cluster spark configuration. This can be done in Databrick Cluster UI : [Edit a cluster](https://learn.microsoft.com/en-us/azure/databricks/clusters/clusters-manage#--edit-a-cluster) + + +