Links

SPRKPY1005

pyspark.conf.SparkConf is not required

Category

Warning.

Description

This issue appears when the tool detects the usage of pyspark.conf.SparkConf which is not required.
Input code:
from pyspark import SparkConf
my_conf = SparkConf(loadDefaults=True)
Output code:
#EWI: SPRKPY1005 => pyspark.conf.SparkConf is not required
#from pyspark import SparkConf
pass
#EWI: SPRKPY1005 => pyspark.conf.SparkConf is not required
my_conf = Session.builder.configs({"user" : "my_user", "password" : "my_password", "account" : "my_account", "role" : "my_role", "warehouse" : "my_warehouse", "database" : "my_database", "schema" : "my_schema"}).create()

Recommendation