Links

SPRKPY1022

pyspark.sql.functions.log10 has a workaround

Category

Warning.

Description

This issue appears when the tool detects the usage of pyspark.sql.functions.log10 which has a workaround.
Input code:
col = log10(colName)
Output code:
#EWI: SPRKPY1022 => pyspark.sql.functions.log10 has a workaround, see documentation for more info
col = log10(colName)

Scenario:

log10(col: ColumnOrName) Action: There is no log10 implementation but can be used log sending literal 10 as the base used to calc de logarithm.
col = log(lit(10),colName)

Recommendation