Links

SPRKPY1046

pyspark.sql.functions.monotonically_increasing_id has workaround

Description

This issue appears when the tool detects the usage of pyspark.sql.functions.monotonically_increasing_id which has a workaround. Note: This workaround is deprecated because a later tool version supports this function.
Input code:
df.select(monotonically_increasing_id())
Output code:
#EWI: SPRKPY1045 => pyspark.sql.functions.map_values has a workaround, see documentation for more info
df.select(monotonically_increasing_id())

Scenario

monotonically_increasing_id() -> pyspark.sql.column.Column
Action: Update the tool version.
df.select(monotonically_increasing_id())

Recommendation