Links

Issues and Troubleshooting

In this section, you will find information about Errors, Warnings, and Issues on PySpark

Issues Code

Parsing errors, and conversion exceptions caused by PySpark. The user should contact to Mobilize Team to fix the issue.
Code
Description
Category
Not supported spark version
Warning
File with parsing errors
Parsing error
Element is not supported
Conversion error
An error occurred when loading the symbol table
Conversion error
The symbol table could not be loaded
Parsing error
pyspark.conf.SparkConf is not required
Warning
pyspark.context.SparkContext is not required
Warning
pyspark.sql.context.SQLContext is not required
Warning
pyspark.sql.context.HiveContext is not required
Warning
pyspark.sql.dataframe.DataFrame.approxQuantile has a workaround
Warning
pyspark.sql.dataframe.DataFrame.checkpoint has a workaround
Warning
pyspark.sql.dataframe.DataFrameStatFunctions.approxQuantile has a workaround
Warning
pyspark.sql.dataframe.DataFrameStatFunctions.writeTo has a workaround
Warning
pyspark.sql.functions.acosh has a workaround
Warning
pyspark.sql.functions.asinh has a workaround
Warning
pyspark.sql.functions.atanh has a workaround
Warning
pyspark.sql.functions.collect_set has a workaround
Warning
pyspark.sql.functions.date_add has a workaround
Warning
pyspark.sql.functions.date_sub has a workaround
Warning
pyspark.sql.functions.datediff has a workaround
Warning
pyspark.sql.functions.instr has a workaround
Warning
pyspark.sql.functions.last has a workaround
Warning
pyspark.sql.functions.log10 has a workaround
Warning
pyspark.sql.functions.log1p has a workaround
Warning
pyspark.sql.functions.log2 has a workaround
Warning
pyspark.sql.functions.ntile has a workaround
Warning
pyspark.sql.readwriter.DataFrameReader.csv has a workaround
Warning
pyspark.sql.readwriter.DataFrameReader.json has a workaround
Warning
pyspark.sql.readwriter.DataFrameReader.orc has a workaround
Warning
pyspark.sql.readwriter.DataFrameReader.parquet has a workaround
Warning
pyspark.sql.session.SparkSession.Builder.appName has a workaround
Warning
pyspark.sql.column.Column.contains
Warning
Element is not defined
Conversion error
pyspark.sql.functions.asc has a workaround
Warning
pyspark.sql.functions.desc has a workaround
Warning
pyspark.sql.functions.reverse has a workaround
Warning
pyspark.sql.column.Column.getField has a workaround
Warning
pyspark.sql.functions.sort_array has a workaround
Warning
Element is not recognized
Conversion error
pyspark.sql.column.Column.getItem has a workaround
Warning
pyspark.sql.functions.explode has workaround
Warning
pyspark.sql.functions.explode_outer has workaround
Warning
pyspark.sql.functions.posexplode has workaround
Warning
pyspark.sql.functions.posexplode_outer has workaround
Warning
pyspark.sql.functions.split has workaround
Warning
pyspark.sql.functions.map_values has workaround
Warning
pyspark.sql.functions.monotonically_increasing_id has workaround
Warning
pyspark.context.SparkContext.setLogLevel has workaround
Warning
pyspark.sql.session.SparkSession.conf has workaround
Warning
pyspark.sql.session.SparkSession.sparkContext
Warning
pyspark.conf.SparkConf.set has workaround
Warning
pyspark.sql.session.SparkSession.Builder.master has a workaround
Warning
pyspark.sql.session.SparkSession.Builder.enableHiveSupport has workaround
Warning