Links

Release Notes

Updates on each released version of Mobilize.Net SnowConvert for Spark (Python)

Release 1.0.457 - December 01, 2022

Python 1.0.452
Python SnowConvert Core 2.0.217
New Features
  • Added support to SnowPark API version 1.0.0
  • Added five new workarounds documentation
  • Added execution info to telemetry
  • Added margin of error to the readiness score
Improvements
  • Improved accuracy in code symbols identification
  • Improvement in the assessment step when logging messages.

Release 1.0.441 - November 23, 2022

Python 1.0.449
PythonSnowConvert Core 2.0.210
New Features
  • Added EWI comments to the output code for not defined PySpark elements
  • Added support for inherited symbols
  • Three new mappings added
  • One workaround added
Improvements
  • Improved readiness score when all the files have errors
  • Improved error message when loading the symbol table
  • Improved handling of generic types
  • One mapping status changed from rename to direct
  • One conversion status changed from workaround to direct mapping
Bug Fixes
  • Fixed markdown conversion issue
  • Fixed syncing issues between PySpark_Mappings_Core table and the tool

Release 1.0.425 - November 17, 2022

Python 1.0.445
PythonSnowConvert Core 2.0.203
Improvements
  • Robustness at the loading symbol table
Bug Fixes
  • Fixed detailed report summary table for spark usage values
  • Fixed some parsing errors
  • Fixed EWI code sync issues between the tool and PySpark_Mappings_Core Snowflake DB table and

Release 1.0.415- November 15, 2022

Python 1.0.441
PythonSnowConvert Core 2.0.199
New Features
  • Added EWI record when an error is detected at loading the symbol table
Bug fixes
  • Fixed new lines issue when converting Jupyter notebook files

Release 1.0.404 - November 11, 2022

Python 1.0.436

PythonSnowConvert Core 2.0.195

New Features
  • Added basic support to convert Jupyter notebook files
  • Added a value for tracking import usages as an inventory
  • Improve the detailed report (Spark usages grouped by support category and Python Import Call Summary)
  • New mappings added
  • New workarounds added for 'SparkSession.Builder.appName'
  • New EWIs added as comments in the output code
  • Added support to copy non-Python files to the output directory
  • Added PySpark usages identification for id expressions
  • Added an error message when symbol table loading fails
Improvements
  • Improved imports mapping
  • Improved type hints mapping
  • Improved rename mappings to direct mappings
Bug Fixes
  • Parsing errors
  • The output directory structure for files with parsing errors
  • Fixed 'pyspark.streaming' full names
  • Fixed CLI crashing

Release 1.0.315 - October 21, 2022

Python 1.0.422
PythonSnowConvert Core 2.0.152
Added
  • Added type inference
  • 5 New mappings supported
Improvements
  • Detailed report
  • Import Statement conversion
  • Transformation documentation
Fixed
  • EWIs related to a Project ID logging
  • 4 Pyspark elements conversion status

Release 1.0.280 - October 12, 2022

Python 1.0.417
PythonSnowConvert Core 2.0.135
Added
  • New transformations
  • Handling unsupported Pyspark elements used in imports
  • Improvements in logging message

Release 1.0.271 - October 05, 2022

Python 1.0.417
PythonSnowConvert Core 2.0.132
Added
  • Robustness to symbol identification
  • Improving in type resolution
Fixed
  • Settings button is not refreshing with license change
  • Documentation link in Python version reference

Release 1.0.247 - September 27, 2022

Python 1.0.410
PythonSnowConvert Core 2.0.126
Added
  • Robustness when parsing Jupypter Notebook files
  • Improvements in resolving symbols with Generics
  • New transformations
Fixed
  • Total Python files in the report

Release 1.0.220 - September 15, 2022

Python 1.0.399
PythonSnowConvert Core 2.0.112
Added
  • New support for imports
  • Alias name in inventories for the imports
Fixed
  • Wrong line number in the inventory for macOS files
  • Identified usages table percentages in the html report
  • Qualification tool showing zero PySpark references
  • Update contact information in the email template

Release 1.0.190 - September 06, 2022

Python 1.0.392
PythonSnowConvert Core 2.0.100
Added
  • 'SnowConvert Version' and 'Snowpark version' columns to SparkUsagesInventory
  • More functions from pyspark supported
  • Improvements to speed analysis
Fixed
  • Direct mapping updating

Release 1.0.148 - August 31st, 2022

Python 1.0.381
PythonSnowConvert Core 2.0.71
Added
  • 10 new mappings supported
  • 17 new workaround conversions detected
  • Support for identification of PySpark usages in Jupyter notebook files
  • Automated and Status columns added to SparkReferenceInventory.csv
  • Summary and detailed html report uploading to snowflake
Fixed
  • Summary and detailed report wordings fixes
  • Email template wording fixes

Release 1.0.107 - August 24th, 2022

Python 1.0.380
PythonSnowConvert Core 2.0.30
Added
  • 30 new mappings supported
  • Identification of pyspark.streaming and pyspark.rdd packages
  • Improvements in identifying imported symbols
  • Email template update
  • Adding "Version information" section to Summary Report
  • Adding "Resources" section to Detailed Report
  • Final screen UI changes
  • Sort SparkReferenceInventory report file
Fixed
  • Settings button removed
  • Detailed report logos update
  • Percentage values precision on summary and detailed assessment reports

Release 1.0.66 - August 17th, 2022

Python 1.0.377
PythonSnowConvert Core 1.0.61
Added
  • 136 new mappings supported
  • Supported status updated for all functions listed as "Corrected" in the shared spreadsheet
  • Information collected from the requirements.txt file
  • Improvements in identifying chained symbols
Fixed
  • Line number in SparkReferenceInventory report

Release 1.0.30 - August 9th, 2022

Python 1.0.373
PythonSnowConvert Core 1.0.29
Added
  • Collect all the import usages
  • Improvements identifying PySpark usages (import without module, import with star)
  • Identifying more DataFrame functions as supported
Fixed
Logging parsing errors

Release 0.1.172 - July 20th, 2022

Python 0.1.172
Added
  • Command line interface.
  • Python code Qualification tool feature.