Updates on each released version of Mobilize.Net SnowConvert for Spark
Release 1.0.3 - March 18th, 2022
Scala 0.1.358
Added
Scala Parser
Support underscore followed by newline when parsing expressions
Improve parsing errors handling
Symbols
Improve support of Unresolved Symbols
Improve creation of Generic Symbols to reuse existing ones
Support Loading and Resolution of Lambda Expressions
Mappings:
Support custom mappings for functions and types via .map files
Added custom map directory parameter
Fixed
Fill missing columns at notification .pam file.
Generate metrics data files (.pam) to specified reports folder
Release 1.0.2 - March 4th, 2022
Scala 0.1.351
Added
Updated logos and text in UI and Documentation
Symbols
Support Generic Identifiers on Type Parameters for Generic Symbol
Exclusion of not required dependencies
ScalaParser:
Backticks idents
ArgAssign expressions
Fixed
ScalaParser:
ExprLambda with ColonType next to ident
Try expression when try is not referring a keyword
Empty lambda expr with args
Underscore ("_") in TypeArgs
Files with all commented out source
New lines at SimpleExpr, SingleExpr, TailExpr nodes
ConversionTool:
Fix Crash of conversion due to javap parsing errors (related with jar dependencies)
Release 1.0.1 - February 14th, 2022
Scala 0.1.333
Features
Command line interface.
Scala code assessment feature.
Consume multiple files or single files with multiple objects.
Conversion of basic Scala programs as defined by functions and syntax to be mutually agreed during the first 3 development sprints.
Comments in Scala code are re-inserted inline.
Insert comments in-line with any errors/warning/reviews.
Basic reporting including
Number of spark elements processed
Summary of elements transformed, files and locations of
Summary of errors/warnings/reviews encountered.
Summary of unsupported Spark APIs
Demonstrated inclusion of the following defined scenarios:
API mappings
Recreate project as SnowPark projects
Setup Proper project structure
Update to SnowPark supported Scala version
Helper Creation to reduce impedance mismatch
Define some pattern rewrite
Document guidelines for non-automatable concepts (e.g.: file usage patterns, data source configuration, or spark libraries without a direct equivalent, like Kafka stream reading)
Greater than 90% successful conversion rate for initial two customer code bases (basis code for the above scenarios) to be provided to Mobilize by Snowflake on the Effective Date.
Measured based upon number of compilable objects in Snowflake
Objects with unsupported/untranslatable functions not counted
Conversion rate for code will be based upon a complete code base containing all dependent objects.
Snowflake will provide access to all available private preview features for Mobilize development benefit