Writing Scala Code
Here you can find how to use Scala and Scala with Snowpark API.
Last updated
Here you can find how to use Scala and Scala with Snowpark API.
Last updated
Follow the steps below or check the tutorial: Deploy Code to Snowflake using the Snowpark API.
First, let's create a new project in the BlackDiamond Studio web portal by clicking the + button.
2. Select the Code from templates option. With this project type, you can use several code templates to facilitate your work. Templates are a set of source code files and pre-installed dependencies that help you start coding faster and easier.
3. Name your project.
4. Set up the project repository. You can create a new repository in BlackDiamond Studio powered by GitLab or connect your existing GitHub repository.
5. As an optional step, connect to your Snowflake account. This is required to deploy to Snowflake.
6. Select the Scala language and select the template of your choice. This will populate your repository with Scala code that you can use to deploy to Snowflake with the Snowpark API.
7. Click the Finish setup button.
8. Click the Open in IDE button on the project page.
In your project repository, you will find the Main.scala file that contains a basic example of how to create a Snowpark session, which then can be used to interact with the Snowflake account you should be connected to.
A Snowflake connection is required to use Snowpark with Scala. This connection can be set up when you create the project in the web portal, or it can be managed in the BlackDiamond Studio IDE with the SQL Tools extension.
The SQL Tools extension can be accessed by clicking on the cylinder icon on the Activity Bar (on the left side of the IDE).
Snowflake stored procedures and UDFs can be written in Scala and then exported to your Snowflake account.
Stored procedures and UDFs can be called or can be used during queries after being exported. They can be invoked from your SQL code or even using Snowpark.
If you want to create and export a Stored Procedure / UDF, follow these steps:
Make sure you have a build.sbt file.
Replace the placeholders in the UDF-Export-Snowflake-Scala.sql template file with the actual values that you want to use. If you are creating and exporting a UDF, you can ignore or remove section 3.1, since it is used for creating a Stored Procedure. Likewise, if you are exporting a Stored Procedure, you can ignore or remove section 3.2, since it is used for creating a UDF.
You can reorganize the template and change it in order to create multiple functions/procedures with the same script.
An example of how to write a "Hello World!" program on Scala is given at the beginning of the Main object, in the Main.scala file.
You can code just like you would normally with Scala.
You can remove the Snowpark code if you don't need it (this includes the UserDefinedFunctions.scala and the Procedures.scala files, and the references to the Snowpark library in the build.sbt file).
Metals' Import Build command fails or an sbt command fails.
BlackDiamond: Export Scala UDF fails.
Make sure that your project is building correctly.
If your project is not building correctly, the template for the creation of the UDF/Procedure will not be generated.
The creation of a UDF or Stored Procedure fails.
Make sure that your function/procedure follows the guidelines for the creation of Scala UDFs.
Make sure you have already imported the builds with Metals. You can click on the Metals logo (an "M") on the activity bar on the IDE left bar and then click on Import build.
Right-click on the build.sbt file and then click on Black Diamond: Export Scala UDF. This will create a template file called UDF-Export-Snowflake-Scala.sql, located in the target folder.
After filling the placeholders, you can run the SQL commands. Left-click on the UDF-Export-Snowflake-Scala.sql and then click on Black Diamond: Deploy. This will execute the SQL script and create the UDF/Procedure.
Check your project/build.properties. When working on the BlackDiamond Studio IDE, your project/build.properties should look like this: This is because sbt has a bug which prevents sbt commands from working on certain environments, where Unix Domain Sockets cannot be created. A fix for this bug has been submitted, but a version with said fix has not been released yet. Currently, the best option is to use version 1.7.0-M3 (a custom build) that is installed in the BlackDiamond Studio IDE.
