Python, Streamlit

Fun Refactoring Python Code

I recently came across a coding challenge. Well, let’s say we needed to handle several combinations of filtering data in a #Pandas Dataframe leveraging the #Streamlit selectbox widget. Not a difficult lift per se. The fun was where it started and where it ended up.  Let’s get started. Scenario I have 4 columns of data …

Snowflake, Snowpark

Snowflake Snowpark JAVA UDF with JAR – Streamlit bonus

Recently, I was asked the following question: “How can I manage my Snowflake JAVA UDFs without needing to re-create the UDF every time I make a change to the logic? And by the way can you show me how to invoke that from Streamlit?” The first thing that popped in my head was, “Streamlit is a …

Snowflake

Data Warehouse Migration with Snowflake VSC and Flyway

Wow! It has been a year since my last blog post. This post was originally going to cover getting #Flyway set up with Snowflake. Then a couple of days ago, my friend Kent Graziano tweeted a link on getting Visual Studio Code (VSC) connected to Snowflake. Considering I had just come off a lengthy project …

Snowflake

Let DBeaver Build Your ERD from a Snowflake Data Warehouse

I was recently responding to a question about DBeaver and the ability to automatically generate an ERD. The following post will walk you through the process.   ;TLDR Looking for an easy way to create one of these?   Let’s create 3 simple tables.  A parent table with a primary key constraint and two additional …

Python, Snowflake

Python Abort trap: 6 fix after Catalina update

A couple of days ago, I update my MacOS to Catalina and immediately after that, all the Snowflake scripts I wrote in #Python started returning an Abort trap: 6 error. My initial thought was something must be a compatibility issue with either the python connector or new default terminal shell zsh. Fortunately I was wrong, …

Snowflake

Snowflake Migration using StreamSets

#OnTapToday, using @StreamSets to migrate data from your source database to Snowflake. In this post, I will walk through the process of configuring StreamSets to migrate data from my on prem DB to Snowflake. WHY You need to get some data from a source database to the Snowflake data warehouse. There were a few options …

Snowflake

Connect to Snowflake Data Warehouse with GO

In this installment, I am going to walk through the process of connecting GO to the Snowflake Data Warehouse Service (DWaaS). This tutorial requires that you have a Snowflake account. You can sign up here for a 30 day/$400.00 trial. Download and Install the ODBC Driver Once you have your account set up in Snowflake, …

Kscope, Oracle

ODTUG Kscope18 in the bag

One month ago, ODTUG Kscope18 was getting started, and one month ago was the first time in two years that I was not the Conference Chair, and today, I can say that my friend Opal did a damn good job at taking the ODTUG Kscope conference to the next level. Thank you Opal for your …

Nodejs

Connect to Snowflake with Node.js Driver

This will be the first entry into my Snowflake toolbox. Today I am going to set my MacBook Pro up to connect to a Snowflake data warehouse via the Snowflake Node.js driver. This could come in handy when needing to move data between systems where direct connections are not available and you need an intermediary. …

Related Posts Plugin for WordPress, Blogger...