Using bq load Command to Load logicalType Partitioned Data into a BigQuery Table

Following is the syntax and bq load command that you need to issue if you want to load data in avro file into a partitioned BigQuery table based on avro field defined as a logicalType.

Given the following schema

{
  "type" : "record",
  "name" : "logicalType",
  "namespace" : "com.ryanchapin.tests",
  "fields" : [ {
    "name" : "id",
    "type" : [ "null", "string" ],
    "default" : null
  }, {
    "name" : "value",
    "type" : [ "null", "long" ],
    "default" : null
  }, 
Continue reading “Using bq load Command to Load logicalType Partitioned Data into a BigQuery Table”

Sheet Pan Mushroom and Gnocchi

Ingredients

  • 1 pound mixed wild mushrooms
  • 2 medium shallots
  • 1 pound fresh, shelf-stable, or frozen potato gnocchi
  • 3 tablespoons olive oil
  • 1/2 teaspoon kosher salt
  • 1/4 teaspoon freshly ground black pepper
  • Fresh thyme leaves, for garnish

Instructions

  1. Preheat oven to 400F
  2. Slice mushrooms, chop shallots
  3. Place mushroom, shallots, and gnocchi in a mixing bowl and drizzle with olive oil. Add seasoning and toss to coat oil and seasonings.
  4. Turn out onto baking sheet in an even layer
  5. Roast for about
Continue reading “Sheet Pan Mushroom and Gnocchi”

Flush Commands to BASH History Immediately

I cannot take credit for figuring this one out. Original post is here.

TLDR; is to add the following to your ~/.bashrc

export PROMPT_COMMAND='history -a'

Following are the history configs that I use

######################################################################
shopt -s histappend
HISTSIZE=-1
HISTFILESIZE=-1
HISTCONTROL=ignoreboth
HISTTIMEFORMAT="[%F %T] "
export PROMPT_COMMAND='history -a'
######################################################################
Continue reading “Flush Commands to BASH History Immediately”

Setting Per File Type Tab Configurations in VSCode

If you would like to have different tab configurations (tabs or spaces) along with the number of tab chars for different file types you can update your user settings.

The first thing you need to do is figure out what the file type code thinks the file that you want to change is. Open the file in vscode and then look at the bottom right of your window. In my case, I’m looking at an avro schema (.avsc) file:

In → Continue reading “Setting Per File Type Tab Configurations in VSCode”

VSCode Keyboard Shortcut to Toggle Visibility of the Explorer Side Panel

I usually have at least two panes in my IDE so that I can see two files, or different parts of the same file, at the same time. VSCode pegs the debug variables in the Explorer side bar so I also end up having to make that panel large at times to see the variables while debugging.

Following are the keybindings that you can add to enable you to toggle the visibility of the left-hand side panel.

Add the following → Continue reading “VSCode Keyboard Shortcut to Toggle Visibility of the Explorer Side Panel”

Code Coverage for Golang Integration Tests with Build Tags

I’ve been writing a lot of Golang code lately. For the most part, I always write unit and integration tests for whatever program that I am building. I’ve been using VSCode as my IDE and really like it. The one thing that I was having trouble with was getting the code coverage to show in the IDE for my integration tests.

I have a different build tag in my unit test code and my integration test code so that I → Continue reading “Code Coverage for Golang Integration Tests with Build Tags”

Running Multiple VSCode Windows from the Same Workspace

In order to have two separate VSCode windows open that point to the same workspace, press CTRL+Shift+P and then search for Duplicate As Workspace in New Window. This will open a new window that is associated with the current workspace.

The thing to keep in mind is that it just DUPLICATED the existing workspace in a new window. Notice that at the top of the EXPLORER it will say UNTITLED (WORKSPACE). You can now work with two windows → Continue reading “Running Multiple VSCode Windows from the Same Workspace”

Apple Pie

A recipe for a double-crust pie. See this post for the pie crust recipe.

  • About 7 or 8 cups of chopped apples (I like to use sweet ones and then I can use less sugar)
  • 1 cup sugar (or 1/2 if you have sweet apples)
  • 1/4 cup flour
  • 1 tsp cinnamon
  • 1/4 tsp nutmeg
  • 1/4 tsp allspice
  • 1/4 tsp ground cloves
  • 1/4 tsp salt
  • 1 tablespoon cider vinegar, or regular white vinegar
  • 1/4 cup citrus juice (apple, orange, etc).
Continue reading “Apple Pie”

Sweet Potato Pie

The egg whites folded into the mix make it a more fluffy and less dense pie. A wonderful treat! A recipe for a single-crust pie. See this post for the pie crust recipe.

  • 4 cups mashed sweet potatoes
  • 1/2 cup butter
  • 1/2 or 1 cup sugar
  • 1/2 cup milk
  • 3 eggs
  • 1/2 tsp nutmeg, cinnamon
  • 1 tsp vanilla
  1. Take the butter out of the fridge to let it come to room temp
  2. You can either peel and boil the
Continue reading “Sweet Potato Pie”

Configuring a Bitbucket Pipeline for a Golang Project with Privately Hosted Dependencies

Go’s dependency management is based solely on git repos. Most of the libraries have publicly available repos from which you can clone the source and then build your project.

In my case, most of the Go that I’m writing ends up in private repos in Bitbucket. Currently, I’ve got a program that I am writing that is dependent on a library that I have written that is hosted as a private repo in Bitbucket. I wanted to setup a Bitbucket → Continue reading “Configuring a Bitbucket Pipeline for a Golang Project with Privately Hosted Dependencies”