Python

VanGohan PDF

Notion scraper to generate PDFs of VanGohan's printable recipes

avatar
Aki Ariga
Read more
4 Steps to Release a CLI in Python featured image

4 Steps to Release a CLI in Python

This is what I learned from creating a Python CLI (digdaglog2sql) in a day. In just 4 steps, you can release a CLI written in Python easily. Create a project by using poetry Poetry …

avatar
Aki Ariga
Read more
Create data lineage from Trino/Hive queries in digdag log with Python featured image

Create data lineage from Trino/Hive queries in digdag log with Python

What’s data lineage? Data lineage is something to describe “Where this data comes from and where it goes?” I learned this term in my previous job. They provided “Cloudera …

avatar
Aki Ariga
Read more

digdaglog2sql

Extract SQLs from digdag log to visualize SQL lineage

avatar
Aki Ariga
Read more

prelimsを使ってHugoの記事にレコメンドを追加する

HugoやJekyllの記事にレコメンドを足すためにprelimsを使った

avatar
Aki Ariga
Read more

Google Colaboratory上でVS Code(code-server)を動かす

VS Code from everywhere

avatar
Aki Ariga
Read more

pandas 1.0 のpd.NAのハマりどころ

pandas.NAに関連するmissing value周りのあれこれ

avatar
Aki Ariga
Read more

Pythonistaのためのdigdag py> operator開発ガイド

Table of Contents workflowをpushするまえにローカル環境で開発とテストをする方法 基本戦略:Pythonのタスクを合理的な粒度にまとめる 1. Treasure Dataの公式Dockerイメージを使う 2. Dockerイメージと同様のPythonの仮想環境を作る py> operatorを含んだworkflowをローカルで実 …

avatar
Aki Ariga
Read more

Facebook Prophetのplotをmodelオブジェクトなしでする

fbprophetの予測結果のグラフをmatplotlibだけでplotする

avatar
Aki Ariga
Read more

tabula-py

Extract you tables in PDF into pandas DataFrame

avatar
Aki Ariga
Read more