This article show how to develop a digdag Python workflow task efficiently.
Table of Contents workflowをpushするまえにローカル環境で開発とテストをする方法 基本戦略:Pythonのタスクを合理的な粒度にまとめる 1. Treasure Da
Photo by Hitesh Choudhary on Unsplash
Recently, I changed my CI from Travis to GitHub Actions. GitHub Actions is handy and useful for testing, publishing Python packages.
Testing Python code on GitHub Actions Migration from Travis is super easy, just writing a simple workflow like:
https://github.com/chezou/tabula-py/blob/master/.github/workflows/pythontest.yml
The benefits of GitHub Actions for Python are:
We can use build matrix (e.g., OS and Python versions) like Travis Launch time of GitHub is faster than Travis Easy for additional dependency installation by using uses syntax, which uses another workflow For example, installing JDK can be written as:
Yesterday, PyPI was renewed to the next-generation site. It is modern and stylish one.
@aodag told me that PEP 566, which was accepted Feb. 2018, allows us for a document on PyPI to use not only reStructuredText but also other formats such as Markdown.
So I enabled my Markdown document on brand-new PyPI.
Upgrade Python packages (if necessary) We can use Markdown with setuptools as of v.38.6.0. Let’s upgrade you python packages if needed.
長い間、Pythonでパッケージを作った場合、構造化されたドキュメントを使う場合は、 reStructuredText (reST)でドキュメントを書く必要がありました。 とこ
Python is a very famous programming language for machine learning. In this article, I will introduce basic Python environment. Glossary I will introduce basic terms about Python package management. pip: A tool for package installation. It retrieves Python packages from PyPI. pip is gem command of Ruby. virtualenv: Package isolation tool for Python. It has similar function with bundler of Ruby, but it also has the function to change Python
先日、 kawasaki.rb の懇親会で「AWS LambdaのためにPythonはじめたいんです」とか「機械学習系の本を読み始めたので、そこに書いてあったcond
https://www.irasutoya.com/2017/05/blog-post_22.html
This article is a translation of this article, originally written by aodag in Japanese. I translated it with his permission. This article is aimed to know simple ways to prepare internal Python package host like a local gem server on Ruby.
Methods Include your packages in your git repository Publish a directory including your packages via HTTP server Build a local PyPI-equivalent server It is a high-cost way to create a local PyPI-equivalent server (translator note: like devpi), and I don’t think there is no need to do so, I will describe first two options.