Skip to content

Learning

Reference

  1. Basic

Buit In: [1-2 day]

Operator: >, <= , =, ==, OR, AND, XOR, ...

Statement Flow: Loop, While, If-else

User-define-function

Data-Type: String, Datetime, Int, Dict, Array.

Operation System: os (Path, OS, stdin, stdot ,...)

Crypto Servies [Optional]

===== [Libraries]

[Community]

Extract, Transform, Load: Pandas, Intake, PyJanitor Exploratory analysis: Jupyter, Seaborn, Matplotlib, Altair Model and evaluate: scikit-learn, statsmodels, PyMC3, spaCy Report in a dashboard: Dash, Panel, Voila

[1] Documents? [API | Reference | Structure]

[2] What can it does?

Select > Pick > Focus

Practice [MVP > Tutorial > Tip & Tricks]

? [Shell [CMD/Bash/zsh/fish].. CLI ... Makefile ... [Service Enhancemance] Tests/Coverage/ Packages/...

OOP / High Order Funcrions / Applications/ Set upp... DBT NIFI, CLOUD FUNCTION, GCLOUD, GCS, .. AWS

There are various:

We focus:

[1] Python

[1] Learning Base Libraries

Go through tutorials HOW TO

[2]

[3] Practive Github

  • Process: Pull Master > Checkout Branch > Track Changes

Staging Areas > Push > PR >

  • CICD Process

[4] Learn dbt, Airflow

[2] Jupiters: https://nbviewer.jupyter.org/

[4] Books:

Learn basic

https://docs.python.org/3/library/functions.html

[1] Điều chỉnh về mặt tài liệu:

  • Viết hoàn thiện thông tin và xác định người đọc.

  • Sử dụng một công cụ review ngữ pháp, e.g Grammaly

  • Sử dụng snapshot hình ảnh vào trong bài viết

  • Tách biệt giữa phương pháp và thông tin.

[3] Tìm hiểu lại về mặt technique:

Database Client: pgAdmin4

Database backend: Postgres

[4] Về phần kiểm tra dữ liệu:

  • Check NULLable of columns

[5] Tìm hiểu thêm về:

  • .gitignore các file tự sinh bởi hệ thống khi run Python

pycache in gitignore - Code Examples & Solutions

  • Coding Style

PEP 8 – Style Guide for Python Code | peps.python.org

  • Python Basic:

Python Tutorial

  • Python Pandas Learn:

  • Pandas — Effective Python for Data Scientists

Task:

Get data of ticker in HNX

Notes:

[1] Separate current step to get_data into the smaller functions that focus on one objective

[2] Try to implement:

a) Multi Thread design Python - Multithreading

b) Ratelimit ratelimit

[3] Try to connect to Postgres at raw schema

[4] Read through ORM, then read through ORM library SQLAlchemy

[5] Connect to Email

Required: Connection String for connection to raw schema.

Add label

Task:

Learn basic concept of OOP: [Python] OOP Learning Path

Chapter 1-2-7 in Intro to Object Oriented Programming | OOP | python-course.eu

Build class SettlementClosingDate inherit date

Change name to singular: VietnamHolidayEvents ~> VietnamHolidayEvent

Convert VSD_SETTTLEMENTS_CLOSING_DATES to list, change name to singular form SETTTLEMENT_CLOSING_DATE

Type hint (if exist)

Add data

Open bquxjob_3866df8f_18924080513.csv bquxjob_3866df8f_18924080513.csv bquxjob_3866df8f_18924080513.csv 05 Jul 2023, 10:11 AM Establish pytest in spectrum: pytest: helps you write better programs — pytest documentation

Write pytest.ini

make console pytest tests/ Test case for check_overlap_time

Generate report pytest-html to JSON

Fix non-trading-date

Schedule Type

CRON [basement] crontab server

Cloud Schedule: Quickstart: Schedule and run a cron job | Cloud Scheduler Documentation | Google Cloud

CICD: GitHub Action, CloudBuild (Trigger)

HTTP Endpoint: Slack …

Read:

[1] gcloud CLI overview | Google Cloud CLI Documentation

Read: chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://groups.seas.harvard.edu/courses/cs152/2011sp/lec23_6up.pdf