Skip to content

Aus800

IT technologies, especially open source tools

Menu

  • Services
  • About

python

Bigquery parallel loading

There are many ways to load data into BQ but using Python gives us the most control. Below I’m going to demonstrate loading files into BQ in parallel. My test scenario is: 191 csv files, sizing from 10Mb – 1Gb

wangts February 20, 2020February 20, 2020 Programming No Comments Read more

Running a Django application on IIS

Django is a popular Python web framework, below is how to use IIS(Internet Information Service) to host Django application on Windows. Install Python on Windows https://python.org Create a python virtual environment so your future development won’t rely on existing Python executables

wangts December 29, 2017December 29, 2017 Programming No Comments Read more

Deploy pgAdmin as a web service under venv environment

pgAdmin can be deployed as a web server therefore user doesn’t need to install any client to access DB. This also provides a securer way of accessing your database:  suppose your web server is on the same network as your

wangts November 1, 2017November 23, 2017 Database No Comments Read more

Recent Posts

  • Postgresql identity column “no owned sequence”
  • PostgreSQL logical replication
  • Use Cloud function to start and stop Cloud sql
  • Bigquery parallel loading
  • Dates in SAP

Recent Comments

  • wangts on Use Cloud function to start and stop Cloud sql
  • wangts on Use Cloud function to start and stop Cloud sql
  • Vemuri Venkateswara Rao on Use Cloud function to start and stop Cloud sql
  • Vemuri Venkateswara Rao on Use Cloud function to start and stop Cloud sql
  • wangts on Use Cloud function to start and stop Cloud sql

Archives

  • July 2020
  • May 2020
  • March 2020
  • February 2020
  • December 2019
  • November 2019
  • June 2019
  • February 2019
  • December 2018
  • June 2018
  • May 2018
  • December 2017
  • November 2017
  • October 2017
  • June 2017
  • May 2017
  • March 2017
  • July 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • October 2015
  • September 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • September 2014
  • August 2014
  • May 2014
  • July 2013
  • April 2013
  • March 2013

Categories

  • Database
  • others
  • Programming
  • Reporting
  • Reviews
  • SAP
  • Telco billing
  • Uncategorized
  • virtualisation
Copyright © 2021 Aus800. Powered by WordPress. Theme: Spacious by ThemeGrill.