Skip to content

Aus800

IT technologies, especially open source tools

Menu

  • Services
  • About

parallel loading

Bigquery parallel loading

There are many ways to load data into BQ but using Python gives us the most control. Below I’m going to demonstrate loading files into BQ in parallel. My test scenario is: 191 csv files, sizing from 10Mb – 1Gb

wangts February 20, 2020February 20, 2020 Programming No Comments Read more

Recent Posts

  • Postgresql identity column “no owned sequence”
  • PostgreSQL logical replication
  • Use Cloud function to start and stop Cloud sql
  • Bigquery parallel loading
  • Dates in SAP

Recent Comments

  • wangts on Use Cloud function to start and stop Cloud sql
  • wangts on Use Cloud function to start and stop Cloud sql
  • Vemuri Venkateswara Rao on Use Cloud function to start and stop Cloud sql
  • Vemuri Venkateswara Rao on Use Cloud function to start and stop Cloud sql
  • wangts on Use Cloud function to start and stop Cloud sql

Archives

  • July 2020
  • May 2020
  • March 2020
  • February 2020
  • December 2019
  • November 2019
  • June 2019
  • February 2019
  • December 2018
  • June 2018
  • May 2018
  • December 2017
  • November 2017
  • October 2017
  • June 2017
  • May 2017
  • March 2017
  • July 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • October 2015
  • September 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • September 2014
  • August 2014
  • May 2014
  • July 2013
  • April 2013
  • March 2013

Categories

  • Database
  • others
  • Programming
  • Reporting
  • Reviews
  • SAP
  • Telco billing
  • Uncategorized
  • virtualisation
Copyright © 2021 Aus800. Powered by WordPress. Theme: Spacious by ThemeGrill.