BigQuery Migration using GCP native methods

set PARQUET_FILE_SIZE=512m
set PARQUET_ANNOTATE_STRINGS_UTF8=true
bq load \
--source_format=Parquet \
datasetName.tableName \
"gs://BucketName/folder/FileName.parquet"
" MERGE " + '`' + Dataset.TargetTable + '`' + " T USING " + '`' + Dataset.SourceTable + '`' + " S ON  T.id = S.id WHEN MATCHED THEN UPDATE SET targetTable.id=sourceTable.id ,  targetTable.column1= sourceTable.column1, targetTable.column2=sourceTable.column2, WHEN NOT MATCHED THEN INSERT VALUES ( id ,   column1 ,   column2 );"

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store