Uploading large files to Google Storage using a VM Instance
If you have a really large file - upwards of 100 MB - that you want to import to your Google Cloud storage, you can bypass your personal computer, and instead use Google Cloud VM Instance. This is quicker and more efficient. This video shows you how.
See my book for more details:
https://www.amazon.com/Data-Analytics...
Install the wget command in Linux:
sudo apt-get install wget
Download the file to your VM Instance:
wget https://s3.amazonaws.com/nyc-tlc/trip...
Create a bucket on Google Storage:
gsutil mb gs://your-bucket-name-here/
Upload csv file to your bucket in Google Storage:
gsutil cp yellow_tripdata_2019-01.csv gs://your-bucket-name-here/
Delete csv file from your VM Instance:
rm yellow_tripdata_2019-01.csv