Situation

When Use gsutil Download Object Get Error

[root@server]# gsutil -m cp -r gs://<bucket>/ .
Traceback (most recent call last):
  File "/usr/lib64/google-cloud-sdk/bin/bootstrapping/gsutil.py", line 16, in <module>
    import bootstrapping
  File "/usr/lib64/google-cloud-sdk/bin/bootstrapping/bootstrapping.py", line 44, in <module>
    from googlecloudsdk.core.credentials import store as c_store
  File "/usr/lib64/google-cloud-sdk/lib/googlecloudsdk/core/credentials/store.py", line 44, in <module>
    from googlecloudsdk.core.credentials import creds as c_creds
  File "/usr/lib64/google-cloud-sdk/lib/googlecloudsdk/core/credentials/creds.py", line 46, in <module>
    import sqlite3
  File "/usr/local/python3/lib/python3.6/sqlite3/__init__.py", line 23, in <module>
    from sqlite3.dbapi2 import *
  File "/usr/local/python3/lib/python3.6/sqlite3/dbapi2.py", line 27, in <module>
    from _sqlite3 import *
ModuleNotFoundError: No module named '_sqlite3'

How To Fix

  • Downlaod sqlite3 so

curl -O https://www.sqlite.org/2018/sqlite-autoconf-3240000.tar.gz

  • Extract And Compile sqlite3

tar -zxvf sqlite-autoconf-3240000.tar.gz
cd sqlite-autoconf-3240000
./configure --prefix=/usr/local/sqlite
make && make install 

cd Python-3.6.8
./configure --enable-loadable-sqlite-extensions
make && make install
ln -s /usr/local/bin/python3 /usr/bin/python3
ln -s /usr/local/bin/pip3 /usr/bin/pip3

  • After Re-Compile, Need Re-Install Package

pip3 install crcmod

  • Verify

[root@server]# gsutil -m cp -r gs://<bucket>/<object>/ .
Copying gs://<bucket>/<object>...
[root@server]# 3.5 GiB]   4% Done  34.7 MiB/s ETA 00:06:21