Please help me with C2_W3_Assignment project I have a great expectation error that stops me to continue with the task

Course Q&A Data Engineering Source Systems, Data Ingestion, and Pipelines
1

This is the console sesion: (thanks a lot)

coder@d63af89b771f:~/project$ source scripts/setup.sh
Environment setup completed successfully. Database connection variables and CLI paths have been configured.
Connection string MYSQL_CONNECTION_STRING: mysql+pymysql://admin:adminpwrd@de-c2w3a1-rds.cpcm4qsi2zjo.us-east-1.rds.amazonaws.com:3306/taxi_trips
coder@d63af89b771f:~/project$ great_expectations init

/ | _ ___ __ | | | | ___ __ ___ | | __ | |() _ _ ___
| ( | '/ -) | _| | _|\ \ / '_ \/ -_) _| _/ _ | | / _ \ ’ (-<
___|| __,|_| |/_\ ./__|__,|_|___/||/__/
||
~ Always know what to expect from your data ~

Traceback (most recent call last):
File “/home/coder/miniconda/bin/great_expectations”, line 8, in
sys.exit(main())
^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/great_expectations/cli/cli.py”, line 146, in main
cli()
File “/home/coder/miniconda/lib/python3.12/site-packages/click/core.py”, line 1157, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/click/core.py”, line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/click/core.py”, line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/click/core.py”, line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/click/core.py”, line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/click/decorators.py”, line 33, in new_func
return f(get_current_context(), *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/great_expectations/cli/init.py”, line 69, in init
project_file_structure_exists = FileDataContext.is_project_scaffolded(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/great_expectations/data_context/data_context/serializable_data_context.py”, line 507, in is_project_scaffolded
and cls.config_variables_yml_exist(ge_dir)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/great_expectations/data_context/data_context/serializable_data_context.py”, line 258, in config_variables_yml_exist
config = yaml.load(f)
^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/main.py”, line 426, in load
return constructor.get_single_data()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 114, in get_single_data
return self.construct_document(node)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 123, in construct_document
for _dummy in generator:
^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 1470, in construct_yaml_map
self.construct_mapping(node, data, deep=True)
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 1359, in construct_mapping
value = self.construct_object(value_node, deep=deep)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 145, in construct_object
data = self.construct_non_recursive_object(node)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 186, in construct_non_recursive_object
for _dummy in generator:
^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 1470, in construct_yaml_map
self.construct_mapping(node, data, deep=True)
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 1360, in construct_mapping
if self.check_mapping_key(node, key_node, maptyp, key, value):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/coder/miniconda/lib/python3.12/site-packages/ruamel/yaml/constructor.py”, line 276, in check_mapping_key
raise DuplicateKeyError(*args)
ruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping
in “/home/coder/project/gx/great_expectations.yml”, line 50, column 3
found duplicate key “checkpoint_store” with value “{‘class_name’: ‘CheckpointStore’, ‘store_backend’: {‘class_name’: ‘TupleS3StoreBackend’, ‘suppress_store_backend_id’: False, ‘bucket’: ‘de-c2w3a1-549042641030-us-east-1-gx-artifacts’, ‘prefix’: ‘checkpoints/’}}” (original value: “None”)
in “/home/coder/project/gx/great_expectations.yml”, line 70, column 3

To suppress this check see:
http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys

2

Hello @albertohtesta,

It seems I could reproduce your issue after editing great_expectations.yml file. I added the new checkpoint_store instead of replacing the old one in the great_expectations.yml file. Follow the instructions to fix it and use the correct indentation.
If you want to start over delete great_expectations.yml and config_variables.yml files and run great_expectations init again. Thank you

  checkpoint_store: <----REPLACE the old block with this one
    class_name: CheckpointStore
    store_backend:
      class_name: TupleS3StoreBackend
      suppress_store_backend_id: false
      bucket: de-c2w3a1-[ACCOUNT_ID]-us-east-1-gx-artifacts
      prefix: checkpoints/

I reproduced the error with 2 checkpoint stores in the yml file:

image
image1554×714 55.8 KB