Não sei mais o que fazer para esse código funcionar. Já pesquisei na internet e revi a aula várias vezes.
Tem um colega que postou a mesma pergunta no forum mas segue sem resposta há um mês...
[2022-05-09 19:57:55,397] {taskinstance.py:1187} INFO - Marking task as FAILED. dag_id=twitter_dag, task_id=transform_twitter_aluraonline, execution_date=20220427T000000, start_date=20220509T225752, end_date=20220509T225755
Traceback (most recent call last):
File "/home/daleffi/datapipeline/.env/bin/airflow", line 37, in <module>
args.func(args)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/cli.py", line 233, in wrapper
func(args)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/cli.py", line 81, in wrapper
return f(*args, **kwargs)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/bin/cli.py", line 814, in test
ti.run(ignore_task_deps=True, ignore_ti_state=True, test_mode=True)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/db.py", line 74, in wrapper
return func(*args, **kwargs)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1102, in run
self._run_raw_task(
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/db.py", line 70, in wrapper
return func(*args, **kwargs)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 984, in _run_raw_task
result = task_copy.execute(context=context)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/contrib/operators/spark_submit_operator.py", line 187, in execute
self._hook.submit(self._application)
File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/contrib/hooks/spark_submit_hook.py", line 403, in submit
raise AirflowException(
airflow.exceptions.AirflowException: Cannot execute: /home/daleffi/datapipeline/spark-3.2.1-bin-hadoop2.7/bin/spark-submit --master local --name twitter_transformation /home/daleffi/datapipeline/spark/transformation.py --src /home/daleffi/datapipeline/datalake/bronze/twitter_aluraonline/extract_date=2022-04-27 --dest /home/daleffi/datapipeline/datalake/silver/twitter_aluraonline --process_date 2022-04-27. Error code is: 2.