Ainda não tem acesso? Estude com a gente! Matricule-se
Ainda não tem acesso? Estude com a gente! Matricule-se
0
respostas

raise AirflowException( airflow.exceptions.AirflowException: Cannot execute: Error code is: 2.

Não sei mais o que fazer para esse código funcionar. Já pesquisei na internet e revi a aula várias vezes.

Tem um colega que postou a mesma pergunta no forum mas segue sem resposta há um mês...

[2022-05-09 19:57:55,397] {taskinstance.py:1187} INFO - Marking task as FAILED. dag_id=twitter_dag, task_id=transform_twitter_aluraonline, execution_date=20220427T000000, start_date=20220509T225752, end_date=20220509T225755
Traceback (most recent call last):
  File "/home/daleffi/datapipeline/.env/bin/airflow", line 37, in <module>
    args.func(args)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/cli.py", line 233, in wrapper
    func(args)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/cli.py", line 81, in wrapper
    return f(*args, **kwargs)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/bin/cli.py", line 814, in test
    ti.run(ignore_task_deps=True, ignore_ti_state=True, test_mode=True)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/db.py", line 74, in wrapper
    return func(*args, **kwargs)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1102, in run
    self._run_raw_task(
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/utils/db.py", line 70, in wrapper
    return func(*args, **kwargs)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 984, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/contrib/operators/spark_submit_operator.py", line 187, in execute
    self._hook.submit(self._application)
  File "/home/daleffi/datapipeline/.env/lib/python3.8/site-packages/airflow/contrib/hooks/spark_submit_hook.py", line 403, in submit
    raise AirflowException(
airflow.exceptions.AirflowException: Cannot execute: /home/daleffi/datapipeline/spark-3.2.1-bin-hadoop2.7/bin/spark-submit --master local --name twitter_transformation /home/daleffi/datapipeline/spark/transformation.py --src /home/daleffi/datapipeline/datalake/bronze/twitter_aluraonline/extract_date=2022-04-27 --dest /home/daleffi/datapipeline/datalake/silver/twitter_aluraonline --process_date 2022-04-27. Error code is: 2.

Quer mergulhar em tecnologia e aprendizagem?

Receba a newsletter que o nosso CEO escreve pessoalmente, com insights do mercado de trabalho, ciência e desenvolvimento de software