Boa tarde, diferente da aula, ao criar o fluxo e colocar o segundo bloco de Change schema, o mesmo não está relacionando os novos campos criados.
Se prosseguirmos e colocarmos o próximo bloco do AWS Glue Data Catalog, e voltar a visualizar o bloco anterior do ChangeSchema, os campos passam a aparecer. Entretanto, ao rodar o Job, o seguinte erro surge:
Error Category: RESOURCE_NOT_FOUND_ERROR; Failed Line Number: 51; Spark Error Class: _LEGACY_ERROR_TEMP_1155; AnalysisException: Partition column open_year not found in schema struct<case_enquiry_id:bigint,open_dt:timestamp,closed_dt:timestamp,case_status:string,case_title:string,subject:string,reason:string,type:string,queue:string,department:string,location:string,fire_district:string,pwd_district:string,city_council_district:string,police_district:string,neighborhood:string,neighborhood_services_district:string,ward:string,precinct:string,location_street_name:string,location_zipcode:string,latitude:string,longitude:string,source:string>.
Segui exatamente o passo a passo da aula,
Att
