Infosys
Posted 2w ago

Data Engineer AWS | Python, SQL, Redshift & Data Lake

Infosys
Sao Paulo, Sao Paulo, Brazil
OnsiteFull Time
Responsibilities
  • designing pipelines
  • developing pipelines
  • optimizing performance
Requirements
  • Solid data engineering experience on AWS with S3
  • Redshift
  • Python, SQL
  • ETL/ELT pipelines
  • API integration
  • Medallion architecture, and advanced English for global collaboration
Technical tools mentioned
Amazon S3RedshiftAWS LambdaStep FunctionsPythonSQLREST/JSONAWS GlueAthenaEMRKafkaKinesisTerraformCloudFormation

Job description

Job Description

Infosys Brasil está em busca de profissionais com o perfil de Data Engineer AWS | Python, SQL, Redshift & Data Lake para juntar-se ao nosso time.


Qualificações requeridas:
  • Experiência sólida em Engenharia de Dados utilizando AWS.
  • Conhecimento prático em Amazon S3, Redshift, AWS Lambda e Step Functions.
  • Experiência no desenvolvimento de pipelines ETL/ELT escaláveis.
  • Domínio de Python para desenvolvimento e automação de processos de dados.
  • Conhecimento avançado em SQL e conceitos de Data Warehouse.
  • Experiência com integração de APIs (REST/JSON).
  • Conhecimento em modelagem de dados e desenho de esquemas.
  • Experiência com arquitetura de dados utilizando o modelo Medallion (Bronze, Silver e Gold).
  • Inglês avançado para interação em ambiente global.


Diferenciais (conhecimentos desejáveis):
  • Experiência com AWS Glue, Athena e EMR.
  • Conhecimento em ferramentas de qualidade e monitoramento de dados.
  • Vivência com arquiteturas orientadas a eventos.
  • Experiência com pipelines de streaming utilizando Kafka ou Kinesis.
  • Conhecimento de CI/CD para workflows de dados.
  • Experiência com infraestrutura como código (Terraform ou CloudFormation).
  • Vivência em projetos corporativos de Analytics e Data Lake.


Principais atividades e responsabilidades:
  • Projetar, desenvolver e otimizar pipelines de dados em ambiente AWS.
  • Implementar processos de ingestão de dados provenientes de APIs e outras fontes externas.
  • Transformar e disponibilizar dados para consumo analítico utilizando Amazon Redshift.
  • Garantir qualidade, integridade e governança dos dados ao longo dos processos.
  • Desenvolver mecanismos de monitoramento, alertas e tratamento de erros.
  • Otimizar armazenamento e performance de consultas em Data Lake e Data Warehouse.
  • Trabalhar em parceria com analistas, cientistas de dados e stakeholders de negócio.
  • Documentar processos, pipelines, modelos de dados e fluxos de integração.
  • Atuar de forma autônoma junto ao cliente, conduzindo entregas, reuniões e alinhamentos técnicos.


Informações adicionais:
Tipo de trabalho : CLT (Trabalho em Tempo Integral), Horário flexível.
Pacote de benefícios : Vale-transporte, vale-refeição, auxílio-creche, seguro de vida, auxílio-funeral, seguro médico e odontológico.
Carreira : Trabalho global em clientes e/ou projetos nacionais e internacionais, com possibilidade de transferência internacional de carreira.

State / Region / Province

Sao Paulo

Country

Brazil

Interest Group

Infy Brazil

Job Role

Technology Lead - Brazil

Company

INFOSYS TECNOLOGIA DO BR

Work Location

Sao Paulo

Domain

Others (Please specify in the Requisition notes)

Skillset

Others (Please specify in the Requisition notes)

External Job Title

Data Engineer AWS | Python, SQL, Redshift & Data Lake

EEO/About Us

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

About Infosys

Provides IT consulting, software development, and business outsourcing services.

Similar jobs

Data Engineer roles near Sao Paulo, Sao Paulo
1d
Save
Mark Applied
Hide
Engenheiro(a) de Dados SR
São Paulo, São Paulo, Brazil
HybridFull Time
Leroy Merlin
Leroy Merlin: Retailer of home improvement, construction, and DIY products.
Completed higher education in technology, data, computer science, engineering, or related fields; proficiency in programming, databases, project management, data analysis, agile methods, and process management.
Programming Languages, Databases
1d
Save
Mark Applied
Hide
Data Engineer II
Osasco, São Paulo, Brazil
HybridFull Time
Bradesco
BradescoNYSE: BBD: Provides comprehensive banking, insurance, and investment services to customers
Advanced Spark, Hive, HBase, programming in Python, Java, or R, and SQL. Requires a degree or postgraduate qualification in data science, statistics, mathematics, economics, engineering, computing, or related fields.
Apache Spark, Apache Hive, Apache HBase, Python, Java, R, SQL, Cloud
4d
Save
Mark Applied
Hide
Engenheiro(a) de Dados Cloud / Databricks
Parauapebas or São Paulo or Brazil
RemoteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
2+ YOEDegree in technology or related field; cloud, Databricks, SQL, Python, DBT, data integration, and database experience required. Experience with GCP, AWS, or Azure is required.
GCP, AWS, Microsoft Azure, Databricks, BigQuery, Dataflow, Apache Beam, Composer, Apache Airflow, DBT, Python, Google Cloud Storage, SQL, Oracle, Sybase, SQL Server, MySQL, IBM InfoSphere DataStage
4d
Save
Mark Applied
Hide
Engenheiro de Dados
São Paulo, São Paulo, Brazil
HybridFull Time
Indra Group
Indra GroupBolsa de Madrid: IDR: Provides defense, aerospace, and digital transformation technology solutions.
Design and optimize Azure Data Lakehouse pipelines using Databricks, PySpark, SQL, Python, Data Factory, Synapse, Delta Lake, Unity Catalog, Git, Azure DevOps, CI/CD, Delta Sharing, and SFTP.
Azure Data Lakehouse, Azure Databricks, PySpark, SQL, Azure Data Factory, Azure Synapse Analytics, Python, Spark SQL, T-SQL, Delta Lake, Unity Catalog, Git, Azure DevOps, CI/CD, Delta Sharing, SFTP
5d
Save
Mark Applied
Hide
SR Data Engineer - Indaiatuba/SP
Indaiatuba, São Paulo, Brazil
HybridFull Time
John Deere
John DeereNYSE: DE: Manufactures agricultural, construction, and forestry machinery and equipment.
Bachelor's degree or equivalent experience; advanced English; extensive ETL, data modeling, warehousing, APIs, Java, Spring Boot, TDD, DevOps, Git, Jenkins, Spark, Databricks, Python, SQL, NoSQL, AWS.
Java, Spring Boot, Git, Jenkins, Apache Spark, Databricks, Python, SQL, AWS, AWS Lambda, Amazon RDS, Amazon ECS, Amazon DynamoDB, Amazon API Gateway, Amazon S3
5d
Save
Mark Applied
Hide
Engenheiro/Engenheira de Dados Sênior
Barueri, São Paulo, Brazil
HybridFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Solid data engineering experience with ETL/ELT pipelines, orchestration, Spark/PySpark, Python, agile methodologies, and distributed data processing; Databricks and Hive are preferred.
Spark, PySpark, Python, Pandas, DataFrames, Spark SQL, Scrum, Kanban, Databricks, Notebooks, Delta Lake, Hive, SQL, Hadoop, Harvard, Pluralsight, SAP, AWS, Microsoft, Salesforce, EF Education First
5d
Save
Mark Applied
Hide
SR Data Engineer - Indaiatuba/SP
Indaiatuba, São Paulo, Brazil
HybridFull Time
John Deere
John DeereNYSE: DE: Manufactures and distributes agricultural, construction, and forestry equipment.
Bachelor's degree or equivalent experience; advanced English; extensive ETL, data modeling, warehousing, large-scale data, REST APIs with Java/Spring Boot, TDD, DevOps, AWS, Spark, Databricks, Python, SQL, and NoSQL.
ETL, REST APIs, Java, Spring Boot, Test-Driven Development (TDD), DevOps, Continuous Integration, Continuous Delivery, Git, Jenkins, Apache Spark, Databricks, Python, SQL, NoSQL, AWS, AWS Lambda, Amazon RDS, Amazon ECS, Amazon DynamoDB, Amazon API Gateway, Amazon S3
5d
Save
Mark Applied
Hide
Engenheiro de Dados | Python & SQL
São Paulo or Rio de Janeiro or Recife or Nova Lima
OnsiteFull Time
Avanade
Avanade: Provider of digital and cloud services on Microsoft platforms.
Requires solid data engineering experience, ETL/ELT pipeline development, advanced Python and SQL, cloud platforms, BigQuery, Airflow or Composer, Git, and modern data architecture knowledge.
Python, SQL, Google Cloud Platform (GCP), Azure, AWS, Google BigQuery, Apache Airflow, Google Composer, Git, Databricks, CI/CD, DataOps, DevOps, Machine Learning, Data Lake