HCLTech
Posted 2w ago

AWS Senior Data Engineer - Glue, SQL, Python (141512)

HCLTech
United States
OnsiteFull Time
Responsibilities
  • developing pipelines
  • writing queries
  • automating deployments
Requirements
  • Proven experience building and maintaining ETL/data pipelines using Amazon Glue
  • Strong SQL and Python skills, and familiarity with DevOps for deployment and automation
Technical tools mentioned
Amazon GlueSQLPythonDevOpsAWS

Job description

Requisition ID 141512 - Posted 


Job Summary

The Senior Developer is responsible for managing and developing solutions using Amazon Glue, SQL, Python, and DevOps practices. The role involves implementing, and maintaining data pipelines and ETL processes to support business objectives efficiently.

Key Responsibilities

1. Develop and maintain data transformation processes using amazon glue for etl workflows.

2. Write complex sql queries to extract and analyze data from various databases and sources.

3. Build scalable and efficient python scripts for data processing and automation tasks.

4. Implement devops solutions to automate deployment, monitoring, and maintenance processes.

5. Collaborate within team to design and implement data solutions that meet business requirements.

6. Troubleshoot and optimize existing data pipelines for improved performance and reliability.

7. Stay updated with the latest industry trends and technologies related to data engineering and software development.

Skill Requirements

1. Proficiency in amazon glue for etl workflows and data processing.

2. Strong sql skills for querying, analyzing, and manipulating data.

3. Advanced knowledge of python programming for scripting and automation.

4. Experience with devops tools and practices for continuous integration and deployment.

5. Understanding of data modeling, data warehousing, and data lake concepts.

6. Good problem-solving and analytical abilities.

7. Strong communication and team collaboration skills.

Other Requirements

1.Relevant certifications in AWS, Python, SQL, or DevOps are a plus.


About HCLTech

Global provider of information technology services and software consulting.

Similar jobs

Data Engineer roles
3h
Save
Mark Applied
Hide
Staff Data Engineer, Mission Data Products - Clearance Required
Fort Belvoir, Virginia, United States
$128k-$191k/yr OnsiteFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
8+ YOEBachelor’s degree or equivalent experience, 8+ years building production data systems, Python and SQL proficiency, enterprise data-platform experience, DoD customer experience, and active Secret clearance.
Python, SQL, Palantir Foundry, Army Vantage, CI/CD, PySpark, DevSecOps
5h
Save
Mark Applied
Hide
Data Engineer, Sr.
Reston, Virginia, United States
$145k-$225k/yr OnsiteFull Time
Chenega Corporation
Chenega Corporation: Provides professional government, defense, and facility support services.
8+ YOEBachelor’s degree or high school diploma/GED with additional experience; 8+ years relevant experience, including data migration; 5+ years RDBMS and SQL; 5+ years data analytics; active TS/SCI with CI Poly.
SQL, REST APIs, JSON, XML, AWS, Jenkins, Puppet, Chef, Ansible, AWS CloudFormation, Kubernetes, Docker, Agile, RDBMS
6h
Save
Mark Applied
Hide
Data Engineer
Washington, District of Columbia, United States
OnsiteFull Time
VIA
VIA: Provides secure decentralized identity and data privacy software solutions.
3+ YOEBachelor’s degree plus 3 years, associate degree plus 7 years, major certification plus 7 years, or 11 years’ specialized experience; Python, SQL, Spark, ML, data visualization, and secure cloud experience required.
Databricks, Docker, Terraform, Python, Spark, Amazon SageMaker, MLflow, Palantir MSS Workshop, Slate, SQL, PySpark, scikit-learn, TensorFlow, XGBoost, Palantir Foundry, MLOps, AWS, Microsoft Azure
6h
Save
Mark Applied
Hide
Data Engineer
United States
$150k-$170k/yr RemoteFull Time
Grüns: Sells nutritional gummies formulated from nutrient-dense whole-food ingredients.
3+ YOERequires 3+ years in data engineering or related work, production-quality Python and advanced SQL, Airflow, dbt, dimensional modeling, API integrations, pipeline operations, monitoring, CI/CD, and strong debugging judgment.
Airflow, dbt, Python, SQL, BigQuery, GCP, Cloud Composer
7h
Save
Mark Applied
Hide
Data Engineer
Huntsville, Alabama, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
Requires 5+ years in application and enterprise data engineering, 3+ years processing structured/unstructured data and building ETL/ELT workflows, TS/SCI clearance, and a bachelor's degree or equivalent experience.
Internet of Things (IoT), Python, SQL, Scala, Java, UNIX, Linux, Shell, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, Maven Smart System, Palantir Foundry Ecosystem
7h
Save
Mark Applied
Hide
Data Engineer-AWS, Python
Richardson or San Antonio or Texas or United States
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Requires Python, Informatica, ETL, AWS, and Glue; SQL and ServiceNow preferred. Requires a bachelor's degree or equivalent progressive experience and unrestricted US work authorization without sponsorship.
Python, Informatica, ETL, AWS, Glue, SQL, ServiceNow
8h
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$150k-$180k/yr OnsiteFull Time
Pharo Management
Pharo Management: Global macro hedge fund specializing in emerging markets investments.
5+ YOERequires 5–7 years in data engineering or quantitative data roles, advanced SQL and Python, cloud warehouse and dbt experience, and strong knowledge of fixed income, foreign exchange, volatility, and trade data.
SQL, Python, Snowflake, dbt, Microsoft SQL Server, Pandas, Polars, Power BI, Bloomberg, LSEG, Azure Data Explorer/KQL, Event Hubs, Change Data Capture (CDC), Tableau
10h
Save
Mark Applied
Hide
Data Engineer
Bristol or United Kingdom or Ireland or United States or Europe
HybridFull Time
PA Consulting
PA Consulting: Global consultancy providing innovation, technology, and management strategy services.
3+ YOEExperience designing production data pipelines and processing structured and unstructured data using Java, Python, Scala, Spark, SQL, APIs, and AWS data services.
Amazon Web Services (AWS), Amazon EMR, AWS Glue, Amazon Redshift, Amazon Kinesis, AWS Lambda, Amazon DynamoDB, Java, Python, Scala, Apache Spark, SQL, Microsoft Teams