ECS ME
Posted 7mo ago

Data Engineer - Data Warehouse, BigData, Python and SQL

ECS ME
Hyderabad, Telangana, India
OnsiteFull Time
Responsibilities
  • design pipelines
  • build warehouses
  • optimize storage
Requirements
  • Design
  • Develop, and manage data pipelines and data warehouses
  • Optimize data storage
  • Ensure data reliability and governance
  • Collaborate on analytics and BI projects
Technical tools mentioned
SQLPL/SQLAmazon RedshiftOracleSQL ServerMySQLPostgreSQLHadoopScalaSparkHiveShell ScriptingAWS EMRAWS LambdaAWS GlueAWS Step FunctionsKafkaFlumeSqoop

Job description

Job Summary 
We are seeking a skilled Data Engineer to join our team and contribute to designing, developing, and managing data solutions, including pipelines and data warehouses. The ideal candidate will handle high-volume data processing, integrate complex data structures, and optimize data storage solutions. You will ensure data reliability, quality, and compliance while collaborating on analytics and business intelligence projects in a diverse technological environment. 

Must-Have Skillsets (Mandatory)
- Expertise in Advanced SQL, PLSQL, and handling bulk data processing. 
- Proficiency with databases like Amazon Redshift, Oracle, SQL Server, MySQL, and Postgres. 
- Experience in data modeling, including Star/Dimensional modeling. 
- Knowledge of Data Warehouse development and ETL processes. 
- Experience with structured and semi-structured data ingestion. 
- Familiarity with big data platforms and technologies such as Hadoop, Scala, Spark, Hive, Shell Scripting, and AWS tools like EMR, Lambda, Glue, and Step Function. 
- Strong problem-solving, debugging, and performance-tuning skills. 
- Ability to design and optimize data storage and manage data governance principles. 

Good-to-Have Skillsets (Optional)
- Hands-on experience with Hadoop/Big Data environments. 
- Experience with streaming data platforms like Kafka or Flume. 
- Knowledge of data analytics and business intelligence solutions. 
- Proficiency in tools for data integration and orchestration like Sqoop. 

Qualifications and Experience
- Bachelor's degree in Computer Science, Information Technology, or a related field. 
- Minimum of [insert years, e.g., 4+ years] experience in database and enterprise data warehouse development. 
- Proven track record of developing and managing complex data pipelines and integrating diverse data sources. 
- Strong analytical and numerical skills with attention to detail. 

This role is ideal for a dynamic professional eager to innovate in a data-driven environment and contribute to transformative projects.

About ECS ME

Provides global enterprise IT consulting and Oracle software implementation services.

Similar jobs

Data Engineer roles near Hyderabad, Telangana
4h
Save
Mark Applied
Hide
Senior / Lead Data Engineer - Azure Databricks
Hyderabad, Telangana, India
OnsiteFull Time
Blend360
Blend360: Provides data science, AI, and marketing consulting services.
4+ YOERequires 4+ years in data engineering, SQL and Python, Azure Databricks, semantic and KPI modeling, data pipelines, Git, data quality, governance, and stakeholder collaboration.
Databricks Metric Views, SQL, Python, Azure Databricks, Git, Azure DevOps, RBAC, CI/CD
5h
Save
Mark Applied
Hide
Lead Data Engineer
Hyderabad, Telangana, India
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years of software engineering experience; advanced programming skills; strong Python and SQL; distributed data processing; Databricks, Spark, Delta, MLflow, anomaly detection, SDLC, and secure AI-assisted development.
Python, SQL, Databricks, Apache Spark, Delta, MLflow, KMeans, DBSCAN, HDBSCAN, Isolation Forest, LOF, PCA, CI/CD
6h
Save
Mark Applied
Hide
Lead Data Engineer (OIC+Python)
Hyderabad, Telangana, India
OnsiteFull Time
Mattel
MattelNASDAQ: MAT: Designs, manufactures, and markets toys and family entertainment franchises.
10+ YOE10–13 years’ experience with OIC, Oracle SQL/PLSQL, Python, data modeling, ETL/ELT, GCP, BigQuery or Oracle 23ai, APIs, deployment, testing, and data quality controls.
Oracle Integration Cloud (OIC), Google Cloud Platform (GCP), SQL, Python, Google BigQuery (GBQ), Oracle Database, Apache Airflow, Cloud Composer, OCP Scheduler, PL/SQL, SQL Developer, Oracle Cloud Infrastructure (OCI), Oracle GoldenGate, Git, OpenAI, DBT, CI/CD
14h
Save
Mark Applied
Hide
Asset & Wealth Management-AM Sales & Marketing Tech-Hyderabad-Associate-Software Engineering
Hyderabad, Telangana, India
OnsiteFull Time
Goldman Sachs
Goldman SachsNYSE: GS: Global investment banking, securities, and investment management firm.
2+ YOERequires 2–3 years of relevant experience, Big Data and modern processing framework expertise, Java/Scala/Python, REST or GraphQL, database knowledge, and a bachelor's degree in Computer Science or equivalent experience.
Hadoop, Spark, Airflow, Flink, Java, Scala, Python, REST, GraphQL, NoSQL, SQL, AWS, Snowflake
19h
Save
Mark Applied
Hide
Data Engineer
Hyderabad, Telangana, India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years of data analysis experience, 15 years of full-time education, scalable data pipeline and ETL experience, data architecture knowledge, database management, large-dataset handling, and data quality expertise.
ETL
20h
Save
Mark Applied
Hide
Data Engineer - Ads
Hyderabad, Telangana, India
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
The posting describes Apple Ads technology and platforms but does not specify qualifications, required experience, education, licenses, or certifications.
1d
Save
Mark Applied
Hide
Associate Engineer
Hyderabad, Telangana, India
OnsiteFull Time
Milestone Technologies
Milestone Technologies: Global provider of IT managed services and digital solutions.
5+ YOEBachelor's degree in a technical field; 5+ years designing, building, and supporting data pipelines; Azure Data Services, SQL Server, Power BI, DAX, PowerShell, Azure DevOps, and Python experience.
SQL Server, Azure Data Catalog, Azure Blob Storage, Azure Data Lake Storage, Azure Synapse Analytics, Azure Analysis Services, Azure Data Factory, Power BI, DAX, PowerShell, Azure DevOps, Python, CI/CD, ETL
1d
Save
Mark Applied
Hide
Associate Engineer
Hyderabad, Telangana, India
OnsiteFull Time
Milestone Technologies
Milestone Technologies: Global provider of IT managed services and digital solutions.
5+ YOEBachelor's degree in a technical field; 5+ years designing and supporting data pipes; 2+ years automating ETL data quality measurement; Azure Data Services, SQL Server, Power BI, DAX, PowerShell, Azure DevOps, and Python experience.
SQL Server, Microsoft Azure, Azure Data Catalog, Azure Blob Storage, Azure Data Lake Storage, Azure Synapse Analytics, Azure Analysis Services, Azure Data Factory, Power BI, DAX, PowerShell, Azure DevOps, Python, CI/CD, ETL