HiringCafe
📋 External Recruiting Agencies

mBridge Solutions is a staffing and professional services firm posting this position on behalf of a third-party client, as evidenced by the job description explicitly seeking a candidate for a 'leading Oil and Gas client'.

This company was flagged and excluded from default search results. Proceed with caution.

M
Posted 2y ago

Sr. Data Engineer

mbridge
View all open roles
Houston, Texas, United States
OnsiteContract
Responsibilities
  • building pipelines
  • assembling datasets
  • supporting stakeholders
Requirements
  • 10+ years experience building and maintaining data pipelines and analytics solutions on Azure using ADF
  • Databricks, Spark
  • Python
  • SQL/Scala
  • Strong data architecture
  • Security, and software engineering practices
Technical tools mentioned
Azure Data FactoryDatabricksPythonSQLScalaSparkAgileADOAnsibleGIT

Job description

mbridge is seeking an experienced Data engineer for a leading Oil and Gas client in Houston, TX.

Job Title: Senior Data Engineer
Contract: 12 months plus
Location: Houston, TX

Note: Only Houston, TX candidates

- Responsibilities:
-Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
-Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
-Create data tools for analytics and data scientist team members that assist them in
-Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements.
-Work with data and analytics experts to strive for greater functionality in our data systems.
-Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
-Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other technologies.
building and optimizing our product into an innovative industry leader.



Requirements

Required Qualifications:
- Minimum 10+ years of experience
-Analytics/data product solution architecture on Azure (Azure Data Factory, Databricks)
-Data extract, load and transformation techniques and tools including orchestration of needed azure resources
-Azure analytics services
-Programming, scripting (Python, SQL, Scala)
-Analytics data frameworks (Spark etc.)
-Data architecture concepts understanding (relational and dimensional data models)
-Information security
-Software engineering tools and methodologies (e.g. Agile, ADO, Ansible, GIT)

Similar jobs

Data Engineer roles near Houston, Texas
1d
Save
Mark Applied
Hide
Senior Data Engineer
Stafford, Texas, United States
OnsiteFull Time
Eurofins Scientific
Eurofins ScientificEuronext Paris: ERF: Global provider of analytical testing and laboratory services.
Bachelor’s or master’s degree or equivalent experience; expert Python, SQL, Git, cloud, orchestration, databases, scientific data, and MLOps experience; analytical chemistry knowledge; unrestricted US work authorization; English proficiency.
Machine Learning (ML), Python, Pandas, NumPy, AWS, Azure, GCP, Azure Data Lake Storage (ADLS), Azure Compute VMs, Azure Functions, Apache Airflow, Prefect, Dagster, SQL, PostgreSQL, Git, Azure ML Studio, MLflow, Kubeflow, Sagemaker, CSV, JSON, LIMS/ELN
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
Atlanta or Chicago or Fairview Heights or Houston or Arlington
$89k-$148k/yr OnsiteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
5+ YOEBachelor's degree and 5 years of data engineering or software development experience. Requires U.S. citizenship or green card, ability to obtain Public Trust, Java, Python, SQL, PySpark, ETL, databases, Databricks, APIs, and CI/CD experience.
SQL, R, Python, Git, Docker, Kubernetes, Java, PySpark, RESTful, SOAP, Co-Pilot, CodeX, MySQL, PostgreSQL, SQL Server, MongoDB, Databricks, GitHub, Jira, Confluence, Kibana, Tableau, Spring Boot
Job PostingView all
1d
Save
Mark Applied
Hide
Sr Data Engineer_ITDE1I
Houston, Texas, United States
$102k-$170k/yr HybridFull Time
ENGIE
ENGIEEuronext Paris: ENGI: Produces and distributes electricity, gas, and renewable energy.
5+ YOEBachelor’s degree or equivalent experience; 5+ years building cloud data pipelines; 2+ years in energy trading, asset management, or energy operations; Python, SQL, ETL/ELT, orchestration, modeling, APIs, and stakeholder backlog management.
AWS, Azure, GCP, Python, SQL, ETL, ELT, APIs, CI/CD
Job PostingView all
3d
Save
Mark Applied
Hide
Lead Analyst Data Engineer
Houston, Texas, United States
OnsiteFull Time
Boardwalk Pipelines
Boardwalk Pipelines: Transporting and storing natural gas and liquids via pipelines.
7+ YOEBachelor's degree in a related field and 7–10 years of cloud data architecture experience, including 5+ years with AWS. Requires AWS, Databricks, SQL, Python, governance, and leadership expertise.
Google Chrome, Safari, Firefox, Microsoft Edge, AWS Glue, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon SageMaker, Amazon Bedrock, AWS Step Functions, Databricks, Alation, SQL, T-SQL, Python, PySpark, Pandas, DAX, Power Query (M), PL/SQL, SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata, Power BI, Git, Visual Studio Code, SSMS
Job PostingView all
1w
Save
Mark Applied
Hide
Enterprise Data Engineer
Ridgeland or Alabama or Houston or Memphis or Florida or Atlanta
RemoteFull Time
Trustmark
TrustmarkNASDAQ: TRMK: Provides retail and commercial banking, wealth, and insurance services.
4+ YOEBachelor's degree in data or computer science or equivalent certification, 4 years with modern ETL platforms, database, data warehousing, modeling, SQL, Python, and advanced analytical skills.
IBM Datastage, Informatica, Snowpipe, Azure, AWS, SQL, Python
Job PostingView all
1w
Save
Mark Applied
Hide
Google Senior Data Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years in data engineering, analytics, or ML; 4+ years with GCP; 5+ years with SQL and pipelines; 3+ years with Python or AI tools; and a bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Looker, Vertex AI, Gemini Foundation Models, Gemini Enterprise, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Looker Studio, Model APIs, Embeddings, Dataplex, IAM, SQL, Python, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer 1
The Woodlands, Texas, United States
OnsiteFull Time
Beusa Energy
Beusa Energy: Provides oil exploration, fracturing, and power generation services.
3+ YOEBachelor's degree in MIS, computer science, engineering, IT, or related field, or equivalent experience; 3-5+ years in a data-focused role; strong Databricks, PySpark, SparkSQL, SQL, and visualization skills.
Databricks, Delta Lake, Delta Live Tables (DLT), Databricks Jobs, Autoloader, CDC, Spark, PySpark, SparkSQL, SQL, Microsoft SQL Server, Power BI, Tableau, Spotfire, Sigma, Z-Ordering, Auto Optimize, OPTIMIZE, VACUUM, MERGE, Change Data Feed, APPLY CHANGES INTO
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer 1
The Woodlands, Texas, United States
OnsiteFull Time
Accelerated Mobile Power
Accelerated Mobile Power: Provides mobile power solutions using gas turbines and generators.
3+ YOEBachelor's degree in MIS, computer science, engineering, IT, or related field, or equivalent experience; 3–5+ years in a data-focused role; Databricks, PySpark, SparkSQL, SQL, and visualization experience.
Databricks, Delta Lake, Delta Live Tables (DLT), Databricks Jobs, Auto Loader, Change Data Capture (CDC), Spark, PySpark, SparkSQL, SQL, Microsoft SQL Server, Power BI, Tableau, Spotfire, Sigma
Job PostingView all