135 data pipeline engineer jobs at 87 companies in Oswego, IL
3d
Save
Mark Applied
Hide
3d
Data Engineer
Chicago, Illinois, United States
$175k-$225k/yrOnsiteFull Time
IMC: Global proprietary trading firm and market maker.
5+ YOERequires 5+ years in data engineering, Kafka streaming and Big Data pipeline experience, Java, Python, SQL, Spark or Flink, Kubernetes, Docker, monitoring tools, statistics, and Unix scripting.
Zeno Group: Global communications agency providing strategic public relations services.
6+ YOE6+ years data engineering experience; strong SQL and Python; experience with cloud warehouses (Snowflake, Redshift, BigQuery), ETL/ELT, Fivetran, and data pipeline design; familiarity with AWS, BI tools, and LLM/vector tooling.
Above Lending: Provides unsecured personal loans and debt consolidation services.
5+ YOE5+ years data engineering experience; expert SQL, Python; hands-on with Snowflake, Airflow, Fivetran, DBT; building data models, pipelines, and validating data quality.
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yrHybridFull Time
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
Wintrust Financial CorporationNASDAQ: WTFC: Provides community banking, commercial finance, and wealth management services.
7+ YOE7+ years data engineering experience (or 5+ with a Master's); experience designing ETL/ELT pipelines, data modeling, data lineage/quality, Microsoft SSIS, SQL, Azure DevOps, and processing semi/unstructured data.
GraingerNYSE: GWW: Distributes maintenance, repair, and operating (MRO) supplies.
3+ YOEBachelor's degree or equivalent experience; 3+ years in modern data engineering, with Python, Scala, Airflow, Kafka, Spark, cloud systems, data pipelines, and machine learning experience.
NinjaHoldings: Provides digital banking, lending, and underwriting analytics platforms.
5+ YOE5+ years data engineering experience, Bachelors in a quantitative field, advanced SQL, Python, Postgres/MySQL, AWS (EC2, RDS, Redshift, Glue, S3), building data pipelines, supervising junior engineers, and experience with analytics or ML a plus.
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
7+ YOE7+ years in data engineering or data architecture with hands-on GCP experience (BigQuery, Dataflow, Pub/Sub), Python, distributed systems, batch/streaming pipelines, and stakeholder communication.
Propelis: Global agency providing brand packaging and marketing production services.
3+ YOEBachelor's in engineering required; 3+ years in packaging, data engineering, analytics engineering, or supply chain data roles. Strong Excel and data management skills; Python, data pipelines, cloud platforms, data modeling, and Microsoft Copilot experience a plus.
Hightower: Provides independent wealth management and financial planning services.
2+ YOEBachelor's degree in a related field and 2–4 years building and operating data pipelines. Requires Python, SQL, Snowflake, dbt, and Mulesoft proficiency plus collaboration and data accuracy skills.
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
HAVI: Global provider of integrated supply chain and logistics services.
3+ YOEBachelor’s degree required; 3+ years building production Spark cloud pipelines; 2+ years Azure Databricks; experience with Azure Data Factory, SQL, data quality, DevOps, IaC, and Azure monitoring.
Apache Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Databricks Workflows, Delta Live Tables, Azure Data Factory, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
United States or San Francisco or New York City or Chicago
$170k-$230k/yrHybridFull Time
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
InRule: Software platform for automating complex enterprise decision logic.
5+ YOE5+ years data engineering experience with 2+ years in senior capacity; deep Snowflake and SQL skills; Microsoft Azure data pipeline experience; production C#/.NET service development; knowledge of GDPR/HIPAA/SOC2; strong communication.
C#, .NET, Snowflake, Microsoft Azure, Data Factory, Event Hubs, Functions, Sisense, SQL, Python, REST, GraphQL, gRPC, Docker
Senior Data Engineer – Physical AI Platform, Data Engineering
Chicago, Illinois, United States
$113k-$183k/yrOnsiteFull Time
CaterpillarNYSE: CAT: Manufactures construction and mining equipment, engines, and gas turbines.
5+ YOEDesign and implement scalable data pipelines and cloud-native data platforms using AWS services; 5+ years data engineering experience; Python/Java and SQL proficiency; EMR/observability and CI/CD experience.
Python, Java, Kinesis, S3, DynamoDB, EventBridge, CloudWatch, Helios Data Platform, SQL, Microsoft Azure DevOps, Jira, Jenkins
4+ YOE4+ years building data warehouse/lake solutions and production data pipelines; expert SQL, Snowflake, and Python; ETL/ELT and CI/CD experience; strong data modeling, performance tuning, and mentoring skills.
DRW: Technology-driven principal trading firm operating in global financial markets
5+ YOE5+ years designing ingestion pipelines for batch and real-time market data; experience with equities/futures data, data quality frameworks, observability, on-prem Linux and cloud, CI/CD and MLOps; Parquet/Iceberg familiarity.
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$81k-$112k/yrOnsiteFull Time
UL Research Institutes: Performs independent research to advance global public safety science.
4+ YOEBachelor’s degree or equivalent experience, 4+ years in data engineering or analytics engineering, strong SQL and Python, cloud platforms, data pipelines, machine learning, and data governance experience.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Microsoft Azure, Amazon Web Services (AWS), Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory