6 pyspark data engineer jobs at 5 companies in Union, IL

1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
1d
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$81k-$112k/yr OnsiteFull Time
UL Research Institutes
UL Research Institutes: Performs independent research to advance global public safety science.
4+ YOEBachelor’s degree or equivalent experience, 4+ years in data engineering or analytics engineering, strong SQL and Python, cloud platforms, data pipelines, machine learning, and data governance experience.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Microsoft Azure, Amazon Web Services (AWS), Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
2w
Save
Mark Applied
Hide
Senior Engineer, Technology II (Data Engineering & Architecture)
North Chicago, Illinois, United States
$110k-$209k/yr HybridFull Time
AbbVie
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
7+ YOE7+ years data architecture/engineering experience with AWS (Glue,S3,EMR), Redshift, Apache Iceberg, SQL, Python, Spark/PySpark; experience with data mesh, Medallion Architecture, SAP/Blue Yonder integration, data governance and cataloging.
AWS Glue, Amazon S3, AWS EMR, AWS Lambda, Informatica, Apache Iceberg, AWS Redshift, SAP, Blue Yonder, SQL, Python, Apache Spark, PySpark, Alation, AWS Glue Data Catalog, PowerBI
1d
Save
Mark Applied
Hide
Solution Architect/Data Engineer
Wood Dale, Illinois, United States
$150k-$170k/yr OnsiteFull Time
AAR
AARNYSE: AIR: Provides aftermarket products and services to global aviation customers.
7+ YOE7+ years in data engineering or solution architecture; strong cloud data analytics experience; hands-on with SQL, PySpark/Python, Java Spring Boot, Spark/Databricks, Snowflake, and Kafka; strong stakeholder and communication skills.
Advanced Analytical SQL, PySpark, Python, Java Spring Boot, Spark, Databricks, Snowflake, Kafka, Azure
2w
Save
Mark Applied
Hide
Senior Developer, Analytics (Hybrid)
Redmond or Rosemont
HybridFull Time
PAC Worldwide
PAC Worldwide: Manufacturer of custom protective and automated packaging solutions.
8+ YOE8+ years in analytics or data engineering, manufacturing cost/financial analytics experience, Power BI, Microsoft Fabric/Synapse, SQL, Delta Lake, Python/PySpark, ETL design, data governance, and stakeholder collaboration.
Power BI, Microsoft Fabric, Synapse, SQL, Delta Lake, Python, PySpark
1mo
Save
Mark Applied
Hide
Consultant- Data Aggregation(336)
Pune or Evanston or United States
HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
4+ YOEMaster's in CS or engineering, 4+ years consulting experience, expertise in patient data aggregation, de-identification/tokenization, HISEC/HIPAA compliance, U.S. pharmaceutical datasets, Python and PySpark, Snowflake/Redshift, Airflow/Databricks.
Python, PySpark, Microsoft Office, Snowflake, Redshift, Airflow, Databricks workflows, EHR