14 pyspark data engineer jobs at 9 companies in Lorain, OH
3w
Save
Mark Applied
Hide
Data Warehouse Engineer
Kingsville, Ontario, Canada
$85k-$95k/yr OnsiteFull Time
Expert SQL, PySpark/Python, Microsoft Fabric experience, data modeling, pipeline design/optimization, data profiling, troubleshooting, and ability to guide other engineers.
Microsoft Fabric, PySpark, Python, SQL, Synapse, S3, Azure Data Lake Storage, Google Cloud Storage, Spark, Kafka, Flink, Fabric Eventstream, GIT, Claude, GitHub Copilot
3w
Save
Mark Applied
Hide
Data Warehouse Engineer
Kingsville, Ontario, Canada
$85k-$95k/yr OnsiteFull Time
Strong Microsoft Fabric, PySpark/Python, and SQL skills; data modeling, pipeline development and optimization, data profiling, troubleshooting, and stakeholder collaboration; bachelor's degree required.
Microsoft Fabric, PySpark, Python, SQL, Synapse, Amazon, S3, Azure Data Lake Storage, Google Cloud Storage, Hadoop, Databricks, AWS, Azure, GCP, Claude, GitHub Copilot, Kafka, Flink, Fabric Eventstream, GIT
3mo
Save
Mark Applied
Hide
Enterprise Data Engineer
Herndon or Cleveland or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia
$112k-$222k/yr OnsiteFull Time
3+ YOE3+ years data engineering experience; strong Python and SQL; experience with Palantir or other ETL platforms; data integration, ETL, transformation, and data quality skills; active TS/SCI with Poly required.
Python, SQL, Palantir, AWS, Azure, GCP, Apache Spark, Hadoop, Apache Airflow, Prefect
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Big Data Engineer
Pittsburgh or Cleveland or Dallas
$100k-$130k/yr HybridFull Time
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Python, Hadoop, Hive, Impala, HDFS, Apache Spark, CA7, Control-M, SQL, Shell Scripting
2w
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
1mo
Save
Mark Applied
Hide
Senior Data Engineer with DevOps
Pittsburgh or Cleveland or Dallas
$80k-$139k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
Apache Spark, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, Apache Airflow, Linux, Docker, OpenShift, Kubernetes, Jenkins, GitHub Actions, Azure DevOps, GitLab CI, Maven, Gradle, Python, Bash, PowerShell, Application Insights, ELK, Elastic Stack, Elasticsearch, GitHub, Hadoop, JSON Web Token (JWT), SQLite, Shell Script
2d
Save
Mark Applied
Hide
Quality Engineer Principal - Big Data / Hadoop / Data Warehousing
Pittsburgh or Strongsville
$91k-$169k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years of relevant experience. Requires Python, Big Data, Hadoop, Spark/PySpark, HQL/SQL, data warehouse and ETL testing, AWS/cloud, automation, and QA team leadership.
Python, Big Data, Hadoop, Data Warehouse, Apache Spark, PySpark, HQL, SQL, AWS, Hive, HDFS, YARN, CI/CD, Agile, Scrum, DevOps, API
3w
Save
Mark Applied
Hide
Engineer
Cleveland, Ohio, United States
$100k-$120k/yr OnsiteFull Time
10+ YOE10+ years in data engineering, 3+ years as data architect; expertise in data architecture, modeling, lakes/warehouses, ETL/ELT, governance; strong fraud/risk domain experience; SQL, Python, Spark, Databricks proficiency.
SQL, Python, Spark, PySpark, Databricks, Kafka, Airflow, Snowflake
1w
Save
Mark Applied
Hide
Software Engineer I, MLOps (Python/Big Data)
Pittsburgh or Cleveland
$75k-$150k/yr OnsiteFull Time
2+ YOEBachelor's degree and 2+ years experience or equivalent, strong Python and big-data engineering skills, experience with MLOps, large-scale data pipelines, production support, and troubleshooting.
Python, Pandas, PySpark, PyArrow, Hadoop, Kafka, Spark Streaming, SLURM, AWS SageMaker
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Senior Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yr HybridFull Time
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
Palantir Foundry, Palantir Gotham, Palantir AIP, Python, PySpark, Java, TypeScript, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Pega CDH Developer
Pittsburgh or Cleveland
$59k-$157k/yr OnsiteFull Time
4+ YOEPega CSSA required,4+ years Pega experience (2+ in CDH),NBA/decisioning,REST integrations,PRPC,Tracer/Clipboard debugging,experience with APIs, integration patterns, and customer data/personalization.
Pega Customer Decision Hub (CDH), Next Best Action, Java, VB (.NET), Mainframe, REST APIs, Tracer, Clipboard, Live UI, PRPC, Connect-Rest, Connect-SOAP, Data Pages, Data Flows, Adobe Experience Cloud (AEP, AJO, AEM), Kafka, AWS, Azure, GCP, Kubernetes, Docker, Python, PySpark, SQL, Informatica, COBOL/DB2
4w
Save
Mark Applied
Hide
Quality Assurance Lead
Pittsburgh or Dallas or Cleveland or Birmingham
$63k-$139k/yr OnsiteFull Time
8+ YOE8+ years QA experience, lead QA initiatives, strong Python and PySpark skills, big data and Hadoop testing experience, Oracle/SQL validation, Unix/Linux scripting, Jenkins/Git CI/CD, Docker/OpenShift experience.
Python, PySpark, Hadoop, HDFS, Hive, Impala, Sqoop, Oracle PL/SQL, SQL, Jenkins, Git, Docker, OpenShift, Unix/Linux, Control M, MLflow, AWS Glue, AWS Athena, AWS S3, AWS SageMaker