12 pyspark data engineer jobs at 10 companies in Columbus, IN
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
2w
Save
Mark Applied
Hide
Sr. Data Engineer
Indianapolis, Indiana, United States
$89k-$139k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong SQL and Python skills; experience with Spark/PySpark, cloud data platforms, data modeling, APIs, data quality, and data governance.
SQL, Python, PySpark, Spark, Databricks, Stackline, Datavations, SimilarWeb, Airflow, Azure Data Factory, SAP, Salesforce, Snowflake, Azure, AWS, GCP
2w
Save
Mark Applied
Hide
Sr. Data Engineer
Indianapolis, Indiana, United States
$89k-$139k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong SQL, Python, PySpark/Spark; cloud data pipelines; API and POS integrations; data modeling, quality, monitoring, and governance experience.
SQL, Python, PySpark, Spark, APIs, SAP, Salesforce, Snowflake, Databricks, Stackline, Datavations, SimilarWeb, Airflow, Azure Data Factory, Azure, AWS, GCP
4d
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Azure Data Engineer
Indianapolis, Indiana, United States
OnsiteFull Time
3+ YOE3+ years data engineering experience with 2+ years on Azure, strong SQL, Python or PySpark, Azure Data Factory, Synapse/Databricks/Azure SQL experience, data modeling, Git and Azure DevOps familiarity.
Microsoft Azure Data Factory, Microsoft Azure Synapse, Databricks, Microsoft Azure SQL, Microsoft Azure Data Lake Storage Gen2, Git, Microsoft Azure DevOps, Python, PySpark, SQL, Microsoft Power BI, Microsoft Purview, DP-203
2w
Save
Mark Applied
Hide
Senior Data Engineer - Databricks (No Sponsorship Available)
Indianapolis, Indiana, United States
OnsiteFull Time
5+ YOE5+ years data engineering experience; Bachelor's or Master's in CS/Engineering/Data Science; expertise with Databricks/Snowflake, Python/PySpark, SQL/Scala; Azure cloud experience and CI/CD familiarity.
Databricks, Snowflake, Delta Lake, Azure DevOps, Azure Data Factory, Azure Synapse, ADLS, Databricks Unity Catalog, Databricks Jobs, Azure Log Analytics, PowerBI, Tableau, Python, PySpark, SQL, Scala, Java, R, Microsoft Office
2w
Save
Mark Applied
Hide
Associate Director - Integrated Risk Data Engineer
Indianapolis or United States
$125k-$183k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years data engineering experience,expertise with Microsoft Fabric,SQL and Python/PySpark,Power BI and data governance,experience integrating enterprise systems and ServiceNow GRC,authorized to work in the U.S.
Microsoft Fabric, Fabric Data Factory, Synapse Data Engineering, Dataflows Gen2, ServiceNow GRC, ServiceNow, SAP, Workday, SuccessFactors, Power BI, SQL, Python, PySpark, Databricks, Git, Lakehouse, Data Warehouse, Power Automate, Power Apps
1w
Save
Mark Applied
Hide
Data Engineer (Databricks/AWS)
Indianapolis, Indiana, United States
HybridFull Time
3+ YOERequires 3–5 years of pharma data engineering experience, Databricks, AWS data services, Apache Spark, ETL/ELT, orchestration, SQL, Python, and a bachelor's degree or equivalent experience.
Databricks, Amazon Web Services (AWS), Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, Amazon Kinesis, Apache Spark, PySpark, Apache Airflow, SQL, Python, Delta Lake, Snowflake, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Director – Real World Data (RWD) Architect - Engineer
Indianapolis, Indiana, United States
$170k-$249k/yr OnsiteFull Time
5+ YOE3+ MgmtBachelor's degree, 5+ years data engineering experience with healthcare RWD, 3+ years people management, deep SQL and Python skills, cloud and Databricks experience, OMOP and healthcare coding familiarity.
Databricks, AWS S3, Azure Data Lake, Snowflake, BigQuery, Redshift, EMR, AWS Glue, dbt, dbt-databricks, Databricks Workflows, Delta Lake, Apache Iceberg, Apache Spark, PySpark, pandas, Polars, Python, SQL, R, Apache Airflow, Prefect, Dagster, Dask, Ray, Git, GitHub Actions, Azure DevOps, Docker, Terraform, MLflow, SageMaker, Azure ML, JIRA, Snakemake, Nextflow, WDL, Great Expectations, Monte Carlo, Epic, Cerner, HL7 FHIR, BioBERT, ClinicalBERT, Athena, Unity Catalog
4w
Save
Mark Applied
Hide
Palantir Senior Engineer
Indianapolis, Indiana, United States
$170k-$180k/yr OnsiteFull Time
8+ YOEExperience with Palantir Foundry, TypeScript, React JS, PySpark and Python; 8+ years experience; Bachelor in Computer Science; proficiency with data pipelines, ETL, testing and visualization.
Palantir Foundry, TypeScript, React JS, PySpark, Python, PyTest, Power BI, Workshop, Quiver, Slate, Contour
2mo
Save
Mark Applied
Hide
IT Manager - Data & Analytics
Indianapolis, Indiana, United States
OnsiteFull Time
Degree in CS/engineering/IS, several years in data engineering or architecture, expertise in Apache Spark and Microsoft Fabric, SQL and Python/Scala, experience with Microsoft Azure, strong data governance and stakeholder collaboration skills.
Apache Spark, Microsoft Fabric, SQL, Python, Scala, Microsoft Azure
1mo
Save
Mark Applied
Hide
Associate Director of RWD Engineering
Indianapolis, Indiana, United States
$156k-$229k/yr OnsiteFull Time
3+ YOEBachelor's in a technical field and minimum 3 years data engineering experience with healthcare RWD; strong SQL and Python skills; experience with cloud data platforms, distributed computing, OMOP, and regulatory/privacy frameworks.
Databricks, AWS S3, Azure Data Lake, Databricks SQL, Python, pandas, PySpark, Polars, Apache Airflow, Prefect, Dagster, Databricks Workflows, Apache Spark, Dask, Ray, AWS Glue, AWS Redshift, AWS EMR, Azure ADLS, Azure Synapse, Azure Data Factory, BigQuery, Delta Lake, Apache Iceberg, dbt, dbt-databricks, Git, GitHub Actions, Azure DevOps, Docker, Terraform, OMOP, Athena, BioBERT, ClinicalBERT, MLflow, SageMaker, Azure ML, Snakemake, Nextflow, WDL, Great Expectations, Monte Carlo, JIRA