1,418 pyspark data engineer jobs at 643 companies in United States

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
6d
Save
Mark Applied
Hide
Pyspark Developer
Irving, Texas, United States
$100k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building scalable data pipelines with PySpark/Spark, Hive/SQL, cloud big-data tools, Python, and data modeling; strong performance tuning and ETL/ELT skills.
Apache Spark, PySpark, Hive, Amazon Web Services (AWS), EMR, Glue, Microsoft Azure, Databricks, Synapse, Google Cloud Platform (GCP), Spark UI, Apache Airflow, Parquet, ORC, Avro, Python, HiveQL, ANSI SQL, Git, Jenkins, Ansible, HBase, Cassandra, MongoDB
2w
Save
Mark Applied
Hide
Data Engineer (Python/PySpark) (Puerto Rico)
Santa Isabel or Aguadilla
HybridFull Time
RTX
RTXNYSE: RTX: RTX provides advanced aerospace and defense systems and services.
U.S. citizenship and Puerto Rico residency required. Strong Python and PySpark experience, advanced SQL, production Apache Spark experience, cloud data platform experience (AWS/Azure/GCP), Snowflake/Big Query/Redshift/Synapse familiarity, and proficiency with Git and Docker.
Python, PySpark, Apache Spark, Delta Lake, Iceberg, Hudi, Apache Airflow, Fast API, Flask, EMR, Glue, Databricks, AWS, Azure, GCP, Snowflake, Big Query, Redshift, Synapse, Git, Docker, Apache Kafka, PySpark MLlib, SQL, Spark SQL
2d
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
1mo
Save
Mark Applied
Hide
Data Engineer Consultant-Azure Databricks, SQL, Pyspark
United States
HybridFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
7+ YOE7+ years in Azure-based data engineering; Databricks/Spark; SQL; Python/Scala; Power BI or similar; cloud security and governance.
Azure Data Factory, Azure Data Lake, Azure Synapse, Azure Databricks, Apache Spark, Scala, Python, SQL, Power BI
3d
Save
Mark Applied
Hide
Data Engineer
United States
OnsiteFull Time
PeerIslands
PeerIslands: Provides cloud modernization and AI software engineering services.
5+ YOE5+ years data engineering experience with Databricks, PySpark, AWS Glue, Python, SQL, and MongoDB; experience building cloud-native ETL, data modeling, and data quality checks.
Databricks, AWS Glue, Python, SQL, MongoDB, PySpark, Delta Lake, Apache Spark, AWS S3, Git
2mo
Save
Mark Applied
Hide
Data Engineer
Plano, Texas, United States
OnsiteFull Time
Ascentt
Ascentt: Provides AI, cloud, and data analytics solutions for enterprise transformation.
2+ YOE2-5 years data engineering; Databricks/Snowflake; SQL & Python; PySpark; ETL/ELT; cloud environments; Bachelor's degree.
Databricks, Snowflake, PySpark, SQL, Python, Airflow, dbt, Azure Data Factory, Git, Delta Lake, Kafka, Spark Streaming
6d
Save
Mark Applied
Hide
Data Engineer
Jersey City, New Jersey, United States
OnsiteFull Time
Virtusa
Virtusa: Global provider of digital engineering and IT outsourcing services.
4+ YOE4+ years in data engineering or governance; strong SQL, PySpark and Python skills; experience with Collibra or Informatica; familiarity with data modeling, warehousing, Agile/Scrum, and teamwork.
SQL, PySpark, Python, Informatica, Collibra, JIRA, Agile, Scrum
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
ReadyOn
ReadyOn: AI-native labor operating system for frontline enterprise workforces.
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
1mo
Save
Mark Applied
Hide
Data Engineer
The Woodlands, Texas, United States
OnsiteFull Time
Beusa Energy
Beusa Energy: Provides oil exploration, fracturing, and power generation services.
3+ YOEDatabricks, Delta Live Tables, PySpark, SQL; 3-5+ years in data roles; BS in MIS/CS/Engineering or related field.
Databricks, Delta Live Tables, PySpark, SparkSQL, Microsoft SQL Server, Power BI, Tableau, Spotfire, Sigma
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
United States or Dallas or Addison
HybridFull Time
Allworth Financial
Allworth Financial: Provides retirement planning and investment advisory services to individuals.
5+ YOE5+ years data engineering; strong SQL; PySpark; cloud ETL/ELT; data modeling; Azure data services; governance.
PySpark, Delta Lake, SQL, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Azure Data Factory, Power BI, ThoughtSpot
3w
Save
Mark Applied
Hide
Data Engineer
Rockville, Maryland, United States
OnsiteFull Time
Axle Informatics
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
Python, SQL, Spark, PySpark, Git, Snowflake, Databricks, Posit Connect, R/Shiny, Streamlit, Jupyter, Galaxy, Code Ocean, S3, Postgres, APIs
1mo
Save
Mark Applied
Hide
Data Engineer
Arlington, Virginia, United States
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
8+ YOEEight+ years in data engineering or related fields; strong Java/Python/SQL/PySpark; AWS and Azure experience; CI/CD; data modeling; security and governance; excellent communication.
Java, Python, SQL, PySpark, REST, SOAP, AWS, S3, Redshift, Lambda, ECS, SQS, CosmosDB, Functions, Docker, Kubernetes, Databricks, Jenkins, Maven, Git, GitHub, Bitbucket, Splunk, CloudWatch, Kibana, Elasticsearch, Jira, Confluence
1mo
Save
Mark Applied
Hide
Data Engineer
Halifax or Alpharetta
$80k-$100k/yr HybridFull Time
AXIS Capital
AXIS CapitalNew York Stock Exchange: AXS: Global provider of specialty lines insurance and reinsurance.
5+ YOE5+ years data engineering; 3+ years Databricks/Delta Lake; strong Azure data platform; Spark/PySpark/SQL; Medallion/Lakehouse; data governance; security/CI/CD/IaC; MLOps; communication.
Azure Databricks, Delta Lake, ADF, Azure Synapse, Event Hubs, Azure Functions, Azure Data Lake Storage Gen2, Azure Key Vault, DevOps, Spark, PySpark, SQL, MLflow, Unity Catalog, Bicep, Terraform, ARM templates, Copilot, GenAI, Power BI
1d
Save
Mark Applied
Hide
Data Engineer
Springfield or Fairfax
$110k-$165k/yr HybridFull Time
ECS
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
2d
Save
Mark Applied
Hide
Data Engineer
Fort Meade, Maryland, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years in data engineering; experience with Maven Smart System (MSS); TS/SCI clearance; bachelor’s degree.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, DAVE
2d
Save
Mark Applied
Hide
Lead Data Engineer
New Jersey or United States
$130k-$150k/yr RemoteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
7+ YOE7+ years data engineering experience with AWS and Snowflake, strong SQL/Python/Pyspark, data warehousing, ETL, data governance, insurance domain knowledge, bachelor's in engineering or related required.
Snowflake, SQL, Python, Pyspark, AWS Glue, AWS EMR, AWS S3, AWS Aurora, AWS RDS
1w
Save
Mark Applied
Hide
Senior Data Engineer
United States
$140k-$170k/yr RemoteFull Time
Hopscotch Primary Care
Hopscotch Primary Care: Provides value-based primary care for seniors in rural areas.
4+ YOE4+ years data engineering experience, Bachelor's in CS/engineering or related, strong Python/PySpark skills, experience with data models/warehouses, data quality/governance, and familiarity with modern cloud data platforms.
Python, PySpark, Palantir Foundry, DBT, Databricks, Snowflake, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or New York
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years in data engineering; strong SQL, PySpark, Databricks; AWS; Airflow; data modeling; BI dashboards; Bachelor in CS/IS or related.
SQL, PySpark, Databricks, Unity Catalog, Snowflake, AWS, Airflow, Git, CI/CD, Delta Lake, S3, IAM, EC2, Glue, Lambda
1mo
Save
Mark Applied
Hide
Data Engineer
Houston, Texas, United States
$60/hr OnsiteFull Time
Rysun Labs
Rysun Labs: Provides AI, data, and digital innovation services for enterprises.
4+ YOE4+ years data engineering experience; strong SQL, ETL/ELT, data warehousing, data lake, and cloud (AWS/Azure/GCP) skills; Python/PySpark/Scala and Big Data (Spark, Databricks, Hadoop, Kafka); CI/CD and Git experience.
SQL, Python, PySpark, Scala, Spark, Databricks, Hadoop, Kafka, AWS, Microsoft Azure, GCP, CI/CD, Git, Snowflake, Redshift, Microsoft Synapse, BigQuery
4w
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM