1,418 pyspark data engineer jobs at 643 companies in United States
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building scalable data pipelines with PySpark/Spark, Hive/SQL, cloud big-data tools, Python, and data modeling; strong performance tuning and ETL/ELT skills.
RTXNYSE: RTX: RTX provides advanced aerospace and defense systems and services.
U.S. citizenship and Puerto Rico residency required. Strong Python and PySpark experience, advanced SQL, production Apache Spark experience, cloud data platform experience (AWS/Azure/GCP), Snowflake/Big Query/Redshift/Synapse familiarity, and proficiency with Git and Docker.
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yrHybridFull Time
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
PeerIslands: Provides cloud modernization and AI software engineering services.
5+ YOE5+ years data engineering experience with Databricks, PySpark, AWS Glue, Python, SQL, and MongoDB; experience building cloud-native ETL, data modeling, and data quality checks.
Virtusa: Global provider of digital engineering and IT outsourcing services.
4+ YOE4+ years in data engineering or governance; strong SQL, PySpark and Python skills; experience with Collibra or Informatica; familiarity with data modeling, warehousing, Agile/Scrum, and teamwork.
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
Guidehouse: Provides management and technology consulting services to diverse organizations.
8+ YOEEight+ years in data engineering or related fields; strong Java/Python/SQL/PySpark; AWS and Azure experience; CI/CD; data modeling; security and governance; excellent communication.
AXIS CapitalNew York Stock Exchange: AXS: Global provider of specialty lines insurance and reinsurance.
5+ YOE5+ years data engineering; 3+ years Databricks/Delta Lake; strong Azure data platform; Spark/PySpark/SQL; Medallion/Lakehouse; data governance; security/CI/CD/IaC; MLOps; communication.
Azure Databricks, Delta Lake, ADF, Azure Synapse, Event Hubs, Azure Functions, Azure Data Lake Storage Gen2, Azure Key Vault, DevOps, Spark, PySpark, SQL, MLflow, Unity Catalog, Bicep, Terraform, ARM templates, Copilot, GenAI, Power BI
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years in data engineering; experience with Maven Smart System (MSS); TS/SCI clearance; bachelor’s degree.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, DAVE
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
7+ YOE7+ years data engineering experience with AWS and Snowflake, strong SQL/Python/Pyspark, data warehousing, ETL, data governance, insurance domain knowledge, bachelor's in engineering or related required.
Hopscotch Primary Care: Provides value-based primary care for seniors in rural areas.
4+ YOE4+ years data engineering experience, Bachelor's in CS/engineering or related, strong Python/PySpark skills, experience with data models/warehouses, data quality/governance, and familiarity with modern cloud data platforms.
Rysun Labs: Provides AI, data, and digital innovation services for enterprises.
4+ YOE4+ years data engineering experience; strong SQL, ETL/ELT, data warehousing, data lake, and cloud (AWS/Azure/GCP) skills; Python/PySpark/Scala and Big Data (Spark, Databricks, Hadoop, Kafka); CI/CD and Git experience.
SQL, Python, PySpark, Scala, Spark, Databricks, Hadoop, Kafka, AWS, Microsoft Azure, GCP, CI/CD, Git, Snowflake, Redshift, Microsoft Synapse, BigQuery
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.