1,583 pyspark developer jobs at 667 companies in United States

6d
Save
Mark Applied
Hide
Pyspark Developer
Irving, Texas, United States
$100k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building scalable data pipelines with PySpark/Spark, Hive/SQL, cloud big-data tools, Python, and data modeling; strong performance tuning and ETL/ELT skills.
Apache Spark, PySpark, Hive, Amazon Web Services (AWS), EMR, Glue, Microsoft Azure, Databricks, Synapse, Google Cloud Platform (GCP), Spark UI, Apache Airflow, Parquet, ORC, Avro, Python, HiveQL, ANSI SQL, Git, Jenkins, Ansible, HBase, Cassandra, MongoDB
1mo
Save
Mark Applied
Hide
Mid Software Developer (Pig/Pyspark)
Linthicum, Maryland, United States
$137k-$147k/yr OnsiteFull Time
Lentech
Lentech: Provides mission-critical IT and engineering solutions for government agencies.
7+ YOEActive TS/SCI with FSP through MD, 7 years software development experience, strong analytics background, experience with Pig and PySpark, Bachelor\u0002s in CS (or 4 additional years SWE experience), familiarity with Python/Java/Scala.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
3d
Save
Mark Applied
Hide
BigData PySpark Consultant
Tampa, Florida, United States
OnsiteFull Time
Virtusa
Virtusa: Global provider of digital engineering and IT outsourcing services.
Design, build and deploy big data solutions using Spark, Hive, Hadoop and UNIX; follow SDLC and best practices; strong analytical, problem-solving and communication skills.
Bigdata, HIVE, UNIX, Spark SQL, Hadoop, Spark, HiveQL
2mo
Save
Mark Applied
Hide
Software Engineer III – Python/PySpark/AWS
Tampa, Florida, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years software development; Python 3, PySpark; AWS; design, debugging, and scalable solutions; SDLC; agile, CI/CD; security.
Python, PySpark, AWS, Hadoop, Databricks, Snowflake, EC2, EKS, RDS, S3, Lambdas
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Python + PySpark
Richmond or McLean or Cambridge
$179k-$225k/yr HybridFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOE1+ MgmtLead software engineer with 4+ years of software engineering experience and 1+ year cloud experience (AWS/Azure/GCP); proficient in Python, PySpark, JavaScript, TypeScript, SQL, Java, and Go; strong leadership and collaboration skills.
Python, PySpark, JavaScript, TypeScript, SQL, Java, Go, Docker, Kubernetes, AWS, Azure, GCP, HTML/CSS, Open Source RDBMS, NoSQL
2mo
Save
Mark Applied
Hide
Senior Algorithm Developer - PySpark / SQL (Durham, NC, US)
Durham, North Carolina, United States
OnsiteFull Time
ACA Group
ACA Group: Regulatory compliance and risk management solutions for financial services.
5+ YOE3+ years PySpark/Python in production; 5+ years SQL; Spark ecosystem; AWS; CI/CD; Git/JIRA; agile teams.
PySpark, Python, SQL, Apache Spark, AWS, Git, JIRA, CI/CD, Iceberg, EMR, S3, CloudWatch
2mo
Save
Mark Applied
Hide
BI developer (Databricks + Pyspark/SparkSQL/Python) (Atlanta, GA, US)
Atlanta, Georgia, United States
$103k-$129k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
BI developer with Databricks, PySpark, SparkSQL, and Python experience; onshore with Anaplan model building/administration; data integration and analytics.
Databricks, PySpark, SparkSQL, Python, Anaplan
1mo
Save
Mark Applied
Hide
Technology Consultant 2
Irving or Tampa or United States
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Spark/PySpark, Hadoop/HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, Python, SQL and shell scripting; bachelor's degree (or equivalent experience); authorized to work in the U.S.; may require relocation/travel.
Spark, Hadoop, HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, PySpark, Python, SQL, Shell scripting
2w
Save
Mark Applied
Hide
Data Engineer (Python/PySpark) (Puerto Rico)
Santa Isabel or Aguadilla
HybridFull Time
RTX
RTXNYSE: RTX: RTX provides advanced aerospace and defense systems and services.
U.S. citizenship and Puerto Rico residency required. Strong Python and PySpark experience, advanced SQL, production Apache Spark experience, cloud data platform experience (AWS/Azure/GCP), Snowflake/Big Query/Redshift/Synapse familiarity, and proficiency with Git and Docker.
Python, PySpark, Apache Spark, Delta Lake, Iceberg, Hudi, Apache Airflow, Fast API, Flask, EMR, Glue, Databricks, AWS, Azure, GCP, Snowflake, Big Query, Redshift, Synapse, Git, Docker, Apache Kafka, PySpark MLlib, SQL, Spark SQL
1mo
Save
Mark Applied
Hide
Software Engineer Lead - Data Product Organization (Cloudera Hadoop, Neo4j, Spark/PySpark)
Pittsburgh or Strongsville or Denver or Phoenix or Birmingham or Dallas
$55k-$138k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
3+ YOEExperience with Cloudera Hadoop, Neo4j, Spark/PySpark, HDFS/Hive/Impala, Iceburg and streaming; strong communication and leadership; 3+ years relevant experience; Bachelor\u0002s degree typical.
Cloudera Hadoop, Neo4j, Spark, PySpark, HDFS, HQL, Hive, Impala, Beeline, Linux, Apache Kafka, Iceburg
2d
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
4w
Save
Mark Applied
Hide
Software Engineer II - BDX Developer Experience
Washington, D.C., District of Columbia, United States
$192k-$213k/yr OnsiteFull Time
Booking Holdings
Booking HoldingsNASDAQ: BKNG: Global provider of online travel and related services.
3+ YOE3+ years software development experience with strong Python and backend/platform or data engineering skills; experience with PySpark, dbt, Airflow, AWS or Snowflake; strong communication and developer-experience focus.
Python, Spark, PySpark, dbt, Airflow, AWS, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer Consultant-Azure Databricks, SQL, Pyspark
United States
HybridFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
7+ YOE7+ years in Azure-based data engineering; Databricks/Spark; SQL; Python/Scala; Power BI or similar; cloud security and governance.
Azure Data Factory, Azure Data Lake, Azure Synapse, Azure Databricks, Apache Spark, Scala, Python, SQL, Power BI
2d
Save
Mark Applied
Hide
Software Engineer II
New York, New York, United States
$123k-$165k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
3+ YOE3+ years backend development experience; proficiency with foundation models, LangChain/LangGraph, PyTorch/TensorFlow, PySpark/Pandas, AWS, Docker, Git; strong software development and communication skills; Bachelor's preferred.
GPT-4, Claude, Bedrock, LangChain, LangGraph, PyTorch, TensorFlow, PySpark, Pandas, AWS, Docker, Git, Flask, FlaskAPI, Cursor, Datadog, Grafana, Conviva, MongoDB
2w
Save
Mark Applied
Hide
Sr. Developer
United States
HybridFull Time
Cognizant
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
8+ YOE8+ years data engineering experience with Databricks and PySpark, Databricks Workflows/CLI experience, prompt engineering knowledge, strong coding and collaboration skills; Databricks certification preferred.
Databricks, PySpark, Databricks SQL, Databricks Workflows, Databricks CLI
2mo
Save
Mark Applied
Hide
Cloud Integration Developer - Python
United States
$111k-$150k/yr RemoteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
5+ YOE5+ years Python development; AWS Glue/S3/Lambda; PySpark; SQL; data mapping/validation; CMS Public Trust clearance eligibility; United States residency.
AWS AppSync, AWS Lambda, AWS Glue, Amazon S3, PySpark, SQL, Kafka (MSK), EventBridge
4w
Save
Mark Applied
Hide
Software Engineer 1
Herndon or Potomac
OnsiteFull Time
Kepora
Kepora: A technology employer hiring cleared engineers to develop analytics and software solutions.
U.S. citizenship and active TS/SCI with Full Scope Polygraph required. Strong analytics development background. Required: Pig, PySpark. Desired: Python, Java, Scala, NiFi, Ansible, Agile experience.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
3mo
Save
Mark Applied
Hide
SOFTWARE ENGINEER LEVEL 1 (DM)
Fort Meade, Maryland, United States
OnsiteFull Time
EOA Technologies
EOA Technologies: Designs and manages secure IT infrastructure for government agencies.
7+ YOEActive TS/SCI with polygraph; 7 years SWE; experience in analytics development; Pig and PySpark; Bachelor in CS; 4 years can substitute for degree.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
2mo
Save
Mark Applied
Hide
Software Engineer 1 (DM)
Hanover, Maryland, United States
OnsiteFull Time
Quevera: Software engineering and cloud solutions for government and defense.
Strong analytics development background; Pig and PySpark; Python, Java, Scala; NiFi; Ansible; agile environment; patch management; must have TS/SCI Poly clearance to apply.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
3w
Save
Mark Applied
Hide
Senior Software Engineer
Sterling, Virginia, United States
OnsiteFull Time
Nightwing
Nightwing: Provides advanced cyber and intelligence solutions for national security.
Requires Solr/Elastic Search expertise, big data experience (Hadoop, Pyspark, Spark, Hbase), backend Java development, college degree in Computer Science or equivalent, and TS/SCI with Polygraph required day 1.
Solr, Elastic Search, Lucene, Hadoop, Pyspark, Spark, Hbase, Java, AWS, JIRA, GITHUB