214 pyspark data engineer jobs at 107 companies in Triangle, VA

3w
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
1d
Save
Mark Applied
Hide
Data Engineer
Atlanta or Washington
$87k-$198k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOEBachelor’s degree and 3+ years with PySpark, SQL, and Azure Databricks; data engineering, analytics, technical collaboration, public health data, and Public Trust eligibility required.
PySpark, SQL, Azure Databricks, R, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Hadoop, Hive, EMR, Kafka, Redshift, MySQL, Snowflake, FHIR, EHR, ETL, ELT
1mo
Save
Mark Applied
Hide
Data Engineer
Rockville, Maryland, United States
OnsiteFull Time
Axle Informatics
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
Python, SQL, Spark, PySpark, Git, Snowflake, Databricks, Posit Connect, R/Shiny, Streamlit, Jupyter, Galaxy, Code Ocean, S3, Postgres, APIs
3w
Save
Mark Applied
Hide
Data Engineer
Springfield or Fairfax
$110k-$165k/yr HybridFull Time
ECS
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
1mo
Save
Mark Applied
Hide
Data Engineer
Vienna or Pensacola
$78k-$123k/yr HybridFull Time
Navy Federal Credit Union
Navy Federal Credit Union: Offers banking and financial services to the military community.
5+ YOEBachelor's in CS/Engineering/Information Systems, 5+ years data engineering, strong SQL, xml/JSON, SSIS, Microsoft Azure (Synapse, Data Factory, Databricks), PySpark, ETL, scripting, query optimization, Azure DevOps, SQL Server, and Power BI familiarity.
SQL, xml/JSON, SSIS, Microsoft Azure Synapse, Microsoft Azure Data Factory, Databricks, PySpark, Microsoft Azure DevOps (ADO), SQL Server, Microsoft Power BI
3w
Save
Mark Applied
Hide
Data Engineer
Fort Meade, Maryland, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years data engineering; experience with Maven Smart System (MSS); TS/SCI clearance and bachelor’s degree required; strong data integration and pipeline development skills.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, Defense Acquisition Visibility Environment (DAVE)
2mo
Save
Mark Applied
Hide
Data Engineer
Springfield, Virginia, United States
$60k-$180k/yr OnsiteFull Time
M9 Solutions
M9 Solutions: Provides IT modernization and technology services to federal agencies.
10+ YOEActive TS/SCI clearance; BS/MS in CS/Engineering or related field; 10+ years in data engineering or software development; strong Python (pandas, PySpark, FastAPI); cloud experience (AWS/Azure); Kafka, Airflow; database internals; data governance and AI/ML integration.
Python, Pandas, PySpark, FastAPI, AWS, Azure, Kafka, Airflow, PostgreSQL, MySQL, ElasticSearch, DynamoDB, Redis, S3, Lambda, Glue, Step Functions, Redshift, BigQuery, Kubernetes, Docker
1mo
Save
Mark Applied
Hide
Data Engineer
Fairfax or United States
$130k-$135k/yr RemoteFull Time
Bixal
Bixal: Provides digital transformation and consulting services for government agencies.
5+ YOEBachelor's degree, 5+ years data engineering experience, expertise with PySpark/Databricks/AWS/Kafka, Python and SQL proficiency, Terraform and Git familiarity, ability to obtain Public Trust clearance.
PySpark, Databricks Intelligence Platform, AWS, S3, IAM, Kafka, Delta Share, Terraform, Python, Git, Linux, SQL, Apache Hive, Apache Hadoop, Apache Spark, QuickSight, Power BI
1mo
Save
Mark Applied
Hide
Data Engineer - Remote
United States or Minnetonka or Minneapolis or Washington
$73k-$130k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
3+ YOE3+ years data engineering experience; strong SQL, Python, and PySpark skills; 1+ year with Azure/Databricks; experience with streaming, ETL, CDC, data quality and Medallion architecture.
Azure, Azure Data Factory, Databricks, Databricks Delta Live Tables, Delta Lake, Parquet, PySpark, Spark, Spark Structured Streaming, Spark Declarative Lakeflow Pipelines, Kafka, Azure Event Hubs, Great Expectations, SQL, Python
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
1w
Save
Mark Applied
Hide
Senior Data Engineer
Bethesda, Maryland, United States
$156k/yr HybridFull Time
EagleBank
EagleBankNASDAQ: EGBN: Provides personalized commercial and consumer banking and lending services.
2+ YOEMaster's in information systems or related, 2+ years as Data Engineer, experience with Python, SQL, Snowflake, AWS services, CI/CD (GitLab), PySpark, and SnowPro certification.
Python, SQL, Snowflake, AWS EMR, AWS Lambda, AWS S3, AWS RDS, GitLab, PySpark
2mo
Save
Mark Applied
Hide
Data Engineer – Senior
Hyattsville or Landover
$140k-$180k/yr RemoteFull Time
BDR Solutions
BDR Solutions: Provider of IT, engineering, and consulting for federal agencies.
8+ YOEActive MBI and U.S. citizenship required; 8+ years cloud data engineering; 3–5 years Databricks; current Databricks Data Engineer and AWS certifications; proficiency with Python, PySpark, SQL, Databricks, and AWS services; bachelor’s degree required.
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, AWS Lake Formation, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, RBAC, ABAC
2mo
Save
Mark Applied
Hide
Data Engineer
Chantilly, Virginia, United States
OnsiteFull Time
GRVTY
GRVTY: Develops defense technology, cyber, and intelligence software solutions.
Active TS/SCI with Polygraph; strong SQL, Python, PySpark; AWS; Linux; ETL; data ingestion/transform; quick learner; good communicator.
SQL, Python, PySpark, AWS, Linux, APIs, Geospatial tools, ETL
1w
Save
Mark Applied
Hide
Data Engineer (WDP)
Chantilly or Herndon
OnsiteFull Time
Bespoke Technologies
Bespoke Technologies: Provides technical engineering and data solutions for national security.
4+ YOEActive TS or TS/SCI clearance required,4+ years data engineering experience,proficiency with Python,SQL,Spark/PySpark,ETL development,cloud data platforms (AWS/Azure),Databricks;Terraform and data quality tooling experience preferred.
Python, SQL, Spark, PySpark, AWS, Azure, Databricks, Databricks Delta Live Tables, Palantir, Snowflake, Terraform, Great Expectations, Airflow, Docker, Kubernetes, NiFi, ElasticSearch
4w
Save
Mark Applied
Hide
Data Engineer - Databricks
McLean, Virginia, United States
$125k-$160k/yr RemoteFull Time
Steampunk
Steampunk: Provides digital transformation and IT consulting for federal agencies.
2+ YOEAbility to obtain Public Trust,2+ years data engineering experience,Databricks,SQL,PySpark/Python,AWS experience,ETL/pipeline migration,agile and CI/CD experience.
Databricks, Apache Spark, Delta Lake, T-SQL, pgSQL, MySQL, Databricks Workflows, Airflow, Step Functions, AWS, S3, EC2, RDS, PySpark, Python, Java, C++, Scala, Apache Iceberg, Informatica EDC, Unity Catalog, Collibra, Alation, Purview, DataZone, CI/CD
3w
Save
Mark Applied
Hide
Mid Data Engineer
Reston, Virginia, United States
$130k-$155k/yr RemoteFull Time
Forge Group
Forge Group: Provides professional consulting and IT solutions for federal agencies.
4+ YOEU.S. citizen with 4+ years data engineering experience, advanced Python, AWS Lambda, PySpark, ETL/ELT, data modeling, CI/CD, Git, and ability to obtain CompTIA Security+ and pass Tier 2 background investigation.
Python, AWS, AWS Lambda, PySpark, MariaDB, PostgreSQL, Git, Appian, Palantir Foundry, CI/CD, SQL, REST API
3w
Save
Mark Applied
Hide
Data Engineer - AWS/Databricks
Reston, Virginia, United States
RemoteFull Time
Acuity
Acuity: Provides digital strategy and technology consulting for federal agencies.
5+ YOE5+ years data engineering experience building scalable ETL/ELT pipelines, cloud data solutions on AWS/Databricks, PySpark/Spark, Delta Lake, and strong data quality and governance practices.
PySpark, Spark, Delta Lake, Databricks, Spark SQL, DataFrame APIs, AWS, S3, Glue, RDS, IAM, Git, GitLab, Jenkins, AWS CloudWatch
1w
Save
Mark Applied
Hide
Senior Data Engineer
Arlington, Virginia, United States
OnsiteFull Time
540
540: Builds mission-critical software and cloud systems for government agencies.
9+ YOE9+ years data engineering experience; Databricks, Python, SQL, PySpark, Apache Spark, Delta Lake; cloud experience (AWS/Azure/GCP); US citizen with active DoW Secret clearance required.
Databricks, Apache Spark, Delta Lake, Python, SQL, PySpark, Unity Catalog, Terraform, Databricks Asset Bundles, Airflow, Kafka, Kinesis, Pulsar, Spark Structured Streaming, MLflow, AWS, Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Washington, District of Columbia, United States
$120k-$199k/yr OnsiteFull Time
The Washington Post
The Washington Post: Provides daily newspaper publishing and digital news reporting services.
3+ YOESenior Data Engineer with 3+ years in ETL/ELT, data modeling, and SQL; strong Python, PySpark, and AWS data lakehouse experience; knowledge of data pipelines, AI/ML tooling, and collaboration with cross-functional teams.
Python, PySpark, Spark, Flink, AWS, Redshift, Athena, EMR, Glue, Pub/Sub, Airflow, Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Google Ad Manager