HiringCafe
Join our community

198 pyspark data engineer jobs at 80 companies in Virginia

1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred Python, SQL, Scala, Java, AWS, and distributed data tools.
Python, PySpark, AWS, Java, Scala, RDBMS, NoSQL, Redshift, Snowflake, machine learning, distributed microservices, SQL, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Springfield or Fairfax
$110k-$165k/yr HybridFull Time
ECS Federal
ECS FederalEFOR: Federal segment of Everforth delivering technology and engineering solutions.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Washington, District of Columbia or Arlington
$93k-$176k/yr RemoteFull Time
Accenture Federal Services
Accenture Federal ServicesNew York Stock Exchange: ACN: Technology and management consulting for U.S. federal agencies.
Experience with cloud ETL, data warehousing, Python, SQL, Spark, PySpark, Databricks, Palantir, Snowflake, orchestration, and data quality; must be a US citizen.
Databricks, Spark, AWS, Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Google Cloud Dataflow, Azure Data Factory, Google BigQuery, Snowflake, Python, SQL, PySpark, Palantir, ElasticSearch, NiFi, Docker, Kubernetes, Hadoop, ELK stack, Agile, Scrum
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Fairfax, Virginia, United States
$130k-$155k/yr OnsiteFull Time
Prometheus Federal Services
Prometheus Federal Services: Private veteran-owned healthcare transformation consulting firm serving U.S. federal agencies.
5+ YOEBachelor’s degree and 5+ years in data engineering, ETL/ELT, or DBA. Requires SQL, Python, PySpark, Spark, Databricks, Azure analytics, database administration, GitHub tools, U.S. work authorization, and ability to obtain public trust.
SQL, Python, PySpark, Spark, Databricks, Azure Data Factory, Azure Synapse, Azure Data Lake Storage, Azure SQL, SQL Server, PostgreSQL, GitHub, GitLab, GitHub Actions
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Chicago or Fairview Heights or Houston or Arlington
$89k-$148k/yr OnsiteFull Time
Guidehouse
Guidehouse: Global consulting firm serving public and commercial sectors.
5+ YOEBachelor's degree and 5 years of data engineering or software development experience. Requires U.S. citizenship or green card, ability to obtain Public Trust, Java, Python, SQL, PySpark, ETL, databases, Databricks, APIs, and CI/CD experience.
SQL, R, Python, Git, Docker, Kubernetes, Java, PySpark, RESTful, SOAP, Co-Pilot, CodeX, MySQL, PostgreSQL, SQL Server, MongoDB, Databricks, GitHub, Jira, Confluence, Kibana, Tableau, Spring Boot
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer - Databricks
McLean, Virginia, United States
$110k-$160k/yr OnsiteFull Time
Steampunk
Steampunk: Federal contractor providing human-centered IT and mission solutions.
2+ YOERequires 2–4 years of data engineering and commercial software coding experience, Databricks, SQL, PySpark/Python, AWS, data architecture, pipelines, Agile, and ability to hold US government Public Trust.
Databricks, SQL, PySpark, Python, AWS, Apache Spark, Delta Lake, Databricks Workflows, Airflow, Step Functions, S3, EC2, RDS, Azure, GCP, T-SQL, pgSQL, MySQL, Java, C++, Scala, Apache Iceberg, CI/CD, Informatica EDC, Unity Catalog, Collibra, Alation, Purview, DataZone
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer (WDP)
Chantilly or Herndon
OnsiteFull Time
Bespoke Technologies, Inc.
Bespoke Technologies, Inc.: Woman-owned U.S. technology consultancy delivering digital transformation, engineering, mission operations, and IT solutions to national-security customers.
4+ YOEActive TS or TS/SCI clearance required,4+ years data engineering experience,proficiency with Python,SQL,Spark/PySpark,ETL development,cloud data platforms (AWS/Azure),Databricks;Terraform and data quality tooling experience preferred.
Python, SQL, Spark, PySpark, AWS, Azure, Databricks, Databricks Delta Live Tables, Palantir, Snowflake, Terraform, Great Expectations, Airflow, Docker, Kubernetes, NiFi, ElasticSearch
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer - Databricks
McLean, Virginia, United States
$125k-$160k/yr RemoteFull Time
Steampunk
Steampunk: Federal contractor providing human-centered IT and mission solutions.
2+ YOEAbility to obtain Public Trust,2+ years data engineering experience,Databricks,SQL,PySpark/Python,AWS experience,ETL/pipeline migration,agile and CI/CD experience.
Databricks, Apache Spark, Delta Lake, T-SQL, pgSQL, MySQL, Databricks Workflows, Airflow, Step Functions, AWS, S3, EC2, RDS, PySpark, Python, Java, C++, Scala, Apache Iceberg, Informatica EDC, Unity Catalog, Collibra, Alation, Purview, DataZone, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer - AWS/Databricks
Reston, Virginia, United States
RemoteFull Time
Acuity, Inc.
Acuity, Inc.: Private federal IT consulting firm providing technical solutions to national-security and public-safety agencies.
5+ YOE5+ years data engineering experience building scalable ETL/ELT pipelines, cloud data solutions on AWS/Databricks, PySpark/Spark, Delta Lake, and strong data quality and governance practices.
PySpark, Spark, Delta Lake, Databricks, Spark SQL, DataFrame APIs, AWS, S3, Glue, RDS, IAM, Git, GitLab, Jenkins, AWS CloudWatch
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Arlington, Virginia, United States
OnsiteFull Time
540
540: Private technology consulting firm building secure software, cloud, data, and AI systems for federal government missions.
9+ YOE9+ years data engineering experience; Databricks, Python, SQL, PySpark, Apache Spark, Delta Lake; cloud experience (AWS/Azure/GCP); US citizen with active DoW Secret clearance required.
Databricks, Apache Spark, Delta Lake, Python, SQL, PySpark, Unity Catalog, Terraform, Databricks Asset Bundles, Airflow, Kafka, Kinesis, Pulsar, Spark Structured Streaming, MLflow, AWS, Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Spark Data Engineer, Senior
Chantilly, Virginia, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Global firm providing management, technology, and engineering consulting services.
5+ YOE5+ years Spark (PySpark or Java) and enterprise-scale data engineering experience, ETL and big data pipeline building, experience with distributed tools (Spark, AWS, Kafka), TS/SCI clearance with polygraph, bachelor\u0002s degree.
Spark, PySpark, Java, AWS, Kafka, Cassandra, Postgres, Docker, Kubernetes
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer – Senior
Herndon, Virginia, United States
$140k-$180k/yr RemoteFull Time
BDR Solutions
BDR Solutions: Service-disabled veteran-owned small IT services firm modernizing health, social-service, and disaster-relief systems for U.S. federal agencies.
8+ YOEActive MBI and U.S. citizenship; 8+ years cloud data engineering, 3–5 years Databricks, Databricks and AWS certifications, Python/PySpark/SQL, Delta Lake/medallion architecture, tenant onboarding and federal security compliance (NIST/FISMA/FedRAMP).
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, CDC, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, AWS Lake Formation
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Palantir Data Engineer
Herndon or Washington
HybridFull Time
Unissant
Unissant: Government technology consulting firm delivering data analytics, AI, digital transformation, and cybersecurity services to U.S. federal agencies.
5+ YOEBachelor's degree and 5+ years of data engineering experience, including 3+ years with Palantir Foundry. Requires Python/PySpark, SQL, cloud platforms, and ability to obtain DHS Public Trust clearance.
Pipeline Builder, Code Workbook, Palantir Foundry, Python, PySpark, SQL, TypeScript, AWS, Azure, GCP
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Data Engineer - Remote (WFH)
Virginia or District of Columbia or Maryland or Tennessee or Florida or Arizona or Colorado or Oregon or Texas
$130k-$160k/yr RemoteFull Time
Cognitive Medical Systems
Cognitive Medical Systems: IT and software engineering services firm serving U.S. government healthcare programs; physician-led and service-disabled veteran-owned.
8+ YOEBachelor's degree in computer science, data engineering, or related field; 8+ years in data engineering, including 4+ years with high-volume batch ETL; expert Python and PySpark; CMS public trust background check eligibility.
Apache Airflow, PySpark, Amazon S3, Amazon Redshift Serverless, Snowflake, Databricks, Amazon Athena, Amazon SQS, AWS Lambda, Amazon EventBridge, Linux, RHEL, CentOS, Amazon Linux 2, Bash, SQL, GitHub, Jenkins, JFrog Artifactory, JFrog Xray, SonarQube, Snyk, BDD, TDD
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer - Remote
Virginia Beach or Alabama or Delaware or Florida or Georgia or Idaho or Indiana or Kansas or Louisiana or Maine or Maryland or Minnesota or Nebraska or Nevada or New Hampshire or North Carolina or North Dakota or Ohio or Oklahoma or Pennsylvania or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Washington or West Virginia or Wisconsin or Wyoming
$80k-$134k/yr RemoteFull Time
Sentara Health
Sentara Health: Non-profit health system providing clinical and insurance services.
3+ YOE3+ years relevant experience building scalable data pipelines with PySpark/Databricks, strong SQL, ETL/ELT, Delta Lake, Azure preferred, Fivetran, Git, and metadata-driven ingestion and data quality/governance practices.
PySpark, Databricks, Fivetran, Delta Lake, Azure, Git, SQL, DataHub, ACP
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer - Homes.com - Arlington, VA
Arlington, Virginia, United States
$128k-$190k/yr HybridFull Time
Homes.com
Homes.com: Private CoStar Group residential real estate marketplace serving homebuyers, renters, sellers, agents, and brokers.
6+ YOEBachelor's degree and 6+ years of software development experience required, with strong Python, PySpark, SQL, data engineering, cloud platforms, secure data architecture, and scalable data pipeline expertise.
Databricks, Snowflake, BigQuery, AWS, Spark, Python, PySpark, SQL, Power BI, Claude Code, GitHub Copilot, Cursor, Gemini, Grok, Azure, DynamoDB, Amazon S3, GCS, Kafka, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
McLean or Maryland or United States
OnsiteFull Time
J5 Consulting
J5 Consulting: Minority-owned cybersecurity and IT consulting firm serving commercial businesses and government and defense organizations.
Experience building production data pipelines with Spark/PySpark, Python (Pandas, NumPy), ETL/ELT, Airflow/Step Functions, Docker/Podman, AWS (S3, Lambda, Step Functions), PostgreSQL/MySQL, SQL, Git/CI-CD; US citizenship and active Top Secret clearance with full-scope polygraph required.
Apache Spark, PySpark, Python, Pandas, NumPy, Step Functions, Airflow, Docker, Podman, S3, Lambda, PostgreSQL, MySQL, SQL, Git, CI/CD, Apache Iceberg, Apache Ranger, Trino, Unity Catalog OSS, Apache Polaris, Apache Superset, Bash, Terraform, CloudFormation, OpenLineage, Java, H3, PostGIS, DynamoDB
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Falls Church, Virginia, United States
$105k-$124k/yr OnsiteFull Time
CommonWealth One Federal Credit Union
CommonWealth One Federal Credit Union: A credit union providing financial services and community-focused banking.
5+ YOEBachelor’s degree in a technical field and 5–7 years of data engineering experience required. Requires Python, SQL, scalable pipelines, cloud data platforms, governance, and data quality expertise.
Python, SQL, Apache Spark, Databricks, Microsoft Fabric
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Chantilly, Virginia, United States
OnsiteFull Time
NS2 Mission
NS2 Mission: Private SAP NS2 subsidiary delivering secure data, analytics, sensor, and spatial solutions to defense and intelligence organizations.
3+ YOE3+ years data engineering experience, strong Python and SQL skills, ETL and data integration experience, familiarity with Palantir and cloud/big-data tools, strong analytic and communication skills.
Python, SQL, Palantir, Apache Spark, Hadoop, AWS, Azure, GCP, Apache Airflow, Prefect
Job PostingView all

Explore Jobs

Expand Your Job Search