205 pyspark data engineer jobs at 104 companies in Frederick, MD
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years in data engineering; experience with Maven Smart System (MSS); TS/SCI clearance; bachelor’s degree.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, DAVE
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years data engineering; experience with Maven Smart System (MSS); TS/SCI clearance and bachelor’s degree required; strong data integration and pipeline development skills.
Steampunk: Design-led federal technology consulting and innovation services firm.
3+ YOE2-4 years data engineering experience; strong Databricks, SQL, PySpark/Python; AWS; ability to hold public trust; experience with data pipelines and data lakes.
Databricks, SQL, PySpark, Python, AWS, Delta Lake, Airflow, S3, EC2
M9 Solutions: Provides IT modernization and technology services to federal agencies.
10+ YOEActive TS/SCI clearance; BS/MS in CS/Engineering or related field; 10+ years in data engineering or software development; strong Python (pandas, PySpark, FastAPI); cloud experience (AWS/Azure); Kafka, Airflow; database internals; data governance and AI/ML integration.
Bixal: Provides digital transformation and consulting services for government agencies.
5+ YOEBachelor's degree, 5+ years data engineering experience, expertise with PySpark/Databricks/AWS/Kafka, Python and SQL proficiency, Terraform and Git familiarity, ability to obtain Public Trust clearance.
eSimplicity: Provides digital and data services to federal government agencies.
5+ YOE5+ years data engineering experience building AWS ETL pipelines using Glue, Spark/PySpark, Lambda and S3; strong Python and SQL skills; ability to obtain Moderate Risk Public Trust clearance.
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yrRemoteFull Time
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
BDR Solutions: Provider of IT, engineering, and consulting for federal agencies.
8+ YOEActive MBI and U.S. citizenship required; 8+ years cloud data engineering; 3–5 years Databricks; current Databricks Data Engineer and AWS certifications; proficiency with Python, PySpark, SQL, Databricks, and AWS services; bachelor’s degree required.
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, AWS Lake Formation, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, RBAC, ABAC
Forge Group: Provides professional consulting and IT solutions for federal agencies.
4+ YOEU.S. citizen with 4+ years data engineering experience, advanced Python, AWS Lambda, PySpark, ETL/ELT, data modeling, CI/CD, Git, and ability to obtain CompTIA Security+ and pass Tier 2 background investigation.
Steampunk: Federal digital transformation and consulting services provider.
5+ YOE5+ years data engineering experience with Databricks, SQL, PySpark/Python, and AWS; ability to architect and migrate data platforms, work in Agile/SDLC, and hold public trust.
Total Wine & More: Large independent retailer of wine, spirits, and beer.
3+ YOEBachelor's preferred, 3+ years data engineering experience; expert SQL, Python, Spark/PySpark; experience with cloud data platforms, streaming (Kafka, Pub/Sub), ELT/ETL, observability, CI/CD, Git, dbt, and Great Expectations.
SQL, Python, Spark, PySpark, Airflow, BigQuery, Microsoft Fabric, Snowflake, Databricks, Delta Lake, Parquet, Kafka, Pub/Sub, Git, Great Expectations, dbt, Power BI, CI/CD
The Washington Post: Provides daily newspaper publishing and digital news reporting services.
3+ YOESenior Data Engineer with 3+ years in ETL/ELT, data modeling, and SQL; strong Python, PySpark, and AWS data lakehouse experience; knowledge of data pipelines, AI/ML tooling, and collaboration with cross-functional teams.
Python, PySpark, Spark, Flink, AWS, Redshift, Athena, EMR, Glue, Pub/Sub, Airflow, Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Google Ad Manager
Analytica: Provides data analytics and IT solutions for federal government agencies.
8+ YOE8+ years data engineering experience, 3+ years supporting CMS/federal healthcare, Databricks and cloud (AWS/Azure) expertise, strong Spark/PySpark/Python/SQL, DataOps and CI/CD experience, healthcare compliance knowledge.
Edgesource Corporation: Providing mission-ready national security and IT solutions.
5+ YOE5+ years experience building production data pipelines, advanced Python, Spark/PySpark, EMR/DB tuning, workflow orchestration, containerization, AWS, SQL and Git; active TS/SCI Full Scope Polygraph required.