52 pyspark data engineer jobs at 30 companies in Edgewood, MD
23h
Save
Mark Applied
Hide
23h
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yrOnsiteFull Time
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years in data engineering; experience with Maven Smart System (MSS); TS/SCI clearance; bachelor’s degree.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, DAVE
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years data engineering; experience with Maven Smart System (MSS); TS/SCI clearance and bachelor’s degree required; strong data integration and pipeline development skills.
BDR Solutions: Provider of IT, engineering, and consulting for federal agencies.
8+ YOEActive MBI and U.S. citizenship required; 8+ years cloud data engineering; 3–5 years Databricks; current Databricks Data Engineer and AWS certifications; proficiency with Python, PySpark, SQL, Databricks, and AWS services; bachelor’s degree required.
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, AWS Lake Formation, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, RBAC, ABAC
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
LMI: Provides management consulting and digital solutions to federal government agencies.
5+ YOE5–8 years data engineering experience with expert Python, SQL, PySpark; experience with Palantir Foundry (Vantage) and Advana; active DoD Secret clearance; familiarity with Army data sources preferred.
LMI: Provides management consulting and digital solutions to government agencies.
5+ YOEActive DoD Secret clearance,5+ years data engineering experience,expert Python,SQL,PySpark,experience with Palantir Foundry/Advana,ability to scale ETL pipelines and manage ontologies.
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yrOnsiteFull Time
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Magpie Health Analytics: A healthcare-focused analytics provider building cloud-native data solutions to improve operations and reporting.
4+ YOEBachelor's degree and 4+ years data engineering experience. Strong SQL and Python proficiency, ETL/ELT pipeline development, AWS/cloud tools, CI/CD, data quality, and distributed processing experience.
Creative Information Technology: Provides IT solutions and software for government and healthcare sectors.
3+ YOE3+ years building data pipelines on AWS, strong Python/SQL and PySpark skills, experience with data lakehouse architectures, ETL/ELT, healthcare data formats, and CI/CD/IaC practices.
PySpark, Python, SQL, Scala, Java, Apache Spark, AWS Glue, S3, Redshift, Athena, EMR, Lake Formation, AWS Health Lake, Iceberg, Delta Lake, Airflow, Terraform, CloudFormation, EDI X12, HL7, FHIR
Baltimore or Alabama or California or Delaware or District of Columbia or Florida or Georgia or Maryland or New Jersey or New York or North Carolina or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or West Virginia
$96k-$162k/yrRemoteFull Time
Fearless: Digital services firm delivering IT solutions for government agencies.
4+ YOERequires 4+ years in data engineering or related roles, bachelor's degree or equivalent, Python, SQL, Spark, ETL/ELT, data modeling, cloud ecosystems, databases, Agile experience, and ability to obtain Public Trust clearance.
Python, SQL, PySpark, Databricks, Azure, AWS, GCP, NLP, Postgres, MySQL, MongoDB, Cassandra, LangChain, Electronic Medical Records (EMR)
Sand Technologies: Provides AI software to optimize critical industrial infrastructure.
3+ YOE3+ years designing and operating large-scale hybrid data platforms; expertise with distributed processing, streaming systems, data governance, and building ML-ready data infrastructure.
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York City or Philadelphia or Raleigh or Tampa or Washington
$100k-$122k/yrOnsiteFull Time
Slalom: A global business and technology consulting firm.
4+ YOERequires 4+ years designing, building, and optimizing production data engineering solutions, with modern data technologies, cloud platforms, data warehouses, and programming skills.
Amazon Web Services, Microsoft Azure, Google Cloud Platform, Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Sand Technologies: Develops industrial AI and digital twin solutions for enterprise operations.
3+ YOE3+ years building and operating large-scale cloud or hybrid data platforms; strong Python and SQL skills; experience with Spark/Kafka, cloud (AWS/Azure/GCP), data governance, observability, and ML enablement.
Peraton: National security and mission-critical government technology services provider.
3+ YOERequires U.S. citizenship, DoD TS with ability to obtain and maintain SCI, Python, SQL, Scala, Spark, Kafka, Hadoop, data modeling, warehousing, streaming architectures, cloud data services, and 3–8 years of relevant experience depending on degree.
Aperio Global: Develops cybersecurity, AI, and intelligence software for government missions.
5+ YOEActive TS/SCI clearance, 5+ years data engineering or security analytics experience, advanced SQL and Python (pandas, PySpark), Databricks/Apache Spark, Apache Kafka, and familiarity with cryptographic protocols and security telemetry.
ParsonsNYSE: PSN: Provides engineering and technology services for infrastructure and defense.
7+ YOEBachelor's in a technical field, 7+ years related experience, ability to develop mathematical algorithms, proficiency with advanced statistical software and MS Office, and U.S. citizenship required.
R, Python, Apache Spark, ElasticSearch, Kibana, SPSS, SAS, MatLab, Microsoft Office, Microsoft Access, Windows