Edgesource
Posted 7mo ago

Data Engineer

Edgesource
Chantilly, Virginia, United States
OnsiteFull Time
Responsibilities
  • Design pipelines
  • Develop architectures
  • Collaborate with teams
Requirements
  • 3-5 years of data engineering experience
  • Strong collaboration
  • Ability to explain complex concepts
  • Detail-oriented
  • Ability to manage multiple priorities
Technical tools mentioned
PythonSQLPySparkElastic/OpenSearchAWSLinuxGitDockerKubernetesREST APIsCI/CDData governanceMLOps

Job description

We offer many opportunities to work on leading programs in both the federal and commercial sectors. Edgesource has partnered with many organizations working on progressive projects vital to both their continued success and our national security. Edgesource is continually seeking top-tier professionals to join our ever-growing diverse teams.



Edgesource offers competitive salaries and benefits packages across our various business units, please reference within individual job postings on our website for additional information.  Edgesource is an Equal Opportunity employer committed to a diverse workforce.

Company Overview:


For over 25 years, Edgesource Corporation has served as an innovative technology service provider for the Department of Defense (DOD), Department of Homeland Security (DHS), Department of State (DOS), the U.S. Intelligence Community, Law Enforcement, and other federal, state, and commercial clients locally, nationally, and abroad. From providing boutique technical solutions in support of the DOD Counter Unmanned Aerial Systems (CUAS) mission set to addressing the most critical Cybersecurity threats facing our nation as a prime contractor with the DHS Cybersecurity & Infrastructure Security Agency (CISA), a career at Edgesource is an opportunity to do meaningful, interesting, and impactful work.


Position Overview:



  • Client is seeking a data engineer to grow our team performing cutting edge client work in mission space. With overwhelming amounts of large data, client is seeking a data engineer to support data structuring for implementation into a larger enterprise system that is being custom developed for client.


Development is performed on client site.


Responsibilities:



  • Design, develop, and maintain ETL/ELT pipelines for batch and real-time processing using Python and SQL.

  • Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, and MS Office files.

  • Build scalable data architectures to support analytics and machine learning workloads.

  • Optimize data processing and queries for performance and cost efficiency in AWS S3.

  • Exposure to PySpark or other big data frameworks is a plus for future pipeline scalability.

  • Develop and implement web scraping and data ingestion workflows to collect open-source data, integrating content and producing structured datasets and visualizations for analytics and stakeholder consumption.


Data Management & Optimization



  • Collect, clean, and validate large volumes of structured and unstructured data.

  • Track data versions, implement data quality checks, and ensure data reliability.

  • Design and optimize data storage in AWS S3, including raw, intermediate, and final datasets.

  • Implement data governance practices, including documentation, cataloging, lineage, and security.

  • Ensure compliance security standards.


Collaboration with Data Science & Stakeholders



  • Work closely with Data Scientists, Analysts, and stakeholders to understand data requirements.

  • Prepare clean, structured, and feature-ready datasets for analytics and machine learning.

  • Support feature engineering, aggregations, and transformations at scale.

  • Assist in deploying ML models to production, ensuring monitoring, versioning, and performance optimization.


APIs, Containers & CI/CD



  • Integrate with REST APIs.

  • Utilize Docker, Kubernetes, Git, and CI/CD pipelines to deploy and manage workflows.


Documentation & Communication



  • Document pipelines, data schemas, and transformations clearly.

  • Communicate technical concepts effectively with cross-functional teams.

  • Participate in code reviews and promote best practices across the team.


Required Qualifications:



  • 3–5 years + of professional experience in data engineering or related roles.

  • Strong collaboration skills to work effectively with Data Scientists, Analysts, and Engineering teams.

  • Ability to communicate complex technical concepts to non-technical stakeholders.

  • Detail-oriented, curious, and committed to data quality.

  • Capable of managing multiple priorities in a fast-paced environment.


Technical Skills



  • Python, SQL, and PySpark (highly desired) for data processing and pipeline development.

  • Elastic/OpenSearch for search and analytics solutions.

  • Experience with AWS cloud services and Linux environments.

  • Git for version control and collaborative development.

  • Understanding of machine learning workflows and MLOps concepts.


Working at Edgesource:

As an ISO 9001:2015 certified and CMMI Level 3 appraised small business, Edgesource specializes in providing a variety of technical solutions to include software development, database services, enterprise networking, data center virtualization, and management support. We are always seeking top-talent to join our team in helping to address the most critical technical challenges facing our nation.


At Edgesource, we understand that our employees are our greatest asset, and as such we offer a wide array of benefits to support the well-being of our staff to include:


- Flexible PTO Policy + 11 Paid Holidays -

- Flexible Work Schedules (Remote / Hybrid) -

- Medical / Dental / Vision / Flexible Spending Account (FSA) -

- 401k Plan with Match -

- Tuition & Professional Development Support -

- Commuter Benefits -

- Bonus & Employee Referral Programs -

- Career Growth Opportunities -


Disclaimer:


Edgesource Corporation is an affirmative action and equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. Edgesource is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, please contact our Recruiting Department by email at [email protected] or by phone at (703) 837-0550.

About Edgesource

Provide technology services and mission support to government agencies.

Year founded
1997
Employees
116
Organization type
Private
Latest investment
Raised $1.51M Debt Financing (2020)
Headquarters
US

Similar jobs

Data Engineer roles near Chantilly, Virginia
11h
Save
Mark Applied
Hide
Data Engineer
Washington, District of Columbia or Arlington
$93k-$176k/yr RemoteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
Experience with cloud ETL, data warehousing, Python, SQL, Spark, PySpark, Databricks, Palantir, Snowflake, orchestration, and data quality; must be a US citizen.
Databricks, Spark, AWS, Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Google Cloud Dataflow, Azure Data Factory, Google BigQuery, Snowflake, Python, SQL, PySpark, Palantir, ElasticSearch, NiFi, Docker, Kubernetes, Hadoop, ELK stack, Agile, Scrum
12h
Save
Mark Applied
Hide
Staff Data Engineer, Mission Data Products - Clearance Required
Fort Belvoir, Virginia, United States
$128k-$191k/yr OnsiteFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
8+ YOEBachelor’s degree or equivalent experience, 8+ years building production data systems, Python and SQL proficiency, enterprise data-platform experience, DoD customer experience, and active Secret clearance.
Python, SQL, Palantir Foundry, Army Vantage, CI/CD, PySpark, DevSecOps
12h
Save
Mark Applied
Hide
Staff Data Engineer, Mission Data Products - Clearance Required
Fort Belvoir, Virginia, United States
$128k-$191k/yr OnsiteFull Time
LMI
LMI: Provides management consulting and digital solutions to government agencies.
8+ YOEBachelor’s degree or equivalent experience, 8+ years building production data systems, Python and SQL expertise, enterprise data-platform experience, and active Secret clearance; U.S. government clearance eligibility required.
Python, SQL, Palantir Foundry, Army Vantage, CI/CD, PySpark, DevSecOps
13h
Save
Mark Applied
Hide
Data Engineer, Sr.
Reston, Virginia, United States
$145k-$225k/yr OnsiteFull Time
Chenega Corporation
Chenega Corporation: Provides professional government, defense, and facility support services.
8+ YOEBachelor’s degree or high school diploma/GED with additional experience; 8+ years relevant experience, including data migration; 5+ years RDBMS and SQL; 5+ years data analytics; active TS/SCI with CI Poly.
SQL, REST APIs, JSON, XML, AWS, Jenkins, Puppet, Chef, Ansible, AWS CloudFormation, Kubernetes, Docker, Agile, RDBMS
14h
Save
Mark Applied
Hide
Data Engineer
Washington, District of Columbia, United States
OnsiteFull Time
VIA
VIA: Provides secure decentralized identity and data privacy software solutions.
3+ YOEBachelor’s degree plus 3 years, associate degree plus 7 years, major certification plus 7 years, or 11 years’ specialized experience; Python, SQL, Spark, ML, data visualization, and secure cloud experience required.
Databricks, Docker, Terraform, Python, Spark, Amazon SageMaker, MLflow, Palantir MSS Workshop, Slate, SQL, PySpark, scikit-learn, TensorFlow, XGBoost, Palantir Foundry, MLOps, AWS, Microsoft Azure
16h
Save
Mark Applied
Hide
Slalom Flex (Project Based) - Data Engineer (Microsoft Fabric)
Atlanta or Austin or Baltimore or Boston or Charlotte or Chicago or Columbus or Dallas or Hartford or Kansas City or Los Angeles or Miami or New York or Philadelphia or Phoenix or Richmond or San Francisco or Seattle or St. Louis or Washington
$50-$70/hr RemoteContract
Slalom
Slalom: Provides business and technology consulting and software engineering services.
Experience with cloud data integration, ETL/ELT, migration, data modeling, Power BI, Microsoft Fabric, testing, validation, and agile collaboration with architects and stakeholders.
Microsoft Fabric, Data Factory, Lakehouse, Warehouse, Power BI, DAX
1d
Save
Mark Applied
Hide
Senior Data Engineer (Secret Cleared)
Arlington, Virginia, United States
$71k-$172k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
4+ YOEBachelor's degree in computer science, engineering, or related field; 4–8 years of data engineering experience; expertise in ETL/ELT, SQL, Python, data modeling, cloud platforms, distributed processing, orchestration, and CI/CD.
SQL, Python, Apache Spark, Databricks, Microsoft Azure Synapse, Microsoft Azure Data Factory, Tableau, Microsoft Power BI, CI/CD, ETL, ELT, Microsoft Azure
1d
Save
Mark Applied
Hide
Data Engineer
Atlanta or Chicago or Fairview Heights or Houston or Arlington
$89k-$148k/yr OnsiteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
5+ YOEBachelor's degree and 5 years of data engineering or software development experience. Requires U.S. citizenship or green card, ability to obtain Public Trust, Java, Python, SQL, PySpark, ETL, databases, Databricks, APIs, and CI/CD experience.
SQL, R, Python, Git, Docker, Kubernetes, Java, PySpark, RESTful, SOAP, Co-Pilot, CodeX, MySQL, PostgreSQL, SQL Server, MongoDB, Databricks, GitHub, Jira, Confluence, Kibana, Tableau, Spring Boot