SoftwareOne
Posted 3mo ago

Data Engineer

SoftwareOne
United States
HybridFull Time
Responsibilities
  • building pipelines
  • designing systems
  • ensuring quality
Requirements
  • Strong data engineer with distributed systems experience
  • Databricks, Azure Data Factory, Python, SQL, Terraform
  • Scalable pipelines
  • Focus on data quality and observability
Technical tools mentioned
DatabricksAzure Data FactoryPythonSQLTerraformREST APIs

Job description

Why SoftwareOne?

 

SoftwareOne and Crayon have come together to form a global, AI-powered software and cloud solutions provider with a bold vision for the future. With a footprint in over 70 countries and a diverse team of 13,000+ professionals, we offer unparalleled opportunities for talent to grow, make an impact, and shape the future of technology. At the heart of our business is our people. We empower our teams to work across borders, innovate fearlessly, and continuously develop their skills through world-class learning and development programs. Whether you're passionate about cloud, software, data, AI, or building meaningful client relationships, you’ll find a place to thrive here. Join us and be part of a purpose-driven culture where your ideas matter, your growth is supported, and your career can go global. 


The role

We are looking for a Data Engineer to build and maintain scalable data pipelines and ingestion frameworks using a mix of open-source and custom-built tooling. 

 

You will design and operate reliable data systems that ingest, validate, and process data from APIs, databases, and event streams—ensuring high data quality, performance, and availability. 

 

Key Responsibilities 

Build and maintain scalable data pipelines and ingestion frameworks 

Design robust data fetching systems for APIs, databases, and streaming sources 

Ensure data quality, validation, and consistency across all pipelines 

Optimize systems for performance, scalability, and cost efficiency 

Implement observability, monitoring, and fault-tolerant architectures 

Manage batch and real-time data processing workflows 

Collaborate with platform, analytics, and product teams to deliver trusted datasets 

Contribute to data architecture, standards, and best practices 

 

Core Skills & Experience 

Strong experience in data engineering and distributed systems 

Proficiency in Databricks, Azure Data Factory, Python, SQL, Terraform, REST APIs.  

Experience with data pipeline tools  

Hands-on with streaming technologies  

Experience with cloud platforms  

Knowledge of data storage systems 

Understanding of data modeling, partitioning, and indexing strategies 

Experience with API integrations and event-driven architectures 

Familiarity with CI/CD and Infrastructure as Code 

 


What we need to see from you

 

Strong understanding of data consistency, reliability, and fault tolerance 

Experience building production-grade, scalable data systems 

Ability to work across teams and translate business needs into data solutions 

Focus on data quality, observability, and performance optimization 

 

Why Join Our Team 

Our job is to take cloud and operational data and turn it into platforms that generate revenue and save customers money. 

What does that look like day to day? 

CCC (Cloud Cost Control), covers Azure, AWS, GCP, and M365 for a large and growing enterprise customer base. You're not building a report for one stakeholder you're building infrastructure that runs FinOps across a multi-tenant production environment at real scale. 

The data problems are genuinely interesting. We ingest billing data from multiple cloud providers, normalize it, run anomaly detection, and pipe it into a web application. Getting that right consistently, at scale, across providers with different APIs and schemas is harder than it sounds. 

The stack is modern and the ownership is real. Databricks, Azure Data Factory, Python, SQL, Terraform, REST APIs. You won't just be closing tickets you'll have a say in how things are built. 


Job Function

Services
Accommodations

SoftwareOne welcomes applicants from all backgrounds and abilities to apply. If you require reasonable adjustments at any point during the recruitment process, email us at [email protected].   
Please include the role for which you are applying and your country location. Someone from our organization that is not part of the decision-making process will be in touch to discuss your specific needs and we will make every effort to accommodate you. Any information shared will be stored securely and treated in the strictest of confidence in line with GDPR.  
  
At SoftwareOne, we are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants and teammates without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.  Additionally, we encourage experienced individuals that have taken an intentional career break and are now prepared to return to work to explore our SOAR program. 

About SoftwareOne

Global provider of end-to-end software and cloud technology solutions.

Similar jobs

Data Engineer roles
45m
Save
Mark Applied
Hide
Data Engineer III
Springfield, Massachusetts, United States
$99k-$130k/yr HybridFull Time
Farm Credit Financial Partners
Farm Credit Financial Partners: Provider of technology products and services to Farm Credit.
5+ YOEBachelor's degree in computer science or MIS; 5+ years in data modeling and cloud technologies; Azure stack experience with Databricks, Data Factory, SQL, Python, and Power BI; Agile and Waterfall experience.
Azure, Databricks, Data Factory, SQL, Python, Power BI, Microsoft Office Suite, Agile, Waterfall, ChatGPT, Claude, Windsurf, Perplexity AI, Grok, Gemini
46m
Save
Mark Applied
Hide
Data Engineer
Knoxville, Tennessee, United States
OnsiteFull Time
American Bureau of Shipping
American Bureau of Shipping: Develops and verifies safety standards for the maritime industry
5+ YOEBachelor's degree or equivalent experience; 5+ years building cloud data pipelines; experience with lakehouse or data warehouse architecture, AI/ML workloads, governance, Python, SQL, Spark, Docker, and Kubernetes.
AWS, Azure, Google Cloud, Databricks, Snowflake, Redshift, Python, SQL, Spark, Docker, Kubernetes
9h
Save
Mark Applied
Hide
Data Engineer
Miami, Florida, United States
OnsiteFull Time
Base-2 Solutions
Base-2 Solutions: Delivers engineering and technology services for national security.
5+ YOEBachelor's degree in computer science, data engineering, or related field, or 5 years equivalent experience; full-stack data applications, APIs, Kubernetes, CI/CD, databases, and geospatial platforms required.
Databricks, Kubernetes, ESRI ArcGIS, Unity Catalog, RESTful, GraphQL, AWS Certified Data Analytics - Specialty, Microsoft Azure Data Engineer Associate, Microsoft Azure, CI/CD
16h
Save
Mark Applied
Hide
Database Administrator
Windsor Mill, Maryland, United States
$63k-$92k/yr RemoteFull Time
RELI Group
RELI Group: Provides professional IT and management services to government agencies.
Experience designing ETL/ELT pipelines and data lakehouse architectures using Python, SQL, PySpark, AWS, Databricks, and Delta Lake; collaboration, data governance, and CI/CD experience required.
Python, SQL, PySpark, AWS, Databricks, Delta Lake, GitHub, Databricks Repos, CI/CD
1d
Save
Mark Applied
Hide
Senior Data Engineer, Databricks
Denver, Colorado, United States
$119k-$146k/yr OnsiteFull Time
Bouygues
BouyguesEuronext Paris: EN: Diversified industrial group focused on construction, energy, and telecommunications.
8+ YOEBachelor's degree or equivalent experience; 8+ years in data engineering, warehousing, and BI; 5+ years building Databricks/Spark platforms; expertise in Python, SQL, modeling, governance, Azure, migration, and CI/CD.
Databricks, Databricks SQL, Apache Spark, PySpark, Spark SQL, Delta Live Tables, Unity Catalog, Databricks Workflows, Delta Lake, Databricks Asset Bundles, Power BI, Microsoft SQL Server, T-SQL, Azure Synapse, Azure Data Factory, Qlik Replicate, Git, Azure DevOps, GitHub Actions, Microsoft Fabric, OneLake, ADLS Gen2, Key Vault, Entra ID, Terraform, SSIS, SSRS, Databricks Genie Agents, Photon, Auto Loader, Structured Streaming, MERGE, OPTIMIZE, Z-ORDER, VACUUM, Direct Lake, DirectQuery, JD Edwards, BMS, CMS, Cority, HCSS, Intelex, Anaplan, Datavail, Birlasoft
2d
Save
Mark Applied
Hide
Data Engineer
Dearborn, Michigan, United States
OnsiteFull Time
Ford Motor Company
Ford Motor CompanyNYSE: F: Designs, manufactures, and sells cars, trucks, and SUVs.
5+ YOEBachelor's degree or equivalent; 5+ years Python, 4+ years automotive AI/ML, and experience with data pipelines, databases, APIs, cloud platforms, agentic AI, and machine learning operations.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Vertex AI, JavaScript, TypeScript, React, HTML, Next.js, Node.js, Python, Go, SQL, NoSQL, REST, GraphQL, Flask, FastAPI, LangChain, LangGraph, Google Agent Development Kit (ADK), Model Context Protocol (MCP), Pandas, PyTorch, TensorFlow, Keras, Hugging Face, Docker, Kubernetes, Terraform, RAGEval
2d
Save
Mark Applied
Hide
Data Engineer
Dearborn, Michigan, United States
$100k-$163k/yr HybridFull Time
Ford Motor Company
Ford Motor CompanyNYSE: F: Ford manufactures, sells, and services vehicles and mobility solutions.
4+ YOEMaster's degree and 4 years of experience, or bachelor's degree with 6+ years; 4 years in data engineering, 3 years in cloud data engineering, and proficiency in at least three named programming languages and cloud data technologies.
Java, Python, Spark, Scala, SQL, Amazon Redshift, Microsoft Azure Synapse Analytics, Google BigQuery, Airflow, Cloud Run, MySQL, PostgreSQL, SQL Server, Apache Kafka, GCP Pub/Sub, Tekton, GitHub Actions, Git, GitHub, Terraform, Docker, Atlassian JIRA, Google Cloud Platform (GCP), Amazon Web Services (AWS), Vertex AI, SonarQube, Checkmarx, Fossa, Cycode, Test Driven Development (TDD), CI/CD, REST APIs, MLOps
2d
Save
Mark Applied
Hide
Business Intelligence - Data Engineer 133-2015
Tulsa, Oklahoma, United States
OnsiteFull Time
CommunityCare
CommunityCare: Provides community-based health insurance and managed care services in Oklahoma.
College degree or equivalent experience; data pipeline, ETL and SSIS experience; process improvement, project management, organization, independence and multitasking skills.
SSIS, ETL