DRW
Posted 2mo ago

Equities Data Engineer

DRW
Chicago or New York City
$175k-$200k/yrOnsiteFull Time
Responsibilities
  • onboarding data
  • building pipelines
  • ensuring quality
Requirements
  • 5+ years designing ingestion pipelines for batch and real-time market data
  • Experience with equities/futures data
  • Data quality frameworks
  • Observability
  • On-prem Linux and cloud
  • CI/CD and MLOps
  • Parquet/Iceberg familiarity
Technical tools mentioned
ParquetIcebergLinuxCI/CDMLOps

Job description

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.

We are seeking an Equities Data Engineer to join the MASS (Multi-asset Systematic Strategies) trading team. In this role, you will be responsible for onboarding, transforming, and managing diverse financial datasets. You will collaborate closely with traders, researchers, and quantitative developers to analyze equity and futures data, identify alphas, and develop global delta-one trading strategies.

Key Responsibilities:

  • Partner with traders, researchers, and analysts to deliver well-structured data that powers trading strategies, predictive models, and AI/ML applications.
  • Build, automate, and maintain resilient pipelines for cleaning, validating, and transforming batch and streaming data that feed into medallion architectures.
  • Develop observability, monitoring, and alerting tools to provide complete visibility into pipeline reliability and performance.
  • Optimize tiered data storage and elastic processing across on-prem, cloud, and hybrid environments to ensure scalable and cost-effective solutions.
  • Enforce data governance, controls, and security standards to preserve confidentiality and operational integrity.
  • Implement data quality frameworks (validation, reconciliation, anomaly detection) to detect gaps, staleness, and corporate action/market data inconsistencies.
  • Maintain point-in-time correctness across datasets used for research and live trading; ensure reproducibility of signals and backtests.
  • Collaborate with platform/infrastructure teams to productionize pipelines, improve runtime efficiency, and meet latency and availability requirements.

Qualifications:

  • Over five years of demonstrated experience designing ingestion pipelines.
  • Familiarity with equities, equity indices, futures, or delta one trading data preferred.
  • Experience processing real-time and batch financial market data.
  • Proven ability to work in an agile, fast-paced environment and handle trading environment demands.
  • Strong understanding of financial point-in-time and time-series data and analysis.
  • Proven expertise in developing data quality control processes to detect gaps or inaccuracies.
  • Experience with monitoring, observability, and alerting systems for data pipelines.
  • Competent in both on-premise Linux systems and cloud platforms.
  • Proficient in automated testing, CI/CD practices, and MLOps.
  • Well-versed in compressed and optimized file formats such as Parquet and Iceberg.

The annual base salary range for this position is $175,000 to $200,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.

For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.

California residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.

#LI-GV1

About DRW

Global proprietary trading firm investing across diverse asset classes.

Similar jobs

Data Engineer roles near Chicago, Illinois
1d
Save
Mark Applied
Hide
Senior Lead Data Engineer
Chicago, Illinois, United States
$128k-$209k/yr OnsiteFull Time
Caterpillar Inc.
Caterpillar Inc.NYSE: CAT: Global manufacturer of construction and mining equipment and engines.
Strong software development and SDLC expertise; Python application development, OOP, Git, CI/CD, AWS, Snowflake, software architecture, testing, and AI coding assistant experience.
Python, Git, Jenkins, GitHub Actions, Azure DevOps, AWS Lambda, Amazon Kinesis, Amazon EventBridge, Amazon CloudWatch, AWS CloudFormation, Amazon DynamoDB, AWS Fargate, Amazon S3, Amazon SageMaker, AWS IAM, Amazon RDS, Snowflake, GitHub Copilot, Claude Code
2d
Save
Mark Applied
Hide
Senior Lead Data Engineer
Chicago, Illinois, United States
$128k-$209k/yr OnsiteFull Time
Caterpillar Inc.
Caterpillar Inc.NYSE: CAT: Global manufacturer of construction and mining equipment and engines.
Strong software development and SDLC expertise; Python application development; Git; CI/CD deployment; AWS; Snowflake; software testing; and experience with AI coding assistants.
Python, Git, Jenkins, GitHub Actions, Azure DevOps, AWS Lambda, Amazon Kinesis, Amazon EventBridge, Amazon CloudWatch, AWS CloudFormation, Amazon DynamoDB, AWS Fargate, Amazon S3, Amazon SageMaker, AWS IAM, Amazon RDS, Snowflake, GitHub Copilot, Claude Code
2d
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or Lake Forest
$113k-$188k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Broad line distributor of maintenance, repair, and operating products.
3+ YOERequires 3+ years in data engineering and pipeline orchestration, 5+ years preparing structured and unstructured data, and 4+ years with Docker/Kubernetes. Requires Databricks, Snowflake, Python or Scala, Spark, CI/CD, and cloud experience.
Kubernetes, Databricks, Snowflake, Spark, Python, Scala, Databricks Workflows, Lakeflow Jobs, Apache Airflow, Luigi, Delta Lake, Unity Catalog, Databricks Runtime, Claude, Claude CLI, GitHub Copilot, Cortex Analyst, Cortex Search, Cortex Agents, Cortex Code, Snowflake CoCo, Cortex Sense, AISQL, Docker, Bash, Unix, Windows shell, Jenkins, GitHub Actions, GitLab CI/CD, AWS, AWS Glue, Athena, Lambda, Amazon S3, DynamoDB
2d
Save
Mark Applied
Hide
Data Engineer
United States or Chicago or New York City or Columbus
RemoteFull Time
Independence Pet Holdings
Independence Pet Holdings: Private U.S. pet health holding serving pet parents through insurance, education, and lost-pet recovery services.
3+ YOERequires 3+ years building cloud data platforms and pipelines, strong SQL and Python, large-scale data experience, AWS, modern data stack tools, CI/CD, Git, and infrastructure-as-code.
dbt, Databricks, AWS, Snowflake, CI/CD, Git, SQL, Python, Airflow, Fivetran, Kafka, Kinesis, Segment, Stripe, Salesforce, mParticle, GDPR, CCPA
3d
Save
Mark Applied
Hide
Sr. Data Engineer - Hybrid
Charlotte or Chicago or Columbus or Hartford
$117k-$176k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provider of property and casualty insurance and employee benefits.
7+ YOEBachelor's degree or 7+ years relevant IT experience; 7+ years ETL/data integration, 2+ years Oracle PL/SQL, complex SQL, data modeling, data warehousing, analytical skills, and experience mentoring Data Engineers.
SQL, Oracle PL/SQL, AWS Snowflake, Python, GitHub, Jenkins, Nexus, uDeploy, AWS, Snowflake, DevOps, CI/CD
3d
Save
Mark Applied
Hide
IT Data Engineer III
Lombard, Illinois, United States
$115k-$140k/yr RemoteFull Time
Paradigm
Paradigm: Privately held specialty care management organization serving injured workers and healthcare payers with complex injuries and diagnoses.
5+ YOEBachelor’s degree required with 5+ years of data engineering experience. Requires SQL, ETL/ELT, cloud data platforms, BI tools, source control, data modeling, and programming or scripting proficiency.
Microsoft Power BI, Microsoft Fabric, SQL Server, Azure Data Factory, SSIS, Microsoft Azure DevOps, AWS Pipelines, DB2, Oracle, Python, PowerShell, DAX/MDX, Spark, Kafka, SQL Server Management Studio, Visual Studio, Microsoft Excel, Microsoft Word, Microsoft PowerPoint, Microsoft Outlook, Microsoft SharePoint, Microsoft Teams, Microsoft Visio, Git, Azure, AWS, GCP
4d
Save
Mark Applied
Hide
Senior Data Engineer (Data Architecture)
United States or Los Angeles or Chicago or New York City
$105k-$135k/yr RemoteFull Time
Wpromote
Wpromote: Full-funnel digital marketing agency serving brands through media, creative, data, strategy, and marketing technology.
5+ YOERequires 5+ years in data engineering or related work, advanced SQL and BigQuery, Python, dbt, data architecture, warehousing, testing, orchestration, and software engineering. Bachelor's degree or equivalent experience required.
BigQuery, dbt, Python, Airflow, Dagster, AWS Glue, Azure Data Factory, Git, Claude Code, OpenAI Codex, OpenCode, Cursor, GitHub Copilot, Google Ads, Meta, The Trade Desk, Amazon Ads, Google Analytics, Adobe Analytics, SQL, CI/CD
4d
Save
Mark Applied
Hide
Data Engineer
Oak Brook, Illinois, United States
$107k-$143k/yr OnsiteFull Time
The Joint Commission
The Joint Commission: Independent nonprofit healthcare accreditor and certifier helping healthcare organizations improve quality and patient safety.
5+ YOEBachelor’s degree in a relevant field and 5–7 years of data engineering, ETL/ELT, or cloud data platform experience. Requires Azure Data Factory, Databricks, Microsoft Fabric, MSSQL, SQL, and Python.
Azure Data Factory, Databricks, Foundry, Microsoft Fabric, MSSQL, SQL, Python, GDPR, HIPAA