This job has expired

This job posting is no longer active and is not accepting applications. Explore similar roles below!

Microsoft
Posted 2w ago

Principle Data Engineer

Microsoft
United States
$143k-$275k/yrRemoteFull Time
Responsibilities
  • architecting AI platforms
  • building data systems
  • leading engineering
Requirements
  • Advanced data and AI engineering expertise
  • 5+ years in Azure data environments
  • Programming experience, and experience with generative AI, LLM, RAG
  • Semantic search
  • Vector databases, and agentic AI
Technical tools mentioned
Microsoft FabricAzure AI FoundryAzure Data PlatformSynapse AnalyticsAzure App ServicePythonC#JavaScalaGenerative AILarge Language Models (LLM)Retrieval-Augmented Generation (RAG)semantic searchvector databaseCopilotsMLOpsLLMOpsSRE

Job description

Overview

MCAPS-Core accelerates customer outcomes and business growth. By uniting product, engineering, marketing, sales, customer success, and partners around a common customer mission, we help customers realize value faster and turn innovation into measurable business impact. Through deep technical expertise and differentiated go-to-market execution, we win competitively, capture market share, and scale repeatable growth motions. We differentiate through value creation - delivering world-class, AI-powered customer experiences that accelerate adoption, strengthen loyalty, and create sustainable competitive advantage, driving growth that outpaces the market.

 

MCAPS-Core Data & Applied AI (DAAI) is a centralized data and AI organization driving Microsoft's transformation through enterprise data platforms, advanced analytics, AI-powered solutions, automation, and governance. Our mission is to turn data into intelligence and intelligence into action, empowering teams across Microsoft to accelerate decision-making, increase productivity, and deliver exceptional customer outcomes through innovative customer-zero solutions.

 

MCAPS-Core DAAI is seeking a Principal Data Engineer to build the AI-powered platforms, intelligent agents, and data foundations that fuel Microsoft's transformation. This role combines deep software engineering, data engineering, and AI expertise to deliver scalable solutions powered by generative AI, LLMs, agentic workflows, and enterprise data platforms. The ideal candidate is a hands-on technical leader who thrives on solving complex engineering challenges and building intelligent systems that translate data into actionable business impact.

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.



Responsibilities
  • Lead end-to-end development of cloud-native applications, APIs, and platform services, applying full-stack engineering principles across frontend, backend, integration, security, observability, testing, and continuous delivery disciplines.
  • Architect and deliver next-generation AI platforms, copilots, agentic systems, and intelligent applications powered by Generative AI, Large Language Models (LLMs), and advanced reasoning capabilities.
  • Design and build AI-ready data platforms and knowledge systems, scalable AI services, APIs, and orchestration frameworks that power autonomous agents, intelligent automation, and enterprise-scale workflows.
  • Drive the technical strategy and architecture for Applied AI solutions, partnering across engineering, data science, product, and business teams to accelerate AI innovation and adoption.
  • Create reusable AI frameworks, SDKs, and platform services that improve developer productivity, model performance, scalability, governance, and reliability.
  • Establish best practices for Responsible AI, AI governance, model evaluation, security, compliance, observability, and operational excellence.
  • Provide hands-on technical leadership through architecture reviews, code reviews, mentoring, and direct contribution to software, data, and AI solutions.
  • Partner with business and technology leaders to identify and deliver transformational AI opportunities that enhance productivity, decision-making, and customer experiences.
  • Champion customer-zero innovation by turning emerging AI technologies into scalable platforms, reusable services, and enterprise-wide solutions.


Qualifications

Required/minimum qualifications

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR equivalent experience.
  • 5+ years of demonstrated experience working in data-intensive Azure environments and translating business requirements into scalable data and AI solutions. Deep expertise with Microsoft technologies, including Microsoft Fabric, Azure AI Foundry, Azure Data Platform, Synapse Analytics, Azure App Service.
  • Hands-on experience developing solutions using Python and/or other modern programming languages such as C#, Java, Scala, or equivalent.
  • Proven experience designing and implementing Generative AI, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), semantic search, vector database, and agentic AI solutions.

 

Additional or preferred qualifications

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 12+ years experience in business analytics, data science, software development, data modeling, or data engineering
    • OR equivalent experience.
  • Experience building and deploying Copilots, intelligent agents, multi-agent systems, and enterprise AI applications.
  • Expertise in AI platform engineering, LLM orchestration, knowledge graphs, prompt engineering, model tuning, and AI evaluation frameworks.
  • Expertise in developing and operating cloud-scale services using modern software engineering and SRE practices, with a focus on reliability, observability, automation, and service excellence.
  • Experience with MLOps, LLMOps, AI observability, model governance, and production AI operations.
  • Proven success leading enterprise-scale cloud, data, analytics, and AI transformation initiatives.
  • Demonstrated ability to mentor engineers, foster innovation, and elevate engineering excellence across large, complex organizations.
  • Strong technical leadership skills with a track record of driving architecture decisions, engineering strategy, and cross-functional execution.

 

Ability to meet Microsoft, customer and / or government security screening requirements are required for this role.  These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire / transfer and every two years thereafter.



Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

About Microsoft

Develops software, services, devices, and cloud computing solutions.

Similar jobs

Data Engineer roles
8h
Save
Mark Applied
Hide
Data Engineer
Miami, Florida, United States
OnsiteFull Time
Base-2 Solutions
Base-2 Solutions: Federal technology provider supporting national security and intelligence missions.
5+ YOEBachelor's degree in computer science, data engineering, or related field, or 5 years equivalent experience. Requires full-stack data engineering, APIs, Kubernetes, GIS, cloud databases, CI/CD, and Top Secret/SCI clearance.
Databricks, Kubernetes, ESRI ArcGIS, Unity Catalog, AWS, Microsoft Azure, RESTful, GraphQL, CI/CD
9h
Save
Mark Applied
Hide
Data Engineer (Police)
Fayette County, Kentucky, United States
$69k/yr OnsiteFull Time
Lexington-Fayette Urban County Government
Lexington-Fayette Urban County Government: Kentucky’s merged urban-county government providing municipal and county services to Lexington-Fayette County residents.
2+ YOEBachelor's degree in computer science, information technology, software engineering, or related field, plus two years of related experience with technologies such as TSQL, C#, PHP, or VBA.
Microsoft Access, Microsoft SQL Server 2022, TSQL, C#, PHP, VBA
1d
Save
Mark Applied
Hide
Data Engineer III
United States or Bismarck or Fargo or California
$94k-$102k/yr RemoteFull Time
North Dakota Information Technology
North Dakota Information Technology: The official government and administrative body of North Dakota.
3+ YOEBachelor's degree in a related computing field and 3+ years of data engineering or software development experience designing, implementing, and supporting complex data solutions.
Agile
1d
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
EXL Service
EXL ServiceNASDAQ: EXLS: Global data analytics, AI, and digital operations solutions.
3+ YOERequires 3–5 years in data engineering, analytics engineering, ETL development, or related work; strong SQL, ETL operations, production support, incident management, database tuning, and stakeholder communication skills.
SQL, SQL Server, Python, R
1d
Save
Mark Applied
Hide
Senior Data Engineer
United States or Canada or Atlanta
$180k-$200k/yr RemoteFull Time
Granum
Granum: Software serving North American landscapers and arborists with management, payments, and workforce-training platforms.
5+ YOEStrong Snowflake, dbt, Terraform, SQL, CI/CD, data governance, semantic modeling, monitoring, troubleshooting, and production data platform experience; clear communication and end-to-end ownership required.
Snowflake, dbt, Fivetran, Terraform, Omni, LookML, dbt Semantic Layer, GitHub, Azure Data Factory, Airflow, SQL
2d
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Bellevue or Arlington or San Francisco
$132k-$206k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Multinational technology focused on e-commerce and cloud computing.
3+ YOE3+ years of data engineering experience, programming in Python, Java, Scala, or NodeJS, data modeling, warehousing, ETL, AWS, and non-relational database experience required.
AWS, AWS Glue, EMR, Lambda, Redshift, S3, Kinesis, Firehose, IAM, Python, Java, Scala, NodeJS, Hadoop, Hive, Spark
2d
Save
Mark Applied
Hide
Data Engineer, Growth
San Francisco or Seattle
$190k-$240k/yr HybridFull Time
Superhuman
Superhuman: Private AI productivity platform for people and teams, combining writing, collaborative docs, email, and proactive AI agents.
3+ YOERequires 3+ years building production data pipelines, proficiency in SQL, Python, Spark, and modern data platforms, plus experience with machine learning workflows, data modeling, orchestration, CI/CD, and data quality.
Spark, Databricks, Google, Meta, LinkedIn, SQL, Python, Delta Lake, dbt, Snowflake, Databricks Workflows, Airflow, Git, Claude Code, Codex, Google Ads
2d
Save
Mark Applied
Hide
Staff Data Engineer
Berkeley, California, United States
$148k-$185k/yr OnsiteFull Time
Form Energy
Form Energy: Developing cost-effective, multi-day iron-air battery storage technology.
7+ YOEBachelor's degree in a relevant technical field and 7+ years of data or software engineering experience. Requires production programming, pipelines, streaming systems, orchestration, AWS, and infrastructure-as-code expertise.
Python, Scala, Java, Go, Apache Spark, PySpark, dbt, Apache Iceberg, Delta Lake, Kafka, Kinesis, Dagster, Prefect, Airflow, AWS, Pulumi, Terraform, Databricks, Snowflake, MQTT, Modbus, OPC-UA, InfluxDB, TimescaleDB, ClickHouse, Druid, REST APIs, webhooks
This job has expired