Microsoft
Principal Data Engineer
Microsoft, Redmond, Washington, United States, 98052
Microsoft Teams is core to Microsoft's vision for intelligent communications and productivity panes into modern workplace. As the hub for teamwork in Office 365, Microsoft Teams continue to build momentum across collaboration, chat, meetings, and calls, with over 320M monthly active users.
We are looking for a Principal Data Engineer as part of Teams data engineering team in Redmond. You will grow your skills by working on highly scalable systems and latest technologies, processing petabyte scale data daily with the latest big data tools like Microsoft Fabric, Azure Data Lake and Azure Data Explorer. You will collaborate closely with data science to derive actionable insights and influence our product and growth strategy.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
You will build advanced code to extract raw data, coach the team on techniques to validate its quality, and ensure the correct data is ingested across the pipeline. You’ll also provide expertise on techniques to transform raw data into forms compatible with downstream data sources.
Using your technical experience, you’ll improve data tools used to transform, manage, and access data across the organization. You’ll also write code to optimize storage and availability of data platforms so that they’re more resilient.
You will improve performance monitoring protocols across the project, building automation into data visualizations and aggregations to address pipeline health patterns. You’ll also implement robust solutions and self-healing processes that prevent recurring points of failure across products.
You will interpret laws and develop procedures that ensure compliance with all applicable laws and policies across the entire pipeline. You’ll also govern data accessibility across multiple data pipelines and/or models.
Embody our culture and values.
Qualifications
Required Qualifications:
Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work
OR equivalent experience.
5+ years of big data experience with any of the big processing tools such as Apache Spark, Snowflake, Hadoop etc.
Experience in processing of Tera Bytes to Peta byte scale of data.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check:
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
Experience in any of the following languages or equivalent language: Scala, Pyspark, C#, Java, Python, Rust.
Experience with Azure cloud.
Experience in other big data technologies.
Data driven, customer focused, and organized.
Experience operationalizing and supporting services.
Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications for the role until November 15, 2024.
#J-18808-Ljbffr
We are looking for a Principal Data Engineer as part of Teams data engineering team in Redmond. You will grow your skills by working on highly scalable systems and latest technologies, processing petabyte scale data daily with the latest big data tools like Microsoft Fabric, Azure Data Lake and Azure Data Explorer. You will collaborate closely with data science to derive actionable insights and influence our product and growth strategy.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
You will build advanced code to extract raw data, coach the team on techniques to validate its quality, and ensure the correct data is ingested across the pipeline. You’ll also provide expertise on techniques to transform raw data into forms compatible with downstream data sources.
Using your technical experience, you’ll improve data tools used to transform, manage, and access data across the organization. You’ll also write code to optimize storage and availability of data platforms so that they’re more resilient.
You will improve performance monitoring protocols across the project, building automation into data visualizations and aggregations to address pipeline health patterns. You’ll also implement robust solutions and self-healing processes that prevent recurring points of failure across products.
You will interpret laws and develop procedures that ensure compliance with all applicable laws and policies across the entire pipeline. You’ll also govern data accessibility across multiple data pipelines and/or models.
Embody our culture and values.
Qualifications
Required Qualifications:
Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work
OR equivalent experience.
5+ years of big data experience with any of the big processing tools such as Apache Spark, Snowflake, Hadoop etc.
Experience in processing of Tera Bytes to Peta byte scale of data.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check:
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
Experience in any of the following languages or equivalent language: Scala, Pyspark, C#, Java, Python, Rust.
Experience with Azure cloud.
Experience in other big data technologies.
Data driven, customer focused, and organized.
Experience operationalizing and supporting services.
Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications for the role until November 15, 2024.
#J-18808-Ljbffr