Principal Data Engineering Tech Lead - Microsoft Corporation

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft's mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers' heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. The Microsoft Identity security team is on a mission to protect our users from account compromise and fraud. Our data science team is at the core of this mission, creating and improving the machine learning based detections that are used to find and block the malicious actors from harming our systems and customers. We are looking for a **Principal Data Engineering Tech Lead** to join our growing team of data scientists and machine learning engineers. You will contribute to designing the next-gen cloud-based ML and data infrastructure that support a full-stack Data Science team. You will be responsible for creating, maintaining, and optimizing the data sets and data pipelines used by our cross-functional Data Science team. You will also partner with the data scientists and analysts to define business metrics and build dashboards to monitor our protections systems and detections and guide our product planning. Do you love big data and the challenges it entails? Do you like the idea of applying your technical skills to protect millions of Microsoft customers from malicious actors? Do you want be part of team of smart, talented and mission driven people? Then this job is for you! Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. **Responsibilities** + Design, develop, maintain, and oversee data infrastructure, data warehouse and back-end services for ML experimentation, investigations, reporting, data collection, and related functions. + Ensure the quality control of data pipelines and promote best data engineering practices. + Create and manage reports and dashboards to monitor KPIs, the identity attack ecosystem, and other indicators crucial for understanding the threat landscape and assessing the accuracy and performance of our detections. + Collaborate with the team to address business inquiries using telemetry data. Effectively communicate key insights and results to stakeholders and leadership. Utilize data storytelling and visualization techniques to recommend product decisions. + Embody our Culture (https://www.microsoft.com/en-us/about/corporate-values) and Values (https://careers.microsoft.com/us/en/culture) **Qualifications** **Required/Minimum Qualifications** **:** + Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work + OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, or data engineering work + OR equivalent experience. + Experience as tech lead/architect role in data engineering support data science team + Experience in developing tools and data pipelines using Apache Spark and Python or similar tools. + Experience in building and optimizing "big data" workflows using modern cloud-based platforms, including ETL, business intelligence pipelines, and data visualization tools like Power BI. **Other Requirements:** + Background Check: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: + Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. + Citizenship Verification: This position requires verification of citizenship due to citizenship-based legal restrictions. Specifically, this position supports United States federal, state, and/or local United States government agency customers and is subject to certain citizenship-based restrictions where required or permitted by applicable law. To meet this legal requirement, and as a condition of employment, the successful candidate's citizenship will be verified with a valid passport. **Preferred Qualifications** **:** + Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 12+ years experience in business analytics, data science, software development, data modeling or data engineering work + OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years of business analytics, data science, software development, data modeling or data engineering work experience + OR equivalent experience. + Experience with one of the major cloud-based data platforms. + Familiarity with relational databases and working knowledge of a variety of big data sources in Spark, Scala, and/or other big data systems. + Experience in designing/implementing large-scale data infrastructure to support a Data Science team. + Demonstrated proficiency in writing complex, highly optimized queries across diverse data sets and implementing data science applications in Python using cloud-based tools. + Understands principals of data modeling. Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $133,600 - $256,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $173,200 - $282,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: US corporate pay information | Microsoft Careers (https://careers.microsoft.com/v2/global/en/us-corporate-pay.html) Microsoft will accept applications for the role until May 9, 2024. \#MSFTSecurity, #IdentityJobs Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .