Principal Software Engineer - Microsoft Corporation

We need an experienced **Principal Software Engineer** with a passion for building large scale distributed systems to enable more innovations on the search, recommendation, and AI services and products. We look for passions in designing and developing cutting-edge techniques such as LLM, Ranking, Index Serving in large scale like 100K+ nodes by collaborating with ML/AI data scientists. Bing Fundamentals focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world's largest distributed systems and have experienced great success in building efficient large scale distributed systems for search. Now, the team has a per decade rare opportunity to simplify the serving stack, to serve the biggest index in the most efficient way, and to drive up the relevance innovations with advanced deep learning and Large Language model techniques. The agility of engineering and deployment also presents as a big challenge when handling such a complex system. As Bing embraces the newest LLM innovations, the need for IndexServe to build up AI intelligence is becoming bigger. Within Bing Fundamentals, we are the IndexServe team, and we have the exciting responsibility of trying to tackle these challenges. As a team, we are trying to build the most agile, performant, stable, experientable yet efficient index serving platform. On this platform, relevance techniques can be quickly implemented, iterated, qualified and flighted to evaluate their customer impacts with convenience while full-funnel debuggability. The same platform also provides all the cutting edged techniques and utilities, like deep learning, machine learning, LLM, C# rankers. It has the most advanced AI toolset for our scientists to innovate, and for our products to serve the most relevant documents. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. **Responsibilities** + Perform engineering work on large scale backend service, specifically on the index serving projects. + Excel and adopt agile service development. + Design innovative algorithms with best performance, latency, scalability, and efficiency. + Profile service performance for analysis and service scaling-up. + Collaborate across multiple teams to design and deliver the solutions. **Qualifications** **Required Qualifications:** + Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python + OR equivalent experience. + Experience on high performance computing (e.g. cache/memory optimization, fine-grained parallel library and runtime). + Familiar with structured query language, tokenization and text parsing, schema definition and validation tool chain. **Other Requirements:** Candidates must be able to meet Microsoft, customer and/or government security screening requirements that are required for this role. These requirements include, but are not limited to the following specialized security screenings: + **Microsoft Cloud Background Check:** This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. **Preferred Qualifications:** + Capable of quantitatively implementing and qualifying a solution in a distributed environment with DevOps model. + Experience on building Machine Learning/Deep Learning systems. + Experience in performance analysis and optimization for both CPUs and GPUs, as well as an understanding of software-hardware codesign. Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay Microsoft will accept applications for the role until December 18, 2024 \#MAI Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .