Are you passionate about cutting edge Generative Artificial Intelligence (AI), Large Language Models (LLM) and Small Language Models (SLM)? Do you love working with an energetic and cross-functional group of people? Does pioneering innovative ways to understand and interact with LLMs sound exciting to you? Are you passionate about training state of the art deep learning models, working with the latest large language models and incorporating the latest research techniques? Do you want to contribute to an effort that defines the way developers interact with LLMs and SLMs, validate their performance and integrate them into our systems?

If so, the Bing Platform Team in Microsoft AI might be an excellent place for you to grow your career.

Our team is central to the efforts in Microsoft AI to enable data annotation through AI (LLMs and SLMs) and large, diverse, worldwide set of labelers for human in the loop. We plan to scale our platform 20X to be able to accommodate expected model inference cost reductions and increased model capacity availability.

We are seeking a highly skilled and motivated Senior Applied Scientist to join us as we continue to embark on this exciting work!

The ideal candidate will have hands-on experience in Deep Learning, Machine Learning and Generative Large Language Models.

In this role you will be responsible for developing a platform that will optimize and produce SLMs based on the labels from LLMs and human annotations. To optimize costs and quality, we expect many teams within Bing and Microsoft AI to go through this process of producing SLMs and we want to provide a platform that enables this easily.

You will be responsible for developing prompts, introducing new features / capabilities, and enabling groundbreaking scenarios. Come play at the absolute cutting edge of artificial intelligence. You will find engineering challenges around big data and will have the opportunity to work with world class data scientists. You will work across our stack, from our public-facing React-based UX, to our Azure-hosted backend, analyzing data with the latest available tools. You will impact the latest products across Microsoft AI, used by billions of people.

Responsibilities

• Evaluate the performance of new LLM and SLM models through rigorous testing and analysis.

• Validate the accuracy, efficiency, and reliability of these models in various applications.

• Collaborate with cross-functional teams to integrate validated models into production systems.

• Analyze model outputs and provide detailed reports on performance metrics.

• Stay up to date with the latest advancements in AI, including reinforcement learning, and data analytics.

• Incorporate best practices into the evaluation process.

• Troubleshoot and resolve issues related to model performance and integration

Qualifications

Required Qualifications

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

• OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)

• OR equivalent experience

• 1+ year(s) experience developing and deploying live production systems, as part of a product team.

Preferred Qualifications

• 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).

• Experience presenting at conferences or other events in the outside research/industry community as an invited speaker.

• 3+ years experience conducting research as part of a research program (in academic or industry settings).

• 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.

• Software engineering background with experience in writing robust and maintainable production code.

• Familiarity with machine learning frameworks and libraries (e.g., Tensorflow, PyTorch)

• Knowledge of model deployment and integration in production environments

• Familiarity with cloud platforms and services (e.g., Azure, AWS)

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until October 9, 2024.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .