Applied Sciences INTERN

Описание

Microsoft Teams is the hub for teamwork that integrates all the people, content, and tools your team needs to be more engaged and effective. It is core to Microsoft’s modern work, modern life & modern education value prop. We are reinventing the way people communicate and work together across the globe.

We are looking to hire a PhD (or published MSc) candidate for a part-time internship to join CMD Labs – an applied science team within Microsoft Teams – to work on improving collaborative agents by applying existing or novel research. Our flagship AI application for Teams is the Copilot agent that works in multi-party collaborative settings (meetings, group chats, channels) and enables groups of humans and agents to more efficiently achieve their shared goals. While most human/agent interactions are textual, within live Teams meetings the agent also interacts in real time via speech. Unlike personal agents (both audio and text), multi-party collaborative agents are faced with significant challenges in implicit context understanding, proactivity, and conversational capabilities.

The intern will be onboarded to our current research directions, and to our non-confidential datasets and related code, and work on improving the existing algorithms as well as proposing novel solutions, in any of the following topics:

• Training/fine-tuning speech-enabled models (e.g. Qwen-omni-8) to support speech in multi-party settings such as business meetings.
• Improve and devise new methodologies for evaluation of audio/text collaborative agents.
• Improve and devise better RL recipes for training/fine-tuning collaborative models including synthetic data generation, and the development and calibration of graders.
• Given substantial scientific novelty of the approach and results, collaboration on a mutual publication is encouraged.

Responsibilities

• Conduct experiments, create and validate metrics, and develop candidate algorithms to improve the existing capabilities of current models and agent implementations in any of the above topics.
• Collaborate closely with CMD Labs researchers and engineers to leverage existing assets, datasets, and ensure results can contribute to the product.
• Embody our culture and values.

Requirements

• Currently enrolled in a PhD program (or published candidate in MSc program) in Computer Science, Electrical or Computer Engineering, Statistics, or a related field.
• Practical experience in training, fine-tuning, and prompt engineering of transformer models or LLMs.
• Practical Python coding experience leveraging modern coding agents.

Nice to have

• Field of research and publications directly related to Audio LLMs or collaborative models and agents.

We offer

• Part-time employment.
• Work site 2 days / week in-office.
• Travel Less than 25%.