Skill UI

A comprehensive SDK for building real-time, bidirectional voice AI applications using Azure AI services within the .NET framework. This library facilitates seamless voice interactions, supporting WebSocket communication, advanced features like function calling, and handling audio/text streaming events for developing sophisticated virtual assistants.

The Azure AI VoiceLive SDK for Java enables real-time, bidirectional voice conversations with AI assistants. Using WebSocket technology, this SDK supports low-latency streaming, advanced features like turn detection, noise reduction, and customizable voice selection (OpenAI/Azure). It is ideal for developers building sophisticated voice bots or interactive voice applications in Java.

This SDK enables the development of real-time, conversational AI applications using Azure Cognitive Services. It supports bidirectional communication via WebSockets, allowing for continuous audio streaming (mic input) and receiving synthesized speech output. Ideal for building voice assistants, IVR systems, and interactive voice experiences.

This SDK provides a comprehensive interface for building real-time, bidirectional voice AI applications using Azure AI services. It supports streaming audio input/output via WebSocket, handling transcription, text-to-speech, and complex session management. Ideal for developing robust voice assistants and interactive AI agents in both Node.js and modern browser environments.

Addresses the critical challenge of managing extremely long conversation histories (millions of tokens) in advanced AI agents, such as coding assistants. This technique moves beyond simple token minimization by implementing structured compression strategies (like Anchored Iterative Summarization) to prevent the loss of critical technical details—such as file paths, decisions, and error messages—ensuring the agent maintains functional context across complex, multi-step tasks. It emphasizes optimizing for 'tokens-per-task' rather than just tokens-per-request.

This skill provides capabilities for bidirectional audio processing using fal.ai models. It supports Text-to-Speech (TTS), converting written text into natural-sounding speech, and Speech-to-Text (STT), accurately transcribing spoken audio into readable text. Use this skill for applications requiring high-quality audio input analysis or synthetic voice generation, such as virtual assistants, content digitization, or multilingual communication tools.

Automated guidance for hyperparameter tuning within ML training workflows, offering best practices, production-ready code, and validation across modeling stages like data prep, training, and experiment tracking.

LLaVA is an open-source vision-language assistant pairing CLIP vision encoders with Vicuna/LLaMA models to power multimodal chatbots, multi-turn image Q&A, captioning, and instruction-following tasks.

This skill guides users through the entire lifecycle of developing intelligent AI assistants, chatbots, and conversational interfaces. It specializes in establishing robust natural language understanding, managing multi-turn context, and defining best practices for creating seamless, production-ready AI applications with real-world value.

Automated guidance for model explainability tooling within ML training workflows, giving step-by-step best practices, production-ready code, and validation for experiments whenever users mention explainability tool needs.

Assists with tensorboard visualizer tasks for ML training by guiding setup, best practices, and experiment tracking whenever tensorboard visualization is mentioned, producing production-ready configs and validated outputs.

This skill outlines security best practices for the TwinMind AI meeting assistant. It covers crucial aspects like on-device audio processing, encrypted cloud backups, and managing microphone permissions. Use it when setting up new TwinMind instances or managing AI operations to ensure data privacy, compliance, and robust security for sensitive meeting data.