Skill UI

This skill analyzes a recorded video of a manual, repetitive process. It extracts visual frames and transcribes audio narration to reconstruct the step-by-step workflow, identifying applications used, data flow, and pain points. Based on a detailed understanding of the process, the assistant proposes targeted, working automation scripts using tools already available on the user's machine.

Process videos, audio, images, and documents on Transloadit’s cloud using 86+ robots to encode formats, generate thumbnails, resize/watermark, run OCR, speech-to-text, moderation, and chain multi-step pipelines for scalable media automation.

Utilize advanced media intelligence to analyze audio, image, video, and text for synthetic manipulation and AI-generated content. This skill detects deepfakes, traces the original AI synthesis source, applies and detects watermarks, verifies speaker identity, and provides comprehensive media provenance analysis, ensuring media authenticity claims are rigorously supported.

Load Hugging Face Hub models, run pipeline inference, generate text, and fine-tune with the Trainer API across NLP, vision, audio, and multimodal tasks using Python and PyTorch.

Implement professional text-to-speech generation and advanced voice cloning using the ElevenLabs API. This comprehensive workflow supports standard text-to-speech conversion, advanced voice customization (stability, similarity boost), and instant voice cloning from audio samples. It also includes WebSocket streaming for real-time applications like chatbots or live narration, making it ideal for building sophisticated, high-quality audio features.

This guide provides comprehensive techniques for optimizing ElevenLabs Text-to-Speech (TTS) performance. Learn how to reduce latency and maximize throughput by strategically selecting models (e.g., Flash vs. v3), implementing streaming endpoints (HTTP or WebSocket), and choosing optimal audio formats. It is essential for real-time conversational AI, IVR systems, and high-volume content generation.

This workflow provides comprehensive audio processing capabilities, covering both real-time streaming transcription (for live captions and voice agents) and advanced post-processing using LeMUR. Use it for summarizing long meetings, answering questions based on transcripts, extracting action items, and running custom LLM analyses on recorded audio.

This skill provides a comprehensive guide to optimizing costs when using AssemblyAI for speech-to-text transcription. It details model selection (Best vs. Nano), guides feature budgeting (e.g., Diarization, Sentiment Analysis), and includes code examples for cost estimation and usage tracking. Use this when managing billing, reducing operational expenses, or implementing budget alerts for high-volume audio processing.

A comprehensive troubleshooting guide for Abridge clinical documentation integration. Covers common errors in authentication, EHR connectivity, audio streaming, note generation, and FHIR validation. Essential for developers and technical users debugging AI-powered clinical workflows.

This workflow implements Abridge's end-to-end clinical documentation pipeline. It captures ambient audio from patient encounters, performs real-time transcription, utilizes generative AI to structure the medical notes (e.g., SOAP, H&P), generates required medical codes (ICD-10, CPT), and finally inserts the structured data directly into the EHR system. Designed for primary clinical encounters, minimizing manual charting time.

Provides structured methods and code examples to optimize Abridge's clinical AI integration for high-volume, enterprise deployments. Focuses on reducing critical latencies across the entire workflow, including audio streaming throughput, note generation pipelines, and secure FHIR push operations, ensuring scalability for large health systems.

Provides a comprehensive architectural blueprint for integrating ambient AI solutions (Abridge) into multi-site health systems. It guides the full process from ambient audio capture to structured note generation, covering data flow, component design, FHIR R4 standards, HIPAA compliance, and integration patterns with major EHRs like Epic and Athena.