Benchmarking Real-Time Voice Cloning on Consumer Apple Silicon: A Practical Evaluation of GPT-SoVITS on M-Series Hardware

Key Points

• This research aims to benchmark the GPT-SoVITS text-to-speech system on Apple Silicon hardware, identifying key performance metrics and issues.
• Conducted benchmarking of GPT-SoVITS on consumer Apple Silicon.
• Resolved seven platform incompatibilities including float16 precision errors.
• Fine-tuned a voice model using 37 minutes of speech data in approximately 70 minutes.
• Measured end-to-end latency for real-time voice generation.
• Achieved 1.5-second end-to-end latency for real-time voice agent.
• Identified and fixed critical compatibility issues.
• Demonstrated practical performance capabilities on MacBook Pro M4 Pro.

Abstract