Low VRAM Usage

Originally required huge VRAM to run this, but with the latest update you can now use this with low VRAM (I'm sure it works with around 12GB but could even work on lower VRAM, please test and report)

Generated this 30 second audio in 50 seconds on A4500.

The

Prompt:

He raps "His palms are sweaty, knees weak, arms are heavy
There's vomit on his sweater already, mom's spaghetti
He's nervous, but on the surface, he looks calm and ready
To drop bombs, but he keeps on forgetting
What he wrote down, the whole crowd goes so loud
He opens his mouth, but the words won't come out
He's chokin', how? Everybody's jokin' now
The clock's run out, time's up, over, blaow
Snap back to reality, ope, there goes gravity"