You can't keep a good Kesha down.

Up until this week, the "We R Who We R" singer was scheduled to perform at Sunday's 2016 Billboard Music Awards — that is, until Dr. Luke's Kemosabe Records rescinded their approval of the performance following media reports that she'd be directly referencing her ongoing legal battle with Dr. Luke in her performance. She denied this was the case on Instagram afterward, saying that it was, in fact, going to be a Bob Dylan tribute.

Despite the BBMAs block, Kesha ultimately went on to perform the song — at a Ben Folds concert last night (May 18) in Los Angeles.

During the encore of his show at the Orpheum Theatre in LA, Ben brought out Kesha to perform a stunning rendition of Bob Dylan's "It Ain't Me Babe," which you can watch above.

And the two didn't stop there.

Together, they sang Folds' own "Still Fighting It," as well as a totally silly mash-up of his "Rock This Bitch" and Kesha's own "Sleazy," which Folds previously covered years ago. The two riffed back and forth to each other, and the result was charmingly cute and messy. (By the end, they had the whole crowd loudly chanting "circle jerk it!")

"dear Mr. ben folds, thank u for tonight. thanks for letting me share your stage, your band, your audience, your humor, your songs. thanks for believing in me...thanks for letting me play a Bob Dylan cover with you. thanKs for being a good friend in this scary business," Kesha later wrote on her Instagram in an extended thank you to the singer-songwriter.

Check out the rest of the duo's performances below.

Kesha's Best Live Vocals