Single-post Template for one category

I currently have a template for my posts (single-post). I would like to create a custom template for a specific category. Is that possible? So single-post-category-x.

I think you can not do this for single categories, right?

(Post-Type is known to me. But I would like to do it without new post-type. That brings too many problems).