However, you could use a general collective noun like:
* Group of hermits
* Community of hermits
* Assembly of hermits
Or, you could be more descriptive and use a noun that reflects their solitary nature:
* Solitude of hermits
* Recluse of hermits
Ultimately, the best choice depends on the context and the specific image you're trying to convey.