Yes they would struggle, but eventually they would adapt.

If everything but plants disappeared tomorrow, many plants would die but some would survive and adapt.

If everything but fungi disappeared tomorrow, they would all die out.

Same with animals.

Bacteria would survive like plants would, with most of them dying but many surviving and adapting.