Shouldn't they be worried about Choujuu Gigaku as well?

Choujuu Gigaku is just another band. That's fine.
The DDC girls are much, much closer to the Prismrivers in concept.

That's kind of what Merlin is saying. Surely, we'll eventually have some kind of "Battle of the Bands" between the 3 of them soon.