It can be quite nerve-wracking riding in groups, but it depends how scared you are riding on your own in the first place. To be honest, I find it easier riding in a group on the track, than riding on your own in a group on the road because generally you know exactly where you’re going!
On the road you may not know what’s coming up next. On a track you can just focus on the bunch rather than having to be aware of the change of terrain, taking corners, whatever it might be. There are no things like road furniture to consider, or anything like that!