I think it would be a nice feature if the replay could preview both teams on the map at the same time. one team in blue and the other in red. It would then be possible to track the movement of each team, where they placed rally points, what their momentum was. I see potential in this for content creators who would analyze the play of both teams or just for yourself if you wondered why you lost and how the enemy team was playing.
Currently, it is possible but quite inconvenient, you have to switch between the spectated player from one and the other team alternately. My suggestion is to merge it up.