This is somewhat true and/or debatable.
Endgame raid dps is a function of bringing the right debuffs, which is typically easier and/or more common for physical dps.
If you actually coordinated a group of casters using a single element (probably cold) and brought all the right debuffs you could get similar results.