Simple solution to this whole affair.
Multiclass characters who want a skill respec only get the skill points their original (level1) class gets. Using
the INT that you started with.
Pure characters get the skill points they would normally get, using the INT that they started with.
If a skill respec is that important to you then you'll take the hit on the numbers...