The int upgrade is huge. It does suck to lose an amazing 4pc, but the overall stat upgrade does even it out. As for raid finder gear, I wouldn't wouldn't worry about wearing it until you gain 4pc for a sheer increase in stats if you are using normal T12.
If you are grabbing normal t13, then I would go to 2pc first without dropping any T12 to ruin the 4pc. The 2pc is nice mainly because of how much damage floats around in DS. If you end up working in Hardmode, you'll definitely want to grab ahold of the 2pc T13.