i can't hear the diff tween two and too, but i can hear it between to and too which is why it bothers me. cuz there's an obvious difference between too and to. ok maybe not so obvious but i hear differences in everything.
You may just be right there,
though I presume that different
regions might not have those
differences. There's often a
shortening of 'to', sometimes
so extreme as t'eliminate the
vowel sound entirely.