Voice chat

The ps4 is frustrating me at the moment.  I didn't play on the ps3 so I don't know if it is just a ps4 thing or playstation issue in general, but I am having a terrible time with voice chat.  On the xbox I usually stayed in party chat because it was with friends and the randoms we're loud and obnoxious, but occasionaly you met some decent people.  So far on the ps4 I have literally heard maybe half a dozen people talk...either which is mind blowing to me.  Either people don't use headsets or they saty in parties I'm not sure which. 

I tried a party the other day...with KamakazeTaco I think...and another person on my friends list....it just didn't work.  I either couldn't hear him and don't know if he heard me at that point, but I know my other friend and I had no luck either.  When we got into a firesquad later on in the Destiny Beta I could hear Taco, but even with the correct settings chat was coming through the tv and I had to put the headset to all audio which made it difficult to hear what was being said.  With no slider between voice and chat it kind of sucked.  (I'm using a plantronics headset with a 2.5 adapter...I can't use regular gaming headsets as they give me headaches)

Is anyone else having issues with the voice chat?  I'm not happy with the xbox one's party system yet since they jacked it up from the 360, but even it seems to work better then this.  Any ideas on how I may fix this?