On Season Two's commentary they said Adam was written out because the writers couldn't find anything to do with the character. Any way to progress his storyline.
I think they made the right choice. Jeremy Piven is the bomb and I fell in love with him when he joined this show. He was so much more interesting than Arye Gross and had much more chemistry with Ellen. Piven would have chemistry with a brick wall though.