I still do and it's addicting! I'm actually running HG right now. It makes the games much more fun and raises the stakes. You'll even be caught by surprise at how useful pokemon you least expected are.
As for avoiding battles, you really don't want to as you'll need the EXP so you don't get wiped by the next important trainer (gym, rival, etc.)