Would a boyfriend blazer look odd if worn for a casual outing?

No, when paired with the right pieces blazers look great casual or dressed up! T-shirts and jeans w/flats or tops/skirts or dresses and heels. Blazers are great staple pieces!