Why do bullets have steel cores?

Many munitions feature a steel core in their bullets construction, and many attribute the main reason for that being armor penetration, However thats not always the case. Also while on the topic why not go into bimetal jackets?