It also depends upon whether you want new or used, or whether you are capable of (and have temporary access to other test equipment) fixing broken stuff.
For new, you could take a look at Rigol's stuff. Here in the USA, Tequipment.net advertises a nice starter set of four pieces (scope, power supply, multimeter and function generator) for about $1,500 USD.
For used (or broken), eBay has mountains of stuff in all conditions and price ranges. I enjoy fixing stuff, and have been pretty successful buying on eBay so far, and with careful shopping, I wouldn't have too much trouble buying a scope, power supply, DMM and function generator for less than $500 total.