Wholesale is where you will get the best value on new items. As a general rule, the more you spend on product, the more you save on cost. That said, having a very limited budget will make it difficult isn't going to help you with wholesale. You're really going to need money behind you to move into wholesale.
A lot of wholesalers will offer a tier system, so spend X and get Y discount, the problem is that many with limited budgets come in on the lowest tier because that's all they can afford, but just because that's wholesale buying, doesn't automatically mean it will be enough to allow you to compete. The problem is, while it may give you a better price than dropshipping will, but if you have buyers coming in over the top of you and purchasing from the top tier and securing greater discounts, then they have the drop on you if they are in your market place.
So even buying wholesale, you can still find yourself out of the market and then with a load of stock that you can't move.
So wholesale has its pitfalls if you're not careful.
Rhea's advice of kicking it off with things from around the house is a good idea and it saves your budget as well. If you're struggling finding things you want to sell from around the house, then maybe consider hitting a few garage (yard) sales in your area and seeing what sort of deals you can find there. Never under estimate the second hand market on eBay, it's huge, always has been and the place is crawling with collectors of all sorts of things just looking for deals.
You need to have a good eye and you need to be able to talk a good deal, but if you can combine those two things, then you can take a very little amount of money and make it a very large amount of money with just a little bit of effort :)