Midges, those aggravating little flies can turn your outdoor fun into a miserable experience. Their stings are painful and their swarms can be overwhelming. But don't worry! There are ways toget rid of them for good. First, try eliminating their breeding grounds.. Midges love standing water, so empty any containers that collect water frequently.