This may sound crazy, but why not have a few direct words with your ghost? Standing up for yourself often works with the living, so it might work on a ghost just as well. You could say something like this....
"Dear ghost: Look, we live here, and we have every right to be here, so this is the bottom line. We let you go about your business in peace, and you do the exact same for us. No more harassment, no more menacing behaviour, no more nasty actions of any kind. We can make your life more difficult than you can make ours (ghosts can't hurt the living), so don't p*ss me off. You're more than welcome to hang out here rent-free as long as you like, but no more crap. I don't put up with that from the living, and I'm not putting up with it from you. Make your choice and make it now, because this is the only warning you'll get."
I'm not kidding, try that. Some people will only respect you if you refuse to take any sh*t from them, and that's what kind of person you might be dealing with in this ghost. In my (very limited) experience with ghosts, they actually respond better if you treat them like people instead of freakish abominations of nature. While you're laying down the law, you're also giving the ghost the same respect you'd give a living person.
Give it a try and see what happens. It won't cost anything, and it just might work.