Well I figured out what it was. It was one of those things that just make you feel all stupid.
The problem was my wireless mouse. The receiver had slipped behind my desk and had worked it's way farther and farther away from the mouse. That caused the mouse to slowly stop working or start working intermittently.
@Joe, let us know how the new version of Ubuntu works for you.