I had a problem much like yours on a similar machine (also Dimension 2350). I solved the problem by removing a jumper and leaving it out. If your motherboard is similar to mine, I removed one jumper at the edge of the motherboard near the bottom, that connected only two pins.
The jumpers will be the little black devices that connect pins on the motherboard together.
I hope this helps you resolve your issue.