This is Matthew Henry’s commentary on Jeremiah 2:13.
There is in Him an all-sufficiency of grace and strength; all our springs are in Him and our streams from him; to forsake Him is, in effect, to deny this. He has been to us a bountiful benefactor, a fountain of living waters, overflowing, ever flowing, in the gifts of his favor; to forsake Him is to refuse to acknowledge His kindness and to withhold that tribute of love and praise which His kindness calls for.
Those who forsake Him cheat themselves, they forsook their own mercies, but it was for lying vanities. They took a great deal of pains to hew themselves out cisterns, to dig pits or pools in the earth or rock which they would carry water to, or which should receive the rain; but they proved broken cisterns, false at the bottom, so that they could hold no water. When they came to quench their thirst there they found nothing but mud and mire, and the filthy sediments of a standing lake. Such idols were to their worshippers, and such a change did those experience who turned from God to them.
If we make an idol of any creature – wealth, or pleasure, or honor, if we place our happiness in it, and promise ourselves the comfort and satisfaction in it which are to be had in God only, if we make it our joy and love, our hope and confidence, we shall find it a cistern, which we take a great deal of pains to hew out and fill, and at the best it will hold but a little water, and that dead and flat, and soon corrupting and becoming nauseous. No, it is a broken cistern, which cracks and cleaves in hot weather, so that the water is lost when we have most need of it. Let us therefore with purpose of heart cleave to the Lord only, for where else shall we go? He has the words of eternal life.