The effort to avoid a future environmental calamity here, at the most polluted site in North America, is a priority of the Energy Dept. but has foundered because of engineering mistakes and runaway costs. 53 million gallons of radioactive sludge, most of it the texture of ketchup, is stored in scores of underground tanks some of which has leaked.