A Penn Yan man indicted for sexual exploitation of a child led police on a foot chase Wednesday that culminated in his arrest.