Former Baptist church pastor drops appeal in sex case