Palmdale Sheriff Frank Dowler chased Perry out of Claifornia