You can also use the gender-neutral term fisher to refer to someone who fishes, regardless of gender.