Is bicycle a feminine word in french?

No, "bicycle" (vélo in French) is not a feminine word. It is a masculine noun.

Here's how you would use it in a sentence:

* J'ai un vélo rouge. (I have a red bicycle.)