What does baton de colle mean?

It literally translates to "stick of glue".

So, if you see "baton de colle" on a product label, you know it's a glue stick!