Were cavemen religious?

Yes. Even "prehumans" believed in an afterlife according to anthropologists. That is the reason they not only bothered to bury their dead, but in a manner displaying respect. Also, they typically buried their dead with implements like spears, jewelery and things they imagined might be needed by the deceased in the afterlife.