Are there bacteria that have RNA instead of DNA

I know it happens with viruses, that the ones that have RNA instead are called Retrovirus.
I wonder if there are "retro-bacteria" or something like that.

No. All cells, both prokaryotic and eukaryotic use DNA for their genomes, and RNA to express those genomes.