Zakaat

Doubting after Discharging the Zakaat

Q: Recently I went for Haj Alhamdulillah. I had taken my zakaat money with me to distribute to the poor in Makkah and Medinah. I had given the zakaat to the cleaners of the Haram in Makkah & Medinah. Someone told me that the cleaners collect a lot of money from others whilst others informed me that they are poor. I am not sure which category do they fall under. Please let me know if my zakaat will be fulfilled or do I need to re-take out zakaat?