*IF* it IS the police, and you work alone, then you have nothing to worry about, you're not breaking any laws. However, while you were away, perhaps someone tried to break in and the neighbours called the police, or something else involving a criminal on/near your property.
If it's not the police, then yes, it's someone playing silly buggers.