
This implies that the speaker is either hiding out somewhere, or new to a city. In either case, he doesn't dare go beyond his immediate surroundings, except in little spurts when he musters enough courage, and, according to the context, he did this a few times.