Assuming that I don't know anyone on both tracks, for me it's more like, "I don't see no lever."
Because I don't want to take the responsibility of changing anyone's fate. Like maybe that one guy over there was lucky enough to be there meanwhile the the 5 on the other track, the train is already hurtling towards you might as well let it be that way. For people saying "oh but you are in the position to save 5 lives over 1." No I am not. I am just a bystander. But if I touch that lever I will be a killer of one, not a savior of 5 guys.