How bad does this scare you? Does it at all

It doesn't scare me, it gives me wonder. There is such a vast collection of things that most of the human race are unable to wrap their minds about, or at least have difficulty in doing so. But we shouldn't be scared of the things we don't understand or don't have all the details on. Of course time is a man-made concept. Where I am right now, it's a certain time and somewhere across the world is another time. We've created 'time' for us so we can go our life with a more of a structured schedule. If we were to be put our individual self in the middle of space, we would have no concept of time because of the obvious reasons. There wouldn't be night or day, everything simply would 'be'. The fact that we are consciously moving with time at all moments, is simply how things 'work' and it shouldn't cause a panic. It's a interesting topic to think and ponder about, and create different views on but I don't think it should be viewed as something to fear.

@Mark P. You are not the only one on YA. Please do not put down others, but make your own point. I do see you have learned a lot of formulas and now are saturated. Do take some rest until you catch up with our world again. You do owe Joseph an apology since we are not JOKERS. You owe the Asker of this question an apology. And please read the other answers, since they are pertinent.
Relative to us at any given moment, time progresses smoothly and at the same pace.
Time is not a "man made concept" at all. Time exists and existed since the "dawn of time". All man has done is devise methods of tracking it! I think man has done very well in that respect.
You said it... one would never know whether there is a deeper truth.
Who cares! Time works OK.

@Al Bart and @Mark P. are saturated and cannot grasp higher concepts, so they use foul words and stop normal progress of ideas in YA and force their own bunch of stereo type formulas into it. Formulas are not wrong for Great Physicists framed them, but misuse to disprove observed astronomy is found to hinder progress in science.